
Description: Apache Nutch is an open source web crawler software project written in Java. It is used to build web search engines and web archiving systems. Nutch can crawl websites and index page content and metadata.
Type: Open Source Test Automation Framework
Founded: 2011
Primary Use: Mobile app testing automation
Supported Platforms: iOS, Android, Windows

Description: Crawlbase is a website crawler and scraper that allows you to extract data from websites. It has a simple interface for creating crawling jobs and lets you scrape content into CSV files or databases.
Type: Cloud-based Test Automation Platform
Founded: 2015
Primary Use: Web, mobile, and API testing
Supported Platforms: Web, iOS, Android, API