Description: Dirpy is an open-source web crawler and web scraper software. It allows users to efficiently crawl websites and extract data from web pages. Key features include recursive crawling, export of scraped data to CSV/JSON, handling of Javascript-heavy sites, and customization of crawling behavior.
Type: software
Pricing: Open Source
Description: Fiddler is a free web debugging proxy which logs all HTTP(S) traffic between your computer and the Internet. It allows developers to inspect traffic, set breakpoints, and fiddle with incoming or outgoing data. Fiddler can be used to debug traffic from virtually any application that supports a proxy like web browsers, mobile apps, IoT devices, and more.
Type: software