Description: Dirpy is an open-source web crawler and web scraper software. It allows users to efficiently crawl websites and extract data from web pages. Key features include recursive crawling, export of scraped data to CSV/JSON, handling of Javascript-heavy sites, and customization of crawling behavior.
Type: software
Pricing: Open Source
Description: HTTP Toolkit is an open-source web debugging proxy and HTTP inspection tool. It allows developers to intercept, inspect, and modify HTTP requests and responses as they pass between a browser or application and the server.
Type: software
Pricing: Open Source