Description: Charles is an HTTP proxy / HTTP monitor / Reverse Proxy that enables a developer to view all of the HTTP and SSL / HTTPS traffic between their machine and the Internet. This includes requests, responses and the HTTP headers (which contain the cookies and caching information).
Type: software
Description: Dirpy is an open-source web crawler and web scraper software. It allows users to efficiently crawl websites and extract data from web pages. Key features include recursive crawling, export of scraped data to CSV/JSON, handling of Javascript-heavy sites, and customization of crawling behavior.
Type: software
Pricing: Open Source