Description: GSiteCrawler is an open-source web crawler that allows you to index websites for searching or archiving purposes. It is customizable and extensible.
Type: software
Pricing: Open Source
Description: phpSitemapNG is an open source PHP script that generates XML sitemaps for websites. It crawl pages, extracts links and images, and creates a sitemap.xml file compliant with search engine guidelines.
Type: software
Pricing: Open Source