Smart Crawler

Scan websites for missing pages, slow loading times, errors in links and more. Lets you input a site and follows links around your website. Notifies you when the crawler is done crawling. Watch the crawler move through your pages and see information about the pages visited in real time. Allows you to configure the crawler to follow or ignore hashes, querys, links to other domains, links on the same domain, delay between requests, and user agent. Export results in an easy-to-read HTML file to see where you're linking to dead pages or what is missing on your website!