Site Audit, its crawler, and Rank Tracking.
Site Audit
Crawl a website, read what it finds, and how pages are counted.
The SemwiserSiteAudit crawler
What the crawler is, what it sends, and how to keep it out.
Rank Tracking
Daily Google positions for a website’s keywords.