WebsiteDetective
Website Detective operates automated web crawlers that analyze publicly accessible websites to identify technologies, platforms, e-commerce systems, hosting infrastructure, SEO signals, performance metrics, and other publicly available characteristics. The data is used for research, analytics, and to power Website Detective's products and services, enabling users to better understand, benchmark, and optimize their web presence. We do not collect private, restricted, or authenticated content.
Our bots
WebsiteDetectiveBot Continuous, automated crawling
WebsiteDetectiveBot/0.1 (+https://website-detective.com/robot) WebsiteDetectiveResearch Specific studies & analyses
WebsiteDetectiveResearch/0.1 (+https://website-detective.com/robot) Block us in robots.txt
User-agent: WebsiteDetectiveBot
User-agent: WebsiteDetectiveResearch
Disallow: /