{"resource":"https://intel.rallylive.ca/site/robots","service":"robots-txt-parser","areas":["web_search"],"answering":true,"http_status":402,"latency_ms":47,"price_usdc":0.01,"buyers_30d":2,"calls_30d":2,"description":"robots.txt fetched and parsed: every user-agent group with its allow/disallow rules and crawl-delay, declared sitemaps, and whether the file exists at all. Understand a site's crawl policy before fetching it. $0.01 per site.","id":"43cbc4cbac0d","category":"Web page readers and scrapers","accuracy":null,"tool_calls":null,"checked_day":"2026-10-11","page":"https://velliumandco.com/sellers/43cbc4cbac0d"}