{"resource":"https://intel.rallylive.ca/monitor/robots-allowed","service":"crawl-allowed-check","areas":["web_search","ai_inference","travel"],"answering":true,"http_status":402,"latency_ms":81,"price_usdc":0.01,"buyers_30d":2,"calls_30d":3,"description":"Is a URL crawlable? Fetches the site's robots.txt and evaluates the given path for a specific user-agent (Googlebot, GPTBot, ClaudeBot, Bingbot or any token; default *), returning allowed/disallowed, the matching rule, the group used, crawl","id":"e09648d28372","category":"Web page readers and scrapers","accuracy":null,"tool_calls":null,"checked_day":"2026-10-11","page":"https://velliumandco.com/sellers/e09648d28372"}