robots.txt blocks ClaudeBot (Anthropic training)
ClaudeBot is the crawler Anthropic uses to gather content that trains Claude and feeds its general knowledge of the web. This check found a robots.txt rule that disallows ClaudeBot across the whole site, so it can't read or learn from any of your pages. Claude is one of the most widely used AI assistants for enterprise and developer audiences. Blocking ClaudeBot removes your business from a meaningful share of the research people and companies do through AI before they ever visit a website directly, and it lowers the odds Claude will ever cite or recommend you. Your developer needs about 10 minutes. Remove the ClaudeBot Disallow rule for / (the whole site) in robots.txt, unless you have a specific and deliberate reason to keep Claude out. Fetch robots.txt directly afterwards to confirm the rule is gone, since a caching layer or CDN can sometimes keep serving the old version for a while.
Why this matters
Claude is one of the most widely used AI assistants for enterprise and developer audiences. Blocking ClaudeBot removes your business from a meaningful share of the research people and companies do through AI before they ever visit a website directly, and it lowers the odds Claude will ever cite or recommend you.
How to fix it
Your developer needs about 10 minutes. Remove the ClaudeBot Disallow rule for / (the whole site) in robots.txt, unless you have a specific and deliberate reason to keep Claude out. Fetch robots.txt directly afterwards to confirm the rule is gone, since a caching layer or CDN can sometimes keep serving the old version for a while.