All 7 major AI crawlers allowed in robots.txt by default policy (no explicit AI-bot rules)

Your robots.txt does not set explicit rules for every AI crawler, so some bots (OAI-SearchBot, Applebot-Extended, Meta-ExternalAgent) fall under your default catch-all rule rather than a named one. Today they are allowed, which is fine. The risk is future-proofing: if you ever tighten your default rule, you could accidentally block the AI crawlers you want, because they were never given explicit permission. Optional hardening — add explicit Allow blocks per AI bot in robots.txt (for example User-agent: GPTBot then Allow: /). That way your AI visibility cannot be broken by a later change to the catch-all rule.

Why this matters

Today they are allowed, which is fine. The risk is future-proofing: if you ever tighten your default rule, you could accidentally block the AI crawlers you want, because they were never given explicit permission.

How to fix it

Optional hardening — add explicit Allow blocks per AI bot in robots.txt (for example User-agent: GPTBot then Allow: /). That way your AI visibility cannot be broken by a later change to the catch-all rule.