Skip to content

No Content-Signal directive in robots.txt

Content-Signal is an emerging line you can add to robots.txt that explicitly tells AI systems whether they may use your pages for search, for live AI answers, or for training a model. This check found no Content-Signal directive anywhere in your robots.txt, meaning your intent is currently unstated rather than declared either way. Without an explicit Content-Signal line, AI crawlers have to guess your intent from other signals, and some platforms are starting to default to a more restrictive interpretation when nothing is declared. As of 2026, explicitly declaring Content-Signal is still rare enough that doing so puts you ahead of the vast majority of sites. Your developer needs about 10 minutes. Add a Content-Signal line to robots.txt under the User-agent: * group, for example: Content-Signal: search=yes, ai-input=yes, ai-train=yes, adjusting the values to match your actual AI visibility preferences. Review the values again if your stance on AI training or citation ever changes, since the directive should reflect current intent, not a one-time default.

Why this matters

Without an explicit Content-Signal line, AI crawlers have to guess your intent from other signals, and some platforms are starting to default to a more restrictive interpretation when nothing is declared. As of 2026, explicitly declaring Content-Signal is still rare enough that doing so puts you ahead of the vast majority of sites.

How to fix it

Your developer needs about 10 minutes. Add a Content-Signal line to robots.txt under the User-agent: * group, for example: Content-Signal: search=yes, ai-input=yes, ai-train=yes, adjusting the values to match your actual AI visibility preferences. Review the values again if your stance on AI training or citation ever changes, since the directive should reflect current intent, not a one-time default.