Skip to content

No Content-Signal preference declared in robots.txt

Content Signals are a Cloudflare-documented mechanism for declaring preferences for search indexing, real-time AI input, and AI training. This check found no Content-Signal directive in robots.txt.

Why this matters

Absence is not a failure and does not mean AI providers will default to blocking the site. Under Cloudflare's Content Signals policy, an omitted signal means the publisher neither grants nor restricts that use through Content Signals. Provider-specific robots.txt controls remain separate.

How to fix it

No change is required. Add Content Signals only if you want to make an explicit policy declaration and have reviewed what each value means. Continue to manage provider-specific crawlers separately where needed.

Turn website findings into an action plan

Create an account to start a Full Audit of your website, with supporting evidence and a prioritised action plan.

Start Full Audit