CCBot is the crawler used by Common Crawl to build its openly available web corpus. This check found robots.txt disallowing CCBot, so future Common Crawl collection through that crawler is restricted for the affected paths.
Why this matters
This is mainly a publisher choice about inclusion in an open web corpus. Common Crawl data can be used by many downstream researchers and model builders, but blocking CCBot does not by itself determine whether a specific commercial AI product can search, cite, or recommend the site.
How to fix it
No change is required if exclusion from Common Crawl is deliberate. If you want the site to be eligible for future Common Crawl collection, remove or narrow the CCBot Disallow rule.
Turn website findings into an action plan
Create an account to start a Full Audit of your website, with supporting evidence and a prioritised action plan.