Skip to content

robots.txt blocks GPTBot (OpenAI training)

GPTBot is the crawler OpenAI uses to gather content that trains ChatGPT's underlying models. This check found a robots.txt rule disallowing GPTBot, so none of your site's content can be used to teach ChatGPT what your business does or knows. ChatGPT handles a growing share of the research people do before choosing a product or service, including B2B buying decisions. Blocking GPTBot means ChatGPT never learns your content, which lowers the long-term likelihood it recommends or accurately describes your business when someone asks a relevant question. Your developer needs about 10 minutes. Remove the GPTBot Disallow rule for / (the whole site) in robots.txt, or if you want more control, set explicit Allow rules for your highest-value pages instead of a blanket block. Either approach removes the current blanket exclusion that's keeping ChatGPT's training pipeline out entirely.

Why this matters

ChatGPT handles a growing share of the research people do before choosing a product or service, including B2B buying decisions. Blocking GPTBot means ChatGPT never learns your content, which lowers the long-term likelihood it recommends or accurately describes your business when someone asks a relevant question.

How to fix it

Your developer needs about 10 minutes. Remove the GPTBot Disallow rule for / (the whole site) in robots.txt, or if you want more control, set explicit Allow rules for your highest-value pages instead of a blanket block. Either approach removes the current blanket exclusion that's keeping ChatGPT's training pipeline out entirely.