No /llms.txt file - AI agents cannot quickly map your site
The /llms.txt file is a proposed convention (similar in spirit to robots.txt) that tells AI assistants - like ChatGPT, Claude, and Perplexity - which pages on your site are most important and how your content is structured. Without it, AI tools have to guess. AI search tools are increasingly how people find businesses, but llms.txt is not how those tools find you. Google stated on the record in July 2025 that it does not support llms.txt and has no plans to, OpenAI's crawler documentation controls its bots through robots.txt and never mentions the file, and large-scale crawler-log analysis finds GPTBot, ClaudeBot and PerplexityBot almost never request it. Adopt it as a cheap early-mover bet if the convention gains traction, not as a way to get cited. What demonstrably governs whether an AI engine can use your page is structured data, crawler permissions in robots.txt, and content that is readable without JavaScript. Create a plain text file at yourwebsite.com/llms.txt listing your most important pages with a brief description of each. The llmstxt.org site provides a specification and example templates. Your developer can set this up in under an hour.
Why this matters
AI search tools are increasingly how people find businesses, but llms.txt is not how those tools find you. Google stated on the record in July 2025 that it does not support llms.txt and has no plans to, OpenAI's crawler documentation controls its bots through robots.txt and never mentions the file, and large-scale crawler-log analysis finds GPTBot, ClaudeBot and PerplexityBot almost never request it. Adopt it as a cheap early-mover bet if the convention gains traction, not as a way to get cited. What demonstrably governs whether an AI engine can use your page is structured data, crawler permissions in robots.txt, and content that is readable without JavaScript.
How to fix it
Create a plain text file at yourwebsite.com/llms.txt listing your most important pages with a brief description of each. The llmstxt.org site provides a specification and example templates. Your developer can set this up in under an hour.