Has llms.txt but no /llms-full.txt
The llms.txt convention (proposed in 2024) is a text file at the root of your website that gives AI systems a structured index of your site's most important pages. The companion /llms-full.txt includes the full text of those pages so AI tools can read your content directly without crawling each page. Without /llms-full.txt, AI tools that respect the llms.txt convention have to crawl each page individually to read your content. This is a forward-looking optimisation: as AI agents that support this convention become more common, having the full-text file in place means your content is easier to consume and reference accurately. Build on your existing llms.txt by creating an /llms-full.txt file that includes the complete text of your top pages in a readable format. Tools like the llms-txt-generator package can automate this, or your developer can create it manually.
Why this matters
Without /llms-full.txt, AI tools that respect the llms.txt convention have to crawl each page individually to read your content. This is a forward-looking optimisation: as AI agents that support this convention become more common, having the full-text file in place means your content is easier to consume and reference accurately.
How to fix it
Build on your existing llms.txt by creating an /llms-full.txt file that includes the complete text of your top pages in a readable format. Tools like the llms-txt-generator package can automate this, or your developer can create it manually.