robots.txt blocks Meta-ExternalAgent (Meta AI / Llama training)
Meta-ExternalAgent is the crawler Meta uses to gather content for training its Llama AI models and powering Meta AI, the assistant built into WhatsApp, Instagram and Facebook. This check found robots.txt disallowing Meta-ExternalAgent. That block applies across the board, so none of Meta's AI products can currently draw on your pages. Meta AI lives directly inside WhatsApp chats, Instagram DMs and Facebook, giving it a huge, habitual audience that asks it questions the way they'd ask a friend. Blocking Meta-ExternalAgent removes your content from all of those answer surfaces, which matters especially for consumer-facing businesses whose customers are already active on Meta's platforms. Your developer needs about 5 minutes. Add an allow rule for Meta-ExternalAgent in robots.txt, unless you're deliberately opting out of Llama training, in which case document that decision in your llms.txt file. Meta AI's reach through WhatsApp and Instagram makes this a higher-value fix than it might first appear for consumer-facing brands.
Why this matters
Meta AI lives directly inside WhatsApp chats, Instagram DMs and Facebook, giving it a huge, habitual audience that asks it questions the way they'd ask a friend. Blocking Meta-ExternalAgent removes your content from all of those answer surfaces, which matters especially for consumer-facing businesses whose customers are already active on Meta's platforms.
How to fix it
Your developer needs about 5 minutes. Add an allow rule for Meta-ExternalAgent in robots.txt, unless you're deliberately opting out of Llama training, in which case document that decision in your llms.txt file. Meta AI's reach through WhatsApp and Instagram makes this a higher-value fix than it might first appear for consumer-facing brands.