Skip to content

robots.txt blocks Applebot-Extended (Apple Intelligence training)

Applebot-Extended is the crawler Apple uses to gather training data for Apple Intelligence, the AI features built into iPhones and iPads running iOS 18 and later. It's separate from the regular Applebot that powers Siri and Spotlight search. This check found robots.txt disallowing Applebot-Extended, so Apple's AI systems are told not to read your content. Apple Intelligence runs on roughly 1.5 billion active iOS 18+ devices. Blocking Applebot-Extended means none of that content or training pipeline can draw on your site, so your business is structurally absent from a very large pool of AI-assisted answers on Apple devices, unless you've deliberately chosen to opt out of AI training. Your developer needs about 5 minutes. Add an allow rule for Applebot-Extended in robots.txt, unless you have a considered policy of opting out of AI training, in which case leave the block in place and note the decision on your llms.txt file or About page so the choice is documented rather than accidental.

Why this matters

Apple Intelligence runs on roughly 1.5 billion active iOS 18+ devices. Blocking Applebot-Extended means none of that content or training pipeline can draw on your site, so your business is structurally absent from a very large pool of AI-assisted answers on Apple devices, unless you've deliberately chosen to opt out of AI training.

How to fix it

Your developer needs about 5 minutes. Add an allow rule for Applebot-Extended in robots.txt, unless you have a considered policy of opting out of AI training, in which case leave the block in place and note the decision on your llms.txt file or About page so the choice is documented rather than accidental.