robots.txt blocks Bytespider (ByteDance/TikTok AI)

Bytespider is the web crawler operated by ByteDance, the company behind TikTok, to gather content for its AI products and TikTok's in-app AI features. This check found a robots.txt rule disallowing Bytespider, meaning your site has explicitly told this crawler to stay away. With Bytespider blocked, TikTok's AI-driven search and recommendation features can't draw on anything from your site. This is a meaningful gap for consumer brands chasing a younger audience, since a large share of that group now searches TikTok before using a traditional search engine, and your content simply isn't part of what TikTok's AI can surface to them. Your developer needs about 5 minutes. Add an explicit allow rule for Bytespider in robots.txt, unless you specifically don't want TikTok's AI referencing your content, for example for competitive or brand-safety reasons. Check the change by fetching robots.txt directly in a browser afterwards to confirm the new allow rule is live.