No Last-Modified HTTP header
Your web server or CDN can include a "Last-Modified" date in its response headers to tell crawlers when your content was last changed. This header is currently missing. AI crawlers and search engines use this date to decide whether to re-crawl your content. Without it, they may treat your pages as stale and crawl them less often, reducing how quickly updates get picked up. Configure your server or CDN to send a Last-Modified header on every page response. Most hosting platforms (Cloudflare, Vercel, Nginx) have a setting or plugin for this that takes a few minutes to enable.
Why this matters
AI crawlers and search engines use this date to decide whether to re-crawl your content. Without it, they may treat your pages as stale and crawl them less often, reducing how quickly updates get picked up.
How to fix it
Configure your server or CDN to send a Last-Modified header on every page response. Most hosting platforms (Cloudflare, Vercel, Nginx) have a setting or plugin for this that takes a few minutes to enable.