robots.txt sets a Crawl-delay that slows indexing on some search engines

robots.txt is a small file on your site that gives instructions to search engine crawlers. This check looks for a Crawl-delay instruction in it, which asks crawlers to wait a set number of seconds between requests. On this site, robots.txt declares a Crawl-delay value. Google ignores Crawl-delay completely, so it has no effect there, but Bing and Yandex do honour it, which means new and updated content on your site gets indexed more slowly on those search engines than it needs to. This matters most for time-sensitive updates, such as new products, price changes, or urgent announcements you want found quickly. You or your developer should remove the Crawl-delay line from robots.txt unless there is a specific reason your server needs to limit crawler load, which takes about ten minutes. If you do need to control crawl rate, do it properly through the crawl rate settings inside Google Search Console and Bing Webmaster Tools instead.