An Eight-Week Analysis of Accept-Language Headers Across Major AI Bots

An Eight-Week Analysis of Accept-Language Headers Across Major AI Bots

I logged the Accept-Language header on 51,884 verified AI-bot requests over eight weeks. There is no shared convention. Most training crawlers (GPTBot, ClaudeBot, Applebot, Bingbot, Amazonbot) send nothing. Googlebot sends a bare *. Claude-Web sends a hardcoded en-US,en;q=0.9. Only the live fetchers, ChatGPT-User and part of PerplexityBot, send real quality lists, and those values leak the locale of the human who triggered the fetch. The practical upshot: on a multi-locale site, your default-loc...

Original Source

Read the full article at Hackernoon →

KhanList aggregates and links to publicly available news content. We do not host full articles from third-party sources. Always verify important information with original sources.