Google adds llms.txt check to Chrome Lighthouse

Back to Devoured - May 21, 2026

DEVOURED

Google adds llms.txt check to Chrome Lighthouse

Google has integrated an llms.txt check into Chrome's Lighthouse audits under "Agentic Browsing" to control how LLMs interact with websites.

What: Google now includes an llms.txt check in Chrome's Lighthouse auditing tool, found within the "Agentic Browsing" category. This aims to provide webmasters with a mechanism, similar to robots.txt, to manage how large language models and other AI agents crawl and interact with their site content.

Why it matters: This development signals a growing recognition from Google of the need for web standards and controls specifically for AI agent interaction, addressing potential issues like unauthorized data scraping or unexpected bot behavior on websites.

Takeaway: If you develop websites, investigate how llms.txt works and consider implementing it to control AI agent access to your content as this standard gains traction.

Decoder

llms.txt: A proposed standard text file, similar to robots.txt, that website owners can use to specify rules for how Large Language Models (LLMs) and other AI agents should interact with their website content, such as crawling or data usage.* Lighthouse: An open-source, automated tool from Google for improving the quality of web pages, running audits for performance, accessibility, SEO, and more.* Agentic Browsing: A category within Google Lighthouse audits that pertains to how automated agents, like LLMs, interact with and process web content.

Original article

Google introduced an llms.txt check in Chrome's Lighthouse audits under the "Agentic Browsing" category to enhance machine interaction with websites.

Explore all 58 articles in today's digest