HomeSuman Dhami
AI Search

Do You Need an llms.txt File? What Google, OpenAI and Lighthouse Actually Say

6 min read·By Suman Dhami·
A document named llms.txt next to a question mark.

If you have followed AI search advice, you have seen both claims: Google says it does not use llms.txt, and Lighthouse checks for it. They sit on different pages for different products.

What does Google Search say about llms.txt?

Google's guidance on generative AI features says you do not need new machine-readable files, AI text files, markup or Markdown to appear in Google Search or its AI features. On llms.txt specifically, it says that adding one will neither harm nor help your visibility or rankings in Google Search, as Google Search ignores them.

Why does Lighthouse check for it?

Lighthouse is a Chrome auditing tool, not Google Search. Its llms.txt audit page, last updated on 5 May 2026, describes the file as an emerging convention for a machine-readable summary of a site, for LLMs and AI agents. It flags a page only if a server error occurs when fetching the file. If the file returns a 404, the audit is marked Not Applicable, because providing the file is optional at the moment. That is a tooling check for agent-friendly sites, not a statement about Search ranking.

Do AI platforms read it?

I checked the crawler and AI pages of OpenAI, Anthropic, Perplexity, Apple and Bing. None says its crawlers or answer systems read llms.txt on other sites to rank, cite or include content. OpenAI and Perplexity each publish an llms.txt for their own documentation, which is the use case the proposal started from. Silence is not proof that no one reads it, so I treat it as unproven.

A decision rule

Your siteWhat I would do
Software or API documentationA file is reasonable. It is the proposal's main use case and costs little.
Business or service websiteSkip it for now. Spend the time on the pages, reviews and technical checks that Google documents.
You already have one from a pluginLeave it. Google says it does no harm. Do not report it as an AI visibility improvement.
A vendor sells llms.txt as an AI ranking fixAsk for the official source. There is none for Google Search.
Software or API documentationA file is reasonable; it costs little
Business or service websiteSkip it for now; spend the time on pages, reviews and technical checks
You already have one from a pluginLeave it; do not report it as an AI visibility improvement
A vendor sells it as an AI ranking fixAsk for the official source; there is none for Google Search
What to do with llms.txt, by site type.

What to do next

Put the effort into technical SEO and pages worth citing. If you want me to check whether AI crawlers can reach your site, see the robots.txt guide for AI bots.

Sources

Frequently Asked Questions

Google says it neither harms nor helps visibility in Google Search.

No. llmstxt.org is a third-party proposal. Lighthouse calls it an emerging convention.

You can. It is harmless for Google Search. Do not expect it to change rankings or AI citations.

Related Services

Get a Free SEO Audit