Glossary

llms.txt

llms.txt is a proposed plain-text file at the root of a site that tells AI models what the site contains and where its most useful pages are.

By SupaVisible Editorial

llms.txt is a proposed convention: a plain-text Markdown file at the root of a domain that describes what the site is and links to its most useful pages. The idea is roughly robots.txt in reverse. Where robots.txt restricts what crawlers may fetch, llms.txt advertises what a model would most benefit from reading.

What goes in it?

A short, consistent structure:

  • An # H1 with the site or product name.
  • A > blockquote giving a one-line description.
  • A short paragraph or two of context.
  • One or more ## sections listing pages as Markdown links, each with a brief description of what it covers.

The format is deliberately plain so that a model can consume it without parsing HTML or executing JavaScript.

Does llms.txt actually do anything?

Not for Google. Google's guide to its AI features lists "LLMS.txt files and other 'special' markup" among the things you do not need to appear in AI Overviews or AI Mode. No other major AI provider has confirmed that it reads the file.

The argument for publishing one anyway is cost. It is one file, it can be generated from the same source as your sitemap so it never goes stale, and it does no harm. Spend the time on pages that answer their search instead.

How is it different from a sitemap?

A sitemap is a machine-readable list of every URL, aimed at search crawlers, and it carries no meaning beyond the addresses and when they changed. An llms.txt is a short curated description aimed at a reader, and it says what each page is for.

A sitemap answers "what exists here". An llms.txt answers "what is this site, and what should I read first".

What does help is in what does and doesn't affect Google rankings. See also answer engine optimization.

Quick answers

What is llms.txt?
llms.txt is a proposed convention: a plain-text Markdown file at the root of a domain that describes what the site is and links to its most useful pages. It is intended for language models in roughly the way robots.txt is intended for crawlers, but it describes content rather than restricting access.
Does llms.txt actually work?
Not for Google. Google's guide to its AI features lists llms.txt files among the things you do not need to appear in AI Overviews or AI Mode. No other major AI provider has confirmed that it reads the file either. It costs one generated file, so some sites publish one anyway, but expect nothing from it.

Try it on your own site

Find the searches you almost rank for.

Get in touch
All terms