llms.txt is a plain Markdown file that sits at /llms.txt on your domain and tells language models, in a few lines, what your site is and which pages to read first. The proposal on llmstxt.org was published by Jeremy Howard on September 3, 2024. If you already have one, check your llms.txt file against the format before you go further.
The llms.txt format
The file is Markdown, and the sections come in a fixed order (llmstxt.org):
- An H1 with the name of the project or site. This is the only required section.
- A blockquote with a short summary of the site.
- Optional paragraphs or lists with more detail, without headings.
- H2 sections that each hold a list of links, written as
[name](url): notes. - An optional section called Optional, for links an agent can skip when it needs a shorter context.
An llms.txt example
# Brightlane
> Brightlane is invoicing software for freelancers who bill monthly retainers.
## Product
- [Features](https://brightlane.com/features): retainers, late-payment reminders, multi-currency
- [Pricing](https://brightlane.com/pricing): plans and limits
## Docs
- [Getting started](https://brightlane.com/docs/start.md): set up your first retainer
## Optional
- [Changelog](https://brightlane.com/changelog)
The proposal also suggests offering a clean Markdown copy of useful pages at the same URL with .md added, such as page.html.md (llmstxt.org).
How to add llms.txt to your site
- List the 10 to 30 pages a newcomer should read: product, pricing, docs, policies.
- Write a one-sentence summary that states what you do and for whom.
- Group the links under a few H2 headings and add a short note to each link.
- Save the file as UTF-8 and publish it at the root of your domain.
- Validate it, then keep it in sync when pages move.
On WordPress and on shops, the same rules apply; only the publishing step changes.
What llms.txt does not do
llms.txt does not block or allow crawlers: that is robots.txt. It doesn't list every URL: that is your sitemap. And it is not a ranking signal you can count on. Google says there are no special files needed to appear in AI Overviews or AI Mode, and that you "don't need to create new machine readable files, AI text files, or markup" (Google Search Central).
That makes llms.txt a low-cost courtesy to tools and agents that choose to read it. Add it if it takes you an hour; don't expect it to change how often AI engines mention you. To know whether anything changes, measure your visibility before and after.
llms.txt vs robots.txt vs sitemap.xml
| File | Purpose | Who reads it |
|---|---|---|
robots.txt |
Allow or block crawling | Search and AI crawlers that honour it |
sitemap.xml |
List every URL you want indexed | Search engines |
llms.txt |
Curated guide to your key pages | Tools and agents that choose to read it |
Sources
- The /llms.txt file · llmstxt.org (Jeremy Howard)
- AI features and your website · Google Search Central