llms.txt suggests
Which pages are worth reading and what each is about. It cannot block anything, and a tool is free to ignore it.
Generate · check · free
llms.txt generator and checker
Enter your site and get an llms.txt drafted from its own pages: the name, a summary, and the pages that matter, grouped and described. Already have one? Check it below.
Reads up to 20 pages: the ones your homepage links to first, then your sitemap.
Check an llms.txt
Enter a site to read its /llms.txt, or paste a file before you upload it. Every link in it is tried, up to 50.
What is llms.txt?
A short markdown file at /llms.txt that tells a language model what your site is and which pages to read.
It was proposed in 2024 at llmstxt.org for tools that read a site on someone's behalf,
where menus, scripts and cookie banners get in the way of the text.
# Example Shop
> Handmade leather boots, shipped worldwide.
## Guides
- [Sizing](https://example.com/sizing): how to measure your foot
- [Care](https://example.com/care): cleaning and waxing
## Optional
- [Blog](https://example.com/blog)- A title,
# Name, the only part that is required. - A summary in a
>quote line: what the site is, in one sentence. - Sections under
##headings, each a list of links with a short note after a colon. - An Optional section for links a tool may skip when it needs to keep things short.
llms.txt and robots.txt
robots.txt permits
Which crawlers may fetch which paths. To keep AI training crawlers out, this is the file to change; the robots.txt generator has a preset for it.
Questions about llms.txt
What is llms.txt?
A plain text file in markdown at the root of a site, /llms.txt, that tells a language model what the site is and which pages matter. It was proposed in 2024 at llmstxt.org as a short map for tools that read a site on a user's behalf, where a full page of navigation and scripts gets in the way.
Does Google use llms.txt?
No. Google's search team has said Google Search does not use it, and none of the big AI assistants has confirmed that it reads the file. Add it because it is cheap and harmless, not because it will change rankings or citations.
What is the difference between llms.txt and robots.txt?
robots.txt tells crawlers what they may fetch; llms.txt suggests what is worth reading. They do not overlap: an llms.txt cannot block anything, and to keep AI crawlers out you still need robots.txt.
What is llms-full.txt?
A companion file some sites publish with the full text of their key pages in one markdown document, so a tool can read everything without following links. Documentation sites use it most.
How do I add llms.txt to WordPress?
Yoast SEO and some other SEO plugins can generate one for you. Otherwise, save the file as llms.txt and upload it to the site's root folder with your host's file manager or FTP, so that it opens at https://yourdomain.com/llms.txt.