Your site, described the way AI reads it.
From sitemap to finished file in one pass, with the format the llms.txt standard expects.
Sitemap discovery
0 ptsReads the Sitemap: lines in robots.txt, then standard locations, then sitemap indexes. Falls back to homepage links when a site has no sitemap.
Smart page selection
0 ptsPicks up to 40 pages: the homepage first, then shallow paths, spread across sections so a blog does not crowd out pricing and docs.
Titles and descriptions
0 ptsVisits each page and uses its title and meta description, falling back to the first real paragraph when the description is missing.
Standard format
0 ptsAn H1 with the site name, a blockquote summary, and Markdown link lists under H2 sections, exactly as the llms.txt proposal specifies.
Copy or download
0 ptsGet the file as text to paste, or as a download named llms.txt ready to drop in your site root.
- Disallow: / under User-agent: *
- No Sitemap: line
- Crawl-delay ignored by Googlebot
Existing file check
0 ptsTells you if the site already serves an llms.txt so you can compare before replacing it.
One file.
Every AI assistant knows what you do.
AI assistants cannot read your whole site every time someone asks about you. llms.txt gives them the short version: what the site is, and which pages answer which questions.
It is the robots.txt of the AI era
robots.txt tells crawlers where they may go. llms.txt tells language models what is worth reading and how to describe you. It is a proposed standard already read by a growing list of tools.
Descriptions do the work
A model uses the description next to each link to decide which page to open. Clear, specific descriptions get your pricing page cited for pricing questions and your docs cited for how-to questions.
It takes five minutes, once
The file is plain text at your domain root. Generate it, publish it, regenerate when your site changes. There is no ongoing cost and no downside.
Publish it. Then make it better.
- 1
Upload the file to your site root
It must be served at yourdomain.com/llms.txt as plain text. On most hosts that means dropping it into the public folder next to robots.txt.
- 2
Improve the summary
The blockquote is the first thing a model reads. Make it one or two sentences that say what you do and for whom, in plain words.
- 3
Tighten the descriptions
Edit any description that is vague. "Pricing for Starter and Growth plans, billed monthly or yearly" beats "Pricing".
- 4
Add pages the sitemap missed
If a key page was skipped or is not in your sitemap, add a line for it by hand under the right section.
- 5
Consider llms-full.txt
For documentation-heavy sites, publish a second file with the full text of your key pages so tools can load everything in one request.
Keep llms.txt and your content in sync, automatically
SiteLift publishes AI-ready articles with structured data and keeps your llms.txt current as your site grows, then distributes the content so AI assistants find it.
No credit card required
Frequently Asked Questions
Everything you need to know about the llms.txt generator.
More free tools
AI Readiness Checker
Check whether AI crawlers can read your site, whether you publish llms.txt, and how well your content is structured to be cited by AI assistants.
AI Bot Access Checker
See whether GPTBot, ClaudeBot, PerplexityBot, Google-Extended and 14 other AI crawlers are allowed or blocked by your robots.txt, with the rule that decides it.
Sitemap Validator
Validate any XML sitemap: file structure, URL counts, lastmod freshness, live status sampling, duplicates, cross-host URLs and robots.txt declaration.