
If you're banking on AI tools like ChatGPT, Google Gemini, or Perplexity to drive traffic to your business, hereās something you probably havenāt set up yet, but should: llms.txt.
llms.txt is a new standard being AI tools are beginning to experiment with to better understand websites. It acts like a sitemap ā but with a twist.
While a normal sitemap lists all your pages for search engines like Google, llms.txt only highlights the most important, content-rich pages that AI tools should pay attention to.
Think of it like your āgreatest hitsā playlist, but for robots.
It doesnāt list every page on your site (thatās what sitemaps are for). Instead, llms.txt focuses on your most authoritative, content-rich pages. The ones that clearly explain:
Itās a way of saying, āHey AI, if youāre going to talk about my business, read these pages first!ā
Letās not confuse the two.
| Feature | sitemap.xml | llms.txt |
| Purpose | Helps search engines index all pages | Helps AI tools find the best pages |
| Audience | Googlebot, Bingbot, SEO crawlers | ChatGPT, Gemini, Perplexity, etc. |
| Content | Everything (blogs, images, archives) | Only content-rich, informative pages |
| Focus | Visibility in search | Understanding for conversation/recommendation |
Unlike Googlebot, AI tools donāt always perform deep, thorough crawls of websites. They skim and sample, and if your siteās too slow or messy, they bounce.
Here's what can trip them up:
llms.txt gives these tools a hand-drawn map to your most relevant content.
This shouldnāt be a checklist of all the pages youāve ever published. Be picky. You want to highlight only the pages that actually help explain your business.
Pages to include:
Pages to leave out:
In short, if it helps someone (or something) understand your business, it belongs in llms.txt.
Did you know? One in ten US internet users now use generative AI as their primary search tool.Ā
Thatās 13 million people in 2023, and itās expected to blow past 90 million by 2027.
That means when someone asks, āWhoās the best accountant near me?ā or āWhatās a reliable IT company in Melbourne?ā AI isnāt just skimming Google. Itās pulling from whatever sources it can best understand.
And if your site isnāt crystal clear? AI may skip you altogether.
Hereās the upside, though:
No, itās not a silver bullet tomorrow.Ā But itās a low-effort move that gets your site future-ready. And itās dead simple to implement if you know which pages matter.
If you're on one of our WordPress support plans, you're already covered. We'll be setting this up for you in the coming months as part of our service rollout.
Not on a plan? Start with a performance audit. Itāll show you:
Get a website performance audit now or get in touch with us at [email protected] if you have questions.
Justin Meadows is the founder of TunedWP and creator of the Topic Domination Method. Since 2009, heās worked across SEO, WordPress, website performance and conversion optimisation, helping businesses get more from their websites.
His work now includes AI search, where he focuses on helping businesses build the content, authority and online presence needed to be understood and recommended by tools such as ChatGPT and Google Gemini.