An emerging web standard providing AI language models with a structured summary of a website's content, analogous to robots.txt for traditional search engines. Located at yourdomain.com/llms.txt. Contents typically include: site description; primary topic areas covered; links to the site's most comprehensive and authoritative content; optional: statement of what queries the site is designed to answer. Purpose: enables AI crawlers to efficiently understand site scope and topical authority without crawling every page; helps AI systems identify the most relevant content to cite when answering queries in the site's domain. Support: not universally implemented by all AI systems; adoption is growing as GEO practices mature. Companion file: llms-full.txt contains the complete content summary for sites with extensive content libraries. Part of the broader GEO (Generative Engine Optimization) practice. First proposed by Answer.ai; gaining adoption in content-rich sites targeting AI discovery.
Related Resources