Discover Websites using llms.txt

We’re excited to announce that BuiltWith now tracks websites that have implemented llms.txt — a new standard that allows site owners to declare how they want their content to be used by AI and LLMs. Just like robots.txt but for large language models, llms.txt gives websites more control over how their data is accessed and utilized. You can now explore a full downloadable list of domains that have added this file to their root directories. 📥

Whether you're an AI researcher, data ethics advocate, or just curious about adoption trends in the LLM space, this new dataset is a goldmine. 🧠💡 Find out which major sites are setting boundaries for AI and see how fast this protocol is gaining traction across the web. Head over to BuiltWith, search for “llms.txt” usage, or download the list directly to explore! 🔍🌐