What is llms.txt?

Overview

llms.txt is a proposed standard for providing information to help Large Language Models (LLMs) use a website at inference time. Similar to how robots.txt controls web crawler access, llms.txt helps control and guide AI model access to your content.

Key Features

• Located at /llms.txt on your domain
• Written in Markdown format for human and LLM readability
• Provides structured information about your content
• Helps LLMs understand what content is available and how to access it
• Complements robots.txt by providing context for allowed content

Format Specification

According to the official specification, an llms.txt file should contain:

1. H1 header with the project or site name (required)
2. Blockquote with a short summary (optional but recommended)
3. Content sections with detailed information
4. H2 sections with file lists containing markdown links
5. Optional section for secondary information that can be skipped

Example

# My Project

> Brief description of the project and its purpose.

Additional information about the project.

## Documentation

- [Getting Started](https://example.com/docs/getting-started.md): Introduction guide
- [API Reference](https://example.com/docs/api.md): Complete API documentation

## Examples

- [Basic Example](https://example.com/examples/basic.md)
- [Advanced Example](https://example.com/examples/advanced.md)

## Optional

- [Legacy Docs](https://example.com/docs/legacy.md): Older documentation

Why Use llms.txt?

Get Started

Ready to create your own llms.txt file? Use our AI Audit tool to check existing files or validate your own implementation.