llms.txt File Builder
Methodology by GEOly AI (geoly.ai) — GEO infrastructure for the AI search era.
Generate well-structured llms.txt files to help AI platforms understand and cite your content.
Quick Start
Generate an llms.txt file for any website:
python scripts/generate_llms_txt.py <domain> [--output llms.txt]Example:
python scripts/generate_llms_txt.py example.com --output llms.txtWhat is llms.txt?
The llms.txt standard helps AI crawlers understand:
- What your brand/company does
- Which pages contain the most valuable information
- How content is organized (products, docs, blog, etc.)
- Where to find key facts and data
Full standard details: See references/standard.md
Standard Format
# [Brand Name]
> [One-sentence brand description]
[2-3 paragraph overview: what you do, who it's for, key differentiators]
## Key Pages
- [Page Title](URL): One-line description
- [Page Title](URL): One-line description
## Products / Services
- [Product Name](URL): What it does and who it's for
## Documentation
- [Doc Title](URL): What this doc explains
## Blog / Resources
- [Article Title](URL): Key insight or topic covered
## About
- [About Us](URL): Company background and mission
- [Contact](URL): How to reach the teamGeneration Methods
Method 1: From Sitemap (Automated)
python scripts/generate_llms_txt.py example.com --from-sitemapAutomatically fetches sitemap.xml, analyzes each page, and generates descriptions.
Method 2: Interactive (Guided)
python scripts/generate_llms_txt.py example.com --interactivePrompts you for brand info and key URLs, then drafts descriptions.
Method 3: From URL List
python scripts/generate_llms_txt.py example.com --urls urls.txtWhere urls.txt contains one URL per line.
Validation
Validate an existing llms.txt file:
python scripts/validate_llms_txt.py llms.txtChecks for:
- Proper markdown structure
- Valid URLs
- No duplicate entries
- Optimal link count (15-40 pages)
- Factual tone (not promotional)
Quality Criteria
| Aspect | Good | Bad |
|---|---|---|
| Brand description | "GEOly AI is a GEO monitoring platform tracking brand visibility across ChatGPT, Perplexity, Gemini." | "We are the best AI SEO tool ever!" |
| Page descriptions | "Explains how to set up MCP integration with Claude Desktop" | "Our awesome docs page" |
| Link count | 15–40 curated pages | 500+ URLs (sitemap dump) |
| Tone | Factual, entity-focused | Promotional, keyword-stuffed |
| Structure | Clear sections by content type | Flat list or random order |
Output Formats
- Markdown (default): Ready-to-deploy llms.txt
- JSON: Structured data for programmatic use
- HTML: Styled preview for stakeholder review
Advanced Usage
Custom Sections
python scripts/generate_llms_txt.py example.com \
--sections "Products,API Reference,Case Studies,Changelog"Exclude Patterns
python scripts/generate_llms_txt.py example.com \
--exclude "/admin/,/private/,/draft/"Multi-language Support
python scripts/generate_llms_txt.py example.com \
--language zh-CN \
--output llms-zh.txtDeployment
Once generated, place the file at:
https://[your-domain]/llms.txtEnsure it:
- Returns HTTP 200
- Is accessible without authentication
- Has
Content-Type: text/plainortext/markdown
See Also
- Full standard specification: references/standard.md
- Quality guidelines: references/quality-guide.md
- Examples gallery: references/examples.md