# Robots.txt for Cyrolo Anonymizer
# Updated: 2025-10-07 for 2026 SEO Best Practices

# Default Rules for All Crawlers
User-agent: *
Allow: /
Disallow: /admin/
Disallow: /api/

# Host
Host: https://cyrolo.eu

# Sitemaps
Sitemap: https://cyrolo.eu/sitemap.xml

# AI & LLM Crawler Resources (2025/2026 SEO Best Practice)
# These files provide structured information for Large Language Models
# and AI-powered search engines (ChatGPT, Gemini, Claude, Perplexity, etc.)

# AI Policy & LLM Information
# https://cyrolo.eu/ai.txt - AI crawler policy & guidelines
# https://cyrolo.eu/llms.txt - Structured site info for LLMs (llms.txt standard)
# https://cyrolo.eu/llms-full.txt - Extended LLM documentation

# AI-Friendly Resources
# https://cyrolo.eu/feed.xml - RSS feed with full blog content
# https://cyrolo.eu/humans.txt - Human-readable site info
# https://cyrolo.eu/ai-usage-policy - Comprehensive AI usage terms

# Contact for AI/LLM Integration
# Email: info@cyrolo.eu
# For API access, licensing, or commercial AI training data

# Note: All blog posts automatically included in sitemap.xml
# Updated: Hourly (new posts added automatically)
# RSS Feed: https://cyrolo.eu/feed.xml (real-time updates)