# Zorgoia robots.txt - search + AI discovery # Host: https://zorgoia.com # # START HERE (everything on the site): # HTML: https://zorgoia.com/everything # JSON: https://zorgoia.com/site.json # Languages: https://zorgoia.com/languages.json # AI: https://zorgoia.com/llms.txt # AI MD: https://zorgoia.com/ai-knowledge.md # Atom: https://zorgoia.com/atom.xml # JSON Feed: https://zorgoia.com/feed.json # Sitemap index: https://zorgoia.com/sitemap.xml # User-agent: * Allow: / Allow: /everything Allow: /site.json Allow: /languages.json Allow: /feed.json Allow: /llms.txt Allow: /ai-knowledge.md Allow: /sitemap.xml Allow: /sitemap-pages.xml Allow: /sitemap-images.xml Allow: /sitemap-news.xml Allow: /sitemap-discovery.xml Allow: /atom.xml Allow: /opensearch.xml Allow: /humans.txt Allow: /manifest.webmanifest Allow: /images/ Disallow: /includes/ User-agent: GPTBot Allow: / Allow: /llms.txt Allow: /ai-knowledge.md Allow: /site.json Allow: /everything User-agent: ChatGPT-User Allow: / Allow: /llms.txt Allow: /ai-knowledge.md Allow: /site.json Allow: /everything User-agent: Google-Extended Allow: / Allow: /llms.txt Allow: /ai-knowledge.md Allow: /site.json Allow: /everything User-agent: GoogleOther Allow: / Allow: /llms.txt Allow: /ai-knowledge.md Allow: /site.json Allow: /everything User-agent: ClaudeBot Allow: / Allow: /llms.txt Allow: /ai-knowledge.md Allow: /site.json Allow: /everything User-agent: anthropic-ai Allow: / Allow: /llms.txt Allow: /ai-knowledge.md Allow: /site.json Allow: /everything User-agent: CCBot Allow: / Allow: /llms.txt Allow: /ai-knowledge.md Allow: /site.json Allow: /everything User-agent: Bytespider Allow: / Allow: /llms.txt Allow: /ai-knowledge.md Allow: /site.json Allow: /everything User-agent: FacebookBot Allow: / Allow: /llms.txt Allow: /ai-knowledge.md Allow: /site.json Allow: /everything User-agent: Meta-ExternalAgent Allow: / Allow: /llms.txt Allow: /ai-knowledge.md Allow: /site.json Allow: /everything User-agent: Applebot-Extended Allow: / Allow: /llms.txt Allow: /ai-knowledge.md Allow: /site.json Allow: /everything User-agent: PerplexityBot Allow: / Allow: /llms.txt Allow: /ai-knowledge.md Allow: /site.json Allow: /everything User-agent: YouBot Allow: / Allow: /llms.txt Allow: /ai-knowledge.md Allow: /site.json Allow: /everything User-agent: Diffbot Allow: / Allow: /llms.txt Allow: /ai-knowledge.md Allow: /site.json Allow: /everything User-agent: cohere-ai Allow: / Allow: /llms.txt Allow: /ai-knowledge.md Allow: /site.json Allow: /everything User-agent: Omgilibot Allow: / Allow: /llms.txt Allow: /ai-knowledge.md Allow: /site.json Allow: /everything User-agent: Omgili Allow: / Allow: /llms.txt Allow: /ai-knowledge.md Allow: /site.json Allow: /everything User-agent: ImagesiftBot Allow: / Allow: /llms.txt Allow: /ai-knowledge.md Allow: /site.json Allow: /everything User-agent: TelegramBot Allow: / Allow: /llms.txt Allow: /ai-knowledge.md Allow: /site.json Allow: /everything Sitemap: https://zorgoia.com/sitemap.xml Sitemap: https://zorgoia.com/sitemap-pages.xml Sitemap: https://zorgoia.com/sitemap-images.xml Sitemap: https://zorgoia.com/sitemap-news.xml Sitemap: https://zorgoia.com/sitemap-discovery.xml # LLM-Context: https://zorgoia.com/llms.txt # Site-Inventory: https://zorgoia.com/site.json # Contact: zorgoias@gmail.com