# ============================================================================== # General access for all crawlers # ============================================================================== User-agent: * Allow: / # ============================================================================== # Explicit Allow for AI Crawlers # This helps ensure your content can be used by various AI models and services. # ============================================================================== # Google AI (Vertex AI, etc.) User-agent: Google-Extended Allow: / # OpenAI (ChatGPT, etc.) User-agent: GPTBot Allow: / # Microsoft AI (Bing Chat/Copilot) User-agent: MicrosoftPreview Allow: / # Anthropic (Claude) User-agent: ClaudeBot Allow: / # Perplexity AI User-agent: PerplexityBot Allow: / # You.com AI Search User-agent: YouBot Allow: / # Cohere AI User-agent: cohere-ai Allow: / # Common Crawl (Data used to train many AI models) User-agent: CCBot Allow: / # Facebook/Meta AI User-agent: MetaBot Allow: / # Apple AI User-agent: Applebot-Extended Allow: / # Amazon AI User-agent: Amazonbot Allow: / # ============================================================================== # Sitemaps # List all your sitemaps to help crawlers find all your content. # ============================================================================== Sitemap: https://www.anouar.gr/sitemap.xml Sitemap: https://www.anouar.gr/en/sitemap.xml