User-agent: * Allow: / # ===== ALLOW ALL AI & GENERATIVE SEARCH BOTS (GEO Optimization) ===== # OpenAI / ChatGPT User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: OAI-SearchBot Allow: / # Google AI / Gemini User-agent: Google-Extended Allow: / User-agent: Googlebot Allow: / # Anthropic / Claude User-agent: ClaudeBot Allow: / User-agent: Claude-Web Allow: / User-agent: anthropic-ai Allow: / # Perplexity AI User-agent: PerplexityBot Allow: / # Meta AI User-agent: Meta-ExternalAgent Allow: / User-agent: FacebookBot Allow: / # Cohere AI User-agent: cohere-ai Allow: / # Common Crawl (used by many AI models) User-agent: CCBot Allow: / # Bing / Microsoft Copilot User-agent: Bingbot Allow: / User-agent: msnbot Allow: / # Amazon Alexa / AWS User-agent: Amazonbot Allow: / # Brave Search User-agent: Brave-Search Allow: / # You.com User-agent: YouBot Allow: / # Omgili / Webz.io (used by AI training) User-agent: OmgiliBot Allow: / # Sitemap declaration Sitemap: https://mathongo-discount.vercel.app/sitemap.xml