User-agent: * Allow: / # Authenticated ERP areas — no SEO value, keep crawlers out Disallow: /admin Disallow: /distributor Disallow: /company Disallow: /location Disallow: /staff-portal Disallow: /login Disallow: /set-password Disallow: /change-expired-password # AI / LLM crawlers — explicitly welcomed (same ERP exclusions as everyone else). # We WANT to be crawled and cited by AI search (ChatGPT, Gemini, Claude, Perplexity). User-agent: GPTBot User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: Google-Extended User-agent: ClaudeBot User-agent: anthropic-ai User-agent: Claude-Web User-agent: PerplexityBot User-agent: Perplexity-User User-agent: CCBot Allow: / Disallow: /admin Disallow: /distributor Disallow: /company Disallow: /location Disallow: /staff-portal Disallow: /login Sitemap: https://accorgwines.com/sitemap.xml