# Public marketing pages and their rendering assets are crawlable. # Customer domains return their own Disallow: / policy in middleware. # Specific crawler groups repeat the private rules; they do not inherit *. User-agent: * Allow: / Disallow: /admin Disallow: /admin-impersonate Disallow: /dashboard Disallow: /api/ Disallow: /verify-email Disallow: /confirm-email-change Disallow: /reset-password Disallow: /proposal/ Disallow: /editor Disallow: /welcome Disallow: /_next/data/ # AI search and answer engines: the bots that fetch pages to cite them in # ChatGPT search, Perplexity, Claude, Google AI Overviews/AI Mode and Apple. User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: PerplexityBot User-agent: Perplexity-User User-agent: Claude-SearchBot User-agent: Claude-User User-agent: Googlebot User-agent: Applebot User-agent: DuckAssistBot User-agent: MistralAI-User Allow: / Disallow: /admin Disallow: /admin-impersonate Disallow: /dashboard Disallow: /api/ Disallow: /verify-email Disallow: /confirm-email-change Disallow: /reset-password Disallow: /proposal/ Disallow: /editor Disallow: /welcome Disallow: /_next/data/ # AI training crawlers: allowed on purpose. Being in training data is how a # brand gets recommended (AEO & GEO Plan, Workstream 1). User-agent: GPTBot User-agent: ClaudeBot User-agent: Google-Extended User-agent: Applebot-Extended User-agent: CCBot User-agent: meta-externalagent User-agent: Amazonbot Allow: / Disallow: /admin Disallow: /admin-impersonate Disallow: /dashboard Disallow: /api/ Disallow: /verify-email Disallow: /confirm-email-change Disallow: /reset-password Disallow: /proposal/ Disallow: /editor Disallow: /welcome Disallow: /_next/data/ User-agent: bingbot Allow: / Disallow: /admin Disallow: /admin-impersonate Disallow: /dashboard Disallow: /api/ Disallow: /verify-email Disallow: /confirm-email-change Disallow: /reset-password Disallow: /proposal/ Disallow: /editor Disallow: /welcome Disallow: /_next/data/ Crawl-delay: 1 User-agent: msnbot Allow: / Disallow: /admin Disallow: /admin-impersonate Disallow: /dashboard Disallow: /api/ Disallow: /verify-email Disallow: /confirm-email-change Disallow: /reset-password Disallow: /proposal/ Disallow: /editor Disallow: /welcome Disallow: /_next/data/ Crawl-delay: 1 Sitemap: https://propovo.com/sitemap.xml?type=index