# # Hello bot! There are some routes that need authentication. You should avoid them :) # # ── AI answer-engine crawlers ──────────────────────────────────────────── # Explicitly welcome the crawlers behind ChatGPT, Claude, Perplexity, # Bing Copilot and Google AI features. Same auth-route disallows as # everyone else, but NO crawl delay so they index freely. User-agent: GPTBot User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: ClaudeBot User-agent: anthropic-ai User-agent: PerplexityBot User-agent: Bingbot User-agent: Google-Extended Disallow: /profile-settings Disallow: /l/new Disallow: /l/*/checkout Disallow: /l/*/draft Disallow: /l/*/pending-approval Disallow: /l/*/new Disallow: /l/*/edit Disallow: /inbox Disallow: /order Disallow: /sale Disallow: /listings Disallow: /account Disallow: /reset-password Disallow: /verify-email Disallow: /preview # ── Everyone else ──────────────────────────────────────────────────────── User-agent: * Disallow: /profile-settings Disallow: /l/new Disallow: /l/*/checkout Disallow: /l/*/draft Disallow: /l/*/pending-approval Disallow: /l/*/new Disallow: /l/*/edit Disallow: /inbox Disallow: /order Disallow: /sale Disallow: /listings Disallow: /account Disallow: /reset-password Disallow: /verify-email Disallow: /preview Crawl-Delay: 5 Sitemap: https://www.schoolscoops.com/sitemap-index.xml