# OverseerOS robots.txt # https://www.overseeros.com/robots.txt User-agent: * Allow: / Disallow: /api/ Disallow: /billing/ Disallow: /account/ Disallow: /admin/ Disallow: /dashboard/ Disallow: /settings/ # Explicit allowances for AI answer engines & search agents. # The public site is open to these crawlers; the private/app routes above stay # disallowed for them too (a named user-agent group overrides the "*" group, so # the disallows are repeated here on purpose). User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: GPTBot User-agent: ClaudeBot User-agent: Claude-User User-agent: PerplexityBot User-agent: Perplexity-User User-agent: Google-Extended User-agent: Applebot-Extended User-agent: Amazonbot User-agent: cohere-ai User-agent: Bytespider Allow: / Disallow: /api/ Disallow: /billing/ Disallow: /account/ Disallow: /admin/ Disallow: /dashboard/ Disallow: /settings/ Sitemap: https://www.overseeros.com/sitemap.xml