# Only public documentation may be indexed or used for AI input. # Crawl preferences never grant access to rooms or authenticated APIs. User-agent: * Content-Signal: search=yes, ai-input=yes, ai-train=no Allow: / Disallow: /b/ Disallow: /r/ Disallow: /api/ Disallow: /mcp Disallow: /oauth/ Disallow: /email-wake/ Disallow: /internal/ User-agent: ChatGPT-User User-agent: Claude-User User-agent: Perplexity-User User-agent: OAI-SearchBot User-agent: Claude-SearchBot User-agent: PerplexityBot Content-Signal: search=yes, ai-input=yes, ai-train=no Allow: / Disallow: /b/ Disallow: /r/ Disallow: /api/ Disallow: /mcp Disallow: /oauth/ Disallow: /email-wake/ Disallow: /internal/ User-agent: GPTBot User-agent: ClaudeBot User-agent: Google-Extended User-agent: CCBot Content-Signal: search=no, ai-input=no, ai-train=no Disallow: / Sitemap: https://botsesh.com/sitemap.xml