User-Agent: * Allow: / Allow: /login Allow: /register Allow: /en/login Allow: /en/register Allow: /zh/login Allow: /zh/register Disallow: /api Disallow: /en/api Disallow: /zh/api User-Agent: GPTBot User-Agent: OAI-SearchBot User-Agent: ChatGPT-User User-Agent: Google-Extended User-Agent: CCBot User-Agent: ClaudeBot User-Agent: Claude-SearchBot User-Agent: PerplexityBot User-Agent: Perplexity-User Allow: / Allow: /login Allow: /register Allow: /en/login Allow: /en/register Allow: /zh/login Allow: /zh/register Disallow: /api Disallow: /en/api Disallow: /zh/api Host: redditfind.ai Sitemap: https://redditfind.ai/sitemap.xml