User-agent: * Disallow: /invite Disallow: /joined Disallow: /no-count Disallow: /signed-in Disallow: /oauth/ Disallow: /api/ Disallow: /get/ # AI search and assistant crawlers, named so it's clear they're welcome. A # crawler follows only the group that names it, so each repeats the rules # above. User-agent: GPTBot Allow: / Disallow: /invite Disallow: /joined Disallow: /no-count Disallow: /signed-in Disallow: /oauth/ Disallow: /api/ Disallow: /get/ User-agent: OAI-SearchBot Allow: / Disallow: /invite Disallow: /joined Disallow: /no-count Disallow: /signed-in Disallow: /oauth/ Disallow: /api/ Disallow: /get/ User-agent: ClaudeBot Allow: / Disallow: /invite Disallow: /joined Disallow: /no-count Disallow: /signed-in Disallow: /oauth/ Disallow: /api/ Disallow: /get/ User-agent: PerplexityBot Allow: / Disallow: /invite Disallow: /joined Disallow: /no-count Disallow: /signed-in Disallow: /oauth/ Disallow: /api/ Disallow: /get/ User-agent: Google-Extended Allow: / Disallow: /invite Disallow: /joined Disallow: /no-count Disallow: /signed-in Disallow: /oauth/ Disallow: /api/ Disallow: /get/ Sitemap: https://leapsteps.ai/sitemap.xml