User-Agent: * Allow: / Disallow: /login Disallow: /analytics Disallow: /clients Disallow: /requirements Disallow: /resources Disallow: /vendors Disallow: /interviewSchedule Disallow: /api/ Disallow: /admin Disallow: /studio User-Agent: Googlebot Allow: / Allow: /hire/profiles/ Disallow: /login Disallow: /api/ Disallow: /admin Disallow: /studio User-Agent: OAI-SearchBot Allow: / Disallow: /login Disallow: /api/ Disallow: /admin Disallow: /studio User-Agent: ChatGPT-User Allow: / Disallow: /login Disallow: /api/ Disallow: /admin Disallow: /studio User-Agent: Claude-SearchBot Allow: / Disallow: /login Disallow: /api/ Disallow: /admin Disallow: /studio User-Agent: PerplexityBot Allow: / Disallow: /login Disallow: /api/ Disallow: /admin Disallow: /studio User-Agent: GPTBot Disallow: / User-Agent: ClaudeBot Disallow: / User-Agent: Google-Extended Disallow: / User-Agent: CCBot Disallow: / User-Agent: Bytespider Disallow: / User-Agent: Diffbot Disallow: / User-Agent: Meta-ExternalAgent Disallow: / User-Agent: Amazonbot Disallow: / User-Agent: anthropic-ai Disallow: / User-Agent: Claude-Web Disallow: / User-Agent: PetalBot Disallow: / User-Agent: AhrefsBot Disallow: / User-Agent: SemrushBot Disallow: / User-Agent: MJ12bot Disallow: / User-Agent: DataForSeoBot Disallow: / User-Agent: DotBot Disallow: / User-Agent: SeekportBot Disallow: / User-Agent: SerpstatBot Disallow: / User-Agent: BLEXBot Disallow: / Sitemap: https://witarist.com/sitemap.xml