User-agent: *
Disallow: /rd




User-agent: bidswitchbot
User-agent: YandexBot
User-agent: GoogleOther
User-agent: SemrushBot
User-agent: DataForSeoBot
User-agent: AhrefsBot
User-agent: MJ12bot
User-agent: DotBot
User-agent: Baiduspider
User-agent: Exabot
User-agent: Sogou web spider

User-agent: GPTBot
User-agent: Microsoft-HTTPAPI/2.0
User-agent: ClaudeBot
User-agent: Grok
User-agent: PerplexityBot
User-agent: LLaMA
User-agent: HuggingChat



Disallow: /
Disallow: /search
Disallow: /job
Disallow: /rd