User-agent: * Disallow: User-agent: ClaudeBot Crawl-delay: 1 User-agent: GPTBot Crawl-delay: 1 User-agent: SemrushBot Crawl-delay: 1 User-agent: Bytespider Crawl-delay: 1 User-agent: meta-externalagent Crawl-delay: 1 User-agent: ExaSearchBot Crawl-delay: 1 User-agent: AhrefsBot Crawl-delay: 1 User-agent: AmazonBot User-agent: Googlebot User-agent: Bingbot User-agent: Applebot User-agent: Applebot-Extended