Host: simkl.com User-agent: * Disallow: /cdn-cgi/ Disallow: /register/ Disallow: /oauth/authorize Disallow: /settings Disallow: /*/list/*/favorite-tv-shows Disallow: /*/list/*/favorite-anime Disallow: /*/list/*/favorite-movies Disallow: /*/list/*/*? Disallow: /*/tags/*/ Disallow: /*/recommendations/ Disallow: /*/*/?tags= Disallow: /*/lists/?list_tags= Disallow: /apps/download/ Disallow: /*/*/t/ User-agent: SemrushBot-BA Disallow: / User-agent: AhrefsBot Disallow: / User-agent: AwarioRssBot User-agent: AwarioSmartBot Disallow: / User-agent: SeekportBot Disallow: / User-agent: GPTBot Disallow: / User-agent: Baiduspider Disallow: / User-agent: Amazonbot Disallow: / # Dark Visitors Robots.txt # AI Data Scraper # https://darkvisitors.com/agents/bytespider User-agent: Bytespider Disallow: / # AI Data Scraper # https://darkvisitors.com/agents/ccbot User-agent: CCBot Disallow: / # AI Data Scraper # https://darkvisitors.com/agents/diffbot User-agent: Diffbot Disallow: / # AI Data Scraper # https://darkvisitors.com/agents/facebookbot User-agent: FacebookBot Disallow: / # AI Data Scraper # https://darkvisitors.com/agents/google-extended User-agent: Google-Extended Disallow: / # AI Data Scraper # https://darkvisitors.com/agents/gptbot User-agent: GPTBot Disallow: / # AI Data Scraper # https://darkvisitors.com/agents/omgili User-agent: omgili Disallow: / # Undocumented AI Agent # https://darkvisitors.com/agents/anthropic-ai User-agent: anthropic-ai Disallow: / # Undocumented AI Agent # https://darkvisitors.com/agents/claude-web User-agent: Claude-Web Disallow: / # Undocumented AI Agent # https://darkvisitors.com/agents/claudebot User-agent: ClaudeBot Disallow: / # Undocumented AI Agent # https://darkvisitors.com/agents/cohere-ai User-agent: cohere-ai Disallow: /