The door at
cnn.com
Near lockdown.cnn.com bans 20 of 22 AI crawlers. The velvet rope is up, with a few names slipping past it.
20 of 22 AI crawlers banned.
Trains models
- GPTBotOpenAIBanned
- ClaudeBotAnthropicBanned
- anthropic-aiAnthropicBanned
- Google-ExtendedGoogle · keeps out /*.jsx$ *.jsx$ /*.jsx/Walked in
- GoogleOtherGoogleBanned
- CCBotCommon CrawlBanned
- Applebot-ExtendedAppleBanned
- BytespiderByteDanceBanned
- meta-externalagentMeta · keeps out /*.jsx$ *.jsx$ /*.jsx/Walked in
- FacebookBotMetaBanned
- cohere-aiCohereBanned
- DiffbotDiffbotBanned
AI search
- OAI-SearchBotOpenAIBanned
- Claude-SearchBotAnthropicBanned
- AmazonbotAmazonBanned
- PerplexityBotPerplexityBanned
- YouBotYou.comBanned
Fetches for a user
- ChatGPT-UserOpenAIBanned
- Claude-UserAnthropicBanned
- Perplexity-UserPerplexityBanned
- DuckAssistBotDuckDuckGoBanned
- MistralAI-UserMistralBanned
Search engine
- GooglebotGoogle · keeps out /*.jsx$ *.jsx$ /*.jsx/Walked in
- BingbotMicrosoft · keeps out /*.jsx$ *.jsx$ /*.jsx/Walked in
