The door at
medium.com
Door ajar.medium.com says no to 0 AI crawlers and keeps 8 to the lobby. Everybody else walks in.
0 of 22 AI crawlers banned.
Trains models
- GPTBotOpenAI · keeps out all but /aboutLobby only
- ClaudeBotAnthropic · keeps out all but /aboutLobby only
- anthropic-aiAnthropic · keeps out /m/ /me/ /@me$Walked in
- Google-ExtendedGoogle · keeps out /m/ /me/ /@me$Walked in
- GoogleOtherGoogle · keeps out all but /aboutLobby only
- CCBotCommon Crawl · keeps out /m/ /me/ /@me$Walked in
- Applebot-ExtendedApple · keeps out all but /aboutLobby only
- BytespiderByteDance · keeps out all but /aboutLobby only
- meta-externalagentMeta · keeps out all but /aboutLobby only
- FacebookBotMeta · keeps out all but /aboutLobby only
- cohere-aiCohere · keeps out /m/ /me/ /@me$Walked in
- DiffbotDiffbot · keeps out /m/ /me/ /@me$Walked in
AI search
- OAI-SearchBotOpenAI · keeps out /m/ /me/ /@me$Walked in
- Claude-SearchBotAnthropic · keeps out /m/ /me/ /@me$Walked in
- AmazonbotAmazon · keeps out all but /aboutLobby only
- PerplexityBotPerplexity · keeps out /m/ /me/ /@me$Walked in
- YouBotYou.com · keeps out /m/ /me/ /@me$Walked in
Fetches for a user
- ChatGPT-UserOpenAI · keeps out /m/ /me/ /@me$Walked in
- Claude-UserAnthropic · keeps out /m/ /me/ /@me$Walked in
- Perplexity-UserPerplexity · keeps out /m/ /me/ /@me$Walked in
- DuckAssistBotDuckDuckGo · keeps out /m/ /me/ /@me$Walked in
- MistralAI-UserMistral · keeps out /m/ /me/ /@me$Walked in
Search engine
- GooglebotGoogle · keeps out /m/ /me/ /@me$Walked in
- BingbotMicrosoft · keeps out /m/ /me/ /@me$Walked in
