The door at
github.com
Door ajar.github.com says no to 1 AI crawler and keeps 5 to the lobby. Everybody else walks in.
1 of 22 AI crawlers banned.
Trains models
- GPTBotOpenAI · keeps out /account-login /copilot/ /copilot/c/Lobby only
- ClaudeBotAnthropic · keeps out /account-login /copilot/ /copilot/c/Lobby only
- anthropic-aiAnthropic · keeps out /account-login /copilot/ /copilot/c/Lobby only
- Google-ExtendedGoogle · keeps out /account-login /copilot/ /copilot/c/Walked in
- GoogleOtherGoogle · keeps out /account-login /copilot/ /copilot/c/Walked in
- CCBotCommon Crawl · keeps out /account-login /copilot/ /copilot/c/Walked in
- Applebot-ExtendedApple · keeps out /account-login /copilot/ /copilot/c/Walked in
- BytespiderByteDanceBanned
- meta-externalagentMeta · keeps out /account-login /copilot/ /copilot/c/Walked in
- FacebookBotMeta · keeps out /account-login /copilot/ /copilot/c/Walked in
- cohere-aiCohere · keeps out /account-login /copilot/ /copilot/c/Walked in
- DiffbotDiffbot · keeps out /account-login /copilot/ /copilot/c/Walked in
AI search
- OAI-SearchBotOpenAI · keeps out /account-login /copilot/ /copilot/c/Lobby only
- Claude-SearchBotAnthropic · keeps out /account-login /copilot/ /copilot/c/Walked in
- AmazonbotAmazon · keeps out /account-login /copilot/ /copilot/c/Walked in
- PerplexityBotPerplexity · keeps out /account-login /copilot/ /copilot/c/Lobby only
- YouBotYou.com · keeps out /account-login /copilot/ /copilot/c/Walked in
Fetches for a user
- ChatGPT-UserOpenAI · keeps out /account-login /copilot/ /copilot/c/Walked in
- Claude-UserAnthropic · keeps out /account-login /copilot/ /copilot/c/Walked in
- Perplexity-UserPerplexity · keeps out /account-login /copilot/ /copilot/c/Walked in
- DuckAssistBotDuckDuckGo · keeps out /account-login /copilot/ /copilot/c/Walked in
- MistralAI-UserMistral · keeps out /account-login /copilot/ /copilot/c/Walked in
Search engine
- GooglebotGoogle · keeps out /account-login /copilot/ /copilot/c/Walked in
- BingbotMicrosoft · keeps out /ekansa/Open-Context-Data /ekansa/opencontext-* /account-loginLobby only
