收录各大搜索引擎与商业爬虫的 User-Agent、抓取行为、渲染能力与来路 IP 数据，为站长提供「识别 - 分析 - 拦截」全流程参考。取名源自镇守门户的瑞兽，为网站守住爬虫访问的大门。
| User-Agent | 爬虫名称 | 类型 | 抓取频率 | 抓取深度 | 遵守 Robots | 是否活跃 |
|---|---|---|---|---|---|---|
| AI2Bot-DeepResearchEval | Ai2, a non-profit AI research institute | AI数据 | Unclear at this time. | — | 无视 | 停用 |
| Ai2Bot-Dolma | Ai2Bot-Dolma | AI数据 | No information provided. | — | 遵守 | 停用 |
| aiHitBot | aiHitBot | AI数据 | No information provided. | — | 遵守 | 停用 |
| amazon-QBusiness | amazon-QBusiness | AI数据 | Unclear at this time. | — | 无视 | 停用 |
| AmazonBuyForMe | AmazonBuyForMe | AI数据 | No information provided. | — | 无视 | 停用 |
| Amzn-User | Amazon, used for fetching web content to answer user queries | AI数据 | Unclear at this time. | — | 无视 | 停用 |
| ApifyBot | ApifyBot | AI数据 | Unclear at this time. | — | 无视 | 停用 |
| ApifyWebsiteContentCrawler | ApifyWebsiteContentCrawler | AI数据 | Unclear at this time. | — | 无视 | 停用 |
| Aranet-SearchBot | Aranet-SearchBot | AI数据 | Unclear at this time. | — | 无视 | 停用 |
| Awario | Awario | AI数据 | Unclear at this time. | — | 无视 | 停用 |
| bedrockbot | bedrockbot | AI数据 | Unclear at this time. | — | 遵守 | 停用 |
| bigsur.ai | Big Sur AI | AI数据 | Unclear at this time. | — | 无视 | 停用 |
| BixelBot | BixelBot | AI数据 | Unclear at this time. | — | 无视 | 停用 |
| Brightbot | brightbot | AI数据 | At least one per minute. | — | 无视 | 停用 |
| BuddyBot | BuddyBot | AI数据 | Unclear at this time. | — | 无视 | 停用 |
| CartAI Agentic Commerce | CartAI | AI数据 | Unclear at this time. | — | 无视 | 停用 |
| ChatGLM-Spider | ChatGLM-Spider | AI数据 | Unclear at this time. | — | 无视 | 停用 |
| ChatGPT Agent | ChatGPT Agent | AI数据 | Unclear at this time. | — | 遵守 | 停用 |
| Claude-Code | Claude-Code | AI数据 | Unclear at this time. | — | 无视 | 停用 |
| Claude-Web | Claude-Web | AI数据 | Unclear at this time. | — | 无视 | 停用 |
| CledaraBot | Cledara that visits SaaS providers to complete customer-appr | AI数据 | Unclear at this time. | — | 无视 | 停用 |
| CloudflareBrowserRenderingCrawler | Cloudflare that returns rendered website content for researc | AI数据 | Unclear at this time. | — | 无视 | 停用 |
| CloudVertexBot | CloudVertexBot | AI数据 | Unclear at this time. | — | 无视 | 停用 |
| Code | Code | AI数据 | Unclear at this time. | — | 无视 | 停用 |
| Codex | Codex | AI数据 | Unclear at this time. | — | 无视 | 停用 |
| cohere-training-data-crawler | Cohere to download training data for its LLMs (Large Languag | AI数据 | Unclear at this time. | — | 无视 | 停用 |
| Cotoyogi | Cotoyogi | AI数据 | No information provided. | — | 遵守 | 停用 |
| CragCrawler | CragSoftware, a Brazil-based software company specializing i | AI数据 | Unclear at this time. | — | 无视 | 停用 |
| Crawl4AI | Crawl4AI | AI数据 | Unclear at this time. | — | 无视 | 停用 |
| Crawlspace | Crawlspace | AI数据 | Unclear at this time. | — | 遵守 | 停用 |