收录各大搜索引擎与商业爬虫的 User-Agent、抓取行为、渲染能力与来路 IP 数据，为站长提供「识别 - 分析 - 拦截」全流程参考。取名源自镇守门户的瑞兽，为网站守住爬虫访问的大门。
| User-Agent | 爬虫名称 | 类型 | 抓取频率 | 抓取深度 | 遵守 Robots | 是否活跃 |
|---|---|---|---|---|---|---|
| ApifyWebsiteContentCrawler | ApifyWebsiteContentCrawler | AI数据 | Unclear at this time. | — | 无视 | 停用 |
| Aranet-SearchBot | Aranet-SearchBot | AI数据 | Unclear at this time. | — | 无视 | 停用 |
| atlassian-bot | atlassian-bot | 搜索引擎 | No information provided. | — | 遵守 | 停用 |
| Awario | Awario | AI数据 | Unclear at this time. | — | 无视 | 停用 |
| AzureAI-SearchBot | AzureAI-SearchBot | 搜索引擎 | Unclear at this time. | — | 无视 | 停用 |
| bedrockbot | bedrockbot | AI数据 | Unclear at this time. | — | 遵守 | 停用 |
| bigsur.ai | Big Sur AI | AI数据 | Unclear at this time. | — | 无视 | 停用 |
| BixelBot | BixelBot | AI数据 | Unclear at this time. | — | 无视 | 停用 |
| Brightbot | brightbot | AI数据 | At least one per minute. | — | 无视 | 停用 |
| BuddyBot | BuddyBot | AI数据 | Unclear at this time. | — | 无视 | 停用 |
| CartAI Agentic Commerce | CartAI | AI数据 | Unclear at this time. | — | 无视 | 停用 |
| Channel3Bot | Channel3Bot | 搜索引擎 | Unclear at this time. | — | 无视 | 停用 |
| ChatGLM-Spider | ChatGLM-Spider | AI数据 | Unclear at this time. | — | 无视 | 停用 |
| ChatGPT Agent | ChatGPT Agent | AI数据 | Unclear at this time. | — | 遵守 | 停用 |
| Claude-Code | Claude-Code | AI数据 | Unclear at this time. | — | 无视 | 停用 |
| Claude-Web | Claude-Web | AI数据 | Unclear at this time. | — | 无视 | 停用 |
| CledaraBot | Cledara that visits SaaS providers to complete customer-appr | AI数据 | Unclear at this time. | — | 无视 | 停用 |
| Cloudflare-AutoRAG | Cloudflare-AutoRAG | 搜索引擎 | Unclear at this time. | — | 遵守 | 停用 |
| CloudflareBrowserRenderingCrawler | Cloudflare that returns rendered website content for researc | AI数据 | Unclear at this time. | — | 无视 | 停用 |
| CloudVertexBot | CloudVertexBot | AI数据 | Unclear at this time. | — | 无视 | 停用 |
| Code | Code | AI数据 | Unclear at this time. | — | 无视 | 停用 |
| Codex | Codex | AI数据 | Unclear at this time. | — | 无视 | 停用 |
| cohere-training-data-crawler | Cohere to download training data for its LLMs (Large Languag | AI数据 | Unclear at this time. | — | 无视 | 停用 |
| Cotoyogi | Cotoyogi | AI数据 | No information provided. | — | 遵守 | 停用 |
| CragCrawler | CragSoftware, a Brazil-based software company specializing i | AI数据 | Unclear at this time. | — | 无视 | 停用 |
| Crawl4AI | Crawl4AI | AI数据 | Unclear at this time. | — | 无视 | 停用 |
| Crawlspace | Crawlspace | AI数据 | Unclear at this time. | — | 遵守 | 停用 |
| Cursor | Cursor | AI数据 | Unclear at this time. | — | 无视 | 停用 |
| Datenbank Crawler | Datenbank | AI数据 | Unclear at this time. | — | 无视 | 停用 |
| DeepSeekBot | DeepSeek | AI数据 | Unclear at this time. | — | 无视 | 停用 |