收录各大搜索引擎与商业爬虫的 User-Agent、抓取行为、渲染能力与来路 IP 数据,为站长提供「识别 - 分析 - 拦截」全流程参考。取名源自镇守门户的瑞兽,为网站守住爬虫访问的大门。
| User-Agent | 爬虫名称 | 类型 | 抓取频率 | 抓取深度 | 遵守 Robots | 是否活跃 |
|---|---|---|---|---|---|---|
| nbot | nbot | 搜索引擎 | Unclear at this time. | — | 无视 | 停用 |
| netEstate Imprint Crawler | netEstate Imprint Crawler | AI数据 | Unclear at this time. | — | 无视 | 停用 |
| newsai | newsai | AI数据 | Unclear at this time. | — | 无视 | 停用 |
| NotebookLM | NotebookLM | AI数据 | Unclear at this time. | — | 无视 | 停用 |
| NovaAct | NovaAct | AI数据 | Unclear at this time. | — | 无视 | 停用 |
| OAI-AdsBot | OAI-AdsBot | AI数据 | Only when a page is submitted as an ad. | — | 无视 | 停用 |
| omgili | omgili | AI数据 | No information. | — | 遵守 | 停用 |
| OpenAI | OpenAI bots | AI数据 | Unclear at this time. | — | 遵守 | 停用 |
| opencode | opencode | AI数据 | Unclear at this time. | — | 无视 | 停用 |
| Operator | Operator | AI数据 | Unclear at this time. | — | 无视 | 停用 |
| Panscient | Panscient | AI数据 | The Panscient web crawler will request a | — | 遵守 | 停用 |
| panscient.com | panscient.com | AI数据 | The Panscient web crawler will request a | — | 遵守 | 停用 |
| Payhawk Invoice Fetching Agent | Payhawk that retrieves invoices from supplier websites for u | AI数据 | Unclear at this time. | — | 无视 | 停用 |
| PhindBot | PhindBot | AI数据 | No explicit frequency provided. | — | 无视 | 停用 |
| Poggio-Citations | Poggio | AI数据 | Unclear at this time. | — | 无视 | 停用 |
| Poseidon Research Crawler | Poseidon Research Crawler | 搜索引擎 | No explicit frequency provided. | — | 无视 | 停用 |
| qodercli | Qoder that helps developers build, debug, and modify softwar | AI数据 | Unclear at this time. | — | 无视 | 停用 |
| QualifiedBot | QualifiedBot | AI数据 | No explicit frequency provided. | — | 无视 | 停用 |
| Querit-SearchBot | Querit that indexes web content for their search API service | AI数据 | Unclear at this time. | — | 无视 | 停用 |
| QueritBot | Querit, a company providing a search API for large language | AI数据 | Unclear at this time. | — | 无视 | 停用 |
| QuillBot | QuillBot | AI数据 | No explicit frequency provided. | — | 无视 | 停用 |
| quillbot.com | quillbot.com | AI数据 | No explicit frequency provided. | — | 无视 | 停用 |
| QwenBot | Alibaba | AI数据 | Unclear at this time. | — | 无视 | 停用 |
| Reflectionbot | Reflectionbot | AI数据 | Unclear at this time. | — | 无视 | 停用 |
| SBIntuitionsBot | SBIntuitionsBot | AI数据 | No information. | — | 遵守 | 停用 |
| SemrushBot-OCOB | SemrushBot-OCOB | AI数据 | Roughly once every 10 seconds. | — | 遵守 | 停用 |
| SemrushBot-SWA | SemrushBot-SWA | AI数据 | Roughly once every 10 seconds. | — | 遵守 | 停用 |
| Shap-User | Shap-User | AI数据 | Unclear at this time. | — | 无视 | 停用 |
| ShapBot | ShapBot | AI数据 | Unclear at this time. | — | 遵守 | 停用 |
| Sidetrade indexer bot | Sidetrade indexer bot | AI数据 | No information. | — | 无视 | 停用 |