Centinel AnalyticaCrawler profiles
Crawlers Centinel can verify by source address or signature, grouped by type.
This page lists the 204 crawlers that Centinel verifies by published IP ranges, reverse DNS, or a web bot auth signature. A request that passes one of these checks comes from the operator. The crawler catalog has all 1960 crawlers, including the ones Centinel knows only by user agent. Snapshot taken 2026-09-30.
Accessibility
- Google Read Aloud, Google
- GoogleUserTriggeredFetcher, Google
Advertising
- adidxbot, Microsoft
- AdkernelTopicCrawler, Adkernel
- admantx
- AdnBot
- AdsBot-Google, Google
- AdsBot-Google-Mobile, Google
- AmazonAdBot, Amazon
- Assaybot, Index Exchange Inc.
- ContextualBot, Mobian
- ContextWebCom-AdsTxt, ContextWeb
- CriteoBot, Criteo
- Google AdsBot, Google
- Google AdSense, Google
- Google-Ads-Creatives-Assistant, Google
- Google-adstxt, Google
- Google-AdWords-Express, Google
- Google-Adwords-Instant, Google
- Google-Display-Ads-Bot, Google
- IAS crawler, Integral Ad Science
- ias-ie, Integral Ad Science
- ias-or, Integral Ad Science
- ias-va
- Mediapartners-Google, Google
- meta-externalads, Meta
- NanoInteractive, NanoInteractive
- NeuwoBot, Neuwo
- OAI-AdsBot, OpenAI
- Outbrain, Outbrain
- peer39_crawler, Peer39
- Proximic, ComScore
- PubMatic Crawler Bot, PubMatic
- PulsePoint
- Quantcastbot, Quantcast
- SmartologyBot, Smartology
- Taboola, Taboola
- Taktikal Scanner, FAST TV Ltd
- TTD Content, The Trade Desk
- YaDirectFetcher
- Yahoo Ad Monitoring, Yahoo
Aggregator
- AppleNewsBot, Apple
- GoogleProducer, Google
- Paqlebot, Paqle
- PressEngineBot, PressEngine
- SentiBot
AI Agent
- ChatGPT Agent, OpenAI
- ChatGPT Operator, OpenAI
- Google-Agent, Google
- GoogleAgent-Mariner, Google
AI Assistant
- ChatGPT-User, OpenAI
- Claude-User, Anthropic
- Claude-Web, Anthropic
- Google-NotebookLM, Google
- Meta-ExternalFetcher, Meta
- MistralAI-User, Mistral AI
- Perplexity‑User, Perplexity
AI Search
- AIWebIndex, Lyrenth
- atlassian-bot, Atlassian
- Claude-SearchBot, Anthropic
- DuckAssistbot, DuckDuckGo
- ExaSearchBot, Exa
- Meta Webindexer, Meta
- MistralAI-Index, Mistral AI
- OAI-SearchBot, OpenAI
- PerplexityBot, Perplexity
- ShapBot, Parallel Web Systems
- SofyaBot, Sofya
- YandexAdditional, Yandex
AI Training
- Amazonbot, Amazon
- anthropic-ai, Anthropic
- Applebot-Extended, Apple
- CCBot
- ClaudeBot, Anthropic
- CloudVertexBot, Google
- FacebookBot, Meta
- Google-CloudVertexBot, Google
- Google-Extended, Google
- GPTBot, OpenAI
- Meta-ExternalAgent, Meta
- Reflectionbot
Archiver
- Arquivo Web Crawler, is the Portuguese web archive
Feed Reader
- FeedBurner, FeedBurner
- FeedFetcher-Google, Google
- FlipboardRSS, Flipboard
- Google Feed Fetcher, Google
- Google Publisher Center, Google
- Inoreader, Inoreader
- NewsBlur, NewsBlur
- RSSAPI, RSSAPI
- Tickaroo ContentFetcher, Tickaroo GmbH
Monitoring
- APA WebMoni, APA - Austria Presse Agentur
- ContentKing
- Datadog, DataDog
- HostTracker, HostTracker
- IsDownBot
- NewRelicbot
- OhDear.app
- Pandalytics, Domainsbot
- Pingdom
- StatusCake, StatusCake
- Synthetic Bot, DataDog
- Testomatobot, Testomato
- updown.io, Updown
- updown.io daemon, updown.io
- UpDownBot, Updown
- UptimeRobot, Uptimerobot
- webpagetest
Other
- Bunny Optimizer, Bunny.net
- Chrome Privacy Preserving Prefetch Proxy, Google
- GitHub-Hookshot, GitHub, Inc.
- Google API, Google
- Google Digital Asset Links, Google
- Google Site Verification, Google
- Stripe, Stripe
- Stripebot, Stripe
- Tickaroo Webhook, Tickaroo GmbH
- Updownerbot, Updown
Preview
- facebookexternalhit, Meta
- GoogleImageProxy, Google
- Iframely, Iframely
- LinkedInBot, LinkedIn
- TelegramBot, Telegram
- Tickaroo LinkPreview, Tickaroo GmbH
- twitterbot
Research
- GoogleOther, Google
- GoogleOther-Image, Google
- GoogleOther-Video, Google
- StatistikHessen, Hessisches Statistisches Landesamt
Search Engine
- 360Spider, Qihoo 360
- Algolia Crawler, Algolia
- Applebot, Apple
- Baiduspider, Baidu
- Baiduspider-image, Baidu
- Baiduspider-news, Baidu
- Baiduspider-render, Baidu
- Baiduspider-video, Baidu
- BingBot, Microsoft
- Cốc Cốc, Cốc Cốc
- coccoc, Coccoc
- coccocbot-image, Cốc Cốc
- coccocbot-web, Coc Coc
- Coveo Bot, Coveo
- cXensebot
- Daum, Kakao
- DuckDuckBot, DuckDuckGo
- DuckDuckGo-Favicons-Bot, DuckDuckGo
- GeedoProductSearch, GeedoProductSearch
- Google Favicon, Google
- Google Images, Google
- Google Scholar, Google
- Google Videos, Google
- Google-Sitemaps, Google
- google-xrawler, Google
- GoogleBot, Google
- Googlebot-IA, Google
- Googlebot-Image, Google
- Googlebot-Mobile, Google
- Googlebot-News, Google
- Googlebot-Video, Google
- jobswithgptcom-bot
- kagibot, kagibot
- MojeekBot, Mojeek
- MS Search 4.0 Robot, Microsoft
- MS Search 6.0 Robot, Microsoft
- msnbot, Microsoft
- msnbot-media, Microsoft
- PetalBot
- Qwantbot, Qwant
- Seekport, SISTRIX
- Seznam, Seznam
- Sogou, Sogou
- Sogou inst spider, Sogou
- Sogou Push Spider, Sogou
- Sogou spider2, Sogou
- Sogou web spider, Sogou
- Storebot-Google, Google
- Yahoo Slurp, Yahoo
- YandexBot, Yandex
- YandexImages, Yandex
- YandexRenderResourcesBot, Yandex
- YandexVertis, Yandex
- Yeti, Naver
- Yeti by Naver, Naver
Security
- CybaaBot, Cybaa
- domains-distillery, Exaforce, Inc.
- Google-InspectionTool, Google
SEO Tool
- AhrefsBot, Ahrefs
- AhrefsSiteAudit, Ahrefs
- Barkrowler, Babbar
- DataForSeoBot, DataForSEO
- deepcrawl.com
- Google StoreBot, Google
- OnCrawl, Oncrawl
- OnCrawl Mobile, Oncrawl
- Semrushbot, Semrush
- SemrushBotBacklinks, Semrush
- SeobilityBot, Seobility
- SERankingBacklinksBot, SE Ranking
- sistrix crawler, SISTRIX
- SiteAuditBot, SiteAuditBot
- Sitebulb, Sitebulb
Social Media
- FlipboardProxy, Flipboard
- Pinterest, Pinterest