# Crawler profiles > Crawlers Centinel can verify by source address or signature, grouped by type. Source: https://docs.centinelanalytica.com/crawlers This page lists the 204 crawlers that Centinel verifies by published IP ranges, reverse DNS, or a web bot auth signature. A request that passes one of these checks comes from the operator. The [crawler catalog](https://docs.centinelanalytica.com/concepts/crawler-catalog.md) has all 1960 crawlers, including the ones Centinel knows only by user agent. Snapshot taken 2026-09-30. ## Accessibility - [Google Read Aloud](https://docs.centinelanalytica.com/crawlers/google-read-aloud.md), Google - [GoogleUserTriggeredFetcher](https://docs.centinelanalytica.com/crawlers/googleusertriggeredfetcher.md), Google ## Advertising - [adidxbot](https://docs.centinelanalytica.com/crawlers/adidxbot.md), Microsoft - [AdkernelTopicCrawler](https://docs.centinelanalytica.com/crawlers/adkerneltopiccrawler.md), Adkernel - [admantx](https://docs.centinelanalytica.com/crawlers/admantx.md) - [AdnBot](https://docs.centinelanalytica.com/crawlers/adnbot.md) - [AdsBot-Google](https://docs.centinelanalytica.com/crawlers/adsbot-google.md), Google - [AdsBot-Google-Mobile](https://docs.centinelanalytica.com/crawlers/adsbot-google-mobile.md), Google - [AmazonAdBot](https://docs.centinelanalytica.com/crawlers/amazonadbot.md), Amazon - [Assaybot](https://docs.centinelanalytica.com/crawlers/assaybot.md), Index Exchange Inc. - [ContextualBot](https://docs.centinelanalytica.com/crawlers/contextualbot.md), Mobian - [ContextWebCom-AdsTxt](https://docs.centinelanalytica.com/crawlers/contextwebcom-adstxt.md), ContextWeb - [CriteoBot](https://docs.centinelanalytica.com/crawlers/criteobot.md), Criteo - [Google AdsBot](https://docs.centinelanalytica.com/crawlers/google-adsbot.md), Google - [Google AdSense](https://docs.centinelanalytica.com/crawlers/google-adsense.md), Google - [Google-Ads-Creatives-Assistant](https://docs.centinelanalytica.com/crawlers/google-ads-creatives-assistant.md), Google - [Google-adstxt](https://docs.centinelanalytica.com/crawlers/google-adstxt.md), Google - [Google-AdWords-Express](https://docs.centinelanalytica.com/crawlers/google-adwords-express.md), Google - [Google-Adwords-Instant](https://docs.centinelanalytica.com/crawlers/google-adwords-instant.md), Google - [Google-Display-Ads-Bot](https://docs.centinelanalytica.com/crawlers/google-display-ads-bot.md), Google - [IAS crawler](https://docs.centinelanalytica.com/crawlers/ias-crawler.md), Integral Ad Science - [ias-ie](https://docs.centinelanalytica.com/crawlers/ias-ie.md), Integral Ad Science - [ias-or](https://docs.centinelanalytica.com/crawlers/ias-or.md), Integral Ad Science - [ias-va](https://docs.centinelanalytica.com/crawlers/ias-va.md) - [Mediapartners-Google](https://docs.centinelanalytica.com/crawlers/mediapartners-google.md), Google - [meta-externalads](https://docs.centinelanalytica.com/crawlers/meta-externalads.md), Meta - [NanoInteractive](https://docs.centinelanalytica.com/crawlers/nanointeractive.md), NanoInteractive - [NeuwoBot](https://docs.centinelanalytica.com/crawlers/neuwobot.md), Neuwo - [OAI-AdsBot](https://docs.centinelanalytica.com/crawlers/oai-adsbot.md), OpenAI - [Outbrain](https://docs.centinelanalytica.com/crawlers/outbrain.md), Outbrain - [peer39_crawler](https://docs.centinelanalytica.com/crawlers/peer39-crawler.md), Peer39 - [Proximic](https://docs.centinelanalytica.com/crawlers/proximic.md), ComScore - [PubMatic Crawler Bot](https://docs.centinelanalytica.com/crawlers/pubmatic-crawler-bot.md), PubMatic - [PulsePoint](https://docs.centinelanalytica.com/crawlers/pulsepoint.md) - [Quantcastbot](https://docs.centinelanalytica.com/crawlers/quantcastbot.md), Quantcast - [SmartologyBot](https://docs.centinelanalytica.com/crawlers/smartologybot.md), Smartology - [Taboola](https://docs.centinelanalytica.com/crawlers/taboola.md), Taboola - [Taktikal Scanner](https://docs.centinelanalytica.com/crawlers/taktikal-scanner.md), FAST TV Ltd - [TTD Content](https://docs.centinelanalytica.com/crawlers/ttd-content.md), The Trade Desk - [YaDirectFetcher](https://docs.centinelanalytica.com/crawlers/yadirectfetcher.md) - [Yahoo Ad Monitoring](https://docs.centinelanalytica.com/crawlers/yahoo-ad-monitoring.md), Yahoo ## Aggregator - [AppleNewsBot](https://docs.centinelanalytica.com/crawlers/applenewsbot.md), Apple - [GoogleProducer](https://docs.centinelanalytica.com/crawlers/googleproducer.md), Google - [Paqlebot](https://docs.centinelanalytica.com/crawlers/paqlebot.md), Paqle - [PressEngineBot](https://docs.centinelanalytica.com/crawlers/pressenginebot.md), PressEngine - [SentiBot](https://docs.centinelanalytica.com/crawlers/sentibot.md) ## AI Agent - [ChatGPT Agent](https://docs.centinelanalytica.com/crawlers/chatgpt-agent.md), OpenAI - [ChatGPT Operator](https://docs.centinelanalytica.com/crawlers/chatgpt-operator.md), OpenAI - [Google-Agent](https://docs.centinelanalytica.com/crawlers/google-agent.md), Google - [GoogleAgent-Mariner](https://docs.centinelanalytica.com/crawlers/googleagent-mariner.md), Google ## AI Assistant - [ChatGPT-User](https://docs.centinelanalytica.com/crawlers/chatgpt-user.md), OpenAI - [Claude-User](https://docs.centinelanalytica.com/crawlers/claude-user.md), Anthropic - [Claude-Web](https://docs.centinelanalytica.com/crawlers/claude-web.md), Anthropic - [Google-NotebookLM](https://docs.centinelanalytica.com/crawlers/google-notebooklm.md), Google - [Meta-ExternalFetcher](https://docs.centinelanalytica.com/crawlers/meta-externalfetcher.md), Meta - [MistralAI-User](https://docs.centinelanalytica.com/crawlers/mistralai-user.md), Mistral AI - [Perplexity‑User](https://docs.centinelanalytica.com/crawlers/perplexity-user.md), Perplexity ## AI Search - [AIWebIndex](https://docs.centinelanalytica.com/crawlers/aiwebindex.md), Lyrenth - [atlassian-bot](https://docs.centinelanalytica.com/crawlers/atlassian-bot.md), Atlassian - [Claude-SearchBot](https://docs.centinelanalytica.com/crawlers/claude-searchbot.md), Anthropic - [DuckAssistbot](https://docs.centinelanalytica.com/crawlers/duckassistbot.md), DuckDuckGo - [ExaSearchBot](https://docs.centinelanalytica.com/crawlers/exasearchbot.md), Exa - [Meta Webindexer](https://docs.centinelanalytica.com/crawlers/meta-webindexer.md), Meta - [MistralAI-Index](https://docs.centinelanalytica.com/crawlers/mistralai-index.md), Mistral AI - [OAI-SearchBot](https://docs.centinelanalytica.com/crawlers/oai-searchbot.md), OpenAI - [PerplexityBot](https://docs.centinelanalytica.com/crawlers/perplexitybot.md), Perplexity - [ShapBot](https://docs.centinelanalytica.com/crawlers/shapbot.md), Parallel Web Systems - [SofyaBot](https://docs.centinelanalytica.com/crawlers/sofyabot.md), Sofya - [YandexAdditional](https://docs.centinelanalytica.com/crawlers/yandexadditional.md), Yandex ## AI Training - [Amazonbot](https://docs.centinelanalytica.com/crawlers/amazonbot.md), Amazon - [anthropic-ai](https://docs.centinelanalytica.com/crawlers/anthropic-ai.md), Anthropic - [Applebot-Extended](https://docs.centinelanalytica.com/crawlers/applebot-extended.md), Apple - [CCBot](https://docs.centinelanalytica.com/crawlers/ccbot.md) - [ClaudeBot](https://docs.centinelanalytica.com/crawlers/claudebot.md), Anthropic - [CloudVertexBot](https://docs.centinelanalytica.com/crawlers/cloudvertexbot.md), Google - [FacebookBot](https://docs.centinelanalytica.com/crawlers/facebookbot.md), Meta - [Google-CloudVertexBot](https://docs.centinelanalytica.com/crawlers/google-cloudvertexbot.md), Google - [Google-Extended](https://docs.centinelanalytica.com/crawlers/google-extended.md), Google - [GPTBot](https://docs.centinelanalytica.com/crawlers/gptbot.md), OpenAI - [Meta-ExternalAgent](https://docs.centinelanalytica.com/crawlers/meta-externalagent.md), Meta - [Reflectionbot](https://docs.centinelanalytica.com/crawlers/reflectionbot.md) ## Archiver - [Arquivo Web Crawler](https://docs.centinelanalytica.com/crawlers/arquivo-web-crawler.md), is the Portuguese web archive ## Feed Reader - [FeedBurner](https://docs.centinelanalytica.com/crawlers/feedburner.md), FeedBurner - [FeedFetcher-Google](https://docs.centinelanalytica.com/crawlers/feedfetcher-google.md), Google - [FlipboardRSS](https://docs.centinelanalytica.com/crawlers/flipboardrss.md), Flipboard - [Google Feed Fetcher](https://docs.centinelanalytica.com/crawlers/google-feed-fetcher.md), Google - [Google Publisher Center](https://docs.centinelanalytica.com/crawlers/google-publisher-center.md), Google - [Inoreader](https://docs.centinelanalytica.com/crawlers/inoreader.md), Inoreader - [NewsBlur](https://docs.centinelanalytica.com/crawlers/newsblur.md), NewsBlur - [RSSAPI](https://docs.centinelanalytica.com/crawlers/rssapi.md), RSSAPI - [Tickaroo ContentFetcher](https://docs.centinelanalytica.com/crawlers/tickaroo-contentfetcher.md), Tickaroo GmbH ## Monitoring - [APA WebMoni](https://docs.centinelanalytica.com/crawlers/apa-webmoni.md), APA - Austria Presse Agentur - [ContentKing](https://docs.centinelanalytica.com/crawlers/contentking.md) - [Datadog](https://docs.centinelanalytica.com/crawlers/datadog.md), DataDog - [HostTracker](https://docs.centinelanalytica.com/crawlers/hosttracker.md), HostTracker - [IsDownBot](https://docs.centinelanalytica.com/crawlers/isdownbot.md) - [NewRelicbot](https://docs.centinelanalytica.com/crawlers/newrelicbot.md) - [OhDear.app](https://docs.centinelanalytica.com/crawlers/ohdear-app.md) - [Pandalytics](https://docs.centinelanalytica.com/crawlers/pandalytics.md), Domainsbot - [Pingdom](https://docs.centinelanalytica.com/crawlers/pingdom.md) - [StatusCake](https://docs.centinelanalytica.com/crawlers/statuscake.md), StatusCake - [Synthetic Bot](https://docs.centinelanalytica.com/crawlers/synthetic-bot.md), DataDog - [Testomatobot](https://docs.centinelanalytica.com/crawlers/testomatobot.md), Testomato - [updown.io](https://docs.centinelanalytica.com/crawlers/updown-io.md), Updown - [updown.io daemon](https://docs.centinelanalytica.com/crawlers/updown-io-daemon.md), updown.io - [UpDownBot](https://docs.centinelanalytica.com/crawlers/updownbot.md), Updown - [UptimeRobot](https://docs.centinelanalytica.com/crawlers/uptimerobot.md), Uptimerobot - [webpagetest](https://docs.centinelanalytica.com/crawlers/webpagetest.md) ## Other - [Bunny Optimizer](https://docs.centinelanalytica.com/crawlers/bunny-optimizer.md), Bunny.net - [Chrome Privacy Preserving Prefetch Proxy](https://docs.centinelanalytica.com/crawlers/chrome-privacy-preserving-prefetch-proxy.md), Google - [GitHub-Hookshot](https://docs.centinelanalytica.com/crawlers/github-hookshot.md), GitHub, Inc. - [Google API](https://docs.centinelanalytica.com/crawlers/google-api.md), Google - [Google Digital Asset Links](https://docs.centinelanalytica.com/crawlers/google-digital-asset-links.md), Google - [Google Site Verification](https://docs.centinelanalytica.com/crawlers/google-site-verification.md), Google - [Stripe](https://docs.centinelanalytica.com/crawlers/stripe.md), Stripe - [Stripebot](https://docs.centinelanalytica.com/crawlers/stripebot.md), Stripe - [Tickaroo Webhook](https://docs.centinelanalytica.com/crawlers/tickaroo-webhook.md), Tickaroo GmbH - [Updownerbot](https://docs.centinelanalytica.com/crawlers/updownerbot.md), Updown ## Preview - [facebookexternalhit](https://docs.centinelanalytica.com/crawlers/facebookexternalhit.md), Meta - [GoogleImageProxy](https://docs.centinelanalytica.com/crawlers/googleimageproxy.md), Google - [Iframely](https://docs.centinelanalytica.com/crawlers/iframely.md), Iframely - [LinkedInBot](https://docs.centinelanalytica.com/crawlers/linkedinbot.md), LinkedIn - [TelegramBot](https://docs.centinelanalytica.com/crawlers/telegrambot.md), Telegram - [Tickaroo LinkPreview](https://docs.centinelanalytica.com/crawlers/tickaroo-linkpreview.md), Tickaroo GmbH - [twitterbot](https://docs.centinelanalytica.com/crawlers/twitterbot.md) ## Research - [GoogleOther](https://docs.centinelanalytica.com/crawlers/googleother.md), Google - [GoogleOther-Image](https://docs.centinelanalytica.com/crawlers/googleother-image.md), Google - [GoogleOther-Video](https://docs.centinelanalytica.com/crawlers/googleother-video.md), Google - [StatistikHessen](https://docs.centinelanalytica.com/crawlers/statistikhessen.md), Hessisches Statistisches Landesamt ## Search Engine - [360Spider](https://docs.centinelanalytica.com/crawlers/360spider.md), Qihoo 360 - [Algolia Crawler](https://docs.centinelanalytica.com/crawlers/algolia-crawler.md), Algolia - [Applebot](https://docs.centinelanalytica.com/crawlers/applebot.md), Apple - [Baiduspider](https://docs.centinelanalytica.com/crawlers/baiduspider.md), Baidu - [Baiduspider-image](https://docs.centinelanalytica.com/crawlers/baiduspider-image.md), Baidu - [Baiduspider-news](https://docs.centinelanalytica.com/crawlers/baiduspider-news.md), Baidu - [Baiduspider-render](https://docs.centinelanalytica.com/crawlers/baiduspider-render.md), Baidu - [Baiduspider-video](https://docs.centinelanalytica.com/crawlers/baiduspider-video.md), Baidu - [BingBot](https://docs.centinelanalytica.com/crawlers/bingbot.md), Microsoft - [Cốc Cốc](https://docs.centinelanalytica.com/crawlers/co-c-co-c.md), Cốc Cốc - [coccoc](https://docs.centinelanalytica.com/crawlers/coccoc.md), Coccoc - [coccocbot-image](https://docs.centinelanalytica.com/crawlers/coccocbot-image.md), Cốc Cốc - [coccocbot-web](https://docs.centinelanalytica.com/crawlers/coccocbot-web.md), Coc Coc - [Coveo Bot](https://docs.centinelanalytica.com/crawlers/coveo-bot.md), Coveo - [cXensebot](https://docs.centinelanalytica.com/crawlers/cxensebot.md) - [Daum](https://docs.centinelanalytica.com/crawlers/daum.md), Kakao - [DuckDuckBot](https://docs.centinelanalytica.com/crawlers/duckduckbot.md), DuckDuckGo - [DuckDuckGo-Favicons-Bot](https://docs.centinelanalytica.com/crawlers/duckduckgo-favicons-bot.md), DuckDuckGo - [GeedoProductSearch](https://docs.centinelanalytica.com/crawlers/geedoproductsearch.md), GeedoProductSearch - [Google Favicon](https://docs.centinelanalytica.com/crawlers/google-favicon.md), Google - [Google Images](https://docs.centinelanalytica.com/crawlers/google-images.md), Google - [Google Scholar](https://docs.centinelanalytica.com/crawlers/google-scholar.md), Google - [Google Videos](https://docs.centinelanalytica.com/crawlers/google-videos.md), Google - [Google-Sitemaps](https://docs.centinelanalytica.com/crawlers/google-sitemaps.md), Google - [google-xrawler](https://docs.centinelanalytica.com/crawlers/google-xrawler.md), Google - [GoogleBot](https://docs.centinelanalytica.com/crawlers/googlebot.md), Google - [Googlebot-IA](https://docs.centinelanalytica.com/crawlers/googlebot-ia.md), Google - [Googlebot-Image](https://docs.centinelanalytica.com/crawlers/googlebot-image.md), Google - [Googlebot-Mobile](https://docs.centinelanalytica.com/crawlers/googlebot-mobile.md), Google - [Googlebot-News](https://docs.centinelanalytica.com/crawlers/googlebot-news.md), Google - [Googlebot-Video](https://docs.centinelanalytica.com/crawlers/googlebot-video.md), Google - [jobswithgptcom-bot](https://docs.centinelanalytica.com/crawlers/jobswithgptcom-bot.md) - [kagibot](https://docs.centinelanalytica.com/crawlers/kagibot.md), kagibot - [MojeekBot](https://docs.centinelanalytica.com/crawlers/mojeekbot.md), Mojeek - [MS Search 4.0 Robot](https://docs.centinelanalytica.com/crawlers/ms-search-4-0-robot.md), Microsoft - [MS Search 6.0 Robot](https://docs.centinelanalytica.com/crawlers/ms-search-6-0-robot.md), Microsoft - [msnbot](https://docs.centinelanalytica.com/crawlers/msnbot.md), Microsoft - [msnbot-media](https://docs.centinelanalytica.com/crawlers/msnbot-media.md), Microsoft - [PetalBot](https://docs.centinelanalytica.com/crawlers/petalbot.md) - [Qwantbot](https://docs.centinelanalytica.com/crawlers/qwantbot.md), Qwant - [Seekport](https://docs.centinelanalytica.com/crawlers/seekport.md), SISTRIX - [Seznam](https://docs.centinelanalytica.com/crawlers/seznam.md), Seznam - [Sogou](https://docs.centinelanalytica.com/crawlers/sogou.md), Sogou - [Sogou inst spider](https://docs.centinelanalytica.com/crawlers/sogou-inst-spider.md), Sogou - [Sogou Push Spider](https://docs.centinelanalytica.com/crawlers/sogou-push-spider.md), Sogou - [Sogou spider2](https://docs.centinelanalytica.com/crawlers/sogou-spider2.md), Sogou - [Sogou web spider](https://docs.centinelanalytica.com/crawlers/sogou-web-spider.md), Sogou - [Storebot-Google](https://docs.centinelanalytica.com/crawlers/storebot-google.md), Google - [Yahoo Slurp](https://docs.centinelanalytica.com/crawlers/yahoo-slurp.md), Yahoo - [YandexBot](https://docs.centinelanalytica.com/crawlers/yandexbot.md), Yandex - [YandexImages](https://docs.centinelanalytica.com/crawlers/yandeximages.md), Yandex - [YandexRenderResourcesBot](https://docs.centinelanalytica.com/crawlers/yandexrenderresourcesbot.md), Yandex - [YandexVertis](https://docs.centinelanalytica.com/crawlers/yandexvertis.md), Yandex - [Yeti](https://docs.centinelanalytica.com/crawlers/yeti.md), Naver - [Yeti by Naver](https://docs.centinelanalytica.com/crawlers/yeti-by-naver.md), Naver ## Security - [CybaaBot](https://docs.centinelanalytica.com/crawlers/cybaabot.md), Cybaa - [domains-distillery](https://docs.centinelanalytica.com/crawlers/domains-distillery.md), Exaforce, Inc. - [Google-InspectionTool](https://docs.centinelanalytica.com/crawlers/google-inspectiontool.md), Google ## SEO Tool - [AhrefsBot](https://docs.centinelanalytica.com/crawlers/ahrefsbot.md), Ahrefs - [AhrefsSiteAudit](https://docs.centinelanalytica.com/crawlers/ahrefssiteaudit.md), Ahrefs - [Barkrowler](https://docs.centinelanalytica.com/crawlers/barkrowler.md), Babbar - [DataForSeoBot](https://docs.centinelanalytica.com/crawlers/dataforseobot.md), DataForSEO - [deepcrawl.com](https://docs.centinelanalytica.com/crawlers/deepcrawl-com.md) - [Google StoreBot](https://docs.centinelanalytica.com/crawlers/google-storebot.md), Google - [OnCrawl](https://docs.centinelanalytica.com/crawlers/oncrawl.md), Oncrawl - [OnCrawl Mobile](https://docs.centinelanalytica.com/crawlers/oncrawl-mobile.md), Oncrawl - [Semrushbot](https://docs.centinelanalytica.com/crawlers/semrushbot.md), Semrush - [SemrushBotBacklinks](https://docs.centinelanalytica.com/crawlers/semrushbotbacklinks.md), Semrush - [SeobilityBot](https://docs.centinelanalytica.com/crawlers/seobilitybot.md), Seobility - [SERankingBacklinksBot](https://docs.centinelanalytica.com/crawlers/serankingbacklinksbot.md), SE Ranking - [sistrix crawler](https://docs.centinelanalytica.com/crawlers/sistrix-crawler.md), SISTRIX - [SiteAuditBot](https://docs.centinelanalytica.com/crawlers/siteauditbot.md), SiteAuditBot - [Sitebulb](https://docs.centinelanalytica.com/crawlers/sitebulb.md), Sitebulb ## Social Media - [FlipboardProxy](https://docs.centinelanalytica.com/crawlers/flipboardproxy.md), Flipboard - [Pinterest](https://docs.centinelanalytica.com/crawlers/pinterest.md), Pinterest