Centinel AnalyticaCentinel Analytica

GoogleBot

Googlebot is Google's web crawler that discovers and indexes web content for Google Search, including both mobile and desktop variants that crawl websites to understand their content.

At a glance

  • Operator: Google
  • Type: Search Engine
  • RSL category: search

How Centinel checks it

  • User agent: The request calls itself this crawler. Anyone can send the same string.
  • IP ranges: The operator publishes the addresses it crawls from, and Centinel checks the client address against that list.
  • Reverse DNS: The client address resolves to a hostname the operator controls, and that hostname resolves back to the same address.

A request that passes one of these checks is GoogleBot itself. One that only matches the user agent is reported as unverified. The match tokens, verification domains, and address feeds are not published here.

Allowing or blocking it

The crawler object in the /validate response sets access_allowed to true only for a verified source that your tenant allowlists. A policy rule can allow or block this crawler by its category, Search Engine.

Back to the crawler catalog