SemrushBot is the web crawler and search bot software that Semrush sends out to discover and collect web data for their SEO platform including backlink analytics, site audit, content research and SEO tools.

At a glance

Operator: Semrush
Type: SEO Tool

How Centinel checks it

User agent: The request calls itself this crawler. Anyone can send the same string.

Semrushbot publishes nothing Centinel can check a source against, so a match reports the name and leaves the source unconfirmed. The match tokens, verification domains, and address feeds are not published here.

Allowing or blocking it

The crawler object in the /validate response sets access_allowed to true only for a verified source that your tenant allowlists. A policy rule can allow or block this crawler by its category, SEO Tool.

Back to the crawler catalog