# Semrushbot

> SemrushBot is the web crawler and search bot software that Semrush sends out to discover and collect web data for their SEO platform including backlink analytics, site audit, content research and SEO tools.

Source: https://docs.centinelanalytica.com/crawlers/semrushbot

## At a glance

- Operator: [Semrush](http://semrush.com/bot.html)
- Type: SEO Tool

The [bot directory page for Semrushbot](https://www.centinelanalytica.com/bots/semrushbot) has its robots.txt token and the steps to verify a request from it.

## How Centinel checks it

- **User agent**: The request calls itself this crawler. Anyone can send the same string.
- **IP ranges**: The operator publishes the addresses it crawls from, and Centinel checks the client address against that list.

A request that passes one of these checks is Semrushbot itself. One that only matches the user agent is reported as unverified. The match tokens, verification domains, and address feeds are not published here.

## Allowing or blocking it

The [crawler object](https://docs.centinelanalytica.com/api/crawlers.md) in the `/validate` response sets `access_allowed` to `true` only for a verified source that your tenant allowlists. A [policy rule](https://docs.centinelanalytica.com/admin/policy.md) can allow or block this crawler by its category, `SEO Tool`.

[Back to the crawler catalog](https://docs.centinelanalytica.com/concepts/crawler-catalog.md)

[Crawlers with a source check](https://docs.centinelanalytica.com/crawlers.md)