Centinel AnalyticaCrawlers
Crawler object schema and category reference returned by the /validate endpoint.
Overview
When /validate detects a known crawler and crawler metadata is enabled for your tenant, the response includes a crawler object identifying which crawler made the request and whether it is whitelisted.
Crawler object
| Field | Type | Required | Description |
|---|---|---|---|
id | string | yes | Crawler identifier (UUID). |
name | string | yes | Human-readable name (e.g., Googlebot). |
access_allowed | boolean | yes | true if the crawler is on your allowlist, false otherwise. |
category | string | no | Human-readable category (e.g., Search Engine, AI Assistant). See Categories. |
rsl_category | string | yes | Machine-readable category key (e.g., search, ai-input). See Categories. |
Categories
Use category for display in dashboards and reports. Use rsl_category for programmatic branching — it has a smaller, stable vocabulary.
| Category (human-readable) | rsl_category (machine-readable) |
|---|---|
| AI Agent | ai-all |
| AI Assistant | ai-input |
| AI Search | ai-input |
| AI Training | ai-train |
| Search Engine | search |
| Accessibility | all |
| Advertising | all |
| Aggregator | all |
| Archiver | all |
| Feed Reader | all |
| Monitoring | all |
| Other | all |
| Preview | all |
| Research | all |
| Scraper | all |
| Security | all |
| SEO Tool | all |
| Social Media | all |