PILOTBot is the source-monitoring crawler for PIL.OT, an independent private international law observatory that tracks judgments, legislation, scholarship, calls for papers and events and publishes verified records in a public archive and a monthly briefing. Its identity page declares the product token PILOTBot, states that it follows robots.txt and honours Crawl-delay and Retry-After, and says it does not bypass login, subscription or CAPTCHA controls and does not retry after HTTP 403 or 429 responses. For publicly accessible judgments, legislation and official gazette records the operator states that it records the robots.txt result but may still continue on predefined official domains and public document routes. The operator publishes no IP ranges and no reverse DNS hostnames for verification, and directs access preferences to info@pil-ot.org.

At a glance

Operator: PIL.OT
Type: Research

How Centinel checks it

User agent: The request calls itself this crawler. Anyone can send the same string.

PILOTBot publishes nothing Centinel can check a source against, so a match reports the name and leaves the source unconfirmed. The match tokens, verification domains, and address feeds are not published here.

Allowing or blocking it

The crawler object in the /validate response sets access_allowed to true only for a verified source that your tenant allowlists. A policy rule can allow or block this crawler by its category, Research.

Back to the crawler catalog