Centinel AnalyticaCentinel Analytica

LighthouseBot

LighthouseBot is a feed reader crawler operated by Lighthouse that retrieves feeds, linked item pages, and user-submitted URLs for the Lighthouse content-curation service. It checks robots.txt rules before fetching.

At a glance

How Centinel checks it

  • User agent: The request calls itself this crawler. Anyone can send the same string.

LighthouseBot publishes nothing Centinel can check a source against, so a match reports the name and leaves the source unconfirmed. The match tokens, verification domains, and address feeds are not published here.

Allowing or blocking it

The crawler object in the /validate response sets access_allowed to true only for a verified source that your tenant allowlists. A policy rule can allow or block this crawler by its category, Feed Reader.

Back to the crawler catalog