NewsBlur Page Fetcher is a bot operated by NewsBlur, an RSS feed reader and news aggregation service. It fetches content from websites on behalf of subscribers, with the user agent number indicating how many users are subscribed to that feed. Its operator does not commit to following robots.txt.

At a glance

Operator: NewsBlur
Type: Feed Reader

How Centinel checks it

User agent: The request calls itself this crawler. Anyone can send the same string.

NewsBlur Page Fetcher publishes nothing Centinel can check a source against, so a match reports the name and leaves the source unconfirmed. The match tokens, verification domains, and address feeds are not published here.

Allowing or blocking it

The crawler object in the /validate response sets access_allowed to true only for a verified source that your tenant allowlists. A policy rule can allow or block this crawler by its category, Feed Reader.

Back to the crawler catalog