freefind is the site search spider operated by FreeFind.com, a hosted site search service that has run since 1998 and reports serving over 200,000 websites. It reads the pages of a subscribing site so that FreeFind can build the index used to answer searches for pages on that site, and the operator states the spider always honors robots.txt. The operator's spider page documents the robots.txt user agent name as FreeFind, while the observed User-Agent carries the lowercase form freefind/2.1. FreeFind publishes no IP ranges and no reverse DNS hostnames for verification.

At a glance

Operator: FreeFind.com
Type: Search Engine
RSL category: search

How Centinel checks it

User agent: The request calls itself this crawler. Anyone can send the same string.

FreeFind Spider publishes nothing Centinel can check a source against, so a match reports the name and leaves the source unconfirmed. The match tokens, verification domains, and address feeds are not published here.

Allowing or blocking it

The crawler object in the /validate response sets access_allowed to true only for a verified source that your tenant allowlists. A policy rule can allow or block this crawler by its category, Search Engine.

Back to the crawler catalog