FyndSearchEngine-ReCrawler
FyndSearchEngine-ReCrawler is a web crawler operated by fynd, a search engine service. This bot specifically handles re-crawling operations to update fynd's search index with fresh content from previously indexed websites.
At a glance
- Operator: Fynd
- Type: Search Engine
- RSL category:
search
How Centinel checks it
- User agent: The request calls itself this crawler. Anyone can send the same string.
FyndSearchEngine-ReCrawler publishes nothing Centinel can check a source against, so a match reports the name and leaves the source unconfirmed. The match tokens, verification domains, and address feeds are not published here.
Allowing or blocking it
The crawler object in the /validate response sets access_allowed to true only for a verified source that your tenant allowlists. A policy rule can allow or block this crawler by its category, Search Engine.