DENIC-Crawler is the web crawler operated by DENIC eG, the registry for the .de country code top level domain. DENIC states that it crawls analogously to common search engines in order to analyse technical security features in the .de zone, and that because of the large number of .de domains the crawl is currently restricted to the start page of a domain. The crawler page gives info@denic.de as the contact for technical problems with the crawler, but it does not state robots.txt compliance, describes no opt out mechanism, and DENIC publishes no IP ranges or reverse DNS hostnames for verification.

At a glance

Operator: DENIC eG
Type: Research

How Centinel checks it

User agent: The request calls itself this crawler. Anyone can send the same string.

DENIC Crawler publishes nothing Centinel can check a source against, so a match reports the name and leaves the source unconfirmed. The match tokens, verification domains, and address feeds are not published here.

Allowing or blocking it

The crawler object in the /validate response sets access_allowed to true only for a verified source that your tenant allowlists. A policy rule can allow or block this crawler by its category, Research.

Back to the crawler catalog