Bot Database

Content Distibution Networks (CDN) and Caching Tools

These bots are used by Content Distribution Networks (CDN's) to speed up page serving from the desktop or mobile. Safe to select all.

Vendor

Bot Service

Recommendation

Description

logotypelogotype

Cloudflare

Cloudflare

Recommended

Not recommended

Cloudflare support crawler, used when Cloudflare perform diagnostics checks.

logotypelogotype

NitroPack

NitroPack

Recommended

Not recommended

NitroPack provides a website speed improvement offering to users of Wordpress and Opencart platforms. This service provides Cache warming and Image Optimization benefits to its subscribers. If you subscribe to NitroPack then please allow this Bot. This is the specific crawler for their Mobile page webhook pusher service.

logotypelogotype

MetaCDN

MetaCDN

Recommended

Not recommended

MetaCDN is Content Delivery Network (CND) which delivers web content faster worldwide using local caching servers distributed globally. This bot compiles analytics for the CDN suppliers, on page views, clicks, and other visitor data.

logotypelogotype

Cloudflare

Always Online

Recommended

Not recommended

Always online, when you are not? CloudFlare's popular CDN has a caching feature that caches a static version of your pages in case your server goes off-line called Always Online. This bot searches for the latest content and adds it to your cache. Always useful.

logotypelogotype

Cloudflare

Accelerated Mobile Pages (AMP)

Recommended

Not recommended

User agent which grabs the AMP HTML content for Cloudflare Accelerated Mobile Links solution:

logotypelogotype

Automattic

Wordpress Photon

Recommended

Not recommended

Photon is an image acceleration and modification service for Jetpack-connected WordPress sites. Converted images are cached automatically and served from the WordPress.com CDN. Images can be cropped, resized, and filtered by using a simple API controlled by GET query arguments. When Photon is enabled in Jetpack, images are updated on the fly.Select this bot if you have a Jetpack enabled Wordpress site.