Minor Search Engines
Minor search engines include services such as ask.com, Duckduckgo, Mojeek, Neeva, and Qwant. Many of these are focused around privacy or offer more specialised search functions. For example Qwant, unlike many of the major search engines, doesn’t track searches, set cookies, or resell personal data to advertisers and others for enhanced targeting. Most sites tend to include the minor search engines - although they produce a fraction of the traffic of the major search engines, they nevertheless do bring in potential extra customers. They are less likely to be targeted by bot impersonators
Vendor
Bot Service
Recommendation
Description
Qwant
Qwant
Recommended
Not recommended
European search engine with additional user privacy features and neutrality. Qwant also has an agreement with Microsoft Bing which allows Qwant to complement its own results with those of Microsoft Bing.
Neeva
Neeva
Recommended
Not recommended
Neeva is a paid for Search Engine, created by ex. Google Execs. The service provides user an Ad-Free, privacy focussed experience. If you're happy for users of this service to see your site in search results, allow this crawler.
Mojeek
Mojeek
Recommended
Not recommended
MojeekBot is the web crawler for the Mojeek search engine, a UK based service with the USP they don't track users. MojeekBot should not request, whether successful or not, more than one page from your site within the same 4 second time period. MojeekBot obeys the Robot Exclusion Standard. MojeekBot will obey the first record with a User-Agent containing "MojeekBot". If there is no such record it will obey the first entry with a User-Agent of "*". MojeekBot will not retrieve any documents with a URL containing a disallowed string. Mojeek's engine obeys the no-index, no-cache and no-follow meta-tags.
Microsoft
MicrosoftPreview
Recommended
Not recommended
MicrosoftPreview generates page snapshots for Microsoft products. Note that MicrosoftPreview has "desktop" and "mobile" variants, both of which are validated by VerifiedVisitors.
Infotiger
Infotiger
Recommended
Not recommended
Infotiger is an independent Search engine with a focus on user privacy. It operates its own search index.
Huawei
Petal
Recommended
Not recommended
PetalBot is the crawler to support the Huawei Petal search engine, being delivered as part of its Mobile device OS solutions. This is being rolled out across the globe to Huawei mobile users, so expect to see a growing volume of visits from this bot. This particular example is their PC crawler.
DuckDuckGo
DuckDuckBot
Recommended
Not recommended
Yet another DuckDuckGo user agent.
Ask.com
Ask Jeeves/Teoma
Recommended
Not recommended
Teoma is the web indexing Bot for Ask, which is the search rebranded from AskJeeves. Still delivers some traffic. Obeys robots.txt
