Jobs & Career Bots
These bots target your HR vacancy / job pages section on your website.Smaller companies don’t tend to advertise new job openings, and recruiters try and exploit the potential opportunity by aggregating the data from millions of HR / vacancy / Open positions bot searches.
Vendor
Bot Service
Recommendation
Description
Monster
Monster Jobs
Recommended
Not recommended
This bot scrapes the web for jobs and career data and uses the content for monster
MetaJob
Metajob
Recommended
Not recommended
German language job crawling bot that scrapes careers pages on websites. This bot obeys robots.txt as well the robots meta tags index / noindex and follow / nofollow. In addition the MetaJobBot follows the following "Politeness" criteria:There are at least 5 seconds between 2 consecutive accesses from the same domain and between 2 accesses is at least 7 times the last observed response times.
Kozvetlen-Allasok
Hungarian Job site
Recommended
Not recommended
Hungarian based job crawler. Crawls web pages for job listings. This bot obeys robots.txt
Jobdigger
JobDigger
Recommended
Not recommended
Netherlands based job portal collects job data for aggregation on the Dutch employment market.
