SEO Tools & Content Marketing

WooRank is a set of tools to help your business optimise its site SEO. Offering both a lightweight free crawl to encourage paid for options. The WooRank crawlers will visit every page and image asset on your site in order to provide the required data for their analysis tool to feedback to the user. Crawls are initiated on demand by its users.

Advertising optimisation and ad revenue protection suite of tools. End-to-End Advertising, Analytics and Optimization, all in one platform

TBC

seo and link tools

Tailor and Analyze SEO projects

cityreview bot provides users with search engine optimization (SEO) performance indicators for any desired domain. Since 2008, the Toolbox has been automatically gathering important data on practically every possible domain. Toolbox is one of the most popular search SEO tools in Germany.

Serpstat is an SEO platform used by marketeers to plan and monitor their campaigns. The bot constantly crawls the web to add new links to their database and monitor existing, known links. It follows Robots.txt commands.

SEO tool automates web site checks, to optimise your SEO. From basic tagging, to mobile optimisation. Providers competitor analysis.

Seostar provides a comprehensive toolkit for SEO Experts. It may be crawling your site because you are a customer of theirs, or because they are building their database, you should decide if you want this crawler on your site.

SEO suite of tools

The SEOkicks web crawlers specifically search the Internet for content for further processing.

SEO tools

This is the SEMrush on-page SEO checker crawler. Its purpose is to check a page for compliance with SEO on and off page best practice.

Enterprise SEO and content marketing platform which connects your SEO tactics and strategy directly to revenue.

UK based SEO applications, crawls each URL for all the content and meta-data. If you don't want competitors to see all your pages and SEO terms then block.

SEO suite of tools

SEO and analytics tools. The bot collects data from your competitors so you can compare keyword rankings with your rivals, and analyses your web pages for errors

Now part of Oracle, Grapeshot assists advertisers to contextually place adverts on pages, to do this it is necessary to examine, or crawl, the page to determine which category, or categories, it best matches.

Rogerbot is the Moz crawler for Moz Pro Campaign site audits. It is different from Dotbot, which is their web crawler which powers the Moz Links index. Rogerbot accesses the code of your site to deliver reports back to your Moz Pro Campaign, serving up data for your Site Crawl report, On-Demand Crawl, Page Optimisation report and On-Page Grader. If you use Moz it's likely you'll see Rogerbot weekly.

MegaIndex is a competitive intelligence suite for online marketing, from SEO and PPC to social media and advertising research. It allows its subscribers to find out what pages are seen in search results for a keyword, collect keywords for SEO and PPC campaigns, benchmark your competitors, and find out current backlinks profile for any website.

MarketBrew scrapes sites to find keyword density and search paramaeters to power its AI driven SEO service

The Lipperhey solution allows you to analyze and optimise websites for SEO and conversation. It's own spider crawls websites its users have specified. To minimize the load from a site, the Lipperhey spider calls up every 300 ms. The spider downloads not more than 250 pages per site. It also ignores illustrations and files and any pages exceeding 125 Kb are not downloaded. The spider does respect Robots.txt.

Free recriprocal Link building service for marketeers to build their website rankings and search traffic volumes.

HubSpot builds sales databases and CRM software to help support direct marketing campaigns

London based SEO agency which uses the found crawler to enhance SEO

DeepCrawl is the world's most comprehensive website crawler. Analyse your website architecture to understand and monitor technical issues to improve SEO performance

DataForSeo provide Marketing and SEO information via an API based service targeted at Marketeers and SEO specialists. If you use their services and/or are happy for them to crawl your site, allow this service.

SEO tools and content tracking

Cocolyze is an SEO solution targeting improved business visibility. The solution allows you to analyze your own website, track your competitors and the wider market place you operate in. If you see this on your site it may be because your own team use it, or one of your competitors is checking your site out.

SEO tools

We are Australia's leading B2B media and publishing company located in Sydney. We have been building and engaging with specialised Australian audiences for over 20 years. We know our audiences and we know how to create content that moves.Learn more about our established brands and services below.

Brevo (Formerly Sendinblue) is a Marketing platform encompassing Marketing, Sales & Communications. If your business used Brevo we'd suggest allowing these crawlers.

The BrightEdge platform is aimed at Marketeers, Content Managers and SEO specialists and helps them to better understand the intent behind search queries, exposes competitors for each content topic, prioritizes efforts by forecasting business impact, guides content creation and optimization, and monitors content performance at any granularity. If your business uses this platform then allow this bot service.

All in one SEO Software to increase revenue and

This is a new version of the crawler for the linkchecker Ahrefs. This is a multi-purpose crawler which supports crawling and data gathering for all their SEO tools. Ahrefs offers a suite of SEO and search traffic monitoring & competitor research. AhrefsBot is a Web Crawler that powers the 12 trillion link database for Ahrefs online marketing toolset. It constantly crawls web to fill their database with new links and check the status of the previously found ones.Ahrefs is used by digital marketers around the world to plan, execute, and monitor their online marketing campaigns.

Hosted Status Pages with integrated Website Monitoring. Does not respect Robots.txt