Bot Database

Team Collaboration Tools

If you use tools tools such as Slack, they operate bots which take meta-tag data and image proxy data to preview the supported webpage directly in the tools. You can safely select all.

Vendor

Bot Service

Recommendation

Description

logotypelogotype

Yandex

Yandex Content Downloaders

Recommended

Not recommended

This bot supports the Yandex.Tracker project management solution.

logotypelogotype

Wikimedia Foundation

MediaWiki

Recommended

Not recommended

The MediaWiki software, from the WikiMedia Foundation, is used by tens of thousands of websites and thousands of companies and organizations. MediaWiki helps users collect and organize knowledge and make it available. MediaWiki is a free server-based wiki software, licensed under the GNU General Public License (GPL). It's designed to serve a website that gets millions of hits per day.MediaWiki is an extremely powerful, scalable software and a feature-rich wiki implementation that uses PHP to process and display data stored in a database, such as MySQL.Pages use MediaWiki's wikitext format, so that users without knowledge of HTML or CSS can edit them easily. When a user submits an edit to a page, MediaWiki writes it to the database, but without deleting the previous versions of the page, thus allowing easy reverts in case of vandalism or spamming. MediaWiki can manage image and multimedia files, too, which are stored in the file system. For large wikis with lots of users, MediaWiki supports caching and can be easily coupled with proxy server software. With dedicated extensions, MediaWiki can also handle structured data.

logotypelogotype

Slack

SlackBot Link Expanding

Recommended

Not recommended

This robot responds to links that Slack users post into their channels, you know the ones, where the devs get carried away! It fetches as little of the page as it can (using HTTP Range headers) to extract meta tags about the content. Specifically, we are looking for oEmbed and Twitter Card / Open Graph tags. If a page's tags refer to an image, video, or audio file, we will fetch that file as well to check validity and extract other metadata. Slack do not currently honor robots.txt files.

logotypelogotype

Slack

SlackBot

Recommended

Not recommended

This is Slacks default, does everything, kitchen sink robot. Anytime they need to make an HTTP request that is not covered by one of their other bots they use this one. Examples would include making API requests for services we integrate with or sending Outgoing Webhooks that users have configured on their teams. Slack do not currently honor robots.txt files.

logotypelogotype

Slack

Slack Image Proxy Bot

Recommended

Not recommended

This robot is used to fetch and cache images posted into Slack channels. Proxying images in this way allows Slack to hide detailed referrer information (which can include team and/or project names), and ensure these images are served over HTTPS, and improve performance. Slack does not currently respect robots.txt files.

logotypelogotype

Microsoft

Skype

Recommended

Not recommended

Skype bot for collecting information about URLs shared in chats.

logotypelogotype

Google

Google Docs

Recommended

Not recommended

This bot collects images for Google Sheets, so if your business uses GSuite, or you are happy for GSuite sheets containing links to your site to be able to gather page assets, then allow this bot. When accessing your site this bot makes a number of GET requests to collect the pages the user has linked to. It does not check for Robots.txt. Note: It is potentially possible that this feature can be used to scrape your site.

logotypelogotype

Discord

Discord

Recommended

Not recommended

All-in-one voice and text chat for gamers that's free, secure, and works on both your desktop and phone. Stop paying for TeamSpeak servers and hassling with Skype. Simplify your life.