Virtual Robots.txt
Virtual Robots.txt automatically creates a robots.txt file for your site. Your robots.txt file can be…
Plugin Tag: crawler
Robots.txt Editor
Robots.txt for WordPress
WordPress Robots.txt optimization (+ XML Sitemap) – Website traffic, SEO & ranking Booster
All-in-One SEO plugin for WordPress Robots.txt optimization with XML Sitemap detection (Yoast, Rank Math, …),…
Robots.txt rewrite
Provide the easy managment of your robots.txt from admin side. It propose you the advanced…
PHPEnkoder
Encodes mailto: links and e-mail addresses with JavaScript to stifle webcrawlers. Automatically turns plaintext e-mails…
WordPress Meta Keywords
This plugin gives you the ability to set Meta Keywords in WordPress. Under pages it…
WordPress Meta Description
With this plugin you can control the text which will be shown as description on…
bodi0`s Bots visits counter
Counts the visits from web spiders, crawlers and bots in your blog, with ability to…
DB Robots.txt
DB Robots.txt automatically creates a virtual file robots.txt including special rules for Yandex.
Block Archive.org via WordPress robots.txt
Blocks the archive.org bots through the WordPress virtual robots.txt file.
Hide Email Address
Protect email address from being collected by web crawlers.
BotRx DeTx Plugin
DeTx uses a global database of attackers (Bots) and also includes Artificial Intelligence and data…
WordPress Stop and Block bots plugin Anti bots
Real-Time Bot Protection. Anti Bots (robots), crawlers and spiders also from botnets. Increase security and…
JaspreetChahal’s wordpress bot detector lite
This plugin detects a few bots (e.g. Google, Google ads, Alta vista etc) and sends…
Page Modified
Display the results of your Page Modified crawls right within your WordPress Admin.
rexCrawler
rexCrawler is a regular expression web-crawler plugin. Able to parse websites, save data and show…
Block eCommerce Assets via robots.txt
Blocks some WooCommerce assets and Search pages that should not be indexed through robots.txt
Block Feed and Comments via robots.txt
Blocks some Feed and Comment resources in order to avoid spam bots
Robots.txt Extender
Dynamic robots.txt for Multisite! Change parameters, or don't, for each site of your network without…