10 Most Used WordPress Crawlers Plugins

  • GM Block Bots

    This blocks semalt.com, buttons-for-website.com and others with a 403 Forbidden message so that they no longer show up in your Google Analytics stats.

  • Multipart robots.txt editor

    Customize your site's robots.txt and include remote content to it

    no screenshot found
  • SEO Crawlytics by Elevatelocal

    SEO Crawlytics helps you gain a better understanding of the behaviour of robots.

    no screenshot found
  • LJPL Armored robots.txt

    Add some directives to your robots.txt file to keep your site safer

    no screenshot found
  • MetaRobots by SEO-Sign

    The easiest way to manage meta robots tag.

    no screenshot found
  • EMAILProtect

    Protects e-mail addresses from being found by spam spiders (or any other web crawler).

    no screenshot found
  • WP Block Semalt

    Simply uses the HTTP_REFERER to determine if it's from 'Semalt', and blocks it with a nice 403 "Unauthorized" response.

    no screenshot found
  • Seo Crawlytics Data Export & Delete

    Exports all entries of Seo Crawlytics and gives you the option to delete the entries that are older than 1 month.

  • SpiderSquash

    SpiderSquash analyzes client behavior and determines whether or not a client is a legitimate user or a malicious bot.

    no screenshot found
  • RobotsWhiz

    Easy way to discourage search engines from indexing only specific pages / posts.

Leave a comment below if we missed any of your favorite crawlers plugins.

If you liked this article, then please subscribe to our mailing list. You can also find us on Twitter.

Leave a Reply

Your email address will not be published. Required fields are marked *