Zen Follower
- Join Date:
- May 2016
- Posts:
- 191
- Plugin Contributions:
- 0
Easiest Way To Block Spambots Crawling?
Hey guys,
Currently getting bombarded by Yannik, b a i d u and Poneytelecom.eu. I noticed an increased search for a particular manufacturer too. It seems to have been spammed. I tried blocking them through robots.txt, they ignore the robots.txt. I tried blocking them through .htaccess with ```
RewriteEngine On
RewriteCond %blahblahblah
RewriteRule .* - [F]
But they just come back with a new IP within seconds.
Any help would be appreciated,
Cheers,
Ash.