blocking spiders

[stitchnkitty]

I have had problems with Russian customers and the only thing I can think of is to block the Russian spiders. The spider is host:*.yandex.ru is there a coding for blocking this host in the htaccess. My server says all I can block thru them is the individual IPs.

Help greatly appreciated.

[joejoejoe]

If your host has the cpanel then there should be an IP blocker on there and you can put in an individual IP, or a string. But blocking the Russian version of Google just means you don't show up in their search engine - it won't block everyone in Russia. You can do an internet search and get the entire IP range to block by a country, but you can do more damage than good when you start blocking in big chunks. What exactly are your problems with the Russians, maybe there is a smarter solution?

[stitchnkitty]

We are an extremely small business. ZenCart has been a lifesaver - We are also in the business in which copywrites are extremely important. Patterns are posted on Russian sites - also I have serious problems with out of the country charge cards. and no I will not go with pay pall that possess even more problems I can not deal with. I have a gateway that processes cards when I key them in. I have dealt with overseas parcels and they do not get delivered and other multitude of issues.

[stitchnkitty]

ok so you are saying that this host is a pat of google?

[RixStix]

See post #13 by DrByte
in this thread http://www.zen-cart.com/showthread.p...283#post817283

We've used it to block quite a few spiders that we dont want to see. Some have gotten really aggressive and don't obey the rules.

We also tried the IP block within Cpanel but all that does is give a 302 redirect.

[stitchnkitty]

I am assuming this is what you are referring: Is it best to use this as is or should I modify it for the host:yandex.ru ???? and can someone specify the code modification?

Also how has this worked for you? I understand this may effect the rankings?



Create a new file: /includes/extra_configures/block_yandex_spider.php ... containing ONLY the following code:
Code:

<?php
if (stristr(strtolower($_SERVER['HTTP_USER_AGENT']), 'yandex')) {
@header("HTTP/1.1 410 Gone");
exit();
}

[RixStix]

No modifications are needed.

You asked about blocking the yandex spider. DrByte's code and instructions are specifically for blocking the Yandex spider. We have created additional files where we replaced the text yandex with the names of other unwanted spiders who show signs of not behaving well.

We haven't noticed any change in ranking.