Zen Cart Logo
Forums / General Questions / Yandex spiders problem

Yandex spiders problem

Locked

Views: 2,936

Results 1 to 8 of 8
This thread is locked. New replies are disabled.
2 May 2010, 8:29 AM
#1
neckdeep avatar

neckdeep

New Zenner

Join Date:
Jan 2010
Posts:
46
Plugin Contributions:
0

Yandex spiders problem

Upgraded to the latest cart version, Linux hosting over at godiddly.

Itsy bitsy spider needs to go. The Yandex spiders have been on my site for the past 4 days, non stop. They are sucking bandwidth...and they gotta go.

It'll change IP's, but just to get it off my site....I dropped an .htaccess file in the root of my server.

<Files *>
order allow,deny
deny from yandex.ru
deny from 87.250.255.241
allow from all
</Files>

saved that as an .htaccess file with word wrap turned off.

Dropped it in the root....

500 Internal Server Error

deleted it and dropped it in the /store...

500 Internal Server Error

Am I 'tarded?

2 May 2010, 8:56 AM
#2
frank18 avatar

frank18

Deceased

Join Date:
Nov 2007
Location:
Sunny Coast, Australia
Posts:
3,427
Plugin Contributions:
2

Re: Yandex spiders problem

NeckDeep:

Upgraded to the latest cart version, Linux hosting over at godiddly.

Itsy bitsy spider needs to go. The Yandex spiders have been on my site for the past 4 days, non stop. They are sucking bandwidth...and they gotta go.

It'll change IP's, but just to get it off my site....I dropped an .htaccess file in the root of my server.

<Files *>
order allow,deny
deny from yandex.ru
deny from 87.250.255.241
allow from all
</Files>

saved that as an .htaccess file with word wrap turned off.

Dropped it in the root....

500 Internal Server Error

deleted it and dropped it in the /store...

500 Internal Server Error

Am I 'tarded?

Latest version is 1.3.9b - is that the version you are using? .htaccess issues are addressed in 1.3.9b

http://www.zen-cart.com/forum/showthread.php?t=154039

2 May 2010, 9:01 AM
#3
neckdeep avatar

neckdeep

New Zenner

Join Date:
Jan 2010
Posts:
46
Plugin Contributions:
0

Re: Yandex spiders problem

Nope. I'm using 1.3.9a... :shocking:

Too funny. Well, at least you didn't just tell me I was 'tarded.

Thank you sir. Tomorrow's project.

2 May 2010, 9:13 AM
#4
frank18 avatar

frank18

Deceased

Join Date:
Nov 2007
Location:
Sunny Coast, Australia
Posts:
3,427
Plugin Contributions:
2

Re: Yandex spiders problem

NeckDeep:

Nope. I'm using 1.3.9a... :shocking:

Too funny. Well, at least you didn't just tell me I was 'tarded.

Thank you sir. Tomorrow's project.

Easy upgrade to 1.3.9b - trust me, just did mine.

2 May 2010, 5:03 PM
#6
g1smd avatar

g1smd

Zen Follower

Join Date:
Mar 2010
Location:
UK
Posts:
449
Plugin Contributions:
0

Re: Yandex spiders problem

If you deny access to all files, and something triggers the deny, when the server goes to send the error page for the 403 error, then it too is denied. These cascading errors can effectively cause a Denial of Service on your server.

2 May 2010, 6:49 PM
#7
neckdeep avatar

neckdeep

New Zenner

Join Date:
Jan 2010
Posts:
46
Plugin Contributions:
0

Re: Yandex spiders problem

Much easier install than the upgrade to 1.3.9a. Just extract and upload the new files, digging that. Might not even need any coffee to get that done.

Think I'll try that PHP first and see if it works, otherwise I'm going to need a bad-bot page for the yandex spider.

It seems to hang out on all the form pages...been here for 4 days now, just sucking bandwidth. I don't sell to Russia....should just block the entire .ru domain and be done with it. Site is slower with it hanging around.

2 minute update: Doctor Byte....Yandex is no more. BEAUTIFUL little bit of PHP. That thing was driving me nuts.

No pink yandexes yandexing. Just pretty little white customer boxes with green shopping carts.

:clap:

2 May 2010, 7:03 PM
#8
neckdeep avatar

neckdeep

New Zenner

Join Date:
Jan 2010
Posts:
46
Plugin Contributions:
0

Re: Yandex spiders problem

4 minute update....still have the googlebots and yahoo spiders showing up, so that bit of code seems to just affect the one I didn't want.

Very cool....thanks again!