Site loads extremely slow - heavy bot traffic

[bfox2718]

In the past few days, we have started to notice our site loads EXTREMELY Slow... pages parse in 2-3 minutes if they dont time out all together.

My hosting provider told me that my site is being attached by bots, and they want to refer me to the development team to get it protected.

I find it hard to believe that we cannot more simply protect ourselves. This is what my hosting company offered up. Any suggestions that are more clear?

After further research, we've identified that your site store.foxmar.com is encountering massive traffic. Just today there's 1,326,195 requests. Going through it, it seems like different bots are contributing to this. Particularly b a i d u. I would recommend setting up robots.txt to disallow certain bots from accessing specific pages on your site.

Site is http: / / s h o p . f o x m a r .com/FoxShoppe/

In particular, the Spring Portraits Section.

Thank you in advance!

[stevesh]

Loads OK here for me this morning.

[RixStix]

We use THIS METHOD posted by DrByte to block bots and spiders that do not "Play Nice" and follow the rules.

Heed his words of Use at your own risk. We have several dozen being blocked for not playing nice.

[RodG]

We use THIS METHOD posted by DrByte to block bots and spiders that do not "Play Nice" and follow the rules.

Heed his words of Use at your own risk. We have several dozen being blocked for not playing nice.

If not already done, you should also add Yandex as one of those spiders that don't follow the rules. This one is notorious for hitting sites hard.

b a i d u is actually quite tame in comparison.

Cheers
RodG

[picandnix]

We use THIS METHOD posted by DrByte to block bots and spiders that do not "Play Nice" and follow the rules.

Heed his words of Use at your own risk. We have several dozen being blocked for not playing nice.

Many a time I've had to search for and use the post linked above by Rixstix, so I've packaged it and it's now available here http://www.zen-cart.com/downloads.php?do=file&id=1854