Question regarding Spiders accessing my site

[ToyPallet]

Hi everyone, I am not sure if I am posting in the right category, but hopefully someone can help me. I have a question regarding spider crawls.

I have been noticing when I click "who's online" I see a lot of "YSpider" logs. Is this normal? I am finding out that this is throwing off my products viewed and probably visitor hit counter as well. Is there any way to prevent this?

Under the Store tab in the "Sessions" option my "prevent spider sessions" is turned on. I also changed the session name from (ZenID) to (SESID) in includes/init_includes (I forget what specific file it was).

I did all the above and still see "YSpiders" accessing my page through my "Who's online" tab. What else do I need to do to prevent this, I don't want interior pages of my site indexed, just the "www.mysitename.com indexed (added to search engines) for example.

Thank you for anyones help, everyone is so polite and helpful here :)

Ben

[afo]

You don't want to stop them from crawling your site and products. It's what allows people to find your site then searching the net.

[Get Em Fast]

afo's right, as afo always is. You might wanna take a look at THIS Google page on bots, as well. You might get a better understanding.

Hope this helps.

[ToyPallet]

Thanks for your responses. I wasn't sure if this was normal or not. I noticed alot of pages were being viewed, but figured a lot of those numbers were from spiders and not actual people viewing them.