Forums / General Questions / Spiders Robots and Web Crawlers oh my,,,what's the harm?

Spiders Robots and Web Crawlers oh my,,,what's the harm?

Views: 981

Results 1 to 6 of 6
12 Dec 2014, 6:08 PM
#1
mespe avatar

mespe

Zen Follower

Join Date:
Sep 2014
Location:
ohio
Posts:
216
Plugin Contributions:
0

Spiders Robots and Web Crawlers oh my,,,what's the harm?

Aside from knowing if it's people visiting my store or robots, is there any reason to turn off spiders. Is it just the hit counter that gets turned off? I think I want spiders crawling around so that my part numbers get some hits.

Mybe I just don't understand what's being turned off,,

12 Dec 2014, 6:18 PM
#2
mc12345678 avatar

mc12345678

Totally Zenned

Join Date:
Jul 2012
Posts:
16,908
Plugin Contributions:
2

Re: Spiders Robots and Web Crawlers oh my,,,what's the harm?

What setting are you referring to when "turning off spiders"?

While monitoring Who's Online, the setting simply changes from showing to not showing what spiders are present. I don't want to venture out on all the other possibilities without a little clarification of what is being looked at. Each individual setting has it's own meaning and result and that should be identified at the location of where the setting is modified. That said, custom coding or other plugins can modify the described system reaction which is why providing as much description of the situation as possible is important in obtaining/requesting help..

ZC Installation/Maintenance Support <- Site
Contribution for contributions welcome...

12 Dec 2014, 7:14 PM
#3
mespe avatar

mespe

Zen Follower

Join Date:
Sep 2014
Location:
ohio
Posts:
216
Plugin Contributions:
0

Re: Spiders Robots and Web Crawlers oh my,,,what's the harm?

config | sessions | prevent spider sessions

12 Dec 2014, 9:18 PM
#5
mc12345678 avatar

mc12345678

Totally Zenned

Join Date:
Jul 2012
Posts:
16,908
Plugin Contributions:
2

Re: Spiders Robots and Web Crawlers oh my,,,what's the harm?

mespe:

config | sessions | prevent spider sessions

Spiders will still troll the site with this setting such that spiders are prevented from sessions. The significant difference is that a spider will not be "awarded" a zenID. The zenID is a session that if posted/shared/cached to a search engine could cause conflicts for those that visit following that link. Ie., if two people come to the site with the same zenID in their URL, then basically they will share each other's cart. A product added by one will be seen by the other as if in their own cart...

As Design75 said, spiders should not be able to have a session...

ZC Installation/Maintenance Support <- Site
Contribution for contributions welcome...

13 Dec 2014, 5:08 AM
#6
drbyte avatar

drbyte

Sensei

Join Date:
Jan 2004
Posts:
63,513
Plugin Contributions:
176

Re: Spiders Robots and Web Crawlers oh my,,,what's the harm?

mespe:

config | sessions | prevent spider sessions
You should NOT be messing with ANY of the setting under Admin->Configuration->Sessions. The default settings should be just fine for 90% of all common server setups.

.
Zen Cart - putting the dream of business ownership within reach of anyone!
Donate to: DrByte directly or to the Zen Cart team as a whole

Remember: Any code suggestions you see here are merely suggestions. You assume full responsibility for your use of any such suggestions, including any impact ANY alterations you make to your site may have on your PCI compliance.
Furthermore, any advice you see here about PCI matters is merely an opinion, and should not be relied upon as "official". Official PCI information should be obtained from the PCI Security Council directly or from one of their authorized Assessors.