If this is your first visit, check our documentation. To post, register or login.
Forums / General Questions / google.bot showing as guest instead of Spyder in Admin

google.bot showing as guest instead of Spyder in Admin

Locked

Started by bigbadbob on 10 Jun 2008, 8:53 AM · Views: 3,563

Results 1 to 20 of 24
This thread is locked. New replies are disabled.
10 Jun 2008, 8:53 AM
#1
bigbadbob avatar

bigbadbob

New Zenner

Join Date:
Feb 2008
Location:
by Nuremberg Germany
Posts:
52
Plugin Contributions:
0

google.bot showing as guest instead of Spyder in Admin

While we all appreciate the google.bot paying attention to our web sites
it appears that it is a double edged sword. Within ZenCart the bot
shows up as a Guest rather than a Spyder and consequently every item
that is "viewed" comes up in the Products Viewed. This then negates the
use of Products Viewed for marketing purposes. Has anyone else had this
problem? Know of a fix?

10 Jun 2008, 2:10 PM
#2
drbyte avatar

drbyte

Sensei

Join Date:
Jan 2004
Posts:
63,512
Plugin Contributions:
176

Re: google.bot showing as guest instead of Spyder in Admin

What version of Zen Cart?
What addons do you have installed?
What version of PHP on your server?
What is your URL?

.
Zen Cart - putting the dream of business ownership within reach of anyone!
Donate to: DrByte directly or to the Zen Cart team as a whole

Remember: Any code suggestions you see here are merely suggestions. You assume full responsibility for your use of any such suggestions, including any impact ANY alterations you make to your site may have on your PCI compliance.
Furthermore, any advice you see here about PCI matters is merely an opinion, and should not be relied upon as "official". Official PCI information should be obtained from the PCI Security Council directly or from one of their authorized Assessors.

10 Jun 2008, 2:21 PM
#3
bigbadbob avatar

bigbadbob

New Zenner

Join Date:
Feb 2008
Location:
by Nuremberg Germany
Posts:
52
Plugin Contributions:
0

Re: google.bot showing as guest instead of Spyder in Admin

What version of Zen Cart?
1.3.8a

What addons do you have installed?
Hum.... I think only:
Image Handler 2.0
Ultimate_SEO_URLs_v2.106

What version of PHP on your server?
4.4.8

What is your URL?
https://www.historichomehardware.com

10 Jun 2008, 4:56 PM
#4
drbyte avatar

drbyte

Sensei

Join Date:
Jan 2004
Posts:
63,512
Plugin Contributions:
176

Re: google.bot showing as guest instead of Spyder in Admin

What are your settings in Admin->Configuration->Sessions?

.
Zen Cart - putting the dream of business ownership within reach of anyone!
Donate to: DrByte directly or to the Zen Cart team as a whole

Remember: Any code suggestions you see here are merely suggestions. You assume full responsibility for your use of any such suggestions, including any impact ANY alterations you make to your site may have on your PCI compliance.
Furthermore, any advice you see here about PCI matters is merely an opinion, and should not be relied upon as "official". Official PCI information should be obtained from the PCI Security Council directly or from one of their authorized Assessors.

10 Jun 2008, 5:20 PM
#5
bigbadbob avatar

bigbadbob

New Zenner

Join Date:
Feb 2008
Location:
by Nuremberg Germany
Posts:
52
Plugin Contributions:
0

Re: google.bot showing as guest instead of Spyder in Admin

See attached screenshot.

10 Jun 2008, 5:54 PM
#6
drbyte avatar

drbyte

Sensei

Join Date:
Jan 2004
Posts:
63,512
Plugin Contributions:
176

Re: google.bot showing as guest instead of Spyder in Admin

Well, since you've turned off the "Prevent Spider Sessions" switch, it's no wonder that spiders are affecting your stats.

You might put it back to the default setting of "true" ... unless you had a specific reason for changing it in the first place.

.
Zen Cart - putting the dream of business ownership within reach of anyone!
Donate to: DrByte directly or to the Zen Cart team as a whole

Remember: Any code suggestions you see here are merely suggestions. You assume full responsibility for your use of any such suggestions, including any impact ANY alterations you make to your site may have on your PCI compliance.
Furthermore, any advice you see here about PCI matters is merely an opinion, and should not be relied upon as "official". Official PCI information should be obtained from the PCI Security Council directly or from one of their authorized Assessors.

10 Jun 2008, 6:39 PM
#7
bigbadbob avatar

bigbadbob

New Zenner

Join Date:
Feb 2008
Location:
by Nuremberg Germany
Posts:
52
Plugin Contributions:
0

Re: google.bot showing as guest instead of Spyder in Admin

Ummmm... By setting "prevent" spyder sessions to False is two negatives. It was set to false always and I never changed it. If I am saying "FALSE to prevent", that means I am allowing Spyder sessions. If set it to TRUE, that would mean I do NOT want to allow SPYDER sessions. Or am I missing something here?

Maybe you are not understanding the problem. I WANT the Spyders, but they are now showing up for some reason as "guests" viewing the product pages. When they show as Guest, they increase the individual products viewed count. As a Spyder not. I like to see what products are being viewed by visitors and not a Spyder/BOT visitor.

10 Jun 2008, 6:49 PM
#8
gjh42 avatar

gjh42

Black Belt

Join Date:
Jul 2005
Location:
Upstate NY
Posts:
21,874
Plugin Contributions:
8

Re: google.bot showing as guest instead of Spyder in Admin

"Prevent Spider Sessions" only keeps them from showing as guests. It does not stop them from indexing your site.
And somehow you have changed it from its original (default) setting of true.

10 Jun 2008, 6:55 PM
#9
bigbadbob avatar

bigbadbob

New Zenner

Join Date:
Feb 2008
Location:
by Nuremberg Germany
Posts:
52
Plugin Contributions:
0

Re: google.bot showing as guest instead of Spyder in Admin

OK, well that is good news. I will change that! BUT, I have never even gone into the Sessions settings so am 10000% sure I did not change anything. I would have no idea why I would even change it because I never new the purpose of the setting!

Thanks, I will change it and see what happens.

10 Jun 2008, 7:19 PM
#10
gjh42 avatar

gjh42

Black Belt

Join Date:
Jul 2005
Location:
Upstate NY
Posts:
21,874
Plugin Contributions:
8

Re: google.bot showing as guest instead of Spyder in Admin

"Prevent Spider Sessions" and "Recreate Session" are both set to true in my 1.3.7 test site, where I have certainly not touched them.

I know from experience that it is possible to have changed things in early exploration and then not recall seeing them later.

10 Jun 2008, 7:21 PM
#11
bigbadbob avatar

bigbadbob

New Zenner

Join Date:
Feb 2008
Location:
by Nuremberg Germany
Posts:
52
Plugin Contributions:
0

Re: google.bot showing as guest instead of Spyder in Admin

Although Glenn, I did the change, but if you click on that setting is says:

Prevent Spider Sessions
Prevent known spiders from starting a session.

I don't really think we want to prevent the Spiders, or? I turned it to TRUE and will check it out over the next few days.

I can always turn it back to the DEFAULT setting of FALSE if it doesn't work.

10 Jun 2008, 7:28 PM
#12
gjh42 avatar

gjh42

Black Belt

Join Date:
Jul 2005
Location:
Upstate NY
Posts:
21,874
Plugin Contributions:
8

Re: google.bot showing as guest instead of Spyder in Admin

A "session" is a recorded sequence of steps with an id number. Bots can go everywhere they want (except where your site says "noindex"), but there will not be a record created for them in your admin.

10 Jun 2008, 7:38 PM
#13
bigbadbob avatar

bigbadbob

New Zenner

Join Date:
Feb 2008
Location:
by Nuremberg Germany
Posts:
52
Plugin Contributions:
0

Re: google.bot showing as guest instead of Spyder in Admin

Yes, but the Session ID of a Bot should show up as a Spyder in ZenCart's admin and not as a Guest. Both are a session. By turning off allowing the session will not only stop it from showing up as a guest, but also showing up as a Spyder. Correct?

I want to see where the Spyder is. But not show up as a guest and increase my Items viewed count.

10 Jun 2008, 7:44 PM
#14
kobra avatar

kobra

Black Belt

Join Date:
Aug 2005
Location:
Arizona
Posts:
31,500
Plugin Contributions:
4

Re: google.bot showing as guest instead of Spyder in Admin

bigbadbob,

All activity when not logged in is as "Guest"

Zen-Venom Get Bitten

10 Jun 2008, 8:21 PM
#15
gjh42 avatar

gjh42

Black Belt

Join Date:
Jul 2005
Location:
Upstate NY
Posts:
21,874
Plugin Contributions:
8

Re: google.bot showing as guest instead of Spyder in Admin

When set to the default, you will see in your admin > Tools > Who's Online the spiders identified as such with "Session ID:" blank.
Guests and logged in users will be identified and have session id's.

10 Jun 2008, 9:43 PM
#16
bigbadbob avatar

bigbadbob

New Zenner

Join Date:
Feb 2008
Location:
by Nuremberg Germany
Posts:
52
Plugin Contributions:
0

Re: google.bot showing as guest instead of Spyder in Admin

The bot that was showing up as a guest is now showing up as a spyder so it worked!

I don't think I will ever figure this stuff out!

Thanks Glenn

11 Jun 2008, 4:44 PM
#17
paffum avatar

paffum

New Zenner

Join Date:
May 2008
Location:
Long Beach, CA
Posts:
14
Plugin Contributions:
0

Re: google.bot showing as guest instead of Spyder in Admin

My Spyder session are set to TRUE, But it's been two days and this keeps showing online guest can anyone PLEASE explain to me what are crawler, spiders etc, and what i'm seeing here?

 12:06:18  	 0  	 [B]¥Spider[/B]  	66.249.73.136  	23:31:16  	11:36:12  	 
  Time Since Clicked:
    00:01:22 ago 	Session ID:
Host: crawl-66-249-73-136.googlebot.com
User Agent: Mozilla/5.0 (compatible; Googlebot/2.1; +[url]http://www.google.com/bot.html[/url])
/zencart/index.php?main_page=tell_a_friend&products_id=147
11 Jun 2008, 4:49 PM
#18
drbyte avatar

drbyte

Sensei

Join Date:
Jan 2004
Posts:
63,512
Plugin Contributions:
176

Re: google.bot showing as guest instead of Spyder in Admin

That already says that Zen Cart is seeing it as a spider.
So, it's not messing up any stats.

.
Zen Cart - putting the dream of business ownership within reach of anyone!
Donate to: DrByte directly or to the Zen Cart team as a whole

Remember: Any code suggestions you see here are merely suggestions. You assume full responsibility for your use of any such suggestions, including any impact ANY alterations you make to your site may have on your PCI compliance.
Furthermore, any advice you see here about PCI matters is merely an opinion, and should not be relied upon as "official". Official PCI information should be obtained from the PCI Security Council directly or from one of their authorized Assessors.

12 Jun 2008, 3:31 AM
#19
paffum avatar

paffum

New Zenner

Join Date:
May 2008
Location:
Long Beach, CA
Posts:
14
Plugin Contributions:
0

Re: google.bot showing as guest instead of Spyder in Admin

So it's not trying to hack my site? Well the hit counter keeps going up. Look
I just want to be sure. I'm a newbie so paranoid, Thanks.

Counter History for last 10 recorded days Session - Total
06/11/2008 801 - 839
06/10/2008 77 - 89
06/09/2008 2 - 9
06/08/2008 4 - 29
06/07/2008 30 - 104
06/06/2008 54 - 87
06/05/2008 12 - 152
06/04/2008 14 - 46
06/03/2008 6 - 70
06/02/2008 6 - 28
and

Hit Counter: 2004

26 Jun 2008, 5:48 PM
#20
charmedbytina2 avatar

charmedbytina2

Totally Zenned

Join Date:
Mar 2007
Location:
AZ
Posts:
1,890
Plugin Contributions:
0

Re: google.bot showing as guest instead of Spyder in Admin

On my site, Googlebot (or microsoft)shows as guest and creates a session id, even though Prevent Spyder Sessions is set to TRUE.

I think this is meesing with my Google Webmaster tools too - because all sitemaps now have warnings!

Also, where should my sessions be stored? I have some funly path in my admin for this - no clue where it came from!

/mnt/m1hnas39_data01/linhostssl21/content/z/e/n/zenhosting/tmp_/zen-cart-v1.3.8a-full-fileset-12112007/cache

Thanks for any insight!

Tina

Next visit, I'll capture the IP address and post it!