Zen Cart Logo
Forums / General Questions / Is this okay?

Is this okay?

Locked

Views: 877

Results 1 to 9 of 9
This thread is locked. New replies are disabled.
28 Apr 2010, 10:19 PM
#1
cdnbride avatar

cdnbride

Zen Follower

Join Date:
Sep 2009
Location:
Toronto, Canada
Posts:
149
Plugin Contributions:
0

Is this okay?

Hi Folks
I have a quick question... sometimes a spider crawler comes onto my site from google bot and I know this because I can see it when I use Who's Online. Now I'm assuming that its a good thing because its checking out my site etc for search results. Please correct me if I'm wrong. But today the spider crawler thing has been on my site for 6.5 hours. Is that bad, good or does it matter?
Thanks
Lisa

28 Apr 2010, 10:30 PM
#2
dbltoe avatar

dbltoe

Totally Zenned

Join Date:
Jan 2004
Location:
N of San Antonio TX
Posts:
9,792
Plugin Contributions:
14

Re: Is this okay?

Are you able to click on the highlighted link/IP? That should tell you if it is Google.

29 Apr 2010, 1:27 AM
#3
cdnbride avatar

cdnbride

Zen Follower

Join Date:
Sep 2009
Location:
Toronto, Canada
Posts:
149
Plugin Contributions:
0

Re: Is this okay?

Well when I click on the IP it opens up a page called DNSstuff dot com and gives me the following:

OrgName: Google Inc.
OrgID: GOGL
Address: I deleted this in case its somebody's personal address
City: Mountain View
StateProv: CA
PostalCode: 94043
Country: US

4 May 2010, 2:14 PM
#4
cdnbride avatar

cdnbride

Zen Follower

Join Date:
Sep 2009
Location:
Toronto, Canada
Posts:
149
Plugin Contributions:
0

Re: Is this okay?

Its been a week since I started this thread and ever since the "google" "spider" thingy has been on my site every single day for hours and hours and hours, this wasn't happening before.

Should I assume that something isn't right?

5 May 2010, 10:32 AM
#5
mprough avatar

mprough

Totally Zenned

Join Date:
Nov 2007
Location:
Woodbine, Georgia, United States
Posts:
4,286
Plugin Contributions:
39

Re: Is this okay?

Nope, as long as it IS Google (by what you posted, this would appear to be valid), then be happy. IF the crawling gets to the point that you have issues with bandwidth or connections w/ your hosting then use your robots.txt to slow the GoogleBot a bit..... But all is well.

~Melanie

5 May 2010, 11:09 AM
#6
g1smd avatar

g1smd

Zen Follower

Join Date:
Mar 2010
Location:
UK
Posts:
449
Plugin Contributions:
0

Re: Is this okay?

Check the Crawl section of your Google WebmasterTools reports and you'll see the data on how often they look at your site.

5 May 2010, 12:22 PM
#7
cdnbride avatar

cdnbride

Zen Follower

Join Date:
Sep 2009
Location:
Toronto, Canada
Posts:
149
Plugin Contributions:
0

Re: Is this okay?

mprough:

Nope, as long as it IS Google (by what you posted, this would appear to be valid), then be happy. IF the crawling gets to the point that you have issues with bandwidth or connections w/ your hosting then use your robots.txt to slow the GoogleBot a bit..... But all is well.

~Melanie

Really? Okay thanks Melanie. Its just very weird to see it there ALL of the time.
Lisa

5 May 2010, 12:23 PM
#8
cdnbride avatar

cdnbride

Zen Follower

Join Date:
Sep 2009
Location:
Toronto, Canada
Posts:
149
Plugin Contributions:
0

Re: Is this okay?

g1smd:

Check the Crawl section of your Google WebmasterTools reports and you'll see the data on how often they look at your site.

I've been using AWSTAT to look at data, thanks for the suggestion (o:

5 May 2010, 12:23 PM
#9
mprough avatar

mprough

Totally Zenned

Join Date:
Nov 2007
Location:
Woodbine, Georgia, United States
Posts:
4,286
Plugin Contributions:
39

Re: Is this okay?

We have been seeing a big increase in Google crawl time since the beginning of the year... for healthy websites anyhow :yes:

~Melanie