Google SitemapAdmin

[stargre]

Are you able to place a screen print up of the page in your Google Sitemaps that shows the error Google is giving you?

Sure! Since I didn't have the store under root directory, I submitted both www.bridgecampus.com and www.bridgecampus.com/catalog/ Both screen prints are attached. Thanks for your help!

[rod44]

Sure! Since I didn't have the store under root directory, I submitted both www.bridgecampus.com and www.bridgecampus.com/catalog/ Both screen prints are attached. Thanks for your help!

Well, but looking at what you have posted, it appears that the last 'validation' was about 10 days ago, and correct me if I am wrong, you have changed the robots.txt file since. If you look at the last 2 pages dated the 18th it shows success. Seems that if they WOULD crawl your site again that it would probably work.

[stargre]

Well, but looking at what you have posted, it appears that the last 'validation' was about 10 days ago, and correct me if I am wrong, you have changed the robots.txt file since. If you look at the last 2 pages dated the 18th it shows success. Seems that if they WOULD crawl your site again that it would probably work.

That's true and that's also what I am confused about. It seems that they have seen the robots.txt change, but that didn't fix the crawl 'robots.txt unreachable' problem. So, modifying robots.txt might not be the correct resolution?

[rod44]

That's true and that's also what I am confused about. It seems that they have seen the robots.txt change, but that didn't fix the crawl 'robots.txt unreachable' problem. So, modifying robots.txt might not be the correct resolution?

No, this is why you need to use the Google SiteMaps and relax. The Googlebot crawls through robots.txt SLOW, and you just have to wait for your 'number to be called' and once the recrawl is completed the page validations should change. This is one of those things you will have to wait a bit to see if it worked. But just so you know, my robots.txt looks like:

# robots.txt for http://www.hatnpatch.com/

User-agent: *
Disallow: /cgi-bin/ # these will soon disappear
Disallow: /logs/ # these will soon disappear

and they are crawling my .html pages off of that. Patience my friend,