
Originally Posted by
BlessIsaacola
Actually, I already have the information for Google, Yahoo and MSN in my robot.txt.
Google Sitemap requires an index sitemap to use to identify the list and Yahoo explorer also requires a file if you're using site explorer. I was basically asking a simple question of which file to put in accounts I have been using with Yahoo for months.
Google is smart enough to read my sitemapindex.xml and go from there to grab the category, product and ezpages xml file. I am not sure how Yahoo Explorer works which is why I was asking.
The robot.txt instruction is different from how Yahoo Site Explorer and Google Sitemap works. Although, both methods are after the same information, it never hurts to give different ways for search engine to find information.
Then if your robots.txt looks something like this, and you have a site AND feed setup, authenticated and listed here, then all is good!
Code:
User-agent: *
Disallow: /catalog/
Disallow: /advanced_search.html
Disallow: /checkout_shipping.html
Disallow: /login.html
Disallow: /order/
Disallow: /shopping_cart.html
Disallow: /tell_a_friend/
Disallow: /unsubscribe.html
Disallow: /write_review/
SITEMAP: http://www.mystore.com/catalog/sitemapindex.xml
Bookmarks