So, you mean just create such robot.txt file and put it in my root directory. And don't touch a thing in either my original store files or the googlesitemapadmin module? Thanks!


Quote Originally Posted by Pixxi View Post
As the error (and quantum) says, you need your robots.txt file at the top level of your site - ie. above the /catalog folder.

Well, someone has reported the error message now ...
Quote Originally Posted by quantum View Post
hi,

I don't think that ZenCart comes with a robotos.txt file as standard, you need to create one (someone correct me if I am wrong on this)

All you really need to do to create one is past the following into a notepad file, and save it to your main directory as robots.txt. The following between the ~~~~ is a sample:

~~~~

User-agent: *
Disallow: catalog/images/
Disallow: catalog/docs/
Disallow: catalog/download/
Disallow: catalog/admin/

~~~~

This file helps control whether you block or let search engine robots index your site. In this example it is telling all search engine bots that they can index anything within the site except those 4 directories.

The robots.txt file is not a necessity for your site, but it will help with MSN search as they seem to better index websites that have it.

To learn more about what it does, visit: http://www.robotstxt.org/wc/robots.html