Easiest way and step by step to make robots.txt

I need to make a robots.txt page, but really don't understand it or know how to do this.... all I know is that I don't have one and need one... can anyone clear this up for me please?

thanks

you create a text document with notepad. Save a blank page titled robot.txt.

Now if you want to configure it, then you need to read this.

http://www.robotstxt.org/wc/exclusion.html

and

http://en.wikipedia.org/wiki/Robots.txt

and

Use the robots checker tool found here: http://tool.motoricerca.info/robots-checker.phtml

That should get you going.

JP

Using a basic file should suffice:User-agent: * Disallow:or if you also don't want your /images folder indexed, use this instead:```
User-agent: *
Disallow: /images

There are other threads discussing options in more detail. But the above will suffice to get your indexing working.  There is nothing more really "needed".

ok, thanks, just wondering, what does this mean?

User-agent: *
Disallow:

keylesslocks:

ok, thanks, just wondering, what does this mean?

User-agent: *
Disallow:

JP's post earlier has links that will explain what those mean.

Google has a tendency to list the popup_image pages.

add:

 
Disallow: /index.php?main_page=popup_image*

HI
Can some one tell me if i did it right ?

i create new txt folder and type their
User-agent: *
Disallow: /images/
Disallow: /cgi-bin/
Disallow: /mystoredemo/
Disallow: /mystore/admin/

I put it in /public_html/

Is that mean it will not go to my admin on mystore?

Do i need to also put in in the directory where mystore are?

Thank you

http://www.zen-cart.com/forum/showthread.php?t=69563 - Might want to read the above thread.