Noindex Nofollow???

Hello everyone,

I noticed that zencart 1.3.7v comes with tag:

<meta name="robots" content="noindex, nofollow" />

on some pages that are not supposed to be indexed and does not show up on others that are supposed to be indexed. So does this mean that it is an automatic inclusion where needed. Which lead me to my next question, I have a robots.txt file as well, Do I need it

Thank you
Batteryman

That' tells the spiders and robots of search engines not to index those pages.

Hello,

I understand that, what I was asking in all that confusion of a post I wrote was, does having an actual file called robots.txt redundant?

batteryman

Depends on what is in your robots text file.

I would believe that it is the same since I had made that robots file based on another zenners thread which included all of the same information ie:

User-agent: *
Disallow: /cgi-bin/
Disallow: /images/large/
Disallow: /index.php?main_page=advanced_search
Disallow: /index.php?main_page=login
Disallow: /index.php?main_page=product_reviews_write
Disallow: /index.php?main_page=redirect
Disallow: /index.php?main_page=shopping_cart
Disallow: /index.php?main_page=tell_a_friend
Disallow: /index.php?main_page=create_account
Disallow: /index.php?main_page=checkout_shipping
Disallow: /index.php?main_page=password_forgotten
Disallow: /index.php?main_page=ask_a_question
Disallow: /index.php?main_page=product_reviews
Disallow: /index.php?main_page=address_book
Disallow: /index.php?main_page=account_notifications
Disallow: /index.php?main_page=account_password
Disallow: /index.php?main_page=account
Disallow: /index.php?main_page=account_edit
Disallow: /index.php?main_page=account_newsletters
Disallow: /index.php?main_page=cookie_usage

so have said that I guess I don't need it. Like to point out that I think that is a cool concept building the robots.txt file into zen to automatically noindex the right pages.

The zen team is doing a great job, just wanted to say thank you!

Batteryman (avel)

You might still choose to keep the disallow for your large images, but all the index.php?blahblah entries are irrelevant

Thank you Dr. Byte

Batteryman