robots.txt

apologies if this is in the wrong section

when I'm using the metatag thing on seo centro its coming up with Robots: Spider robots are not allowed to spider the web page.

But it seems to be only on product pages

It was fine before the weekend. How do I fix this?

Do I even need this on my site or would I be better off with a sitemap submitted to google?

ok I've done some extra digging around and found I have a no index no follow meta name thing going on. How do I get rid of this? I've seen solutions for v1.3.8 but I'm using v1.3.9f

is it anything to do with this? (in my html_header.php)

<?php if (defined('ROBOTS_PAGES_TO_SKIP') && in_array($current_page_base,explode(",",constant('ROBOTS_PAGES_TO_SKIP'))) || $current_page_base=='down_for_maintenance' || $robotsNoIndex === true) { ?> <meta name="robots" content="noindex, nofollow" /> <?php } ?>

If I take out the "$robotsNoIndex === true" part will this work and will it mess up any other part of my site?

If you're truly using v1.3.9, then you do not need to touch the html_header.php file.