Well, I'm still having problems with certain bots ignoring robots.txt and ROBOTS_PAGES_TO_SKIP in meta_tags.php. Yahoo absolves itself from any and all misbehaving bots, so there's no solution to be found on their end. From an SEO standpoint, there's nothing on my end that would contribute to this (and nothing relevant in htaccess). So, since we're all using ZC, I can't be the only one who's experiencing this - or the only one who checks server stats on a regular basis (to notice it). Yahoo slurp isn't the only offender, but it is the biggest and worst.

If I can assume that certain bots are just ignoring the page-skip define, then I'm back to tweaking my robots.txt file...

When researching this topic, I found many instances where "Disallow: /cookie_usage.php" was offered as a solution. Well, in the past several years of using open source carts, that has NEVER worked for me. Besides, I'm not convinced that robots.txt works for disallowing individual pages. I have also tried disallowing the directory (e.g. /cookie_usage/), but that doesn't seem to work either.

I hate to provide too much information (in a viewable text file), but would adding the path prove more effective: "Disallow: /includes/modules/pages/cookie_usage/"? Or would "Disallow: /includes/modules/pages/cookie_usage.php" be correct?

On another note, I manually added <meta name="robots" content="noindex, nofollow"> to the headers of select pages in v1.2.7, and it seemed to work. And while I do see that in the source view of certain pages in 1.3.8a, I'm wondering if the page-skip definition is somehow being rendered ineffective. At this point, I'm just grasping at straws...