can any one help.?? Have problems sitemapping my zen cart site. Us e a program that spiders the site and creates a sitemap. It wont look any further into the store directory Ie www.blahblah/store
I have a robots file which ive blocked out every other directory
User-agent: *
Disallow: /beauty/thumbs/
Disallow: /beauty/slides/
Disallow: /images/
Disallow: /accessories/
Disallow: /apprentice/
Disallow: /beauty/
Disallow: /cutting/
Disallow: /electrical/
Disallow: /guestbook/
Disallow: /wigs/
Disallow: /nails/

And this is the result
http://www.vividwholesale.com.au
http://www.vividwholesale.com.au/home.html
http://www.vividwholesale.com.au/hair.html
http://www.vividwholesale.com.au/professional.html
http://www.vividwholesale.com.au/store
http://www.vividwholesale.com.au/shop
http://www.vividwholesale.com.au/links.html
http://www.vividwholesale.com.au/cgi...ale&id=counter
http://www.vividwholesale.com.au/training.html
http://www.vividwholesale.com.au/contact.html
http://www.vividwholesale.com.au/index.html
http://www.vividwholesale.com.au/store/ (this is where my zen is)
http://www.vividwholesale.com.au/beauty%20training
http://www.vividwholesale.com.au/nail%20course
http://www.vividwholesale.com.au/waxing
http://www.vividwholesale.com.au/hair%20training

I have ultimate urls installed
if i delete the robots file it will index everything