Forums / General Questions / Drouplicating site - Don't want spiders to Crawl Test Site

Drouplicating site - Don't want spiders to Crawl Test Site

Locked

Started by grafx2g on 15 May 2009, 5:18 AM · Views: 1,351

Results 1 to 4 of 4
This thread is locked. New replies are disabled.
15 May 2009, 5:18 AM
#1
grafx2g avatar

grafx2g

New Zenner

Join Date:
Jan 2009
Location:
Los Angeles, CA
Posts:
69
Plugin Contributions:
0

Drouplicating site - Don't want spiders to Crawl Test Site

I have some general questions about creating a test database and making sure the test database doesn't get indexed.

How can I set up my site so that google or any bots do not crawl the site what so ever?

:blush:

We are getting ready to test live data feeds and want to test it on a test site. So I'm duplicating the website and I've set up a domain name and directory already.

What are some of the first steps I should do to make sure the pages don't get indexed on the test site? :lamo:

15 May 2009, 5:36 AM
#2
mprough avatar

mprough

Totally Zenned

Join Date:
Nov 2007
Location:
Woodbine, Georgia, United States
Posts:
4,326
Plugin Contributions:
41

Re: Drouplicating site - Don't want spiders to Crawl Test Site

includes/templates/YOUR_TEMPLATE/common/html_header.php

Somewhere is this file... like just below the title add the following line...

<meta name="robots" content="noindex, nofollow" />

Remember to remove it for launch

~Melanie

15 May 2009, 5:55 AM
#3
grafx2g avatar

grafx2g

New Zenner

Join Date:
Jan 2009
Location:
Los Angeles, CA
Posts:
69
Plugin Contributions:
0

Re: Drouplicating site - Don't want spiders to Crawl Test Site

is it that easy? i'm afraid all my pages will be indexed but are you saying the spiders will only read my site from the index page first before seeing any of the other pages.

seems to easy.

:hug:

15 May 2009, 7:26 AM
#4
mprough avatar

mprough

Totally Zenned

Join Date:
Nov 2007
Location:
Woodbine, Georgia, United States
Posts:
4,326
Plugin Contributions:
41

Re: Drouplicating site - Don't want spiders to Crawl Test Site

mprough:

includes/templates/YOUR_TEMPLATE/common/html_header.php

Somewhere is this file... like just below the title add the following line...

<meta name="robots" content="noindex, nofollow" /> ``` > > Remember to remove it for launch > > ~Melanie

This will add the command to all pages that are Zen cart