Results 1 to 9 of 9
  1. #1
    Join Date
    Oct 2009
    Posts
    378
    Plugin Contributions
    0

    Default Google Indexing Issue With No Follow, No Index

    Hi All!

    I have have been having an issue with Google displaying my site on Search for about the past 8 months. I had installed the Ultimate SEO plugin about last November on my v 1.5.8 site and that is when my site's Google Search results rapidly started to decline. I removed the module, thinking that this was the problem, and have requested site indexing from Google once again and waited for results to recover as Google states it could take months.


    My website (nitwitcollections.com) has been active for nearly 18 years and we previously derived 30% of our sales from organic Google Search....so this has obviously impacted our site in a very negative way.

    I have again been searching for reasons why it is not showing. I do not have anything in my robots.txt that prevents it, but in using Google Search Console do a live URL inspection of a recently released product, GSC results show "URL is Not Available to Google" "Page cannot be indexed: Excluded by ‘noindex’ tag" and under indexing allowed it states "No: 'noindex' detected in 'robots' meta tag"

    I see in the /templates/common/html_header file that the code is:

    <?php if (defined('ROBOTS_PAGES_TO_SKIP') && in_array($current_page_base,explode(",",constant('ROBOTS_PAGES_TO_SKIP'))) || $current_page_base=='down_for_maintenance' || $robotsNoIndex === true) { ?>
    <meta name="robots" content="noindex, nofollow">
    <?php } ?>

    Is this noindex, nofollow code causing my problem? If so, can I change this to ALL or is there a setting in Admin->Config that is overriding?

    Any help would be greatly appreciated.

    Jeff

  2. #2
    Join Date
    Feb 2014
    Location
    Germany
    Posts
    269
    Plugin Contributions
    0

    Default Re: Google Indexing Issue With No Follow, No Index

    The code in the header file looks okay.

    Adding an url rewrite is no problem for your SERP because the indexed pages are still available with their dynamic urls and will be rewritten when a page is loaded.
    The problem is when Google has re-indexed your urls with the new SEO urls and you then go back to dynamic urls by removing the SEO plugin.

    Normally there is only a robots sample file and you normally don't need one at all.
    If you have a robots.txt then rename it and try GSC again.
    My business is GDPR compliant Webhosting and other Web Services.
    Beside that I still have a Zen Cart Shop running for Classic Vespa Spare Parts
    Locations in Germany, Spain and Finland. Other worldwide locations on demand

  3. #3
    Join Date
    Oct 2009
    Posts
    378
    Plugin Contributions
    0

    Default Re: Google Indexing Issue With No Follow, No Index

    Thanks for your help Shop Suey!

    I have tried changing the <meta name="robots" content="noindex, nofollow"> to <meta name="robots" content="index, follow"> and run a live URL test in GSC and it corrected this problem of Google not being able to index the page. I tried this in 3 other product pages from my site (live URL test) and they have now all passed and can and will be indexed.

    Thanks for the heads up on the robots.txt I will also make this change and have GSC recrawl my site.

    Thanks again!

  4. #4
    Join Date
    Feb 2014
    Location
    Germany
    Posts
    269
    Plugin Contributions
    0

    Default Re: Google Indexing Issue With No Follow, No Index

    You're welcome

    The header code is intended to give the crawler the advise to noindex stuff like popup images, under construction sites and so on.
    It's good that you can solve the problem at the moment but not the code itself is the problem (as far I could compare to mine).
    You should continue your analysis.

    BTW: your file probably should be under includes/templates/<your-template>/common/
    Last edited by Shop Suey; 28 Sep 2024 at 01:43 PM.
    My business is GDPR compliant Webhosting and other Web Services.
    Beside that I still have a Zen Cart Shop running for Classic Vespa Spare Parts
    Locations in Germany, Spain and Finland. Other worldwide locations on demand

  5. #5
    Join Date
    Oct 2009
    Posts
    378
    Plugin Contributions
    0

    Default Re: Google Indexing Issue With No Follow, No Index

    Thanks again for your help Shop Suey....and for letting me know that this likely is not the culprit.

    I will continue to monitor and and search for what is causing my issue.

  6. #6
    Join Date
    Jan 2004
    Posts
    66,411
    Blog Entries
    7
    Plugin Contributions
    81

    Default Re: Google Indexing Issue With No Follow, No Index

    Quote Originally Posted by NWCE View Post
    PHP Code:
    <?php if (defined('ROBOTS_PAGES_TO_SKIP') && in_array($current_page_base,explode(",",constant('ROBOTS_PAGES_TO_SKIP'))) || $current_page_base=='down_for_maintenance' || $robotsNoIndex === true) { ?>
      <meta name="robots" content="noindex, nofollow">
    <?php ?>
    Is this noindex, nofollow code causing my problem? If so, can I change this to ALL or is there a setting in Admin->Config that is overriding?
    If your store is outputting the noindex,nofollow tag, then it means one of the several conditions above it is true:
    - the URL of the page is main_page=xyz where xyz is in the ROBOTS_PAGES_TO_SKIP list (most stores never need to touch that list; found in extra_configures/robots_pages_to_skip.php on latest ZC version, was in meta_tags.php language file in older versions)
    - the URL of the current page is "down_for_maintenance", because ...er, well, the store is down for maintenance according to the config switch in your Admin
    - $robotsNoIndex is set to true

    What sets $robotsNoIndex to true:
    - invalid category specified in browser URL by customer visiting the page
    - product is not found in the database
    - product is in the database but status is turned off
    .

    Zen Cart - putting the dream of business ownership within reach of anyone!
    Donate to: DrByte directly or to the Zen Cart team as a whole

    Remember: Any code suggestions you see here are merely suggestions. You assume full responsibility for your use of any such suggestions, including any impact ANY alterations you make to your site may have on your PCI compliance.
    Furthermore, any advice you see here about PCI matters is merely an opinion, and should not be relied upon as "official". Official PCI information should be obtained from the PCI Security Council directly or from one of their authorized Assessors.

  7. #7
    Join Date
    Oct 2009
    Posts
    378
    Plugin Contributions
    0

    Default Re: Google Indexing Issue With No Follow, No Index

    Thank you for shedding light on the extra_configures/robots_pages_to_skip.php Dr.Byte....I really appreciate it....as you know this cart inside and out!

    I will definitely look into this and insure that it is not causing the problem as I have eliminated your other possible options as to why a product page is not being indexed.

    Thanks again for your help!

  8. #8
    Join Date
    Jan 2004
    Posts
    66,411
    Blog Entries
    7
    Plugin Contributions
    81

    Default Re: Google Indexing Issue With No Follow, No Index

    One other thing to check: If you added the product by any means other than using the Admin, did the product description get saved properly? One way a product might become "not found" is if the "description" portion of the record (which is stored in a separate db table) isn't present. It's kinda unusual for that to happen, especially if a store has only 1 language set up. But I mention it for the sake of thoroughness.
    .

    Zen Cart - putting the dream of business ownership within reach of anyone!
    Donate to: DrByte directly or to the Zen Cart team as a whole

    Remember: Any code suggestions you see here are merely suggestions. You assume full responsibility for your use of any such suggestions, including any impact ANY alterations you make to your site may have on your PCI compliance.
    Furthermore, any advice you see here about PCI matters is merely an opinion, and should not be relied upon as "official". Official PCI information should be obtained from the PCI Security Council directly or from one of their authorized Assessors.

  9. #9
    Join Date
    Oct 2009
    Posts
    378
    Plugin Contributions
    0

    Default Re: Google Indexing Issue With No Follow, No Index

    Thanks for this additional info and to check on to insure it is not causing me the problem!

    I will double check these....you never know if there was a glitch during insertion of a product....

    Thanks again....much appreciated!

 

 

Similar Threads

  1. v150 Remove no index, no follow from category with no products
    By inky100 in forum General Questions
    Replies: 4
    Last Post: 4 Oct 2018, 06:29 PM
  2. Google indexing pages with a strange URL
    By JoshAaron in forum General Questions
    Replies: 4
    Last Post: 7 Aug 2013, 04:47 PM
  3. Google not indexing with Sitemap XML
    By Retail tech in forum General Questions
    Replies: 2
    Last Post: 17 Mar 2010, 08:42 AM

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
disjunctive-egg
Zen-Cart, Internet Selling Services, Klamath Falls, OR