Google SitemapAdmin

[spinnywoman]

Hi eggrush

I had the same error messages.

Looking through this thread I realised that I did not have a robots.txt file in the root of my store per:

Originally Posted by tlsystems
The first one: "File "robots.txt" not found in save path..". For this one, I've added a file called robots.txt in which I wrote: "Sitemap: http://www.tlsystems.co.uk/sitemapindex.xml". After I've done this, the message "File "robots.txt" not found in save path.." disapeared. Was it the right way to fix it ?

I made one last night (with my own site name obviously) and uploaded it, then I resubmitted my sitemaps and checking this morning - no errors! Horray!

[dableys]

Hi y'all

i'm totally new to the zen-cart forum as in asking a question, i must say that i've had great help from reading the replies to problems i've come up against since installing my own zen-cart store, but i just can't seem to get a clear answer to the problem i'm having at the moment which is to do with installing the google sitemap add-on
I've followed all the instructions regarding installing the sitemap, at first i couldn't get the sitemap to display in (admin/tools) i could only see it in (admin/configuration) but then i did finally get it into the admin/tools section, problem is that when i try to execute it i get a 404 error saying:
Not Found
The requested URL /admin/FILENAME_GOOGLESITEMAP.php was not found on this server.

Additionally, a 404 Not Found error was encountered while trying to use an ErrorDocument to handle the request.
also the google sitemap showing up in the tools menu is displayed exactly as follows:

BOX_GOOGLESITEMAP

Is this the way it should be displayed? If anyone out there can give me a list of the directories that each of the files should be copied into (i have no override folder , couldn't get my head around it when i was setting up my cart ) i'd be most greatful. I have yet to create my products and categories list, and i have a backup of my cart so i'm not to worried yet if i mess up, although the smart thing would have been to create an overrides folder in the first place.

Please, please offer me some comprehensive help on this
Regards & Thanks in advance
Darbleys

[tlsystems]

Thx, it is working now.

I've made some modifications who may interest some people and maybe the author:

line 129, I corrected a small mistake ("EZpages" and not "category"):

message('<span style="font-weight: bold); color: red;">ERROR: Google EZPages Sitemap Generation FAILED!</span><br />' . "\n\n");

line 424, I modified the function called "GenerateEzpagesSitemap" (modifications in bold):

function GenerateEzpagesSitemap(){
    global $db;
    $where = array();
    if(GOOGLE_SITEMAP_EZPAGES_HEADER == 'true')  $where[] = '(status_header = 1 AND header_sort_order > 0)';
    if(GOOGLE_SITEMAP_EZPAGES_SIDEBOX == 'true') $where[] = '(status_sidebox = 1 AND sidebox_sort_order > 0)';
    if(GOOGLE_SITEMAP_EZPAGES_FOOTER == 'true')  $where[] = '(status_footer = 1 AND footer_sort_order > 0)';
    //$where[] = '(status_header = 1 AND header_sort_order > 0)';
    //$where[] = '(status_sidebox = 1 AND sidebox_sort_order > 0)';
    //$where[] = '(status_footer = 1 AND footer_sort_order > 0)';
    //if(sizeof($where) == 0) return false;
    $container = array();
    if(defined('TABLE_EZPAGES_TEXT')) {
      $from = "LEFT JOIN " . TABLE_EZPAGES_TEXT . " pt ON (p.pages_id = pt.pages_id)
               LEFT JOIN " . TABLE_LANGUAGES . " l ON (pt.languages_id = l.languages_id) ";
    } else {
      $from = "";
    }
    
    $where_stmt = empty($where) ? "" : " WHERE " . implode(' OR ', $where);
      
    $page_query = $db->Execute("SELECT *
                                FROM " . TABLE_EZPAGES . " p " . $from . $where_stmt . " 

                                ORDER BY sidebox_sort_order");
    while (!$page_query->EOF) {
      if($page_query->fields['alt_url_external'] == '') { // skip external link
        $lang_param = (isset($page_query->fields['code']) && $page_query->fields['code'] != DEFAULT_LANGUAGE ? '&language=' . $page_query->fields['code'] : '');
        if($page_query->fields['alt_url'] != '') { // internal link
          $link = (substr($page_query->fields['alt_url'],0,4) == 'http') ?
                  $page_query->fields['alt_url'] :
                  zen_href_link($page_query->fields['alt_url'], $lang_param, ($page_query->fields['page_is_ssl']=='0' ? 'NONSSL' : 'SSL'), false, true, true);
        } else { // use EZPage ID to create link
          $link = zen_href_link(FILENAME_EZPAGES, 'id=' . $page_query->fields['pages_id'] . ((int)$page_query->fields['toc_chapter'] != 0 ? '&chapter=' . $page_query->fields['toc_chapter'] : '') . $lang_param, ($page_query->fields['page_is_ssl']=='0' ? 'NONSSL' : 'SSL'), false);
        }
        if(!isset($this->duplicated_links[$link])) {
          $this->duplicated_links[$link] = true;
          $page_query->fields['last_date'] = null;
          if(isset($page_query->fields['date_added']) && $page_query->fields['date_added'] != null) {
            $page_query->fields['last_date'] = strtotime($page_query->fields['date_added']);
          }
          if(isset($page_query->fields['last_modified']) && $page_query->fields['last_modified'] != null) {
            $page_query->fields['last_date'] = strtotime($page_query->fields['last_modified']);
          }
          $container[$link] = array('loc' => $link,
                                    'lastmod' => $page_query->fields['last_date'],
                                    'changefreq' => GOOGLE_SITEMAP_EZPAGES_CHANGE_FREQ,
                                    'priority' => GOOGLE_SITEMAP_EZPAGES_CHANGE_PRIOR);
        }
      }
      $page_query->MoveNext();
    }
    return $this->GenerateSitemap($container, 'ezpages');
  }

I've then added the possibility to generate 2 new sitemaps: manufacturers' pages and other pages like "new products", "shipping info"...

I've added the following code:
line 39:

@define('GOOGLE_SITEMAP_OTHERPAGES_CHANGE_FREQ', 'weekly');
@define('GOOGLE_SITEMAP_OTHERPAGES_CHANGE_PRIOR', 0.5);
@define('GOOGLE_SITEMAP_MANUFACTURERS_CHANGE_FREQ', 'daily');
@define('GOOGLE_SITEMAP_MANUFACTURERS_CHANGE_PRIOR', 0.5);

line 131:

message('<br />');
if ($google->GenerateManufacturersSitemap()){
  message('Generated Google Manufacturers Sitemap Successfully' . ' - <a href="' . $google->base_url . 'manufacturers.xml" target="_blank">' . $google->base_url . 'sitemapmanufacturers.xml</a><br />' . "\n");
} else {
  $submit = false;
  message('<span style="font-weight: bold); color: red;">ERROR: Google Manufacturers Sitemap Generation FAILED!</span><br />' . "\n\n");
}

message('<br />');
if ($google->GenerateOtherpagesSitemap()){
  message('Generated Google Other Pages Sitemap Successfully' . ' - <a href="' . $google->base_url . 'otherpages.xml" target="_blank">' . $google->base_url . 'sitemapotherpages.xml</a><br />' . "\n");
} else {
  $submit = false;
  message('<span style="font-weight: bold); color: red;">ERROR: Google Other Pages Sitemap Generation FAILED!</span><br />' . "\n\n");
}

line 474:

// generate other pages sitemap data
  function GenerateManufacturersSitemap(){
    global $db;
    $languages_dir = array();
    $language_query = $db->Execute("SELECT *
                                    FROM " . TABLE_LANGUAGES);
    while (!$language_query->EOF) {
      if($language_query->fields['directory'] != ''){
        $languages_dir[$language_query->fields['code']] = $language_query->fields['directory'];
      }
      $language_query->MoveNext();
    }  
    
    $container = array();
    
    $manufacturer_query = $db->Execute("SELECT *
                                        FROM " . TABLE_MANUFACTURERS);
    while (!$manufacturer_query->EOF) {
      foreach ($languages_dir as $language_code=>$language_dir) {
        if($language_code != DEFAULT_LANGUAGE){
          $link = zen_href_link(FILENAME_DEFAULT, 'manufacturers_id='.$manufacturer_query->fields['manufacturers_id'].'&language='.$language_code);
        }
        else {
          $link = zen_href_link(FILENAME_DEFAULT, 'manufacturers_id='.$manufacturer_query->fields['manufacturers_id']);
        }
        if(!isset($this->duplicated_links[$link])) {
          $this->duplicated_links[$link] = true;
          $container[$link] = array('loc' => $link,
                                    'lastmod' => time(),
                                    'changefreq' => GOOGLE_SITEMAP_MANUFACTURERS_CHANGE_FREQ,
                                    'priority' => GOOGLE_SITEMAP_MANUFACTURERS_CHANGE_PRIOR);
        }        
      }
      $manufacturer_query->MoveNext();
    }
    return $this->GenerateSitemap($container, 'manufacturers');
  }    
  
  
  // generate other pages sitemap data
  function GenerateOtherpagesSitemap(){
    global $db;
    global $template_dir;
    $languages_dir = array();
    $language_query = $db->Execute("SELECT *
                                    FROM " . TABLE_LANGUAGES);
    while (!$language_query->EOF) {
      if($language_query->fields['directory'] != ''){
        $languages_dir[$language_query->fields['code']] = $language_query->fields['directory'];
      }
      $language_query->MoveNext();
    }  
    
    $container = array();

    foreach ($languages_dir as $language_code=>$language_dir) {

      $path_oe = DIR_FS_CATALOG . DIR_WS_LANGUAGES . $language_dir . '/html_includes/' . $template_dir;

      if ($op_dir = @dir($path_oe)) {
        while ($filename = $op_dir->read()) {
          $tmp_zen_filename = str_replace(".php", "", $filename);
          if($tmp_zen_filename != $filename) {
            $zen_filename = str_replace("define_", "", $tmp_zen_filename);
            if($zen_filename != $tmp_zen_filename){
              //echo "<br />".$filename." ".$zen_filename;
              if($language_code != DEFAULT_LANGUAGE){
                $link = zen_href_link($zen_filename, 'language='.$language_code);
              }
              else {
                $link = zen_href_link($zen_filename);
              }
              if(!isset($this->duplicated_links[$link])) {
                $this->duplicated_links[$link] = true;
                $container[$link] = array('loc' => $link,
                                          'lastmod' => filemtime($path_oe . '/' . $filename),
                                          'changefreq' => GOOGLE_SITEMAP_OTHERPAGES_CHANGE_FREQ,
                                          'priority' => GOOGLE_SITEMAP_OTHERPAGES_CHANGE_PRIOR);
              }
            }
          }
        }
      }
    }
    
    return $this->GenerateSitemap($container, 'otherpages');
  }

[a_berezin]

v 1.3.19 20.04.2008 17:24
1. Optimizing code.
2. Delete debug code from GenerateEzpagesSitemap() function :-(

[gsdcypher]

Google sitemap keeps popping warnings on my sitemaps.

URLs not followed
When we tested a sample of the URLs from your Sitemap, we found that some URLs were not accessible to Googlebot because they contained too many redirects. Please change the URLs in your Sitemap that redirect and replace them with the destination URL (the redirect target). All valid URLs will still be submitted.

It was suggested that this may be due to redirecting links. Is there a way to have the mod not include redirect links? And if so how?

Thanks!

[kitcorsa]

i have resubmited my sitemaps to google and i am not recieveing any errors anymore

[a_berezin]

You must know the address and redirect reasons.
What version of the Google SitemapAdmin?
I can add a tool to check url in sitemaps xml.

[gsdcypher]

Hi,

Zen Cart 1.3.8a
Google Sitemap Version Date 1.3.18 15.04.2008 15:20

I have many products that are copied to multiple categories...

From Google:
When we processed your Sitemap, we found that some URLs aren't accessible to Googlebot because they contain too many redirects. Please change the URLs in your Sitemap that redirect and replace them with the destination URL (the redirect target).
This category lists URLs that we were unable to completely follow, along with some information as to why. In general, keep in the mind the following to ensure Google's spiders can follow links in your site:

• Use a text browser such as Lynx to examine your site, since many search engines see your site much as Lynx would. If features such as Javascript, cookies, session IDs, frames, DHTML, or Flash keep you from seeing all of your site in a text browser, then search engine spiders may have trouble crawling your site.
• Don't use &ID= as a parameter in your URLs.
• If you use dynamic pages (for instance, the URL contains a ? character), be aware that not all search engine spiders crawl dynamic and static pages. It helps to keep the parameters short and the number of them few.
• If you are permanently redirecting from one page to another, use a permanent redirect (301).
• Where possible, use absolute rather than relative links. (For instance, when linking to another page in your site, link to www.example.com/mypage.html rather than simply mypage.html).

301 (Moved permanently) The requested page has been permanently moved to a new location. When the server returns this response (as a response to a GET or HEAD request), it automatically forwards the requestor to the new location. You should use this code to let Googlebot know that a page or site has permanently moved to a new location.

thanks!

[kitcorsa]

Hi,

Zen Cart 1.3.8a
Google Sitemap Version Date 1.3.18 15.04.2008 15:20

I have many products that are copied to multiple categories...

From Google:
When we processed your Sitemap, we found that some URLs aren't accessible to Googlebot because they contain too many redirects. Please change the URLs in your Sitemap that redirect and replace them with the destination URL (the redirect target).

This category lists URLs that we were unable to completely follow, along with some information as to why. In general, keep in the mind the following to ensure Google's spiders can follow links in your site:

• Use a text browser such as Lynx to examine your site, since many search engines see your site much as Lynx would. If features such as Javascript, cookies, session IDs, frames, DHTML, or Flash keep you from seeing all of your site in a text browser, then search engine spiders may have trouble crawling your site.
• Don't use &ID= as a parameter in your URLs.
• If you use dynamic pages (for instance, the URL contains a ? character), be aware that not all search engine spiders crawl dynamic and static pages. It helps to keep the parameters short and the number of them few.
• If you are permanently redirecting from one page to another, use a permanent redirect (301).
• Where possible, use absolute rather than relative links. (For instance, when linking to another page in your site, link to www.example.com/mypage.html rather than simply mypage.html).

301 (Moved permanently) The requested page has been permanently moved to a new location. When the server returns this response (as a response to a GET or HEAD request), it automatically forwards the requestor to the new location. You should use this code to let Googlebot know that a page or site has permanently moved to a new location.

thanks!

i had the same error, the error is got to do with you submitted a sitemap and then changed something so what the sitemap says and what google bot sees is different i belive. i just updates and pinged google again and 3 days later error was gone

[gsdcypher]

I thought that was the case with my site to, so I did the same thing. I recreated, resubmitted and re-pinged everything. It worked for a few days and then starting popping warnings again (even though I didn't change anything).

you submitted a sitemap and then changed something so what the sitemap says and what google bot sees is different i belive. i just updates and pinged google again and 3 days later error was gone