Google Base Feeder Support Thread [OLD]

I updated the google base feed to 1.7.4. However I still have an issue where not all my products get added to the feed. Any idea what could be wrong.

I have 98 products on my site.

here is a link to my feed:

http://www.mallover.com/feed/domain_products.xml

only 46 of them are processed by googlebase.

any ideas what could be wrong.

Anybody knows why, BTW I am unable to generate a new feed!!!
If I click in generate products feed in Admin it does nothing there are no new files in feed ... and it has 777 permissions so I think there is a problem with the xml generation ...

Well, the upgrading issues are gone, now my problem is it's not generating a feed! hmmm what am I missing?

I read the thread from page 151 to the last page, but I couldn't find any explanation to this ... My online feed is outdated! I need to solve this ASAP!

Thanks countrycharm for your tips ...

numinix:

Has anyone been able to use this script with over 1000 products without editing the php.ini or .htaccess files?

I'm using an older version of this mod.
I have a store with 1,005 products I have no issues at all using this mod with this store.

However, I also have other stores with more than 10,000 products, no luck with those with or without editing the php.ini or .htaccess files.

BTW, can someone tell me if the if the latest version of this mod supports GoogleBase UK and/or Germany, as well as the latest changes introduced by GoogleBase (item condition, specific product category according to GB, etc)?

icecold:

Well, the upgrading issues are gone, now my problem is it's not generating a feed! hmmm what am I missing?

I read the thread from page 151 to the last page, but I couldn't find any explanation to this ... My online feed is outdated! I need to solve this ASAP!

Thanks countrycharm for your tips ...
Make sure your feed cache is set to 777
Go to your store admin/configurations/google_base_feeder_configurations and cut on the debug and create another feed and see what errors it tells you there.
If that don't show anything lets try one more thing Look in your server root for a file named php.ini. If you don't have one create/open a file called php.ini and add the following lines:
max_execution_time = 300
max_input_time = 90
memory_limit = 32M

countrycharm:

Make sure your feed cache is set to 777
Go to your store admin/configurations/google_base_feeder_configurations and cut on the debug and create another feed and see what errors it tells you there.
If that don't show anything lets try one more thing Look in your server root for a file named php.ini. If you don't have one create/open a file called php.ini and add the following lines:

I tried the above and my feed is only processing 46/91 products .. any ideas ?

dannyd:

I tried the above and my feed is only processing 46/91 products .. any ideas ?

What version of Google base are you using?
Have you ran the GOOGLE_BASE_DEBUG yet? If not run that and see what kind of errors it's showing if any.

dannyd:

I tried the above and my feed is only processing 46/91 products .. any ideas ?

I am running the latest version of Google Base 1.7.4 I replaced this portion of the xml sanitizer code in includes/classes/google_base.php in 1.7.4 with the one from 1.7.0a
This is what version 1.7.4 looks like

// sanitizes code for XML
function google_base_xml_sanitizer($str, $cdata = false) {
$str = str_replace(array("\t" , "\n", "\r"), ' ', $str);
$str = html_entity_decode($str);
$str = strip_tags($str);
$str = htmlentities($str);
$str = utf8_encode(str_replace(array("®", "©", "™", " "), array('(r)', '(c)', '(tm)', ' '), $str));
$str = eregi_replace("[^[:alnum:][:space:].,!()'-_/+=?ÀÂÄßÈÉÊËÎÏÔÖÙÛÜàâäèéêëîïôöùûüÿÇç«»]", "", $str);
$out = "";
$length = strlen($str);
for ($i = 0; $i < $length; $i++) {
$current = ord($str{$i});
if ((($current == 0x9) || ($current == 0xA) || ($current == 0xD) || (($current >= 0x20) && ($current <= 0xD7FF)) || (($current >= 0xE000) && ($current <= 0xFFFD)) || (($current >= 0x10000) && ($current <= 0x10FFFF))) && ($current > 10) ) {
$out .= chr($current);
} else {
$out .= " ";
}
}
$str = trim($out);
$str = str_replace(array("<", ">"), array("<", ">"), $str);
if ($cdata) {
$str = '<![CDATA[' . $str . ']]>';
}
return $str;
}

Replace with this one from 1.7.0a

// sanitizes code for XML
function google_base_xml_sanitizer($str, $cdata = false) {
$_strip_search = array("![\t ]+$|^[\t ]+!m",'%[\r\n]+%m'); // remove CRs and newlines
$_strip_replace = array('',' ');
$_cleaner_array = array(">" => "> ", "®" => "", "®" => "", "™" => "", "™" => "", "\t" => "", " " => "");
$str = html_entity_decode($str);
$str = strtr($str, $_cleaner_array);
$str = preg_replace($_strip_search, $strip_replace, $str);
$str = strip_tags($str);
$str = eregi_replace("[^[:alnum:][:space:].,!()'-/+=?äÂÄöÖüÜß]", "", $str);
$str = utf8_encode(htmlentities($str));
//$str = $str;
$str = str_replace('&', '&', $str);
//if (!$cdata) {
//$str = htmlentities(html_entity_decode($str));
//$in = $out = array();
//$in[] = "®"; $out[] = '(r)';
//$in[] = "©"; $out[] = '(c)';
//$in[] = "™"; $out[] = '(tm)';
//$str = html_translate($str);
$str = trim($str);
if ($cdata) {
$str = '<![CDATA[' . $str . ']]>';
}
return $str;
}

Make sure you Include Zero Quantity" is ON and it is included all your items.
Create another feed and see what happens. Hope this helps.

When I go into the cpanel to add a cron job

Am I suppose to add 0 5 * * *

in the "Command to run:" 0 5 * * * GET http://www.tack2u.co.uk/googlefroogle.php?feed=fy_uy_tp

if it gives me the options on when to run in underneath?

sorry I went into the Advanced (Unix Style) option and I see what its there for now.

countrycharm:

Make sure your feed cache is set to 777
Go to your store admin/configurations/google_base_feeder_configurations and cut on the debug and create another feed and see what errors it tells you there.
If that don't show anything lets try one more thing Look in your server root for a file named php.ini. If you don't have one create/open a file called php.ini and add the following lines:

Feed cache? where is it? the only feed in the store's tree is the feed directory which has 777 permissions.

My php.ini is controlled by my host I have no access to it, so I can't pass any parameters.

I am sure if I am allowed to write my own php.ini on my root folder ... with just these parameters ...

Thanks

G'day,

I think that in the function google_base_xml_sanitizer in file includes/classes/google_base.php needs the line

$str = preg_replace('/\s+/', ' ', $str);

added to replace muliple spaces with a single space, somewhere just before it finishes.

This will help Google Base Feeder's test for a description length of at least 15 characters work better.

I'm not sure how to handle this length test treating HTML entities in the sanitized description as multiple characters instead of just one caracter.

Cheers, Lloyd Borrett.

i have been reading this thread all night and cant find the solution.

Zencart 1.3.8a
Google Base Feeder 1.7.4

i am getting these errors:

Feed status summary

1153 of 1538 items inserted - Processed on Jun 14, 2009 12:15 am PDT

Detected file format: XML
Feed Level Messages
Warning: Missing recommended attribute: upc
While items missing recommended attributes will process successfully, we recommend including relevant attributes if they are available.
Item Errors - 385 items with errors
383
Missing required attribute: description
Please make sure you include all required attributes in your data feed.

Examples:
Item Nr. 	Line Nr.
15 	273
387 	7,341
390 	7,398
591 	11,217
905 	17,183
36
Missing title
You must enter an item title. "Title" is a required attribute.

Examples:
Item Nr. 	Line Nr.
111 	2,097
118 	2,230
288 	5,460
1,415 	26,873
1,420 	26,968
Item Warnings - 382 items with warnings
380
Invalid encoding
Some of the characters in your data feed seem to be invalid. Please verify all the characters in your feed are valid for your selected encoding.
Learn more.

Examples:
Item Nr. 	Line Nr.
15 	290
387 	7,358
390 	7,415
591 	11,234
905 	17,200
36
Invalid encoding
Some of the characters in your data feed seem to be invalid. Please verify all the characters in your feed are valid for your selected encoding.
Learn more.

Examples:
Item Nr. 	Line Nr.
111 	2,098
118 	2,231
288 	5,461
1,415 	26,874
1,420 	26,969

i went back and checked the examples and all seemed fine. all of my products have Titles & Descriptions

ams30gts:

i have been reading this thread all night and cant find the solution.

Zencart 1.3.8a
Google Base Feeder 1.7.4

i am getting these errors:

Feed status summary

1153 of 1538 items inserted - Processed on Jun 14, 2009 12:15 am PDT

Detected file format: XML
Feed Level Messages
Warning: Missing recommended attribute: upc
While items missing recommended attributes will process successfully, we recommend including relevant attributes if they are available.
Item Errors - 385 items with errors
383
Missing required attribute: description
Please make sure you include all required attributes in your data feed.

Examples:
Item Nr. Line Nr.
15 273
387 7,341
390 7,398
591 11,217
905 17,183
36
Missing title
You must enter an item title. "Title" is a required attribute.

Examples:
Item Nr. Line Nr.
111 2,097
118 2,230
288 5,460
1,415 26,873
1,420 26,968
Item Warnings - 382 items with warnings
380
Invalid encoding
Some of the characters in your data feed seem to be invalid. Please verify all the characters in your feed are valid for your selected encoding.
Learn more.

Examples:
Item Nr. Line Nr.
15 290
387 7,358
390 7,415
591 11,234
905 17,200
36
Invalid encoding
Some of the characters in your data feed seem to be invalid. Please verify all the characters in your feed are valid for your selected encoding.
Learn more.

Examples:
Item Nr. Line Nr.
111 2,098
118 2,231
288 5,461
1,415 26,874
1,420 26,969

> 
> i went back and checked the examples and all seemed fine.  all of my products have Titles & Descriptions

yeah, this is something new that google base is doing now. For the last month mine were fine, then i checked it last night and now this screen pops up. 
Have you looked thru the file and see what those lines are indicating yet?

I just receive an email from GOOGLE BASE ,,, With those terms ,, I suppose lots of people use Zencart can not use google base in the future ?
(((( I AM USING ZENCART too )))

Hello,

Thank you for your email. While reviewing your data feed we noticed that
your site isn't compliant with our Program Policies. We have therefore
disabled your Google Base account.

You must own any products that you submit to Google Base and ship these
products directly to the buyer. We aren't accepting sites which sell
products on commission, including, but not limited to:

• Affiliate sites
• Comparison shopping sites
• Readymade 'wholesale' or 'drop ship' sites

Please visit
http://base.google.com/support/bin/answer.py?answer=61118&hl=en for more
details on our Program Policies.

Sincerely,

The Google Team

HI,
I run Google Base Feeder successfully , however on my other website the base file name is domain_base_us_feed ,
whenever I run the upload to google script the file uploaded is domain_base_us_feed_products , due to this extra word "products" I cannot auto update.

Any solutions ?

harry2cool:

HI,
I run Google Base Feeder successfully , however on my other website the base file name is domain_base_us_feed ,
whenever I run the upload to google script the file uploaded is domain_base_us_feed_products , due to this extra word "products" I cannot auto update.

Any solutions ?

Are you uploading to Google base manually? If so try add .xml at the end. domain_base_us_feed_products.xml If that doesn't work change the name to one word like domainbase1 it will work then.

If I upload it manually through google base website the file gets accepted, however when I run the googlefroogle.php the file does not get uploaded automatically , the word product is added after the file name.

Yes my last solution will be to create a new feed with name ending with _products , this seems to work.

Any help appreciated.

harry2cool:

If I upload it manually through google base website the file gets accepted, however when I run the googlefroogle.php the file does not get uploaded automatically , the word product is added after the file name.

Yes my last solution will be to create a new feed with name ending with _products , this seems to work.

Any help appreciated.

Why do you upload it automatically from your store admin/google base? You can just as easily let Google base get it from you automatically. Just go to Google base/Data feeds look under Schedule/create and put in the information for the time you would like Google to grab your feed. This is a lot simpler that using the store to do it.

Well the store auto upload not only uploads the feed but also updates it, this becomes totally automatic.

harry2cool:

Well the store auto upload not only uploads the feed but also updates it, this becomes totally automatic.
No your feed will be the exact same unless you set a cron to generate the feed before the time you've set for Google to parse the feed file on your server.

In response to your previous email, you are supposed to set a name in the admin like "domain" and then register your feed with Google Base as "domain_products" or "domain_documents" or "domain_news." The last part of the file name is automatically appended for each feed type to avoid overwriting other feeds.