Froogle Merchant Center merged into GoogleBase

[brimsjewelry]

bluehost may have phpftp functions disabled.. may want to ask them about it

Yep that's the problem. In fact, bluehost doesn't support phpftp. sigh...what to do?

[BlessIsaacola]

Does anyone know if there is a limitation to how many products googlefroogle can process. The mod is now timing our because we have more than 10k products. I looked in the error log and it bailed because is exceeded 60 seconds. I changed that to 120 seconds, it still did not complete the process but no error.

Any ideas?

Thanks!

[a_berezin]

Isaacola!
I add @set_time_limit(0); and do some optimization. Try this version.

v 1.2.13 25.11.2006 17:51

[BlessIsaacola]

Isaacola!
I add @set_time_limit(0); and do some optimization. Try this version.

v 1.2.13 25.11.2006 17:51

Thanks for the update. It did not fix my problem. The error message I received is pasted below: [Sat Nov 25 12:05:23 2006] [error] PHP Fatal error: Allowed memory size of 20971520 bytes exhausted (tried to allocate 20972449 bytes) in /****/googlefroogle.php on line 131. I am going to change php.ini to memory_limit = 30M and see if that works.

Geez, I used to have this set at 8M, then changed it to 20M for this mod when I first got the error and now is looking for more. This thing is memory hungry :)

How come this needs so much memory and Easy Populate generates the googlebase file just fine?

Thanks!

[BlessIsaacola]

Andrew, I have exhausted my limited knowledge and I still cannot get this complete the process. The file hangs everytime before completing the creation of the frogle text file. The only thing that changed today is our product offering went from 5525 to 11,117. Any ideas?

Thanks!

[a_berezin]

BlessIsaacola!
I add some statistic to googlefroogle.php. You can see something interesting:

Execution time:
Function			Execution time	Percent
zen_froogle_fwrite		0.023367	0.52%
zen_froogle_sanita		0.061071	1.35%
zen_froogle_category_tree	0.128599	2.85%
$products->mySQL		0.082445	1.83%
zen_get_tax_rate(cached)	0.023425	0.48%
zen_get_products_actual_price	3.128807	69.35%
zen_add_tax			0.009057	0.2%
$currencies->value		0.007719	0.17%
zen_get_info_page		0.598652	11.84%
zen_href_link			0.026346	0.52%
main_product_image.php		0.366336	8.12%
zen_froogle_expiration_date	0.006011	0.13%
zen_froogle_get_category	0.019781	0.44%
Other				0.077633	1.72%
Total				4.511542	100%
Froogle File Complete In 4.511542 Seconds 116 Records

The basic time is spent by the following standard zen functions:
zen_get_products_actual_price - 69.35% (!!!)
zen_get_info_page - 11.84%
main_product_image.php - 8.12%

[a_berezin]

BlessIsaacola!

The basic time is spent by the following standard zen functions:
zen_get_products_actual_price - 69.35% (!!!)
zen_get_info_page - 11.84%
main_product_image.php - 8.12%

1. Use products_price_sorter field instead of function zen_get_products_actual_price;
2. Use selected type_handler field instead of function zen_get_info_page;
Test this one.

[BlessIsaacola]

BlessIsaacola!

1. Use products_price_sorter field instead of function zen_get_products_actual_price;
2. Use selected type_handler field instead of function zen_get_info_page;
Test this one.

It did not work. I got the following error:

1054 Unknown column 'databaseDELETED.m.products_id' in 'on clause'
in:
[SELECT p.products_id, p.products_model, pd.products_name, pd.products_description, p.products_image, p.products_tax_class_id, p.products_price_sorter, GREATEST(p.products_date_added, p.products_last_modified, p.products_date_available) AS base_date, m.manufacturers_name, p.products_quantity, pt.type_handler FROM products p LEFT JOIN manufacturers m USING (manufacturers_id) LEFT JOIN products_description pd USING (products_id) LEFT JOIN product_types pt ON (p.products_type=pt.type_id) WHERE p.products_status = 1 AND p.product_is_call = 0 AND p.product_is_free = 0 AND pd.language_id = 1 ORDER BY p.products_id ASC]

Please note that for security reasons, I have deleted the database name from the first line of the error.

Thanks!

[a_berezin]

OK! I replace USING by ON in sql. Test this one.
P.S. May be we goto e-mail talking?

[BlessIsaacola]

OK! I replace USING by ON in sql. Test this one.
P.S. May be we goto e-mail talking?

I tried it again and there was no error on my screen but this error was generated in the server log: [Mon Nov 27 10:26:32 2006] [error] PHP Fatal error: Allowed memory size of 31457280 bytes exhausted (tried to allocate 20972893 bytes) in /folderNAME/googlefroogle.php on line 227 I used to have max memory limit for script set to 10MB and I have adjusted to 30MB for this mod and it is still not enough.

Thanks!