EasyPopulate 4.0 Support Thread

mc12345678:

The question remains (for clarity) the detailed attributes export from the same store that is having an issue with the basic attributes export, works or only a single record? Could also identify php version and zen cart version, please? Done any phpmyadmin query testing of the database? I'll go back and try to review such an old version but without understanding why this one is not displaying all of the data for you but is for others makes it difficult to diagnose or claim specifically is a problem with the software, especially when the same software was reported as installed in a different store and reported as fully functional.

I am using php 7.2 and ZC 1.5.7c.
The Detailed Attributes is working without an issue as it exports all data. Basic Attributes exports one line of data. I checked the database and the data is all there and did not see any issue. I have another site that I can run the most recent EP and see if I have a different result, but will likely get that done in the morning.

mc12345678:

Only idea(s) that come to mind is that there is some other image handling software that does something when processing through the normal admin. Standard image processing reads the database file location for TY e base product image and then uses the "rules" for images to locate the large, additional, etc. Images for that product. I know that software such as image handler processes an image when it goes through the handler. I can't recall if the user doesn't see the results until the image is loaded a second time or if it's compression is observable on the first visit.

In other words, I have no explanation to why it happens on the site in question as there is nothing that is done that should cause or allow an issue such as that.

Thanks for your help. I'm using the latest version of Zen Cart (version 1.5.7c) but this same thing has happened in the previous versions of Zen Cart as well (so which version doesn't seem to matter). Am I the only one experiencing this? So strange, as I've installed several Zen Cart stores and they all do this. I don't have any plugins other than Easy Populate. Why would clicking edit, then preview, and then save fix the problem? That's what I do to every product (hundreds of products). Very frustrating as I'm always importing new products (if I don't, the images remain small and never fix themselves). I think perhaps this problem may be happening to others but they aren't clicking on the "larger image" link so they don't realize the issue. Surely I'm not the only one?

chuckrey:

I am using php 7.2 and ZC 1.5.7c.
The Detailed Attributes is working without an issue as it exports all data. Basic Attributes exports one line of data. I checked the database and the data is all there and did not see any issue. I have another site that I can run the most recent EP and see if I have a different result, but will likely get that done in the morning.

Okay, so when say "all the data is there" what query from EP4 was executed from within phpmyadmin to validate this statement? My question here is if there is a problem with the query or how the data is handled once the query has been executed. Further what about this store is causing a difference than the other store reported to work correctly.

JNR345:

Thanks for your help. I'm using the latest version of Zen Cart (version 1.5.7c) but this same thing has happened in the previous versions of Zen Cart as well (so which version doesn't seem to matter). Am I the only one experiencing this? So strange, as I've installed several Zen Cart stores and they all do this. I don't have any plugins other than Easy Populate. Why would clicking edit, then preview, and then save fix the problem? That's what I do to every product (hundreds of products). Very frustrating as I'm always importing new products (if I don't, the images remain small and never fix themselves). I think perhaps this problem may be happening to others but they aren't clicking on the "larger image" link so they don't realize the issue. Surely I'm not the only one?

So as a "test". If you now export data that includes a product in your previous import and compare the v_products_image path between the two files, what is the difference?

If there are no other plugins installed, the images are loaded to the site via ftp or whatever and the database is updated e by either EP4 or stepping through the product update process, then the fields should be exactly the same and further neither process really does anything with the image itself. The browser on the other hand may operate differently and may require such a process to support sufficient display. What content is in the field space of the CSV file for that image field? It may be possible that "additional" information may be present that interferes with the browser's processing of the HTML. Perhaps could provide a link to one of these updated products that is not behaving properly.

mc12345678:

Okay, so when say "all the data is there" what query from EP4 was executed from within phpmyadmin to validate this statement? My question here is if there is a problem with the query or how the data is handled once the query has been executed. Further what about this store is causing a difference than the other store reported to work correctly.

I misunderstood. I checked the data within phpmyadmin but did not run a query, sorry for my confusion. Can you please advise which query I can run and I will share the results?

Also, I checked the easypopulate_4_export.php file and replaced row 222-301 with the following and it worked, all data is showing when processing Basic Attributtes. Of course the code is coming from a previous version of EP4

/ these variables are for the Attrib_Basic Export
$active_products_id = ""; // start empty
$active_options_id = ""; // start empty
$active_language_id = ""; // start empty
$active_row = array(); // empty array
$last_products_id = "";
$print1 = 0;
$result = ep_4_query($filelayout_sql);
while ($row = ($ep_uses_mysqli ? mysqli_fetch_array($result) : mysql_fetch_array($result))) {

if ($ep_dltype == 'attrib_basic') { // special case 'attrib_basic'


if ($row['v_products_id'] == $active_products_id) {
	if ($row['v_options_id'] == $active_options_id) {
		// collect the products_options_values_name
		if ($active_language_id <> $row['v_language_id']) {
			$l_id = $row['v_language_id'];
			$active_row['v_products_options_type'] = $row['v_products_options_type'];
			$active_row['v_products_options_name_'.$l_id] = $row['v_products_options_name'];
			$active_row['v_products_options_values_name_'.$l_id] = $row['v_products_options_values_name'];
			$active_language_id = $row['v_language_id'];
		} else {
			$l_id = $row['v_language_id'];
			$active_row['v_products_options_name_'.$l_id] = $row['v_products_options_name'];
			$active_row['v_products_options_values_name_'.$l_id] .= ",".$row['v_products_options_values_name'];
			$active_row['v_products_options_type'] = $row['v_products_options_type'];
		}
		continue; // loop - for more products_options_values_name on same v_products_id/v_options_id combo
	} else { // same product, new attribute - only executes once on new option
		// Clean the texts that could break CSV file formatting
		$dataRow = '';
		$problem_chars = array("\r", "\n", "\t"); // carriage return, newline, tab
		foreach($filelayout as $key => $value) {
			$thetext = $active_row[$key];
			// remove carriage returns, newlines, and tabs - needs review
			$thetext = str_replace($problem_chars,' ',$thetext);
			// encapsulate data in quotes, and escape embedded quotes in data
			$dataRow .= '"'.str_replace('"','""',$thetext).'"'.$csv_delimiter;
		}
		// Remove trailing tab, then append the end-of-line
		$dataRow = rtrim($dataRow,$csv_delimiter)."\n";
		fwrite($fp, $dataRow); // write 1 line of csv data (this can be slow...)
		$ep_export_count++;				
		
		$active_options_id = $row['v_options_id'];
		$active_language_id = $row['v_language_id'];
		$l_id = $row['v_language_id'];
		$active_row['v_products_options_name_'.$l_id] = $row['v_products_options_name'];
		$active_row['v_products_options_values_name_'.$l_id] = $row['v_products_options_values_name'];
		$active_row['v_products_options_type'] = $row['v_products_options_type'];
		continue; // loop - for more products_options_values_name on same v_products_id/v_options_id combo
	}
} else { // new combo or different product or first time through while-loop
	if ($active_row['v_products_model'] <> $last_products_id) {
		// Clean the texts that could break CSV file formatting
		$dataRow = '';
		$problem_chars = array("\r", "\n", "\t"); // carriage return, newline, tab
		foreach($filelayout as $key => $value) {
			$thetext = $active_row[$key];
			// remove carriage returns, newlines, and tabs - needs review
			$thetext = str_replace($problem_chars,' ',$thetext);
			// encapsulate data in quotes, and escape embedded quotes in data
			$dataRow .= '"'.str_replace('"','""',$thetext).'"'.$csv_delimiter;
		}
		// Remove trailing tab, then append the end-of-line
		$dataRow = rtrim($dataRow,$csv_delimiter)."\n";
		fwrite($fp, $dataRow); // write 1 line of csv data (this can be slow...)
		$ep_export_count++;
		$last_products_id = $active_row['v_products_model'];
	}
	
	// get current row of data
	$active_products_id = $row['v_products_id'];
	$active_options_id = $row['v_options_id'];
	$active_language_id = $row['v_language_id'];
	
	$active_row['v_products_model'] = $row['v_products_model'];
	$active_row['v_products_options_type'] = $row['v_products_options_type'];
	
	$l_id = $row['v_language_id'];
	$active_row['v_products_options_name_'.$l_id] = $row['v_products_options_name']; 
	$active_row['v_products_options_values_name_'.$l_id] = $row['v_products_options_values_name'];
} // end of special case 'attrib_basic'

chuckrey:

I misunderstood. I checked the data within phpmyadmin but did not run a query, sorry for my confusion. Can you please advise which query I can run and I will share the results?

Also, I checked the easypopulate_4_export.php file and replaced row 222-301 with the following and it worked, all data is showing when processing Basic Attributtes. Of course the code is coming from a previous version of EP4

// these variables are for the Attrib_Basic Export
$active_products_id = ""; // start empty
$active_options_id = ""; // start empty
$active_language_id = ""; // start empty
$active_row = array(); // empty array
$last_products_id = "";
$print1 = 0;
$result = ep_4_query($filelayout_sql);
while ($row = ($ep_uses_mysqli ? mysqli_fetch_array($result) : mysql_fetch_array($result))) {

if ($ep_dltype == 'attrib_basic') { // special case 'attrib_basic'


if ($row['v_products_id'] == $active_products_id) {
	if ($row['v_options_id'] == $active_options_id) {
		// collect the products_options_values_name
		if ($active_language_id <> $row['v_language_id']) {
			$l_id = $row['v_language_id'];
			$active_row['v_products_options_type'] = $row['v_products_options_type'];
			$active_row['v_products_options_name_'.$l_id] = $row['v_products_options_name'];
			$active_row['v_products_options_values_name_'.$l_id] = $row['v_products_options_values_name'];
			$active_language_id = $row['v_language_id'];
		} else {
			$l_id = $row['v_language_id'];
			$active_row['v_products_options_name_'.$l_id] = $row['v_products_options_name'];
			$active_row['v_products_options_values_name_'.$l_id] .= ",".$row['v_products_options_values_name'];
			$active_row['v_products_options_type'] = $row['v_products_options_type'];
		}
		continue; // loop - for more products_options_values_name on same v_products_id/v_options_id combo
	} else { // same product, new attribute - only executes once on new option
		// Clean the texts that could break CSV file formatting
		$dataRow = '';
		$problem_chars = array("\r", "\n", "\t"); // carriage return, newline, tab
		foreach($filelayout as $key => $value) {
			$thetext = $active_row[$key];
			// remove carriage returns, newlines, and tabs - needs review
			$thetext = str_replace($problem_chars,' ',$thetext);
			// encapsulate data in quotes, and escape embedded quotes in data
			$dataRow .= '"'.str_replace('"','""',$thetext).'"'.$csv_delimiter;
		}
		// Remove trailing tab, then append the end-of-line
		$dataRow = rtrim($dataRow,$csv_delimiter)."\n";
		fwrite($fp, $dataRow); // write 1 line of csv data (this can be slow...)
		$ep_export_count++;				
		
		$active_options_id = $row['v_options_id'];
		$active_language_id = $row['v_language_id'];
		$l_id = $row['v_language_id'];
		$active_row['v_products_options_name_'.$l_id] = $row['v_products_options_name'];
		$active_row['v_products_options_values_name_'.$l_id] = $row['v_products_options_values_name'];
		$active_row['v_products_options_type'] = $row['v_products_options_type'];
		continue; // loop - for more products_options_values_name on same v_products_id/v_options_id combo
	}
} else { // new combo or different product or first time through while-loop
	if ($active_row['v_products_model'] <> $last_products_id) {
		// Clean the texts that could break CSV file formatting
		$dataRow = '';
		$problem_chars = array("\r", "\n", "\t"); // carriage return, newline, tab
		foreach($filelayout as $key => $value) {
			$thetext = $active_row[$key];
			// remove carriage returns, newlines, and tabs - needs review
			$thetext = str_replace($problem_chars,' ',$thetext);
			// encapsulate data in quotes, and escape embedded quotes in data
			$dataRow .= '"'.str_replace('"','""',$thetext).'"'.$csv_delimiter;
		}
		// Remove trailing tab, then append the end-of-line
		$dataRow = rtrim($dataRow,$csv_delimiter)."\n";
		fwrite($fp, $dataRow); // write 1 line of csv data (this can be slow...)
		$ep_export_count++;
		$last_products_id = $active_row['v_products_model'];
	}
	
	// get current row of data
	$active_products_id = $row['v_products_id'];
	$active_options_id = $row['v_options_id'];
	$active_language_id = $row['v_language_id'];
	
	$active_row['v_products_model'] = $row['v_products_model'];
	$active_row['v_products_options_type'] = $row['v_products_options_type'];
	
	$l_id = $row['v_language_id'];
	$active_row['v_products_options_name_'.$l_id] = $row['v_products_options_name']; 
	$active_row['v_products_options_values_name_'.$l_id] = $row['v_products_options_values_name'];
} // end of special case 'attrib_basic'

I believe I have found the issue.  Please answer at least the below first question. I ask that the second be answered only if the answer to the first is yes.  
1. On the other site where EP4 basic attributes were expiring propelling, was the primary key set to the default of products_model? 
2. To be answered if the above was yes.  What custom field(s) are identified for import/export?

In either case, thank you for reporting this issue. I can see that as>was trying to simplify the code more and also offer additional options that some of the code changes were incomplete for use by the many as compared to the few.

mc12345678:

I believe I have found the issue. Please answer at least the below first question. I ask that the second be answered only if the answer to the first is yes.

1. On the other site where EP4 basic attributes were expiring propelling, was the primary key set to the default of products_model?
2. To be answered if the above was yes. What custom field(s) are identified for import/export?

In either case, thank you for reporting this issue. I can see that as>was trying to simplify the code more and also offer additional options that some of the code changes were incomplete for use by the many as compared to the few.

1. • Yes, products_model
2. I am not certain as to which setting you are referring so I am going to send all settings. Sorry.

Uploads Directory - temp/
Uploads Directory Admin/Catalog - true
Import/Export Primary Key - products_model
Import Language Override - language_id
Import/Export CSV Delimiter - ,
Export Language Identifier - id
Export Price Decimals - 2
Upload File Date Format - m-d-y
Default Raw Time - 09:00:00
Export Filename Date - Y-m-d
Upload/Download Prices Include Tax - false
Verbose Feedback - true
Show all EP4 Filetypes with Files - true
Replace Blank Image - false
Activate Blank Featured - true
Remove Blank Specials - negative
Make Zero Qty Products Inactive - false
Smart Tags Replacement of Newlines - true
Advanced Smart Tags - false
Auto-extend fields - false
Debug Logging - true
Maximum Quantity Discounts - 0
Split On Number of Records - 2000
Script Execution Time - 60
Convert Curly Quotes, etc. - 0
Convert Character 0x92 - 1
Enable Products Meta Data - 1
Enable Products Music Data - 0
User Defined Products Fields [this field is blank]
Export URI with Prod and or Cat - 1

Thank you for all your work, EP is a necessity and I am surprised this is not included w/ the install.

chuckrey:

1. • Yes, products_model
2. I am not certain as to which setting you are referring so I am going to send all settings. Sorry.

Uploads Directory - temp/
Uploads Directory Admin/Catalog - true
Import/Export Primary Key - products_model
Import Language Override - language_id
Import/Export CSV Delimiter - ,
Export Language Identifier - id
Export Price Decimals - 2
Upload File Date Format - m-d-y
Default Raw Time - 09:00:00
Export Filename Date - Y-m-d
Upload/Download Prices Include Tax - false
Verbose Feedback - true
Show all EP4 Filetypes with Files - true
Replace Blank Image - false
Activate Blank Featured - true
Remove Blank Specials - negative
Make Zero Qty Products Inactive - false
Smart Tags Replacement of Newlines - true
Advanced Smart Tags - false
Auto-extend fields - false
Debug Logging - true
Maximum Quantity Discounts - 0
Split On Number of Records - 2000
Script Execution Time - 60
Convert Curly Quotes, etc. - 0
Convert Character 0x92 - 1
Enable Products Meta Data - 1
Enable Products Music Data - 0
User Defined Products Fields [this field is blank]
Export URI with Prod and or Cat - 1

Thank you for all your work, EP is a necessity and I am surprised this is not included w/ the install.

Those are the settings from which store? The one where basic attributes export works or doesn't?

Thanks. Will note, one always has options about the tool to use to accomplish a task. There are other applications available to perform similar or subset tasks.

Hi
I am having an issue with the module while updating quantity discounts. I have worked with this module earlier never faced any issue.
While updating products quantity pricing it shows but it does not reflect in the site. I checked the table zen_products_discount_quantity and see that the values are not updated.## I tried reinstalling etc. Still the same. Is there any idea what's happening?

Version of Zencart is## v1.5.7c
Easy Populate 4

Filename: priceqty-epDEC.csv

UPDATED! - v_products_model: AB144 | 1 | 1.52 | 2 | 0 | 100 | 1.44 | 301 | 1.34 | | |
UPDATED! - v_products_model: AB145 | 1 | 1.52 | 2 | 0 | 100 | 1.44 | 301 | 1.34 | | |

RegardsNisha

nishajh:

Hi
I am having an issue with the module while updating quantity discounts. I have worked with this module earlier never faced any issue.
While updating products quantity pricing it shows but it does not reflect in the site. I checked the table zen_products_discount_quantity and see that the values are not updated.## I tried reinstalling etc. Still the same. Is there any idea what's happening?

Version of Zencart is## v1.5.7c
Easy Populate 4

Filename: priceqty-epDEC.csv

UPDATED! - v_products_model: AB144 | 1 | 1.52 | 2 | 0 | 100 | 1.44 | 301 | 1.34 | | |
UPDATED! - v_products_model: AB145 | 1 | 1.52 | 2 | 0 | 100 | 1.44 | 301 | 1.34 | | |

RegardsNisha

You mean a price breakdown import where instead of:

Filename: priceqty-epDEC.csv

Should be:

Filename: pricebreaks-epDEC.csv

Thank you. That solved the issue

nishajh:

Thank you. That solved the issue

No problem. Hope you have/had a Happy New Year!

Sorry for the long delay, I was away w/ the family off the grid for a bit.
That is from the site where Basic Attributes was not working for me. Do you need the settings from the other site ?

chuckrey:

Sorry for the long delay, I was away w/ the family off the grid for a bit.
That is from the site where Basic Attributes was not working for me. Do you need the settings from the other site ?
Please provide the same so that can see if those settings drive a different result on export or if there is another factor to consider. Thank you and no problem on the delay, thank you for taking the time to come back and address.

Here are the settings for the other file.
Thanks.

Uploads Directory - temp/
Uploads Directory Admin/Catalog - true
Import/Export Primary Key - products_model
Upload File Date Format - m-d-y
Default Raw Time - 09:00:00
Upload/Download Prices Include Tax - false
Verbose Feedback - true
Show all EP4 Filetypes with Files - true
Replace Blank Image - false
Activate Blank Featured - true
Make Zero Qty Products Inactive - false
Smart Tags Replacement of Newlines - true
Advanced Smart Tags - false
Debug Logging - true
Maximum Quantity Discounts - 3
Split On Number of Records - 2000
Script Execution Time - 60
Convert Curly Quotes, etc. - 0
Convert Character 0x92 - 1
Enable Products Meta Data - 1
Enable Products Music Data - 0
User Defined Products Fields -
Export URI with Prod and or Cat - 0

GitHub: there are many branches and the Master seems way behind others. Hard to know what to use, to feed back PRs....

torvista:

GitHub: there are many branches and the Master seems way behind others. Hard to know what to use, to feed back PRs....

Without knowing what the suggestion is, I would say that the master branch should be used to then maybe incorporate into a further appropriate location.

I just don't want to reinvent wheels....for things that are already addressed in another branch.

Suggestions could be many, or nothing show-stopping yet.

torvista:

I just don't want to reinvent wheels....for things that are already addressed in another branch.

Suggestions could be many, or nothing show-stopping yet.

Perhaps could raise a an issue and if already addressed then can point out the where? Right now one of the issues is that there has been an overhaul of some central processing to then also address existing issues.

I can say that one "topic" that is being worked on though not yet shown in Github is identification of database field defaults to expand on improved import capability. Unfortunately for me I have been focusing on update operations more than insert and had lost out on addressing import of product where fields were omitted. I didn't want to implement something very short term that was going to need to be undone immediately so am trying to address it in a single modification with any issues identified to be corrected.

i need help using Easy Populate V4

I am trying copy all my product from one store to another.

Easy populate installation was easy on both store.
I choose Complete product as an export but i am getting an error when trying to upload it to the new store.

The error is and goes for all products:

SKIPPED! - v_products_model: FI66 - No category provided for this new product
SKIPPED! - v_products_model: E8-4812P - No category provided for this new product
SKIPPED! - v_products_model: FI86 - No category provided for this new product
SKIPPED! - v_products_model: FD85 - No category provided for this new product
SKIPPED! - v_products_model: FW89 - No category provided for this new product

However the file has a v_category_name_1 and the new store is entirely blank ( see screenshot)

Any ideas on how to fix this? Thank you for your help