EasyPopulate 4.0 Support Thread

dimsumgurl:

Hey!

I just tried to do some testing..

(sorry I forgot to add: Is the latest vers in the first post of this thread? Just so I know I installed the latest one...)

So since the bug log said "MySQLi error 1366: Incorrect integer value: '' for column 'products_discount_type' at row 1"

I added v_products_discount_type in the top field and I entered "0" in the CSV files (just like a majority of the items were entered with I imported the file and checked their fields)

But that threw an error.

Then I though to add products_discount_type into the config>easy pop4>User Defined Products Fields

Then I get another error "MySQLi error 1110: Column 'products_discount_type' specified twice"
What error was thrown when the value of 0 was entered? Did it have to do with the field just below it in the above sql query?

BTW, good testing. That's the point of the first step of the readme.txt file.

Some things can be predetermined and are known to be required a specific way in order for ZC to function. Some things are/can be modified related to a default store and therefore are not "locked in". Again, will look at that field to see what's going on but the way it is supposed to work is to pull the default value(s) from the database and replace whatever default value with whatever is entered in the csv file if the field is provided in the file, otherwise if the field is not present then to not push the value(s) to the database and allow the database to auto-populate the field with the default value if it's a new record or to leave it alone if the record already exists.

mc12345678:

What error was thrown when the value of 0 was entered? Did it have to do with the field just below it in the above sql query?

BTW, good testing. That's the point of the first step of the readme.txt file.

Some things can be predetermined and are known to be required a specific way in order for ZC to function. Some things are/can be modified related to a default store and therefore are not "locked in". Again, will look at that field to see what's going on but the way it is supposed to work is to pull the default value(s) from the database and replace whatever default value with whatever is entered in the csv file if the field is provided in the file, otherwise if the field is not present then to not push the value(s) to the database and allow the database to auto-populate the field with the default value if it's a new record or to leave it alone if the record already exists.

I did two testings:

1. The config>easy pop4>User Defined Products Fields is left blank
   I added new column and put v_products_discount_type and below entered "0" for my newly created model number. I get the follow in the error log

MySQLi error 1366: Incorrect integer value: '' for column 'products_discount_type_from' at row 1
When executing:
INSERT INTO products SET
							products_model					= 'wooly',
							products_type     		        = 1,
							products_price					= '255', products_image			= '',
							products_weight					= '5',
							products_discount_type          = '0',
							products_discount_type_from     = '',
							product_is_call                 = '0',
							products_sort_order             = '0',
							products_quantity_order_min     = 1,
							products_quantity_order_units   = 1,
							products_priced_by_attribute	= '0',
							product_is_always_free_shipping	= '0',
							products_tax_class_id			= 1,
							products_date_available			= NULL, 
							products_date_added				= '2016-09-26 20:25:00',
							products_last_modified			= CURRENT_TIMESTAMP,
							products_quantity				= 5,
							master_categories_id			= 65,
							manufacturers_id				= 10,
							products_status					= '1',
							metatags_title_status			= '0',
							metatags_products_name_status	= '0',
							metatags_model_status			= '0',
							metatags_price_status			= '0',
							metatags_title_tagline_status	= '0'

2. config>easy pop4>User Defined Products Fields has "products_discount_type" entered
   I then exported a copy of the CSV so the v_products_discount_type column shows up.
   I do the same thing as in adding a new item etc
   I import that file and got error that says

MySQLi error 1110: Column 'products_discount_type' specified twice
When executing:
INSERT INTO products SET
							products_model					= 'wooly',
							products_type     		        = 1,
							products_price					= '55', products_discount_type = '0', products_image			= '',
							products_weight					= '6',
							products_discount_type          = '0',
							products_discount_type_from     = '',
							product_is_call                 = '0',
							products_sort_order             = '0',
							products_quantity_order_min     = 1,
							products_quantity_order_units   = 1,
							products_priced_by_attribute	= '0',
							product_is_always_free_shipping	= '0',
							products_tax_class_id			= 1,
							products_date_available			= NULL, 
							products_date_added				= '2016-09-26 20:25:56',
							products_last_modified			= CURRENT_TIMESTAMP,
							products_quantity				= 5,
							master_categories_id			= 65,
							manufacturers_id				= 10,
							products_status					= '1',
							metatags_title_status			= '0',
							metatags_products_name_status	= '0',
							metatags_model_status			= '0',
							metatags_price_status			= '0',
							metatags_title_tagline_status	= '0'

What i am confused is, how is the integer wrong when all the other items have "0" too??

Slow down a little and rereview the two errors, the one first reported and the one that occurred after resolving the first and before trying to provide the user_defined field.

The first error had to do with: products_discount_type, the second because of products_discount_type**_from** which is a different field. Originally both had '', then after resolving the first issue, only the second one had ''. Again will look at how both of those fields should behave, but this is/was the first report of that "issue".

As discussed elsewhere here, either those familiar with the plugin have self corrected it, had someone else do so without reporting the issue, have moved on to something else, or have operated in a way that didn't bring that to the surface. Regardless of their reasons, thank you for reporting this.

mc12345678:

Slow down a little and rereview the two errors, the one first reported and the one that occurred after resolving the first and before trying to provide the user_defined field.

The first error had to do with: products_discount_type, the second because of products_discount_type**_from** which is a different field. Originally both had '', then after resolving the first issue, only the second one had ''. Again will look at how both of those fields should behave, but this is/was the first report of that "issue".

As discussed elsewhere here, either those familiar with the plugin have self corrected it, had someone else do so without reporting the issue, have moved on to something else, or have operated in a way that didn't bring that to the surface. Regardless of their reasons, thank you for reporting this.

Oh my, Thanks for pointing that out to me. I guess I got tired eyes from looking at too many codes and trying to figure this out for too long I'm not reading the error properly.

I will go back and add the products_discount_type_from field and go from there...

But like you said, if the field isn't in the CSV, it should just default "0" right? Because right now it's basically forcing me to include every field untill it's all complete before it can import a new items that I am trying to transfer from...

dimsumgurl:

Oh my, Thanks for pointing that out to me. I guess I got tired eyes from looking at too many codes and trying to figure this out for too long I'm not reading the error properly.

I will go back and add the products_discount_type_from field and go from there...

But like you said, if the field isn't in the CSV, it should just default "0" right? Because right now it's basically forcing me to include every field untill it's all complete before it can import a new items that I am trying to transfer from...

Well, there's a couple of things for me to look at before I can comment on how it is expected to operate as compared to how it is operating. But I would like to take a moment to point out that now that you see how to add a single product, adding multiple should be relatively easy in comparison. Sort of the tree/forrest thing. So you have a column that you would end liking to have all the same value. Your working with a spreadsheet. Copy/paste, done. Focus on the fields/data necessary first and then fill in the fluff, can even resequence the columns to suit so that the columns to end up needing such a "global" copy and paste are on the right side. Take the row before, highlight the cells, drag down (depending on how "intelligent" the editor is it may increment one or more fields, but that's the workbook editor not EP4).

Another side note, understand that if your plan is to add one product at a time (just for discussion), then I would say that the product probably should be added using a different method. There is a sort of trade off in using something like this depending on how much is being added/modified.

Had an opportunity to look and am in the process of applying corrections.

Comes down to this: in the quest of rewriting EP4 to provide data sanitization, at one point or another some of the fields for import were posed as strings instead of their respective float or integer as so far found. So I'm going through all of the import records to be sure that the data type of the input matches the datatype of the database as applied against a default database.

In the case of the above issue, the field being empty was treated as an empty string '' instead of an empty integer 0. That is why the empty field (not imported in the file) caused the error/issue. Now that discovered and the code is consistent, it's a lot easier to address and correct all at once. Still takes some time, but a lot easier...

Again, thank you for pointing out that issue. It's really the only way to see things get corrected (when they are a problem) or to know/learn why they are the way they are.

Hey, I have a question. I have over 50 files that I have imported. If I delete those files does it remove any of my products? I just updated my Quantity of products today. If I delete file also will it remove any of my products?

Thanks
Wade

wmorris:

Hey, I have a question. I have over 50 files that I have imported. If I delete those files does it remove any of my products? I just updated my Quantity of products today. If I delete file also will it remove any of my products?

Thanks
Wade
The presence (or absence) of the file(s) on the server has no direct effect on the database. Certainly opening EP4 to see no files may leave one feeling empty as well, but it will not remove or adjust any information in the database by being deleted (just like the that there is no change by uploading the file(s)).

That said, it may be worth maintaining a certain amount of history of operations/changes, but they do not have to stay on your server.

For others desiring to use EP4 to delete a product, change the status of the product to 9, then import the file/product and it and all of its linked versions will be removed from the database. To reassign a product's master_category_id which will remove it from the previously designated category, use a value of 7 as the product's status and the product's master_category_id will become that of the category for the current row.

mc12345678:

Well, there's a couple of things for me to look at before I can comment on how it is expected to operate as compared to how it is operating. But I would like to take a moment to point out that now that you see how to add a single product, adding multiple should be relatively easy in comparison. Sort of the tree/forrest thing. So you have a column that you would end liking to have all the same value. Your working with a spreadsheet. Copy/paste, done. Focus on the fields/data necessary first and then fill in the fluff, can even resequence the columns to suit so that the columns to end up needing such a "global" copy and paste are on the right side. Take the row before, highlight the cells, drag down (depending on how "intelligent" the editor is it may increment one or more fields, but that's the workbook editor not EP4).

Another side note, understand that if your plan is to add one product at a time (just for discussion), then I would say that the product probably should be added using a different method. There is a sort of trade off in using something like this depending on how much is being added/modified.

Hello!

I wanted to report that after adding v_products_discount_type v_products_discount_type_from to the CSV file, it worked!

I added those two columns and tried creating a new product via CSV and it imported with no problems :smile:

I also tried to move those two columns to the end of the CSV just to make sure it's okay to re-arrange the CSV and it was good as well! this is great news as you mentioned it would be SO much easier to focus on my commonly used fields first then copy/paste the remaining info that isn't relevant to my products.

Thanks so much again!! Much appreciated!

zc 1.5.5a, Responsive Sheffield Blue 2.0, Dynamic Filters, Easy Populate 4.0 and numerous other mods. This exercise on WAMP test site only.

I'm trying to change my category set up - Currently ie, Master Category (ie Socks), several sub categories (ie Small Socks, Medium Socks) then products within the subcategories. The sub categories have a sort order and the products do not.

Change I'm making is to eliminate sub-categories and move all products into new Master Categories, then assign v_product_sort_order so products would appear in sequence similar to previous set up. My original setup won't show Dynamic Filters on Master Category if there are sub-categories. (So -Master Category - Socks, then all products with product sort numbers so they appear in correct sequence - ie all Small Socks - sort order 10, all Medium Socks - sort order 20. Products also have read-only attributes - so Dynamic Filter will give visitor the option to filter by size, or if on mobile - scroll through the products in a meaningful sequence.

I downloaded EZP file, opened in Open Office, edited product sort numbers from '0', saved, browsed, uploaded, and imported. Messages on EZP page show everything imported successfully, and I can see the sort numbers in the verbose feedback.

However, when I go back into my admin the product sort numbers remain '0' for any product that is linked. None of the linked categories are master categories, though all are top level categories. Only the non linked products have the sort order successfully changed.

I have tried making each sub-category into a top category and making that category a master category, and have also tried copying all the products within a sub-category to a new category, un-linking them from original sub-category, and making the new category a master category.

Assigning sort numbers to the products within sub-categories was easy as they were already sequenced in the file because of the sub-category sort order. But the linked categories are all over the map - very big job to un-link/ re-link everything.

And now, my question:

Should I be able to successfully assign a v_product_sort_order to linked products, and if so, is there something I've missed in procedure I've tried?

soxophoneplayer:

zc 1.5.5a, Responsive Sheffield Blue 2.0, Dynamic Filters, Easy Populate 4.0 and numerous other mods. This exercise on WAMP test site only...Should I be able to successfully assign a v_product_sort_order to linked products, and if so, is there something I've missed in procedure I've tried?

I may have this sorted. Still have to try and replicate.

I followed same procedure as in previous post but this time I cropped the working .csv file down, leaving only the new master categories, and cutting off the categories to which products from the former are linked. As is happens, my original sub-categories sort numbers placed them at the top of the file while the categories to which many products have links were lower on the page.

Perhaps the '0' product sort in the linked category, being lower on the page, was overwriting the new sort number in the product's master category placement.

Oy.

soxophoneplayer:

I may have this sorted. Still have to try and replicate.

I followed same procedure as in previous post but this time I cropped the working .csv file down, leaving only the new master categories, and cutting off the categories to which products from the former are linked. As is happens, my original sub-categories sort numbers placed them at the top of the file while the categories to which many products have links were lower on the page.

Perhaps the '0' product sort in the linked category, being lower on the page, was overwriting the new sort number in the product's master category placement.

Oy.
Glad you got this sorted out. To be honest I thought you were trying to do something slightly different which I was going to advise is not possible in a default store.

If the problem is/was, that the sort order of a product could not be imported to change, and the import file contained the same primary key (typically products_model) on two or more rows, then yes the last row in the file would be what everything becomes.

There are a number of ways to address this, and it really comes down to your own business model, ability to work with/around it, etc... even another product may be of interest/use or to use different product for different reason, whatever the case... it's important to understand how the software works (instructions), how it fits into ZC (exported results as compared to contents of the zc_install/sql folder and any modifications made by other plugins/programmers), and the effect of an import/manual change (import, export of data or viewing from the admin).

Again glad that it was something that seemed like could be figured out and resolved.

Fyi,

I've pushed an updated copy of EP4 to https://github.com/mc12345678/EasyPopulate-4.0 that should address all of the problems that have been identified "recently". It does not yet directly address sort order of attributes, but it does correct things like requiring fields that are typically 0 or 1 and that if 0 they need to be directly listed, it adds some improved user operations upon upload of a csv file (presents an import button in-line), the issue of manufacturer's information in ZC 1.5.4+ not fully being properly stored, improved indication of the default data related to the status dropdown, other corrections related to the import sanitization, the import file has been reduced by pushing the one-off import files to separate module files which should improve operation a little and improve code readability, modified the alternate primary key operations to offer some consistency, and other minor administrative changes.

Also posted the software to ZC, will notify if/when I discover that it has been updated; however, for those that have installed the version from the site should receive notification through program use.

okay guys/gals, I have been working on this for a long time with no luck maybe someone can simplify it. I have attached screen shots i have download my full shop list etc... it never inports. I am using a mac with open office and zen cart 1.5.5a

Not sure what the heck is wrong but have no clue
:frusty:

Well, there doesn't appear to be any properly named files in the folder used by EP4.

Please step through the process you are using, or follow this and report results.
In the upper left area, click the blue link that reads: Complete Products (with Metatags).

After a period of time, the screen should update and a file should appear towards the bottom of the list on that screen and associated with full product.

There should be buttons/a link next to that file, the link is download, the buttons to perform other action such as import, delete, split the file, etc...

If the store is properly setup to be fully compatible (each products_model is unique) then you could/should be able to import that file and technically nothing would change about the store.

The other thing is when you say it never imports, to what part of the process are you referring? As used for EP4: export: take data from database and create a file on the server that contains that data.
Download: copy the contents of the file that contains the exported data and place the copy on the local computer.
Upload: transfer the contents of the file on the local computer to the server so that the server can eventually access the file.
Import: process the contents of a server file with consideration of the filename's "prefix" to update/modify the database.

mc12345678:

Well, there doesn't appear to be any properly named files in the folder used by EP4.

Please step through the process you are using, or follow this and report results.
In the upper left area, click the blue link that reads: Complete Products (with Metatags).

Okay got file wont let me download error 403. but was able to download it from server through filezilla attachment included.

After a period of time, the screen should update and a file should appear towards the bottom of the list on that screen and associated with full product.

There should be buttons/a link next to that file, the link is download, the buttons to perform other action such as import, delete, split the file, etc...

If the store is properly setup to be fully compatible (each products_model is unique) then you could/should be able to import that file and technically nothing would change about the store.

The other thing is when you say it never imports, to what part of the process are you referring? As used for EP4: export: take data from database and create a file on the server that contains that data.
I upload file back in and it shows at the bottom of the list the one with all the missing files.....after i add a product as the others are setup in the file save it.

Download: copy the contents of the file that contains the exported data and place the copy on the local computer.
Upload: transfer the contents of the file on the local computer to the server so that the server can eventually access the file.
Import: process the contents of a server file with consideration of the filename's "prefix" to update/modify the database.

this is where iam at this moment just frustrated would love to get this working as i put 200 to 500 items in my store at a time maybe its just something i am not sure of

Okay, so from that it sounds like you have setup your download/upload folder as a folder in your admin directory. Because the admin directory has default permissions on it to prevent "random" file types from being accessed, a little additional file is needed to be added to the folder to prevent the error that you are seeing. It is located in the download zip file in the folder htaccess4AdminTempFolder... now care should be taken in applying that file as it should not just replace another .htaccess file if it exists.

As to the file handling described above, I do not understand what is not understood. I believe what has been said is that the file has been uploaded, but the import button not pressed. The previously provided images don't support that part of the discussion though. The previous images show no files on the server.

Be glad to help, just need to understand the current settings, the current setup, and what is or is not understood. If you can continue to communicate on these issues, then can get through.

mc12345678:

Okay, so from that it sounds like you have setup your download/upload folder as a folder in your admin directory. Because the admin directory has default permissions on it to prevent "random" file types from being accessed, a little additional file is needed to be added to the folder to prevent the error that you are seeing. It is located in the download zip file in the folder htaccess4AdminTempFolder... now care should be taken in applying that file as it should not just replace another .htaccess file if it exists.

As to the file handling described above, I do not understand what is not understood. I believe what has been said is that the file has been uploaded, but the import button not pressed. The previously provided images don't support that part of the discussion though. The previous images show no files on the server.

Be glad to help, just need to understand the current settings, the current setup, and what is or is not understood. If you can continue to communicate on these issues, then can get through.

Okay lets start with the .httaccess file i do have one in my admin folder is that where I need to copy the one from the zip folder? or does the one in the zip folder go into the temp folder where ep uses (sorry i am stupid when it comes to this)

then we can go on to fix the files not found.

Did you look at the cvs file i uploaded i dont use product model when i add a new product i just do name cost description how many file upload of picture then set product weight

MY SITE IS https://www.patchesrus.net

Okay so now i have the .htt file correct that allows me to download the csv file.

What about the rest of the stuff that is showing NO Supported data files? Is this something i should worry about

Alright as to my other problem with import. I downloaded the file opened with open office got the scrrenshot so after i opened it went to the bottom of the list added 1 item saved it kept format... the clicked on the upload ep file at top browsed for the file and clicked upload file then went to the bottom and clicked import.... it has been 3 mins and nothing shows blank screen

hope this helps....And THANK YOU for helping me

Robert