Help Needed with Easy Populate 4.0.35.

LittleAngell52:

I just realized something. I have got no model numbers so I am going to added them to the store by hand then see if it produce a EP spreadsheet that I can edit. So give a day or so to do this. I will reply in this post or do you want me to pm you if its worked or not.

No need to apply by hand... Use EP4 to populate the data...

Goto configuration, change the setting to use the primary key of products_id.
Export your data, you should see the products_id as one of the fields.

Now, you should also see the products_model as a field...

For every row with a unique products_id, add/make a products_model field that is unique as compared to any other.

Upload the file,
import the file.
Now all the records have a products_model.

Go back to the configuration, change the primary_key back to products_model, now you have a generic way to reference each of the products in the store and if new product has a unique products_model, then it will be okay...

It's a brain teaser I get it, but it's being creative and flexible that allows more to be done...

mc12345678:

EP4 does create a proper file... It is before it gets brought into Excel or any other editor. Once modified and then saved again is the issue...

EP4 creates a plain text file that has a list of fields in the first row, each field separated by a comma. Then in the second and subsequent rows the data for each field applies... This has nothing to do with PHP.

Here is an example of a file created by EP4 on a system that had two languages and the demo product installed, though not really "translated yet" as viewed from a plain text editor and will import just fine with EP4:

"v_products_model","v_products_type","v_products_image","v_products_name_1","v_products_description_1","v_products_url_1","v_products_name_2","v_products_description_2","v_products_url_2","v_specials_price","v_specials_date_avail","v_specials_expires_date","v_products_price","v_products_weight","v_product_is_call","v_products_sort_order","v_products_quantity_order_min","v_products_quantity_order_units","v_products_priced_by_attribute","v_product_is_always_free_shipping","v_date_avail","v_date_added","v_products_quantity","v_manufacturers_name","v_categories_name_1","v_categories_name_2","v_tax_class_title","v_status","v_metatags_products_name_status","v_metatags_title_status","v_metatags_model_status","v_metatags_price_status","v_metatags_title_tagline_status","v_metatags_title_1","v_metatags_keywords_1","v_metatags_description_1","v_metatags_title_2","v_metatags_keywords_2","v_metatags_description_2"
"MG200MMS","1","matrox/mg200mms.gif","Matrox G200 MMS","Reinforcing its position as a multi-monitor trailblazer, Matrox Graphics Inc. has once again developed the most flexible and highly advanced solution in the industry. Introducing the new Matrox G200 Multi-Monitor Series; the first graphics card ever to support up to four DVI digital flat panel displays on a single 8" PCI board.<br /><br />With continuing demand for digital flat panels in the financial workplace, the Matrox G200 MMS is the ultimate in flexible solutions. The Matrox G200 MMS also supports the new digital video interface (DVI) created by the Digital Display Working Group (DDWG) designed to ease the adoption of digital flat panels. Other configurations include composite video capture ability and onboard TV tuner, making the Matrox G200 MMS the complete solution for business needs.<br /><br />Based on the award-winning MGA-G200 graphics chip, the Matrox G200 Multi-Monitor Series provides superior 2D/3D graphics acceleration to meet the demanding needs of business applications such as real-time stock quotes (Versus), live video feeds (Reuters & Bloombergs), multiple windows applications, word processing, spreadsheets and CAD.","www.matrox.com/mga/products/g200_mms/home.cfm","Matrox G200 MMS","Reinforcing its position as a multi-monitor trailblazer, Matrox Graphics Inc. has once again developed the most flexible and highly advanced solution in the industry. Introducing the new Matrox G200 Multi-Monitor Series; the first graphics card ever to support up to four DVI digital flat panel displays on a single 8" PCI board.<br /><br />With continuing demand for digital flat panels in the financial workplace, the Matrox G200 MMS is the ultimate in flexible solutions. The Matrox G200 MMS also supports the new digital video interface (DVI) created by the Digital Display Working Group (DDWG) designed to ease the adoption of digital flat panels. Other configurations include composite video capture ability and onboard TV tuner, making the Matrox G200 MMS the complete solution for business needs.<br /><br />Based on the award-winning MGA-G200 graphics chip, the Matrox G200 Multi-Monitor Series provides superior 2D/3D graphics acceleration to meet the demanding needs of business applications such as real-time stock quotes (Versus), live video feeds (Reuters & Bloombergs), multiple windows applications, word processing, spreadsheets and CAD.","www.matrox.com/mga/products/g200_mms/home.cfm",,,,"299.99","23","0","0","1","1","0","0",,"2003-11-03 12:32:17","31","Matrox","Hardware^Graphics Cards","Hardware^Graphics Cards","Taxable Goods","1","0","0","0","0","0",,,,,,

> 
> If your product does not have information in the products_model field, then you will need to change the primary key to either products_id or new_blank so that when uploading the software can find a unique record to which to apply the data...
> 
> BTW, I thought that this was something that was previously in use but had been seen as an upgrade?

Nope the 1st time I have ever used it. I was waiting on it to come out on ZC 1.5.5. My old computer was only showing the Version for 1.5.4. Only by chance I was going threw admin plugins yesterday as wanted to see if it had been done yet to find out that the version for ZC 1.5.5 had been out since April. Just shows you how bad my old computer was behaving. LOL. I will try it and see if it all works and get it work as just downloaded it via the way you said and change it back to how it was. Just bear with me while I try it out. One quick question. When adding a new product is added do you but the info in each cell to match what is on line one?

LittleAngell52:

Nope the 1st time I have ever used it. I was waiting on it to come out on ZC 1.5.5. My old computer was only showing the Version for 1.5.4. Only by chance I was going threw admin plugins yesterday as wanted to see if it had been done yet to find out that the version for ZC 1.5.5 had been out since April. Just shows you how bad my old computer was behaving. LOL. I will try it and see if it all works and get it work as just downloaded it via the way you said and change it back to how it was. Just bear with me while I try it out. One quick question. When adding a new product is added do you but the info in each cell to match what is on line one?

The information from above is what the CSV file looks like, as far as putting the "info in" if the field (header/column) exists, whatever is or is not entered will be put in the database on import.. If the field is not present then it will not be changed. If the field is present and the row is blank, then for that record either the field will be made blank or the "typical" default value that ZC expects.

As for "quotes", you don't need to put a quote at the beginning and end of a cell when typing the information in, but if you do plan to use a "special character" in an area of text then you will need to escape it. For example if you wanted the name of a product or text in a description to be like "The way it's going." then the apostrophe will require escaping like "The way it's going."

If you wanted to add the Matrox G200 MMS that is provided in the default ZC products install, then you could enter everything that you see in the above line 1 (copy and paste to a file that with a name that would display in the full-EP section of the screen) and import it and voila you have the MG200MMS product in your store, though it won't yet have the attributes that go with it... :)

Anyways, hope that helps a little more... Takes a smidge to get to understand it, but then it can be very helpful if it supports the intended/desired use.

mc12345678:

The information from above is what the CSV file looks like, as far as putting the "info in" if the field (header/column) exists, whatever is or is not entered will be put in the database on import.. If the field is not present then it will not be changed. If the field is present and the row is blank, then for that record either the field will be made blank or the "typical" default value that ZC expects.

As for "quotes", you don't need to put a quote at the beginning and end of a cell when typing the information in, but if you do plan to use a "special character" in an area of text then you will need to escape it. For example if you wanted the name of a product or text in a description to be like "The way it's going." then the apostrophe will require escaping like "The way it's going."

If you wanted to add the Matrox G200 MMS that is provided in the default ZC products install, then you could enter everything that you see in the above line 1 (copy and paste to a file that with a name that would display in the full-EP section of the screen) and import it and voila you have the MG200MMS product in your store, though it won't yet have the attributes that go with it... :)

Anyways, hope that helps a little more... Takes a smidge to get to understand it, but then it can be very helpful if it supports the intended/desired use.

do you mean everything goes into the first cell for example A2. Earlier on I showed you what my A1 cell looked like on open office or should it be this A1 v_products_model and then in B1 v_products_type and so on. The reason I want Easy populate is that I have got over 15000 products to add to the store and doing it one by one is time consuming I have manged to get over 800 products up on the store since last December. Now I am back to this SKIPPED! - Model: PP_10001,"1","PP-Preview01.jpg","Pattern;Papers;-0;Set;"01"" - Products model exceeds max. length: 32 Is it because I used a underscore?

Column A is a field, Column B is a field. For example if you wanted to only update the products_name of a single products_model, then you could have in either A1 or B1 either of those two headings: v_products_model in one and v_products_name_1 in the other (the number 1 ties back to the installed language. Was going to change it to use the two letter code, but something else has come up so maybe if I ever get around to it.) anyways, then in row 2 is the data for that column (A2, B2)

As to the products_model issue described? The underscore should not be an issue, but perhaps the lack of quotes around the products_model is? Or perhaps the quotes within the fourth field with the "01""? Looks like missing an escape character with the quotes around the 01... that may play a factor...

Would expect to see "01""

mc12345678:

Column A is a field, Column B is a field. For example if you wanted to only update the products_name of a single products_model, then you could have in either A1 or B1 either of those two headings: v_products_model in one and v_products_name_1 in the other (the number 1 ties back to the installed language. Was going to change it to use the two letter code, but something else has come up so maybe if I ever get around to it.) anyways, then in row 2 is the data for that column (A2, B2)

As to the products_model issue described? The underscore should not be an issue, but perhaps the lack of quotes around the products_model is? Or perhaps the quotes within the fourth field with the "01""? Looks like missing an escape character with the quotes around the 01... that may play a factor...

Would expect to see "01""

So would I type in "01"" or is it what you put above

so for example would I type this in for the model number PP100_"01"" or would it be PP100_"01"" or is it "PP100_\01"" as don't really understand what your trying to say.

LittleAngell52:

So would I type in "01"" or is it what you put above
From what I interpret the field is expected to contain when "displayed" (eventually presented to the browser) and maybe the field is truncated, maybe not, at least the start of that field when looked at in your spreadsheet should look like:

Pattern;Papers;-0;Set;\"01\"

If there is/was more then, that should follow. Take a look on the Internet on escaping characters which should identify what characters require such escapes.

LittleAngell52:

so for example would I type this in for the model number PP100_"01"" or would it be PP100_"01 as don't really understand what your trying to say.
The model number actually looks correct, the problem is that down the line there are characters not properly escaped and so the interpreter thinks that everything leading up to the last character set ("01"") is closing the first field...

Could try this. Again, the reason exporting data is the best way to see how things need to be formatted in order to import. Edit/enter a product into the database using the normal admin method. Export the data (maybe a single category through the dropdowns), look at the plain text file from the download and see what it did with the data entered. It could be that the data seen is because of Excel, which is one reason it is not a preferred application, but if it is something that you intentionally had in there, then again, the export will guide to the expectation.

mc12345678:

From what I interpret the field is expected to contain when "displayed" (eventually presented to the browser) and maybe the field is truncated, maybe not, at least the start of that field when looked at in your spreadsheet should look like:

Pattern;Papers;-0;Set;"01"

> 
> If there is/was more then, that should follow. Take a look on the Internet on escaping characters which should identify what characters require such escapes.

i sent you a copy of the file that EP had created and hadn't been changed. so where do I get the information from to help me correct this error.

mc12345678:

The model number actually looks correct, the problem is that down the line there are characters not properly escaped and so the interpreter thinks that everything leading up to the last character set ("01"") is closing the first field...

Could try this. Again, the reason exporting data is the best way to see how things need to be formatted in order to import. Edit/enter a product into the database using the normal admin method. Export the data (maybe a single category through the dropdowns), look at the plain text file from the download and see what it did with the data entered. It could be that the data seen is because of Excel, which is one reason it is not a preferred application, but if it is something that you intentionally had in there, then again, the export will guide to the expectation.

I am really not understanding what you are trying to say. Is there a way I can create a blank file with just the line one on it and use that as a template? What if I tried to type this in Paper;Patterns;-;Set"01 or do I type in Paper Patterns - Set 01

LittleAngell52:

i sent you a copy of the file that EP had created and hadn't been changed. so where do I get the information from to help me correct this error.

LittleAngell52:

I am really not understanding what you are trying to say. Is there a way I can create a blank file with just the line one on it and use that as a template?
Both files posted on page 1 of this thread were not created by a default install of EP4 because EP4 uses commas not semicolons in the export. In fact commas are hard coded in the code. So the semicolons came from something else (likely a "save" of the file when using either Open Office or Excel and indicating that the divider should be a semicolon (;) instead of a comma (,)).

As to creating a "blank" file, of course. Again the "best" method is to export data, download the file, delete everything from row 2 on down. Then go back and type in whatever is to be had in each field. If you don't want to update a field associated with the input (for example assume you have somehow entered the products_price, and don't want to change it, then delete the v_products_price column from the file).

If you are copying and pasting text from somewhere, then when pasting, be sure to indicate to paste just text. Other formatting from the source is likely to cause trouble if included in the paste.

mc12345678:

Both files posted on page 1 of this thread were not created by a default install of EP4 because EP4 uses commas not semicolons in the export. In fact commas are hard coded in the code. So the semicolons came from something else (likely a "save" of the file when using either Open Office or Excel and indicating that the divider should be a semicolon (;) instead of a comma (,)).

As to creating a "blank" file, of course. Again the "best" method is to export data, download the file, delete everything from row 2 on down. Then go back and type in whatever is to be had in each field. If you don't want to update a field associated with the input (for example assume you have somehow entered the products_price, and don't want to change it, then delete the v_products_price column from the file).

If you are copying and pasting text from somewhere, then when pasting, be sure to indicate to paste just text. Other formatting from the source is likely to cause trouble if included in the paste.

Oh yes it was as i can do a video of me creating a file from my admin center and I will send it to you. Since moving to a new hosting provider 3 weeks ago I have had things changing on my ZC store for example Open Exchange Rate which updates you currency don't work any more. I have contacted Open Exchange Rate and they said to go to Zencart Forums for help. I may be changing hosting providers again as need a store work properly Now it looks like EP don't work properly as its changing things on the file. One reason why i wanted to update my store by hand and change a few things on it. see all the v_ thingy are just in cell A1 and I know that isn't correct as saw a video of a very old version of EP the where in there own cell for each v_ thingy. Oh i found the mistake how do I get a space after - as on the spreadsheet it reads -0 if i type in the space it puts the 0 in so would &nbsp work as that is non breaking space?

LittleAngell52:

Oh yes it was as i can do a video of me creating a file from my admin center and I will send it to you. Since moving to a new hosting provider 3 weeks ago I have had things changing on my ZC store for example Open Exchange Rate which updates you currency don't work any more. I have contacted Open Exchange Rate and they said to go to Zencart Forums for help. I may be changing hosting providers again as need a store work properly Now it looks like EP don't work properly as its changing things on the file. One reason why i wanted to update my store by hand and change a few things on it. see all the v_ thingy are just in cell A1 and I know that isn't correct as saw a video of a very old version of EP the where in there own cell for each v_ thingy. Oh i found the mistake how do I get a space after - as on the spreadsheet it reads -0 if i type in the space it puts the 0 in so would &nbsp work as that is non breaking space?

If you go into your admin folder and look at the file: easypopulate_4.php

What do you have on line 6 where $csv_delimiter is defined (third row down in the below code)?

Here is the code from github for that area:

// CSV VARIABLES - need to make this configurable in the ADMIN 
// $csv_delimiter = "\t"; // "\t" = tab AND "," = COMMA 
$csv_delimiter = ","; // "\t" = tab AND "," = COMMA 
$csv_enclosure = '"'; // chadd - i think you should always use the '"' for best compatibility 
//$category_delimiter = "^"; //Need to move this to the admin panel 
$category_delimiter = "\x5e"; //Need to move this to the admin panel 

You can/should see that it is defined as "," which is double-quote, comma, double-quote without spaces or any other character.

Throughout the code, the $csv_delimiter is used to insert a divider between each field that is output to the file. This delimiter is what the spreadsheet needs to know about when importing data so that an entire row of data does not appear into a single cell as described above.

I know earlier I talked about how it is possible to move columns around, but that is something that can/should be done once the file is opened in an editor that can handle the CSV data as individual columns and rows. Normally, the output file would be like what I posted earlier, where there are commas between each of the v_fieldname fields. When opening/importing the file into the spreadsheet there should be one or more options on delimited text. Either as fixed length (not the case for EP4, but it means that there are only so many characters per column and when that many characters are found then the next field is what is begun. This is a very old method of delimiting content and is dependent on always exporting a set number of characters for every field) or as delimited text (this is what EP4 uses which allows the field content to be whatever length it needs to be to support the operation and that the next field begins just after the delimiter). The "default" export sequence is frequently referenced/shown in the EP4 thread by review of other's files, but starts with v_products_model, then v_products_type, etc like (where I have removed the second language field shown in the previous post as well as all of the quotes):

v_products_model,v_products_type,v_products_image,v_products_name_1,v_products_description_1,v_products_url_1,v_specials_price,v_specials_date_avail,v_specials_expires_date,v_products_price,v_products_weight,v_product_is_call,v_products_sort_order,v_products_quantity_order_min,v_products_quantity_order_units,v_products_priced_by_attribute,v_product_is_always_free_shipping,v_date_avail,v_date_added,v_products_quantity,v_manufacturers_name,v_categories_name_1,v_tax_class_title,v_status,v_metatags_products_name_status,v_metatags_title_status,v_metatags_model_status,v_metatags_price_status,v_metatags_title_tagline_status,v_metatags_title_1,v_metatags_keywords_1,v_metatags_description_1

The above should be considered that A1 would have v_products_model, B1 would have v_products_type, C1 would have v_products_image, etc... fields that end with an underscore are those that are language dependent. Ie. if english is installed as the first language and say French is installed as a second language, then it would be expected that the product name could be different in French than it is in English and therefore would need to be stored as a separate entry. More than likely French would be language 2, but these numbers are shown in the upper right hand corner of the Tools->Easy Populate 4 screen adjacent to the language(s) installed.

The delimiter expected to be assigned is the comma, but for some reason it looks like your software setup (server?) may be using a semi-colon instead of the comma. Thus, when importing your data to your spreadsheet, it appears that you would want to follow the guidance say for Open Office's Convert Text to Columns using semi-colon as the delimiter (based on the file information posted in this thread) which should separate all of your v_fields to be one in a column as described above. It is because the import software does not seem to see the appropriate delimiter between fields that it is putting all of the text of the first row into a single cell... No divider, no division. :)

mc12345678:

If you go into your admin folder and look at the file: easypopulate_4.php

What do you have on line 6 where $csv_delimiter is defined (third row down in the below code)?

Here is the code from github for that area:

// CSV VARIABLES - need to make this configurable in the ADMIN
// $csv_delimiter = "\t"; // "\t" = tab AND "," = COMMA
$csv_delimiter = ","; // "\t" = tab AND "," = COMMA
$csv_enclosure = '"'; // chadd - i think you should always use the '"' for best compatibility
//$category_delimiter = "^"; //Need to move this to the admin panel
$category_delimiter = "\x5e"; //Need to move this to the admin panel

>  
> You can/should see that it is defined as "," which is double-quote, comma, double-quote without spaces or any other character.
> 
> Throughout the code, the $csv_delimiter is used to insert a divider between each field that is output to the file. This delimiter is what the spreadsheet needs to know about when importing data so that an entire row of data does not appear into a single cell as described above. 
> 
> I know earlier I talked about how it is possible to move columns around, but that is something that can/should be done once the file is opened in an editor that can handle the CSV data as individual columns and rows.  Normally, the output file would be like what I posted earlier, where there are commas between each of the v_fieldname fields.  When opening/importing the file into the spreadsheet there should be one or more options on delimited text.  Either as fixed length (not the case for EP4, but it means that there are only so many characters per column and when that many characters are found then the next field is what is begun.  This is a very old method of delimiting content and is dependent on always exporting a set number of characters for every field) or as delimited text (this is what EP4 uses which allows the field content to be whatever length it needs to be to support the operation and that the next field begins just after the delimiter).  The "default" export sequence is frequently referenced/shown in the EP4 thread by review of other's files, but starts with v_products_model, then v_products_type, etc like (where I have removed the second language field shown in the previous post as well as all of the quotes):
> 
> 
> The above should be considered that A1 would have v_products_model, B1 would have v_products_type, C1 would have v_products_image, etc... fields that end with an underscore are those that are language dependent.  Ie. if english is installed as the first language and say French is installed as a second language, then it would be expected that the product name could be different in French than it is in English and therefore would need to be stored as a separate entry.  More than likely French would be language 2, but these numbers are shown in the upper right hand corner of the Tools->Easy Populate 4 screen adjacent to the language(s) installed.
> 
> The delimiter expected to be assigned is the comma, but for some reason it looks like your software setup (server?) may be using a semi-colon instead of the comma.  Thus, when importing your data to your spreadsheet, it appears that you would want to follow the guidance say for [Open Office's Convert Text to Columns](https://forum.openoffice.org/en/forum/viewtopic.php?t=60944) using semi-colon as the delimiter (based on the file information posted in this thread) which should separate all of your v_fields to be one in a column as described above.  It is because the import software does not seem to see the appropriate delimiter between fields that it is putting all of the text of the first row into a single cell... No divider, no division. :)

so are you say that -0 should be -"," is that right?

LittleAngell52:

I am really not understanding what you are trying to say. Is there a way I can create a blank file with just the line one on it and use that as a template? What if I tried to type this in Paper;Patterns;-;Set"01 or do I type in Paper Patterns - Set 01

I didn't see this edit previously...

You should only have to enter the text as last provided:

Paper Patterns - Set 01

When "exporting" the file to save as a CSV, spaces should not be considered delimiters, I'm trying to find the latest instructions for exporting/storing as a CSV, since I don't have ready access to OO. But, those spaces should not be converted to semi-colons, that just throws things out as well. Key parts of the export, quotes around fields, commas separating fields, UTF-8 (or without dash or possibly small case or a combination of the two.)

Now, if you want two or more spaces between something, then yes, probably want to use the html non-blank space type encoding, but EP4 otherwise is supposed to address that aspect. It's the getting the data (escaping) to that processing that has to be done up front (if/when such characters are needed).

This is the best "help" that I can find at the moment for saving files from Open Office. In last use, I think some minor changes were made in the interface, but that should guide to the correct settings needed. It appears that one of the current settings is to convert spaces to semi-colons, which is incorrect as well.

see i am so lost on this and really think of taking EP off the store but saying that I am getting complaints from people that the products aren't going up on the store fast enough.

mc12345678:

This is the best "help" that I can find at the moment for saving files from Open Office. In last use, I think some minor changes were made in the interface, but that should guide to the correct settings needed. It appears that one of the current settings is to convert spaces to semi-colons, which is incorrect as well.

Oh guess what I have been doing is just saving it and not save as. Also my Open office has got a Auto Save on it but just turned it off.

LittleAngell52:

Oh guess what I have been doing is just saving it and not save as. Also my Open office has got a Auto Save on it but just turned it off.
Well, auto-save isn't a bad thing as long as the "final" save is as needed.

I certainly hope that helps. :)

So, again, here's the general suggestion on "figuring" out how to get things to work and from there "trouble-shoot" why there are differences:
Export data from EP4.
Download file.
Look at file using a plain text editor.
Close editor, don't save any changes.
Open "spreadsheet",
Save (save as or export whatever is needed for the workbook program) the file with a different name (feel free to modify anything after EP).
Open the new worksheet in the same plain text editor. Generally speaking things should look the same as the previous file, any differences should be reviewed for potential impact and what is needed to get the same or very similar result.
Once that process of using the workbook program is understood, reduce the data down to one row of import data so that you can make a change (something minor) and then upload the file, and import the file to see that the desired change was made.

Now, with an understanding of how these things work together, what is needed, have at it and populate the product data.

When working with the other downloads, you'll already be familiar with the in and out process and just need to provide more data. :)

Sound like a plan?