Help Needed with Easy Populate 4.0.35.

mc12345678:

Well, auto-save isn't a bad thing as long as the "final" save is as needed.

I certainly hope that helps. :)

So, again, here's the general suggestion on "figuring" out how to get things to work and from there "trouble-shoot" why there are differences:
Export data from EP4.
Download file.
Look at file using a plain text editor.
Close editor, don't save any changes.
Open "spreadsheet",
Save (save as or export whatever is needed for the workbook program) the file with a different name (feel free to modify anything after EP).
Open the new worksheet in the same plain text editor. Generally speaking things should look the same as the previous file, any differences should be reviewed for potential impact and what is needed to get the same or very similar result.
Once that process of using the workbook program is understood, reduce the data down to one row of import data so that you can make a change (something minor) and then upload the file, and import the file to see that the desired change was made.

Now, with an understanding of how these things work together, what is needed, have at it and populate the product data.

When working with the other downloads, you'll already be familiar with the in and out process and just need to provide more data. :)

Sound like a plan?

so are you saying the I am to open EP in as Wordpad or notepad++ just after I have downloaded it from EP and then save it and Save As whatever I have renamed it to. Then open it in Open Office and edited the file and then Save As what I have renamed it to. I really do appreciate your help and once we get EP working I am sure I will love the plugin.

I have just noticed something on my admin pages and wanted to ask what does this mean Parse Time 0,666s is it anything to worry about?

LittleAngell52:

so are you saying the I am to open EP in as Wordpad or notepad++ just after I have downloaded it from EP and then save it and Save As whatever I have renamed it to. Then open it in Open Office and edited the file and then Save As what I have renamed it to. I really do appreciate your help and once we get EP working I am sure I will love the plugin.
If I had used step numbers, it would have been easier to reference back. I hope not to go in circles.

The reason to look at the file in a plain text editor (word pad isn't quite a plain text editor, but notepad++ would do) is the csv file that comes from EP and goes to EP will be formatted at least in a way that it could be imported again with no edits performed and should be accepted as a properly formatted file.

Then the goal is that whatever is going to edit the contents of that file will, make or leave the file formatted to import. By having a copy of the original file and comparing it to the changed file you should this "first" go round be able to see the differences. For example inserting a bunch of semi-colons wherever there was a space is huge difference. There's a reason for it. Understand the reason. And in this case fix the reason.

Once you work out how each program works/affects the data, then you should be able to get to this:
Export data,
Download data,
Edit data,
Save edits,
Upload file,
Import file.

In the future, should be able to:
Open a file of the desired type to know what headers/fields are expected,
Enter the new data starting at row 2 for example.
Save file,
Upload file,
Import file.

There should not be any filler actions, no further comparing. But you need to understand what steps need to be performed to make that happen. That's why I suggested the intermittent troubleshooting steps.

Once you know that to save the file in the desired format requires save as, check these boxes, uncheck those, press this button will give a good data CSV data file, then there is no need really to look at the CSV in the middle, just upload and then import. If there is/was a problem with the data, you should be notified similar to the "product_model" issue. Only so much "trouble" information can be given by the computer.

LittleAngell52:

I have just noticed something on my admin pages and wanted to ask what does this mean Parse Time 0,666s is it anything to worry about?
I would not say that less than a second to read a file, process it which includes asking the database about each field, and then update or insert as appropriate to be too much of a concern. There is a sort of max timeout to be concerned about which is why there is the possibility to split files that are to be imported. Should start seeing that with x records (rows) it will take y long. More rows, longer time, though it also depends on if it is a new record or a change in an existing one.

I'm sorry, I like to try to educate and increase understanding. I've more than likely overwhelmed you with information. I think you're capable of getting there and whether it is EP4 or something else that is used, you will benefit from being able to work "offline" and put things together to populate your store. Just need to be able to generate a file that is usable. :)

mc12345678:

If I had used step numbers, it would have been easier to reference back. I hope not to go in circles.

The reason to look at the file in a plain text editor (word pad isn't quite a plain text editor, but notepad++ would do) is the csv file that comes from EP and goes to EP will be formatted at least in a way that it could be imported again with no edits performed and should be accepted as a properly formatted file.

Then the goal is that whatever is going to edit the contents of that file will, make or leave the file formatted to import. By having a copy of the original file and comparing it to the changed file you should this "first" go round be able to see the differences. For example inserting a bunch of semi-colons wherever there was a space is huge difference. There's a reason for it. Understand the reason. And in this case fix the reason.

Once you work out how each program works/affects the data, then you should be able to get to this:
Export data,
Download data,
Edit data,
Save edits,
Upload file,
Import file.

In the future, should be able to:
Open a file of the desired type to know what headers/fields are expected,
Enter the new data starting at row 2 for example.
Save file,
Upload file,
Import file.

There should not be any filler actions, no further comparing. But you need to understand what steps need to be performed to make that happen. That's why I suggested the intermittent troubleshooting steps.

Once you know that to save the file in the desired format requires save as, check these boxes, uncheck those, press this button will give a good data CSV data file, then there is no need really to look at the CSV in the middle, just upload and then import. If there is/was a problem with the data, you should be notified similar to the "product_model" issue. Only so much "trouble" information can be given by the computer.

Right I am going to work on EP this evening as and see if I can see why I am getting this error. It would have gone wrong on someone who don't know much about EP So why is it that the v thingies is all in one cell Which is even on the one I have just downloaded or is this correct?

LittleAngell52:

Right I am going to work on EP this evening as and see if I can see why I am getting this error. It would have gone wrong on someone who don't know much about EP So why is it that the v thingies is all in one cell Which is even on the one I have just downloaded or is this correct?

They are all in the one cell, because when opening/importing the file into Open Office, the delimiter (long discussion a few posts before) is incorrect for what is in the file...

The delimiter as generated by EP4 should be a comma. When opening the file or importing it the software needs to know or be told what delimiter is being used by your system/file. For example I found this help information on importing a CSV to Open Office (Calc is the program). They use or reference a tab delimited file, but EP4 was written to be a comma delimited file, what you have uploaded before and said is what directly comes from EP4 is a semi-colon delimited file.

In everyone else's use of a base version of EP4, they would have a comma between each v_fieldname and therefore when importing into Calc, would select the comma as the delimiter between fields and the " as encompassing a field.

Following the instructions at that link though, should successfully be able to import the CSV file to Calc. I don't though see the real importance of renaming the file extension from .csv to .txt other than perhaps it makes it possible/easier to be open in Writer (open source word processor by Open Office).

Actually, so far as EP goes, nothing really has been done with it... This is all about how to use and create a delimited text file. Ie. export something, modify it, then put it back with just the changes to be made, not all of the other things that the editing software introduces...

mc12345678:

They are all in the one cell, because when opening/importing the file into Open Office, the delimiter (long discussion a few posts before) is incorrect for what is in the file...

The delimiter as generated by EP4 should be a comma. When opening the file or importing it the software needs to know or be told what delimiter is being used by your system/file. For example I found this help information on importing a CSV to Open Office (Calc is the program). They use or reference a tab delimited file, but EP4 was written to be a comma delimited file, what you have uploaded before and said is what directly comes from EP4 is a semi-colon delimited file.

In everyone else's use of a base version of EP4, they would have a comma between each v_fieldname and therefore when importing into Calc, would select the comma as the delimiter between fields and the " as encompassing a field.

Following the instructions at that link though, should successfully be able to import the CSV file to Calc. I don't though see the real importance of renaming the file extension from .csv to .txt other than perhaps it makes it possible/easier to be open in Writer (open source word processor by Open Office).

Actually, so far as EP goes, nothing really has been done with it... This is all about how to use and create a delimited text file. Ie. export something, modify it, then put it back with just the changes to be made, not all of the other things that the editing software introduces...

Right I unchecked use spaces as semi-colons as and checked use commas it that correct. I am better at grasping thing if show how to do it rather then read how to do it. now when EP generates the file for me and I view it via notepad++ its has got for example "Pattern;Papers;-0;Set;"01"" is this correct cos i don't think it is.

all spaces have a semi colon in them to the example you showed how it should look mine is completely wrong but how to correct it i cant phantom out. Unless I type in the correct thing by hand which is going to take me days to do and I am not going to even try to do it. One thing I do know is that on my hosting account PHP MyAdmin is very old as it is asking me to install the latest version. I am going to change hosting providers as I have had enough of having problems on my store and having to fix them I have been with Go Daddy for nearly a month now and I haven't added one single product to the store as I have been trying to fix problems on the store.

So after you download the file, and then you open it with notepad++, you are seeing the semi-colons there?

mc12345678:

So after you download the file, and then you open it with notepad++, you are seeing the semi-colons there?

Yes that is correct. I cant understand why its happening. I am leaving my hosting company and going with one that is based the UK. The good news is i got it to spread out in open office so we are slowly getting there. Would it be because PHP MyAdmin is running a older version?

mc12345678:

This is the best "help" that I can find at the moment for saving files from Open Office. In last use, I think some minor changes were made in the interface, but that should guide to the correct settings needed. It appears that one of the current settings is to convert spaces to semi-colons, which is incorrect as well.

OMG - this link brought me success - particularly the part when "save as" edited file to check the 'edit filter settings' box. Checking this generates the dropdown to select utf-8. I had just been doing save as - csv without checking that box. Kept getting 'no model field in record, this line was skipped' when uploading/importing the edited file.

All this is with zc 1.5.5a, Responsive Sheffiled Blue 2.0 adapted of 1.5.5a, many mods, and Easy Populate 4.0.35

I haven't dared to try the Stock by Attributes facility on EP yet. Baby steps.

soxophoneplayer:

OMG - this link brought me success - particularly the part when "save as" edited file to check the 'edit filter settings' box. Checking this generates the dropdown to select utf-8. I had just been doing save as - csv without checking that box. Kept getting 'no model field in record, this line was skipped' when uploading/importing the edited file.

All this is with zc 1.5.5a, Responsive Sheffiled Blue 2.0 adapted of 1.5.5a, many mods, and Easy Populate 4.0.35

I haven't dared to try the Stock by Attributes facility on EP yet. Baby steps.

Well I am glad you had success cos so far I haven't had any as mine is full of semi-colons for the spaces. Right Yes it is for open office and I was doing the same as you was.

LittleAngell52:

Well I am glad you had success cos so far I haven't had any as mine is full of semi-colons for the spaces. Right Yes it is for open office and I was doing the same as you was.
Do you have access or feel like you might be able to export say the products_description table from your phpmyadmin? You should be able to export to a csv file. I'd be interested to know if it includes the semi-colons that are reported to be inserted when EP4 captures the data and stores it in the file.

mc12345678:

Do you have access or feel like you might be able to export say the products_description table from your phpmyadmin? You should be able to export to a csv file. I'd be interested to know if it includes the semi-colons that are reported to be inserted when EP4 captures the data and stores it in the file.

I have just downloaded Product_Description via PHP MyAdmin and everything is correct and no Semi-colons in the file. I have attached the file so you can see for yourself.

I reviewed the above file (visually) didn't get a chance to put it through some editors that detect characteristics of the data.

I have three thoughts of things to try.

1. Export the categories listing.
2. Download the generated file.
3. Post the file (do not open the file with any software in this or the previous steps.)

2nd thing: in YOUR_ADMIN/easypopulate_4.php at line 6, change

$csv_delimiter = ",";

To:

$csv_delimiter = "\x2c";
``` (this is the UTF-8 equivalent to a comma. Then export the categories listing again, post it as a second "file" do not edit or open the file before posting the contents.

3rd thing to try is to read through and verify following the below or similar instruction for importing the CSV into Open Office. Note the expected delimiter is a comma.
<https://wiki.openoffice.org/wiki/Documentation/OOo3_User_Guides/Getting_Started/Opening_existing_spreadsheets#Opening_CSV_Files>

Kind of guessing, thinking that if the export help file helped soxophoneplayer, then perhaps the above would help you or another...

mc12345678:

I reviewed the above file (visually) didn't get a chance to put it through some editors that detect characteristics of the data.

I have three thoughts of things to try.

1. Export the categories listing.
2. Download the generated file.
3. Post the file (do not open the file with any software in this or the previous steps.)

2nd thing: in YOUR_ADMIN/easypopulate_4.php at line 6, change

$csv_delimiter = ",";

> To:
> ```
$csv_delimiter = "\x2c";
``` (this is the UTF-8 equivalent to a comma. Then export the categories listing again, post it as a second "file" do not edit or open the file before posting the contents.
> 
> 3rd thing to try is to read through and verify following the below or similar instruction for importing the CSV into Open Office. Note the expected delimiter is a comma.
> <https://wiki.openoffice.org/wiki/Documentation/OOo3_User_Guides/Getting_Started/Opening_existing_spreadsheets#Opening_CSV_Files>
> 
> Kind of guessing, thinking that if the export help file helped soxophoneplayer, then perhaps the above would help you or another...

OK Thank you mc12345678. I will give it a try once my site it up on the new server as I just waiting on the new hosting company to make my sites like.

LittleAngell52:

OK Thank you mc12345678. I will give it a try once my site it up on the new server as I just waiting on the new hosting company to make my sites like.
Well, if that's the case, I wouldn't worry about the test of bullet 2 above, because 1) code should work out-of-the-box (to the extent that the 4.0.35.ZC.1 version downloaded is free of bugs). 2) have potentially new/different things to deal with so would suggest just trying to use the code again as originally provided and also for education to read the previous post. :)

mc12345678:

Well, if that's the case, I wouldn't worry about the test of bullet 2 above, because 1) code should work out-of-the-box (to the extent that the 4.0.35.ZC.1 version downloaded is free of bugs). 2) have potentially new/different things to deal with so would suggest just trying to use the code again as originally provided and also for education to read the previous post. :)

Ok thank you. I am still setting up server side of the new hosting company once I have installed EP onto the new server I will be using that to get products up onto my store.

LittleAngell52:

Ok thank you. I am still setting up server side of the new hosting company once I have installed EP onto the new server I will be using that to get products up onto my store.
You're going to import your "existing" database first though correct? And then add additional product using EP4 or similar, correct?

mc12345678:

You're going to import your "existing" database first though correct? And then add additional product using EP4 or similar, correct?

I thought I might start from afresh as just to make sure everything is going smoothly. I have also found out that I have got broadband issues which don't help matters hopefully they can fix the problem via the telephone exchange. If they can't then they will have to come out to the home and test equipment in my home. I have to keep an eye on how the internet behave's and if no improvement I have to ring them back tomorrow (Mon) to book them coming out to the home.