When will the new 1.5.2 version be available for download?
Printable View
When will the new 1.5.2 version be available for download?
Thanks for the reminder!:smile:Quote:
Originally Posted by slitter
I'll get that packaged up and report back.
I've just submitted v1.5.2 of the DbIo to the Zen Cart plugins for review; I'll post back here once it's available for download (https://www.zen-cart.com/downloads.php?do=file&id=2091).Quote:
Originally Posted by lat9
This release contains changes associated with the following GitHub issues:
#124: Recognize utf8mb4 DB_CHARSET as a valid match to a CHARSET of utf-8
#125: Recognize a field-type of double.
#126: Accept negative integer values.
That was fast!:smile: DbIo 1.5.2 is now available for download.Quote:
Originally Posted by lat9
Thanks for the update.. just wondering if it is possible to combine Order information from Orders, Orders Products, Orders Attributes, Order Total, Order history tables and combine them with Customer information such as Customer name, Customer address ##etc etc ##into ONE CSV file ?
That's a tall order as there are (as you've identified) a significant number of tables to pull together. I'll give it some consideration, but will caution you not to expect anything soon.Quote:
Originally Posted by slitter
Just installed ZC 1.56a. a nice clean new install and then added DbIo. I'm attempting to merge to product databases into one. I used DbIo to export products from the other 2 ZC installations, both of which are v1.5.5b. Using excel on the two exported CSV files I changed the product_ID column to have unique numbers so there wouldn't be any conflict. It all looks good in the CSV file, but when I attempt to import I get a bazillion errors of "Value (1) is not an integer" (the number in the parenthesis changes with the number in the field it identifies. It looks like there are about 7 columns that generate this error message even though, there is definitely and "integer" in those fields. And the CSV appears to be correctly formated as far as numbers NOT having quotes around them and no extra spaces etc.. So how to I get DbIo or MySql to stop rejecting my integers?
Here is the displayed error message after attempting the importQuote:
Originally Posted by lynbor
.
The DbIo import from file "/hm//public_html/zc/chnk-Dd-fsH/dbio/dbio.Products.upload2.csv" was completed with 6707 errors and 518 warnings. 0 records were inserted or updated.
And here is a portion of the log
2019-04-03 16:43:42:[*] products.products_type, line #2: Value (1) is not an integer
2019-04-03 16:43:42:[*] products.products_virtual, line #2: Value (0) is not an integer
2019-04-03 16:43:42:[*] products.products_date_added, line #2: Value (0000-00-00 00:00:00) is not a recognized date value; the default value for the field will be used.
2019-04-03 16:43:42:[*] products.products_status, line #2: Value (1) is not an integer
2019-04-03 16:43:42:[*] products.products_priced_by_attribute, line #2: Value (0) is not an integer
2019-04-03 16:43:42:[*] products.product_is_free, line #2: Value (0) is not an integer
2019-04-03 16:43:42:[*] products.product_is_call, line #2: Value (0) is not an integer
2019-04-03 16:43:42:[*] products.products_quantity_mixed, line #2: Value (1) is not an integer
2019-04-03 16:43:42:[*] products.product_is_always_free_shipping, line #2: Value (0) is not an integer
2019-04-03 16:43:42:[*] products.products_qty_box_status, line #2: Value (1) is not an integer
2019-04-03 16:43:42:[*] products.products_sort_order, line #2: Value (10) is not an integer
2019-04-03 16:43:42:[*] products.products_discount_type, line #2: Value (2) is not an integer
2019-04-03 16:43:42:[*] products.products_discount_type_from, line #2: Value (0) is not an integer
2019-04-03 16:43:42:[*] products.products_mixed_discount_quantity, line #2: Value (1) is not an integer
And here is a portion of the CSV data I'm trying to import.
v_products_id,v_products_type,v_products_quantity,v_products_model,v_products_im age,v_products_price,v_products_virtual,v_products_date_added,v_products_last_mo dified,v_products_date_available,v_products_weight,v_products_status,v_products_ ordered,v_products_quantity_order_min,v_products_quantity_order_units,v_products _priced_by_attribute,v_product_is_free,v_product_is_call,v_products_quantity_mix ed,v_product_is_always_free_shipping,v_products_qty_box_status,v_products_quanti ty_order_max,v_products_sort_order,v_products_discount_type,v_products_discount_ type_from,v_products_price_sorter,v_products_mixed_discount_quantity,v_metatags_ title_status,v_metatags_products_name_status,v_metatags_model_status,v_metatags_ price_status,v_metatags_title_tagline_status,v_products_name_en,v_products_descr iption_en,v_products_url_en,v_products_viewed_en,v_manufacturers_name,v_tax_clas s_title,v_categories_name,v_dbio_command
1,1,8968,468-9120-16,468-9120-16.jpg,20.51,0,0000-00-00 00:00:00,6/25/2018 8:35,,2,1,1037,1,1,0,0,0,1,0,1,0,10,2,0,20.51,1,1,1,1,1,1
AS you can see, line 2, the first two items are in fact integers. Arugh!
PM sent.
@lynbor, thanks for a copy of that product-import CSV. I took the first line, stripping all others, and added the DbIo command ADD as the last column, so that the added product won't overwrite my test setup.
I did receive:
Where the category-related issues are due to differences between my categories and yours, but I'm not seeing the "Value is not an integer". Are you using the same version of DbIo and its parameters (set in Configuration->DbIo Manager Settings) for both the store from which you're exporting and the store to which you're importing?Code:✗ products.products_date_added, line #2: Value (0000-00-00 00:00:00) is not a recognized date value; the default value for the field will be used.
✗ Product not inserted at line number 2; category id (0) has categories.
✗ products.products_date_added, line #3: Value (0000-00-00 00:00:00) is not a recognized date value; the default value for the field will be used.
✗ Product not inserted at line number 3; category id (0) has categories.
✗ products.products_date_added, line #4: Value (0000-00-00 00:00:00) is not a recognized date value; the default value for the field will be used.
✗ Product not inserted at line number 4, no match found for categories_name (Irontite).
I installed DbIo from the same file to all three shopping cart programs. The only setting change I made was to the version I'm importing into I turned on the ability for products to be able to create catagories. Otherwise they are all from the same install files. Also, i'm importing into a brand new fresh full install without sample data in the database. (not sure if that matters) It's just weird that it thinks those numbers are not integers. How is that even possible?Quote:
Originally Posted by lat9
@lynbor, I still don't have an answer regarding the results you're seeing and have requested that a full DbIo debug be generated and sent to me directly.
Correction found for the issue reported by @lynbor; see https://github.com/lat9/dbio/commit/...7bb295aebedbea for details.
Hi,
I installed DbIo on ZC 1.5.0 which runs non english language. Copied the language files to my language folders and DBIo seemed to work. Then I started to make around 1700 product import preparations and spent all most a day of doing so. Now I am little frustrated because I get this error:
The current import-file is missing these (v_products_id) required columns; the import is disallowed.
I use ; as a delimeter but changed that on the settings to be correct first thing. I also converted to , delimeter but no change. v_products_id is first column in my csv file. This is very frustrating because I have a tight time frame regarding these products and now I have 0 of them for sale and selling season goes by hour by hour... Any help would be greatly appreciated.
I turned out debugging but it revealed nothing I could see, then I made an export from the folder where I was going to import products and it revealed something very peculiar:
Attachment 18409
Actually that is all most funny but I am so pissed of I am not laughing. See Wikipedia and find out what an Integer is
Okay, perhaps the problem lies here, because we use umlauts the db collation is the Real deal aka UTF-8 not utf8, no they are not the same thing: https://www.iana.org/assignments/cha...ter-sets.xhtml Preferred name is UTF-8!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
So this reveals something: https://medium.com/@adamhooper/in-my...4-11761243e434
So is your dbio using 3 bytes encoding?
There is a ready made library for utf-8 support: https://github.com/tchwork/utf8/blob...Shim/Iconv.php
Sorry if I was very snappy earlier, haven't slept for ages and totally lost it.
There is a ready made library for iconv utf-8 support: https://github.com/tchwork/utf8/blob...Shim/Iconv.php
Seems it could possibly be incorporated to support other encodings. this is from forceutf8 at encoding.php:
The database in question is ancient and has been around since early 2000 and db-tables use utf-8(so it supports newly named utf8mb4 if I have understood right) and must accomodate all sorts of peculiar strings because related to technical products and language is not english to begin with. DB is ancient, converted possibly many times to support those and I suspect it contains åö䩪«¬##® etc chars. So the db connection is utf-8 in configure.phpCode:* It may fail to convert characters to UTF-8 if they fall into one of these scenarios:
*
* 1) when any of these characters: ÀÁÂÃÄÅÆÇÈÉÊËÌÍÎÏÐÑÒÓÔÕÖ×ØÙÚÛÜÝÞß
* are followed by any of these: ("group B")
* ¡¢£¤¥¦§¨©ª«¬##®¯°±²³´µ¶•¸¹º»¼½¾¿
* For example: %ABREPRESENT%C9%BB. «REPRESENTÉ»
* The "«" (%AB) character will be converted, but the "É" followed by "»" (%C9%BB)
* is also a valid unicode character, and will be left unchanged.
*
* 2) when any of these: àáâãäåæçèéêëìíîï are followed by TWO chars from group B,
* 3) when any of these: ðñòó are followed by THREE chars from group B.
and I am not sure if you try to import öä宩ª strings to it and have mysql db connection of utf8 and db tables utf-8 with myisam. What will happen? mysql utf8 connection means 3-byte character support right? So I am in terrible trouble if I try to squeeze 3 byte stuff which requires special chars in 4 byte environment?
I guess myisam is a good enough storage engine still for lots of reads and less writes. I have still no proper testing environment so can not simply test things out. Thanks to our very sluggish hosting operator.
Db currently anyways works and shows special characters right. Reason I must understood this thorough is that we are planning (or my boss is planning) to accomodate extra 30-70K products into that db. This tool would be a great help say for transferring few thousand products at a time. Next part is perhaps more complex but I tried to start with this.
Sorry for lengthy post.
Quote:
Originally Posted by OopsIbrickedIT
It sounds like (from the first referenced post) that you're importing those products. You'll need to add a column named v_dbio_command and fill each column with the DbIo command ADD to force the import of those products.Quote:
Originally Posted by OopsIbrickedIT
For the second referenced post, you've run into the same issue as @lynbor; see post #213 for the correction.
I installed the github upgrade but I still have import problems. Now I get:Quote:
Originally Posted by lat9
So are also warnings preventing the upgrade?Code:dbio.Products.test24_1_500.csv" was completed with 0 errors and 1071 warnings. 0 records were inserted or updated.
Apparently! What were the warnings?
Here, I have made the subcategories like :: Vanteet :: 19 tuumaa but I still get this:Quote:
Originally Posted by lat9
Attachment 18415
Would you post (between CODE tags) one line of that import CSV?
Here is first part of it:Code:v_products_id;v_products_type;v_products_quantity;v_products_model;v_products_image;v_products_price;v_products_virtual;v_products_date_added;v_products_last_modified;v_products_date_available;v_products_weight;v_products_status;v_products_ordered;v_products_quantity_order_min;v_products_quantity_order_units;v_products_priced_by_attribute;v_product_is_free;v_product_is_call;v_products_quantity_mixed;v_product_is_always_free_shipping;v_products_qty_box_status;v_products_quantity_order_max;v_products_sort_order;v_products_discount_type;v_products_discount_type_from;v_products_price_sorter;v_products_mixed_discount_quantity;v_metatags_title_status;v_metatags_products_name_status;v_metatags_model_status;v_metatags_price_status;v_metatags_title_tagline_status;v_products_name_fi;v_products_description_fi;v_products_short_desc_fi;v_products_url_fi;v_products_viewed_fi;v_manufacturers_name;v_tax_class_title;v_categories_name;v_dbio_command
0;1;0;RHPRO295947R/MGM/3000(1169);art_1011159.jpg;553.9;0;12.4.2019 22:56;12.4.2019 22:58;;10;1;0;1;1;0;0;0;1;0;1;0;0;0;0;553.9;1;0;1;1;1;0;BARRACUDA PROJECT 2.0 Mattgunmetal/ undercut Colour Trim punaine;BARRACUDA PROJECT 2.0 Mattgunmetal/ undercut Colour Trim punainen Vanne 9.5x19 - 19 tuumaa 5x112 Pulttijako;;;0;;;:: Vanteet ::^Barracuda^19 tuumaa^5x112;ADD
0;1;0;RHPRO285945R/MGM220293000(1173);art_1011157.jpg;569.65;0;12.4.2019 22:56;12.4.2019 22:58;;10;1;0;1;1;0;0;0;1;0;1;0;0;0;0;569.65;1;0;1;1;1;0;BARRACUDA PROJECT 2.0 Mattgunmetal/ undercut Colour Trim punaine;BARRACUDA PROJECT 2.0 Mattgunmetal/ undercut Colour Trim punainen Vanne 8.5x19 - 19 tuumaa 5x112 Pulttijako;;;0;;;:: Vanteet ::^Barracuda^19 tuumaa^5x112;ADD
0;1;0;RHPRO295947R/MGM220283000(1171);art_1011137.jpg;588.55;0;12.4.2019 22:56;12.4.2019 22:58;;10;1;0;1;1;0;0;0;1;0;1;0;0;0;0;588.55;1;0;1;1;1;0;BARRACUDA PROJECT 2.0 Mattgunmetal/ undercut Colour Trim punaine;BARRACUDA PROJECT 2.0 Mattgunmetal/ undercut Colour Trim punainen Vanne 9.5x19 - 19 tuumaa 5x112 Pulttijako;;;0;;;:: Vanteet ::^Barracuda^19 tuumaa^5x112;ADD
0;1;0;RHPRO285945R/MGM/3000(1151);art_1011072.jpg;532.9;0;12.4.2019 22:56;12.4.2019 22:58;;10;1;0;1;1;0;0;0;1;0;1;0;0;0;0;532.9;1;0;1;1;1;0;BARRACUDA PROJECT 2.0 Mattgunmetal/ undercut Colour Trim punaine;BARRACUDA PROJECT 2.0 Mattgunmetal/ undercut Colour Trim punainen Vanne 8.5x19 - 19 tuumaa 5x112 Pulttijako;;;0;;;:: Vanteet ::^Barracuda^19 tuumaa^5x112;ADD
0;1;0;RHPRO285945R/MGM22029(1086);art_1011075.jpg;539.2;0;12.4.2019 22:56;12.4.2019 22:58;;10;1;0;1;1;0;0;0;1;0;1;0;0;0;0;539.2;1;0;1;1;1;0;BARRACUDA PROJECT 2.0 Mattgunmetal vanne 8.5x19 - 19 tuumaa 5x11;BARRACUDA PROJECT 2.0 Mattgunmetal Vanne 8.5x19 - 19 tuumaa 5x112 Pulttijako;;;0;;;:: Vanteet ::^Barracuda^19 tuumaa^5x112;ADD
0;1;0;RHPRO290035T/MGM12124(1089);art_1011121.jpg;640;0;12.4.2019 22:56;12.4.2019 22:58;;10;1;0;1;1;0;0;0;1;0;1;0;0;0;0;640;1;0;1;1;1;0;BARRACUDA PROJECT 2.0 Mattgunmetal vanne 9x20 - 20 tuumaa 5x120;BARRACUDA PROJECT 2.0 Mattgunmetal Vanne 9x20 - 20 tuumaa 5x120 Pulttijako;;;0;;;:: Vanteet ::^Barracuda^20 tuumaa^5x120;ADD
Is Finnish the default language for your store? I've taken the CSV sample that you provided (changing the language-based fields from _fi to _en), creating the associated categories and had no issue with the import.
Hi,
yes finnish is the default language and old shop does not seem to have even an option to change language. I just started working with this shop. I will try to change to _en
If I remember right I had to copy some files to english side to finnish side when installing to get the GUI visible & working. It could be perhaps something related to that.Quote:
Originally Posted by lat9
I tried changing language related categories to _en and I got same results aka warning can not insert to subgategories because they don't exists.
Seems to have fixed it for me. Just tried importing yesterday and got 3 zillion integer errors. Added the GitHub fixes and all seems good now. Fixing to install and fire up a fresh copy of zencart and try again.Quote:
Originally Posted by lat9
Thank you Lat9. I also installed latest Github version and got rid of Integer errors.
Main reason I could not make exports to subcategories was that I had 2 same named categories the old one without subcategories was BARRACUDA and the new which had right subcategories was named Barracuda. The db-connection query does not see any difference between them and because I had "make categories from csv" turned off it could not make categories to old BARRACUDA folder either. Lat9 spotted that. Thank you to her very much! I have now bulk imported over 1500 products to ZC with DbIo without any problems.
You're welcome, @OopsIbrickedIT, I'm glad to have helped.
I've just submitted v1.5.3 of the DbIo Manager to the Zen Cart plugins for review and will post back here when it's available for download (https://www.zen-cart.com/downloads.php?do=file&id=2091).
This release contains corrections for the following GitHub issues:
#127: Auto-create categories error on more recent/strict versions of MySQL.
#128: Fatal error adding a product
#129: Incorrect detection of invalid integer fields.
#130: Unwanted PHP Notice when creating a product.
Great plugin and will be very useful, but I'm not sure if there is a problem with plugin or my DB. Maybe I'm doing something wrong, but when I am trying to add new items to ProductOption, I make all new options have "v_products_options_id" equal to "0". I upload CSV and it says import is successful but when I check the Option Name Manager, none are entered except for the last entry, which in Option Name Manager has ID = 0.
Now available for download.Quote:
Originally Posted by lat9
I've created this issue (https://github.com/lat9/dbio/issues/131) to track the change required.Quote:
Originally Posted by howb
Noting that a similar issue is associated with the ProductsOptionsValues import. Part of the underlying cause was a subtle coding change introduced in zc156 where a default (id = 0) entry was added to each of the products_options and products_options_values tables.Quote:
Originally Posted by lat9
I've just submitted v1.5.4 for review by the plugin moderators. This release contains the changes associated with the following GitHub issues:
#122: Update ProductsAttribsRaw to support a "REMOVE" command.
#131: ProductsOptions/ProductsOptionsValues: Insert error.
#132: Correct various PHP "Notice" issues.
#133: ProductsAttribsRaw throws error for strict MySQL installations.
#134: ProductsDiscountQuantity throws error for strict MySQL installations.
I'll post back once it's available for download.
That was lightning fast! Now available for download.Quote:
Originally Posted by lat9
Thanks for fixing the issues! ProductOptions working well now. It's a great replacement for Apsona.Quote:
Originally Posted by lat9
I'm trying to change a products Master category? Is this possible? When I change category in Products Handler it makes it a linked product?
Thanks again for all your help
@howb, I've created this issue (https://github.com/lat9/dbio/issues/135) on the DbIo GitHub repository to track the associated change.
This may well be a daft question, but I've read the docs and this thread and have either missed the obvious or it isn't there.
How to import/export Specials data to/from the Specials table?
Not a daft question, nor did you miss the description in the documentation. There's not (currently) a ProductSpecials handler, but I've created a GitHub issue to identify and track the request.Quote:
Originally Posted by Ryk
Thanks. Looking forward to seeing it.
Another possibly silly question. I can see that v_dbio_command can include ADD or REMOVE, but what should be the command for just updating? Leaving the column blank throws a fatal error.
All I've found in the readme is
Quote:
DbIo introduces a new column (v_dbio_command) that a handler can conditionally enable to support record-removal and/or other commands. Starting with v1.1.0, the Products handling supports this field; set that column's value to REMOVE for a particular product and, if the product exists, it will be removed.
You've not given me much to work with! What version of DbIo, which import handler, what is the fatal error thrown?Quote:
Originally Posted by Ryk
Thanks for getting back to me.
Version 1.5.4
Products
Unrecognized command (0) found at line #2; the operation was not performed.
(This was because file had 0 under v_dbio_command - changing it to ADD removed the error)
But my question should probably have been - is there a specific entry required in the v_dbio_command column when just updating a product
When simply updating a product, the v_dbio_command column should be left blank (i.e. an empty string).Quote:
Originally Posted by Ryk
Hi Cindy.
Zen Cart 1.5.6a
PHP: 7.2.18
MySQL 5.6.44
DBIO Version 1.5.4
Handler - Products
If we leave products_id blank, we get
zen_products.products_id, line #2: Value () is not an integer
Entering a products_id of 0 seems counter-intuitive but that then gives a successful import. Just want to check if this is expected behaviour?
Ryk, that's the expected behavior, albeit counter-intuitive, since the products_id value is (in the database) an integer.Quote:
Originally Posted by Ryk
Are you inserting or modifying products?
Thanks. I'm testing with one of those clients who has a little bit of knowledge of the dangerous kind, doesn't like change (been a long time user of EasyPop) and generates his csv file from Access so the waters keep getting a little muddied! :smile:
We're adding, modifying and removing.
I found I had to download his file and change the format of his model number from "number" to "text" (he has alpha-numeric model numbers) , then re-upload it to get a successful import. This doesn't make sense to me as I thought that formatting was irrelevant in a csv file.
But your module is excellent and I'm gradually getting him to believe it! LOL
I've just submitted v1.5.5 of the Database I/O Manager to the Zen Cart plugins for review and will post back here once approved.
This release contains changes associated with the following GitHub issues:
#138: Double record-header included in first chunk of a split file.
#139: Don't record generated SQL when performing a full import (for performance).
#140: Disregard empty records during CSV import operations.
Now available for download: https://www.zen-cart.com/downloads.php?do=file&id=2091Quote:
Originally Posted by lat9
I've just submitted v1.5.6 of the DbIo to the Zen Cart moderators for review and will post back when it's available for download.
This release contains changes associated with the following GitHub issues:
#142: Correct split when fields contain embedded spaces.
#143: Correct PHP notice when imported CSV contains blank lines.
#141: Add select/unselect all for file delete operation.
Thanks for the great mod. I just uploaded to 1.5.6c. I am trying to import my products. I downloaded csv from my supplier and getting this error when trying to import:
Please choose an upload file that is associated with the current handler (Products), e.g. dbio.Products.*.csv.
What does this mean exactly?
You have to have the importing csv named as per the example in the error message and its content needs to be in the same format as the dbio output csv.
Further to that, it is highly unlikely that your supplier will be providing the data in the format expected by dbio/Zencart.
You should download your existing products using dbio and use that file as a template into which you copy the relevant information from your supplier's file to the appropriate columns.
Now available for download: https://www.zen-cart.com/downloads.php?do=file&id=2091Quote:
Originally Posted by lat9
Hi All ,
Trying out DB I/O and looks good so far . I am having am issue with an error message of "The current import-file is missing these (v_products_id) required columns; the import is disallowed." . I did find a link to that message in this thread which related to the csv separator , which I tried changing.
I turned on the log file and have attache to this post . Could someone take a look and see what I am doing wrong ?
Thanks in advance !!
https://yadi.sk/d/6TYwKEApZS1A2g
The columns in the header don't seem to match the associated data (like I don't see where the v_products_model is supplied). If you are trying to add all new products, then you'll include a v_dbio_command column and set that column for all newly-added products to ADD.Quote:
Originally Posted by Hasher
What program did you use to create that csv-import; it's currently encoded as UTF-8 BOM instead of the expected UTF-8, and I don't know if that's affecting the import.
Thanks Lat9
I will do my best to recreate the file as the export. I used VB.NET and and automated MS EXCEL to create file . I will make sure it saves as UTF-8!
Hi Lat9
I made what I think is a perfect copy of the import files. I have changed the encoding to UTF-8 , Office 365 version of only shows UTF8 encoding but no UTF8 BOM . So im not sure if it is saving to UTF8 BOM encoding without giving me an option . If its an encoding issue the I guess I need to get a different copy of a CSV editor.
I have tried chnaging the seperator and have included the logs in my files. Current error is "The current import-file is missing these (v_products_id, v_products_model) required columns; the import is disallowed."
Part in logs that worries me is "2019-08-21 10:19:56: importGetHeader, using headers:
Array
(
[0] => PK ¡O¬}° ñ xl/workbook.xmlMNÃ0…¯bù 8uH‘¢$ ‹.@•@°6Τ±ê? µÇÇq$¬<oæóÓ›i.Ï_ÎÉÕhjl飯 r#Âó`ÓlphDLOÌ
)
"
Which seems to be its not reading encoding right ! I could be wrong :)
https://yadi.sk/d/kHp37h4B4zHp8A
Thanks for any help !
Paul
Since you're using Excel, you can change DbIo's encoding to use latin1 instead of utf8 (the default). I believe that will correct your issues.Quote:
Originally Posted by Hasher
Hi Lat9 ,
I changed to Latin1 and the import log does look better but I am now getting the message" "The current import-file is missing these (v_products_id) required columns; the import is disallowed." Uploaded a new log file if this helps. Do you use OpenOffice ?
https://yadi.sk/d/p9Ix-IZWuJ_FdA
That log doesn't tell me anything.:( Would you post a zip of the to-be-imported CSV?Quote:
Originally Posted by Hasher
Sure, here is a link :)
https://yadi.sk/d/FGB5d8r9lVOfbw
The issue is that the .csv input is being stored with UTF-8 BOM encoding. I was able to import that CSV after opening it in Notepad++, clicking the "Encoding" tab, clicking Convert to UTF-8 and saving.
Thanks Lat9 !
Excel is just being a bit*h ! Impressed with your work !
Yep, it's a love/hate relationship! Thanks for the compliment.:blush:Quote:
Originally Posted by Hasher
Excel is prehistoric/useless when dealing with encodings.Quote:
Excel is just being a bit*h
If you use Libreoffice you have full control of this on import and export of csv, I use this for all my work regarding import/export.
If I am adding a new product and the category I selected doesn't exist . Will it then be created ? I would try but I don't want to break anything :p
There is a configuration setting (Products: Auto-Create Categories on Import) that controls whether or not categories are automatically created on an import (default false).Quote:
Originally Posted by Hasher
I recommend using the Import (Check Only) action as the first step of any import, so you can "see" what will be done via an import prior to actually performing it. Clicking on the "View Import Details" link will identify any messages associated with the import ... essentially performing all the checking steps without actually performing any database manipulations.
Been using the Check Only feature . Very good Idea!Quote:
Originally Posted by lat9
I sent a PM Lat9 about something else !
To give credit where credit is due, it was @torvista that originally suggested that "Check only" feature!Quote:
Originally Posted by Hasher
Hi Cindy,
I've searched this thread and re-read the docs but haven't found an answer. I am trying to use dbio to link products to different categories but have not had any success yet. What happens is it just moves the products to the newly specified category. Am I missing something or is this not an available function of dbio?
I see a workaround. I need to add the products to the new linked category, which makes that the new master category. I then need to edit the csv to change the category back to the original and re-upload and import to set the master category back to the original.
Hi All,
I am having trouble importing product attributes , I have faithfully copied the exported file. When I do an import (check only) a blank page with "WARNING: An Error occurred, please refresh the page and try again.If you were entering information, press the BACK button in your browser and re-check the information you had entered to be sure you left no blank fields." appears.
Looking in the server debug log I have found this error
Code:[15-Sep-2019 12:29:06 UTC] Request URI: /admin/dbio_manager.php?action=file, IP address: 220.000.152.100
#1 trigger_error() called at [/home/u241385883/domains/rm/public_html/includes/classes/db/mysql/query_factory.php:171]
#2 queryFactory->show_error() called at [/home/u241385883/domains/rm/public_html/includes/classes/db/mysql/query_factory.php:143]
#3 queryFactory->set_error() called at [/home/u241385883/domains/rm/public_html/includes/classes/db/mysql/query_factory.php:270]
#4 queryFactory->Execute() called at [/home/u241385883/domains/rm/public_html/admin/includes/classes/dbio/DbIoHandler.php:931]
#5 DbIoHandler->importCsvRecord() called at [/home/u241385883/domains/rm/public_html/admin/includes/classes/dbio/DbIo.php:265]
#6 DbIo->dbioImport() called at [/home/u241385883/domains/rm/public_html/admin/dbio_manager.php:223]
--> PHP Fatal error: 1062:Duplicate entry '0' for key 'PRIMARY' :: INSERT INTO products_attributes_download (`products_attributes_filename`, `products_attributes_maxdays`, `products_attributes_maxcount`)
VALUES ('9', 7, 15) ==> (as called by) /home/u241385883/domains/rm/public_html/admin/includes/classes/dbio/DbIoHandler.php on line 931 <== in /home/u241385883/domains/rm/public_html/includes/classes/db/mysql/query_factory.php on line 171.
Here is a link to a sample CSV file I created . Any help is appreciated :)
https://yadi.sk/d/TscaBWdKATapHA
Hmm, I'll need some time to investigate. I'm not sure that I've previously tested with downloads. I've grabbed that CSV for inspection.
Confirmed as a bug; follow this GitHub issue for resolution.Quote:
Originally Posted by lat9
I've just submitted v1.5.7 of the DbIo to the Zen Cart moderators for review; I'll post back when it's available for download.
This release contains changes associated with the following GitHub issues:
#136: ProductsAttribsRaw: Include manufacturer's name in the export.
#147: Enable resizing of multi-select dropdowns.
#148: ProductsAttribsRaw: Correct MySQL error when adding a download attribute.
v1.5.7a (I'd forgotten to update the release date) is now available for download: https://www.zen-cart.com/downloads.php?do=file&id=2091Quote:
Originally Posted by lat9
Ok, I expect this is a dumb question, but how do I export/import metatags content (titles, descriptions, keywords)?
I would have expected this to be in the basic product handler, or in the meta-tags template...but it's not...:lookaroun
Your questions are never dumb, @torvista. I'll check it out in the morning.
I've just submitted v1.6.0 of the Database I/O Manager to the Zen Cart moderators for review; I'll post back here once it's available for download.
This release contains changes associated with the following GitHub issues, containing features and bugfixes requested/identified by @lankeeyankee and @torvista:
#137: Add a handler to import/export product specials (SpecialsHandler).
#144: Products/Orders: Correctly export customized templates, maintaining fields' positions.
#149: Give an option to automatically download an export, after the file's created.
#150: Correct PHP notice on copying template for multi-lingual stores when a language-record is missing.
#151: Products: Correct export/import of product-related meta-tag values.
#152: ProductsAttribsRaw: Ensure that download max-count and max-days are set to numeric values.
#153: Manufacturers: Correct multi-lingual stores' export, was only in the default language.
#154: Enhance some of the handlers' on-screen instructions.
#155: Correct PHP notice when an export has no fields to be exported.
#156: Products: Ensure sufficient information supplied for a to-be-added product.
#157: Install/upgrade, numeric database fields' defaults changed to be numeric.
#158: StatsHandler, truncate (i.e. empty) dbio_stats table on export.
I've just submitted v1.6.1 of the Database I/O Manager for review and will post back here when it's available for download.
Sorry for the churn, but I was notified that the changes in v1.6.0 included a MySQL error on the plugin's initial install.:(
This release contains changes associated with the following GitHub issues:
#161: Hide import "Check Report" pop-up title.
#162: Correct MySQL error on initial install, introduced in v1.6.0.
Quote:
Originally Posted by lat9
v1.6.1 is now available for download from the Zen Cart plugins.Quote:
Originally Posted by lat9
When I try to import "Products" with the program I receive an error "Internal Server Error" I looked through the logs that this program generated, but I do not see any errors. What could be causing this issue. I exported the product list with the same program [I am changing host plans I would like to move my products from the old store to the new one].
Thanks
When you receive an "Internal Server Error", that's normally due to a PHP or MySQL error in the page's processing. You 'should' see a myDEBUG-adm-*.log file present in your site's /logs directory.Quote:
Originally Posted by joem83
That file will identify what went wrong, as the DbIo 'logs' are simply a trace of what operations it has performed. Remember, if you post the contents of that myDEBUG log, that the information will contain your site's 'secret admin directory name', so be sure to xxx-out any such references.
Hi Cindy
Can you confirm that to use the remove command, it must be used in a file containing all columns?
I have a client who has been using a csv with just the v_dbio_command, v_products_id, v_products_model and is complaining that products aren't being deleted.
Thanks
Ryk
Ryk, I'll give this a look and report back if I can reproduce the issue.Quote:
Originally Posted by Ryk
... and I can't. Using DbIo v1.6.1 with a .csv containing only v_products_id, v_products_model and v_dbio_command.Quote:
Originally Posted by lat9
Check, though, to make sure that either (1) the DbIo configuration is set to allow duplicate models on import or (2) that the v_products_id and v_products_model fields' combinations refer to unique products for the site.
Hi Cindy
Thanks for that rapid response. So just using the 3 columns is OK - darn it! Hate it when the customer is right LOL
Can you explain though why allow duplicate models on import should be set when removing a product? He's bound to ask, so I may as well give him the corrrect answer rather than something I made up!
Thanks
Ryk
It depends on how the customer intends to perform the removal. If he's going to just list the v_products_id values to be removed and leave the v_products_model field blank, the REMOVE operation will fail since the duplicate-model checks occur prior to the determination that the request is a product removal.Quote:
Originally Posted by Ryk
Many thanks
Does anyone know what this error is related too ?
Other Products in the same category import correctly.Quote:
✗ Product not inserted at line number 488; category id (613) has categories.
✗ Product not inserted at line number 489; category id (613) has categories.
✗ Product not inserted at line number 490; category id (613) has categories.
Thank in advance !
Could you post one of the CSV lines that imports correctly and one that doesn't for that category #613?Quote:
Originally Posted by Hasher
Hi Lat9Quote:
Originally Posted by lat9
Attached a file , First line imports fine but next 3 lines are the problem
https://yadi.sk/d/ahtSFAF_KFri8w
Hope this helps. :)
... and it did! The first line identifies a category-path of Agriculture^Tractors^Challenger^MT 400 B^Quote:
Originally Posted by Hasher
and the subsequent lines identify a category-path of Agriculture^Tractors^Challenger
Upon importing that first product, the Agriculture^Tractors^Challenger category now has a sub-category (MT 400 B), so products can't be added to that 'parent' category.
Thank you Lat9 ,Quote:
Originally Posted by lat9
You save me everytime !
Thanks lat9,
DBIO saved a tremendous amount of time reconfiguring attribute switches that were affected by some attribute pricing changes made in 156 from 154
Export the table, edit it in Excell and upload..... whew
No problems, @RixStix, I'm happy that DbIo was helpful. For my edification, which attribute-pricing changes were causing you grief?Quote:
Originally Posted by RixStix