Printable View
It is pre-existing with products. Since the first several dozen attempts did nothing, I assumed that either I was doing something wrong or category creation was not a feature, so I began trying to import a single test product into an existing category.Quote:
Originally Posted by lat9
When you're adding a product, I suggest a two-fold approach:Quote:
Originally Posted by RixStix
1. Set the v_products_id value to 0 (not an empty string)
2. Include the v_dbio_command column and set that value to ADD.
TNXQuote:
Originally Posted by lat9
I will try again. I'm pretty sure using a v_products_id value 0 gave a white screen of death and sent me off in a different direction.
EDIT before the timelimit expired to edit this post.
Nothing added when I set the v_products_id to 0 (zero)
Code:2021-03-10 11:35:52: Forcing ADD of product at line #3, via DbIo command
2021-03-10 11:35:52: [*] products.products_date_added, line #3: Value () is not a recognized date value; the default value for the field will be used.
2021-03-10 11:35:52: [*] products.products_ordered, line #3: Value () is not a floating-point value.
2021-03-10 11:35:52: [*] products.metatags_title_status, line #3: Value () is not an integer
2021-03-10 11:35:52: [*] products.metatags_products_name_status, line #3: Value () is not an integer
2021-03-10 11:35:52: [*] products.metatags_model_status, line #3: Value () is not an integer
2021-03-10 11:35:52: [*] products.metatags_price_status, line #3: Value () is not an integer
2021-03-10 11:35:52: [*] products.metatags_title_tagline_status, line #3: Value () is not an integer
Rick, those errors in the CSV import (other than the products_date_added) will result in that record not being imported due to an error in the data-types.Quote:
Originally Posted by RixStix
I guess I don't understand other than it sounds like I have been wasting your time?
Products_ordered for a new product that is impossible to have been ordered? required?
meta_tags? required?
Rick, none of those fields are required but if they're included in the import, the value must be valid for the field, e.g. the products-ordered must be a valid floating-point number.Quote:
Originally Posted by RixStix
Thanks. When the "abbreviated" import didn't work, I assumed that a required field must have been neglected; thus the reason for going to the full file.
Back to square 1
Square 1. Original abbreviated import fileQuote:
Originally Posted by RixStix
Upload my abbreviated file
File Action: Import (check only)
Results: GREEN, 3 lines imported
File Action: Import (FULL)
White Screen of death
This is what happens when you put a 0 (zero) in the v_products_id field
Code:[11-Mar-2021 09:16:37 America/Los_Angeles] Request URI: /ADMINFOLDER/dbio_manager.php?action=file, IP address: 98.xxx.yyy.zzz
#1 trigger_error() called at [/home/chainwea/public_html/includes/classes/db/mysql/query_factory.php:171]
#2 queryFactory->show_error() called at [/home/chainwea/public_html/includes/classes/db/mysql/query_factory.php:143]
#3 queryFactory->set_error() called at [/home/chainwea/public_html/includes/classes/db/mysql/query_factory.php:270]
#4 queryFactory->Execute() called at [/home/chainwea/public_html/ADMINFOLDER/includes/classes/dbio/DbIoHandler.php:943]
#5 DbIoHandler->importCsvRecord() called at [/home/chainwea/public_html/ADMINFOLDER/includes/classes/dbio/DbIo.php:265]
#6 DbIo->dbioImport() called at [/home/chainwea/public_html/ADMINFOLDER/dbio_manager.php:240]
--> PHP Fatal error: 1062:Duplicate entry '0-1' for key 'PRIMARY' :: INSERT INTO products_description (`products_name`, `products_description`, `language_id`, `products_id`)
VALUES ('Sterling Clasp Assortment 1', 'This is a test description', 1, 0) ==> (as called by) /home/chainwea/public_html/ADMINFOLDER/includes/classes/dbio/DbIoHandler.php on line 943 <== in /home/chainwea/public_html/includes/classes/db/mysql/query_factory.php on line 171.
Rick, did you accompany that v_products_id = 0 with a v_dbio_command of ADD?
Yes, all caps ADD Used the same file that I sent to you but with 0 zero inserted into the prod_id fieldQuote:
Originally Posted by lat9
Crap, the screen paste doesn't work.
Rick, I'll see what's up a bit later. I've got a bunch of paid work that's got to be done.Quote:
Originally Posted by RixStix
No problem. I understand paid dollars being first in line.
1.5.7c
latest and greatest DBIO
I am getting this error on just 5000 rows (7.25mb) to upload:
Warning: File is larger than allowed sizes. See "Maximum Values" settings.
I am able to process like 40,000 records with the other I/O module ... albeit there are some errors happening with some records.
Is there some way I can open it up to process more rows or am I doing something wrong? How many rows would you estimate it should be able to upload at one time?
Also, would be great if it could spit out the SEO url associated with each product.
Thank you!
The Maximum Values settings are probably your server's PHP configuration, specifically upload_max_size and post_max_size
You can see their current settings via Admin->Tools->Server Info.
To change them, talk to your hosting company's support team.
Quote:
Originally Posted by shrimp-gumbo-mmmhhh
As DrByte indicated, it's not the number of rows being processed, it's the size of the .csv file itself.Quote:
Originally Posted by DrByte
I'll also look at including a v_products_link (export-only) value for the Products output.
That updated version of /admin/includes/classes/dbio/DbIoProductsHandler.php can be downloaded here (https://raw.githubusercontent.com/la...ctsHandler.php) while I prepare a v1.6.6 release.Quote:
Originally Posted by lat9
I've just submitted v1.6.6 of the Database I/O Manager for the Zen Cart moderators' review and will post back here when it's available for download.
This release contains changes associated with the following GitHub issues:
#184: PHP 8.1+ preparation.
#185: Correcting PHP Fatal error (Uncaught ArgumentCountError) for DbIoProductsHandler.
#186: Add 'v_products_link' (storefront link) to the DbIoProductsHandler.
Thank you DrByte! Good thought. The Database I/O has a few more fields than the Populate mod has .... but for my files the extra fields are empty so there is not too much difference in size.... I am able to load and import okay (at least without a message that the file is too big) about 37,000 products, I think at least 30,000 are getting put in????. I think I might be doing something wrong because I have gone down to 5000 rows and still not get it in....Quote:
Originally Posted by DrByte
Thank you for thinking on my issue!
Quote:
Originally Posted by lat9
Thank you so much! Excited to give it a try.
Noting that you can use the DbIo's Templates feature for your Products handling, reducing the number of fields exported to only those that you're manipulating. That will further cut down on the size of that imported .csv.Quote:
Originally Posted by shrimp-gumbo-mmmhhh
Now available for download: https://www.zen-cart.com/downloads.php?do=file&id=2091Quote:
Originally Posted by lat9
Great will test it out!
Is there a comparison of DbIo vs EP4 anywhere? I tried searching and did not find anything significant.
There some information in the DbIo's readme: https://vinosdefrutastropicales.com/...io/readme.htmlQuote:
Originally Posted by g2ktcf
Update: Look specifically in the Customization tab.
Hello lat9,
You mentioned that a could change the template to take out unpopulated fields to make the file size smaller..... do I really need to create a template as long as I just take away fields from an existing template?
Thank you!
Shrimp
You don't need to make a special template if you're going to simply remove columns from the import. It's just that having a template that 'supports' the import you're looking to do is a bit of a time-saver.Quote:
Originally Posted by shrimp-gumbo-mmmhhh
dear guys, i'm sorry if the answer was already given and i overlooked it. can this be installed besides EP without problems?
it looks great, ( i would if possible use it to export my customers and all, to implement in a new shop)
but my dyslectic puts a break on some reading sometimes. ( do my best honestly)
have a good weekend
DbIo is a totally separate entity from EP and can be safely installed together with EP.Quote:
Originally Posted by kernheimer
Quote:
Originally Posted by lat9
thank you so much for your quick answer! very much appreciated! i'm giving it a go :D
Zen Cart 1.5.7c
PHP Version 7.4.16
MySQL 5.7.32
I'm getting a MySQL error with exports for Manufacturers, ProuctsAttribsbasic, and Products.
For a manufacturers export the log is as follows:
Note the lack of a languages_id just before the ORDER BY.Code:[06-Aug-2021 20:33:34 Europe/Paris] Request URI: /testadmin/index.php?cmd=dbio_manager&action=export, IP address: ::1
#1 trigger_error() called at [/Users/steph/Sites/localhost/homebrew/includes/classes/db/mysql/query_factory.php:170]
#2 queryFactory->show_error() called at [/Users/steph/Sites/localhost/homebrew/includes/classes/db/mysql/query_factory.php:142]
#3 queryFactory->set_error() called at [/Users/steph/Sites/localhost/homebrew/includes/classes/db/mysql/query_factory.php:269]
#4 queryFactory->Execute() called at [/Users/steph/Sites/localhost/homebrew/testadmin/includes/classes/dbio/DbIo.php:167]
#5 DbIo->dbioExport() called at [/Users/steph/Sites/localhost/homebrew/testadmin/dbio_manager.php:156]
#6 require(/Users/steph/Sites/localhost/homebrew/testadmin/dbio_manager.php) called at [/Users/steph/Sites/localhost/homebrew/testadmin/index.php:11]
--> PHP Fatal error: 1064:You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near 'ORDER BY m.manufacturers_id ASC' at line 1 :: SELECT m.manufacturers_id, m.manufacturers_name, m.manufacturers_image, m.date_added, m.last_modified FROM zen_manufacturers AS m, zen_manufacturers_info AS mi WHERE m.manufacturers_id = mi.manufacturers_id AND mi.languages_id = ORDER BY m.manufacturers_id ASC ==> (as called by) /Users/steph/Sites/localhost/homebrew/testadmin/includes/classes/dbio/DbIo.php on line 167 <== in /Users/steph/Sites/localhost/homebrew/includes/classes/db/mysql/query_factory.php on line 170.
I went to DbioManufacturersHandler.php and set some error_log outputs after
the results of which areCode:$export_language = ($this->export_language == 'all') ? $this->languages[$this->first_language_code] : $this->languages[$this->export_language];
error_log("export language: ".$this->export_language);
error_log("first_language_code: ".$this->languages[$this->first_language_code]);
error_log("this export langueage: ".$this->languages[$this->export_language]);
error_log("export language var: ".$export_language);
The error logs for ProuctsAttribsbasic and Products also show a missing language_id in the query.Code:[06-Aug-2021 20:33:34 Europe/Paris] export language: all
[06-Aug-2021 20:33:34 Europe/Paris] first_language_code:
[06-Aug-2021 20:33:34 Europe/Paris] this export langueage:
[06-Aug-2021 20:33:34 Europe/Paris] export language var:
Any suggestions on the cause, and a solution to this issue?
Obviously a multiple-language failure is the cause; the solution will be an update to those handlers. See (https://github.com/lat9/dbio/issues/193) for the tracking of these changes.Quote:
Originally Posted by strelitzia
OK, I'm not able to reproduce this issue on either a single- or dual-language site.Quote:
Originally Posted by lat9
What languages are present in the site? What version of DbIo? What DB_CHARSET is being used?
Hi,
I have quite a few linked products originally uploaded using easypopulate CSV.
With Easypopulate CSV I had created spreadsheets with linked products listed as another row. This means that I would have multiple rows for one linked product.
All of my Easypopulate spreadsheets need updating to work with DBIO (as the category must be listed in just one column with the ^ delimiter). As DBIO only exports the master category I am unable to easily keep a record of linked categories.
On import the DBIO manager also requires multiple uploads to achieve the desired result – e.g. one import to add a linked category, then another import to set the master category back to what it was.
Would it be possible to import/export v_categories_name as a list of linked categories? I believe this has been mentioned by Torvista in post #361. This would make managing the master category and linked categories much easier.
Alternatively would it be possible to add an additional column such as v_categories_linked to allow linked categories to be clearly defined.
Any help with this would be much appreciated. We have found this add on to be one of the most useful mods available for Zen Cart. I would be happy to make a donation to help cover the costs of implementing these changes.
--
Many thanks
Richard
Richard, I like that v_categories_linked column idea. There's already an open issue (https://github.com/lat9/dbio/issues/135) requesting changes to the linked-categories' handling that I'll update to identify that implementation possibility.Quote:
Originally Posted by richard7315
I've just submitted v1.6.7 of DbIo for the Zen Cart moderators' review; I'll post back here when it's available for download.
This release contains changes associated with the following GitHub issues:
#189: ProductsHandler, select all sub-categories when a higher-level category is selected for export.
#190: Correct initial installation error for databases using a utf8mb4 collation.
#191: Correct PHP warning for product-addition and specified category is non-existant.
#192: Adding longtext as a possible text-type field.
#194: Updating language files to use HTML5 <br>'s
#195: Correctly disallow Products' import of duplicate models if disallowed via configuration.
#196: Disallow Products' import if an empty category/sub-category is specified.
Now available for download: https://www.zen-cart.com/downloads.php?do=file&id=2091Quote:
Originally Posted by lat9
Forgive me if I missed it in this thread already, but I'm looking for a couple of "best practices" or ideas on how to best implement this plugin to achieve a more seamless inventory management strategy. I started building an excel spreadsheet with formulas to help me standardize item titles, make it a little more user-friendly visually, and ensure I'm consistent with product codes, model numbers, descriptions, etc. This works great for building the inventory from scratch, but where I'm struggling is how to maintain it once the site goes live. For example, if an item sells, presumably I will export the database with updated information, but then am stuck with how to best link it to my master spreadsheet with formulas, etc. so that everything updates without having to repopulate formulas and risk messing up the products. A large portion of my inventory consists of unique/single quantity items, so I'm constantly adding/removing products and I'm finding the I/O database is a little more cumbersome for extensive changes/additions. Any suggestions would be appreciated.
I'm currently using an older version of Dbio (which will be replaced with the newest version when I finished upgrading to 1.5.7). I use it to break down our transactions by state. At this time, I can only get a total sale amount for each transaction. I need it broken down by sale amount and shipping amount. Is this in the new version--sorry, I read through most of the readme doc, but I didn't see that specific element. If not in the new version, could I request that it be added?
Request noted: https://github.com/lat9/dbio/issues/197Quote:
Originally Posted by HeleneWallis
Thanks, that will help with states that impose sales tax on shipping as well as the base sale amount.Quote:
Originally Posted by lat9
Success! DBIO succeeded where EZ Populate failed!
Question: would it make sense to default v_dbio_command to ADD when v_products_id = 0?
Oh also a question: after I exported, I copied the last row but when I tried to import I get warnings on the date field:
2022-03-22 11:17:01:[*] products.products_date_added, line #2: Value (2022-03-22 10:44:32) is not a recognized date value; the default value for the field will be used.
Should I just remove this column from the spreadsheet to prevent trouble?
I wonder if v_products_link should also be removed?
I searched the ReadMe and this thread but didn't see an answer. I suspect it's there as it's not a very unique question.
How do I change the Master Category? We have linked products and want to change the Master Category.
When I export, I see the v_categories_name column has only the current Master Category. Do I type in the new Master Category and re-import?
You might find help in the docs. https://docs.zen-cart.com/user/admin...aster-category.
I'm afraid the Accessibility Widget doesn't speak shikawgo. :cool:
Thank you for the help. However, I was looking for a way to do it with this plugin. There are hundreds of products that need updating so was looking to avoid one by one in the admin.Quote:
Originally Posted by dbltoe
Jim, see the online documentation (https://github.com/lat9/dbio/blob/ma...uctshandler.md) regarding some of the intricacies of the Products Handler, including how to (a) change the master category or (b) unlink a product from a category.Quote:
Originally Posted by jeking
Yes, that is what I was looking for. Thank you!Quote:
Originally Posted by lat9
Here's my confusion. One of the products in question is in two categories. I see this on the product page in the admin. When I export all products, there is only one category in the v_categories_name column in the csv, the current master category. In order to change it, do I need to enter the other category name in the v_categories_name and re-import?
Per that documentation referenced:Quote:
Originally Posted by jeking
Code:If the product is being updated, then the v_categories_name (if included) identifies the product's new master_categories_id. The product's previous master_categories_id becomes a linked category.
Thanks, I'll give that a try.Quote:
Originally Posted by lat9
Version 2.0.0 of DbIo is now available from the Zen Cart plugins: https://www.zen-cart.com/downloads.php?do=file&id=2091
This release contains updates for the following GitHub issues:
#209: DbIo manager, checkboxes can't be selected via labels
#207: Product Export: debug for empty trim on metatags
#206: Remove duplicate language constants for dbio_customize tool
#205: Unable to resize select windows in Safari
#203: PHP notice/warning when there's an error or it's not "ok to proceed"
#202: Drop support for Zen Cart versions prior to zc157
#201: PHP 8.2: explicitly declaring variables
#199: Use zen_cfg_read_only for the DbIo version 'setting'
#198: PHP 8.16: PHP deprecated, auto_detect_line_endings is deprecated
#197: Add shipping cost value to DbIoOrders output
Downloaded this plugin and followed the directions to upload the files. I also manually tried uploading file to proper folders to make sure nothing was missed. When I log into ADMIN and I click the HOME link on the right upper side of page where it says:Quote:
Originally Posted by lat9
Home Storefront Support Version Account Logoff
Nothing installed. My setup is as follows;
Zen-cart 1.58
New Install
Windows 11
Php 7.4 (also tried on 8.0)
Template: Clone of Bootstrap (also switched to regular bootstrap and tried clicking HOME)
Any debug-logs present?
NOTE: I replaced my directory name with "privatedir" to prevent visit to store (privacy reasons).Quote:
Originally Posted by lat9
mystore[20-Jan-2023 02:52:53 America/New_York] Request URI: /privatedir/, IP address: 173.231.210.61
#1 include(/home/jwsuok/public_html/privatedir/includes/extra_datafiles/dbio_file_database_names_admin.php) called at [/home/jwsuok/public_html/privatedir/includes/init_includes/init_file_db_names.php:78]
#2 require(/home/jwsuok/public_html/privatedir/includes/init_includes/init_file_db_names.php) called at [/home/jwsuok/public_html/privatedir/includes/application_top.php:198]
#3 require(/home/jwsuok/public_html/privatedir/includes/application_top.php) called at [/home/jwsuok/public_html/privatedir/index.php:25]
--> PHP Warning: Use of undefined constant DIR_FS_ADMIN - assumed 'DIR_FS_ADMIN' (this will throw an Error in a future version of PHP) in /home/jwsuok/public_html/privatedir/includes/extra_datafiles/dbio_file_database_names_admin.php on line 6.
[20-Jan-2023 02:52:53 America/New_York] Request URI: /privatedir/, IP address: 173.231.210.61
#1 include(/home/jwsuok/public_html/privatedir/includes/extra_datafiles/dbio_file_database_names_admin.php) called at [/home/jwsuok/public_html/privatedir/includes/init_includes/init_file_db_names.php:78]
#2 require(/home/jwsuok/public_html/privatedir/includes/init_includes/init_file_db_names.php) called at [/home/jwsuok/public_html/privatedir/includes/application_top.php:198]
#3 require(/home/jwsuok/public_html/privatedir/includes/application_top.php) called at [/home/jwsuok/public_html/privatedir/index.php:25]
--> PHP Warning: Use of undefined constant DIR_FS_ADMIN - assumed 'DIR_FS_ADMIN' (this will throw an Error in a future version of PHP) in /home/jwsuok/public_html/privatedir/includes/extra_datafiles/dbio_file_database_names_admin.php on line 9.
[20-Jan-2023 02:52:53 America/New_York] Request URI: /privatedir/, IP address: 173.231.210.61
#1 include(/home/jwsuok/public_html/privatedir/includes/extra_datafiles/dbio_file_database_names_admin.php) called at [/home/jwsuok/public_html/privatedir/includes/init_includes/init_file_db_names.php:78]
#2 require(/home/jwsuok/public_html/privatedir/includes/init_includes/init_file_db_names.php) called at [/home/jwsuok/public_html/privatedir/includes/application_top.php:198]
#3 require(/home/jwsuok/public_html/privatedir/includes/application_top.php) called at [/home/jwsuok/public_html/privatedir/index.php:25]
--> PHP Warning: Use of undefined constant DIR_FS_ADMIN - assumed 'DIR_FS_ADMIN' (this will throw an Error in a future version of PHP) in /home/jwsuok/public_html/privatedir/includes/extra_datafiles/dbio_file_database_names_admin.php on line 10.
Quote:
Here is the logs. I removed my store's directory name and replaced it with "privatedir" so it's not public. If you need to know it i can message you.Quote:
Originally Posted by lat9
Quote:
mystore[20-Jan-2023 02:52:53 America/New_York] Request URI: /privatedir/, IP address: 173.231.210.61
#1 include(/home/jwsuok/public_html/privatedir/includes/extra_datafiles/dbio_file_database_names_admin.php) called at [/home/jwsuok/public_html/privatedir/includes/init_includes/init_file_db_names.php:78]
#2 require(/home/jwsuok/public_html/privatedir/includes/init_includes/init_file_db_names.php) called at [/home/jwsuok/public_html/privatedir/includes/application_top.php:198]
#3 require(/home/jwsuok/public_html/privatedir/includes/application_top.php) called at [/home/jwsuok/public_html/privatedir/index.php:25]
--> PHP Warning: Use of undefined constant DIR_FS_ADMIN - assumed 'DIR_FS_ADMIN' (this will throw an Error in a future version of PHP) in /home/jwsuok/public_html/privatedir/includes/extra_datafiles/dbio_file_database_names_admin.php on line 6.
[20-Jan-2023 02:52:53 America/New_York] Request URI: /privatedir/, IP address: 173.231.210.61
#1 include(/home/jwsuok/public_html/privatedir/includes/extra_datafiles/dbio_file_database_names_admin.php) called at [/home/jwsuok/public_html/privatedir/includes/init_includes/init_file_db_names.php:78]
#2 require(/home/jwsuok/public_html/privatedir/includes/init_includes/init_file_db_names.php) called at [/home/jwsuok/public_html/privatedir/includes/application_top.php:198]
#3 require(/home/jwsuok/public_html/privatedir/includes/application_top.php) called at [/home/jwsuok/public_html/privatedir/index.php:25]
--> PHP Warning: Use of undefined constant DIR_FS_ADMIN - assumed 'DIR_FS_ADMIN' (this will throw an Error in a future version of PHP) in /home/jwsuok/public_html/privatedir/includes/extra_datafiles/dbio_file_database_names_admin.php on line 9.
[20-Jan-2023 02:52:53 America/New_York] Request URI: /privatedir/, IP address: 173.231.210.61
#1 include(/home/jwsuok/public_html/privatedir/includes/extra_datafiles/dbio_file_database_names_admin.php) called at [/home/jwsuok/public_html/privatedir/includes/init_includes/init_file_db_names.php:78]
#2 require(/home/jwsuok/public_html/privatedir/includes/init_includes/init_file_db_names.php) called at [/home/jwsuok/public_html/privatedir/includes/application_top.php:198]
#3 require(/home/jwsuok/public_html/privatedir/includes/application_top.php) called at [/home/jwsuok/public_html/privatedir/index.php:25]
--> PHP Warning: Use of undefined constant DIR_FS_ADMIN - assumed 'DIR_FS_ADMIN' (this will throw an Error in a future version of PHP) in /home/jwsuok/public_html/privatedir/includes/extra_datafiles/dbio_file_database_names_admin.php on line 10.
Sigh, I'll give it a look ... but I've tested in zc158.
FWIW, that constant "should" be defined in /YOUR_ADMIN/includes/defined_paths.php, which is one of the most earliest-running php scripts.
I have DBIO working now on my site. I basically deleted all files that were automatically uploaded by dbio once I renamed the admin folder to my admin name and restored my to my previous backup version. I decided to try again tonight and I manually uploaded all the files in the dbio package. Then clicked the "home" link. I didn't see anything indicating that it had installed but when I checked under Tools the Database I/O Manager link is there.Quote:
Originally Posted by printchic
Just updating that this problem is resolved.
FWIW, the admin side messaging for plugin installations/upgrades can get (as you saw) lost ... for whatever reason. Thanks for the update that all's well.
ZC 1.5 8
Database I/O (DbIo) Manager v2.0.0-beta3 (2023-01-02)
PHP Version 7.4.33
I have recently installed Dbio, having used Apsona until recently. I have read through this entire thread, and the most applicable set of instructions to import Products seems to come around page 11 or so, from 2017. Is there a more recent set of instructions?
I have a couple of hundred items to add to ZenCart; can I add them as a separate csv file, or do I append them to a downloaded file?
What about the Product ID value..I thought I undertstood it from the 2017 conversation, but since then a couple of posts indicate something different needed to be done. I understand that all fields need to be included in the upload, but which ones don't take a value or if a default value (blank or zero or whatever) which ones are they?
Your help is appreciated, and I apologize upfront for my lack of knowledge.
There's additional on-line documentation on the plugin's GitHub repository. For the ProductsHandler: https://github.com/lat9/dbio/blob/ma...uctshandler.md.Quote:
Originally Posted by Phil Soth
Note, too, that v2.0.0 of DbIo was released on 2023-01-19. I can't remember which specific updates occurred between the release and your beta version.
Using DBIO 2.0.0
Not sure if this has happened to anyone else or been mentioned before, but had an issue where the import was generating multiple duplicate categories with a single product in each - but only on some categories, not all.
The client supplied data was a bit off "ideal", but after a bit of head-scratching, realised that all the offending category names exceeded the VARCHAR value set for the category name. Increasing that cured the problem, and the 10000+ products correctly imported on the next attempt.
Notifying in case it's something that could be planned for within the code, but if it happens to you, the solution is simple.
ZC Version 1.5.8a
ERROR LOG:
Any ideas? Filename is correct. CSV is comma-delimited (and set to this in DBIO config) - but there is no Enclosure in the file - doesn't need one. There is no MODEL NUMBER as the products are DOCUMENT-GENERAL (type 3).Code:[24-Aug-2023 18:25:17 UTC] PHP Fatal error: Uncaught ValueError: fgetcsv(): Argument #4 ($enclosure) must be a single character in /var/www/vhosts/MY-WEBSITE.com/httpdocs/MY-ADMIN-FOLDER/includes/classes/dbio/DbIo.php:331
Stack trace:
#0 /var/www/vhosts/MY-WEBSITE.com/httpdocs/MY-ADMIN-FOLDER/includes/classes/dbio/DbIo.php(331): fgetcsv()
#1 /var/www/vhosts/MY-WEBSITE.com/httpdocs/MY-ADMIN-FOLDER/includes/classes/dbio/DbIo.php(270): DbIo->getCsvRecord()
#2 /var/www/vhosts/MY-WEBSITE.com/httpdocs/MY-ADMIN-FOLDER/dbio_manager.php(242): DbIo->dbioImport()
#3 /var/www/vhosts/MY-WEBSITE.com/httpdocs/MY-ADMIN-FOLDER/index.php(11): require('...')
#4 {main}
thrown in /var/www/vhosts/MY-WEBSITE.com/httpdocs/MY-ADMIN-FOLDER/includes/classes/dbio/DbIo.php on line 331
[24-Aug-2023 18:25:17 UTC] Request URI: /MY-ADMIN-FOLDER/index.php?cmd=dbio_manager&action=file, IP address: XX.XXX.XXX.XXX
--> PHP Fatal error: Uncaught ValueError: fgetcsv(): Argument #4 ($enclosure) must be a single character in /var/www/vhosts/MY-WEBSITE.com/httpdocs/MY-ADMIN-FOLDER/includes/classes/dbio/DbIo.php:331
Stack trace:
#0 /var/www/vhosts/MY-WEBSITE.com/httpdocs/MY-ADMIN-FOLDER/includes/classes/dbio/DbIo.php(331): fgetcsv()
#1 /var/www/vhosts/MY-WEBSITE.com/httpdocs/MY-ADMIN-FOLDER/includes/classes/dbio/DbIo.php(270): DbIo->getCsvRecord()
#2 /var/www/vhosts/MY-WEBSITE.com/httpdocs/MY-ADMIN-FOLDER/dbio_manager.php(242): DbIo->dbioImport()
#3 /var/www/vhosts/MY-WEBSITE.com/httpdocs/MY-ADMIN-FOLDER/index.php(11): require('...')
#4 {main}
thrown in /var/www/vhosts/MY-WEBSITE.com/httpdocs/EMY-ADMIN-FOLDER/includes/classes/dbio/DbIo.php on line 331.
EDIT - Looks like LINE 331insists on "Enclosure" - let me put one in and try again...
OK - have "repaired" the issue...Quote:
Originally Posted by schoolboy
This website is using ONLY the DOCUMENT_GENERAL product type - for which there is no admin screen INPUT for "Model Number" when adding/editing a product. (IE: we are using ZC as a "general CMS" for showcasing magazine and newspaper articles - so are not using any of ZC's shopping functions).
I therefore had blanks in the CSV file for "v_products_model" - but if I add these to th CSV, then the data import works.
... Maybe an idea to facilitate a function in DBIO that if a "product" is DOCUMENT_GENERAL, then v_products_model is not a mandatory field in the CSV ?
Thanks for the report and analysis, @schoolboy. Unfortunately the DbIo products' import is complicated enough without adding specific processing for the document-general product type.Quote:
Originally Posted by schoolboy
I'll note that when you perform a products' export, you'll see that the (albeit empty) products_model column is present.
Thanks CindyQuote:
Originally Posted by lat9
Yes... simply by inserting unique "model numbers" into the CSV fixes the issue. Perhaps a note in your installation documents to point this out is (as you so rightly say) a lot easier than 4 million lines of extra code :smile:
zencart 1.5.8a
PHP Version: 8.0.30
Database Engine: MySQL 8.0.36
Having an issue using the productattributesbasic importer.
Product imports work excellent! Uploading over 1000 products seemed to go without any issue (although it did give me a ton of warnings although no errors).
The only problem I am having is I downloaded the productattributesbasic CSV and I wanted to reupload it so I can have my drop down menus etc again. Uploading the spreadsheet is fine but as soon as I select the import and hit the go button I get this error:
This page isn’t working is currently unable to handle this request.
HTTP ERROR 500
Anybody else experience this? Not sure what I am doing wrong. (I did not make any changes to the file or the filename itself)
Thank you for your help!
Server 500 implies that there's a debug-log (myDEBUG-adm-*.log) in the site's /logs directory. You can send me a copy to my direct email address.
v2.0.1 of the Database I/O Manager (DbIo) is now available for download: https://www.zen-cart.com/downloads.php?do=file&id=2091
This release contains changes associated with the following GitHub issues:
#212: Correct sprintf messages for split-file message.
#215: Use different names for different forms, correcting HTML validation issue.
#217: Correct PHP error when exporting via the DbIoProductsAttribsBasicHandler.
#218: Correct DbIoProductsAttribsBasicHandler import processing.
1.5.8a
PHP 7.4
POSM and DBIO
Trying to add a product using the following but no joy. I'm sure it's something simple:blush:
Not a base DbIo issue. I've noted the issue in POSM's private GitHub and will check that out soon.Quote:
Originally Posted by dbltoe
17,000+ line items waiting patiently to be added :P :hug:
Try changing line 205 of /admin/includes/classes/dbio/DbIoOptionsStockFullHandler.php fromQuote:
Originally Posted by dbltoe
toPHP Code:if ($sql_query !== false && $this->operation !== 'check') {
Does that correct the issue?PHP Code:if ($this->operation !== 'check') {
Unfortunately, not.
Got this
@dbltoe, shoot a copy of the to-be-imported CSV to my direct email address, please.
On the way.
Thanks, dealt with via private email conversation.Quote:
Originally Posted by dbltoe
Hi all, just a couple of questions I'm having trouble finding the answer to in the readme docs, etc.
1) Is there a way to update a product with a linked category without changing the master category? In otherwords, how can I add/update a new product with 2 or 3 different categories through DBIO? Can more than one category be listed in the v_categories_name column, and if so, what should I use to separate them?
2) If I turn on the "allow duplicate model" option, would I be able to simply "overwrite" an existing product with a new product without having to use the REMOVE command for the old and a new line for the NEW? I have a lot of unique, single quantity items, so trying to find an easy way to just replace old, out of stock items with the new ones without having to create a bunch of new products.
I would like the ability to see the next product ID in the admin, I regularly create new products via the DBio plugin and to get the next product ID I have to create a test product to see the next ID and then delete the test product.
Am I missing exactly where I can see the next ID to use for new products, or if possible is there a way to add into the csv to simply use next id availible?
You don't have to see the next product ID. If you simply use a v_dbio_command column and set that column to ADD, the processing will automatically add the product so long as its configuration is ok-fine.Quote:
Originally Posted by DannyVarley
See this (https://github.com/lat9/dbio/wiki/Pr...er-Usage-Notes) GitHub Wiki article for additional information.
Perfect, this is so much simpler!Quote:
Originally Posted by lat9
When I try the ADD in the command I get the issues:
✗ products.products_id, line #2: Value () is not an integer
✗ products.products_date_added, line #2: Value (0000-00-00 00:00:00) is not a recognized date value; the default value for the field will be used.
not sure if I need to put something in the products id or I need to sort the issue with the date value?
Im missing something somewhere im sure :(
Use a v_products_id of 0 and either remove the v_products_date_added column or change the date value to be a real date.Quote:
Originally Posted by DannyVarley
Just wanted to say this is awesome. I have been using a custom easypopulate version for years and after updating Maria a couple days ago it had error log issue and altering the code was taking longer than 2 minutes to fix so I got annoyed and found this. Its actually better than what I had been using once you setup a custom file creation. Weird it has so few downloads given how good it is. So thank you !!!
Thanks for your kind words!Quote:
Originally Posted by JimmyV
Certainly
Now if I wanted to bring all the special prices into the products feed to make it one huge csv I'd put that where? Looking in classes appears right. So into the ability to create a "custom" report I'd want to add
v_specials_new_products_price
v_specials_new_products_group_a_price
v_specials_new_products_group_b_price
v_specials_new_products_group_c_price
v_specials_new_products_group_d_price
to compliment the various group pricing tiers
In which table do the specials_new_products_group_x_price fields exist?
specials table...
its where if you have a special date designated sku it goes there on sale for x expiring on y and so forth
Hmm, the DbIoSpecialsHandler could be 'cloned' to handle those additional fields.
Yes working on learning how this was done/written and expanding that function.
Anyone using this plugin successfully in Zencart 2.0.1 or will it need updating?
yes, no
CSV not appearing in process area.
Hello. I have a problem that seems sort of like I am missing something. Spreadsheet is not showing for processing.
Zencart v1.5.8a
DBio 2.0.1
PHP version: 8.1.30
Mysql 8.1.30
No errors logs
Just started using the Plugin and tested first:
Actions:
1) Added product manually, and exported said product to get sheet.
2) Manually deleted same product and imported same exported sheet Ran test to get a feel for test interface and proceeded with import. Import succeeded fine.
3) Decided to clean up imports and deleted them from the GUI
4) Imported 1473 row CSV. Site reported a successful import but no file appeared in the GUI interface for processing. I tried again before launching a full scale investigation. Same effect.
Things I have done:
* Refreshed
*Logged out logged in
* cleared cache
* looked for logs,
* tried to read nearly every post on this thread (sorry missed the last 4 pages I think)
* checked my version statuses
* upped processing time (for just in case)
* retested with a site produced spreadsheet (it also doesn't appear)
* checked the folder on the server, and the file exists. Permissions are fine (hence it working before)
I am at a loss! This seems like such a simple ...."something".. not sure.
I'm not sure what you were expecting. On an import, DbIo takes the CSV that you selected and modifies the database based on information present in that CSV.
There's no CSV output; that's what's created on an export.
I guess I didn't explain that right or something. The CSV is not visible in the area where they are supposed to be visible when you import them (see attached example). It doesn't appear here to be processed. Before I deleted the other used ones, they were visible and could be processed as such.Quote:
Originally Posted by lat9
I know how to use plugins (and hope I can predict most behavior.. lol) been using Zen Cart for a blue million years. This is a great program.. I am just missing something in my "scientific method" analysis to figure what the heck is going on.
Attachment 20773
That screenshot shows files associated with an "Orders" export, not product-related. When you choose the type of import/export you're trying to perform, DbIo displays the .csv/.log files associated with the selected I/O type.
Thank you for your reply. I think somehow I am still not communicating this issue,Quote:
Originally Posted by lat9
The screenshot I sent was was the Docs area of the actual program. Not MY screenshot. I was using it as an example of the area in which the correct imports/exports would appear. When using whatever handler, would match the handlers type import. Just an example of where ii goes when it goes .. that is all.
Please understand that I understand how the program is supposed to work.This is not matter of me not understanding. It worked just fine until I deleted old imports. Then nothing new will appear in that area after uploading (and getting a success report)
At this point, I feel like all that is happening is you are confused about the problem I am having and I was just looking for help with this specific issue to see if anyone had ANY idea why my imports would not appear here.
You're right, we're not communicating. If you could post two screenshots, one of the site's file-system showing the file contents of the /admin/dbio subdirectory and another of the Database I/O Manager page (the full page, please).
I'm unable to reproduce your issue based on your various descriptions.
After taking a few months off, I'm back trying to load more products using DBIO. I previously had no issues uploading databases, and have made no changes to my website since. Now, I have updated my .csv file and am trying to import the database. But, when I select the file to upload and click Upload, nothing happens. No files upload. I can export/download just fine, but can't upload the changes I've made. The only log entries I found show:
What am I missing? Why won't it upload anything? Thanks in advance!PHP Code:#1 require_once(/home/thecoinauthority/public_html/ADMIN/includes/init_includes/init_numinix_product_fields.php) called at [/home/thecoinauthority/public_html/includes/autoload_func.php:40]
#2 require(/home/thecoinauthority/public_html/includes/autoload_func.php) called at [/home/thecoinauthority/public_html/ADMIN/includes/application_top.php:42]
#3 require(/home/thecoinauthority/public_html/ADMIN/includes/application_top.php) called at [/home/thecoinauthority/public_html/ADMIN/dbio_manager.php:8]
#4 require(/home/thecoinauthority/public_html/ADMIN/dbio_manager.php) called at [/home/thecoinauthority/public_html/ADMIN/index.php:11]
--> PHP Warning: Undefined array key "gID" in /home/thecoinauthority/public_html/ADMIN/includes/init_includes/init_numinix_product_fields.php on line 79.
V 1.5.8a
DBIO 2.0.1
Uploading a .csv file simply (er) uploads the file to your server. You then need to select the uploaded file to "Import" the changes.
Thanks, lat9 but it wasn't even uploading the file to the server. After some extensive troubleshooting, I discovered it was a filesize error (for whatever reason it was not generating/showing the error message when failing to upload). I modified the max upload size on my host server, and then also had to modify settings in Maximum Values. Now it seems to be working as intended, but will report back if any unforeseen issues.Quote:
Originally Posted by lat9
Thanks for the update. I've created a GitHub issue (https://github.com/lat9/dbio/issues/220) to remind myself to check and correct!Quote:
Originally Posted by mcqueeneycoins