Database I/O Manager (DbIo) Plugin [Support Thread]

lat9:

Rick, got the files via email (thanks). Was the OOPS!!!! category pre-existing when you performed the import, or was it auto-created when this product was imported?

It is pre-existing with products. Since the first several dozen attempts did nothing, I assumed that either I was doing something wrong or category creation was not a feature, so I began trying to import a single test product into an existing category.

RixStix:

It is pre-existing with products. Since the first several dozen attempts did nothing, I assumed that either I was doing something wrong or category creation was not a feature, so I began trying to import a single test product into an existing category.
When you're adding a product, I suggest a two-fold approach:

1. Set the v_products_id value to **0 **(not an empty string)
2. Include the v_dbio_command column and set that value to ADD.

lat9:

When you're adding a product, I suggest a two-fold approach:

1. Set the v_products_id value to **0 **(not an empty string)
2. Include the v_dbio_command column and set that value to ADD.

TNX
I will try again. I'm pretty sure using a v_products_id value 0 gave a white screen of death and sent me off in a different direction.

EDIT before the timelimit expired to edit this post.

Nothing added when I set the v_products_id to 0 (zero)

2021-03-10 11:35:52: Forcing ADD of product at line #3, via DbIo command
2021-03-10 11:35:52: 
[*] products.products_date_added, line #3: Value () is not a recognized date value; the default value for the field will be used.
2021-03-10 11:35:52: 
[*] products.products_ordered, line #3: Value () is not a floating-point value.
2021-03-10 11:35:52: 
[*] products.metatags_title_status, line #3: Value () is not an integer
2021-03-10 11:35:52: 
[*] products.metatags_products_name_status, line #3: Value () is not an integer
2021-03-10 11:35:52: 
[*] products.metatags_model_status, line #3: Value () is not an integer
2021-03-10 11:35:52: 
[*] products.metatags_price_status, line #3: Value () is not an integer
2021-03-10 11:35:52: 
[*] products.metatags_title_tagline_status, line #3: Value () is not an integer

RixStix:

TNX
I will try again. I'm pretty sure using a v_products_id value 0 gave a white screen of death and sent me off in a different direction.

EDIT before the timelimit expired to edit this post.

Nothing added when I set the v_products_id to 0 (zero)

2021-03-10 11:35:52: Forcing ADD of product at line #3, via DbIo command
2021-03-10 11:35:52:
[] products.products_date_added, line #3: Value () is not a recognized date value; the default value for the field will be used.
2021-03-10 11:35:52:
[] products.products_ordered, line #3: Value () is not a floating-point value.
2021-03-10 11:35:52:
[] products.metatags_title_status, line #3: Value () is not an integer
2021-03-10 11:35:52:
[] products.metatags_products_name_status, line #3: Value () is not an integer
2021-03-10 11:35:52:
[] products.metatags_model_status, line #3: Value () is not an integer
2021-03-10 11:35:52:
[] products.metatags_price_status, line #3: Value () is not an integer
2021-03-10 11:35:52:
[*] products.metatags_title_tagline_status, line #3: Value () is not an integer

Rick, those errors in the CSV import (other than the products_date_added) will result in that record not being imported due to an error in the data-types.

I guess I don't understand other than it sounds like I have been wasting your time?

Products_ordered for a new product that is impossible to have been ordered? required?
meta_tags? required?

RixStix:

I guess I don't understand other than it sounds like I have been wasting your time?

Products_ordered for a new product that is impossible to have been ordered? required?
meta_tags? required?
Rick, none of those fields are *required *but if they're included in the import, the value must be valid for the field, e.g. the products-ordered must be a valid floating-point number.

Thanks. When the "abbreviated" import didn't work, I assumed that a required field must have been neglected; thus the reason for going to the full file.

Back to square 1

RixStix:

Thanks. When the "abbreviated" import didn't work, I assumed that a required field must have been neglected; thus the reason for going to the full file.

Back to square 1

Square 1. Original abbreviated import file

Upload my abbreviated file
File Action: Import (check only)
Results: GREEN, 3 lines imported

File Action: Import (FULL)
White Screen of death
This is what happens when you put a 0 (zero) in the v_products_id field

[11-Mar-2021 09:16:37 America/Los_Angeles] Request URI: /ADMINFOLDER/dbio_manager.php?action=file, IP address: 98.xxx.yyy.zzz
#1  trigger_error() called at [/home/chainwea/public_html/includes/classes/db/mysql/query_factory.php:171]
#2  queryFactory->show_error() called at [/home/chainwea/public_html/includes/classes/db/mysql/query_factory.php:143]
#3  queryFactory->set_error() called at [/home/chainwea/public_html/includes/classes/db/mysql/query_factory.php:270]
#4  queryFactory->Execute() called at [/home/chainwea/public_html/ADMINFOLDER/includes/classes/dbio/DbIoHandler.php:943]
#5  DbIoHandler->importCsvRecord() called at [/home/chainwea/public_html/ADMINFOLDER/includes/classes/dbio/DbIo.php:265]
#6  DbIo->dbioImport() called at [/home/chainwea/public_html/ADMINFOLDER/dbio_manager.php:240]
--> PHP Fatal error: 1062:Duplicate entry '0-1' for key 'PRIMARY' :: INSERT INTO products_description (`products_name`, `products_description`, `language_id`, `products_id`)
VALUES ('Sterling Clasp Assortment 1', 'This is a test description', 1, 0) ==> (as called by) /home/chainwea/public_html/ADMINFOLDER/includes/classes/dbio/DbIoHandler.php on line 943 <== in /home/chainwea/public_html/includes/classes/db/mysql/query_factory.php on line 171.

Rick, did you accompany that v_products_id = 0 with a v_dbio_command of ADD?

lat9:

Rick, did you accompany that v_products_id = 0 with a v_dbio_command of ADD?

Yes, all caps ADD Used the same file that I sent to you but with 0 zero inserted into the prod_id field

Crap, the screen paste doesn't work.

RixStix:

Yes, all caps ADD Used the same file that I sent to you but with 0 zero inserted into the prod_id field

Crap, the screen paste doesn't work.
Rick, I'll see what's up a bit later. I've got a bunch of paid work that's got to be done.

No problem. I understand paid dollars being first in line.

1.5.7c
latest and greatest DBIO

I am getting this error on just 5000 rows (7.25mb) to upload:

Warning: File is larger than allowed sizes. See "Maximum Values" settings.

I am able to process like 40,000 records with the other I/O module ... albeit there are some errors happening with some records.

Is there some way I can open it up to process more rows or am I doing something wrong? How many rows would you estimate it should be able to upload at one time?

Also, would be great if it could spit out the SEO url associated with each product.

Thank you!

The Maximum Values settings are probably your server's PHP configuration, specifically upload_max_size and post_max_size
You can see their current settings via Admin->Tools->Server Info.
To change them, talk to your hosting company's support team.

shrimp-gumbo-mmmhhh:

1.5.7c
latest and greatest DBIO

I am getting this error on just 5000 rows (7.25mb) to upload:

Warning: File is larger than allowed sizes. See "Maximum Values" settings.

I am able to process like 40,000 records with the other I/O module ... albeit there are some errors happening with some records.

Is there some way I can open it up to process more rows or am I doing something wrong? How many rows would you estimate it should be able to upload at one time?

Also, would be great if it could spit out the SEO url associated with each product.

Thank you!

DrByte:

The Maximum Values settings are probably your server's PHP configuration, specifically upload_max_size and post_max_size
You can see their current settings via Admin->Tools->Server Info.
To change them, talk to your hosting company's support team.
As DrByte indicated, it's not the number of *rows *being processed, it's the *size *of the .csv file itself.

I'll also look at including a v_products_link (export-only) value for the **Products **output.

lat9:

As DrByte indicated, it's not the number of *rows *being processed, it's the *size *of the .csv file itself.

I'll also look at including a v_products_link (export-only) value for the **Products **output.
That updated version of /admin/includes/classes/dbio/DbIoProductsHandler.php can be downloaded here (https://raw.githubusercontent.com/lat9/dbio/master/YOUR_ADMIN/includes/classes/dbio/DbIoProductsHandler.php) while I prepare a v1.6.6 release.

I've just submitted v1.6.6 of the Database I/O Manager for the Zen Cart moderators' review and will post back here when it's available for download.

 This release contains changes associated with the following GitHub issues:

#184: PHP 8.1+ preparation.
#185: Correcting PHP Fatal error (Uncaught ArgumentCountError) for DbIoProductsHandler.
#186: Add 'v_products_link' (storefront link) to the DbIoProductsHandler.

DrByte:

The Maximum Values settings are probably your server's PHP configuration, specifically upload_max_size and post_max_size
You can see their current settings via Admin->Tools->Server Info.
To change them, talk to your hosting company's support team.

Thank you DrByte! Good thought. The Database I/O has a few more fields than the Populate mod has .... but for my files the extra fields are empty so there is not too much difference in size.... I am able to load and import okay (at least without a message that the file is too big) about 37,000 products, I think at least 30,000 are getting put in????. I think I might be doing something wrong because I have gone down to 5000 rows and still not get it in....

Thank you for thinking on my issue!

lat9:

I've just submitted v1.6.6 of the Database I/O Manager for the Zen Cart moderators' review and will post back here when it's available for download.

 This release contains changes associated with the following GitHub issues:

#184: PHP 8.1+ preparation.
#185: Correcting PHP Fatal error (Uncaught ArgumentCountError) for DbIoProductsHandler.
#186: Add 'v_products_link' (storefront link) to the DbIoProductsHandler.

Thank you so much! Excited to give it a try.

shrimp-gumbo-mmmhhh:

Thank you DrByte! Good thought. The Database I/O has a few more fields than the Populate mod has .... but for my files the extra fields are empty so there is not too much difference in size.... I am able to load and import okay (at least without a message that the file is too big) about 37,000 products, I think at least 30,000 are getting put in????. I think I might be doing something wrong because I have gone down to 5000 rows and still not get it in....

Thank you for thinking on my issue!
Noting that you can use the DbIo's Templates feature for your *Products *handling, reducing the number of fields exported to only those that you're manipulating. That will further cut down on the size of that imported .csv.