Database I/O Manager (DbIo) Plugin [Support Thread]

Using ZC 2.1.0 / php 8.2
I haven't given up on this working but nearly there. I am using a test site completely free of other plugins and installed DBIO from Github.
Installed Products Options - Worked, no issue
Installed Product Options Vales - Inserts all lines, however when trying to view products via Catalog > Option Value Manager - Nothing appears, just blank.
I then went to PHPMyadmin and viewed the table of Products_Options_Values and they are all there...
I also checked products_options_values_to_products_options and it was blank.

Anyone suggestions? Anyone? Thanks :)

chuckrey:

Using ZC 2.1.0 / php 8.2
I haven't given up on this working but nearly there. I am using a test site completely free of other plugins and installed DBIO from Github.
Installed Products Options - Worked, no issue
Installed Product Options Vales - Inserts all lines, however when trying to view products via Catalog > Option Value Manager - Nothing appears, just blank.
I then went to PHPMyadmin and viewed the table of Products_Options_Values and they are all there...
I also checked products_options_values_to_products_options and it was blank.

Anyone suggestions? Anyone? Thanks :)
That blank-screen display sounds like there's a PHP error that's been logged into the site's /logs directory. If you find that and post its full contents (obfuscating the name of the site's admin directory), that would give me something to "go on".

lat9:

That blank-screen display sounds like there's a PHP error that's been logged into the site's /logs directory. If you find that and post its full contents (obfuscating the name of the site's admin directory), that would give me something to "go on".

I am including a log below. But let me better explain the issue. When I said "blank" I did not mean the entire page was a white blank page. I meant that the "field values" imported were not displayed on the catalog>option values menu. The header, footer, etc, was all there, but not the fields imported. However, when I went to PHPmyadmin all fields were imported. Here is the log..

[17-Apr-2025 03:11:13 UTC] Request URI: /xxxx/index.php?cmd=attributes_controller&products_filter=18&current_category_id=2, IP address: 107.201.xxx.xxx, Language id 1
#0 /home/xxxx/public_html/xxxx/attributes_controller.php(1962): zen_debug_error_handler()
#1 /home/xxxx/public_html/xxxx/index.php(16): require('/home/xxxx/...')
--> PHP Warning: Undefined variable $attributes_value in /home/xxxx/public_html/xxxx/attributes_controller.php on line 1962.

chuckrey:

I am including a log below. But let me better explain the issue. When I said "blank" I did not mean the entire page was a white blank page. I meant that the "field values" imported were not displayed on the catalog>option values menu. The header, footer, etc, was all there, but not the fields imported. However, when I went to PHPmyadmin all fields were imported. Here is the log..

[17-Apr-2025 03:11:13 UTC] Request URI: /xxxx/index.php?cmd=attributes_controller&products_filter=18&current_category_id=2, IP address: 107.201.xxx.xxx, Language id 1
#0 /home/xxxx/public_html/xxxx/attributes_controller.php(1962): zen_debug_error_handler()
#1 /home/xxxx/public_html/xxxx/index.php(16): require('/home/xxxx/...')
--> PHP Warning: Undefined variable $attributes_value in /home/xxxx/public_html/xxxx/attributes_controller.php on line 1962.
That log's a known issue; see this Zen Cart PR for details: https://github.com/zencart/zencart/commit/2f443e698ebb2abbaf9102e0ffcd7ad2904ddaae

I'm still looking at the non-display of the imported option values.

lat9:

That log's a known issue; see this Zen Cart PR for details: https://github.com/zencart/zencart/commit/2f443e698ebb2abbaf9102e0ffcd7ad2904ddaae

I'm still looking at the non-display of the imported option values.

Great. Thank you so much for your help. I also forgot to mention when trying to add attributes to a test product via admin, it does not display either. Just in PHPmyadmin. Thanks again.

chuckrey:

Great. Thank you so much for your help. I also forgot to mention when trying to add attributes to a test product via admin, it does not display either. Just in PHPmyadmin. Thanks again.
Is this when you're trying to add attributes using the option values you've created via DbIo?

lat9:

Is this when you're trying to add attributes using the option values you've created via DbIo?

Yes. When I go to the attribute controller, I can see the option names but there are no values listed. All values added were via DBIo.

chuckrey:

Yes. When I go to the attribute controller, I can see the option names but there are no values listed. All values added were via DBIo.
Yep, as noted in our discussion above, the current implementation of the handler for the importing of options' values is quite messed up.

I should have an update (essentially a total rewrite) available within a couple of days.

lat9:

Yep, as noted in our discussion above, the current implementation of the handler for the importing of options' values is quite messed up.

I should have an update (essentially a total rewrite) available within a couple of days.

Okay, thanks for getting back to me. I will keep an eye out for the rewrite...

I found a bug.

when importing products if your text has a characteristics it does not like it still will import. But when you go to export file it looks or distorted within the excel sheet.

The issue is 'product_desc' table

If you open in excel and trim / clean formula in the description it will solve the issue and everything import/export fine.

This can really mess things up if people forgot to clean there html during the import process.

chadlly2003:

I found a bug.

when importing products if your text has a characteristics it does not like it still will import. But when you go to export file it looks or distorted within the excel sheet.

The issue is 'product_desc' table

If you open in excel and trim / clean formula in the description it will solve the issue and everything import/export fine.

This can really mess things up if people forgot to clean there html during the import process.
Without further information, it sounds like a "Garbage in, garbage out" scenario.

That "characteristics" are you referring to and what is "it" that doesn't like them?

Are you using Microsoft Excel? If so, what is your setting for Configuration / Database I/O Manager Settings / CSV: Encoding? Note that for Microsoft Excel, that should be set to 'latin1'.

lat9:

Without further information, it sounds like a "Garbage in, garbage out" scenario.

That "characteristics" are you referring to and what is "it" that doesn't like them?

Are you using Microsoft Excel? If so, what is your setting for Configuration / Database I/O Manager Settings / CSV: Encoding? Note that for Microsoft Excel, that should be set to 'latin1'.

I had it set to utf8

change it to

latin1

thank you

lat9:

Yep, as noted in our discussion above, the current implementation of the handler for the importing of options' values is quite messed up.

I should have an update (essentially a total rewrite) available within a couple of days.

Just an update in effort to have DBIo working for me.. I checked the table products_options_values_to_products_options on another site then extracted the data (the products are the same) I then went to the website where I have DBIo installed for testing purposes and imported the table (this table was empty even after I initially uploaded Option values via DBIo). After the table import via phpMyadmin the fields are displaying within admin. Is there another file within DBIo I am suppose to upload for the products_options_values_to_products_options table to be populated?

chuckrey:

Just an update in effort to have DBIo working for me.. I checked the table products_options_values_to_products_options on another site then extracted the data (the products are the same) I then went to the website where I have DBIo installed for testing purposes and imported the table (this table was empty even after I initially uploaded Option values via DBIo). After the table import via phpMyadmin the fields are displaying within admin. Is there another file within DBIo I am suppose to upload for the products_options_values_to_products_options table to be populated?
Nope, it'll happen 'organically' in the correct DbIoProductsOptionsValuesHandler.

lat9:

Nope, it'll happen 'organically' in the correct DbIoProductsOptionsValuesHandler.

Started fresh once again and downloaded the DBIo plugin w/ the recent changes made in GitHub and so far so good. My final update will be prices to attributes.
Just wanted to provide an update in case anyone else is having a similar issue. The latest GitHub files seemed to help resolve my issue. Thanks!

chuckrey:

Started fresh once again and downloaded the DBIo plugin w/ the recent changes made in GitHub and so far so good. My final update will be prices to attributes.
Just wanted to provide an update in case anyone else is having a similar issue. The latest GitHub files seemed to help resolve my issue. Thanks!
Thanks for the update! I'll get that updated version packaged up and released.

v2.0.2 of the Database I/O Manager (DbIo) is now available for download: https://www.zen-cart.com/downloads.php?do=file&id=2091

This release contains changes associated with these GitHub issues:

#221: E_USER_ERROR is deprecated in PHP 8.4.
#222: Can't remove a DbIo template, once created.
#223: Remove zc1.3.x-era boxes file and subdirectory.
#224: Initialize inserted categories' sort-order to 0 (was null).
#225: Correct DbIoOptionsValuesHandler, was creating uneditable option-values.
#226: Pre-define all class properties in the DbIoHandler class.
#238: Remove unwanted centered-text styling from the customization tool.
#239: Add links to the GitHub wiki in the main admin tools' instructions.

Hi,

In EP4, I could do the following but I seem to have trouble with this module. Perhaps I am missing something.

1. How to import products using unique products_id without products_model (blank)? In other words, can products_id be set as the primary key used for import of the data?
2. How to import products with same products_models? Setting "Allow Duplicate Models" to Yes didn't work.
3. How to auto-create categories if they don't pre-exist? Setting "Auto-Create Categories on Import" to Yes didn't work.
   The error was "Product not inserted; category id (x) has categories."

Thanks

dealbyethan.com:

Hi,

In EP4, I could do the following but I seem to have trouble with this module. Perhaps I am missing something.

1. How to import products using unique products_id without products_model (blank)? In other words, can products_id be set as the primary key used for import of the data?
2. How to import products with same products_models? Setting "Allow Duplicate Models" to Yes didn't work.
3. How to auto-create categories if they don't pre-exist? Setting "Auto-Create Categories on Import" to Yes didn't work.
   The error was "Product not inserted; category id (x) has categories."

Thanks
1 and 2. Just export the products (so you've got both the v_products_id and v_products_model). The combination of those two values provides a unique 'key' for the import.

2 (maybe). To force a product record to be inserted, use the ADD v_dbio_command.

3. The message you received says it all: The category name you specified has categories, so products cannot be added.

lat9:

1 and 2. Just export the products (so you've got both the v_products_id and v_products_model). The combination of those two values provides a unique 'key' for the import.

2 (maybe). To force a product record to be inserted, use the ADD v_dbio_command.

3. The message you received says it all: The category name you specified has categories, so products cannot be added.

Hi, thanks for your responses.

More tests were done but there are still some issues.
This module prioritises products_model as the primary key during import and ignore products_id by creating a new one. Is it possible to have an option in the configuration for choosing the import/export primary key: products_id or products_model, like in EP4? The main reason is that products_id always has an automatic unique number no matter what; whereas products_model has to be manually made unique but some suppliers use the same model numbers for products with different colors.

Although command ADD may work for adding products with the same products_model, it adds the linked product as a new product instead. Turning it on and off in configuration can be confusing and inconvenient.

Is there a way to bulk create categories before importing products?