Categories and Products on Same Level

Then that would need to be re-written to run the settings in groups rather than try to tackle the whole database at one time ...

Ajeh,

I still have two orphaned products after running the reset master categories id... should I delete those?

Also, something is not right with the TOP categories. When I go to move a product, I'm getting that weird category name....

Circular - Accessories > Connectors >&nb

Connectors are a TOP level category. I don't know where the &nb is comming from. I think this may be part of my problem... ???

Are you able to find the two products_id that have no recorders in the products_to_categories table?

Do you have records for those two products_id in the products_description table?

I have no idea at this point the cause of:

Circular - Accessories > Connectors >&nb

It could be due to the bad data etc.

It could be the names you are using on the Categories ...

Ajeh:

Are you able to find the two products_id that have no recorders in the products_to_categories table?

Do you have records for those two products_id in the products_description table?

It could be the names you are using on the Categories ...

Yes, I had the products_id and products_model. They don't have entries in products_description. Nor do these products_model show when searching in Categories/Products. At some point they
were duplicated and had different products_id's ... probably due to a crash to the import script (EP).

I figured this was confirmation enough to delete them and did so.

The &nb is really bugging me... Did anyone every write a script for checking for corrupt or orphaned data in Zencart?

I think I'll run Dr Bytes Database Backup MySQL and download the file and see what the raw data looks like.

I really appreciate your help. You gave me a LOT of great info that I didn't have.

Please let me know if anything comes to mind about this funky "&nb" in my TOP category.

Thanks!!

I'm hoping someone can help me identify the cause of the "&nb" showing as a top level category name when I attempt to move a product. I think this may be related to why I am have the other problems with the site.

I've attached an image of what this looks like. Note that there is no category that the starts with "&nb" and I've looked in the actual databases. It's like some kind of pointer error??
I also verified this behavior by backing up the database and recreating it on another server (had to use ssh and mysql directly to handle THAT much data). The default store does the same thing.

I really hope someone can help with this! Thank you!

This is a weird one ... I do not have the exact cause, but it appears to be something to do with the version of php ...

It does not happen in php v5.2.3 but I do see it in php 5.2.17 ...

It is a visual thing so ignore it and we will look into it further ...

Scratch the php idea ...

It's a small display anomaly that's apparently been there since the beginning of time ... It will be fixed in 2.0 ...

Thanks for the report ...

Hi Ajeh,

That's both good and bad news...

Good that I found something weird (and thank you for really taking a look at this).
Bad that I'm back to the drawing board trying to figure out why my import script is dying on this one particular server :(

Thanks!

See if this helps you in doing an update on a large database for:
Master Categories ID
Products Price Sorter
Attributes Sort Order

and if this is working it can later be turned into Add On once it is complete ...

Hi Ajeh!

This seemed to work fine. I was able to update price sorter in 50k increments, but the master categories id had to be done in smaller increments of around 10-20k. Thank you!

I still think I they have something screwy in their categories. I made a fresh install of 1.39h in a test directory and was able to use my EP4 to import 470,000 records. Doing this into a fresh database doesn't show that "&nb" ... when I move a product to another category.

Still have more testing to do.

Really appreciate the effort. I don't know how many Zencart stores there are out there with close to a million products! Your code will certainly help.

-cj

Thanks for the update that this code was able to help you manage your large database of Products and Categories to eliminate the time outs ... :smile:

Ignore the issue on the part that shows a broken &nbsp as that is just a bug in the existing code that will be addressed in v2.0 ... it is not hurting anything but just looks odd ...

Hiya Ajeh!

Hope this catches your eye since it's been a while!

I was wondering if your script can be modified to run from as a cron job and automatically increment itself after each iteration (say every 50,000 records or something like that) to cycle through the whole 800,000+ records on the site?

Thanks!

You would need to write your own customized code for this to work with a cron job as it uses gets and posts to run the current code ...

Ajeh:

You would need to write your own customized code for this to work with a cron job as it uses gets and posts to run the current code ...

I've been doing a little digging.... and your script kind of enlightened me....

Langer was running zen_update_products_price_sorter() on the ENTIRE database at the end of every import (even if you only imported or updated a small number of produts)! (and choking on the 900,000 products! for elcom).

Is there any reason why I couldn't just call zen_update_products_price_sorter() on each producs_id after I either updated or added? I think this may be what I need to do.

Also, I've added a .csv file splitter to my code so I can take that 800,000 product file and auto split it into smaller more manageable chunks. Not an original idea, but my implementation makes better sense.

-cj

One more question to go with the above... Are there any specifics for testing the price sorter?

WOW! :O

Calling zen_update_products_price_sorter() effectively DOUBLES the execution time of my script! Zonkers!