Changing to UTF-8 in existing cart?

[Arunachala]

I have a bookstore with a few non-English titles. These titles display correctly in zen cart but when a customer orders them the order email has gibberish for non-English titles. A thread in the forum has a tutorial on how to change the encoding to UTF-8 from ISO_8859-1 to solve such problems. Can it be done without a new install of zen cart. It would save a lot of work if the changes can be done in the existing install. Any help? Suggestion? Thanks in advance.

[DrByte]

In phpMyAdmin when you look at the structure of the products_name field in your products_description table, what collation is it set to?
Similarly, what is the collation of the customers_lastname field in your customers table?
In your english.php files, what is CHARSET defined to? What is CHARSET set to in any other languages you've got on your site?
What version of PHP?
What version of MySQL?


What is your usual backup procedure for your site?

[Arunachala]

Our website keeps back up for 7 days. I downloaded the mysql database and the files. I went ahead and successfully changed the zen cart encoding to utf-8. The gibbersish in the email for non English characters is still there. I will find answer to the questions raised by you and get back to you.

[paulm]

I would be careful because translations from English to Gibberish, and even Klingon, are easy. But translation back from Klingon to English might be problematic...
(but I must admit am still an encoding noob..)

[Arunachala]

DrByte Some of the questions raised by you opened my eyes to a host of incompatibility issues. Here is what I found.
In phpMyadmin when I looked at the structure of the produts_name filed, the collation was set to latin1_swedish_ci. I changed it to uft-8. Same with customers_lastname and I changed it to uft8_general_ci. In english.php I changed the CHARSET to uft8. No other language pack has been used by me in zen cart. php version was 4!!! But I could change it to 5The full version is 5.2.17. mysql is version 5.0.

[DrByte]

I was asking questions, not giving instructions. I hope you keep copies of your backups. You may have damaged your database.

You should *never* change the collation settings directly, lest you lose characters aren't translated properly using that approach. There's a conversion script for changing the database collation/charset safely.
And in your English.php files charset should go to utf-8 not utf8.

What version of Zen Cart are you using?

[Arunachala]

English.php file charset is utf-8 and was never utf8. I am using
Zen Cart 1.3.9f
Patch: 1::
Database Patch Level: 1.3.9a

Thanks for the warning. Is there any way to check if the database is damaged. Outwardly it looks OK.

[DrByte]

I am using
Zen Cart 1.3.9f
Patch: 1::
Database Patch Level: 1.3.9a

You should really be upgrading to v1.3.9h ... it's generally just a matter of updating a few files.

Is there any way to check if the database is damaged. Outwardly it looks OK.

only by looking at products/categories/customer names/addresses, etc which have non-english characters in them that are dependent on utf8 for proper display. If you get funny symbols like square boxes or reverse-hearts etc showing in place of cyrillic symbols, for example, then that's an indicator that you've damaged the data.

In phpMyadmin when I looked at the structure of the produts_name filed, the collation was set to latin1_swedish_ci.

If that's what you found *after* running the conversion script you said you ran earlier, then ... your script did NOT actually do the job it should have done.

I changed it to uft-8. Same with customers_lastname and I changed it to uft8_general_ci.

You should really be letting the script do that, and not doing it by hand, since doing it by hand will typically *lose* the special utf8-specific characters.

php version was 4!!! But I could change it to 5The full version is 5.2.17.

I am using
Zen Cart 1.3.9f

You should be fine with PHP 5.2.17, and indeed that would be a better choice than PHP4. If you're running any other software on your website or any old addons that require PHP4, then you might need to upgrade those first before upgrading your PHP version. But ZC v1.3.9 is fine with PHP 5.2.3 and higher.

[Arunachala]

DrByte I did most of the changes for collation based on the advice given below. Evidently those who have used it are OK with it.

I posted a tutorial as to how to transition

zen-cart over to UTF-8 encoding also having the database encoded in UTF-8 too. This was made for carts using Japanese, but it could be used for many other languages.

Here is the link
UTF-8 Zen-Cart

I hope people find this helpful.

Regards,

CKD

I also found this add on UTF-8 Support for Zencart. It says changing on to UTF-8 on an existing cart is hard work and not for the faint-hearted . Has anybody used this add-on for fresh install.

[Arunachala]

I have solved my problem by using English transliteration for non-English titles. This works fine.

Thanks for your advice.