Language Display Problems...

[Peace Freak]

I have a two language cart, the primary language being English with Japanese language packs for the cart and admin areas installed.

After upgrading, in the cart, in the following areas the Japanese characters are not appearing correctly (mojibake): In the Search Box, both bread crumb areas, Who's Online, the word "Manufactured by" that appears below each product… (The names of the items and descriptions are readable!)

In the Admin area it is the opposite. The names of each of the products, the descriptions, the Japanese names of customers, the status of each order are all unreadable!

I have been trying to find a fix and found this thread http://www.zen-cart.com/showthread.p...plays-in-Admin for version 1.3.9:
...To get the utf-8 to work properly, you need to insert a one-line php file into the the includes/extra_configures folder. The name can be anything, but the contents are the single line:
<?php define('DB_CHARSET', 'utf8');...

I tried putting the file in both the admin and cart areas. In the cart it caused the correctly displaying Japanese to get messed up! In the admin area it did change the format of the characters, but the characters remained unreadable. Anyway, both have been removed.

I am wondering what needs to be done for things to work in 1.5.1. Do individual files need to have their charsets adjusted or is there some setting I need to adjust to get thing right?

Thank you!

[kobra]

What are your database tables??
UTF8 or latin1_swedish_ci

In your /includes/languages/english.php what is defined for

// charset for web pages and emails
  define('CHARSET', '?????');

In your /includes/languages/japanese.php what is defined for

// charset for web pages and emails
  define('CHARSET', '?????');

[Peace Freak]

The database character set is: UTF8-general_ci

For /includes/languages/english.php it is: 'utf-8'

For /includes/languages/japanese.php it is: 'utf-8'

I guess I am going to have to convert the database to just UTF8. Anyway, I await your instructions.

BTW, it seems that pre-upgrade database was: latin1_swedish_ci

Thank you!

[kobra]

The database character set is: UTF8-general_ci

Using phpmyadmin and loading your database - are all tables UTF-8?

You could also try in your japanese.php setting the character set to

define('CHARSET', 'iso-8859-1');

Save the original on your PC in case it does not work

[Peace Freak]

Using phpmyadmin and loading your database - are all tables UTF-8?

No! See the attached is a screen shot showing some variation. All the tables below the screen shot are encoded with:

latin1_swedish_ci

You could also try in your japanese.php setting the character set to

define('CHARSET', 'iso-8859-1');

Save the original on your PC in case it does not work

Will try...

[Peace Freak]

I have now changed everything that I could change to UTF-8, except for the "missing" items as noted in my previous post.

Basically, all the menus now appear correct, including the breadcrumb area, the text in the Search Box, Who's Online etc.

However, in the store (what the customer sees) the text for each of the products (titles and descriptions) is unreadable. If I change the browser encoding to Japanese(EUC) everything becomes readable!

So I went to the admin area and tried doing the same. It doesn't matter what browser encoding I use (UTF-8, Japanese(EUC) etc), none of the Japanese is readable!

But then I noticed that ONE single item WAS READABLE which struck me as really strange. I checked if that was readable in the store/customer area and it wasn't. I tried all the different encoding options in my browser but none worked for that particular item!

As a test, in the admin area, I deleted the unreadable title and description of another product and replaced it with Japanese and saved it. It became readable in the admin area but in the store/customer area it became unreadable regardless of the browser encoding I chose...

I am not sure what to make of this...

It seems that the data is encoded in Japanese (EUC) and as the admin area is set to UTF-8 it cannot be read.

If I add new items in the admin area, they become readable in the admin area, but in the browser side, they cannot be read regardless of the browers encoding.

I feel like I am really close to getting this solved, but I really don't know enough to decide what I need to do.

I am looking forward to hearing any ideas on what I might try next.

Thanks...

[Peace Freak]

I have now changed everything that I could change to UTF-8, except for the "missing" items as noted in my previous post.

Basically, all the menus now appear correct, including the breadcrumb area, the text in the Search Box, Who's Online etc.

However, in the store (what the customer sees) the text for each of the products (titles and descriptions) is unreadable. If I change the browser encoding to Japanese(EUC) everything becomes readable!

So I went to the admin area and tried doing the same. It doesn't matter what browser encoding I use (UTF-8, Japanese(EUC) etc), none of the Japanese is readable!

But then I noticed that ONE single item WAS READABLE which struck me as really strange. I checked if that was readable in the store/customer area and it wasn't. I tried all the different encoding options in my browser but none worked for that particular item!

As a test, in the admin area, I deleted the unreadable title and description of another product and replaced it with Japanese and saved it. It became readable in the admin area but in the store/customer area it became unreadable regardless of the browser encoding I chose...

I am not sure what to make of this...

It seems that the data is encoded in Japanese (EUC) and as the admin area is set to UTF-8 it cannot be read.

If I add new items in the admin area, they become readable in the admin area, but in the browser side, they cannot be read regardless of the browers encoding.

I feel like I am really close to getting this solved, but I really don't know enough to decide what I need to do.

I am looking forward to hearing any ideas on what I might try next.

Thanks...

I am really stuck on this and need to get things working. In a nutshell:

1/ In the backend of the store, using UTF-8 Text Encoding allows me to see only newly added items correctly. None of the other items (added previously) be read regardless of the text encoding setting in my browser.

2/ In the store itself, the newly added items do not appear readable regardless of the text encoding of my browser, however existing items in the store can be read, if the text encoding is set to Japanese EUC, yet these same items are unreadable in the backend!

My logic tells me that the backend is now set to UTF-8 as I can now read a couple of items in there with my browser set to UTF-8, which is actually the default setting of my browser.

As that same content is not readable in the frontend of the store (with my browser set to UTF-8) there must be some setting that I have missed that I need to change.

Which files control the display of product data in the frontend of the store? It seems the setting is stuck on Japanese EUC.

Thank you in advance!

[kobra]

You could also try

define('CHARSET', 'iso-2022-jp');

[kobra]

Try running this
http://www.zen-cart.com/downloads.php?do=file&id=1318

Follow instructions

[Peace Freak]

Back at work on getting this sorted out...

I have narrowed things down to this:

In the japanese/header.php file in this section:

// charset for web pages and emails
define('CHARSET', 'UTF-8');

using UTF-8 will give me a readable words "home" and "login" (in Japanese) in the breadcrumb area, but the body of the page is unreadable.

If I change UTF-8 to EUC-JP the body becomes readable but the breadcrumb area gets messed up...

There appears to be something else messing things up. There seem to be conflicting charsets...

I would appreciate any suggestions...