cjkAnalyzer does not work

Submitted by dbsightguy on Tue, 2007-10-09 22:50.Troubleshooting

Hi,
when trying to search an index generated from a database with Chinese. it does not work. When I return all records from the index. the chinese characters are all chaos:
such as

Here I set CJKAnalyzer for each field with Chinese.

Can you help me out?

thanks

dbsightguy

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.
Submitted by dbsightguy on Tue, 2007-10-09 22:51.

Following is an sample:
[CDATA[ ÖÐÎĽéÉܸÃÈ˵Äname age ºÍ general information
]]

The data is from mysql:
the table's character setting is UTF8
CREATE TABLE `test` (
`id` int(11) default NULL,
`name` varchar(20) collate utf8_unicode_ci default NULL,
`age` int(11) default NULL,
`resume` blob,
`desc` varchar(200) collate utf8_unicode_ci default NULL
) ENGINE=MyISAM DEFAULT CHARSET=utf8 COLLATE=utf8_unicode_ci

thanks

Submitted by will on Wed, 2007-10-10 10:14.

When you configure the query, you can preview the data. Can you try to use it to find the data and see if it can display correctly?

Often the problem is that the data is "garbage-in-garbage-out", so you didn't notice the encoding problem before.