Cannot get result of search Chinese character - centos 5.4

RT Users
1

Sir,

Installed RT4.0.4 on CentOS 5.4 box, make new database from RT or
restore mysql file, everything looks well. But cannot get result of
search Chinese character.

For example, if ticket subject is “Best Practical 公司”, then we can
search “Best” or “Practical” to list this ticket, but “公司” get no
result.

I tried to install old version of FCGI(from 0.74 to 0.68), but still
the same issue.

refer: Centos 5.4 + FCGI + Unicode in messages = Failure -

Do you have advise?

Thanks,

Jia

2

Sir,

Installed RT4.0.4 on CentOS 5.4 box, make new database from RT or
restore mysql file, everything looks well. But cannot get result of
search Chinese character.

For example, if ticket subject is “Best Practical 公司”, then we can
search “Best” or “Practical” to list this ticket, but “公司” get no
result.

I tried to install old version of FCGI(from 0.74 to 0.68), but still
the same issue.

refer: Centos 5.4 + FCGI + Unicode in messages = Failure -
Carbon60: Managed Cloud Services

Were you getting Wide character in the logs? Downgrading FCGI is
unlikely to do anything other than cause problems with RT4.0.4

What is the actual query being run, against what raw Subject field
from the database that you expect to match on?

-kevin

3

kevin,

a. search from RT as “http://domain/Search/Simple.html?q=中文”, RT got:
Found 0 tickets
b. search database using SQL as “SELECT * FROM rt4.Tickets WHERE
( Subject LIKE ‘%中文%’ )”, database got: Showing rows 0 - 0 (1
total, Query took 0.0003 sec)

Does it mean that we can search Chinese character from sql query, but
can not from RT web page?

LiuJia

4

kevin,

a. search from RT as “http://domain/Search/Simple.html?q=中文”, RT got:
Found 0 tickets
b. search database using SQL as “SELECT * FROM rt4.Tickets WHERE
( Subject LIKE ‘%中文%’ )”, database got: Showing rows 0 - 0 (1
total, Query took 0.0003 sec)

Does it mean that we can search Chinese character from sql query, but
can not from RT web page?

Please turn on $StatementLog in your config and capture the actual
query that RT runs. We’d also need to see the actual Subject line
stored in the Tickets table.

-kevin

5

Kevin,

Thanks for your reply.

Same database, from Debian box is okay, but CentOS 5.4 is not.

Here it sql file:

INSERT INTO Tickets (id, EffectiveId, Queue, Type,
IssueStatement, Resolution, Owner, Subject, InitialPriority,
FinalPriority, Priority, TimeEstimated, TimeWorked, Status,
TimeLeft, Told, Starts, Started, Due, Resolved,
LastUpdatedBy, LastUpdated, Creator, Created, Disabled)
VALUES
(1, 1, 1, ‘ticket’, 0, 0, 6, ‘中文测试 - test - 123abc’, 0, 0, 0, 0, 0,
‘new’, 0, NULL, ‘1970-01-01 00:00:00’, ‘1970-01-01 00:00:00’,
‘1970-01-01 00:00:00’, ‘1970-01-01 00:00:00’, 12, ‘2011-12-20
14:02:47’, 12, ‘2011-12-20 14:02:47’, 0),
(2, 2, 1, ‘ticket’, 0, 0, 6, ‘中文测试2’, 0, 0, 0, 0, 0, ‘new’, 0, NULL,
‘1970-01-01 00:00:00’, ‘1970-01-01 00:00:00’, ‘1970-01-01 00:00:00’,
‘1970-01-01 00:00:00’, 12, ‘2011-12-20 15:51:25’, 12, ‘2011-12-20
15:51:24’, 0);

Here it is from rt.log(Debian):

[debug]: SQL(0.167067s): SELECT main.* FROM Tickets main WHERE
(main.Status != ‘deleted’) AND (main.Subject LIKE ‘%中%’) AND
(main.Type = ‘ticket’) AND (main.EffectiveId = main.id) ORDER BY
main.id ASC LIMIT 50; (/opt/rt4/sbin/…/lib/RT/Interface/Web.pm:1064)

Here it is from rt.log(CentOS):

[debug]: SQL(0.000729s): SELECT count(main.id) FROM Tickets main
WHERE (main.Status != ‘deleted’) AND (main.Subject LIKE ‘%涓?’) AND
(main.Type = ‘ticket’) AND (main.EffectiveId = main.id) ;
(/opt/rt4/sbin/…/lib/RT/Interface/Web.pm:1064)

Thanks,

Jia

6

Sir,

Looks like can search Chinese character when use Perl 5.10 instead of
Perl 5.8.8 on CentOS 5.

Jia

7

If you run RT with standalone server, is the problem still there?

standalone server, I mean you start RT with something like
/path/to/rt/sbin/rt-server --port 8080

sunnavyOn 11-12-29 08:53, nectar wrote:

Sir,

Looks like can search Chinese character when use Perl 5.10 instead of
Perl 5.8.8 on CentOS 5.

–
Jia

RT Training Sessions (http://bestpractical.com/services/training.html)

  • Boston March 5 & 6, 2012
8

I failed to reproduce this on centos 5.7 with shipped perl5.8.8, and I tried
both stardalone server and apache+mod_fastcgi.

It would be great if there are more details of the configuration.

sunnavyOn 12-01-20 22:11, sunnavy wrote:

If you run RT with standalone server, is the problem still there?

standalone server, I mean you start RT with something like
/path/to/rt/sbin/rt-server --port 8080

sunnavy

On 11-12-29 08:53, nectar wrote:

Sir,

Looks like can search Chinese character when use Perl 5.10 instead of
Perl 5.8.8 on CentOS 5.

–
Jia

RT Training Sessions (http://bestpractical.com/services/training.html)

  • Boston March 5 & 6, 2012

RT Training Sessions (http://bestpractical.com/services/training.html)

  • Boston March 5 & 6, 2012
9

I had same problem Japanese Character ( RT3.8.11 )

Please check DBIx::SearchBuilder version.

DBIx::SearchBuilder version 1.56 or 1.59, i can get result of search
Japanese character.
Howerver, DBIx::SearchBuilder version over 1.6.0, i can not ger result
of search Japanese character.2012/1/21 sunnavy sunnavy@bestpractical.com:

I failed to reproduce this on centos 5.7 with shipped perl5.8.8, and I tried
both stardalone server and apache+mod_fastcgi.

It would be great if there are more details of the configuration.

sunnavy

On 12-01-20 22:11, sunnavy wrote:

If you run RT with standalone server, is the problem still there?

standalone server, I mean you start RT with something like
/path/to/rt/sbin/rt-server --port 8080

sunnavy

On 11-12-29 08:53, nectar wrote:

Sir,

Looks like can search Chinese character when use Perl 5.10 instead of
Perl 5.8.8 on CentOS 5.

–
Jia

RT Training Sessions (http://bestpractical.com/services/training.html)

  • Boston March 5 & 6, 2012

RT Training Sessions (http://bestpractical.com/services/training.html)

  • Boston March 5 & 6, 2012

RT Training Sessions (http://bestpractical.com/services/training.html)

  • Boston March 5 & 6, 2012

ryo.ogata@gmail.com

10

Hi,

Which database do you use? Which version of the corresponding DBD
driver is installed on your system?

You can use the following commands to figure out version:

perl -MDBD::mysql\ 9999 -e 1
perl -MDBD::Pg\ 9999 -e 1
perl -MDBD::Oracle\ 9999 -e 1

Use one that matches RDBMS you use.On Mon, Jan 23, 2012 at 05:29, Ryo O ryo.ogata@gmail.com wrote:

I had same problem Japanese Character ( RT3.8.11 )

Please check DBIx::SearchBuilder version.

DBIx::SearchBuilder version 1.56 or 1.59, i can get result of search
Japanese character.
Howerver, DBIx::SearchBuilder version over 1.6.0, i can not ger result
of search Japanese character.

2012/1/21 sunnavy sunnavy@bestpractical.com:

I failed to reproduce this on centos 5.7 with shipped perl5.8.8, and I tried
both stardalone server and apache+mod_fastcgi.

It would be great if there are more details of the configuration.

sunnavy

On 12-01-20 22:11, sunnavy wrote:

If you run RT with standalone server, is the problem still there?

standalone server, I mean you start RT with something like
/path/to/rt/sbin/rt-server --port 8080

sunnavy

On 11-12-29 08:53, nectar wrote:

Sir,

Looks like can search Chinese character when use Perl 5.10 instead of
Perl 5.8.8 on CentOS 5.

–
Jia

RT Training Sessions (http://bestpractical.com/services/training.html)

  • Boston March 5 & 6, 2012

RT Training Sessions (http://bestpractical.com/services/training.html)

  • Boston March 5 & 6, 2012

RT Training Sessions (http://bestpractical.com/services/training.html)

  • Boston March 5 & 6, 2012

–

ryo.ogata@gmail.com

RT Training Sessions (http://bestpractical.com/services/training.html)

  • Boston March 5 & 6, 2012

Best regards, Ruslan.

11

I tested RT 4.0.4 with DBIx::SearchBuilder 1.61.
all modules are up-to-date from CPAN.

sunnavyOn 12-01-23 10:29, Ryo O wrote:

I had same problem Japanese Character ( RT3.8.11 )

Please check DBIx::SearchBuilder version.

DBIx::SearchBuilder version 1.56 or 1.59, i can get result of search
Japanese character.
Howerver, DBIx::SearchBuilder version over 1.6.0, i can not ger result
of search Japanese character.

2012/1/21 sunnavy sunnavy@bestpractical.com:

I failed to reproduce this on centos 5.7 with shipped perl5.8.8, and I tried
both stardalone server and apache+mod_fastcgi.

It would be great if there are more details of the configuration.

sunnavy

On 12-01-20 22:11, sunnavy wrote:

If you run RT with standalone server, is the problem still there?

standalone server, I mean you start RT with something like
/path/to/rt/sbin/rt-server --port 8080

sunnavy

On 11-12-29 08:53, nectar wrote:

Sir,

Looks like can search Chinese character when use Perl 5.10 instead of
Perl 5.8.8 on CentOS 5.

–
Jia

RT Training Sessions (http://bestpractical.com/services/training.html)

  • Boston March 5 & 6, 2012

RT Training Sessions (http://bestpractical.com/services/training.html)

  • Boston March 5 & 6, 2012

RT Training Sessions (http://bestpractical.com/services/training.html)

  • Boston March 5 & 6, 2012

–

ryo.ogata@gmail.com

RT Training Sessions (http://bestpractical.com/services/training.html)

  • Boston March 5 & 6, 2012
12

Why don’t you trying downgrade DBIx::SearchBuilder from 1.61 to 1.5.x

i did it like below

-bash-3.2# cpan
cpan[1]> install RUZ/DBIx-SearchBuilder-1.56.tar.gz

And Restart RT.

i hope it can help you …2012/1/24 sunnavy sunnavy@bestpractical.com:

I tested RT 4.0.4 with DBIx::SearchBuilder 1.61.
all modules are up-to-date from CPAN.

sunnavy

On 12-01-23 10:29, Ryo O wrote:

I had same problem Japanese Character ( RT3.8.11 )

Please check DBIx::SearchBuilder version.

DBIx::SearchBuilder version 1.56 or 1.59, i can get result of search
Japanese character.
Howerver, DBIx::SearchBuilder version over 1.6.0, i can not ger result
of search Japanese character.

2012/1/21 sunnavy sunnavy@bestpractical.com:

I failed to reproduce this on centos 5.7 with shipped perl5.8.8, and I tried
both stardalone server and apache+mod_fastcgi.

It would be great if there are more details of the configuration.

sunnavy

On 12-01-20 22:11, sunnavy wrote:

If you run RT with standalone server, is the problem still there?

standalone server, I mean you start RT with something like
/path/to/rt/sbin/rt-server --port 8080

sunnavy

On 11-12-29 08:53, nectar wrote:

Sir,

Looks like can search Chinese character when use Perl 5.10 instead of
Perl 5.8.8 on CentOS 5.

–
Jia

RT Training Sessions (http://bestpractical.com/services/training.html)

  • Boston March 5 & 6, 2012

RT Training Sessions (http://bestpractical.com/services/training.html)

  • Boston March 5 & 6, 2012

RT Training Sessions (http://bestpractical.com/services/training.html)

  • Boston March 5 & 6, 2012

–

ryo.ogata@gmail.com

RT Training Sessions (http://bestpractical.com/services/training.html)

  • Boston March 5 & 6, 2012

RT Training Sessions (http://bestpractical.com/services/training.html)

  • Boston March 5 & 6, 2012

おがた りょう ( ryo.ogata@gmail.com )

13

Hi Ryo

I think you misunderstood, I don’t have the problem but was trying
to reproduce it.

anyway, downgrading SB to 1.5* doesn’t help reproducing this problem.

sunnavyOn 12-01-24 09:12, Ryo O wrote:

Why don’t you trying downgrade DBIx::SearchBuilder from 1.61 to 1.5.x

i did it like below

-bash-3.2# cpan
cpan[1]> install RUZ/DBIx-SearchBuilder-1.56.tar.gz

And Restart RT.

i hope it can help you …

2012/1/24 sunnavy sunnavy@bestpractical.com:

I tested RT 4.0.4 with DBIx::SearchBuilder 1.61.
all modules are up-to-date from CPAN.

sunnavy

On 12-01-23 10:29, Ryo O wrote:

I had same problem Japanese Character ( RT3.8.11 )

Please check DBIx::SearchBuilder version.

DBIx::SearchBuilder version 1.56 or 1.59, i can get result of search
Japanese character.
Howerver, DBIx::SearchBuilder version over 1.6.0, i can not ger result
of search Japanese character.

2012/1/21 sunnavy sunnavy@bestpractical.com:

I failed to reproduce this on centos 5.7 with shipped perl5.8.8, and I tried
both stardalone server and apache+mod_fastcgi.

It would be great if there are more details of the configuration.

sunnavy

On 12-01-20 22:11, sunnavy wrote:

If you run RT with standalone server, is the problem still there?

standalone server, I mean you start RT with something like
/path/to/rt/sbin/rt-server --port 8080

sunnavy

On 11-12-29 08:53, nectar wrote:

Sir,

Looks like can search Chinese character when use Perl 5.10 instead of
Perl 5.8.8 on CentOS 5.

–
Jia

RT Training Sessions (http://bestpractical.com/services/training.html)

  • Boston March 5 & 6, 2012

RT Training Sessions (http://bestpractical.com/services/training.html)

  • Boston March 5 & 6, 2012

RT Training Sessions (http://bestpractical.com/services/training.html)

  • Boston March 5 & 6, 2012

–

ryo.ogata@gmail.com

RT Training Sessions (http://bestpractical.com/services/training.html)

  • Boston March 5 & 6, 2012

RT Training Sessions (http://bestpractical.com/services/training.html)

  • Boston March 5 & 6, 2012

–

おがた りょう ( ryo.ogata@gmail.com )

RT Training Sessions (http://bestpractical.com/services/training.html)

  • Boston March 5 & 6, 2012
14

Hello,

Why don’t you trying downgrade DBIx::SearchBuilder from 1.61 to 1.5.x

You have problems with DBIx::SB 1.60+ and don’t have with 1.59 and
older versions. We can not reproduce problem with either.
[skip]

i hope it can help you …

It can not, we tried both versions with the same result.

You didn’t answer my questions about database and version of the DBD
driver. It’s really relevant.> 2012/1/24 sunnavy sunnavy@bestpractical.com:

I tested RT 4.0.4 with DBIx::SearchBuilder 1.61.
all modules are up-to-date from CPAN.

sunnavy

On 12-01-23 10:29, Ryo O wrote:

I had same problem Japanese Character ( RT3.8.11 )

Please check DBIx::SearchBuilder version.

DBIx::SearchBuilder version 1.56 or 1.59, i can get result of search
Japanese character.
Howerver, DBIx::SearchBuilder version over 1.6.0, i can not ger result
of search Japanese character.

2012/1/21 sunnavy sunnavy@bestpractical.com:

I failed to reproduce this on centos 5.7 with shipped perl5.8.8, and I tried
both stardalone server and apache+mod_fastcgi.

It would be great if there are more details of the configuration.

sunnavy

On 12-01-20 22:11, sunnavy wrote:

If you run RT with standalone server, is the problem still there?

standalone server, I mean you start RT with something like
/path/to/rt/sbin/rt-server --port 8080

sunnavy

On 11-12-29 08:53, nectar wrote:

Sir,

Looks like can search Chinese character when use Perl 5.10 instead of
Perl 5.8.8 on CentOS 5.

–
Jia

RT Training Sessions (http://bestpractical.com/services/training.html)

  • Boston March 5 & 6, 2012

RT Training Sessions (http://bestpractical.com/services/training.html)

  • Boston March 5 & 6, 2012

RT Training Sessions (http://bestpractical.com/services/training.html)

  • Boston March 5 & 6, 2012

–

ryo.ogata@gmail.com

RT Training Sessions (http://bestpractical.com/services/training.html)

  • Boston March 5 & 6, 2012

RT Training Sessions (http://bestpractical.com/services/training.html)

  • Boston March 5 & 6, 2012

–

おがた りょう ( ryo.ogata@gmail.com )

RT Training Sessions (http://bestpractical.com/services/training.html)

  • Boston March 5 & 6, 2012

Best regards, Ruslan.