UTF-8 search Problem

RT Users
1

I have rt-3.0.8 Apache-1 perl-5.8.3 FreeBSD installation
Double UTF-8 problem has been solved by perl-5.8.3 installation.
But I can’t search tickets by international UTF-8 characterset.

IS it only my problem?
Does anybody have the same problem?

Dmitry Monakhov System Administrator
Open Technologies, tel: +7(095)787-7027
e-mail: monakhv@ot.ru, http://www.ot.ru/

2

I have rt-3.0.8 Apache-1 perl-5.8.3 FreeBSD installation
Double UTF-8 problem has been solved by perl-5.8.3 installation.
But I can’t search tickets by international UTF-8 characterset.

IS it only my problem?
Does anybody have the same problem?
I just tested search with my name “Ondřej” as search string and it found
tickets with it without any problems.

What database and what version do you have? Have you properly
configured locale in database correctly?

O.
Ondřej Surý sury.ondrej@globe.cz
Globe Internet s.r.o.

3

Ondřej Surý wrote:

I have rt-3.0.8 Apache-1 perl-5.8.3 FreeBSD installation
Double UTF-8 problem has been solved by perl-5.8.3 installation.
But I can’t search tickets by international UTF-8 characterset.

IS it only my problem?
Does anybody have the same problem?

I just tested search with my name “Ondřej” as search string and it found
tickets with it without any problems.

What database and what version do you have? Have you properly
configured locale in database correctly?
It is definitely not database problem. I use Mysql 4.0.16
and I can do search by SQL SELECT command.
However I failed to make search via RT.

Well, I tested it more after my first mail and I cannot search subject
with accents. So there are some problems with utf-8 searches.

O.
Ondřej Surý sury.ondrej@globe.cz
Globe Internet s.r.o.

4

Ondřej Surý wrote:> On Fri, 2004-01-23 at 12:20, Dmitry Monakhov wrote:

I have rt-3.0.8 Apache-1 perl-5.8.3 FreeBSD installation
Double UTF-8 problem has been solved by perl-5.8.3 installation.
But I can’t search tickets by international UTF-8 characterset.

IS it only my problem?
Does anybody have the same problem?

I just tested search with my name “Ondřej” as search string and itfound
tickets with it without any problems.

What database and what version do you have? Have you properly
configured locale in database correctly?
It is definitely not database problem. I use Mysql 4.0.16
and I can do search by SQL SELECT command.
However I failed to make search via RT.

Dmitry Monakhov

5

It is definitely not database problem. I use Mysql 4.0.16
and I can do search by SQL SELECT command.
However I failed to make search via RT.

Can you capture the SQL query that RT is generating in yor mysql logs
and compare it with your hand-entered query and tell us what the
difference is?

Jesse

Dmitry Monakhov

rt-users mailing list
rt-users@lists.bestpractical.com
The rt-users Archives

Have you read the FAQ? The RT FAQ Manager lives at http://fsck.com/rtfm

Request Tracker... So much more than a help desk — Best Practical Solutions – Trouble Ticketing. Free.

6

Jesse Vincent wrote:

It is definitely not database problem. I use Mysql 4.0.16
and I can do search by SQL SELECT command.
However I failed to make search via RT.

Can you capture the SQL query that RT is generating in yor mysql logs
and compare it with your hand-entered query and tell us what the
difference is?

The difference is in the search pattern. It seems to be double utf-8
encoded. By the way, I had no such problem in version 3.0.6

Dmitry Monakhov System Administrator
Open Technologies, tel: +7(095)787-7027
e-mail: monakhv@ot.ru, http://www.ot.ru/

7

Jesse Vincent wrote:

It is definitely not database problem. I use Mysql 4.0.16
and I can do search by SQL SELECT command.
However I failed to make search via RT.

Can you capture the SQL query that RT is generating in yor mysql logs
and compare it with your hand-entered query and tell us what the
difference is?

The difference is in the search pattern. It seems to be double utf-8
encoded. By the way, I had no such problem in version 3.0.6

Sorry, I should have asked you to send a copy of the query along as
well. Also, are you using perl 5.8.3 or something older? 5.8.3 fixed a
bunch of utf8 bugs, including a bad double-encoding one.

-j

–
Dmitry Monakhov System Administrator
Open Technologies, tel: +7(095)787-7027
e-mail: monakhv@ot.ru, http://www.ot.ru/

rt-users mailing list
rt-users@lists.bestpractical.com
The rt-users Archives

Have you read the FAQ? The RT FAQ Manager lives at http://fsck.com/rtfm

Request Tracker... So much more than a help desk — Best Practical Solutions – Trouble Ticketing. Free.

8

Can you capture the SQL query that RT is generating in yor mysql logs
and compare it with your hand-entered query and tell us what the
difference is?

The difference is in the search pattern. It seems to be double utf-8
encoded. By the way, I had no such problem in version 3.0.6

Sorry, I should have asked you to send a copy of the query along as
well. Also, are you using perl 5.8.3 or something older? 5.8.3 fixed a
bunch of utf8 bugs, including a bad double-encoding one.

I’m using perl 5.8.3 and double utf-8 encoding problem I had before has
been solved by perl upgrade. You can find two file attached below:

  1. rt_q.sql RT sql query captured from mysql log file which produce no
    counts
    2 hand.sql the same sql query as the first one but corrected by me to
    produce right result

Dmitry Monakhov System Administrator
Open Technologies, tel: +7(095)787-7027
e-mail: monakhv@ot.ru, http://www.ot.ru/

rt_q.sql (162 Bytes)

hand.sql (156 Bytes)