Issue with iso/utf in 3.8.1?

Hello,

Has anyone else had problems with special character after upgrading
to rt 3.8.1? The nordic letters æøå is now missrepresented in both
user-realname and case texts. It looks like some iso-8859-x <-> utf-8
problems, but I can’t seem to find any settings related to this in the
configuration files.

-geir

Geir Skjotskift, mnemonic AS Email : geir@mnemonic.no
Wergelandsveien 25 Cell : +47 95 10 51 09
N-0167 Oslo, NORWAY Fax : +47 23 20 47 01
Key A2360FF3 availiable at subkeys.pgp.net

Hello,

Has anyone else had problems with special character after upgrading
to rt 3.8.1? The nordic letters ��� is now missrepresented in both
user-realname and case texts. It looks like some iso-8859-x <-> utf-8
problems, but I can’t seem to find any settings related to this in the
configuration files.

You’re using mysql, right?

Did you run the schema.mysql-4.0-4.1 upgrade ?

Emmanuel Lacour wrote:

You’re using mysql, right?

Did you run the schema.mysql-4.0-4.1 upgrade ?

using mysql yes.

I ran the

“/opt/rt3/sbin/rt-setup-database --dba root --prompt-for-dba-password --action upgrade”

and specified 3.8.0 as “upgrade from” and it said no database updates from 3.8.0

I did the upgrade from 3.6.1 -> 3.8.0 three days ago, and did the same thing.
It made (apparently) a lot of changes to the db at that run.

-geir

Geir Skjotskift, mnemonic AS Email : geir@mnemonic.no
Wergelandsveien 25 Cell : +47 95 10 51 09
N-0167 Oslo, NORWAY Fax : +47 23 20 47 01
Key A2360FF3 availiable at subkeys.pgp.net

Emmanuel Lacour wrote:

You’re using mysql, right?

Did you run the schema.mysql-4.0-4.1 upgrade ?

using mysql yes.

I ran the

“/opt/rt3/sbin/rt-setup-database --dba root --prompt-for-dba-password --action upgrade”

and specified 3.8.0 as “upgrade from” and it said no database updates from 3.8.0

I did the upgrade from 3.6.1 -> 3.8.0 three days ago, and did the same thing.
It made (apparently) a lot of changes to the db at that run.

You forgot to read UPGRADING.mysql. It will tell you to upgrade format
of DB fields as now RT uses full UTF-8 colation.

Just run the steps related to schema.mysql-4.0-4.1 (make a backup
before!) and you’re non ascii chars will be back :slight_smile:

Emmanuel Lacour wrote:

You forgot to read UPGRADING.mysql. It will tell you to upgrade format
of DB fields as now RT uses full UTF-8 colation.

hm. Indeed I did. Sorry.

However, when I do the :

 mysql -u root -p rt3 < sql.queries

it tells me :

Enter password:
ERROR 1067 (42000) at line 3: Invalid default value for 'RightName’
zsh: 6183 exit 1 mysql -u root -p rt3 < sql.queries

Line three contains :

ALTER TABLE ACL MODIFY RightName VARBINARY(25) NOT NULL DEFAULT NULL;

-geir

Geir Skjotskift, mnemonic AS Email : geir@mnemonic.no
Wergelandsveien 25 Cell : +47 95 10 51 09
N-0167 Oslo, NORWAY Fax : +47 23 20 47 01
Key A2360FF3 availiable at subkeys.pgp.net

Emmanuel Lacour wrote:

You forgot to read UPGRADING.mysql. It will tell you to upgrade format
of DB fields as now RT uses full UTF-8 colation.

hm. Indeed I did. Sorry.

However, when I do the :

 mysql -u root -p rt3 < sql.queries

it tells me :

Enter password:
ERROR 1067 (42000) at line 3: Invalid default value for 'RightName’
zsh: 6183 exit 1 mysql -u root -p rt3 < sql.queries

Line three contains :

ALTER TABLE ACL MODIFY RightName VARBINARY(25) NOT NULL DEFAULT NULL;

Which RT version you used to generate sql.queries? 3.8.0 or 3.8.1?

(this bug was reported in list before 3.8.1 and should be fixed as I
remember).

Emmanuel Lacour wrote:

Which RT version you used to generate sql.queries? 3.8.0 or 3.8.1?

(this bug was reported in list before 3.8.1 and should be fixed as I
remember).

Ok. Thanks. I made the assumption that these files had been upgraded as well
and used the ones in the rt3 installation directory. When I used the
ones directly from the tarball everything worked fine. My nordic letters
are back again. :slight_smile:

Thank you so much. You have been of great help.

-geir

Geir Skjotskift, mnemonic AS Email : geir@mnemonic.no
Wergelandsveien 25 Cell : +47 95 10 51 09
N-0167 Oslo, NORWAY Fax : +47 23 20 47 01
Key A2360FF3 availiable at subkeys.pgp.net

Hi List,

I have done the same upgrade (3.8.0 -> 3.8.1) with the following steps:

  1. backup the old rt3 database with mysqldump
  2. unpack rt-3.8.1.tar.gz
  3. ./configure and make testdeps (everything was ok)
  4. in the source directory of rt 3.8.1 run: perl etc/upgrade/
    schema.mysql-4.0-4.1.pl db user pass > sql.queries
  5. run: mysql -u root -p rt3 < sql.queries
  6. make upgrade
  7. /opt/rt3/sbin/rt-setup-database --dba root --prompt-for-dba-password
    –action upgrade

After that every non iso8859-1 character was wrong (like CF descriptions,
comments. etc.).
What should I do to solve this problem and what information do you need?
I am using MySQL 5.0.51. With command line mysql client everythins seems
good (for example SELECT Subject FROM Tickets WHERE id =
$ticket_id_of_a_non_iso_subject_ticket) and everything seems utf8 and not
latin1.

If I change the SET NAMES ‘utf8’ line to SET NAMES ‘latin1’ in
/opt/rt3/lib/RT/Handle.pm, everything is fine again,
but I think it’s not a good solution.

Any suggestion?

Thanks,
BekenyOn Wed, Aug 20, 2008 at 6:44 PM, Geir Skjotskift geir@mnemonic.no wrote:

Emmanuel Lacour wrote:

Which RT version you used to generate sql.queries? 3.8.0 or 3.8.1?

(this bug was reported in list before 3.8.1 and should be fixed as I
remember).

Ok. Thanks. I made the assumption that these files had been upgraded as
well
and used the ones in the rt3 installation directory. When I used the
ones directly from the tarball everything worked fine. My nordic letters
are back again. :slight_smile:

Thank you so much. You have been of great help.

-geir



Geir Skjotskift, mnemonic AS Email : geir@mnemonic.no
Wergelandsveien 25 Cell : +47 95 10 51 09
N-0167 Oslo, NORWAY Fax : +47 23 20 47 01
Key A2360FF3 availiable at subkeys.pgp.net


http://lists.bestpractical.com/cgi-bin/mailman/listinfo/rt-users

Community help: http://wiki.bestpractical.com
Commercial support: sales@bestpractical.com

Discover RT’s hidden secrets with RT Essentials from O’Reilly Media.
Buy a copy at http://rtbook.bestpractical.com