Problems with German Umlaute on new server

Hello,

I installed RT 4.0.19 on a new Ubuntu 14.04 server and imported my old database (PostgreSQL 9.3 UTF-8 database)

With new tickets on the new server I have a problem with German Umlaute (äöüß). When I create a new ticket with äöü in subject, it’s replaced to öäü or something like that.
There’s no difference if I create a ticket from web, rt cli or mail. Old tickets are untouched.

The same is for custom fields or other fields (e.g. on users or groups). Only message body is OK.

I had a look into the database directly and saw that the data inside the database is also wrong.

What can I do?

Best regards,

Bernhard Eierschmalz
EDV

Tel. +49 8223 4002-39
Fax +49 8223 4002-1239
Mobil: +49 151 22308260
Bernhard.Eierschmalz@scheppach.commailto:Bernhard.Eierschmalz@scheppach.com
oder bde@scheppach.com
[Logo]http://www.scheppach.com scheppach Fabrikation von Holzbearbeitungmaschinen GmbH
Günzburger Str. 69 | D-89335 Ichenhausen
Tel.: +49 8223 4002-0 | Fax: +49 8223 4002-20
E-Mail: info@scheppach.com | www.scheppach.com

[facebook]https://www.facebook.com/scheppach.group [xing] https://www.xing.com/companies/scheppachgroup [LinkedIn] http://www.linkedin.com/company/scheppach-group [twitter] https://twitter.com/ScheppachGroup
Geschäftsführer / Managing Director: Ernst Pfaff, Stephan W. Müller
Registergericht Memmingen HRB 11800

Diese Nachricht enthält vertrauliche und ggf. rechtlich geschützte Informationen. Falls Sie nicht der beabsichtigte Empfänger sind, benachrichtigen Sie bitte den Absender und löschen Sie diese Nachricht umgehend aus Ihrem System. Das unerlaubte Kopieren, die Offenlegung sowie die Weitergabe dieser E-Mail sind nicht gestattet.
This email may contain trade secrets or otherwise confidential information. If you have received this email in error, please inform the sender immediately and destroy the original transmittal. Any unauthorized copying, disclosure or distribution is not permitted.

[Scheppach Aktion]http://aktion.scheppach.com

I installed RT 4.0.19 on a new Ubuntu 14.04 server and imported my old database
(PostgreSQL 9.3 UTF-8 database)

With new tickets on the new server I have a problem with German Umlaute (äöüß).
When I create a new ticket with äöü in subject, it’s replaced to öäü
or something like that.

There’s no difference if I create a ticket from web, rt cli or mail. Old
tickets are untouched.

The same is for custom fields or other fields (e.g. on users or groups). Only
message body is OK.

I had a look into the database directly and saw that the data inside the
database is also wrong.

This sounds like something might be wrong with any field that stores
strings in the database. Are you sure that you didn’t have something odd
happen when you imported your database, such as mangled UTF8 settings?

Testing locally against 9.2.1 with 4.0.19 and a fresh DB, I cannot
replicate. I do not have easy access to 9.3.

If you make a clean RT install on 9.3, do you see the problem? Do you
see it on RT 4.2?

-kevin

Hello Kevin,

This sounds like something might be wrong with any field that stores strings in the database. Are you sure that you didn’t have something odd happen when you imported your database, such as mangled UTF8 settings?
Yes - I didn’t see any error.

If you make a clean RT install on 9.3, do you see the problem? Do you see it on RT 4.2?
yes and yes.

I tried the following in my testing environment:

  1. updated RT to RT 4.2.5 - nothing changed. New tickets still have äöü problems.

  2. I dropped my DB and ran “make initialize-database” again - new database is created
    I logged in and created a new ticket - still the same problem.

here are the versions I use:
OS: Ubuntu 14.04
DB: Postgres 9.3.4
Perl 5.18.2
Apache 2.4.7 (Ubuntu)
RT: 4.2.5

Mit freundlichen Grüßen,
Best regards,

Bernhard Eierschmalz
EDV

Tel. +49 8223 4002-39
Fax +49 8223 4002-1239
Mobil: +49 151 22308260
mailto:Bernhard.Eierschmalz@scheppach.com
oder bde@scheppach.com

scheppach Fabrikation von Holzbearbeitungmaschinen GmbH
Günzburger Str. 69 | D-89335 Ichenhausen
Tel.: +49 8223 4002-0 | Fax: +49 8223 4002-20
E-Mail: info@scheppach.com | www.scheppach.com

Geschäftsführer/Managing Director: Ernst Pfaff, Stephan W. Müller
Registergericht Memmingen HRB 11800

Diese Nachricht enthält vertrauliche und ggf. rechtlich geschützte Informationen. Falls Sie nicht der beabsichtigte Empfänger sind, benachrichtigen Sie bitte den Absender und löschen Sie diese Nachricht umgehend aus Ihrem System. Das unerlaubte Kopieren, die Offenlegung sowie die Weitergabe dieser E-Mail sind nicht gestattet.
This email may contain trade secrets or otherwise confidential information. If you have received this email in error, please inform the sender immediately and destroy the original transmittal. Any unauthorized copying, disclosure or distribution is not permitted.-----Ursprüngliche Nachricht-----
Von: rt-devel [mailto:rt-devel-bounces@lists.bestpractical.com] Im Auftrag von Kevin Falcone
Gesendet: Freitag, 11. Juli 2014 03:25
An: rt-devel@lists.bestpractical.com
Betreff: Re: [rt-devel] Problems with German Umlaute on new server

On Thu, Jul 10, 2014 at 09:47:40AM +0000, Eierschmalz, Bernhard wrote:

I installed RT 4.0.19 on a new Ubuntu 14.04 server and imported my old
database (PostgreSQL 9.3 UTF-8 database)

With new tickets on the new server I have a problem with German Umlaute (äöüß).
When I create a new ticket with äöü in subject, it’s replaced to
öäü or something like that.

There’s no difference if I create a ticket from web, rt cli or mail.
Old tickets are untouched.

The same is for custom fields or other fields (e.g. on users or
groups). Only message body is OK.

I had a look into the database directly and saw that the data inside
the database is also wrong.

This sounds like something might be wrong with any field that stores strings in the database. Are you sure that you didn’t have something odd happen when you imported your database, such as mangled UTF8 settings?

Testing locally against 9.2.1 with 4.0.19 and a fresh DB, I cannot replicate. I do not have easy access to 9.3.

If you make a clean RT install on 9.3, do you see the problem? Do you see it on RT 4.2?

-kevin

  1. I dropped my DB and ran “make initialize-database” again - new database is created
    I logged in and created a new ticket - still the same problem.

Thanks for the heads-up – I’ve replicated locally on 9.3. I don’t
think we’ll hold the upcoming 4.0.21 and 4.2.6 releases for this, but
fixing it is a high priority. I’ll file a bug.

  • Alex