Centos 5.4 + FCGI + Unicode in messages = Failure

Hi.

I have some curious situation here.

If I install RT-3.8.7 from the box on default Ubuntu installation then Unicode works very good. But if I use gentoo 10.1 or centos 5.4 (with enabled Unicode support), then I can’t create or list a ticket with Unicode characters with that Error: Wide character in FCGI::Stream::PRINT at /usr/lib/perl5/site_perl/5.8.8/HTML/Mason/CGIHandler.pm line 105. Can you please help me with that?

MySQL 5.0.77, 5.0.84, 5.1
Perl 5.8.8, 5.10.1

Here’s other configuration options:

Perl v5.8.8 under linux
Apache::Session v1.88;
Apache::Session::Generate::MD5 v2.12;
Apache::Session::lock::MySQL v1.01;
Apache::Session::MySQL v1.01;
Apache::Session::Serialize::Storable v1.01;
Apache::Session::Store::DBI v1.02;
Apache::Session::Store::MySQL v1.04;
AutoLoader v5.60;
base v2.07;
bytes v1.02;
Cache::Simple::TimedExpiry v0.27;
capitalization v0.03;
Carp v1.04;
CGI v3.49;
CGI::Cookie v1.29;
CGI::Fast v1.08;
CGI::Util v3.48;
Class::Accessor v0.34;
Class::Accessor::Fast v0.34;
Class::Container v0.12;
Class::Data::Inheritable v0.08;
Class::Inspector v1.24;
Class::ISA v0.33;
Class::ReturnValue v0.55;
Clone v0.31;
constant v1.05;
CSS::Squish v0.09;
Cwd v3.31;
Data::Dumper v2.125;
DateTime v0.54;
DateTime::Duration v0.54;
DateTime::Helpers v0.54;
DateTime::Infinite v0.54;
DateTime::Locale v0.44;
DateTime::TimeZone v1.13;
DateTime::TimeZone::Floating v0.01;
DateTime::TimeZone::Local v0.01;
DateTime::TimeZone::OffsetOnly v0.02;
DateTime::TimeZone::UTC v0.01;
DBD::mysql v4.012;
DBI v1.609;
DBIx::SearchBuilder v1.56;
DBIx::SearchBuilder::Union v0;
DBIx::SearchBuilder::Unique v0.01;
Devel::StackTrace v1.22;
Devel::StackTraceFrame v1.22;
Devel::Symdump v2.08;
Digest::base v1.00;
Digest::MD5 v2.36;
DynaLoader v1.05;
Email::Address v1.889;
Encode v2.39;
Encode::Alias v2.12;
Encode::Config v2.05;
Encode::Encoding v2.05;
Errno v1.0901;
Exception::Class v1.29;
Exception::Class::Base v1.20;
Exporter v5.58;
Exporter::Heavy v5.58;
FCGI v0.69;
Fcntl v1.05;
File::Basename v2.74;
File::Glob v1.05;
File::Path v1.08;
File::ShareDir v1.01;
File::Spec v3.31;
File::Spec::Unix v3.3;
File::Temp v0.22;
FileHandle v2.01;
FindBin v1.47;
HTML::Element v3.23;
HTML::Entities v1.35;
HTML::Formatter v2.04;
HTML::FormatText v2.04;
HTML::Mason v1.44;
HTML::Mason::CGIHandler v1.00;
HTML::Mason::Exception v1.1;
HTML::Mason::Exception::Abort v1.1;
HTML::Mason::Exception::Compilation v1.1;
HTML::Mason::Exception::Compilation::IncompatibleCompiler v1.1;
HTML::Mason::Exception::Compiler v1.1;
HTML::Mason::Exception::Decline v1.1;
HTML::Mason::Exception::Params v1.1;
HTML::Mason::Exception::Syntax v1.1;
HTML::Mason::Exception::System v1.1;
HTML::Mason::Exception::TopLevelNotFound v1.1;
HTML::Mason::Exception::VirtualMethod v1.1;
HTML::Mason::Exceptions v1.43;
HTML::Parser v3.55;
HTML::Scrubber v0.08;
HTML::Tagset v3.10;
HTML::TreeBuilder v3.23;
I18N::LangTags v0.35;
I18N::LangTags::Detect v1.03;
integer v1.00;
IO v1.22;
IO::File v1.13;
IO::Handle v1.25;
IO::InnerFile v2.110;
IO::Lines v2.110;
IO::ScalarArray v2.110;
IO::Seekable v1.1;
IO::WrapTie v2.110;
IPC::Open2 v1.02;
IPC::Open3 v1.02;
List::MoreUtils v0.22;
List::Util v1.23;
Locale::Maketext v1.09;
Locale::Maketext::Fuzzy v0.10;
Locale::Maketext::Lexicon v0.79;
Locale::Maketext::Lexicon::Gettext v0.17;
Log::Any v0.11;
Log::Dispatch v2.26;
Log::Dispatch::Base v2.26;
Log::Dispatch::Output v2.26;
Log::Dispatch::Screen v2.26;
Log::Dispatch::Syslog v2.26;
Mail::Address v2.06;
Mail::Field v2.06;
Mail::Field::AddrList v2.06;
Mail::Field::Date v2.06;
Mail::Field::Generic v2.06;
Mail::Header v2.06;
Mail::Internet v2.06;
Mail::Mailer v2.06;
Mail::Util v2.06;
MIME::Base64 v3.07;
MIME::Body v5.427;
MIME::Decoder v5.427;
MIME::Decoder::NBit v5.427;
MIME::Entity v5.427;
MIME::Field::ContDisp v5.427;
MIME::Field::ConTraEnc v5.427;
MIME::Field::ContType v5.427;
MIME::Field::ParamVal v5.427;
MIME::Head v5.427;
MIME::Parser v5.427;
MIME::QuotedPrint v3.07;
MIME::Tools v5.427;
MIME::Words v5.427;
Module::Versions::Report v1.06;
overload v1.04;
Params::Util v1.00;
Params::Validate v0.95;
PerlIO v1.04;
PerlIO::scalar v0.04;
POSIX v1.09;
re v0.05;
Regexp::Common v2010010201;
Regexp::Common::delimited v2010010201;
RT v3.8.7;
RT::Interface::Email v2;
RT::Interface::Web::Request v0.30;
Scalar::Util v1.23;
SelectSaver v1.01;
Socket v1.78;
Storable v2.15;
strict v1.03;
Symbol v1.06;
Sys::Syslog v0.27;
Text::Template v1.45;
Text::Wrapper v1.02;
Time::HiRes v1.9717;
Time::JulianDay v2003.1125;
Time::Local v1.11;
Time::ParseDate v2006.0814;
Time::Timezone v2006.0814;
Time::Zone v2.24;
UNIVERSAL v1.01;
UNIVERSAL::require v0.13;
URI v1.35;
URI::Escape v3.28;
URI::file v4.19;
utf8 v1.06;
vars v1.01;
warnings v1.05;
warnings::register v1.01;
XSLoader v0.10;
RT Config
ActiveStatus
new, open, stalled
core config

Active_MakeClicky

core config

AmbiguousDayInFuture
0
core config

AmbiguousDayInPast
0
core config

ApprovalRejectionNotes
1
core config

AutoLogoff
0
core config

CanonicalizeOnCreate
0
core config

CanonicalizeRedirectURLs
0
core config

CommentAddress

core config

CorrespondAddress

core config

CustomFieldValuesSources

core config

DashboardAddress

core config

DashboardSubject
%s Dashboard: %s
core config

DatabaseHost
localhost
core config

DatabaseName
rt3
core config

DatabasePassword
Password not printed
core config

DatabasePort

core config

DatabaseRTHost
localhost
core config

DatabaseType
mysql
core config

DatabaseUser
rt_user
core config

DateDayBeforeMonth
1
core config

DateTimeFormat
DefaultFormat
core config

DefaultSearchResultFormat
id/TITLE:#’, ‘Subject/TITLE:Subject’, Status, QueueName, OwnerName, Priority, ‘NEWLINE’, ‘’, ‘Requestors’, ‘CreatedRelative’, ‘ToldRelative’, ‘LastUpdatedRelative’, 'TimeLeft
core config

DefaultSelfServiceSearchResultFormat
id/TITLE:#’, ‘Subject/TITLE:Subject’, Status, Requestors, OwnerName
core config

DefaultSummaryRows
10
core config

DefaultTimeUnitsToHours
0
core config

DevelMode
0
core config

DisableGD
1
core config

DisableGraphViz
1
core config

EmailFrequency
Individual messages
core config

EmailInputEncodings
utf-8, iso-8859-1, us-ascii
core config

EmailOutputEncoding
utf-8
core config

EnableReminders
1
core config

ExtractSubjectTagMatch
Regexp
core config

ExtractSubjectTagNoMatch
Regexp
core config

ForwardFromUser
0
core config

FriendlyFromLineFormat
"%s via RT" <%s>
core config

FriendlyToLineFormat
"%s of example.com Ticket #%s":;
core config

GnuPG
RejectOnBadData, 1, Enable, 0, RejectOnMissingPrivateKey, 1, AllowEncryptDataInDB, 0, OutgoingMessagesFormat, RFC
core config

GnuPGOptions
homedir, /opt/rt3/var/data/gpg
core config

HomePageRefreshInterval
0
core config

HomepageComponents
QuickCreate, Quicksearch, MyAdminQueues, MySupportQueues, MyReminders, RefreshHomepage, Dashboards
core config

InactiveStatus
resolved, rejected, deleted
core config

LexiconLanguages
core config

LinkTransactionsRun1Scrip
0
core config

LogDir
/opt/rt3/var/log
core config

LogStackTraces

core config

LogToFileNamed
rt.log
core config

LogToScreen
info
core config

LogToSyslog
info
core config

LogToSyslogConf

core config

LogoURL
/NoAuth/images/bplogo.gif
core config

LoopsToRTOwner
1
core config

MailCommand
sendmailpipe
core config

MailParams

core config

MasonParameters

core config

MaxAttachmentSize
10000000
core config

MaxInlineBody
12000
core config

MessageBoxHeight
15
core config

MessageBoxIncludeSignature
1
core config

MessageBoxRichText
1
core config

MessageBoxRichTextHeight
200
core config

MessageBoxWidth
72
core config

MessageBoxWrap
HARD
core config

MinimumPasswordLength
5
core config

NetServerOptions

core config

NotifyActor
0
core config

OldestTransactionsFirst
1
core config

Organization
example.com
core config

OverrideOutgoingMailFrom

core config

OwnerEmail
root
core config

PlainTextMono
0
core config

PlainTextPre
0
core config

Plugins

core config

PreviewScripMessages
0
core config

RTAddressRegexp
^rt@example.com$
core config

RecordOutgoingEmail
1
core config

RedistributeAutoGeneratedMessages
privileged
core config

SMTPDebug
0
core config

SearchResultsRefreshInterval
0
core config

SelfServiceRegex
Regexp
core config

SendmailArguments
-oi -t
core config

SendmailBounceArguments
-f "<>"
core config

SendmailPath
/usr/sbin/sendmail
core config

SetOutgoingMailFrom
0
core config

ShowBccHeader
0
core config

ShowTransactionImages
1
core config

ShowUnreadMessageNotifications
1
core config

StandaloneMaxServers
1
core config

StandaloneMaxSpareServers
0
core config

StandaloneMinServers
1
core config

StandaloneMinSpareServers
0
core config

StrictLinkACL
1
core config

Timezone
US/Eastern
core config

UseFriendlyFromLine
1
core config

UseFriendlyToLine
0
core config

UseTransactionBatch
1
core config

UsernameFormat
concise
core config

WebBaseURL
http://localhost
core config

WebDefaultStylesheet
web2
core config

WebDomain
localhost
core config

WebExternalAuthContinuous
1
core config

WebFlushDbCacheEveryRequest
1
core config

WebImagesURL
/NoAuth/images/
core config

WebNoAuthRegex
Regexp
core config

WebPath

core config

WebPort
80
core config

WebSecureCookies
0
core config

WebURL
http://localhost/
core config

WikiImplicitLinks
0
core config

rtname
example.com
site config

RT Variables
RT::BasePath
/opt/rt3
RT::BinPath
/opt/rt3/bin
RT::EtcPath
/opt/rt3/etc
RT::LocalEtcPath
/opt/rt3/local/etc
RT::LocalLexiconPath
/opt/rt3/local/po
RT::LocalLibPath
/opt/rt3/local/lib
RT::LocalPath
/opt/rt3/local
RT::LocalPluginPath
/opt/rt3/local/plugins
RT::MasonComponentRoot
/opt/rt3/share/html
RT::MasonDataDir
/opt/rt3/var/mason_data
RT::MasonLocalComponentRoot
/opt/rt3/local/html
RT::MasonSessionDir
/opt/rt3/var/session_data
RT::PluginPath
/opt/rt3/plugins
RT::SbinPath
/opt/rt3/sbin
RT::VERSION
3.8.7
RT::VarPath
/opt/rt3/var
RT Size
Tickets
1
Queues
2
Transactions
28
Groups
22
Privileged Users
1
Unprivileged Users
2
Perl configuration
Summary of my perl5 (revision 5 version 8 subversion 8) configuration:
Platform:
osname=linux, osvers=2.6.18-53.el5, archname=x86_64-linux-thread-multi
uname=‘linux builder10.centos.org 2.6.18-53.el5 #1 smp mon nov 12 02:14:55 est 2007 x86_64 x86_64 x86_64 gnulinux ‘
config_args=’-des -Doptimize=-O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector --param=ssp-buffer-size=4 -m64 -mtune=generic -Dversion=5.8.8 -Dmyhostname=localhost -Dperladmin=root@localhost -Dcc=gcc -Dcf_by=Red Hat, Inc. -Dinstallprefix=/usr -Dprefix=/usr -Dlibpth=/usr/local/lib64 /lib64 /usr/lib64 -Dprivlib=/usr/lib/perl5/5.8.8 -Dsitelib=/usr/lib/perl5/site_perl/5.8.8 -Dvendorlib=/usr/lib/perl5/vendor_perl/5.8.8 -Darchlib=/usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi -Dsitearch=/usr/lib64/perl5/site_perl/5.8.8/x86_64-linux-thread-multi -Dvendorarch=/usr/lib64/perl5/vendor_perl/5.8.8/x86_64-linux-thread-multi -Darchname=x86_64-linux-thread-multi -Dvendorprefix=/usr -Dsiteprefix=/usr -Duseshrplib -Dusethreads -Duseithreads -Duselargefiles -Dd_dosuid -Dd_semctl_semun -Di_db -Ui_ndbm -Di_gdbm -Di_shadow -Di_syslog -Dman3ext=3pm -Duseperlio -Dinstallusrbinperl=n -Ubincompat5005 -Uversiononly -Dpager=/usr/bin/less -isr -Dd_gethostent_r_proto -Ud_endhostent_r_proto -Ud_sethostent_r_proto -Ud_endprotoent_r_proto -Ud_setprotoent_r_proto -Ud_endservent_r_proto -Ud_setservent_r_proto -Dinc_version_list=5.8.7 5.8.6 5.8.5 -Dscriptdir=/usr/bin’
hint=recommended, useposix=true, d_sigaction=define
usethreads=define use5005threads=undef useithreads=define usemultiplicity=define
useperlio=define d_sfio=undef uselargefiles=define usesocks=undef
use64bitint=define use64bitall=define uselongdouble=undef
usemymalloc=n, bincompat5005=undef
Compiler:
cc=‘gcc’, ccflags =’-D_REENTRANT -D_GNU_SOURCE -fno-strict-aliasing -pipe -Wdeclaration-after-statement -I/usr/local/include -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -I/usr/include/gdbm’,
optimize=’-O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector --param=ssp-buffer-size=4 -m64 -mtune=generic’,
cppflags=’-D_REENTRANT -D_GNU_SOURCE -fno-strict-aliasing -pipe -Wdeclaration-after-statement -I/usr/local/include -I/usr/include/gdbm’
ccversion=’’, gccversion=‘4.1.2 20080704 (Red Hat 4.1.2-46)’, gccosandvers=’‘
intsize=4, longsize=8, ptrsize=8, doublesize=8, byteorder=12345678
d_longlong=define, longlongsize=8, d_longdbl=define, longdblsize=16
ivtype=‘long’, ivsize=8, nvtype=‘double’, nvsize=8, Off_t=‘off_t’, lseeksize=8
alignbytes=8, prototype=define
Linker and Libraries:
ld=‘gcc’, ldflags =’‘
libpth=/usr/local/lib64 /lib64 /usr/lib64
libs=-lresolv -lnsl -lgdbm -ldb -ldl -lm -lcrypt -lutil -lpthread -lc
perllibs=-lresolv -lnsl -ldl -lm -lcrypt -lutil -lpthread -lc
libc=, so=so, useshrplib=true, libperl=libperl.so
gnulibc_version=‘2.5’
Dynamic Linking:
dlsrc=dl_dlopen.xs, dlext=so, d_dlsymun=undef, ccdlflags=’-Wl,-E -Wl,-rpath,/usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/CORE’
cccdlflags=’-fPIC’, lddlflags=’-shared -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector --param=ssp-buffer-size=4 -m64 -mtune=generic’

Perl Include Paths (@INC)
/opt/rt3/bin/…/local/lib
/opt/rt3/bin/…/lib
/usr/lib64/perl5/site_perl/5.8.8/x86_64-linux-thread-multi
/usr/lib/perl5/site_perl/5.8.8
/usr/lib/perl5/site_perl
/usr/lib64/perl5/vendor_perl/5.8.8/x86_64-linux-thread-multi
/usr/lib/perl5/vendor_perl/5.8.8
/usr/lib/perl5/vendor_perl
/usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi
/usr/lib/perl5/5.8.8

Hello Vitaly.

Downgrade FCGI module to version 0.68.On Mon, Mar 15, 2010 at 7:20 PM, Vitaly Tskhovrebov Vitaly.Tskhovrebov@exigenservices.com wrote:

Hi.

I have some curious situation here.

If I install RT-3.8.7 from the box on default Ubuntu installation then Unicode works very good. But if I use gentoo 10.1 or centos 5.4 (with enabled Unicode support), then I can’t create or list a ticket with Unicode characters with that Error: Wide character in FCGI::Stream::PRINT at /usr/lib/perl5/site_perl/5.8.8/HTML/Mason/CGIHandler.pm line 105. Can you please help me with that?

MySQL 5.0.77, 5.0.84, 5.1
Perl 5.8.8, 5.10.1

Here’s other configuration options:

[snip]

Best regards, Ruslan.

Yes, this worked. Thanks a lot.From: Ruslan Zakirov [mailto:ruslan.zakirov@gmail.com]
Sent: 15 марта 2010 г. 21:51
To: Vitaly Tskhovrebov
Cc: rt-users@lists.bestpractical.com
Subject: Re: [rt-users] Centos 5.4 + FCGI + Unicode in messages = Failure

Hello Vitaly.

Downgrade FCGI module to version 0.68.