Postgres doesn't like Barracuda notification mails

Hi,

I got a lot of mails from my fetchmail-cronjob this morning, that said:

RT server error.

The RT server which handled your email did not behave as expected. It
said:

no connection to syslog available
- stream /dev/conslog is not writable
- console is not writable at
/usr/local/lib/perl5/site_perl/5.8.8/Log/Dispatch/Syslog.pm line 77

Stack:
[/usr/local/lib/perl5/5.8.8/Carp.pm:269]
[/usr/local/lib/perl5/5.8.8/mach/Sys/Syslog.pm:802]
[/usr/local/lib/perl5/5.8.8/mach/Sys/Syslog.pm:709]
[/usr/local/lib/perl5/site_perl/5.8.8/Log/Dispatch/Syslog.pm:77]
[/usr/local/lib/perl5/site_perl/5.8.8/Log/Dispatch/Output.pm:41]
[/usr/local/lib/perl5/site_perl/5.8.8/Log/Dispatch.pm:100]
[/usr/local/lib/perl5/site_perl/5.8.8/Log/Dispatch.pm:79]
[/usr/local/lib/perl5/5.8.8/Carp.pm:272]
[/usr/local/lib/perl5/site_perl/5.8.8/DBIx/SearchBuilder/Handle.pm:518]
[/usr/local/lib/perl5/site_perl/5.8.8/DBIx/SearchBuilder/Handle.pm:353]
[/usr/local/lib/perl5/site_perl/5.8.8/DBIx/SearchBuilder/Handle/Pg.pm:66]
[/usr/local/lib/perl5/site_perl/5.8.8/DBIx/SearchBuilder/Record.pm:1294]
[/usr/local/rt3/lib/RT/Record.pm:310]
[/usr/local/rt3/lib/RT/Attachment_Overlay.pm:207]
[/usr/local/rt3/lib/RT/Attachment_Overlay.pm:189]
[/usr/local/rt3/lib/RT/Attachment_Overlay.pm:189]
[/usr/local/rt3/lib/RT/Transaction_Overlay.pm:487]
[/usr/local/rt3/lib/RT/Transaction_Overlay.pm:158]
[/usr/local/rt3/lib/RT/Record.pm:1446]
[/usr/local/rt3/lib/RT/Ticket_Overlay.pm:746]
[/usr/local/rt3/lib/RT/Interface/Email.pm:730]
[/usr/local/rt3/share/html/REST/1.0/NoAuth/mail-gateway:61]

fetchmail: MDA returned nonzero status 75

In the rt.log, there was this:
[Wed Oct 17 07:05:03 2007] [warning]: DBD::Pg::st execute failed:
ERROR: invalid byte sequence for encoding “UTF8”: 0xdc62
HINT: This error can also happen if the byte sequence does not match
the encoding expected by the server, which is controlled by “client_e
ncoding”.
(/usr/local/lib/perl5/site_perl/5.8.8/DBIx/SearchBuilder/Handle.pm:505)
[Wed Oct 17 07:05:03 2007] [warning]: RT::Handle=HASH(0xae33e88)
couldn’t execute the query ‘INSERT INTO Attachments (ContentType, Parent,
Subject, Filename, Headers, Creator, MessageId, Created, Content,
ContentEncoding, TransactionId) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)’
at /usr/local/lib/perl5/site_perl/5.8.8/DBIx/SearchBuilder/Handle.pm
line 518

DBIx::SearchBuilder::Handle::SimpleQuery(‘RT::Handle=HASH(0xae33e88)’,
‘INSERT INTO Attachments (ContentType, Parent, Subject, File
na…’, ‘text/plain’, 27634, ‘’, ‘undef’, ‘Content-Type: text/plain;
charset=“utf-8”\x{a}Content-Transfer-En…’, 14039, ‘’, …) called at
/usr/local/lib/perl5/site_perl/5.8.8/DBIx/SearchBuilder/Handle.pm line 353

DBIx::SearchBuilder::Handle::Insert(‘RT::Handle=HASH(0xae33e88)’,
‘Attachments’, ‘ContentType’, ‘text/plain’, ‘Parent’, 27634, ‘Sub
ject’, ‘’, ‘Filename’, …) called at
/usr/local/lib/perl5/site_perl/5.8.8/DBIx/SearchBuilder/Handle/Pg.pm line 66

DBIx::SearchBuilder::Handle::Pg::Insert(‘RT::Handle=HASH(0xae33e88)’,
‘Attachments’, ‘ContentType’, ‘text/plain’, ‘Parent’, 27634,
‘Subject’, ‘’, ‘Filename’, …) called at
/usr/local/lib/perl5/site_perl/5.8.8/DBIx/SearchBuilder/Record.pm line 1294

DBIx::SearchBuilder::Record::Create(‘RT::Attachment=HASH(0xd662500)’,
‘ContentType’, ‘text/plain’, ‘Parent’, 27634, ‘Subject’, ‘’,
‘Filename’, ‘undef’, …) called at /usr/local/rt3/lib/RT/Record.pm line 310
RT::Record::Create(‘RT::Attachment=HASH(0xd662500)’,
‘TransactionId’, 53476, ‘ContentType’, ‘text/plain’, ‘ContentEncoding’,
‘none’
, ‘Parent’, 27634, …) called at
/usr/local/rt3/lib/RT/Attachment_Overlay.pm line 207
RT::Attachment::Create(‘RT::Attachment=HASH(0xd662500)’,
‘TransactionId’, 53476, ‘Parent’, 27634, ‘Attachment’, ‘MIME::Entity=HASH(
0xd5ec140)’) called at /usr/local/rt3/lib/RT/Attachment_Overlay.pm line 189
RT::Attachment::Create(‘RT::Attachment=HASH(0xd673fb8)’,
‘TransactionId’, 53476, ‘Parent’, 27633, ‘Attachment’, ‘MIME::Entity=HASH(
0xd00e02c)’) called at /usr/local/rt3/lib/RT/Attachment_Overlay.pm line 189
RT::Attachment::Create(‘RT::Attachment=HASH(0xd570aa4)’,
‘TransactionId’, 53476, ‘Attachment’, ‘MIME::Entity=HASH(0xd31a734)’) call
ed at /usr/local/rt3/lib/RT/Transaction_Overlay.pm line 487
RT::Transaction::_Attach(‘RT::Transaction=HASH(0xd63d5d8)’,
‘MIME::Entity=HASH(0xd31a734)’) called at /usr/local/rt3/lib/RT/Transac
tion_Overlay.pm line 158
RT::Transaction::Create(‘RT::Transaction=HASH(0xd63d5d8)’,
‘ObjectId’, 3687, ‘ObjectType’, ‘RT::Ticket’, ‘TimeTaken’, 0, ‘Type’, ‘C
reate’, …) called at /usr/local/rt3/lib/RT/Record.pm line 1446
RT::Record::_NewTransaction(‘RT::Ticket=HASH(0xd4ea008)’,
‘Type’, ‘Create’, ‘TimeTaken’, 0, ‘MIMEObj’, ‘MIME::Entity=HASH(0xd31a734
)’) called at /usr/local/rt3/lib/RT/Ticket_Overlay.pm line 746
RT::ticket::Create(‘RT::Ticket=HASH(0xd4ea008)’, ‘Queue’, 13,
‘Subject’, ‘SpamQuarant\x{c3}\x{a4}ne Zusammenfassung’, ‘Requestor’,
‘ARRAY(0xd63d254)’, ‘Cc’, ‘ARRAY(0xd666334)’, …) called at
/usr/local/rt3/lib/RT/Interface/Email.pm line 730
RT::Interface::email::Gateway(‘HASH(0xd666388)’) called at
/usr/local/rt3/share/html/REST/1.0/NoAuth/mail-gateway line 61
HTML::Mason::Commands::ANON(‘SessionType’, ‘REST’, ‘action’,
‘correspond’, ‘queue’, ‘hosting’, ‘message’, ‘Received: from mail.
scalera.ch [195.129.94.194]\x{a}\x{9}by rt3.ip-te…’) called at
/usr/local/lib/perl5/site_perl/5.8.8/HTML/Mason/Component.pm line 135

HTML::Mason::Component::run(‘HTML::Mason::Component::FileBased=HASH(0xb49a5d4)’,
‘SessionType’, ‘REST’, ‘action’, ‘correspond’, ‘qu
eue’, ‘hosting’, ‘message’, ‘Received: from mail.scalera.ch
[195.129.94.194]\x{a}\x{9}by rt3.ip-te…’, …) called at
/usr/local/lib/perl5
/site_perl/5.8.8/HTML/Mason/Request.pm line 1251
eval {…} called at
/usr/local/lib/perl5/site_perl/5.8.8/HTML/Mason/Request.pm line 1246
HTML::Mason::Request::comp(‘undef’, ‘undef’, ‘undef’,
‘SessionType’, ‘REST’, ‘action’, ‘correspond’, ‘queue’, ‘hosting’, …)
calle
d at /usr/local/lib/perl5/site_perl/5.8.8/HTML/Mason/Request.pm line 460
eval {…} called at
/usr/local/lib/perl5/site_perl/5.8.8/HTML/Mason/Request.pm line 460
eval {…} called at
/usr/local/lib/perl5/site_perl/5.8.8/HTML/Mason/Request.pm line 412

HTML::Mason::Request::exec(‘HTML::Mason::Request::ApacheHandler=HASH(0xd34ff24)’)
called at /usr/local/lib/perl5/site_perl/5.8.8/HT
ML/Mason/ApacheHandler.pm line 168

HTML::Mason::Request::ApacheHandler::exec(‘HTML::Mason::Request::ApacheHandler=HASH(0xd34ff24)’)
called at /usr/local/lib/perl5/sit
e_perl/5.8.8/HTML/Mason/ApacheHandler.pm line 826

HTML::Mason::ApacheHandler::handle_request(‘HTML::Mason::ApacheHandler=HASH(0xae2c628)’,
‘Apache2::RequestRec=SCALAR(0xd63165c)’) c
alled at /usr/local/rt3/bin/webmux.pl line 125
eval {…} called at /usr/local/rt3/bin/webmux.pl line 125
RT::Mason::handler(‘Apache2::RequestRec=SCALAR(0xd63165c)’)
called at -e line 0
eval {…} called at -e line 0
(/usr/local/lib/perl5/5.8.8/Carp.pm:272)
[Wed Oct 17 07:05:03 2007] [crit]: Transaction not committed. Usually
indicates a software fault.Data loss may have occurred (/usr/local/rt
3/lib/RT/Interface/Web/Handler.pm:195)

The culprit turned out to be a nightly Barracuda notification mail, that
has now been re-routed to another account (it’s useless in RT anyway).

But my question is actually, if RT is not supposed to somehow “sanitize”
these mails before they reach the database?
I don’t want this to happen again.

I use RT 3.6.4 on FreeBSD6.2 with PostgreSQL 8.2.4 (and apache2/mod_perl2).

cheers,
Rainer

That would be great if you grab one of emails and send it for analysis
and most probably we’ll fix an issues and write a regression test.On 10/17/07, Rainer Duffner rainer@ultra-secure.de wrote:

Hi,

I got a lot of mails from my fetchmail-cronjob this morning, that said:

RT server error.

The RT server which handled your email did not behave as expected. It
said:

no connection to syslog available
- stream /dev/conslog is not writable
- console is not writable at
/usr/local/lib/perl5/site_perl/5.8.8/Log/Dispatch/Syslog.pm line 77

Stack:
[/usr/local/lib/perl5/5.8.8/Carp.pm:269]
[/usr/local/lib/perl5/5.8.8/mach/Sys/Syslog.pm:802]
[/usr/local/lib/perl5/5.8.8/mach/Sys/Syslog.pm:709]
[/usr/local/lib/perl5/site_perl/5.8.8/Log/Dispatch/Syslog.pm:77]
[/usr/local/lib/perl5/site_perl/5.8.8/Log/Dispatch/Output.pm:41]
[/usr/local/lib/perl5/site_perl/5.8.8/Log/Dispatch.pm:100]
[/usr/local/lib/perl5/site_perl/5.8.8/Log/Dispatch.pm:79]
[/usr/local/lib/perl5/5.8.8/Carp.pm:272]
[/usr/local/lib/perl5/site_perl/5.8.8/DBIx/SearchBuilder/Handle.pm:518]
[/usr/local/lib/perl5/site_perl/5.8.8/DBIx/SearchBuilder/Handle.pm:353]
[/usr/local/lib/perl5/site_perl/5.8.8/DBIx/SearchBuilder/Handle/Pg.pm:66]
[/usr/local/lib/perl5/site_perl/5.8.8/DBIx/SearchBuilder/Record.pm:1294]
[/usr/local/rt3/lib/RT/Record.pm:310]
[/usr/local/rt3/lib/RT/Attachment_Overlay.pm:207]
[/usr/local/rt3/lib/RT/Attachment_Overlay.pm:189]
[/usr/local/rt3/lib/RT/Attachment_Overlay.pm:189]
[/usr/local/rt3/lib/RT/Transaction_Overlay.pm:487]
[/usr/local/rt3/lib/RT/Transaction_Overlay.pm:158]
[/usr/local/rt3/lib/RT/Record.pm:1446]
[/usr/local/rt3/lib/RT/Ticket_Overlay.pm:746]
[/usr/local/rt3/lib/RT/Interface/Email.pm:730]
[/usr/local/rt3/share/html/REST/1.0/NoAuth/mail-gateway:61]

fetchmail: MDA returned nonzero status 75

In the rt.log, there was this:
[Wed Oct 17 07:05:03 2007] [warning]: DBD::Pg::st execute failed:
ERROR: invalid byte sequence for encoding “UTF8”: 0xdc62
HINT: This error can also happen if the byte sequence does not match
the encoding expected by the server, which is controlled by “client_e
ncoding”.
(/usr/local/lib/perl5/site_perl/5.8.8/DBIx/SearchBuilder/Handle.pm:505)
[Wed Oct 17 07:05:03 2007] [warning]: RT::Handle=HASH(0xae33e88)
couldn’t execute the query ‘INSERT INTO Attachments (ContentType, Parent,
Subject, Filename, Headers, Creator, MessageId, Created, Content,
ContentEncoding, TransactionId) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)’
at /usr/local/lib/perl5/site_perl/5.8.8/DBIx/SearchBuilder/Handle.pm
line 518

DBIx::SearchBuilder::Handle::SimpleQuery(‘RT::Handle=HASH(0xae33e88)’,
‘INSERT INTO Attachments (ContentType, Parent, Subject, File
na…’, ‘text/plain’, 27634, ‘’, ‘undef’, ‘Content-Type: text/plain;
charset=“utf-8”\x{a}Content-Transfer-En…’, 14039, ‘’, …) called at
/usr/local/lib/perl5/site_perl/5.8.8/DBIx/SearchBuilder/Handle.pm line 353

DBIx::SearchBuilder::Handle::Insert(‘RT::Handle=HASH(0xae33e88)’,
‘Attachments’, ‘ContentType’, ‘text/plain’, ‘Parent’, 27634, ‘Sub
ject’, ‘’, ‘Filename’, …) called at
/usr/local/lib/perl5/site_perl/5.8.8/DBIx/SearchBuilder/Handle/Pg.pm line 66

DBIx::SearchBuilder::Handle::Pg::Insert(‘RT::Handle=HASH(0xae33e88)’,
‘Attachments’, ‘ContentType’, ‘text/plain’, ‘Parent’, 27634,
‘Subject’, ‘’, ‘Filename’, …) called at
/usr/local/lib/perl5/site_perl/5.8.8/DBIx/SearchBuilder/Record.pm line 1294

DBIx::SearchBuilder::Record::Create(‘RT::Attachment=HASH(0xd662500)’,
‘ContentType’, ‘text/plain’, ‘Parent’, 27634, ‘Subject’, ‘’,
‘Filename’, ‘undef’, …) called at /usr/local/rt3/lib/RT/Record.pm line 310
RT::Record::Create(‘RT::Attachment=HASH(0xd662500)’,
‘TransactionId’, 53476, ‘ContentType’, ‘text/plain’, ‘ContentEncoding’,
‘none’
, ‘Parent’, 27634, …) called at
/usr/local/rt3/lib/RT/Attachment_Overlay.pm line 207
RT::Attachment::Create(‘RT::Attachment=HASH(0xd662500)’,
‘TransactionId’, 53476, ‘Parent’, 27634, ‘Attachment’, ‘MIME::Entity=HASH(
0xd5ec140)’) called at /usr/local/rt3/lib/RT/Attachment_Overlay.pm line 189
RT::Attachment::Create(‘RT::Attachment=HASH(0xd673fb8)’,
‘TransactionId’, 53476, ‘Parent’, 27633, ‘Attachment’, ‘MIME::Entity=HASH(
0xd00e02c)’) called at /usr/local/rt3/lib/RT/Attachment_Overlay.pm line 189
RT::Attachment::Create(‘RT::Attachment=HASH(0xd570aa4)’,
‘TransactionId’, 53476, ‘Attachment’, ‘MIME::Entity=HASH(0xd31a734)’) call
ed at /usr/local/rt3/lib/RT/Transaction_Overlay.pm line 487
RT::Transaction::_Attach(‘RT::Transaction=HASH(0xd63d5d8)’,
‘MIME::Entity=HASH(0xd31a734)’) called at /usr/local/rt3/lib/RT/Transac
tion_Overlay.pm line 158
RT::Transaction::Create(‘RT::Transaction=HASH(0xd63d5d8)’,
‘ObjectId’, 3687, ‘ObjectType’, ‘RT::Ticket’, ‘TimeTaken’, 0, ‘Type’, ‘C
reate’, …) called at /usr/local/rt3/lib/RT/Record.pm line 1446
RT::Record::_NewTransaction(‘RT::Ticket=HASH(0xd4ea008)’,
‘Type’, ‘Create’, ‘TimeTaken’, 0, ‘MIMEObj’, ‘MIME::Entity=HASH(0xd31a734
)’) called at /usr/local/rt3/lib/RT/Ticket_Overlay.pm line 746
RT::ticket::Create(‘RT::Ticket=HASH(0xd4ea008)’, ‘Queue’, 13,
‘Subject’, ‘SpamQuarant\x{c3}\x{a4}ne Zusammenfassung’, ‘Requestor’,
‘ARRAY(0xd63d254)’, ‘Cc’, ‘ARRAY(0xd666334)’, …) called at
/usr/local/rt3/lib/RT/Interface/Email.pm line 730
RT::Interface::email::Gateway(‘HASH(0xd666388)’) called at
/usr/local/rt3/share/html/REST/1.0/NoAuth/mail-gateway line 61
HTML::Mason::Commands::ANON(‘SessionType’, ‘REST’, ‘action’,
‘correspond’, ‘queue’, ‘hosting’, ‘message’, ‘Received: from mail.
scalera.ch [195.129.94.194]\x{a}\x{9}by rt3.ip-te…’) called at
/usr/local/lib/perl5/site_perl/5.8.8/HTML/Mason/Component.pm line 135

HTML::Mason::Component::run(‘HTML::Mason::Component::FileBased=HASH(0xb49a5d4)’,
‘SessionType’, ‘REST’, ‘action’, ‘correspond’, ‘qu
eue’, ‘hosting’, ‘message’, ‘Received: from mail.scalera.ch
[195.129.94.194]\x{a}\x{9}by rt3.ip-te…’, …) called at
/usr/local/lib/perl5
/site_perl/5.8.8/HTML/Mason/Request.pm line 1251
eval {…} called at
/usr/local/lib/perl5/site_perl/5.8.8/HTML/Mason/Request.pm line 1246
HTML::Mason::Request::comp(‘undef’, ‘undef’, ‘undef’,
‘SessionType’, ‘REST’, ‘action’, ‘correspond’, ‘queue’, ‘hosting’, …)
calle
d at /usr/local/lib/perl5/site_perl/5.8.8/HTML/Mason/Request.pm line 460
eval {…} called at
/usr/local/lib/perl5/site_perl/5.8.8/HTML/Mason/Request.pm line 460
eval {…} called at
/usr/local/lib/perl5/site_perl/5.8.8/HTML/Mason/Request.pm line 412

HTML::Mason::Request::exec(‘HTML::Mason::Request::ApacheHandler=HASH(0xd34ff24)’)
called at /usr/local/lib/perl5/site_perl/5.8.8/HT
ML/Mason/ApacheHandler.pm line 168

HTML::Mason::Request::ApacheHandler::exec(‘HTML::Mason::Request::ApacheHandler=HASH(0xd34ff24)’)
called at /usr/local/lib/perl5/sit
e_perl/5.8.8/HTML/Mason/ApacheHandler.pm line 826

HTML::Mason::ApacheHandler::handle_request(‘HTML::Mason::ApacheHandler=HASH(0xae2c628)’,
‘Apache2::RequestRec=SCALAR(0xd63165c)’) c
alled at /usr/local/rt3/bin/webmux.pl line 125
eval {…} called at /usr/local/rt3/bin/webmux.pl line 125
RT::Mason::handler(‘Apache2::RequestRec=SCALAR(0xd63165c)’)
called at -e line 0
eval {…} called at -e line 0
(/usr/local/lib/perl5/5.8.8/Carp.pm:272)
[Wed Oct 17 07:05:03 2007] [crit]: Transaction not committed. Usually
indicates a software fault.Data loss may have occurred (/usr/local/rt
3/lib/RT/Interface/Web/Handler.pm:195)

The culprit turned out to be a nightly Barracuda notification mail, that
has now been re-routed to another account (it’s useless in RT anyway).

But my question is actually, if RT is not supposed to somehow “sanitize”
these mails before they reach the database?
I don’t want this to happen again.

I use RT 3.6.4 on FreeBSD6.2 with PostgreSQL 8.2.4 (and apache2/mod_perl2).

cheers,
Rainer


The rt-users Archives

Community help: http://wiki.bestpractical.com
Commercial support: sales@bestpractical.com

Discover RT’s hidden secrets with RT Essentials from O’Reilly Media.
Buy a copy at http://rtbook.bestpractical.com

Best regards, Ruslan.