Httpd2-prefork segfaulting on SLES11

i’m having problems with running RT 3.8.8 on SLES11. 4/5 times when i try to start apache it segfaults

[16167.712443] httpd2-prefork[24765]: segfault at ba37a3d4 ip b742f3b1 sp bfad70a4 error 4 in libc-2.11.1.so[b7402000+15b000]

when it does start, rt works fine though. i’ve had this on several builds i’ve done as i’ve been playing with RT. Its similar to another issue someone had with opensuse 11 (Carbon60: Cloud Consulting - Services and Solutions)

The first build I did, I let make fixdeps do most of the work installing moduls from cpan. I did another build today where I tried to install as many modules as possible from the sles sdk cd. results were the same always.

I did a strace httpd2-prefork -X and see this

time(NULL) = 1288898480
semget(IPC_PRIVATE, 1, IPC_CREAT|0600) = 524291
semctl(524291, 0, IPC_64|SETVAL, 0xbff7cfd8) = 0
geteuid32() = 0
semctl(524291, 0, IPC_64|IPC_SET, 0xbff7cfa8) = 0
gettimeofday({1288898480, 105778}, NULL) = 0
write(2, “[Thu Nov 04 15:21:20 2010] [warn”…, 96) = 96
stat64(“/usr/lib/perl5/vendor_perl/5.10.0/i586-linux-thread-multi/auto/DBI/DESTROY.al”, 0xb793f460) = -1 ENOENT (No such file or directory)
stat64(“/srv/www/perl-lib/auto/DBI/DESTROY.al”, 0xbff7ca80) = -1 ENOENT (No such file or directory)
stat64(“/opt/rt/bin/…/local/lib/auto/DBI/DESTROY.al”, 0xbff7ca80) = -1 ENOENT (No such file or directory)
stat64(“/opt/rt/bin/…/lib/auto/DBI/DESTROY.al”, 0xbff7ca80) = -1 ENOENT (No such file or directory)
stat64(“/usr/lib/perl5/5.10.0/i586-linux-thread-multi/auto/DBI/DESTROY.al”, 0xbff7ca80) = -1 ENOENT (No such file or directory)
stat64(“/usr/lib/perl5/5.10.0/auto/DBI/DESTROY.al”, 0xbff7ca80) = -1 ENOENT (No such file or directory)
stat64(“/usr/lib/perl5/site_perl/5.10.0/i586-linux-thread-multi/auto/DBI/DESTROY.al”, 0xbff7ca80) = -1 ENOENT (No such file or directory)
stat64(“/usr/lib/perl5/site_perl/5.10.0/auto/DBI/DESTROY.al”, 0xbff7ca80) = -1 ENOENT (No such file or directory)
stat64(“/usr/lib/perl5/vendor_perl/5.10.0/i586-linux-thread-multi/auto/DBI/DESTROY.al”, 0xbff7ca80) = -1 ENOENT (No such file or directory)
stat64(“/usr/lib/perl5/vendor_perl/5.10.0/auto/DBI/DESTROY.al”, 0xbff7ca80) = -1 ENOENT (No such file or directory)
stat64(“/usr/lib/perl5/vendor_perl/auto/DBI/DESTROY.al”, 0xbff7ca80) = -1 ENOENT (No such file or directory)
stat64(“./auto/DBI/DESTROY.al”, 0xbff7ca80) = -1 ENOENT (No such file or directory)
stat64(“/srv/www/auto/DBI/DESTROY.al”, 0xbff7ca80) = -1 ENOENT (No such file or directory)
brk(0xba64c000) = 0xba64c000
munmap(0xb61de000, 135168) = 0
brk(0xba625000) = 0xba625000
brk(0xba602000) = 0xba602000
brk(0xba5e0000) = 0xba5e0000
brk(0xba5be000) = 0xba5be000
brk(0xba599000) = 0xba599000
munmap(0xb6ea8000, 24764) = 0

(…)

munmap(0xb778c000, 8352) = 0
— SIGSEGV (Segmentation fault) @ 0 (0) —
+++ killed by SIGSEGV +++

i’m not really sure how to interpret it. anyone have suggestions on how to diagnose/fix?

Thanks

brian

“RK&K” and “RK&K Engineers” are registered trade names of Rummel, Klepper & Kahl, LLP, a Maryland
limited liability partnership. This message contains confidential information intended only for
the person or persons named above. If you have received this message in error, please immediately
notify the sender by return email and delete the message. Thank you.

Brian,

I’m getting this same thing only on opensuse 11.3 x86_x64 running under VMware. I’ve been beating my head against it most of the day and making nearly zero headway. I’ve tried both httpd2-perfork and worker but it doesn’t matter, sometimes is starts, mostly is doesn’t. I see this behavior when installing the perl modules from either CPAN or the devel:languages:perl.repo.

I have been able to get it to start successfully doing the follow. It’s ugly but it works.

  • /etc/init.d/apache2 stop
  • mv /etc/apache2/conf.d/rt.conf /etc/apache2/conf.d/rt.off
  • /etc/init.d/apache2 start
  • mv /etc/apache2/conf.d/rt.off /etc/apache2/conf.d/rt.conf
  • /etc/init.d/apache2 reload

SegFault errors.
httpd2-worker[13254]: segfault at 7f0ed3c173e8 ip 00007f0ece748bb0 sp 00007fff60526d60 error 4 in libc-2.11.2.so[7f0ece714000+156000]
httpd2-prefork[13015]: segfault at 7f87b75a1f98 ip 00007f87b20b5bb0 sp 00007fff2657f100 error 4 in libc-2.11.2.so[7f87b2081000+156000]

Darin Perusich
Email: Darin.Perusich@ctg.com
Office: 716-888-3690
Cell: 716-807-4589

-----Original Message-----
From: rt-users-bounces@lists.bestpractical.com [mailto:rt-users-
bounces@lists.bestpractical.com] On Behalf Of Brian Dial
Sent: Thursday, November 04, 2010 3:24 PM
To: rt-users@lists.bestpractical.com
Subject: [rt-users] httpd2-prefork segfaulting on SLES11

i’m having problems with running RT 3.8.8 on SLES11. 4/5 times when i
try to start apache it segfaults

[16167.712443] httpd2-prefork[24765]: segfault at ba37a3d4 ip b742f3b1
sp bfad70a4 error 4 in libc-2.11.1.so[b7402000+15b000]

when it does start, rt works fine though. i’ve had this on several
builds i’ve done as i’ve been playing with RT. Its similar to another
issue someone had with opensuse 11 (http://www.gossamer-
Threads)

The first build I did, I let make fixdeps do most of the work
installing moduls from cpan. I did another build today where I tried
to install as many modules as possible from the sles sdk cd. results
were the same always.

I did a strace httpd2-prefork -X and see this

time(NULL) = 1288898480
semget(IPC_PRIVATE, 1, IPC_CREAT|0600) = 524291
semctl(524291, 0, IPC_64|SETVAL, 0xbff7cfd8) = 0
geteuid32() = 0
semctl(524291, 0, IPC_64|IPC_SET, 0xbff7cfa8) = 0
gettimeofday({1288898480, 105778}, NULL) = 0
write(2, “[Thu Nov 04 15:21:20 2010] [warn”…, 96) = 96
stat64(“/usr/lib/perl5/vendor_perl/5.10.0/i586-linux-thread-
multi/auto/DBI/DESTROY.al”, 0xb793f460) = -1 ENOENT (No such file or
directory)
stat64(“/srv/www/perl-lib/auto/DBI/DESTROY.al”, 0xbff7ca80) = -1 ENOENT
(No such file or directory)
stat64(“/opt/rt/bin/…/local/lib/auto/DBI/DESTROY.al”, 0xbff7ca80) = -1
ENOENT (No such file or directory)
stat64(“/opt/rt/bin/…/lib/auto/DBI/DESTROY.al”, 0xbff7ca80) = -1
ENOENT (No such file or directory)
stat64(“/usr/lib/perl5/5.10.0/i586-linux-thread-
multi/auto/DBI/DESTROY.al”, 0xbff7ca80) = -1 ENOENT (No such file or
directory)
stat64(“/usr/lib/perl5/5.10.0/auto/DBI/DESTROY.al”, 0xbff7ca80) = -1
ENOENT (No such file or directory)
stat64(“/usr/lib/perl5/site_perl/5.10.0/i586-linux-thread-
multi/auto/DBI/DESTROY.al”, 0xbff7ca80) = -1 ENOENT (No such file or
directory)
stat64(“/usr/lib/perl5/site_perl/5.10.0/auto/DBI/DESTROY.al”,
0xbff7ca80) = -1 ENOENT (No such file or directory)
stat64(“/usr/lib/perl5/vendor_perl/5.10.0/i586-linux-thread-
multi/auto/DBI/DESTROY.al”, 0xbff7ca80) = -1 ENOENT (No such file or
directory)
stat64(“/usr/lib/perl5/vendor_perl/5.10.0/auto/DBI/DESTROY.al”,
0xbff7ca80) = -1 ENOENT (No such file or directory)
stat64(“/usr/lib/perl5/vendor_perl/auto/DBI/DESTROY.al”, 0xbff7ca80) =
-1 ENOENT (No such file or directory)
stat64(“./auto/DBI/DESTROY.al”, 0xbff7ca80) = -1 ENOENT (No such file
or directory)
stat64(“/srv/www/auto/DBI/DESTROY.al”, 0xbff7ca80) = -1 ENOENT (No such
file or directory)
brk(0xba64c000) = 0xba64c000
munmap(0xb61de000, 135168) = 0
brk(0xba625000) = 0xba625000
brk(0xba602000) = 0xba602000
brk(0xba5e0000) = 0xba5e0000
brk(0xba5be000) = 0xba5be000
brk(0xba599000) = 0xba599000
munmap(0xb6ea8000, 24764) = 0

(…)

munmap(0xb778c000, 8352) = 0
— SIGSEGV (Segmentation fault) @ 0 (0) —
+++ killed by SIGSEGV +++

i’m not really sure how to interpret it. anyone have suggestions on
how to diagnose/fix?

Thanks

brian

“RK&K” and “RK&K Engineers” are registered trade names of Rummel,
Klepper & Kahl, LLP, a Maryland
limited liability partnership. This message contains confidential
information intended only for
the person or persons named above. If you have received this message
in error, please immediately
notify the sender by return email and delete the message. Thank you.
The information transmitted is intended only for the person or entity to which
it is addressed and may contain confidential and/or privileged material. Any
review, retransmission, dissemination or other use of, or taking of any action
in reliance upon, this information by persons or entities other than the
intended recipient is prohibited. If you are not the intended recipient of this
message, please contact the sender and delete this material from this computer.

Oh, there was a similar issue on opensuse related to hald-probe-inpu seg faulting. libc-2.11.2.so is part of the glibc-32bit package which was recently updated, build date of the rpm is 27 Oct 2010. I haven’t backed out of the patch but maybe it’s releated.

https://bugzilla.novell.com/show_bug.cgi?id=577489
http://forums.opensuse.org/english/get-help-here/pre-release-beta/441429-errors-boot.html

Darin Perusich
Email: Darin.Perusich@ctg.com
Office: 716-888-3690
Cell: 716-807-4589

-----Original Message-----
From: rt-users-bounces@lists.bestpractical.com [mailto:rt-users-
bounces@lists.bestpractical.com] On Behalf Of Darin Perusich
Sent: Thursday, November 04, 2010 4:08 PM
To: Brian Dial; rt-users@lists.bestpractical.com
Subject: Re: [rt-users] httpd2-prefork segfaulting on SLES11

Brian,

I’m getting this same thing only on opensuse 11.3 x86_x64 running under
VMware. I’ve been beating my head against it most of the day and making
nearly zero headway. I’ve tried both httpd2-perfork and worker but it
doesn’t matter, sometimes is starts, mostly is doesn’t. I see this
behavior when installing the perl modules from either CPAN or the
devel:languages:perl.repo.

I have been able to get it to start successfully doing the follow. It’s
ugly but it works.

  • /etc/init.d/apache2 stop
  • mv /etc/apache2/conf.d/rt.conf /etc/apache2/conf.d/rt.off
  • /etc/init.d/apache2 start
  • mv /etc/apache2/conf.d/rt.off /etc/apache2/conf.d/rt.conf
  • /etc/init.d/apache2 reload

SegFault errors.
httpd2-worker[13254]: segfault at 7f0ed3c173e8 ip 00007f0ece748bb0 sp
00007fff60526d60 error 4 in libc-2.11.2.so[7f0ece714000+156000]
httpd2-prefork[13015]: segfault at 7f87b75a1f98 ip 00007f87b20b5bb0 sp
00007fff2657f100 error 4 in libc-2.11.2.so[7f87b2081000+156000]


Darin Perusich
Email: Darin.Perusich@ctg.com
Office: 716-888-3690
Cell: 716-807-4589

-----Original Message-----
From: rt-users-bounces@lists.bestpractical.com [mailto:rt-users-
bounces@lists.bestpractical.com] On Behalf Of Brian Dial
Sent: Thursday, November 04, 2010 3:24 PM
To: rt-users@lists.bestpractical.com
Subject: [rt-users] httpd2-prefork segfaulting on SLES11

i’m having problems with running RT 3.8.8 on SLES11. 4/5 times when
i
try to start apache it segfaults

[16167.712443] httpd2-prefork[24765]: segfault at ba37a3d4 ip
b742f3b1
sp bfad70a4 error 4 in libc-2.11.1.so[b7402000+15b000]

when it does start, rt works fine though. i’ve had this on several
builds i’ve done as i’ve been playing with RT. Its similar to
another
issue someone had with opensuse 11 (http://www.gossamer-
Threads)

The first build I did, I let make fixdeps do most of the work
installing moduls from cpan. I did another build today where I tried
to install as many modules as possible from the sles sdk cd. results
were the same always.

I did a strace httpd2-prefork -X and see this

time(NULL) = 1288898480
semget(IPC_PRIVATE, 1, IPC_CREAT|0600) = 524291
semctl(524291, 0, IPC_64|SETVAL, 0xbff7cfd8) = 0
geteuid32() = 0
semctl(524291, 0, IPC_64|IPC_SET, 0xbff7cfa8) = 0
gettimeofday({1288898480, 105778}, NULL) = 0
write(2, “[Thu Nov 04 15:21:20 2010] [warn”…, 96) = 96
stat64(“/usr/lib/perl5/vendor_perl/5.10.0/i586-linux-thread-
multi/auto/DBI/DESTROY.al”, 0xb793f460) = -1 ENOENT (No such file or
directory)
stat64(“/srv/www/perl-lib/auto/DBI/DESTROY.al”, 0xbff7ca80) = -1
ENOENT
(No such file or directory)
stat64(“/opt/rt/bin/…/local/lib/auto/DBI/DESTROY.al”, 0xbff7ca80) =
-1
ENOENT (No such file or directory)
stat64(“/opt/rt/bin/…/lib/auto/DBI/DESTROY.al”, 0xbff7ca80) = -1
ENOENT (No such file or directory)
stat64(“/usr/lib/perl5/5.10.0/i586-linux-thread-
multi/auto/DBI/DESTROY.al”, 0xbff7ca80) = -1 ENOENT (No such file or
directory)
stat64(“/usr/lib/perl5/5.10.0/auto/DBI/DESTROY.al”, 0xbff7ca80) = -1
ENOENT (No such file or directory)
stat64(“/usr/lib/perl5/site_perl/5.10.0/i586-linux-thread-
multi/auto/DBI/DESTROY.al”, 0xbff7ca80) = -1 ENOENT (No such file or
directory)
stat64(“/usr/lib/perl5/site_perl/5.10.0/auto/DBI/DESTROY.al”,
0xbff7ca80) = -1 ENOENT (No such file or directory)
stat64(“/usr/lib/perl5/vendor_perl/5.10.0/i586-linux-thread-
multi/auto/DBI/DESTROY.al”, 0xbff7ca80) = -1 ENOENT (No such file or
directory)
stat64(“/usr/lib/perl5/vendor_perl/5.10.0/auto/DBI/DESTROY.al”,
0xbff7ca80) = -1 ENOENT (No such file or directory)
stat64(“/usr/lib/perl5/vendor_perl/auto/DBI/DESTROY.al”, 0xbff7ca80)
=
-1 ENOENT (No such file or directory)
stat64(“./auto/DBI/DESTROY.al”, 0xbff7ca80) = -1 ENOENT (No such file
or directory)
stat64(“/srv/www/auto/DBI/DESTROY.al”, 0xbff7ca80) = -1 ENOENT (No
such
file or directory)
brk(0xba64c000) = 0xba64c000
munmap(0xb61de000, 135168) = 0
brk(0xba625000) = 0xba625000
brk(0xba602000) = 0xba602000
brk(0xba5e0000) = 0xba5e0000
brk(0xba5be000) = 0xba5be000
brk(0xba599000) = 0xba599000
munmap(0xb6ea8000, 24764) = 0

(…)

munmap(0xb778c000, 8352) = 0
— SIGSEGV (Segmentation fault) @ 0 (0) —
+++ killed by SIGSEGV +++

i’m not really sure how to interpret it. anyone have suggestions on
how to diagnose/fix?

Thanks

brian

“RK&K” and “RK&K Engineers” are registered trade names of Rummel,
Klepper & Kahl, LLP, a Maryland
limited liability partnership. This message contains confidential
information intended only for
the person or persons named above. If you have received this message
in error, please immediately
notify the sender by return email and delete the message. Thank you.
The information transmitted is intended only for the person or entity
to which
it is addressed and may contain confidential and/or privileged
material. Any
review, retransmission, dissemination or other use of, or taking of any
action
in reliance upon, this information by persons or entities other than
the
intended recipient is prohibited. If you are not the intended recipient
of this
message, please contact the sender and delete this material from this
computer.
The information transmitted is intended only for the person or entity to which
it is addressed and may contain confidential and/or privileged material. Any
review, retransmission, dissemination or other use of, or taking of any action
in reliance upon, this information by persons or entities other than the
intended recipient is prohibited. If you are not the intended recipient of this
message, please contact the sender and delete this material from this computer.

interesting. we’re running it in vmware as well. but i’m inclined to think it’s more of a suse thing than a vmware thing. thanks for the suggestions. maybe i can work that into the init script since my main concern is that it starts on boot in case the machine has to be rebooted when i’m not around to make sure apache restarts correctly.

Brian,

I’m getting this same thing only on opensuse 11.3 x86_x64 running under VMware. I’ve been beating my head against it most of the day and making nearly zero headway. I’ve tried both httpd2-perfork and worker but it doesn’t matter, sometimes is starts, mostly is doesn’t. I see this behavior when installing the perl modules from either CPAN or the devel:languages:perl.repo.

I have been able to get it to start successfully doing the follow. It’s ugly but it works.

  • /etc/init.d/apache2 stop
  • mv /etc/apache2/conf.d/rt.conf /etc/apache2/conf.d/rt.off
  • /etc/init.d/apache2 start
  • mv /etc/apache2/conf.d/rt.off /etc/apache2/conf.d/rt.conf
  • /etc/init.d/apache2 reload

SegFault errors.
httpd2-worker[13254]: segfault at 7f0ed3c173e8 ip 00007f0ece748bb0 sp 00007fff60526d60 error 4 in libc-2.11.2.so[7f0ece714000+156000]
httpd2-prefork[13015]: segfault at 7f87b75a1f98 ip 00007f87b20b5bb0 sp 00007fff2657f100 error 4 in libc-2.11.2.so[7f87b2081000+156000]

Darin Perusich
Email: Darin.Perusich@ctg.com
Office: 716-888-3690
Cell: 716-807-4589

-----Original Message-----
From: rt-users-bounces@lists.bestpractical.com [mailto:rt-users-
bounces@lists.bestpractical.com] On Behalf Of Brian Dial
Sent: Thursday, November 04, 2010 3:24 PM
To: rt-users@lists.bestpractical.com
Subject: [rt-users] httpd2-prefork segfaulting on SLES11

i’m having problems with running RT 3.8.8 on SLES11. 4/5 times when i
try to start apache it segfaults

[16167.712443] httpd2-prefork[24765]: segfault at ba37a3d4 ip b742f3b1
sp bfad70a4 error 4 in libc-2.11.1.so[b7402000+15b000]

when it does start, rt works fine though. i’ve had this on several
builds i’ve done as i’ve been playing with RT. Its similar to another
issue someone had with opensuse 11 (http://www.gossamer-
Threads)

The first build I did, I let make fixdeps do most of the work
installing moduls from cpan. I did another build today where I tried
to install as many modules as possible from the sles sdk cd. results
were the same always.

I did a strace httpd2-prefork -X and see this

time(NULL) = 1288898480
semget(IPC_PRIVATE, 1, IPC_CREAT|0600) = 524291
semctl(524291, 0, IPC_64|SETVAL, 0xbff7cfd8) = 0
geteuid32() = 0
semctl(524291, 0, IPC_64|IPC_SET, 0xbff7cfa8) = 0
gettimeofday({1288898480, 105778}, NULL) = 0
write(2, “[Thu Nov 04 15:21:20 2010] [warn”…, 96) = 96
stat64(“/usr/lib/perl5/vendor_perl/5.10.0/i586-linux-thread-
multi/auto/DBI/DESTROY.al”, 0xb793f460) = -1 ENOENT (No such file or
directory)
stat64(“/srv/www/perl-lib/auto/DBI/DESTROY.al”, 0xbff7ca80) = -1 ENOENT
(No such file or directory)
stat64(“/opt/rt/bin/…/local/lib/auto/DBI/DESTROY.al”, 0xbff7ca80) = -1
ENOENT (No such file or directory)
stat64(“/opt/rt/bin/…/lib/auto/DBI/DESTROY.al”, 0xbff7ca80) = -1
ENOENT (No such file or directory)
stat64(“/usr/lib/perl5/5.10.0/i586-linux-thread-
multi/auto/DBI/DESTROY.al”, 0xbff7ca80) = -1 ENOENT (No such file or
directory)
stat64(“/usr/lib/perl5/5.10.0/auto/DBI/DESTROY.al”, 0xbff7ca80) = -1
ENOENT (No such file or directory)
stat64(“/usr/lib/perl5/site_perl/5.10.0/i586-linux-thread-
multi/auto/DBI/DESTROY.al”, 0xbff7ca80) = -1 ENOENT (No such file or
directory)
stat64(“/usr/lib/perl5/site_perl/5.10.0/auto/DBI/DESTROY.al”,
0xbff7ca80) = -1 ENOENT (No such file or directory)
stat64(“/usr/lib/perl5/vendor_perl/5.10.0/i586-linux-thread-
multi/auto/DBI/DESTROY.al”, 0xbff7ca80) = -1 ENOENT (No such file or
directory)
stat64(“/usr/lib/perl5/vendor_perl/5.10.0/auto/DBI/DESTROY.al”,
0xbff7ca80) = -1 ENOENT (No such file or directory)
stat64(“/usr/lib/perl5/vendor_perl/auto/DBI/DESTROY.al”, 0xbff7ca80) =
-1 ENOENT (No such file or directory)
stat64(“./auto/DBI/DESTROY.al”, 0xbff7ca80) = -1 ENOENT (No such file
or directory)
stat64(“/srv/www/auto/DBI/DESTROY.al”, 0xbff7ca80) = -1 ENOENT (No such
file or directory)
brk(0xba64c000) = 0xba64c000
munmap(0xb61de000, 135168) = 0
brk(0xba625000) = 0xba625000
brk(0xba602000) = 0xba602000
brk(0xba5e0000) = 0xba5e0000
brk(0xba5be000) = 0xba5be000
brk(0xba599000) = 0xba599000
munmap(0xb6ea8000, 24764) = 0

(…)

munmap(0xb778c000, 8352) = 0
— SIGSEGV (Segmentation fault) @ 0 (0) —
+++ killed by SIGSEGV +++

i’m not really sure how to interpret it. anyone have suggestions on
how to diagnose/fix?

Thanks

brian

“RK&K” and “RK&K Engineers” are registered trade names of Rummel,
Klepper & Kahl, LLP, a Maryland
limited liability partnership. This message contains confidential
information intended only for
the person or persons named above. If you have received this message
in error, please immediately
notify the sender by return email and delete the message. Thank you.
The information transmitted is intended only for the person or entity to which
it is addressed and may contain confidential and/or privileged material. Any
review, retransmission, dissemination or other use of, or taking of any action
in reliance upon, this information by persons or entities other than the
intended recipient is prohibited. If you are not the intended recipient of this
message, please contact the sender and delete this material from this computer.

I setup RT on my home PC last night, opensuse 11.2, and I’m seeing the same seg fault it so that tells me it’s not vmware. Are you running via mod_perl or fastcgi? I’m using mod_perl and my next move was to try fastcgi.

Darin Perusich
Email: Darin.Perusich@ctg.com
Office: 716-888-3690
Cell: 716-807-4589

-----Original Message-----
From: rt-users-bounces@lists.bestpractical.com [mailto:rt-users-
bounces@lists.bestpractical.com] On Behalf Of Brian Dial
Sent: Thursday, November 04, 2010 5:48 PM
To: rt-users@lists.bestpractical.com
Subject: Re: [rt-users] httpd2-prefork segfaulting on SLES11

interesting. we’re running it in vmware as well. but i’m inclined to
think it’s more of a suse thing than a vmware thing. thanks for the
suggestions. maybe i can work that into the init script since my main
concern is that it starts on boot in case the machine has to be
rebooted when i’m not around to make sure apache restarts correctly.

----- Original Message -----
Brian,

I’m getting this same thing only on opensuse 11.3 x86_x64 running under
VMware. I’ve been beating my head against it most of the day and making
nearly zero headway. I’ve tried both httpd2-perfork and worker but it
doesn’t matter, sometimes is starts, mostly is doesn’t. I see this
behavior when installing the perl modules from either CPAN or the
devel:languages:perl.repo.

I have been able to get it to start successfully doing the follow. It’s
ugly but it works.

  • /etc/init.d/apache2 stop
  • mv /etc/apache2/conf.d/rt.conf /etc/apache2/conf.d/rt.off
  • /etc/init.d/apache2 start
  • mv /etc/apache2/conf.d/rt.off /etc/apache2/conf.d/rt.conf
  • /etc/init.d/apache2 reload

SegFault errors.
httpd2-worker[13254]: segfault at 7f0ed3c173e8 ip 00007f0ece748bb0 sp
00007fff60526d60 error 4 in libc-2.11.2.so[7f0ece714000+156000]
httpd2-prefork[13015]: segfault at 7f87b75a1f98 ip 00007f87b20b5bb0 sp
00007fff2657f100 error 4 in libc-2.11.2.so[7f87b2081000+156000]


Darin Perusich
Email: Darin.Perusich@ctg.com
Office: 716-888-3690
Cell: 716-807-4589

-----Original Message-----
From: rt-users-bounces@lists.bestpractical.com [mailto:rt-users-
bounces@lists.bestpractical.com] On Behalf Of Brian Dial
Sent: Thursday, November 04, 2010 3:24 PM
To: rt-users@lists.bestpractical.com
Subject: [rt-users] httpd2-prefork segfaulting on SLES11

i’m having problems with running RT 3.8.8 on SLES11. 4/5 times when
i
try to start apache it segfaults

[16167.712443] httpd2-prefork[24765]: segfault at ba37a3d4 ip
b742f3b1
sp bfad70a4 error 4 in libc-2.11.1.so[b7402000+15b000]

when it does start, rt works fine though. i’ve had this on several
builds i’ve done as i’ve been playing with RT. Its similar to
another
issue someone had with opensuse 11 (http://www.gossamer-
Threads)

The first build I did, I let make fixdeps do most of the work
installing moduls from cpan. I did another build today where I tried
to install as many modules as possible from the sles sdk cd. results
were the same always.

I did a strace httpd2-prefork -X and see this

time(NULL) = 1288898480
semget(IPC_PRIVATE, 1, IPC_CREAT|0600) = 524291
semctl(524291, 0, IPC_64|SETVAL, 0xbff7cfd8) = 0
geteuid32() = 0
semctl(524291, 0, IPC_64|IPC_SET, 0xbff7cfa8) = 0
gettimeofday({1288898480, 105778}, NULL) = 0
write(2, “[Thu Nov 04 15:21:20 2010] [warn”…, 96) = 96
stat64(“/usr/lib/perl5/vendor_perl/5.10.0/i586-linux-thread-
multi/auto/DBI/DESTROY.al”, 0xb793f460) = -1 ENOENT (No such file or
directory)
stat64(“/srv/www/perl-lib/auto/DBI/DESTROY.al”, 0xbff7ca80) = -1
ENOENT
(No such file or directory)
stat64(“/opt/rt/bin/…/local/lib/auto/DBI/DESTROY.al”, 0xbff7ca80) =
-1
ENOENT (No such file or directory)
stat64(“/opt/rt/bin/…/lib/auto/DBI/DESTROY.al”, 0xbff7ca80) = -1
ENOENT (No such file or directory)
stat64(“/usr/lib/perl5/5.10.0/i586-linux-thread-
multi/auto/DBI/DESTROY.al”, 0xbff7ca80) = -1 ENOENT (No such file or
directory)
stat64(“/usr/lib/perl5/5.10.0/auto/DBI/DESTROY.al”, 0xbff7ca80) = -1
ENOENT (No such file or directory)
stat64(“/usr/lib/perl5/site_perl/5.10.0/i586-linux-thread-
multi/auto/DBI/DESTROY.al”, 0xbff7ca80) = -1 ENOENT (No such file or
directory)
stat64(“/usr/lib/perl5/site_perl/5.10.0/auto/DBI/DESTROY.al”,
0xbff7ca80) = -1 ENOENT (No such file or directory)
stat64(“/usr/lib/perl5/vendor_perl/5.10.0/i586-linux-thread-
multi/auto/DBI/DESTROY.al”, 0xbff7ca80) = -1 ENOENT (No such file or
directory)
stat64(“/usr/lib/perl5/vendor_perl/5.10.0/auto/DBI/DESTROY.al”,
0xbff7ca80) = -1 ENOENT (No such file or directory)
stat64(“/usr/lib/perl5/vendor_perl/auto/DBI/DESTROY.al”, 0xbff7ca80)
=
-1 ENOENT (No such file or directory)
stat64(“./auto/DBI/DESTROY.al”, 0xbff7ca80) = -1 ENOENT (No such file
or directory)
stat64(“/srv/www/auto/DBI/DESTROY.al”, 0xbff7ca80) = -1 ENOENT (No
such
file or directory)
brk(0xba64c000) = 0xba64c000
munmap(0xb61de000, 135168) = 0
brk(0xba625000) = 0xba625000
brk(0xba602000) = 0xba602000
brk(0xba5e0000) = 0xba5e0000
brk(0xba5be000) = 0xba5be000
brk(0xba599000) = 0xba599000
munmap(0xb6ea8000, 24764) = 0

(…)

munmap(0xb778c000, 8352) = 0
— SIGSEGV (Segmentation fault) @ 0 (0) —
+++ killed by SIGSEGV +++

i’m not really sure how to interpret it. anyone have suggestions on
how to diagnose/fix?

Thanks

brian

“RK&K” and “RK&K Engineers” are registered trade names of Rummel,
Klepper & Kahl, LLP, a Maryland
limited liability partnership. This message contains confidential
information intended only for
the person or persons named above. If you have received this message
in error, please immediately
notify the sender by return email and delete the message. Thank you.
The information transmitted is intended only for the person or entity
to which
it is addressed and may contain confidential and/or privileged
material. Any
review, retransmission, dissemination or other use of, or taking of any
action
in reliance upon, this information by persons or entities other than
the
intended recipient is prohibited. If you are not the intended recipient
of this
message, please contact the sender and delete this material from this
computer.
The information transmitted is intended only for the person or entity to which
it is addressed and may contain confidential and/or privileged material. Any
review, retransmission, dissemination or other use of, or taking of any action
in reliance upon, this information by persons or entities other than the
intended recipient is prohibited. If you are not the intended recipient of this
message, please contact the sender and delete this material from this computer.

mod_perl. fastcgi looked rather complicated so i was hoping to avoid that

I setup RT on my home PC last night, opensuse 11.2, and I’m seeing the same seg fault it so that tells me it’s not vmware. Are you running via mod_perl or fastcgi? I’m using mod_perl and my next move was to try fastcgi.

Darin Perusich
Email: Darin.Perusich@ctg.com
Office: 716-888-3690
Cell: 716-807-4589

-----Original Message-----
From: rt-users-bounces@lists.bestpractical.com [mailto:rt-users-
bounces@lists.bestpractical.com] On Behalf Of Brian Dial
Sent: Thursday, November 04, 2010 5:48 PM
To: rt-users@lists.bestpractical.com
Subject: Re: [rt-users] httpd2-prefork segfaulting on SLES11

interesting. we’re running it in vmware as well. but i’m inclined to
think it’s more of a suse thing than a vmware thing. thanks for the
suggestions. maybe i can work that into the init script since my main
concern is that it starts on boot in case the machine has to be
rebooted when i’m not around to make sure apache restarts correctly.

----- Original Message -----
Brian,

I’m getting this same thing only on opensuse 11.3 x86_x64 running under
VMware. I’ve been beating my head against it most of the day and making
nearly zero headway. I’ve tried both httpd2-perfork and worker but it
doesn’t matter, sometimes is starts, mostly is doesn’t. I see this
behavior when installing the perl modules from either CPAN or the
devel:languages:perl.repo.

I have been able to get it to start successfully doing the follow. It’s
ugly but it works.

  • /etc/init.d/apache2 stop
  • mv /etc/apache2/conf.d/rt.conf /etc/apache2/conf.d/rt.off
  • /etc/init.d/apache2 start
  • mv /etc/apache2/conf.d/rt.off /etc/apache2/conf.d/rt.conf
  • /etc/init.d/apache2 reload

SegFault errors.
httpd2-worker[13254]: segfault at 7f0ed3c173e8 ip 00007f0ece748bb0 sp
00007fff60526d60 error 4 in libc-2.11.2.so[7f0ece714000+156000]
httpd2-prefork[13015]: segfault at 7f87b75a1f98 ip 00007f87b20b5bb0 sp
00007fff2657f100 error 4 in libc-2.11.2.so[7f87b2081000+156000]


Darin Perusich
Email: Darin.Perusich@ctg.com
Office: 716-888-3690
Cell: 716-807-4589

-----Original Message-----
From: rt-users-bounces@lists.bestpractical.com [mailto:rt-users-
bounces@lists.bestpractical.com] On Behalf Of Brian Dial
Sent: Thursday, November 04, 2010 3:24 PM
To: rt-users@lists.bestpractical.com
Subject: [rt-users] httpd2-prefork segfaulting on SLES11

i’m having problems with running RT 3.8.8 on SLES11. 4/5 times when
i
try to start apache it segfaults

[16167.712443] httpd2-prefork[24765]: segfault at ba37a3d4 ip
b742f3b1
sp bfad70a4 error 4 in libc-2.11.1.so[b7402000+15b000]

when it does start, rt works fine though. i’ve had this on several
builds i’ve done as i’ve been playing with RT. Its similar to
another
issue someone had with opensuse 11 (http://www.gossamer-
Threads)

The first build I did, I let make fixdeps do most of the work
installing moduls from cpan. I did another build today where I tried
to install as many modules as possible from the sles sdk cd. results
were the same always.

I did a strace httpd2-prefork -X and see this

time(NULL) = 1288898480
semget(IPC_PRIVATE, 1, IPC_CREAT|0600) = 524291
semctl(524291, 0, IPC_64|SETVAL, 0xbff7cfd8) = 0
geteuid32() = 0
semctl(524291, 0, IPC_64|IPC_SET, 0xbff7cfa8) = 0
gettimeofday({1288898480, 105778}, NULL) = 0
write(2, “[Thu Nov 04 15:21:20 2010] [warn”…, 96) = 96
stat64(“/usr/lib/perl5/vendor_perl/5.10.0/i586-linux-thread-
multi/auto/DBI/DESTROY.al”, 0xb793f460) = -1 ENOENT (No such file or
directory)
stat64(“/srv/www/perl-lib/auto/DBI/DESTROY.al”, 0xbff7ca80) = -1
ENOENT
(No such file or directory)
stat64(“/opt/rt/bin/…/local/lib/auto/DBI/DESTROY.al”, 0xbff7ca80) =
-1
ENOENT (No such file or directory)
stat64(“/opt/rt/bin/…/lib/auto/DBI/DESTROY.al”, 0xbff7ca80) = -1
ENOENT (No such file or directory)
stat64(“/usr/lib/perl5/5.10.0/i586-linux-thread-
multi/auto/DBI/DESTROY.al”, 0xbff7ca80) = -1 ENOENT (No such file or
directory)
stat64(“/usr/lib/perl5/5.10.0/auto/DBI/DESTROY.al”, 0xbff7ca80) = -1
ENOENT (No such file or directory)
stat64(“/usr/lib/perl5/site_perl/5.10.0/i586-linux-thread-
multi/auto/DBI/DESTROY.al”, 0xbff7ca80) = -1 ENOENT (No such file or
directory)
stat64(“/usr/lib/perl5/site_perl/5.10.0/auto/DBI/DESTROY.al”,
0xbff7ca80) = -1 ENOENT (No such file or directory)
stat64(“/usr/lib/perl5/vendor_perl/5.10.0/i586-linux-thread-
multi/auto/DBI/DESTROY.al”, 0xbff7ca80) = -1 ENOENT (No such file or
directory)
stat64(“/usr/lib/perl5/vendor_perl/5.10.0/auto/DBI/DESTROY.al”,
0xbff7ca80) = -1 ENOENT (No such file or directory)
stat64(“/usr/lib/perl5/vendor_perl/auto/DBI/DESTROY.al”, 0xbff7ca80)
=
-1 ENOENT (No such file or directory)
stat64(“./auto/DBI/DESTROY.al”, 0xbff7ca80) = -1 ENOENT (No such file
or directory)
stat64(“/srv/www/auto/DBI/DESTROY.al”, 0xbff7ca80) = -1 ENOENT (No
such
file or directory)
brk(0xba64c000) = 0xba64c000
munmap(0xb61de000, 135168) = 0
brk(0xba625000) = 0xba625000
brk(0xba602000) = 0xba602000
brk(0xba5e0000) = 0xba5e0000
brk(0xba5be000) = 0xba5be000
brk(0xba599000) = 0xba599000
munmap(0xb6ea8000, 24764) = 0

(…)

munmap(0xb778c000, 8352) = 0
— SIGSEGV (Segmentation fault) @ 0 (0) —
+++ killed by SIGSEGV +++

i’m not really sure how to interpret it. anyone have suggestions on
how to diagnose/fix?

Thanks

brian

“RK&K” and “RK&K Engineers” are registered trade names of Rummel,
Klepper & Kahl, LLP, a Maryland
limited liability partnership. This message contains confidential
information intended only for
the person or persons named above. If you have received this message
in error, please immediately
notify the sender by return email and delete the message. Thank you.
The information transmitted is intended only for the person or entity
to which
it is addressed and may contain confidential and/or privileged
material. Any
review, retransmission, dissemination or other use of, or taking of any
action
in reliance upon, this information by persons or entities other than
the
intended recipient is prohibited. If you are not the intended recipient
of this
message, please contact the sender and delete this material from this
computer.
The information transmitted is intended only for the person or entity to which
it is addressed and may contain confidential and/or privileged material. Any
review, retransmission, dissemination or other use of, or taking of any action
in reliance upon, this information by persons or entities other than the
intended recipient is prohibited. If you are not the intended recipient of this
message, please contact the sender and delete this material from this computer.

mod_perl. fastcgi looked rather complicated so i was hoping to avoid that

Here’s the whole of our RT config in apache. First, install and enable the mod_fastcgi module in apache 2.2, then use the following, but adjust the file paths to match where you put things. Note that the trailing / in the Alias to mason_handler.fcgi is important.

Also you will want to make sure that the mason cache directory is writable by the user your apache runs under. it will complain if this is not the case.

RT3 Setup

<Directory “/usr/local/share/rt38”>
AllowOverride None
Order allow,deny
Allow from all

set idle timeout a bit longer than RT’s idle timeout.

FastCgiServer /usr/local/share/rt38/bin/mason_handler.fcgi -processes 8 -idle-timeout 305

<VirtualHost *:80>
ServerName rt.example.com
DocumentRoot “/usr/local/share/rt38/html”
AddDefaultCharset UTF-8
ErrorLog /var/log/httpd-rt-error.log
CustomLog /var/log/httpd-rt-access.log combined
AddHandler fastcgi-script fcgi

Alias /NoAuth/images /usr/local/share/rt38/html/NoAuth/images
Alias / /usr/local/share/rt38/bin/mason_handler.fcgi/

END RT3 Setup

that looks a lot easier than the wiki made it look, thanks!----- Original Message -----
On Nov 5, 2010, at 9:09 AM, Brian Dial wrote:

mod_perl. fastcgi looked rather complicated so i was hoping to avoid that

Here’s the whole of our RT config in apache. First, install and enable the mod_fastcgi module in apache 2.2, then use the following, but adjust the file paths to match where you put things. Note that the trailing / in the Alias to mason_handler.fcgi is important.

Also you will want to make sure that the mason cache directory is writable by the user your apache runs under. it will complain if this is not the case.

RT3 Setup

<Directory “/usr/local/share/rt38”>
AllowOverride None
Order allow,deny
Allow from all

set idle timeout a bit longer than RT’s idle timeout.

FastCgiServer /usr/local/share/rt38/bin/mason_handler.fcgi -processes 8 -idle-timeout 305

<VirtualHost *:80>
ServerName rt.example.com
DocumentRoot “/usr/local/share/rt38/html”
AddDefaultCharset UTF-8
ErrorLog /var/log/httpd-rt-error.log
CustomLog /var/log/httpd-rt-access.log combined
AddHandler fastcgi-script fcgi

Alias /NoAuth/images /usr/local/share/rt38/html/NoAuth/images
Alias / /usr/local/share/rt38/bin/mason_handler.fcgi/

END RT3 Setup

“RK&K” and “RK&K Engineers” are registered trade names of Rummel, Klepper & Kahl, LLP, a Maryland
limited liability partnership. This message contains confidential information intended only for
the person or persons named above. If you have received this message in error, please immediately
notify the sender by return email and delete the message. Thank you.

Apache is not crashing using mod_fastcgi, which I installed from the Apache Modules repo at http://download.opensuse.org/repositories/Apache:/Modules/openSUSE_11.3/

Darin Perusich
Email: Darin.Perusich@ctg.com
Office: 716-888-3690
Cell: 716-807-4589

-----Original Message-----
From: rt-users-bounces@lists.bestpractical.com [mailto:rt-users-
bounces@lists.bestpractical.com] On Behalf Of Brian Dial
Sent: Friday, November 05, 2010 9:27 AM
To: rt-users@lists.bestpractical.com
Subject: Re: [rt-users] httpd2-prefork segfaulting on SLES11

that looks a lot easier than the wiki made it look, thanks!

----- Original Message -----

mod_perl. fastcgi looked rather complicated so i was hoping to avoid
that

Here’s the whole of our RT config in apache. First, install and enable
the mod_fastcgi module in apache 2.2, then use the following, but
adjust the file paths to match where you put things. Note that the
trailing / in the Alias to mason_handler.fcgi is important.

Also you will want to make sure that the mason cache directory is
writable by the user your apache runs under. it will complain if this
is not the case.

RT3 Setup

<Directory “/usr/local/share/rt38”>
AllowOverride None
Order allow,deny
Allow from all

set idle timeout a bit longer than RT’s idle timeout.

FastCgiServer /usr/local/share/rt38/bin/mason_handler.fcgi -processes 8
-idle-timeout 305

<VirtualHost *:80>
ServerName rt.example.com
DocumentRoot “/usr/local/share/rt38/html”
AddDefaultCharset UTF-8
ErrorLog /var/log/httpd-rt-error.log
CustomLog /var/log/httpd-rt-access.log combined
AddHandler fastcgi-script fcgi

Alias /NoAuth/images /usr/local/share/rt38/html/NoAuth/images
Alias / /usr/local/share/rt38/bin/mason_handler.fcgi/

END RT3 Setup

###################################################################

“RK&K” and “RK&K Engineers” are registered trade names of Rummel,
Klepper & Kahl, LLP, a Maryland
limited liability partnership. This message contains confidential
information intended only for
the person or persons named above. If you have received this message
in error, please immediately
notify the sender by return email and delete the message. Thank you.
The information transmitted is intended only for the person or entity to which
it is addressed and may contain confidential and/or privileged material. Any
review, retransmission, dissemination or other use of, or taking of any action
in reliance upon, this information by persons or entities other than the
intended recipient is prohibited. If you are not the intended recipient of this
message, please contact the sender and delete this material from this computer.