Rt2-to-rt3 fails

I’m trying to migrate my RT 2 database to RT 3. rt-2.0-to-dumpfile causes an
"Out of memory!" error after running for about 4 minutes. The database is in
MySQL running on an HP-UX 11.00 server with 2GB physical RAM and 2 CPUs. The
database holds about 16,000 RT tickets, and uses about 130Mb disk space. The
rt-2.0-to-dumpfile script doesnt generate any other errors to help locate the
problem.

perl version? 5.6.x or 5.8.x?

A.-----Original Message-----
From: rt-users-bounces@lists.bestpractical.com
[mailto:rt-users-bounces@lists.bestpractical.com] On Behalf Of Craig Schenk
Sent: Monday, January 12, 2004 9:35 PM
To: rt-users@lists.bestpractical.com
Subject: [rt-users] rt2-to-rt3 fails

I’m trying to migrate my RT 2 database to RT 3. rt-2.0-to-dumpfile causes an
“Out of memory!” error after running for about 4 minutes. The database is in
MySQL running on an HP-UX 11.00 server with 2GB physical RAM and 2 CPUs. The
database holds about 16,000 RT tickets, and uses about 130Mb disk space. The
rt-2.0-to-dumpfile script doesnt generate any other errors to help locate
the
problem.
rt-users mailing list
rt-users@lists.bestpractical.com
http://lists.bestpractical.com/mailman/listinfo/rt-users

Have you read the FAQ? The RT FAQ Manager lives at http://fsck.com/rtfm

perl version? 5.6.x or 5.8.x?

5.6.1

Upgrade to 5.8.x.

Search the archives of the mailing list, this has been mentioned many times!
Just a few days ago someone had problems with rt2-to-rt3 and was also
running perl 5.6.x.

A.From: murple@dhcp-310-125 [mailto:murple@dhcp-310-125] On Behalf Of Craig
Schenk
Sent: Monday, January 12, 2004 9:49 PM
To: Aleš Sušnik; Aleš Sušnik; rt-users@lists.bestpractical.com
Subject: RE: [rt-users] rt2-to-rt3 fails

perl version? 5.6.x or 5.8.x?

5.6.1

The only things in the mailing list archive I see about rt2-to-rt3 memory
failures dont mention anything about perl 5.6… The only thing relating to
perl 5.6 and this script has to do with some guy getting a segmentation fault
on some perl module, which isn’t what’s happening with me.

The only things in the mailing list archive I see about rt2-to-rt3
memory
failures dont mention anything about perl 5.6… The only thing
relating to

The one thing many people forget is that just because your system has
2GB of physical memory doesn’t mean that your process is allowed to use
all of it. In fact, it would be really bad if the OS let you do that.

You are most likely running up against process size limits. You need
to investigate how to increase those limits for your shell before
running the command that is using up all the resources. Usually this
is with the ‘limit’ or ‘ulimit’ command to the shell. Of course, there
may be a hard system-imposed limit you cannot increase without system
administrator assistance.

Upgrade to 5.8.x.

Search the archives of the mailing list, this has been mentioned many times!
Just a few days ago someone had problems with rt2-to-rt3 and was also
running perl 5.6.x.

OK, I know I’m probably creating flame bait here, but I’d like to try
and make a difference, one list at a time :slight_smile:

Instead of saying:
Read the FAQ, read the archives, etc

Give a specific reference. If the reply is that it’s easy to find in
the FAQ or archive, then copy/paste the link to it! It saves the
ensuing E-mail volley of “I did”, “Where is the archive” “Its not the
same”, etc

I’ve been in technical support (1st, 2nd, and 3rd Tier) for at least 8
or 9 years now as a technician/engineer/manager, and despite the fact
almost every inquiry we get is in the manual/method of procedure (MOP),
we still show people how to find the answer. As well as reading it to
them over the phone/via email/fax/whatever. Granted, it is easier to be
callous via E-mail but given the fact that OSS is supposed to be
community-based it makes sense that we’d be MORE supportive than our M$
brethren.

I run a supporting website that allows people to share PCM files, so
that they can re-program their 4th Gen Camaros/Firebirds (LT1/LS1
Edit). At least several times a week, I get an Email asking “Do you
have XXX file?” I give them a link to the specific file, as well as the
webpage which contains a link to it from an index. I could just say
"Read my website", but what good does that do?

I know I’m probably not popular with this opinion, but oh well…

John

PS. Don’t get me started on “Just upgrade” responses, either… cough
M$ Cough

Well, the problem was not ulimit. Running as root with no limit set, it still
crashed. The problem doesn’t appear to be Perl 5.6.x either since the script
works fine with Perl if I narrow the dump (see below). The host I was running
on has 2 gigs physical ram and a pretty good ammount of swap. If 2Gb+ memory
isnt sufficient to run a dump on a 16000 record 300Mb database, there’s
something wrong with that picture… I mention this only because some of the
responses in the mailing list archives suggested that this script requires 5Gb
and several days to run, which seems to be just slightly absurd.

I tried running the script with the since option, and found that this would
let me dump a few months worth of records before it started crashing. Since
date limits arent really useful because some old tickets are still open, I
modified the script to limit the database search on the Queue field in Tickets
rather than LastUpdated. This way, I can dump out whole queues at a time, and
not lose tickets older than a certain date. It’s also a little more useful in
that it allows for migration only of queues that are of interest. The
maintainer of this script may want to consider incorporating this kind of
functionality in future revisions.

I did save the corefile generated when the script crashed before, if anybody
cares to debug the problem.

doesn’t fix your problem but when I since’d, it treated the new
transactions chronologically, not by ticket order, so updates to old
tickets were included.

rickOn Fri, 16 Jan 2004, Craig Schenk wrote:

I tried running the script with the since option, and found that this would
let me dump a few months worth of records before it started crashing. Since
date limits arent really useful because some old tickets are still open, I
modified the script to limit the database search on the Queue field in Tickets
Rick Rezinas
Unix Systems Administrator
Qsent, Inc.

When Gladstone was British Prime Minister he visited Michael Faraday’s
laboratory and asked if some esoteric substance called `Electricity’
would ever have practical significance.
“One day, sir, you will tax it,” was the answer.
– Science, 1994