Rt-4.0.0rc2 eating so much CPU

When loading the web UI, I see a big hit on the CPU.

CPU: 50.4% user, 0.0% nice, 1.9% system, 0.6% interrupt, 47.2% idle Mem: 752M Active, 1712M Inact, 219M Wired, 112M Buf, 431M Free Swap: 5900M Total, 5900M Free

PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU
COMMAND
98129 www 1 104 0 130M 118M CPU1 0 0:05 36.96%
httpd
98121 www 1 76 0 130M 118M select 1 0:07 25.98%
httpd
3369 root 1 44 0 131M 127M select 1 7:29 0.00%
suidperl

I only have two Queues and I am the only active user on the system. I am
running Apache 2.2.17, mod_perl2, Perl 5.8.9 and MySQL-5.x
I have perldoc-ed RT_Config.pm and compared with my RT_SiteConfig.pm (found
here - http://lix.in/-9a992d) and I just cannot find what is causing this
CPU madness.

What should I do? Where should I look?

Best regards,
Odhiambo WASHINGTON,
Nairobi,KE
+254733744121/+254722743223


Damn!!

When loading the web UI, I see a big hit on the CPU.

Do you mean that you see that for the time that RT’s homepage loads and then it drops back down or does it stick there?

If the former, can you enable MasonX::Profiler (as described in RT_Config.pm) and see what it shows?

Does it happen only for one page or for any page load?

When loading the web UI, I see a big hit on the CPU.

Do you mean that you see that for the time that RT’s homepage loads and
then it drops back down or does it stick there?

It does whenever:

(a) Apache is started
(b) I am logging in to the RT UI
© Loading anything on the UI

then it drops down… However, there is some considerable delay even in
loading the main page just to login.

Does my RT_SiteConfig.pm have any wild parameters that I need to work on?

If the former, can you enable MasonX::Profiler (as described in
RT_Config.pm) and see what it shows?

Here is what I have gotten from MasonX::Profiler: http://goo.gl/4Yg0t

Does it happen only for one page or for any page load?

Appears to happen for any page load.

As a matter of fact, I don’t even have many tickets. I have been just
testing this far to see how fast the system would respond in case there were
several users.

CPU: 50.4% user, 0.0% nice, 1.9% system, 0.6% interrupt, 47.2% idle Mem: 752M Active, 1712M Inact, 219M Wired, 112M Buf, 431M Free Swap: 5900M Total, 5900M Free

PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU
COMMAND
98129 www 1 104 0 130M 118M CPU1 0 0:05 36.96%
httpd
98121 www 1 76 0 130M 118M select 1 0:07 25.98%
httpd
3369 root 1 44 0 131M 127M select 1 7:29 0.00%
suidperl

I only have two Queues and I am the only active user on the system. I am
running Apache 2.2.17, mod_perl2, Perl 5.8.9 and MySQL-5.x
I have perldoc-ed RT_Config.pm and compared with my RT_SiteConfig.pm
(found
here - http://lix.in/-9a992d) and I just cannot find what is causing
this
CPU madness.

What should I do? Where should I look?


Best regards,
Odhiambo WASHINGTON,
Nairobi,KE
+254733744121/+254722743223


Damn!!


List info:
http://lists.bestpractical.com/cgi-bin/mailman/listinfo/rt-devel

Best regards,
Odhiambo WASHINGTON,
Nairobi,KE
+254733744121/+254722743223


Damn!!

Here is what I have gotten from MasonX::Profiler: http://goo.gl/4Yg0t

7s to load RT’s login page is… not right. Can you tell us about the hardware?

Here is what I have gotten from MasonX::Profiler: http://goo.gl/4Yg0t

7s to load RT’s login page is… not right. Can you tell us about the
hardware?

Sure.

CPU: Intel® Pentium® 4 CPU 3.06GHz (3059.02-MHz 686-class CPU)
Origin = “GenuineIntel” Id = 0xf49 Family = f Model = 4 Stepping = 9
Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
Features2=0x651d<SSE3,DTES64,MON,DS_CPL,TM2,CNXT-ID,CX16,xTPR>
AMD Features=0x20000000
AMD Features2=0x1
TSC: P-state invariant
real memory = 4295491584 (4096 MB)
avail memory = 3260903424 (3109 MB)

This server is mainly a mail server. It runs Exim+Dovecot and has a webmail
UI which is rarely used as most users are on POP3. The system is not loaded
generally. It has SATA disks.

Best regards,
Odhiambo WASHINGTON,
Nairobi,KE
+254733744121/+254722743223


Damn!!

Wash,

Could you try again having turned off DevelMode?On Tue, Jan 18, 2011 at 06:43:32PM +0300, Odhiambo Washington wrote:

On Tue, Jan 18, 2011 at 6:25 PM, Jesse Vincent jesse@bestpractical.comwrote:

On Tue, Jan 18, 2011 at 06:21:04PM +0300, Odhiambo Washington wrote:

Here is what I have gotten from MasonX::Profiler: http://goo.gl/4Yg0t

7s to load RT’s login page is… not right. Can you tell us about the
hardware?

Sure.

CPU: Intel® Pentium® 4 CPU 3.06GHz (3059.02-MHz 686-class CPU)
Origin = “GenuineIntel” Id = 0xf49 Family = f Model = 4 Stepping = 9
Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
Features2=0x651d<SSE3,DTES64,MON,DS_CPL,TM2,CNXT-ID,CX16,xTPR>
AMD Features=0x20000000
AMD Features2=0x1
TSC: P-state invariant
real memory = 4295491584 (4096 MB)
avail memory = 3260903424 (3109 MB)

This server is mainly a mail server. It runs Exim+Dovecot and has a webmail
UI which is rarely used as most users are on POP3. The system is not loaded
generally. It has SATA disks.


Best regards,
Odhiambo WASHINGTON,
Nairobi,KE
+254733744121/+254722743223


Damn!!


List info: http://lists.bestpractical.com/cgi-bin/mailman/listinfo/rt-devel

  • Odhiambo Washington:

Does my RT_SiteConfig.pm have any wild parameters that I need to work on?

Case-insensitive email addresses, perhaps?

Florian Weimer fweimer@bfk.de
BFK edv-consulting GmbH http://www.bfk.de/
Kriegsstraße 100 tel: +49-721-96201-1
D-76133 Karlsruhe fax: +49-721-96201-99

  • Odhiambo Washington:

Does my RT_SiteConfig.pm have any wild parameters that I need to work on?

Case-insensitive email addresses, perhaps?

Hi Florian,

Is that somewhere in my config? I cannot see it.

Best regards,
Odhiambo WASHINGTON,
Nairobi,KE
+254733744121/+254722743223


Damn!!

Here is what I have gotten from MasonX::Profiler: http://goo.gl/4Yg0t

7s to load RT’s login page is… not right. Can you tell us about the hardware?

As far as I can see those 7 seconds mostly spent in JS squishing.


List info: http://lists.bestpractical.com/cgi-bin/mailman/listinfo/rt-devel

Best regards, Ruslan.

Here is what I have gotten from MasonX::Profiler: http://goo.gl/4Yg0t

7s to load RT’s login page is… not right. Can you tell us about the
hardware?

As far as I can see those 7 seconds mostly spent in JS squishing.

??

Anything I should do/try??

Best regards,
Odhiambo WASHINGTON,
Nairobi,KE
+254733744121/+254722743223


Damn!!

  • Odhiambo Washington:> On Tue, Jan 18, 2011 at 7:38 PM, Florian Weimer fweimer@bfk.de wrote:
  • Odhiambo Washington:

Does my RT_SiteConfig.pm have any wild parameters that I need to work on?

Case-insensitive email addresses, perhaps?

Is that somewhere in my config? I cannot see it.

I’m not sure. I noticed that our RT was doing lower-case database
searches for email addresses when we had a similar problem. Adding a
few functional indexes fixed it. I thought this was a configuration
option, but I can’t find it.

Florian Weimer fweimer@bfk.de
BFK edv-consulting GmbH http://www.bfk.de/
Kriegsstraße 100 tel: +49-721-96201-1
D-76133 Karlsruhe fax: +49-721-96201-99

After upgrading from 3.9.7 to 4.0.0rc1 and then 4.0.0rc2, I was experiencing similar slowdown compared to 3.9.7.
I initially assumed the slow response was because I have RT currently running on a virtual machine on a desktop, but that doesn’t explain why 3.9.7 was seemed so much more responsive on the same VM.

I grabbed the output with MasonX::Profiler enabled for both 4.0.0RC1 and 4.0.0RC2 while loading a page while this issue was occurring. I reverted my VM to an old state with RT3.9.7 installed and tried to enable MasonX::Profiler, but it wasn’t
producing any extra output for some reason. I’d be happy to play around with it some more to get it working if anyone would find that information useful.

Devel mode is off in both of these instances. No more than a couple of tickets total in the database. A clean RT_SiteConfig file with nothing but MasonX::Profiler enabled doesn’t seem to make any difference in page loads. The client is Firefox.

4.0.0 RC1 Output: http://pastebin.com/xUHP07nz
4.0.0 RC2 Output: http://pastebin.com/kFxr0Cg8

I grabbed the above output before reverting back to 3.9.7. Odhiambo’s log also shows a long time being taken to process /Elements/HeaderJavascript as in my logs.

After playing around with RT 3.9.7 for a little bit and not getting the extra output from MasonX::Profiler, I reverted my VM back to it’s current state with RT 4.0.0RC2 running and for some odd reason, it’s now running faster than 3.9.7 was without
any additional changes. At this point I’d be willing to chalk up my own experience to a system configuration issue on my end, but if Odhiambo is still experiencing a similar issue, it may be related.

It never occurred to me to try Chrome’s resource tracking feature while I was experiencing the issue to see where the delays were coming from on the client end until after it had resolved itself.

Just thought I’d throw out my experiences so far. If I can be of any further assistance, let me know.

Regards,
Evan

Jesse Vincent jesse@bestpractical.com writes:

DevelMode is commented out in my config. Do I have to explicitly turn it
off?

I have turned it off and here is the MasonX::Profiler result now:
http://goo.gl/q6gc3

Can you go to Configuration -> Tools -> System Information and send that to
the list?

Here goes…

Option Value Source (?-xism:[.+? #\d+]) qr/(?-xism:[.+? #\d+])/
core config (?x-ism:^ (?:/+NoAuth/ | /+REST/\d+.\d+/NoAuth/) )
qr/(?x-ism:^ (?:/+NoAuth/ | /+REST/\d+.\d+/NoAuth/) )/
core config (?x-ism:^(?:/+SelfService/))
qr/(?x-ism:^(?:/+SelfService/))/
core config ARRAY(0xb271b64) [
‘QuickCreate’,
‘Quicksearch’,
‘MyAdminQueues’,
‘MySupportQueues’,
‘MyReminders’,
‘RefreshHomepage’,
‘Dashboards’,
‘SavedSearches’
]
core config Active_MakeClicky []
site config AdminSearchResultFormat {
‘Groups’ => ‘‘id/TITLE:#’,‘Name/TITLE:Name’,‘Description’’,
‘Queues’ => ‘‘id/TITLE:#’,‘Name/TITLE:Name’,Description,Address,Priority,DefaultDueIn,Disabled’,
‘Users’ => ‘‘id/TITLE:#’,‘Name/TITLE:Name’,RealName,
EmailAddress’,
‘Templates’ => ‘‘id/TITLE:#’,‘Name/TITLE:Name’,‘Description’’,
‘Classes’ => ’ ‘id/TITLE:#’,‘Name/TITLE:Name’,Description’,
‘Scrips’ => ‘‘id/TITLE:#’,‘Description/TITLE:Description’,Stage,
Condition, Action, Template’,
‘CustomFields’ => ‘‘id/TITLE:#’,‘Name/TITLE:Name’,AppliedTo,
FriendlyType, FriendlyPattern
}
core config AllowUserAutocompleteForUnprivileged 0
site config AmbiguousDayInFuture 0
site config AmbiguousDayInPast 0
site config ApprovalRejectionNotes 1
site config ArticleOnTicketCreate '1’
site config AutoLogoff 0
site config AutocompleteOwners 0
site config CSSFiles []
core config CanonicalizeEmailAddressMatch 'gw.domain.com$'
site config CanonicalizeEmailAddressReplace 'domain.com
site config CanonicalizeOnCreate 0
site config CanonicalizeRedirectURLs 0
site config ChartFont {
‘ja’ => ‘/opt/rt4/share/fonts/DroidSansFallback.ttf’,
‘others’ => ‘/opt/rt4/share/fonts/DroidSans.ttf’,
‘zh-cn’ => ‘/opt/rt4/share/fonts/DroidSansFallback.ttf’,
‘zh-tw’ => ‘/opt/rt4/share/fonts/DroidSansFallback.ttf’
}
core config ChartsTimezonesInDB 0
site config CommentAddress ''
site config CorrespondAddress ''
site config CustomFieldValuesSources []
site config DashboardAddress ''
site config DashboardSubject '%s Dashboard: %s’
site config DatabaseHost ''
site config DatabaseName 'rt4’
site config DatabasePassword Password not printed site config
DatabasePort ''
site config DatabaseRTHost ''
site config DatabaseType 'mysql’
site config DatabaseUser 'rt3x’
site config DateDayBeforeMonth 1
site config DateTimeFormat 'DefaultFormat’
site config DefaultErrorMailPrecedence 'bulk’
site config DefaultMailPrecedence 'bulk’
site config DefaultQueue ‘General’
site config DefaultSearchResultFormat ‘
id/TITLE:#’,
Subject/TITLE:Subject’,
Status,
QueueName,
OwnerName,
Priority,
NEWLINE’,
’’,
Requestors’,
CreatedRelative’,
ToldRelative’,
LastUpdatedRelative’,
TimeLeft’'
core config DefaultSelfServiceSearchResultFormat '
id/TITLE:#’,
Subject/TITLE:Subject’,
Status,
Requestors,
OwnerName’
core config DefaultSummaryRows 10
site config DefaultTimeUnitsToHours 0
site config DevelMode '0’
site config DisplayTicketAfterQuickCreate 0
core config EditCustomFieldsSingleColumn 0
core config EmailDashboardRemove []
core config EmailFrequency 'Individual messages’
core config EmailInputEncodings [
‘utf-8-strict’,
‘ascii’
]
site config EmailOutputEncoding ‘utf-8’
site config EnableReminders 1
site config ExtractSubjectTagMatch qr/(?-xism:[.+? #\d+])/
site config ForwardFromUser 0
site config FriendlyFromLineFormat ‘"%s via RT" <%s>‘
site config FriendlyToLineFormat ‘"%s of domain.com Ticket #%s":;‘
site config FullTextSearch {
‘Enable’ => 0,
‘Indexed’ => 0
}
core config GnuPG {
‘RejectOnBadData’ => 1,
‘Enable’ => 0,
‘RejectOnMissingPrivateKey’ => 1,
‘AllowEncryptDataInDB’ => 0,
‘OutgoingMessagesFormat’ => ‘RFC’
}
core config GnuPGOptions {
‘homedir’ => ‘/opt/rt4/var/data/gpg’
}
core config HideArticleSearchOnReplyCreate ‘0’
site config HomePageRefreshInterval 0
site config HomepageComponents [
‘QuickCreate’,
‘Quicksearch’,
‘MyAdminQueues’,
‘MySupportQueues’,
‘MyReminders’,
‘RefreshHomepage’,
‘Dashboards’,
‘SavedSearches’
]
site config JSFiles [
‘jquery-1.4.2.min.js’,
‘jquery_noconflict.js’,
‘jquery-ui-1.8.4.custom.min.js’,
‘jquery.tablesorter.min.js’,
‘jquery-ui-patch-datepicker.js’,
‘ui.timepickr.js’,
‘titlebox-state.js’,
‘util.js’,
‘userautocomplete.js’,
‘jquery.event.hover-1.0.js’,
‘superfish.js’,
‘supersubs.js’,
‘jquery.supposition.js’,
‘history-folding.js’,
‘late.js’
]
core config LexiconLanguages [

]
site config Lifecycles {
‘default’ => {
‘rights’ => {
-> rejected’ => ‘ModifyTicket’,
’* -> ’ => ‘ModifyTicket’,
-> deleted’ => ‘DeleteTicket’
},
‘actions’ => [
‘new -> open’,
{
‘label’ => ‘Open It’,
‘update’ => ‘Respond’
},
‘new -> resolved’,
{
‘label’ => ‘Resolve’,
‘update’ => ‘Comment’
},
‘new -> rejected’,
{
‘label’ => ‘Reject’,
‘update’ => ‘Respond’
},
‘new -> deleted’,
{
‘label’ => ‘Delete’
},
‘open -> stalled’,
{
‘label’ => ‘Stall’,
‘update’ => ‘Comment’
},
‘open -> resolved’,
{
‘label’ => ‘Resolve’,
‘update’ => ‘Comment’
},
‘open -> rejected’,
{
‘label’ => ‘Reject’,
‘update’ => ‘Respond’
},
‘stalled -> open’,
{
‘label’ => ‘Open It’
},
‘resolved -> open’,
{
‘label’ => ‘Re-open’,
‘update’ => ‘Comment’
},
‘rejected -> open’,
{
‘label’ => ‘Re-open’,
‘update’ => ‘Comment’
},
‘deleted -> open’,
{
‘label’ => ‘Undelete’
}
],
‘inactive’ => [
‘resolved’,
‘rejected’,
‘deleted’
],
‘defaults’ => {
‘on_merge’ => ‘resolved’,
‘on_create’ => ‘new’
},
‘active’ => [
‘open’,
‘stalled’
],
‘initial’ => [
‘new’
],
‘transitions’ => {
‘stalled’ => [
‘new’,
‘open’,
‘rejected’,
‘resolved’,
‘deleted’
],
‘open’ => [
‘new’,
‘stalled’,
‘resolved’,
‘rejected’,
‘deleted’
],
’’ => [
‘new’,
‘open’,
‘resolved’
],
‘rejected’ => [
‘new’,
‘open’,
‘stalled’,
‘resolved’,
‘deleted’
],
‘resolved’ => [
‘new’,
‘open’,
‘stalled’,
‘rejected’,
‘deleted’
],
‘deleted’ => [
‘new’,
‘open’,
‘stalled’,
‘rejected’,
‘resolved’
],
‘new’ => [
‘open’,
‘stalled’,
‘resolved’,
‘rejected’,
‘deleted’
]
}
}
}
core config LinkTransactionsRun1Scrip 0
site config LogDir '/opt/rt4/var/log’
site config LogStackTraces '0’
site config LogToFile 0
site config LogToFileNamed 'rt.log’
site config LogToScreen 'info’
site config LogToSyslog 'info’
site config LogToSyslogConf []
site config LogoAltText 'Best Practical Solutions, LLC corporate logo’
site config LogoImageHeight 38
site config LogoImageWidth 181
site config LogoLinkURL 'http://bestpractical.com
site config LogoURL '/NoAuth/images/bpslogo.png’
site config LogoutRefresh 1
site config LoopsToRTOwner 1
site config MailCommand 'sendmailpipe’
site config MailParams []
site config MasonParameters [
‘preamble’,
‘my $p = MasonX::Profiler->new($m, $r);’
]
site config MaxAttachmentSize 10000000
site config MaxInlineBody 12000
site config MessageBoxHeight 15
site config MessageBoxIncludeSignature 1
site config MessageBoxIncludeSignatureOnComment 1
site config MessageBoxRichText 1
site config MessageBoxRichTextHeight 200
site config MessageBoxWrap 'SOFT’
site config MinimumPasswordLength '6’
site config MoreAboutRequestorExtraInfo ''
site config MoreAboutRequestorTicketList 'Active’
site config NotifyActor 0
site config OldestTransactionsFirst '1’
site config OnlySearchActiveTicketsInSimpleSearch 1
core config Organization 'domain.com
site config OwnerEmail 'root’
site config ParseNewMessageForTicketCcs '1’
site config PlainTextMono 0
site config PlainTextPre 0
site config Plugins []
site config PreviewScripMessages 0
site config RTAddressRegexp '^rt\@gw.domain.com$'
site config RecordBaseClass 'DBIx::SearchBuilder::Record::Cachable’
core config RecordOutgoingEmail 1
site config RedistributeAutoGeneratedMessages 'privileged’
site config RememberDefaultQueue 1
site config SMTPDebug 0
site config SearchResultsAutoRedirect 0
core config SearchResultsRefreshInterval 0
site config SelfServiceRegex qr/(?x-ism:^(?:/+SelfService/))/
site config SendmailArguments '-oi -t’
site config SendmailBounceArguments '-f “<>”'
site config SendmailPath '/usr/sbin/sendmail’
site config SetOutgoingMailFrom 0
site config ShowBccHeader 0
site config ShowMoreAboutPrivilegedUsers 1
site config ShowRTPortal 1
core config ShowTransactionImages 1
site config ShowUnreadMessageNotifications 0
site config StrictLinkACL 1
site config TicketsItemMapSize 1000
site config Timezone 'Africa/Nairobi’
site config UseFriendlyFromLine 0
site config UseFriendlyToLine 0
site config UseOriginatorHeader 1
site config UseSideBySideLayout 1
site config UseTransactionBatch 1
site config UserAutocompleteFields {
‘RealName’ => ‘LIKE’,
‘Name’ => ‘STARTSWITH’,
‘EmailAddress’ => ‘STARTSWITH’
}
core config UsernameFormat 'concise’
site config VERPDomain 'domain.com
site config VERPPrefix 'rt-'
site config WebBaseURL 'http://rt.domain.com
core config WebDefaultStylesheet 'web2’
site config WebDomain 'rt.domain.com
site config WebExternalAuthContinuous 1
site config WebFlushDbCacheEveryRequest '1’
site config WebImagesURL '/NoAuth/images/'
site config WebNoAuthRegex
qr/(?x-ism:^ (?:/+NoAuth/ | /+REST/\d+.\d+/NoAuth/) )/
site config WebPath ''
site config WebPort 80
site config WebSecureCookies 0
site config WebSessionClass 'Apache::Session::File’
site config WebURL 'http://rt.domain.com/'
core config WikiImplicitLinks 0
site config rtname 'domain.com
site config
RT core variables
Variable Value RT::BasePath /opt/rt4 RT::BinPath /opt/rt4/bin
RT::EtcPath /opt/rt4/etc RT::LexiconPath /opt/rt4/share/po
RT::LocalEtcPath /opt/rt4/local/etc RT::LocalLexiconPath /opt/rt4/local/po
RT::LocalLibPath /opt/rt4/local/lib RT::LocalPath /opt/rt4/local
RT::LocalPluginPath /opt/rt4/local/plugins RT::MasonComponentRoot
/opt/rt4/share/html
RT::MasonDataDir /opt/rt4/var/mason_data RT::MasonLocalComponentRoot
/opt/rt4/local/html
RT::MasonSessionDir /opt/rt4/var/session_data RT::PluginPath /opt/rt4/plugins
RT::SbinPath /opt/rt4/sbin RT::VERSION 4.0.0rc2 RT::VarPath /opt/rt4/var
RT Size
Object Size Tickets 2 Queues 2 Transactions 54 Groups 39
PrivilegedUsers 3 UnprivilegedUsers 5
Mason template search order

  1. /opt/rt4/local/html
  2. /opt/rt4/share/html
Perl library search order
  1. /opt/rt4/sbin/…/local/lib
  2. /opt/rt4/sbin/…/lib
  3. /usr/local/lib/perl5/5.8.9/BSDPAN
  4. /usr/local/lib/perl5/site_perl/5.8.9/mach
  5. /usr/local/lib/perl5/site_perl/5.8.9
  6. /usr/local/lib/perl5/5.8.9/mach
  7. /usr/local/lib/perl5/5.8.9
  8. .
  9. /usr/local
 Loaded perl modules

Module Version Source Apache2::CmdParms 2.000004
/usr/local/lib/perl5/site_perl/5.8.9/mach/Apache2/CmdParms.pm
Apache2::Const 2.000004
/usr/local/lib/perl5/site_perl/5.8.9/mach/Apache2/Const.pm
Apache2::Directive 2.000004
/usr/local/lib/perl5/site_perl/5.8.9/mach/Apache2/Directive.pm
Apache2::Log 2.000004 /usr/local/lib/perl5/site_perl/5.8.9/mach/Apache2/Log.pm
Apache2::PerlSections 2.00
/usr/local/lib/perl5/site_perl/5.8.9/mach/Apache2/PerlSections.pm
Apache2::RequestIO 2.000004
/usr/local/lib/perl5/site_perl/5.8.9/mach/Apache2/RequestIO.pm
Apache2::RequestRec 2.000004
/usr/local/lib/perl5/site_perl/5.8.9/mach/Apache2/RequestRec.pm
Apache2::RequestUtil 2.000004
/usr/local/lib/perl5/site_perl/5.8.9/mach/Apache2/RequestUtil.pm
Apache2::Response 2.000004
/usr/local/lib/perl5/site_perl/5.8.9/mach/Apache2/Response.pm
Apache2::ServerRec 2.000004
/usr/local/lib/perl5/site_perl/5.8.9/mach/Apache2/ServerRec.pm
Apache2::ServerUtil 2.000004
/usr/local/lib/perl5/site_perl/5.8.9/mach/Apache2/ServerUtil.pm
Apache::Session 1.89 /usr/local/lib/perl5/site_perl/5.8.9/Apache/Session.pm
Apache::Session::File 1.54
/usr/local/lib/perl5/site_perl/5.8.9/Apache/Session/File.pm
Apache::Session::Generate::MD5 2.12
/usr/local/lib/perl5/site_perl/5.8.9/Apache/Session/Generate/MD5.pm
Apache::Session::lock::File 1.04
/usr/local/lib/perl5/site_perl/5.8.9/Apache/Session/Lock/File.pm
Apache::Session::Serialize::Storable 1.01
/usr/local/lib/perl5/site_perl/5.8.9/Apache/Session/Serialize/Storable.pm
Apache::Session::Store::File 1.04
/usr/local/lib/perl5/site_perl/5.8.9/Apache/Session/Store/File.pm
APR 0.009000 /usr/local/lib/perl5/site_perl/5.8.9/mach/APR.pm
APR::Pool 0.009000
/usr/local/lib/perl5/site_perl/5.8.9/mach/APR/Pool.pm APR::Table
0.009000 /usr/local/lib/perl5/site_perl/5.8.9/mach/APR/Table.pm
AutoLoader 5.67 /usr/local/lib/perl5/5.8.9/AutoLoader.pm base 2.13
/usr/local/lib/perl5/5.8.9/
base.pm bytes 1.02 /usr/local/lib/perl5/5.8.9/bytes.pm
Cache::Simple::TimedExpiry 0.27
/usr/local/lib/perl5/site_perl/5.8.9/Cache/Simple/TimedExpiry.pm
capitalization 0.03 /usr/local/lib/perl5/site_perl/5.8.9/capitalization.pm
Carp 1.10 /usr/local/lib/perl5/5.8.9/Carp.pm CGI 3.42
/usr/local/lib/perl5/5.8.9/CGI.pm
CGI::Cookie 1.29 /usr/local/lib/perl5/5.8.9/CGI/Cookie.pm
CGI::Emulate::PSGI 0.10
/usr/local/lib/perl5/site_perl/5.8.9/CGI/Emulate/PSGI.pm
CGI::PSGI 0.13 /usr/local/lib/perl5/site_perl/5.8.9/CGI/PSGI.pm
CGI::Util 1.5_01
/usr/local/lib/perl5/5.8.9/CGI/Util.pm Class::Accessor 0.34
/usr/local/lib/perl5/site_perl/5.8.9/Class/Accessor.pm
Class::Accessor::Fast 0.34
/usr/local/lib/perl5/site_perl/5.8.9/Class/Accessor/Fast.pm
Class::Container 0.12 /usr/local/lib/perl5/site_perl/5.8.9/Class/Container.pm
Class::Data::Inheritable 0.08
/usr/local/lib/perl5/site_perl/5.8.9/Class/Data/Inheritable.pm
Class::Inspector 1.24 /usr/local/lib/perl5/site_perl/5.8.9/Class/Inspector.pm
Class::Load 0.06 /usr/local/lib/perl5/site_perl/5.8.9/Class/Load.pm
Class::ReturnValue 0.55
/usr/local/lib/perl5/site_perl/5.8.9/Class/ReturnValue.pm
Clone 0.31 /usr/local/lib/perl5/site_perl/5.8.9/mach/Clone.pm constant 1.17
/usr/local/lib/perl5/5.8.9/constant.pm CSS::Squish 0.10
/usr/local/lib/perl5/site_perl/5.8.9/CSS/Squish.pm
Cwd 3.33 /usr/local/lib/perl5/5.8.9/mach/Cwd.pm Data::Dumper 2.128
/usr/local/lib/perl5/5.8.9/mach/Data/Dumper.pm
Data::OptList 0.106 /usr/local/lib/perl5/site_perl/5.8.9/Data/OptList.pm
DateTime 0.65 /usr/local/lib/perl5/site_perl/5.8.9/mach/DateTime.pm
DateTime::_Thawed 0.65
DateTime::Duration 0.65
/usr/local/lib/perl5/site_perl/5.8.9/mach/DateTime/Duration.pm
DateTime::Helpers 0.65
/usr/local/lib/perl5/site_perl/5.8.9/mach/DateTime/Helpers.pm
DateTime::Infinite 0.65
/usr/local/lib/perl5/site_perl/5.8.9/mach/DateTime/Infinite.pm
DateTime::Infinite::Future 0.65
DateTime::Infinite::Past 0.65
DateTime::Locale 0.45 /usr/local/lib/perl5/site_perl/5.8.9/DateTime/Locale.pm
DateTime::TimeZone 1.26
/usr/local/lib/perl5/site_perl/5.8.9/DateTime/TimeZone.pm
DateTime::TimeZone::Catalog 1.26
/usr/local/lib/perl5/site_perl/5.8.9/DateTime/TimeZone/Catalog.pm
DateTime::TimeZone::Floating 1.26
/usr/local/lib/perl5/site_perl/5.8.9/DateTime/TimeZone/Floating.pm
DateTime::TimeZone::Local 1.26
/usr/local/lib/perl5/site_perl/5.8.9/DateTime/TimeZone/Local.pm
DateTime::TimeZone::OffsetOnly 1.26
/usr/local/lib/perl5/site_perl/5.8.9/DateTime/TimeZone/OffsetOnly.pm
DateTime::TimeZone::UTC 1.26
/usr/local/lib/perl5/site_perl/5.8.9/DateTime/TimeZone/UTC.pm
DB 1.26
DBD::mysql 4.017 /usr/local/lib/perl5/site_perl/5.8.9/mach/DBD/mysql.pm
DBI 1.615 /usr/local/lib/perl5/site_perl/5.8.9/mach/DBI.pm
DBIx::SearchBuilder 1.59
/usr/local/lib/perl5/site_perl/5.8.9/DBIx/SearchBuilder.pm
DBIx::SearchBuilder::Union 0
/usr/local/lib/perl5/site_perl/5.8.9/DBIx/SearchBuilder/Union.pm
DBIx::SearchBuilder::Unique 0.01
/usr/local/lib/perl5/site_perl/5.8.9/DBIx/SearchBuilder/Unique.pm
Devel::GlobalDestruction 0.02
/usr/local/lib/perl5/site_perl/5.8.9/mach/Devel/GlobalDestruction.pm
Devel::StackTrace 1.26
/usr/local/lib/perl5/site_perl/5.8.9/Devel/StackTrace.pm
Devel::StackTrace::Frame 1.26
/usr/local/lib/perl5/site_perl/5.8.9/Devel/StackTrace/Frame.pm
Devel::Symdump 2.08 /usr/local/lib/perl5/site_perl/5.8.9/Devel/Symdump.pm
Digest::base 1.00 /usr/local/lib/perl5/5.8.9/Digest/base.pm Digest::MD5 2.37
/usr/local/lib/perl5/5.8.9/mach/Digest/MD5.pm DynaLoader 1.09
/usr/local/lib/perl5/5.8.9/mach/DynaLoader.pm
Email::Address 1.892 /usr/local/lib/perl5/site_perl/5.8.9/Email/Address.pm
Encode 2.40 /usr/local/lib/perl5/5.8.9/mach/Encode.pm Encode::Alias
2.12 /usr/local/lib/perl5/5.8.9/mach/Encode/Alias.pm
Encode::Config 2.05 /usr/local/lib/perl5/5.8.9/mach/Encode/Config.pm
Encode::Detect::Detector 1.01
/usr/local/lib/perl5/site_perl/5.8.9/mach/Encode/Detect/Detector.pm
Encode::Encoding 2.05 /usr/local/lib/perl5/5.8.9/mach/Encode/Encoding.pm
Encode::Guess 2.04 /usr/local/lib/perl5/5.8.9/mach/Encode/Guess.pm
Encode::Unicode 2.07 /usr/local/lib/perl5/5.8.9/mach/Encode/Unicode.pm
Errno 1.1 /usr/local/lib/perl5/5.8.9/mach/Errno.pm Exception::Class
1.32 /usr/local/lib/perl5/site_perl/5.8.9/Exception/Class.pm
Exception::Class::Base 1.32
/usr/local/lib/perl5/site_perl/5.8.9/Exception/Class/Base.pm
Exporter 5.63 /usr/local/lib/perl5/5.8.9/Exporter.pm Exporter::Heavy
5.63 /usr/local/lib/perl5/5.8.9/Exporter/Heavy.pm
Fcntl 1.06 /usr/local/lib/perl5/5.8.9/mach/Fcntl.pm File::Basename
2.77 /usr/local/lib/perl5/5.8.9/File/Basename.pm
File::Glob 1.06 /usr/local/lib/perl5/5.8.9/mach/File/Glob.pm
File::Path 2.07_02
/usr/local/lib/perl5/5.8.9/File/Path.pm File::ShareDir 1.02
/usr/local/lib/perl5/site_perl/5.8.9/File/ShareDir.pm
File::Spec 3.33 /usr/local/lib/perl5/5.8.9/mach/File/Spec.pm
File::Spec::Unix 3.33 /usr/local/lib/perl5/5.8.9/mach/File/Spec/Unix.pm
File::Temp 0.22 /usr/local/lib/perl5/5.8.9/File/Temp.pm FileHandle
2.01 /usr/local/lib/perl5/5.8.9/FileHandle.pm
GD 2.45 /usr/local/lib/perl5/site_perl/5.8.9/mach/GD.pm GD::Image
2.38 /usr/local/lib/perl5/site_perl/5.8.9/mach/GD/Image.pm
Getopt::Long 2.37 /usr/local/lib/perl5/5.8.9/Getopt/Long.pm GraphViz
2.04 /usr/local/lib/perl5/site_perl/5.8.9/GraphViz.pm
Hash::MultiValue 0.08 /usr/local/lib/perl5/site_perl/5.8.9/Hash/MultiValue.pm
HTML::Element 4.1 /usr/local/lib/perl5/site_perl/5.8.9/HTML/Element.pm
HTML::Entities 3.68 /usr/local/lib/perl5/site_perl/5.8.9/mach/HTML/Entities.pm
HTML::Formatter 2.04 /usr/local/lib/perl5/site_perl/5.8.9/HTML/Formatter.pm
HTML::FormatText 2.04 /usr/local/lib/perl5/site_perl/5.8.9/HTML/FormatText.pm
HTML::Mason 1.45 /usr/local/lib/perl5/site_perl/5.8.9/HTML/Mason.pm
HTML::Mason::CGIHandler 1.00
/usr/local/lib/perl5/site_perl/5.8.9/HTML/Mason/CGIHandler.pm
HTML::Mason::Exception 1.1
HTML::Mason::Exception::Abort 1.1
HTML::Mason::Exception::Compilation 1.1
HTML::Mason::Exception::Compilation::IncompatibleCompiler 1.1
HTML::Mason::Exception::Compiler 1.1
HTML::Mason::Exception::Decline 1.1
HTML::Mason::Exception::Params 1.1
HTML::Mason::Exception::Syntax 1.1
HTML::Mason::Exception::System 1.1
HTML::Mason::Exception::TopLevelNotFound 1.1
HTML::Mason::Exception::VirtualMethod 1.1
HTML::Mason::Exceptions 1.43
/usr/local/lib/perl5/site_perl/5.8.9/HTML/Mason/Exceptions.pm
HTML::Mason::PSGIHandler 0.52
/usr/local/lib/perl5/site_perl/5.8.9/HTML/Mason/PSGIHandler.pm
HTML::Mason::PSGIHandler::Streamy 0.52
/usr/local/lib/perl5/site_perl/5.8.9/HTML/Mason/PSGIHandler/Streamy.pm
HTML::Mason::Request::PSGI 0.52
HTML::Parser 3.68 /usr/local/lib/perl5/site_perl/5.8.9/mach/HTML/Parser.pm
HTML::Scrubber 0.08 /usr/local/lib/perl5/site_perl/5.8.9/HTML/Scrubber.pm
HTML::Tagset 3.20 /usr/local/lib/perl5/site_perl/5.8.9/HTML/Tagset.pm
HTML::TreeBuilder 4.1 /usr/local/lib/perl5/site_perl/5.8.9/HTML/TreeBuilder.pm
HTTP::Body 1.11 /usr/local/lib/perl5/site_perl/5.8.9/HTTP/Body.pm
HTTP::Body::MultiPart 1.11
/usr/local/lib/perl5/site_perl/5.8.9/HTTP/Body/MultiPart.pm
HTTP::Body::OctetStream 1.11
/usr/local/lib/perl5/site_perl/5.8.9/HTTP/Body/OctetStream.pm
HTTP::Body::UrlEncoded 1.11
/usr/local/lib/perl5/site_perl/5.8.9/HTTP/Body/UrlEncoded.pm
HTTP::Body::XForms 1.11
/usr/local/lib/perl5/site_perl/5.8.9/HTTP/Body/XForms.pm
HTTP::Body::XFormsMultipart 1.11
/usr/local/lib/perl5/site_perl/5.8.9/HTTP/Body/XFormsMultipart.pm
HTTP::Date 5.831 /usr/local/lib/perl5/site_perl/5.8.9/HTTP/Date.pm
HTTP::Headers 5.835 /usr/local/lib/perl5/site_perl/5.8.9/HTTP/Headers.pm
HTTP::Message 5.837 /usr/local/lib/perl5/site_perl/5.8.9/HTTP/Message.pm
HTTP::Response 5.836 /usr/local/lib/perl5/site_perl/5.8.9/HTTP/Response.pm
HTTP::Status 5.817 /usr/local/lib/perl5/site_perl/5.8.9/HTTP/Status.pm
I18N::LangTags 0.35 /usr/local/lib/perl5/5.8.9/I18N/LangTags.pm
I18N::LangTags::Detect 1.03 /usr/local/lib/perl5/5.8.9/I18N/LangTags/Detect.pm
integer 1.00 /usr/local/lib/perl5/5.8.9/integer.pm IO 1.23
/usr/local/lib/perl5/5.8.9/mach/IO.pm
IO::File 1.14 /usr/local/lib/perl5/5.8.9/mach/IO/File.pm IO::Handle
1.27 /usr/local/lib/perl5/5.8.9/mach/IO/Handle.pm
IO::InnerFile 2.110 /usr/local/lib/perl5/site_perl/5.8.9/IO/InnerFile.pm
IO::Lines 2.110 /usr/local/lib/perl5/site_perl/5.8.9/IO/Lines.pm
IO::ScalarArray 2.110 /usr/local/lib/perl5/site_perl/5.8.9/IO/ScalarArray.pm
IO::Seekable 1.1 /usr/local/lib/perl5/5.8.9/mach/IO/Seekable.pm
IO::WrapTie 2.110 /usr/local/lib/perl5/site_perl/5.8.9/IO/WrapTie.pm
IPC::Open2 1.03 /usr/local/lib/perl5/5.8.9/IPC/Open2.pm IPC::Open3
1.03 /usr/local/lib/perl5/5.8.9/IPC/Open3.pm
IPC::Run 0.89 /usr/local/lib/perl5/site_perl/5.8.9/IPC/Run.pm
IPC::Run::Debug 0.89 /usr/local/lib/perl5/site_perl/5.8.9/IPC/Run/Debug.pm
IPC::Run::IO 0.89 /usr/local/lib/perl5/site_perl/5.8.9/IPC/Run/IO.pm
IPC::Run::Timer 0.89 /usr/local/lib/perl5/site_perl/5.8.9/IPC/Run/Timer.pm
JavaScript::Minifier 1.05
/usr/local/lib/perl5/site_perl/5.8.9/JavaScript/Minifier.pm
List::MoreUtils 0.26
/usr/local/lib/perl5/site_perl/5.8.9/mach/List/MoreUtils.pm
List::Util 1.23 /usr/local/lib/perl5/5.8.9/mach/List/Util.pm
Locale::Maketext 1.13 /usr/local/lib/perl5/5.8.9/Locale/Maketext.pm
Locale::Maketext::Fuzzy 0.10
/usr/local/lib/perl5/site_perl/5.8.9/Locale/Maketext/Fuzzy.pm
Locale::Maketext::Guts 1.13 /usr/local/lib/perl5/5.8.9/Locale/Maketext/Guts.pm
Locale::Maketext::GutsLoader 1.13
/usr/local/lib/perl5/5.8.9/Locale/Maketext/GutsLoader.pm
Locale::Maketext::Lexicon 0.82
/usr/local/lib/perl5/site_perl/5.8.9/Locale/Maketext/Lexicon.pm
Locale::Maketext::Lexicon::Gettext 0.17
/usr/local/lib/perl5/site_perl/5.8.9/Locale/Maketext/Lexicon/Gettext.pm
Log::Any 0.11 /usr/local/lib/perl5/site_perl/5.8.9/Log/Any.pm
Log::Dispatch 2.26 /usr/local/lib/perl5/site_perl/5.8.9/Log/Dispatch.pm
Log::Dispatch::Base 2.27
/usr/local/lib/perl5/site_perl/5.8.9/Log/Dispatch/Base.pm
Log::Dispatch::Output 2.27
/usr/local/lib/perl5/site_perl/5.8.9/Log/Dispatch/Output.pm
Log::Dispatch::Screen 2.27
/usr/local/lib/perl5/site_perl/5.8.9/Log/Dispatch/Screen.pm
Log::Dispatch::Syslog 2.27
/usr/local/lib/perl5/site_perl/5.8.9/Log/Dispatch/Syslog.pm
Mail::Address 2.07 /usr/local/lib/perl5/site_perl/5.8.9/Mail/Address.pm
Mail::Field 2.07 /usr/local/lib/perl5/site_perl/5.8.9/Mail/Field.pm
Mail::Field::AddrList 2.07
/usr/local/lib/perl5/site_perl/5.8.9/Mail/Field/AddrList.pm
Mail::Field::Date 2.07 /usr/local/lib/perl5/site_perl/5.8.9/Mail/Field/Date.pm
Mail::Field::Generic 2.07
/usr/local/lib/perl5/site_perl/5.8.9/Mail/Field/Generic.pm
Mail::Header 2.07 /usr/local/lib/perl5/site_perl/5.8.9/Mail/Header.pm
Mail::Internet 2.07 /usr/local/lib/perl5/site_perl/5.8.9/Mail/Internet.pm
Mail::Mailer 2.07 /usr/local/lib/perl5/site_perl/5.8.9/Mail/Mailer.pm
Mail::Util 2.07 /usr/local/lib/perl5/site_perl/5.8.9/Mail/Util.pm
MasonX::Profiler 0.06 /usr/local/lib/perl5/site_perl/5.8.9/MasonX/Profiler.pm
MIME::Base64 3.13 /usr/local/lib/perl5/5.8.9/mach/MIME/Base64.pm
MIME::Body 5.428 /usr/local/lib/perl5/site_perl/5.8.9/MIME/Body.pm
MIME::Decoder 5.428 /usr/local/lib/perl5/site_perl/5.8.9/MIME/Decoder.pm
MIME::Entity 5.428 /usr/local/lib/perl5/site_perl/5.8.9/MIME/Entity.pm
MIME::Field::ContDisp 5.428
/usr/local/lib/perl5/site_perl/5.8.9/MIME/Field/ContDisp.pm
MIME::Field::ConTraEnc 5.428
/usr/local/lib/perl5/site_perl/5.8.9/MIME/Field/ConTraEnc.pm
MIME::Field::ContType 5.428
/usr/local/lib/perl5/site_perl/5.8.9/MIME/Field/ContType.pm
MIME::Field::ParamVal 5.428
/usr/local/lib/perl5/site_perl/5.8.9/MIME/Field/ParamVal.pm
MIME::Head 5.428 /usr/local/lib/perl5/site_perl/5.8.9/MIME/Head.pm
MIME::Parser 5.428 /usr/local/lib/perl5/site_perl/5.8.9/MIME/Parser.pm
MIME::QuotedPrint 3.13 /usr/local/lib/perl5/5.8.9/mach/MIME/QuotedPrint.pm
MIME::Tools 5.428 /usr/local/lib/perl5/site_perl/5.8.9/MIME/Tools.pm
MIME::Words 5.428 /usr/local/lib/perl5/site_perl/5.8.9/MIME/Words.pm
mod_perl 2.000004 /usr/local/lib/perl5/site_perl/5.8.9/mach/mod_perl2.pm
mod_perl2 2.000004 /usr/local/lib/perl5/site_perl/5.8.9/mach/mod_perl2.pm
ModPerl::Const 2.000004
/usr/local/lib/perl5/site_perl/5.8.9/mach/ModPerl/Const.pm
Module::Versions::Report 1.06
/usr/local/lib/perl5/site_perl/5.8.9/Module/Versions/Report.pm
Net::CIDR 0.14 /usr/local/lib/perl5/site_perl/5.8.9/Net/CIDR.pm overload 1.06
/usr/local/lib/perl5/5.8.9/overload.pm Params::Util 1.03
/usr/local/lib/perl5/site_perl/5.8.9/mach/Params/Util.pm
Params::Validate 0.95
/usr/local/lib/perl5/site_perl/5.8.9/mach/Params/Validate.pm
parent 0.224 /usr/local/lib/perl5/site_perl/5.8.9/parent.pm PerlIO
1.05 /usr/local/lib/perl5/5.8.9/PerlIO.pm
PerlIO::scalar 0.06 /usr/local/lib/perl5/5.8.9/mach/PerlIO/scalar.pm
Plack::Request 0.9951 /usr/local/lib/perl5/site_perl/5.8.9/Plack/Request.pm
POSIX 1.15 /usr/local/lib/perl5/5.8.9/mach/POSIX.pm re 0.0601
/usr/local/lib/perl5/5.8.9/mach/
re.pm Regexp::Common 2010010201
/usr/local/lib/perl5/site_perl/5.8.9/Regexp/Common.pm
Regexp::Common::support 2010010201
/usr/local/lib/perl5/site_perl/5.8.9/Regexp/Common/

support.pm Regexp::Common::balanced 2010010201
/usr/local/lib/perl5/site_perl/5.8.9/Regexp/Common/
balanced.pm Regexp::Common::CC 2010010201
/usr/local/lib/perl5/site_perl/5.8.9/Regexp/Common/CC.pm
Regexp::Common::comment 2010010201
/usr/local/lib/perl5/site_perl/5.8.9/Regexp/Common/
comment.pm Regexp::Common::delimited 2010010201
/usr/local/lib/perl5/site_perl/5.8.9/Regexp/Common/
delimited.pm Regexp::Common::lingua 2010010201
/usr/local/lib/perl5/site_perl/5.8.9/Regexp/Common/
lingua.pm Regexp::Common::list 2010010201
/usr/local/lib/perl5/site_perl/5.8.9/Regexp/Common/
list.pm Regexp::Common::net 2010010201
/usr/local/lib/perl5/site_perl/5.8.9/Regexp/Common/
net.pm Regexp::Common::net::CIDR 0.02
/usr/local/lib/perl5/site_perl/5.8.9/Regexp/Common/net/CIDR.pm
Regexp::Common::number 2010010201
/usr/local/lib/perl5/site_perl/5.8.9/Regexp/Common/
number.pm Regexp::Common::profanity 2010010201
/usr/local/lib/perl5/site_perl/5.8.9/Regexp/Common/
profanity.pm Regexp::Common::SEN 2010010201
/usr/local/lib/perl5/site_perl/5.8.9/Regexp/Common/SEN.pm
Regexp::Common::URI 2010010201
/usr/local/lib/perl5/site_perl/5.8.9/Regexp/Common/URI.pm
Regexp::Common::URI::fax 2010010201
/usr/local/lib/perl5/site_perl/5.8.9/Regexp/Common/URI/
fax.pm Regexp::Common::URI::file 2010010201
/usr/local/lib/perl5/site_perl/5.8.9/Regexp/Common/URI/
file.pm Regexp::Common::URI::ftp 2010010201
/usr/local/lib/perl5/site_perl/5.8.9/Regexp/Common/URI/
ftp.pm Regexp::Common::URI::gopher 2010010201
/usr/local/lib/perl5/site_perl/5.8.9/Regexp/Common/URI/
gopher.pm Regexp::Common::URI::http 2010010201
/usr/local/lib/perl5/site_perl/5.8.9/Regexp/Common/URI/
http.pm Regexp::Common::URI::news 2010010201
/usr/local/lib/perl5/site_perl/5.8.9/Regexp/Common/URI/
news.pm Regexp::Common::URI::pop 2010010201
/usr/local/lib/perl5/site_perl/5.8.9/Regexp/Common/URI/
pop.pm Regexp::Common::URI::prospero 2010010201
/usr/local/lib/perl5/site_perl/5.8.9/Regexp/Common/URI/
prospero.pm Regexp::Common::URI::RFC1035 2010010201
/usr/local/lib/perl5/site_perl/5.8.9/Regexp/Common/URI/RFC1035.pm
Regexp::Common::URI::RFC1738 2010010201
/usr/local/lib/perl5/site_perl/5.8.9/Regexp/Common/URI/RFC1738.pm
Regexp::Common::URI::RFC1808 2010010201
/usr/local/lib/perl5/site_perl/5.8.9/Regexp/Common/URI/RFC1808.pm
Regexp::Common::URI::RFC2384 2010010201
/usr/local/lib/perl5/site_perl/5.8.9/Regexp/Common/URI/RFC2384.pm
Regexp::Common::URI::RFC2396 2010010201
/usr/local/lib/perl5/site_perl/5.8.9/Regexp/Common/URI/RFC2396.pm
Regexp::Common::URI::RFC2806 2010010201
/usr/local/lib/perl5/site_perl/5.8.9/Regexp/Common/URI/RFC2806.pm
Regexp::Common::URI::tel 2010010201
/usr/local/lib/perl5/site_perl/5.8.9/Regexp/Common/URI/
tel.pm Regexp::Common::URI::telnet 2010010201
/usr/local/lib/perl5/site_perl/5.8.9/Regexp/Common/URI/
telnet.pm Regexp::Common::URI::tv 2010010201
/usr/local/lib/perl5/site_perl/5.8.9/Regexp/Common/URI/
tv.pm Regexp::Common::URI::wais 2010010201
/usr/local/lib/perl5/site_perl/5.8.9/Regexp/Common/URI/
wais.pm Regexp::Common::whitespace 2010010201
/usr/local/lib/perl5/site_perl/5.8.9/Regexp/Common/
whitespace.pm Regexp::Common::zip 2010010201
/usr/local/lib/perl5/site_perl/5.8.9/Regexp/Common/
zip.pm Regexp::IPv6 0.03 /usr/local/lib/perl5/site_perl/5.8.9/Regexp/IPv6.pm
RT 4.0.0rc2 /opt/rt4/sbin/…/lib/RT.pm RT::Interface::Email 2
/opt/rt4/sbin/…/lib/RT/Interface/Email.pm
RT::Interface::Web::Request 0.30
/opt/rt4/sbin/…/lib/RT/Interface/Web/Request.pm
Scalar::Util 1.23 /usr/local/lib/perl5/5.8.9/mach/Scalar/Util.pm
SelectSaver 1.01 /usr/local/lib/perl5/5.8.9/SelectSaver.pm Socket
1.81 /usr/local/lib/perl5/5.8.9/mach/Socket.pm
Storable 2.21 /usr/local/lib/perl5/site_perl/5.8.9/mach/Storable.pm
strict 1.03
/usr/local/lib/perl5/5.8.9/strict.pm Sub::Exporter 0.982
/usr/local/lib/perl5/site_perl/5.8.9/Sub/Exporter.pm
Sub::Install 0.925 /usr/local/lib/perl5/site_perl/5.8.9/Sub/Install.pm
Symbol 1.06 /usr/local/lib/perl5/5.8.9/Symbol.pm Sys::Syslog 0.27
/usr/local/lib/perl5/5.8.9/mach/Sys/Syslog.pm
Text::Password::Pronounceable 0.30
/usr/local/lib/perl5/site_perl/5.8.9/Text/Password/Pronounceable.pm
Text::Template 1.45 /usr/local/lib/perl5/site_perl/5.8.9/Text/Template.pm
Text::Wrapper 1.02 /usr/local/lib/perl5/site_perl/5.8.9/Text/Wrapper.pm
Tie::Hash 1.03 /usr/local/lib/perl5/5.8.9/Tie/Hash.pm Time::HiRes
1.9715 /usr/local/lib/perl5/5.8.9/mach/Time/HiRes.pm
Time::JulianDay 2003.1125
/usr/local/lib/perl5/site_perl/5.8.9/Time/JulianDay.pm
Time::Local 1.1901 /usr/local/lib/perl5/5.8.9/Time/Local.pm
Time::ParseDate 2006.0814
/usr/local/lib/perl5/site_perl/5.8.9/Time/ParseDate.pm
Time::Timezone 2006.0814 /usr/local/lib/perl5/site_perl/5.8.9/Time/Timezone.pm
Time::Zone 2.24 /usr/local/lib/perl5/site_perl/5.8.9/Time/Zone.pm
UNIVERSAL 1.01 /usr/local/lib/perl5/5.8.9/UNIVERSAL.pm
UNIVERSAL::require 0.13
/usr/local/lib/perl5/site_perl/5.8.9/UNIVERSAL/require.pm URI 1.56
/usr/local/lib/perl5/site_perl/5.8.9/URI.pm
URI::Escape 3.30 /usr/local/lib/perl5/site_perl/5.8.9/URI/Escape.pm
URI::file 4.20 /usr/local/lib/perl5/site_perl/5.8.9/URI/file.pm utf8
1.07 /usr/local/lib/perl5/5.8.9/
utf8.pm vars 1.01 /usr/local/lib/perl5/5.8.9/vars.pm warnings
1.05_01 /usr/local/lib/perl5/5.8.9/
warnings.pm warnings::register 1.01 /usr/local/lib/perl5/5.8.9/warnings/
register.pm XSLoader 0.10 /usr/local/lib/perl5/5.8.9/mach/XSLoader.pm
Perl configuration

Summary of my perl5 (revision 5 version 8 subversion 9) configuration:
Platform:
osname=freebsd, osvers=8.1-stable, archname=i386-freebsd-64int
uname=‘freebsd gw.domain.com 8.1-stable freebsd 8.1-stable #0: fri
oct 15 19:04:15 eat 2010 root@gw.domain.com:usrobjusrsrcsysgw i386 ‘
config_args=’-sde -Dprefix=/usr/local
-Darchlib=/usr/local/lib/perl5/5.8.9/mach
-Dprivlib=/usr/local/lib/perl5/5.8.9
-Dman3dir=/usr/local/lib/perl5/5.8.9/perl/man/man3
-Dman1dir=/usr/local/man/man1
-Dsitearch=/usr/local/lib/perl5/site_perl/5.8.9/mach
-Dsitelib=/usr/local/lib/perl5/site_perl/5.8.9
-Dscriptdir=/usr/local/bin
-Dsiteman3dir=/usr/local/lib/perl5/5.8.9/man/man3
-Dsiteman1dir=/usr/local/man/man1 -Ui_malloc -Ui_iconv
-Uinstallusrbinperl -Dcc=cc -Duseshrplib -Dinc_version_list=none
-Dccflags=-DAPPLLIB_EXP="/usr/local/lib/perl5/5.8.9/BSDPAN"
-Doptimize=-O2 -pipe -fno-strict-aliasing -Dd_dosuid=define -Ui_gdbm
-Dusethreads=n -Dusemymalloc=y -Duse64bitint’
hint=recommended, useposix=true, d_sigaction=define
usethreads=undef use5005threads=undef useithreads=undef
usemultiplicity=undef
useperlio=define d_sfio=undef uselargefiles=define usesocks=undef
use64bitint=define use64bitall=undef uselongdouble=undef
usemymalloc=y, bincompat5005=undef
Compiler:
cc=‘cc’, ccflags
=’-DAPPLLIB_EXP="/usr/local/lib/perl5/5.8.9/BSDPAN" -DHAS_FPSETMASK
-DHAS_FLOATINGPOINT_H -fno-strict-aliasing -pipe
-I/usr/local/include’,
optimize=’-O2 -pipe -fno-strict-aliasing’,
cppflags=’-DAPPLLIB_EXP="/usr/local/lib/perl5/5.8.9/BSDPAN"
-DHAS_FPSETMASK -DHAS_FLOATINGPOINT_H -fno-strict-aliasing -pipe
-I/usr/local/include’
ccversion=’’, gccversion=‘4.2.1 20070719 [FreeBSD]’, gccosandvers=’‘
intsize=4, longsize=4, ptrsize=4, doublesize=8, byteorder=12345678
d_longlong=define, longlongsize=8, d_longdbl=define, longdblsize=12
ivtype=‘long long’, ivsize=8, nvtype=‘double’, nvsize=8,
Off_t=‘off_t’, lseeksize=8
alignbytes=4, prototype=define
Linker and Libraries:
ld=‘cc’, ldflags =’ -Wl,-E -L/usr/local/lib’
libpth=/usr/lib /usr/local/lib
libs=-lgdbm -lm -lcrypt -lutil
perllibs=-lm -lcrypt -lutil
libc=, so=so, useshrplib=true, libperl=libperl.so
gnulibc_version=’‘
Dynamic Linking:
dlsrc=dl_dlopen.xs, dlext=so, d_dlsymun=undef, ccdlflags=’
-Wl,-R/usr/local/lib/perl5/5.8.9/mach/CORE’
cccdlflags=’-DPIC -fPIC’, lddlflags=’-shared -L/usr/local/lib’

Best regards,
Odhiambo WASHINGTON,
Nairobi,KE
+254733744121/+254722743223


Damn!!

After upgrading from 3.9.7 to 4.0.0rc1 and then 4.0.0rc2, I was
experiencing similar slowdown compared to 3.9.7.
I initially assumed the slow response was because I have RT currently
running on a virtual machine on a desktop, but that doesn’t explain why
3.9.7 was seemed so much more responsive on the same VM.

I grabbed the output with MasonX::Profiler enabled for both 4.0.0RC1 and
4.0.0RC2 while loading a page while this issue was occurring. I reverted my
VM to an old state with RT3.9.7 installed and tried to enable
MasonX::Profiler, but it wasn’t
producing any extra output for some reason. I’d be happy to play around
with it some more to get it working if anyone would find that information
useful.

Devel mode is off in both of these instances. No more than a couple of
tickets total in the database. A clean RT_SiteConfig file with nothing but
MasonX::Profiler enabled doesn’t seem to make any difference in page loads.
The client is Firefox.

4.0.0 RC1 Output: http://pastebin.com/xUHP07nz
4.0.0 RC2 Output: http://pastebin.com/kFxr0Cg8

I grabbed the above output before reverting back to 3.9.7. Odhiambo’s log
also shows a long time being taken to process /Elements/HeaderJavascript as
in my logs.

After playing around with RT 3.9.7 for a little bit and not getting the
extra output from MasonX::Profiler, I reverted my VM back to it’s current
state with RT 4.0.0RC2 running and for some odd reason, it’s now running
faster than 3.9.7 was without
any additional changes. At this point I’d be willing to chalk up my own
experience to a system configuration issue on my end, but if Odhiambo is
still experiencing a similar issue, it may be related.

It never occurred to me to try Chrome’s resource tracking feature while I
was experiencing the issue to see where the delays were coming from on the
client end until after it had resolved itself.

Just thought I’d throw out my experiences so far. If I can be of any
further assistance, let me know.

I am still stuck with this problem, and not sure what is my next move.

Best regards,
Odhiambo WASHINGTON,
Nairobi,KE
+254733744121/+254722743223


Damn!!

It never occurred to me to try Chrome's resource tracking feature while I was experiencing the issue to see where the delays were coming from on the client end until after it had
resolved itself.

Just thought I'd throw out my experiences so far. If I can be of any further assistance, let me know.

I am still stuck with this problem, and not sure what is my next move.

I’ve got no idea what’s wrong with your RT. Can you try the latest rc
and see if 1) it’s better and 2) what chrome’s profiling shows?

Jesse Vincent jesse@bestpractical.com writes:

I’ve got no idea what’s wrong with your RT. Can you try the latest rc
and see if 1) it’s better and 2) what chrome’s profiling shows?

I upgraded to RC3 and the issue began reoccurring. I wiped the db and did a clean install of RC4 when it was released and I’m still seeing the same performance hits that appear to be attributed to the squishing process as Ruslan first pointed out.

Mason output: http://pastebin.com/8U9J7yRQ
Chrome info: http://img811.imageshack.us/i/rt400rc4.png/

Let me know if I can be of any further assistance.

Thanks,
Evan

Jesse Vincent jesse@bestpractical.com writes:

Can you pastebin your apache config, as well as the RT “System
Information” page?

Sure thing.

apache2.conf: http://pastebin.com/zGU8Ywuw
Apache site config: http://pastebin.com/W7WNJ4zK

System config is attached.

Let me know if you need anything else.

Regards,
Evan

sysconfig.htm (165 KB)

Jesse Vincent jesse@bestpractical.com writes:

Evan,

Can you try installing jsmin and enabling it in your RT config and seeing
if it improves things?

Best,
Jesse

After compiling and enabling jsmin, it does seem to be consistantly ~3 seconds faster than it was previously, bringing it down to ~5 seconds when js/css is not cached, and around 2.5 seconds when it is.

Mason output: http://pastebin.com/XwU6L1aJ
Chrome: http://img137.imageshack.us/img137/7858/rt400rc4jsmin.png

Evan

After playing around with it a bit more, I may have overstated the speed increase. Chrome is flakey when it comes to actually clearing the cache, but on average I’m seeing a little closer to 5.5 second load times when not cached and around ~4.5
seconds when everything is cached. Still an improvement for sure, just not as big as I first thought.

In comparison, our production RT server (still running 3.8.4) has load times around 0.1 - 0.5 seconds on slightly faster hardware with many more users.

Evan Horne

After playing around with it a bit more, I may have overstated the speed increase. Chrome is flakey when it comes to actually clearing the cache, but on average I’m seeing a little closer to 5.5 second load times when not cached and around ~4.5
seconds when everything is cached. Still an improvement for sure, just not as big as I first thought.

There’s something pretty wrong looking with your numbers. Even Wash’s server seems faster to me after the first request on a given apache process.