Re: [rt-users] DB upgrade errors from 3.8.9 to 4.0.4
On 2012-01-25 16:42, Kevin Falcone wrote: Your error appears to be because your 3.8 install is being loaded along with the 4.0 install: /usr/lib/perl5/vendor_perl/5.10.1/RT/ACE_Overlay.pm line 650 (/usr/lib/perl5/vendor_perl/5.10.1/RT/ACE_Overlay.pm:553) etc etc, others trimmed. ACE_Overlay.pm is a 3.8 file, it doesn't exist in 4.0 You'll need to remove the RPM install, use another server, or use another perl to install 4.0 on this system (this is one of the many problems with installing RT into the standard system perl paths, which is the technique used by the RPMs). Also, I wouldn't trust that any part of the upgrade ran properly, since having 3.8 libraries loaded on top of the 4.0 libraries guarantees some failures. Hi Kevin, Thanks for that - I had hoped to be able to run both installations side by side on the same system, but what you say makes sense. I'll remove the RPM and re-install Thanks again, Kim RT Training Sessions (http://bestpractical.com/services/training.html) * Boston March 5 6, 2012
Re: [rt-users] DB upgrade errors from 3.8.9 to 4.0.4
On 2012-01-25 17:07, Kevin Falcone wrote: Thanks for that - I had hoped to be able to run both installations side by side on the same system, but what you say makes sense. I'll remove the RPM and re-install yeahhh, sorry about that. With two normal installs, you would be able to do what you want. The Debian packages can also be run in parallel, but the RPMs dump RT into @INC which pollutes the box for any other RT installs. You could build your own recent perl into /opt/perl and use that to install RT. No problem - it all worked like a charm. I removed the 2 RPMs (rpm -e rt rt-mailgate), cloned the rt3 database to again, and when I ran make upgrade-database it passed with flying colors. If I need to roll back I can re-install the RPMs and re-instate the configs, but hopefull that won't be necessary Kim RT Training Sessions (http://bestpractical.com/services/training.html) * Boston March 5 6, 2012
Re: [rt-users] webmux.pl - Insecure dependency in chdir while running with -T switch
LOL - that figures :-) Yes, the path and permissions is alright - I can switch to the Apache user and all the perl modules in /usr/lib/perl5/5.10.1/File are 444, with the path directories being 755 It's Line 250 in /usr/lib/perl5/5.10.1/File/Path.pm that throws off webmux.pl. Could it be some sort of RT/Webmux compatibility issue /bug with Mandriva Perl 5.10.1? - Again the live installation is running with the same version of Perl, and I've compared the Path.pm webmux.pl files between systems and they are identical --- /usr/lib/perl5/5.10.1/File/Path.pm --- if ( -d _ ) { $root = VMS::Filespec::pathify($root) if $Is_VMS; Line 250if (!chdir($root)) { # see if we can escalate privileges to get in # (e.g. funny protection mask such as -w- instead of rwx) $perm = 0; my $nperm = $perm | 0700; if (!($arg-{safe} or $nperm == $perm or chmod($nperm, $root))) { _error($arg, cannot make child directory read-write-exec, $canon); next ROOT_DIR; } elsif (!chdir($root)) { _error($arg, cannot chdir to child, $canon); next ROOT_DIR; } } --- Kim P On 2011-01-18 08:25, Schincke, Keith D. (JSC-IT)[DB Consulting Group, Inc.] wrote: My typo. It should have been perl module. Is the path to/usr/lib/perl5/5.10.1/File/Path.pm readable by the apache user? Each of the directories should be 755 with the perl module being 644. I sometimes get DAG modules installing with a 750 and 640 respectively. Everything passes as root but fails as a user. Keith From: rt-users-boun...@lists.bestpractical.com [rt-users-boun...@lists.bestpractical.com] On Behalf Of Kim Pedersen [li...@kimp.org] Sent: Tuesday, January 18, 2011 12:48 AM Cc: rt-users@lists.bestpractical.com Subject: Re: [rt-users] webmux.pl - Insecure dependency in chdir while running with -T switch Hi Keith, I am not sure I understand 100% what permissions to the perl mode means. But the line calling File::Path in /usr/sbin/webmux.pl refers to $RT::MasonDataDir, which points to /var/cache/rt/mason_data/. The content and permissions of that folder is the following: drwxrwx--- 5 apache apache 38 2011-01-18 01:06 ./ drwxr-xr-x 4 root root 42 2011-01-18 01:06 ../ drwxrwx--- 2 apache apache 6 2011-01-18 01:06 cache/ drwxrwx--- 2 apache apache 6 2011-01-18 01:06 etc/ drwxrwx--- 3 apache apache 50 2011-01-18 01:06 obj/ The obj dir has session related files in it (That are recreated by apache if I empty the folders) all created by apache, and apache also has the permissions to delete the files It looks like webmux.pl is trying to clean out the /var/cache/rt/mason_data/obj folder and failing for some reason, with Insecure dependency in mkdir while running with -T switch at /usr/lib/perl5/5.10.1/File/Path.pm line 108, line 2. if ( $ENV{'MOD_PERL'} !RT-Config-Get('DevelMode')) { # Under static_source, we need to purge the component cache # each time we restart, so newer components may be reloaded. # # We can't do this in FastCGI or we'll blow away the component # root _every_ time a new server starts which happens every few # hits. require File::Path; require File::Glob; my @files = File::Glob::bsd_glob($RT::MasonDataDir/obj/*); File::Path::rmtree([ @files ], 0, 1) if @files; } 1; Kim P On 2011-01-18 02:32, Schincke, Keith D. (JSC-IT)[DB Consulting Group, Inc.] wrote: What are the directory permissions to the perl mode? One of the directories or the Path.pm file may not allow the web process to access the file. Keith Sent from my Verizon Wireless Phone - Reply message - From: Kim Pedersenli...@kimp.orgmailto:li...@kimp.org Date: Mon, Jan 17, 2011 11:28 pm Subject: [rt-users] webmux.pl - Insecure dependency in chdir while running with -T switch To: rt-users@lists.bestpractical.commailto:rt-users@lists.bestpractical.com rt-users@lists.bestpractical.commailto:rt-users@lists.bestpractical.com Hi everyone,. I am installing a cloned copy of our live 3.8.8 RT installation (To test a restoration/reinstallation and later to play with the 3.9.4 release). The new server is running Apache 2.2.15 with mod_perl 2.0.4 on Mandriva 2010.1 x64, with Postgresql 9.0 - which is the same as the live server. And the RT version is installed from RPM (built from a modified Mandriva .spec file, updated to work with 3.8.8) After installing RT I can't start Apache any longer and I am stuck with the following problem in my apache log: [error] Insecure dependency in chdir while running with -T switch at /usr/lib/perl5/5.10.1/File/Path.pm line 250.\nCompilation failed in require at (eval 2) line 1.\n [error] Can't load Perl file: /usr/sbin/webmux.pl for server
Re: [rt-users] webmux.pl - Insecure dependency in chdir while running with -T switch
Hi Josh, Thanks for your input - I've just about come to the same point as well, but don't know how to fix either :-/ Kim When the taint mode (-T) is in effect, the . directory is removed from @INC, and the environment variables PERL5LIB and PERLLIB are ignored by Perl. You can still adjust @INC from outside the program by using the -I command line option as explained in perlrun. The two environment variables are ignored because they are obscured, and a user running a program could be unaware that they are set, whereas the -I option is clearly visible and therefore permitted. Another way to modify @INC without modifying the program, is to use the lib pragma, e.g.: perl -Mlib=/foo program The benefit of using -Mlib=/foo over -I/foo, is that the former will automagically remove any duplicated directories, while the later will not. Note that if a tainted string is added to @INC, the following problem will be reported: Insecure dependency in require while running with -T switch ESC[1mCleaning Up Your PathESC[0m For Insecure $ENV{PATH} messages, you need to set $ENV{'PATH'} to a known value, and each directory in the path must be absolute and non- writable by others than its owner and group. You may be surprised to get this message even if the pathname to your executable is fully qualified. This is ESC[4mnotESC[24m generated because you didn't supply a full path to the program; instead, it's generated because you never set your PATH environment variable, or you didn't set it to something that was safe. Because Perl can't guarantee that the executable in question isn't itself going to turn around and execute some other program that is dependent on your PATH, it makes sure you set the PATH. On 2011-01-18 09:47, Josh Narins wrote: From what I understand of Taint (-T) mode, this has nothing to do with directory permissions, and everything to do with trying to chdir to a variable (representing a directory) that has been marked as being unsafe, i.e. from user input. See perldoc perldiag to find the error message, which then leads you to perldoc perlsec for more about taint mode. That said, I don't know, inside RT, the appropriate way to deal with this. Josh Narins Director of Application Development SeniorBridge 845 Third Ave 7th Floor New York, NY 10022 Tel: (212) 994-6194 Mobile: (917) 488-6248 Fax: (212) 994-4260 jnar...@seniorbridge.com SeniorBridge Managing Complex Chronic Care http://www.seniorbridge.com SeniorBridge Statement of Confidentiality: The contents of this email message are intended for the exclusive use of the addressee(s) and may contain confidential or privileged information. Any dissemination, distribution or copying of this email by an unintended or mistaken recipient is strictly prohibited. In said event, kindly reply to the sender and destroy all entries of this message and any attachments from your system. Thank you.-Original Message- Fr
Re: [rt-users] webmux.pl - Insecure dependency in chdir while running with -T switch
Hi Alex, Thank you for that clarification. I went grepping for the PerlTaintCheck line in the config files, and it is nowhere to be found. I did find then -T option to perl under Mandriva's mod_perl config file, but it was already set to not be enabled. This is obviously distribution specific - I am not sure if a default has changed somewhere or what. I moved the RT installation to another server (Supposedly identical as well), and things are working fine there. Thank you for your input everyone, I'll leave it at that. Regards, Kim P On 2011-01-18 04:35, Alex Vandiver wrote: On Tue, 2011-01-18 at 01:27 -0400, Kim Pedersen wrote: [error] Insecure dependency in chdir while running with -T switch at /usr/lib/perl5/5.10.1/File/Path.pm line 250.\nCompilation failed in require at (eval 2) line 1.\n We don't support running RT under taint mode. Remove the PerlTaintCheck line from your mod_perl configuration. - Alex
[rt-users] webmux.pl - Insecure dependency in chdir while running with -T switch
Hi everyone,. I am installing a cloned copy of our live 3.8.8 RT installation (To test a restoration/reinstallation and later to play with the 3.9.4 release). The new server is running Apache 2.2.15 with mod_perl 2.0.4 on Mandriva 2010.1 x64, with Postgresql 9.0 - which is the same as the live server. And the RT version is installed from RPM (built from a modified Mandriva .spec file, updated to work with 3.8.8) After installing RT I can't start Apache any longer and I am stuck with the following problem in my apache log: [error] Insecure dependency in chdir while running with -T switch at /usr/lib/perl5/5.10.1/File/Path.pm line 250.\nCompilation failed in require at (eval 2) line 1.\n [error] Can't load Perl file: /usr/sbin/webmux.pl for server www.testserver.com:0, exiting... If I run webmux.pl manually as root, there are no Perl errors. A make testdeps from the RT sources show all dependencies being okay as well. The RT config files are the same as on the live server - File::Path is called at the end of webmux.pl, but I am just lost for what to look for / how to troubleshoot this. Any hints / pointers? Regards Kim P
Re: [rt-users] webmux.pl - Insecure dependency in chdir while running with -T switch
Hi Keith, I am not sure I understand 100% what permissions to the "perl mode" means. But the line calling File::Path in /usr/sbin/webmux.pl refers to "$RT::MasonDataDir", which points to /var/cache/rt/mason_data/. The content and permissions of that folder is the following: drwxrwx--- 5 apache apache 38 2011-01-18 01:06 ./ drwxr-xr-x 4 root root 42 2011-01-18 01:06 ../ drwxrwx--- 2 apache apache 6 2011-01-18 01:06 cache/ drwxrwx--- 2 apache apache 6 2011-01-18 01:06 etc/ drwxrwx--- 3 apache apache 50 2011-01-18 01:06 obj/ The "obj" dir has session related files in it (That are recreated by apache if I empty the folders) all created by apache, and apache also has the permissions to delete the files It looks like webmux.pl is trying to clean out the /var/cache/rt/mason_data/obj folder and failing for some reason, with "Insecure dependency in mkdir while running with -T switch at /usr/lib/perl5/5.10.1/File/Path.pm line 108, line 2. " if ( $ENV{'MOD_PERL'} !RT-Config-Get('DevelMode')) { # Under static_source, we need to purge the component cache # each time we restart, so newer components may be reloaded. # # We can't do this in FastCGI or we'll blow away the component # root _every_ time a new server starts which happens every few # hits. require File::Path; require File::Glob; my @files = File::Glob::bsd_glob("$RT::MasonDataDir/obj/*"); File::Path::rmtree([ @files ], 0, 1) if @files; } 1; Kim P On 2011-01-18 02:32, Schincke, Keith D. (JSC-IT)[DB Consulting Group, Inc.] wrote: What are the directory permissions to the perl mode? One of the directories or the Path.pm file may not allow the web process to access the file. Keith Sent from my Verizon Wireless Phone ----- Reply message - From: "Kim Pedersen" li...@kimp.org Date: Mon, Jan 17, 2011 11:28 pm Subject: [rt-users] webmux.pl - Insecure dependency in chdir while running with -T switch To: "rt-users@lists.bestpractical.com" rt-users@lists.bestpractical.com Hi everyone,. I am installing a cloned copy of our live 3.8.8 RT installation (To test a restoration/reinstallation and later to play with the 3.9.4 release). The new server is running Apache 2.2.15 with mod_perl 2.0.4 on Mandriva 2010.1 x64, with Postgresql 9.0 - which is the same as the live server. And the RT version is installed from RPM (built from a modified Mandriva .spec file, updated to work with 3.8.8) After installing RT I can't start Apache any longer and I am stuck with the following problem in my apache log: [error] Insecure dependency in chdir while running with -T switch at /usr/lib/perl5/5.10.1/File/Path.pm line 250.\nCompilation failed in require at (eval 2) line 1.\n [error] Can't load Perl file: /usr/sbin/webmux.pl for server www.testserver.com:0, exiting... If I run webmux.pl manually as root, there are no Perl errors. A "make testdeps" from the RT sources show all dependencies being okay as well. The RT config files are the same as on the live server - File::Path is called at the end of webmux.pl, but I am just lost for what to look for / how to troubleshoot this. Any hints / pointers? Regards Kim P
Re: [rt-users] Slow Ticket History 3.8.8
Hi Justin, Our RT instance is much smaller than yours, but we had very similar problems. Optimizing MySQL using the output from the tuner script made nearly all the speed issues go away. The one remaining issue we had with slow queries was resolved after the upgrade to 3.8.8 Your key buffer size looks like overkill - probably want to reduce that, and you have many joins done without indexes - that's a performance killer. Your InnoDB memory allocation looks like it needs to be increasing. Overall I'd say your database performance is skewed towards ISAM performance and not InnoDB (Which is what RT3 uses by default) Kim On 2010-06-29 10:53, Justin Hayes wrote: Seem to be quite a few things to look at Jason. Need to figure out what they all mean first. Justin General Statistics -- [--] Skipped version check for MySQLTuner script [OK] Currently running supported MySQL version 5.1.37-1ubuntu5.4-log [OK] Operating on 64-bit architecture Storage Engine Statistics --- [--] Status: -Archive -BDB -Federated +InnoDB -ISAM -NDBCluster [--] Data in MyISAM tables: 611M (Tables: 8) [--] Data in InnoDB tables: 10G (Tables: 20) [!!] Total fragmented tables: 21 Performance Metrics - [--] Up for: 19d 19h 32m 37s (110M q [64.266 qps], 222K conn, TX: 637B, RX: 39B) [--] Reads / Writes: 98% / 2% [--] Total buffers: 602.0M global + 134.8M per thread (150 max threads) [!!] Maximum possible memory usage: 20.3G (262% of installed RAM) [OK] Slow queries: 0% (229K/110M) [!!] Highest connection usage: 100% (151/150) [OK] Key buffer size / total MyISAM indexes: 512.0M/6.7M [OK] Key buffer hit rate: 100.0% (84M cached / 7K reads) [OK] Query cache efficiency: 71.4% (76M cached / 107M selects) [!!] Query cache prunes per day: 661360 [OK] Sorts requiring temporary tables: 0% (0 temp sorts / 2M sorts) [!!] Joins performed without indexes: 112714 [!!] Temporary tables created on disk: 33% (968K on disk / 2M total) [OK] Thread cache hit rate: 99% (1K created / 222K connections) [OK] Table cache hit rate: 36% (318 open / 880 opened) [OK] Open file limit used: 14% (166/1K) [OK] Table locks acquired immediately: 99% (39M immediate / 39M locks) [!!] InnoDB data size / buffer pool: 10.1G/8.0M Recommendations - General recommendations: Run OPTIMIZE TABLE to defragment tables for better performance Reduce your overall MySQL memory footprint for system stability Reduce or eliminate persistent connections to reduce connection usage Adjust your join queries to always utilize indexes When making adjustments, make tmp_table_size/max_heap_table_size equal Reduce your SELECT DISTINCT queries without LIMIT clauses Variables to adjust: *** MySQL's maximum memory usage is dangerously high *** *** Add RAM before increasing MySQL buffer variables *** max_connections ( 150) wait_timeout ( 28800) interactive_timeout ( 28800) query_cache_size ( 16M) join_buffer_size ( 2.0M, or always use indexes with joins) tmp_table_size ( 128M) max_heap_table_size ( 64M) innodb_buffer_pool_size (= 10G) Discover RT's hidden secrets with RT Essentials from O'Reilly Media. Buy a copy at http://rtbook.bestpractical.com
Re: [rt-users] RT as a intranet portal? Or other suggestions?
I've been happy with TWiki for our internal needs. A wiki-notion of edit-in-place is more suitable for our documentation than RT's notion of serial appends to a thread (ticket). I've also been interested in Trac, but that uses its own built-in wiki and ticketing system. I like the integration Trac provides, but I don't want a second ticketing system or a second wiki. FWIW, it probably would not be too hard to make a twiki plugin that interacted with RT via the REST interface. And probably the reverse, if you wanted some RT interface to twiki (e.g. to use wiki pages instead of RTFM articles). We use Twiki and RT as well, but with no integration. Googling on the subject sometime last year, I did run across references to companies who have done some integration of RT into Twiki, using Mason - but I've been unable to find any concrete information, and it isn't a high enough priority / we don't have the resources at my work place for it. Regards, Kim ___ http://lists.bestpractical.com/cgi-bin/mailman/listinfo/rt-users Community help: http://wiki.bestpractical.com Commercial support: [EMAIL PROTECTED] Discover RT's hidden secrets with RT Essentials from O'Reilly Media. Buy a copy at http://rtbook.bestpractical.com