Re: [rt-users] DB upgrade errors from 3.8.9 to 4.0.4

2012-01-25 Thread Kim Pedersen

On 2012-01-25 16:42, Kevin Falcone wrote:
Your error appears to be because your 3.8 install is being loaded 
along with the 4.0 install:

/usr/lib/perl5/vendor_perl/5.10.1/RT/ACE_Overlay.pm line 650
(/usr/lib/perl5/vendor_perl/5.10.1/RT/ACE_Overlay.pm:553)

etc etc, others trimmed.

ACE_Overlay.pm is a 3.8 file, it doesn't exist in 4.0

You'll need to remove the RPM install, use another server, or use
another perl to install 4.0 on this system (this is one of the many
problems with installing RT into the standard system perl paths, which
is the technique used by the RPMs).

Also, I wouldn't trust that any part of the upgrade ran properly,
since having 3.8 libraries loaded on top of the 4.0 libraries
guarantees some failures.



Hi Kevin,

Thanks for that - I had hoped to be able to run both installations side 
by side on the same system, but what you say makes sense.


I'll remove the RPM and re-install


Thanks again,

Kim


RT Training Sessions (http://bestpractical.com/services/training.html)
* Boston  March 5  6, 2012


Re: [rt-users] DB upgrade errors from 3.8.9 to 4.0.4

2012-01-25 Thread Kim Pedersen

On 2012-01-25 17:07, Kevin Falcone wrote:

Thanks for that - I had hoped to be able to run both installations
side by side on the same system, but what you say makes sense.

I'll remove the RPM and re-install
yeahhh, sorry about that.  With two normal installs, you would be able
to do what you want.  The Debian packages can also be run in parallel,
but the RPMs dump RT into @INC which pollutes the box for any other RT
installs.

You could build your own recent perl into /opt/perl and use that to
install RT.


No problem - it all worked like a charm.

I removed the 2 RPMs (rpm -e rt rt-mailgate), cloned the rt3 database to 
again, and when I ran make upgrade-database it passed with flying colors.


If I need to roll back I can re-install the RPMs and re-instate the 
configs, but hopefull that won't be necessary



Kim




RT Training Sessions (http://bestpractical.com/services/training.html)
* Boston  March 5  6, 2012


Re: [rt-users] webmux.pl - Insecure dependency in chdir while running with -T switch

2011-01-18 Thread Kim Pedersen


LOL - that figures :-)

Yes, the path and permissions is alright - I can switch to the Apache 
user and all the perl modules in /usr/lib/perl5/5.10.1/File are 444, 
with the path directories being 755


It's Line 250 in /usr/lib/perl5/5.10.1/File/Path.pm that throws off 
webmux.pl. Could it be some sort of RT/Webmux compatibility issue /bug 
with Mandriva Perl 5.10.1?
 - Again the live installation is running with the same version of 
Perl, and I've compared the Path.pm  webmux.pl files between systems 
and they are identical


--- /usr/lib/perl5/5.10.1/File/Path.pm ---
if ( -d _ ) {
$root = VMS::Filespec::pathify($root) if $Is_VMS;

Line 250if (!chdir($root)) {
# see if we can escalate privileges to get in
# (e.g. funny protection mask such as -w- instead of rwx)
$perm = 0;
my $nperm = $perm | 0700;
if (!($arg-{safe} or $nperm == $perm or chmod($nperm, 
$root))) {
_error($arg, cannot make child directory 
read-write-exec, $canon);

next ROOT_DIR;
}
elsif (!chdir($root)) {
_error($arg, cannot chdir to child, $canon);
next ROOT_DIR;
}
}
---


Kim P

On 2011-01-18 08:25, Schincke, Keith D. (JSC-IT)[DB Consulting Group, 
Inc.] wrote:

My typo. It should have been perl module.

Is the path to/usr/lib/perl5/5.10.1/File/Path.pm readable by the apache user? 
Each of the directories should be 755 with the perl module being 644.

I sometimes get DAG modules installing with a 750 and 640 respectively. 
Everything passes as root but fails as a user.

Keith

From: rt-users-boun...@lists.bestpractical.com 
[rt-users-boun...@lists.bestpractical.com] On Behalf Of Kim Pedersen 
[li...@kimp.org]
Sent: Tuesday, January 18, 2011 12:48 AM
Cc: rt-users@lists.bestpractical.com
Subject: Re: [rt-users] webmux.pl - Insecure dependency in chdir while running 
with -T switch

Hi Keith,

I am not sure I understand 100% what permissions to the perl mode means.

But the line calling File::Path in /usr/sbin/webmux.pl refers to 
$RT::MasonDataDir, which points to /var/cache/rt/mason_data/.

The content and permissions of that folder is the following:

drwxrwx--- 5 apache apache 38 2011-01-18 01:06 ./
drwxr-xr-x 4 root   root   42 2011-01-18 01:06 ../
drwxrwx--- 2 apache apache  6 2011-01-18 01:06 cache/
drwxrwx--- 2 apache apache  6 2011-01-18 01:06 etc/
drwxrwx--- 3 apache apache 50 2011-01-18 01:06 obj/

The obj dir has session related files in it (That are recreated by apache if 
I empty the folders) all created by apache, and apache also has the permissions to delete 
the files


It looks like webmux.pl is trying to clean out the /var/cache/rt/mason_data/obj folder 
and failing for some reason, with Insecure dependency in mkdir while running with 
-T switch at /usr/lib/perl5/5.10.1/File/Path.pm line 108, line 2. 

if ( $ENV{'MOD_PERL'}  !RT-Config-Get('DevelMode')) {
 # Under static_source, we need to purge the component cache
 # each time we restart, so newer components may be reloaded.
 #
 # We can't do this in FastCGI or we'll blow away the component
 # root _every_ time a new server starts which happens every few
 # hits.

 require File::Path;
 require File::Glob;
 my @files = File::Glob::bsd_glob($RT::MasonDataDir/obj/*);
 File::Path::rmtree([ @files ], 0, 1) if @files;
}

1;


Kim P




On 2011-01-18 02:32, Schincke, Keith D. (JSC-IT)[DB Consulting Group, Inc.] 
wrote:
What are the directory permissions to the perl mode?
One of the directories or the Path.pm file may not allow the web process to 
access the file.

Keith


Sent from my Verizon Wireless Phone

- Reply message -
From: Kim Pedersenli...@kimp.orgmailto:li...@kimp.org
Date: Mon, Jan 17, 2011 11:28 pm
Subject: [rt-users] webmux.pl - Insecure dependency in chdir while running with 
-T switch
To: rt-users@lists.bestpractical.commailto:rt-users@lists.bestpractical.com  
rt-users@lists.bestpractical.commailto:rt-users@lists.bestpractical.com


Hi everyone,.

I am installing a cloned copy of our live 3.8.8 RT installation (To test
a restoration/reinstallation and later to play with the 3.9.4 release).

The new server is running Apache 2.2.15 with mod_perl 2.0.4 on Mandriva
2010.1 x64, with Postgresql 9.0 - which is the same as the live server.

And the RT version is installed from RPM (built from a modified Mandriva
.spec file, updated to work with 3.8.8)

After installing RT I can't start Apache any longer and I am stuck with
the following problem in my apache log:

[error] Insecure dependency in chdir while running with -T switch at
/usr/lib/perl5/5.10.1/File/Path.pm line 250.\nCompilation failed in
require at (eval 2) line 1.\n
[error] Can't load Perl file: /usr/sbin/webmux.pl for server

Re: [rt-users] webmux.pl - Insecure dependency in chdir while running with -T switch

2011-01-18 Thread Kim Pedersen


Hi Josh,

Thanks for your input - I've just about come to the same point as well, 
but don't know how to fix either :-/



Kim



   When the taint mode (-T) is in effect, the . directory is 
removed
   from @INC, and the environment variables PERL5LIB and 
PERLLIB are
   ignored by Perl. You can still adjust @INC from outside the 
program by

   using the -I command line option as explained in perlrun. The two
   environment variables are ignored because they are obscured, and 
a user
   running a program could be unaware that they are set, whereas 
the -I

   option is clearly visible and therefore permitted.

   Another way to modify @INC without modifying the program, is to 
use the

   lib pragma, e.g.:

 perl -Mlib=/foo program

   The benefit of using -Mlib=/foo over -I/foo, is that the former
   will automagically remove any duplicated directories, while the 
later

   will not.

   Note that if a tainted string is added to @INC, the following 
problem

   will be reported:

 Insecure dependency in require while running with -T switch

   ESC[1mCleaning Up Your PathESC[0m
   For Insecure $ENV{PATH} messages, you need to set $ENV{'PATH'} 
to a
   known value, and each directory in the path must be absolute and 
non-
   writable by others than its owner and group.  You may be 
surprised to

   get this message even if the pathname to your executable is fully
   qualified.  This is ESC[4mnotESC[24m generated because you 
didn't supply a full path
   to the program; instead, it's generated because you never set 
your PATH
   environment variable, or you didn't set it to something that was 
safe.

   Because Perl can't guarantee that the executable in question isn't
   itself going to turn around and execute some other program that is
   dependent on your PATH, it makes sure you set the PATH.



On 2011-01-18 09:47, Josh Narins wrote:

 From what I understand of Taint (-T) mode, this has nothing to do with 
directory permissions, and everything to do with trying to chdir to a variable 
(representing a directory) that has been marked as being unsafe, i.e. from user 
input.

See perldoc perldiag to find the error message, which then leads you to perldoc 
perlsec for more about taint mode.

That said, I don't know, inside RT, the appropriate way to deal with this.



Josh Narins
Director of Application Development
SeniorBridge
845 Third Ave
7th Floor
New York, NY 10022
Tel: (212) 994-6194
Mobile: (917) 488-6248
Fax: (212) 994-4260
jnar...@seniorbridge.com

SeniorBridge
Managing Complex Chronic Care
http://www.seniorbridge.com


SeniorBridge Statement of Confidentiality: The contents of this email message 
are intended for the exclusive use of the addressee(s) and may contain 
confidential or privileged information. Any dissemination, distribution or 
copying of this email by an unintended or mistaken recipient is strictly 
prohibited. In said event, kindly reply to the sender and destroy all entries 
of this message and any attachments from your system. Thank you.-Original 
Message-

Fr




Re: [rt-users] webmux.pl - Insecure dependency in chdir while running with -T switch

2011-01-18 Thread Kim Pedersen


Hi Alex,

Thank you for that clarification.

I went grepping for the PerlTaintCheck line in the config files, and it 
is nowhere to be found.


I did find then -T option to perl under Mandriva's mod_perl config file, 
but it was already set to not be enabled.


This is obviously distribution specific - I am not sure if a default has 
changed somewhere or what. I moved the RT installation to another server 
(Supposedly identical as well), and things are working fine there.



Thank you for your input everyone, I'll leave it at that.


Regards,

Kim P

On 2011-01-18 04:35, Alex Vandiver wrote:

On Tue, 2011-01-18 at 01:27 -0400, Kim Pedersen wrote:

[error] Insecure dependency in chdir while running with -T switch at
/usr/lib/perl5/5.10.1/File/Path.pm line 250.\nCompilation failed in
require at (eval 2) line 1.\n

We don't support running RT under taint mode.  Remove the
PerlTaintCheck line from your mod_perl configuration.
  - Alex





[rt-users] webmux.pl - Insecure dependency in chdir while running with -T switch

2011-01-17 Thread Kim Pedersen


Hi everyone,.

I am installing a cloned copy of our live 3.8.8 RT installation (To test 
a restoration/reinstallation and later to play with the 3.9.4 release).


The new server is running Apache 2.2.15 with mod_perl 2.0.4 on Mandriva 
2010.1 x64, with Postgresql 9.0 - which is the same as the live server.


And the RT version is installed from RPM (built from a modified Mandriva 
.spec file, updated to work with 3.8.8)


After installing RT I can't start Apache any longer and I am stuck with 
the following problem in my apache log:


[error] Insecure dependency in chdir while running with -T switch at 
/usr/lib/perl5/5.10.1/File/Path.pm line 250.\nCompilation failed in 
require at (eval 2) line 1.\n
[error] Can't load Perl file: /usr/sbin/webmux.pl for server 
www.testserver.com:0, exiting...



If I run webmux.pl manually as root, there are no Perl errors. A make 
testdeps from the RT sources show all dependencies being okay as well.
The RT config files are the same as on the live server -  File::Path is 
called at the end of webmux.pl, but I am just lost for what to look for 
/ how to troubleshoot this.



Any hints / pointers?


Regards

Kim P




Re: [rt-users] webmux.pl - Insecure dependency in chdir while running with -T switch

2011-01-17 Thread Kim Pedersen


  
  

Hi Keith,

I am not sure I understand 100% what permissions to the "perl mode"
means.

But the line calling File::Path in /usr/sbin/webmux.pl refers to "$RT::MasonDataDir",
  which points to /var/cache/rt/mason_data/.

The content and permissions of that folder is the following:

drwxrwx--- 5 apache apache 38 2011-01-18 01:06 ./
  drwxr-xr-x 4 root root 42 2011-01-18 01:06 ../
  drwxrwx--- 2 apache apache 6 2011-01-18 01:06 cache/
  drwxrwx--- 2 apache apache 6 2011-01-18 01:06 etc/
  drwxrwx--- 3 apache apache 50 2011-01-18 01:06 obj/
  
  The "obj" dir has session related files in it (That are recreated
  by apache if I empty the folders) all created by apache, and
  apache also has the permissions to delete the files 


It looks like webmux.pl is trying to clean out the
/var/cache/rt/mason_data/obj folder and failing for some reason,
with "Insecure dependency in mkdir while running with -T switch at
/usr/lib/perl5/5.10.1/File/Path.pm line 108, line 2.
"

if ( $ENV{'MOD_PERL'} 
  !RT-Config-Get('DevelMode')) {
   # Under static_source, we need to purge the component cache
   # each time we restart, so newer components may be reloaded.
   #
   # We can't do this in FastCGI or we'll blow away the component
   # root _every_ time a new server starts which happens every
  few
   # hits.
  
   require File::Path;
   require File::Glob;
   my @files = File::Glob::bsd_glob("$RT::MasonDataDir/obj/*");
   File::Path::rmtree([ @files ], 0, 1) if @files;
  }
  
  1;


Kim P




On 2011-01-18 02:32, Schincke, Keith D. (JSC-IT)[DB Consulting
Group, Inc.] wrote:

  
  
  
  
  What are the directory permissions to the perl mode?
  One of the directories or the Path.pm file may not allow the web
  process to access the file.
  
  Keith
  
  
  Sent from my Verizon Wireless Phone
  
  ----- Reply message -
From: "Kim Pedersen" li...@kimp.org
Date: Mon, Jan 17, 2011 11:28 pm
Subject: [rt-users] webmux.pl - Insecure dependency in chdir
while running with -T switch
To: "rt-users@lists.bestpractical.com"
rt-users@lists.bestpractical.com

  
  

  Hi everyone,.
  
  I am installing a cloned copy of our live 3.8.8 RT
  installation (To test 
  a restoration/reinstallation and later to play with the 3.9.4
  release).
  
  The new server is running Apache 2.2.15 with mod_perl 2.0.4 on
  Mandriva 
  2010.1 x64, with Postgresql 9.0 - which is the same as the
  live server.
  
  And the RT version is installed from RPM (built from a
  modified Mandriva 
  .spec file, updated to work with 3.8.8)
  
  After installing RT I can't start Apache any longer and I am
  stuck with 
  the following problem in my apache log:
  
  [error] Insecure dependency in chdir while running with -T
  switch at 
  /usr/lib/perl5/5.10.1/File/Path.pm line 250.\nCompilation
  failed in 
  require at (eval 2) line 1.\n
  [error] Can't load Perl file: /usr/sbin/webmux.pl for server 
  www.testserver.com:0,
  exiting...
  
  
  If I run webmux.pl manually as root, there are no Perl errors.
  A "make 
  testdeps" from the RT sources show all dependencies being okay
  as well.
  The RT config files are the same as on the live server -
  File::Path is 
  called at the end of webmux.pl, but I am just lost for what to
  look for 
  / how to troubleshoot this.
  
  
  Any hints / pointers?
  
  
  Regards
  
  Kim P
  
  

  


  



Re: [rt-users] Slow Ticket History 3.8.8

2010-06-30 Thread Kim Pedersen


Hi Justin,

Our RT instance is much smaller than yours, but we had very similar 
problems.


Optimizing MySQL using the output from the tuner script made nearly all 
the speed issues go away.


The one remaining issue we had with slow queries was resolved after the 
upgrade to 3.8.8



Your key buffer size looks like overkill - probably want to reduce that, 
and you have many joins done without indexes - that's a performance killer.


Your InnoDB memory allocation looks like it needs to be increasing.

Overall I'd say your database performance is skewed towards ISAM 
performance and not InnoDB (Which is what RT3 uses by default)



Kim


On 2010-06-29 10:53, Justin Hayes wrote:

Seem to be quite a few things to look at Jason. Need to figure out what they 
all mean first.

Justin

 General Statistics --
[--] Skipped version check for MySQLTuner script
[OK] Currently running supported MySQL version 5.1.37-1ubuntu5.4-log
[OK] Operating on 64-bit architecture

 Storage Engine Statistics ---
[--] Status: -Archive -BDB -Federated +InnoDB -ISAM -NDBCluster
[--] Data in MyISAM tables: 611M (Tables: 8)
[--] Data in InnoDB tables: 10G (Tables: 20)
[!!] Total fragmented tables: 21

 Performance Metrics -
[--] Up for: 19d 19h 32m 37s (110M q [64.266 qps], 222K conn, TX: 637B, RX: 39B)
[--] Reads / Writes: 98% / 2%
[--] Total buffers: 602.0M global + 134.8M per thread (150 max threads)
[!!] Maximum possible memory usage: 20.3G (262% of installed RAM)
[OK] Slow queries: 0% (229K/110M)
[!!] Highest connection usage: 100%  (151/150)
[OK] Key buffer size / total MyISAM indexes: 512.0M/6.7M
[OK] Key buffer hit rate: 100.0% (84M cached / 7K reads)
[OK] Query cache efficiency: 71.4% (76M cached / 107M selects)
[!!] Query cache prunes per day: 661360
[OK] Sorts requiring temporary tables: 0% (0 temp sorts / 2M sorts)
[!!] Joins performed without indexes: 112714
[!!] Temporary tables created on disk: 33% (968K on disk / 2M total)
[OK] Thread cache hit rate: 99% (1K created / 222K connections)
[OK] Table cache hit rate: 36% (318 open / 880 opened)
[OK] Open file limit used: 14% (166/1K)
[OK] Table locks acquired immediately: 99% (39M immediate / 39M locks)
[!!] InnoDB data size / buffer pool: 10.1G/8.0M

 Recommendations -
General recommendations:
 Run OPTIMIZE TABLE to defragment tables for better performance
 Reduce your overall MySQL memory footprint for system stability
 Reduce or eliminate persistent connections to reduce connection usage
 Adjust your join queries to always utilize indexes
 When making adjustments, make tmp_table_size/max_heap_table_size equal
 Reduce your SELECT DISTINCT queries without LIMIT clauses
Variables to adjust:
   *** MySQL's maximum memory usage is dangerously high ***
   *** Add RAM before increasing MySQL buffer variables ***
 max_connections (  150)
 wait_timeout (  28800)
 interactive_timeout (  28800)
 query_cache_size (  16M)
 join_buffer_size (  2.0M, or always use indexes with joins)
 tmp_table_size (  128M)
 max_heap_table_size (  64M)
 innodb_buffer_pool_size (= 10G)

   



Discover RT's hidden secrets with RT Essentials from O'Reilly Media.
Buy a copy at http://rtbook.bestpractical.com


Re: [rt-users] RT as a intranet portal? Or other suggestions?

2008-04-18 Thread Kim Pedersen

 I've been happy with TWiki for our internal needs.  A wiki-notion
 of edit-in-place is more suitable for our documentation than RT's
 notion of serial appends to a thread (ticket).

 I've also been interested in Trac, but that uses its own
 built-in wiki and ticketing system.  I like the integration Trac
 provides, but I don't want a second ticketing system or a second wiki.

 FWIW, it probably would not be too hard to make a twiki plugin
 that interacted with RT via the REST interface.  And probably
 the reverse, if you wanted some RT interface to twiki (e.g. to
 use wiki pages instead of RTFM articles).
   
We use Twiki and RT as well, but with no integration.

Googling on the subject sometime last year, I did run across references 
to companies who have done some integration of RT into Twiki, using 
Mason - but I've been unable to find any concrete information, and it 
isn't a high enough priority / we don't have the resources at my work 
place for it.



Regards,
Kim

___
http://lists.bestpractical.com/cgi-bin/mailman/listinfo/rt-users

Community help: http://wiki.bestpractical.com
Commercial support: [EMAIL PROTECTED]


Discover RT's hidden secrets with RT Essentials from O'Reilly Media. 
Buy a copy at http://rtbook.bestpractical.com