Re: libhdfs process fork problem

2012-03-27 Thread Brian Bockelman
Hi Tareq, Sorry - out of ideas, without doing something like "strace"ing the process to verify that the master never tries to initialize a JVM. If exec'ing doesn't work, then it is certainly something in the environment. Brian On Mar 27, 2012, at 10:07 AM, Tareq Aljabban wrote: > Hi Brian, >

Re: libhdfs process fork problem

2012-03-27 Thread Tareq Aljabban
Hi Brian, Thanks for your response.. Actually the master process doesn't even try to access HDFS.. What's happening is that process Master forks 2 processes A and B. A and B are the ones that try to connect to HDFS.. I tried doing this in a separate application and it worked.. for some reason it do

Re: libhdfs process fork problem

2012-03-23 Thread Brian Bockelman
Hi Tareq, This is because libhdfs will keep a bit of state data (especially if the master was connected to HDFS). Three suggestions: 1) [Likely to work] Fork the children first, then do any HDFS actions in the master. Alternately, don't have the master do any HDFS actions; have it fork a chil