Re: Extra start-up overhead with hadoop-2.1.0-beta

2013-08-07 Thread Krishna Kishore Bonagiri
Hi Omkar, Can you please see if you can answer my question with this info or if you need anything else from me? Also, does resource localization improve or impact any performance? Thanks, Kishore On Thu, Aug 1, 2013 at 11:20 PM, Omkar Joshi ojo...@hortonworks.com wrote: How are you making

Re: Extra start-up overhead with hadoop-2.1.0-beta

2013-08-07 Thread Ravi Prakash
Kishore Bonagiri write2kish...@gmail.com To: user@hadoop.apache.org Sent: Wednesday, August 7, 2013 10:03 AM Subject: Re: Extra start-up overhead with hadoop-2.1.0-beta Hi Omkar,  Can you please see if you can answer my question with this info or if you need anything else from me?  Also

Re: Extra start-up overhead with hadoop-2.1.0-beta

2013-08-07 Thread Krishna Kishore Bonagiri
-up overhead with hadoop-2.1.0-beta Hi Omkar, Can you please see if you can answer my question with this info or if you need anything else from me? Also, does resource localization improve or impact any performance? Thanks, Kishore On Thu, Aug 1, 2013 at 11:20 PM, Omkar Joshi ojo

Re: Extra start-up overhead with hadoop-2.1.0-beta

2013-08-02 Thread Krishna Kishore Bonagiri
Hi Omkar, I have got these number by running a simple C program on the containers that fetches the timestamp in microseconds and exits. The times mentioned are low and high, they are not varying so drastically with in a version but there are huge differences(like a second) between the two

Re: Extra start-up overhead with hadoop-2.1.0-beta

2013-08-01 Thread Krishna Kishore Bonagiri
Hi, Please share with me if you anyone has an answer or clues to my question regarding the start up performance. Also, one more thing I have observed today is the time taken to run a command on a container went up by more than a second in this latest version. When using 2.0.4-alpha, it used to

Extra start-up overhead with hadoop-2.1.0-beta

2013-07-25 Thread Krishna Kishore Bonagiri
Hi, I have been using the hadoop-2.0.1-beta release candidate and observed that it is slower in running my simple application that runs on 2 containers. I have tried to find out which parts of it is really having this extra overhead(compared to hadoop-2.0.4-alpha), and here is what I found