Re: Regarding containers not launching

Tuesday, January 30, 2018 9:47 AM Subject: Re: Regarding containers not launching Is your job able to use more containers, I.e. does your job have tasks waiting or are all tasks in progress? William Watson On Tue, Jan 30, 2018 at 1:56 AM, nishchay malhotra <nishchay.malht...@g

Re: Regarding containers not launching

Also, is there anything interesting in the yarn scheduler logs? Something about scheduling being skipped? On Wed, Jan 31, 2018 at 05:16 Billy Watson wrote: > Ok, and your container settings? > > On Wed, Jan 31, 2018 at 02:38 nishchay malhotra < >

Re: Regarding containers not launching

Ok, and your container settings? On Wed, Jan 31, 2018 at 02:38 nishchay malhotra wrote: > yes my job has about 160,000 maps and my cluster not getting fully > utilized around 6000 maps ran for 2 hrs and then I killed the job. At any > point of time only 40

Re: Regarding containers not launching

yes my job has about 160,000 maps and my cluster not getting fully utilized around 6000 maps ran for 2 hrs and then I killed the job. At any point of time only 40 containers are running thats just 11% of my cluster capacity. { "classification": "mapred-site", "properties": {

Re: Regarding containers not launching

Is your job able to use more containers, I.e. does your job have tasks waiting or are all tasks in progress? William Watson On Tue, Jan 30, 2018 at 1:56 AM, nishchay malhotra < nishchay.malht...@gmail.com> wrote: > What should I be looking for if my 24-node cluster in not launching enough >