I figured it out. Of course it's obvious in retrospect.
The tests passed after I added a call to user.setAuthMethod(KERBEROS) after
createProxy(). I didn't need to do that with SIMPLE auth so I assumed the
same would be true with Kerberos auth. The UGI's authentication method was
set to PROXY but
Also, is there anything interesting in the yarn scheduler logs? Something
about scheduling being skipped?
On Wed, Jan 31, 2018 at 05:16 Billy Watson wrote:
> Ok, and your container settings?
>
> On Wed, Jan 31, 2018 at 02:38 nishchay malhotra <
>
Ok, and your container settings?
On Wed, Jan 31, 2018 at 02:38 nishchay malhotra
wrote:
> yes my job has about 160,000 maps and my cluster not getting fully
> utilized around 6000 maps ran for 2 hrs and then I killed the job. At any
> point of time only 40