[ 
https://issues.apache.org/jira/browse/MAPREDUCE-5623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13829994#comment-13829994
 ] 

Jason Lowe commented on MAPREDUCE-5623:
---------------------------------------

bq. Or, I've noticed that Job#getCounters() can return null in some cases

I think that's much more likely to be the case of what's happening here.  It's 
not like the JobImpl was just created at the time we're trying to get the 
counters for it, as we're waiting for job completion before attempting to get 
them.

Unfortunately I can't reproduce the issue locally to dig deeper.  I think 
knowing what the AM logs looked like for the job and whether the client was 
redirected to the history server before the null counters could shed a lot of 
light on the problem.  If the client was redirected, examining the .jhist file 
would also be interesting.

> TestJobCleanup fails because of RejectedExecutionException and NPE.
> -------------------------------------------------------------------
>
>                 Key: MAPREDUCE-5623
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5623
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>            Reporter: Tsuyoshi OZAWA
>            Assignee: Tsuyoshi OZAWA
>         Attachments: MAPREDUCE-5623.1.patch
>
>
> org.apache.hadoop.mapred.TestJobCleanup can fail because of 
> RejectedExecutionException by NonAggregatingLogHandler. This problem is 
> described in YARN-1409. TestJobCleanup can still fail after fixing 
> RejectedExecutionException, because of NPE by Job#getCounters()'s returning 
> null.
> {code}
> -------------------------------------------------------------------------------
> Test set: org.apache.hadoop.mapred.TestJobCleanup
> -------------------------------------------------------------------------------
> Tests run: 3, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 140.933 sec 
> <<< FAILURE! - in org.apache.hadoop.mapred.TestJobCleanup
> testCustomAbort(org.apache.hadoop.mapred.TestJobCleanup)  Time elapsed: 
> 31.068 sec  <<< ERROR!
> java.lang.NullPointerException: null
>         at 
> org.apache.hadoop.mapred.TestJobCleanup.testFailedJob(TestJobCleanup.java:199)
>         at 
> org.apache.hadoop.mapred.TestJobCleanup.testCustomAbort(TestJobCleanup.java:296)
> {code}



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Reply via email to