[
https://issues.apache.org/jira/browse/HADOOP-5608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12694639#action_12694639
]
sam rash commented on HADOOP-5608:
----------------------------------
code that brought about this bug; hangs on one particular job in the loop to
get map task reports.
{code}
log.info("start: querying hadoop job tracker %s",
conf.get("mapred.job.tracker"));
for (JobStatus jobStatus : jobClient.getAllJobs()) {
List<MapTaskProfile> mapTaskProfileList = new ArrayList<MapTaskProfile>();
for (TaskReport taskReport :
jobClient.getMapTaskReports(jobStatus.getJobID())) {
mapTaskProfileList.add(new MapTaskProfile(taskReport,
jobStatus.getJobID().toString()));
}
List<ReduceTaskProfile> reduceTaskProfileList = new
ArrayList<ReduceTaskProfile>();
for (TaskReport taskReport :
jobClient.getReduceTaskReports(jobStatus.getJobID())) {
reduceTaskProfileList.add(new ReduceTaskProfile(taskReport,
jobStatus.getJobID().toString()));
}
RunningJob runningJob = jobClient.getJob(jobStatus.getJobID());
if (runningJob != null) {
eventList.add(new JobProfileEvent(eventBatchId.get(), new
DateTime(),
new JobProfile(jobStatus, runningJob.getJobName(),
mapTaskProfileList, reduceTaskProfileList, runningJob.getCounters()))
);
}
}
log.info("end: querying hadoop job tracker %s", conf.get("mapred.job.tracker"));
{code}
if i try to view the info of this job from the jobtracker gui, i also get a 500
and the logs show the same NPE
2009-04-01 17:40:06,400 WARN /:
/jobdetails.jsp?jobid=job_200902281847_18859&refresh=0:
java.lang.NullPointerException
> NullPointerException when retrieving task reports
> -------------------------------------------------
>
> Key: HADOOP-5608
> URL: https://issues.apache.org/jira/browse/HADOOP-5608
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.19.0
> Reporter: sam rash
>
> It appears as thought Counters is null for a given task which causes an NPE
> in the logs (and clients to hang)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.