[
https://issues.apache.org/jira/browse/MAPREDUCE-7042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16340174#comment-16340174
]
Xuan Gong commented on MAPREDUCE-7042:
--------------------------------------
The symptom is that we can not find this application in JHS.
A little bit more context:
1) we have ATSv2 enabled.
2) we get ATSv2 socketTimeout Exception while putting the timeline entity
{code}
[eventHandlingThread]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Exception while
publishing configs on JOB_SUBMITTED Event for the job : job_1516776025831_0063
org.apache.hadoop.yarn.exceptions.YarnException: Failed while publishing entity
Caused by: java.net.SocketTimeoutException: Read timed out
{code}
3) It happens that we run an MR application and kill it immediately. But if we
let the application run for a while(for a couple of minutes) and kill it, JHS
will have the application.
> Killed mapreduce job data does not move to mapreduce.jobhistory.done-dir
> ------------------------------------------------------------------------
>
> Key: MAPREDUCE-7042
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7042
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 3.0.0
> Reporter: Yesha Vora
> Priority: Major
>
> Steps:
> 1) Start a mapreduce job
> {code}
> hadoop jar
> /usr/hdp/current/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient-3.0.0.3.0.0.0-751-tests.jar
> sleep "-Dmapreduce.job.user.name=hrt_qa" -m 10 -r 1 -mt 1000 -rt
> 1000{code}
> 2) kill job
> 3) Validate job is present at mapreduce.jobhistory.done-dir
> mapreduce.jobhistory.done-dir dir does not have job_1516776025831_0048 entry.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
