[
https://issues.apache.org/jira/browse/HADOOP-14522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Satish Subhashrao Saley updated HADOOP-14522:
---------------------------------------------
Affects Version/s: 2.8.0
> Unable to see logs for Job end notification
> -------------------------------------------
>
> Key: HADOOP-14522
> URL: https://issues.apache.org/jira/browse/HADOOP-14522
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 2.8.0
> Reporter: Satish Subhashrao Saley
>
> Hi, I have set {{mapreduce.job.end-notification.url}} and I am able to get
> the notification correctly. But I am unable to see log lines from class
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster regarding job end
> notification. When I was trying out different notification urls (before
> stabilizing my app), I didn't have any way to look at the logs and wasted a
> lot of time figuring out actual issue. It would be good if these logs are
> also included in syslog for container.
> [relevant
> code|https://github.com/apache/hadoop/blob/branch-2.8/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/MRAppMaster.java#L641-L650]
> {code}
> notifyIsLastAMRetry(isLastAMRetry);
> // Stop all services
> // This will also send the final report to the ResourceManager
> LOG.info("Calling stop for all the services"); <---- Able to see this.
> MRAppMaster.this.stop();
> if (isLastAMRetry) {
> // Send job-end notification when it is safe to report termination to
> // users and it is the last AM retry
> if (getConfig().get(MRJobConfig.MR_JOB_END_NOTIFICATION_URL) != null)
> {
> try {
> LOG.info("Job end notification started for jobID : "
> + job.getReport().getJobId()); <--- unable to see this
> JobEndNotifier notifier = new JobEndNotifier();
> notifier.setConf(getConfig());
> JobReport report = job.getReport();
> {code}
> Is it because we are shutting down all services including
> JobHistoryEventHandler in {{MRAppMaster.this.stop();}} ?
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
