[
https://issues.apache.org/jira/browse/MAPREDUCE-6159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
JasonZhu updated MAPREDUCE-6159:
--------------------------------
Description:
I intend to dig into 'mapreduce.jobhistory.intermediate-done-dir' argument, the
position of which is at `JHAdminConfig:73`, to get some comprehension on
history server. This argument is referenced at
`JobHistoryEventHandler.moveToDoneNow()`, where history server moves job
summary file
from "$[yarn.app.mapreduce.am.staging-dir]/$[user]/.staging" to
"$[mapreduce.jobhistory.intermediate-done-dir]/$[user]".
The following code snippet in `moveToDoneNow()` will definitely write some logs
out to log file, but I can found no any sign of it in all logs in
$HADOOP_LOG_DIR via command `grep "Copied to done location" *`.
if (copied)
LOG.info("Copied to done location: " + toPath);
else
LOG.info("copy failed");
Is there anything that I missed?
was:
I intend to dig into 'mapreduce.jobhistory.intermediate-done-dir' argument, the
position of which is at `JHAdminConfig:73`, to get some comprehension on
history server. This argument is referenced at
`JobHistoryEventHandler.moveToDoneNow()`, where history server moves job
summary file
from "$[yarn.app.mapreduce.am.staging-dir]/$[user]/.staging" to
"$[mapreduce.jobhistory.intermediate-done-dir]/$[user]".
Since the following code snippet in `moveToDoneNow()` will definitely write
some logs out to log file, but I can found no any sign of it in all logs in
$HADOOP_LOG_DIR via command `grep "Copied to done location" *`.
if (copied)
LOG.info("Copied to done location: " + toPath);
else
LOG.info("copy failed");
Is there anything that I missed?
> No log of JobHistory found in all logs files
> --------------------------------------------
>
> Key: MAPREDUCE-6159
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-6159
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: jobhistoryserver, mrv2
> Affects Versions: 2.2.0
> Environment: Hadoop-2.2.0
> Reporter: JasonZhu
>
> I intend to dig into 'mapreduce.jobhistory.intermediate-done-dir' argument,
> the position of which is at `JHAdminConfig:73`, to get some comprehension on
> history server. This argument is referenced at
> `JobHistoryEventHandler.moveToDoneNow()`, where history server moves job
> summary file
> from "$[yarn.app.mapreduce.am.staging-dir]/$[user]/.staging" to
> "$[mapreduce.jobhistory.intermediate-done-dir]/$[user]".
> The following code snippet in `moveToDoneNow()` will definitely write some
> logs out to log file, but I can found no any sign of it in all logs in
> $HADOOP_LOG_DIR via command `grep "Copied to done location" *`.
> if (copied)
> LOG.info("Copied to done location: " + toPath);
> else
> LOG.info("copy failed");
> Is there anything that I missed?
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
