[
https://issues.apache.org/jira/browse/HADOOP-5994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12720040#action_12720040
]
Hadoop QA commented on HADOOP-5994:
-----------------------------------
Tested these scenarios and found them to pass:
1) Launch a job, allow it to complete and then verify if the related
files move from history directory to done directory.
2) Launch a job, kill it in the middle and verify if the related
files move from history directory to done directory.
3) Launch multiple jobs (say 5) simultaneously and kill them as soon
as they start and verify if the related files move from history
directory to done directory.
4) Remove "done" directory and then kill the job to verify if done
directory is created again.
5) Kill a task before it says "setup successful".
Expected behaviour: It moves the related files to done directory.
Observed behaviour : same
6) Older files under done folder can be removed without any issue to
jobtracker.
Expected behaviour: Files from "done" folder have to be removed after
a specific time and job tracker should not be affected.
Observed behaviour: Older files from "done" folder are removed after
a successful job has been executed. job tracker si not affected by this.
But the files don't get removed when jobs are killed. For this a Jira was
raised:
https://issues.apache.org/jira/browse/HADOOP-6050
But the overall testscenario passes as the files in done directory is removed
both by manually deleting it or by Jobtracker filecleaner deleting it, without
affecting the running jobtracker.
7) The webui of "Job History" works, whether the job is killed or it
completes successfully. All the links in that "Job History" page is
working.
8) The in memory (running) jobs, shown in Jobtracker ui, works
correctly. I checked all links.
> Move the completed jobs' history files to a DONE subdirectory inside the
> configured history directory
> -----------------------------------------------------------------------------------------------------
>
> Key: HADOOP-5994
> URL: https://issues.apache.org/jira/browse/HADOOP-5994
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Reporter: Devaraj Das
> Assignee: Amar Kamat
> Fix For: 0.21.0
>
> Attachments: HADOOP-5994-v1.7.patch, HADOOP-5994-v1.8.patch
>
>
> Whenever a job completes, the history file can be moved to a directory called
> DONE. That would make the management of job history files easier (for
> example, administrators can move the history files from that directory to
> some other place, delete them, archive them, etc.).
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
