[
https://issues.apache.org/jira/browse/MAPREDUCE-7313?focusedWorklogId=524323&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-524323
]
ASF GitHub Bot logged work on MAPREDUCE-7313:
---------------------------------------------
Author: ASF GitHub Bot
Created on: 15/Dec/20 09:03
Start Date: 15/Dec/20 09:03
Worklog Time Spent: 10m
Work Description: Deegue opened a new pull request #2550:
URL: https://github.com/apache/hadoop/pull/2550
History Server searches applications by visiting `history file`. If we move
`history file` to `/done` before `conf file`, at the same time, stop the
History Server, however, `conf file` is still in `/intermediate`. When we start
History Server again, this `conf file` won't be moved to `/done` because ` the
history file` is no longer in `/intermediate`. In this case, `conf file` is
trash.
When we move `conf file` first, stop the History Server, however, `conf
file` isn't exist but `history file` does. When we start History Server again,
it'll try to move the `conf file` and throw FileNotFound exception. In this
case, `history file` is trash.
Trash(outdated `conf file` and `history file`) will pile up in
`/intermediate` directory util we delete them manually or it'll slow down
History Server.
Our solution is changing move order and making file exist check.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 524323)
Remaining Estimate: 0h
Time Spent: 10m
> History file should move after conf file
> -----------------------------------------
>
> Key: MAPREDUCE-7313
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7313
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Reporter: Deegue
> Priority: Minor
> Time Spent: 10m
> Remaining Estimate: 0h
>
> History Server searches applications by visiting `history file`. If we move
> `history file` to `/done` before `conf file`, at the same time, stop the
> History Server, however, `conf file` is still in `/intermediate`. When we
> start the History Server again, this `conf file` won't be moved to `/done`
> because `history file` is no longer in `/intermediate`.
> Trash(outdated `conf file`) will pile up in `/intermediate` directory util we
> delete them manually or it'll slow down History Server.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
