[
https://issues.apache.org/jira/browse/MAPREDUCE-5652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13968971#comment-13968971
]
Karthik Kambatla commented on MAPREDUCE-5652:
---------------------------------------------
bq. However that's outside of the scope (and project) of this JIRA. I'll try to
address that in YARN-1354 or possibly a separate YARN JIRA.
Thanks for the clarification. Let us track this in YARN-1354.
bq. serviceStart() indirectly calls initStateStore to open the database, and
serviceStop() closes the database.
I see. Makes sense to leave it in serviceStart(). Do you think renaming
initStateStore to initAndOpenStore or startStore is reasonable?
bq. Maybe may need the equivalent of YARN-888 for hadoop-mapreduce-project poms
to only declare them in the leaf modules and still have them be picked up
properly.
MAPREDUCE-5362 . Let us try to get that in first. Mind taking a look? I ll also
look at it shortly.
> NM Recovery. ShuffleHandler should handle NM restarts
> -----------------------------------------------------
>
> Key: MAPREDUCE-5652
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-5652
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 2.2.0
> Reporter: Karthik Kambatla
> Assignee: Jason Lowe
> Labels: shuffle
> Attachments: MAPREDUCE-5652-v2.patch, MAPREDUCE-5652-v3.patch,
> MAPREDUCE-5652-v4.patch, MAPREDUCE-5652-v5.patch, MAPREDUCE-5652.patch
>
>
> ShuffleHandler should work across NM restarts and not require re-running
> map-tasks. On NM restart, the map outputs are cleaned up requiring
> re-execution of map tasks and should be avoided.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
