[
https://issues.apache.org/jira/browse/YARN-666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13660040#comment-13660040
]
Carlo Curino commented on YARN-666:
-----------------------------------
Vinod, I completely agree YARN/MR separation makes hacking around this much
simpler.
As soon as we are done polishing/publishing the rest of
checkpointing/preemption we will work on rebasing this code and we will post
what we have.
Also we are happy to socialize this, both development and experiments. For us
this was a step towards cheaper checkpointing (as an hdfs-based shuffle
is almost stateless for checkpoint purposes), but the performance wins are
clearly interesting and there is quite a bit of variations you can think
of (e.g., a hybrid strategy using both streaming and localized data etc.. fun
stuff).
By the way some of the refactorings we propose in MAPREDUCE-5192 and
MAPREDUCE-5194 are (aside from their use in checkpointing) useful towards this.
> [Umbrella] Support rolling upgrades in YARN
> -------------------------------------------
>
> Key: YARN-666
> URL: https://issues.apache.org/jira/browse/YARN-666
> Project: Hadoop YARN
> Issue Type: Improvement
> Affects Versions: 2.0.4-alpha
> Reporter: Siddharth Seth
> Attachments: YARN_Rolling_Upgrades.pdf, YARN_Rolling_Upgrades_v2.pdf
>
>
> Jira to track changes required in YARN to allow rolling upgrades, including
> documentation and possible upgrade routes.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
