[
https://issues.apache.org/jira/browse/YARN-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15566718#comment-15566718
]
Li Lu commented on YARN-4061:
-----------------------------
Thanks [~jrottinghuis]! So our current plan is to extend the buffered mutator
in HBase, so that it buffers data in a more persistent way, right? This can
address HBase cluster failures. However, my concern is that we may also need to
address timeline collector failures. This said, with a fault tolerant buffered
mutator, it seems like we need to address the same kind of problems again for
timeline collectors in the future? If we can some how make the retry/persisting
logic reusable, maybe we can address both problems together? Thanks!
> [Fault tolerance] Fault tolerant writer for timeline v2
> -------------------------------------------------------
>
> Key: YARN-4061
> URL: https://issues.apache.org/jira/browse/YARN-4061
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: timelineserver
> Reporter: Li Lu
> Assignee: Joep Rottinghuis
> Labels: YARN-5355
> Attachments: FaulttolerantwriterforTimelinev2.pdf
>
>
> We need to build a timeline writer that can be resistant to backend storage
> down time and timeline collector failures.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
