[ https://issues.apache.org/jira/browse/YARN-3949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14641380#comment-14641380 ]
Joep Rottinghuis commented on YARN-3949: ---------------------------------------- LGTM. Joep > ensure timely flush of timeline writes > -------------------------------------- > > Key: YARN-3949 > URL: https://issues.apache.org/jira/browse/YARN-3949 > Project: Hadoop YARN > Issue Type: Sub-task > Components: timelineserver > Affects Versions: YARN-2928 > Reporter: Sangjin Lee > Assignee: Sangjin Lee > Attachments: YARN-3949-YARN-2928.001.patch, > YARN-3949-YARN-2928.002.patch, YARN-3949-YARN-2928.002.patch, > YARN-3949-YARN-2928.003.patch, YARN-3949-YARN-2928.004.patch, > YARN-3949-YARN-2928.004.patch > > > Currently flushing of timeline writes is not really handled. For example, > {{HBaseTimelineWriterImpl}} relies on HBase's {{BufferedMutator}} to batch > and write puts asynchronously. However, {{BufferedMutator}} may not flush > them to HBase unless the internal buffer fills up. > We do need a flush functionality first to ensure that data are written in a > reasonably timely manner, and to be able to ensure some critical writes are > done synchronously (e.g. key lifecycle events). -- This message was sent by Atlassian JIRA (v6.3.4#6332)