[
https://issues.apache.org/jira/browse/HDFS-3960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13487155#comment-13487155
]
Todd Lipcon commented on HDFS-3960:
-----------------------------------
We can't pass the length (ie call fsync()) on every hflush. That would be too
expensive -- eg a typical region server under load calls HFlush ~300 times per
second. On a cluster of even 100 HBase nodes, that would result in 30k RPC/sec
to the NN which could easily overwhelm it. Hence the proposal to add a flag so
that this is only done in specific places where the client needs extra
durability.
> Snapshot of Being Written Files
> -------------------------------
>
> Key: HDFS-3960
> URL: https://issues.apache.org/jira/browse/HDFS-3960
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Reporter: Tsz Wo (Nicholas), SZE
> Assignee: Tsz Wo (Nicholas), SZE
>
> Here is a design question: Suppose there is a being written file when a
> snapshot is being taken. What should the length of the file be shown in the
> snapshot? In other words, how to determine the length of being written file
> when a snapshot is being taken?
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
