Bogdan Raducanu created HDFS-7268:
-------------------------------------
Summary: Can't append with SYNC_BLOCK
Key: HDFS-7268
URL: https://issues.apache.org/jira/browse/HDFS-7268
Project: Hadoop HDFS
Issue Type: Bug
Components: hdfs-client
Affects Versions: 2.4.1
Reporter: Bogdan Raducanu
Assignee: Bogdan Raducanu
It seems to me that currently it's not possible to start appending to a file
with CreateFlag.SYNC_BLOCK behavior (i.e. hsync after each block). This means
proper fsync is not possible when appending (unless doing hsync after every
write, I guess).
FileSystem.append doesn't accept a CreateFlag argument (probably shouldn't
anyway).
FileSystem.create ignores CreateFlag.APPEND
It seems it might work through FileContext but in the end DFSOutputStream can't
be passed a CreateFlag for appending anyway.
Am I missing something?
I will think of a way to fix it. An immediate thought is to add a
setSyncBlock() method to DFSOutputStream and remove CreateFlag.SYNC_BLOCK.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
