[
https://issues.apache.org/jira/browse/HADOOP-931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12467519
]
Tom White commented on HADOOP-931:
----------------------------------
No, it's not breaking anything that I know of. I wanted to make S3FileSystem
consistent with DFS, but as you rightly point out LocalFileSystem makes partial
files visible.
It would be nice to improve the documentation of FileSystem to make it clearer
what the contract permits, this could be combined with creating a set of common
unit tests for different implementations. However, this feels like a longer
term goal, so I won't pursue it further at the moment.
I'll close this issue.
> Make writes to S3FileSystem world visible only on completion
> ------------------------------------------------------------
>
> Key: HADOOP-931
> URL: https://issues.apache.org/jira/browse/HADOOP-931
> Project: Hadoop
> Issue Type: Bug
> Components: fs
> Reporter: Tom White
>
> Currently files written to S3 are visible to other processes as soon as the
> first block has been written. This is different to DFS which only makes files
> world visible after the stream writing to the file has closed (see
> FSNamesystem.completeFile).
> We could implement this by having a piece of inode metadata that indicates
> the visibility of the file.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
