[
https://issues.apache.org/jira/browse/HADOOP-89?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12518884
]
dhruba borthakur commented on HADOOP-89:
----------------------------------------
This patch does not change APIs and disk formats. The idea is that files that
are created by clients appear immediately in the namespace. Other clients can
see the file and get its attributes. This is a big change in semantics and I
would rather do this in the beginning of a release than towards the end of the
release cycle. This is a step in implementing full-fledged "appends" for HDFS
files (HADOOP-1700).
Regarding "removing pending creates" structures, I agree that they should move
into a new kind of inode. I can do it after you introduce the concept of
class-hierarchy of inodes (HADOOP-1687).
Please let me know if the above sounds good to you and makes you agree that
this patch is commit-able.
> files are not visible until they are closed
> -------------------------------------------
>
> Key: HADOOP-89
> URL: https://issues.apache.org/jira/browse/HADOOP-89
> Project: Hadoop
> Issue Type: Bug
> Components: dfs
> Affects Versions: 0.1.0
> Reporter: Yoram Arnon
> Assignee: dhruba borthakur
> Priority: Critical
> Attachments: atomicCreation.patch
>
>
> the current behaviour, whereby a file is not visible until it is closed has
> several flaws,including:
> 1. no practical way to know if a file/job is progressing
> 2. no way to implement files that never close, such as log files
> 3. failure to close a file results in loss of the file
> The part of the file that's written should be visible.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
