[
https://issues.apache.org/jira/browse/HADOOP-89?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12528221
]
Konstantin Shvachko commented on HADOOP-89:
-------------------------------------------
+1
My only concern is that in order to add or remove blocks you reallocate the
array of blocks
so that it's length always equals the number of blocks in the file.
I tested this patch with small files (1 or 2 blocks) and did not see any
degradation in performance.
Since our average file size is 1.5 blocks this is good.
IMO we should still test it for bigger files to make sure there is no slow-down.
> files are not visible until they are closed
> -------------------------------------------
>
> Key: HADOOP-89
> URL: https://issues.apache.org/jira/browse/HADOOP-89
> Project: Hadoop
> Issue Type: Bug
> Components: dfs
> Affects Versions: 0.1.0
> Reporter: Yoram Arnon
> Assignee: dhruba borthakur
> Priority: Critical
> Attachments: tail3.patch
>
>
> the current behaviour, whereby a file is not visible until it is closed has
> several flaws,including:
> 1. no practical way to know if a file/job is progressing
> 2. no way to implement files that never close, such as log files
> 3. failure to close a file results in loss of the file
> The part of the file that's written should be visible.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
