[ 
https://issues.apache.org/jira/browse/HDFS-7943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14369525#comment-14369525
 ] 

Hudson commented on HDFS-7943:
------------------------------

FAILURE: Integrated in Hadoop-Mapreduce-trunk #2087 (See 
[https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2087/])
HDFS-7943. Append cannot handle the last block with length greater than the 
preferred block size. Contributed by Jing Zhao. (jing9: rev 
bee5a6a64a1c037308fa4d52249be39c82791590)
* 
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestHDFSConcat.java
* hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
* 
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirConcatOp.java


> Append cannot handle the last block with length greater than the preferred 
> block size
> -------------------------------------------------------------------------------------
>
>                 Key: HDFS-7943
>                 URL: https://issues.apache.org/jira/browse/HDFS-7943
>             Project: Hadoop HDFS
>          Issue Type: Bug
>    Affects Versions: 2.7.0
>            Reporter: Jing Zhao
>            Assignee: Jing Zhao
>            Priority: Blocker
>             Fix For: 2.7.0
>
>         Attachments: HDFS-7943.000.patch, HDFS-7943.001.patch
>
>
> In HDFS-3689, we remove the restriction from concat that all the source files 
> should have the same preferred block size with the target file. This can 
> cause a file to contain blocks with size larger than its preferred block size.
> If such block happens to be the last block of a file, and later we append 
> data to the file without the {{CreateFlag.NEW_BLOCK}} flag (i.e., appending 
> data to the last block), looks like the current client code will keep writing 
> to the last block and never allocate a new block.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to