[ 
https://issues.apache.org/jira/browse/HDFS-5704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Arpit Agarwal updated HDFS-5704:
--------------------------------

    Description: 
Currently every time a block a allocated, the entire list of blocks are written 
in the editlog in OP_UPDATE_BLOCKS operation. This has n^2 growth issue. The 
total size of editlog records for a file with large number of blocks could be 
huge.

The goal of this jira is discuss adding a different editlog record that only 
records allocation of block and not the entire block list, on every block 
allocation.

> Change OP_UPDATE_BLOCKS  with a new OP_ADD_BLOCK
> ------------------------------------------------
>
>                 Key: HDFS-5704
>                 URL: https://issues.apache.org/jira/browse/HDFS-5704
>             Project: Hadoop HDFS
>          Issue Type: Bug
>            Reporter: Suresh Srinivas
>            Assignee: Suresh Srinivas
>
> Currently every time a block a allocated, the entire list of blocks are 
> written in the editlog in OP_UPDATE_BLOCKS operation. This has n^2 growth 
> issue. The total size of editlog records for a file with large number of 
> blocks could be huge.
> The goal of this jira is discuss adding a different editlog record that only 
> records allocation of block and not the entire block list, on every block 
> allocation.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Reply via email to