[ 
https://issues.apache.org/jira/browse/HBASE-24055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17076018#comment-17076018
 ] 

Duo Zhang commented on HBASE-24055:
-----------------------------------

For WAL we need the output stream to support hflush/hsync. But by default, when 
you create a file under a EC directory, the output stream will not support 
hflush/hsync, as it will buffer the output locally and once we have a big 
enough chunk we will calculate the EC and write them to datanodes.

So HDFS introduces a CreateFlag called SHOULD_REPLICATE, if it is specified, no 
matter whether the target directory is EC or not, the file will always be a 
normal file without EC support, which means it can support hflush/hsync.

> Make AsyncFSWAL can run on EC cluster
> -------------------------------------
>
>                 Key: HBASE-24055
>                 URL: https://issues.apache.org/jira/browse/HBASE-24055
>             Project: HBase
>          Issue Type: Improvement
>          Components: wal
>            Reporter: Duo Zhang
>            Assignee: Duo Zhang
>            Priority: Major
>
> We need to enable replicate when creating the file.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to