[
https://issues.apache.org/jira/browse/HBASE-18784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Busbey updated HBASE-18784:
--------------------------------
Attachment: HBASE-18784.0.patch
-0
* pull things that don't rely on HDFS in hbase-server/FSUtils into
hbase-common/CommonFSUtils
* refactor setStoragePolicy so that it can move into
hbase-common/CommonFSUtils, as a side effect update it for Hadoop 2.8,3.0+
* refactor WALProcedureStore so that it handles its own FS interactions
* add a reflection-based lookup of stream capabilities
* call said lookup in places where we make WALs to make sure hflush/hsync
is available.
> Use of filesystem that requires hflush / hsync / append / etc should query
> outputstream capabilities
> ----------------------------------------------------------------------------------------------------
>
> Key: HBASE-18784
> URL: https://issues.apache.org/jira/browse/HBASE-18784
> Project: HBase
> Issue Type: Improvement
> Components: Filesystem Integration
> Affects Versions: 1.4.0, 2.0.0-alpha-2
> Reporter: Sean Busbey
> Assignee: Sean Busbey
> Priority: Blocker
> Fix For: 2.1.0, 1.5.0
>
> Attachments: HBASE-18784.0.patch
>
>
> In places where we rely on the underlying filesystem holding up the promises
> of hflush/hsync (most importantly the WAL), we should use the new interfaces
> provided by HDFS-11644 to fail loudly when they are not present (e.g. on S3,
> on EC mounts, etc).
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
