[
https://issues.apache.org/jira/browse/HBASE-20429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16590991#comment-16590991
]
Andrew Purtell edited comment on HBASE-20429 at 8/24/18 12:41 AM:
------------------------------------------------------------------
I don't want this to be considered "FSredo". We need improvements in branch-1
for today's production. I deliberately did not file this under the related FS
redo JIRAs. I am going to remove the tag. We can have #2, at least to some
extent, without reinventing how we manage files in an incompatible way. For
example HBASE-20431. It is not going to be sufficient to commit something to
master (aka 3.0) and call it a day
was (Author: apurtell):
I don't want this to be considered "FSredo". We need improvements in branch-1
for today's production. Sure, branch-2 is in the future sometime, but not
today, at least not for us. So I deliberately did not file this under the
related FS redo JIRAs. I am going to remove the tag. We can have #2, at least
to some extent, without reinventing how we manage files in an incompatible way.
For example HBASE-20431. It is not going to be sufficient to commit something
to master (aka 3.0) and call it a day
> Support for mixed or write-heavy workloads on non-HDFS filesystems
> ------------------------------------------------------------------
>
> Key: HBASE-20429
> URL: https://issues.apache.org/jira/browse/HBASE-20429
> Project: HBase
> Issue Type: Umbrella
> Reporter: Andrew Purtell
> Priority: Major
>
> We can support reasonably well use cases on non-HDFS filesystems, like S3,
> where an external writer has loaded (and continues to load) HFiles via the
> bulk load mechanism, and then we serve out a read only workload at the HBase
> API.
> Mixed workloads or write-heavy workloads won't fare as well. In fact, data
> loss seems certain. It will depend in the specific filesystem, but all of the
> S3 backed Hadoop filesystems suffer from a couple of obvious problems,
> notably a lack of atomic rename.
> This umbrella will serve to collect some related ideas for consideration.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
