[
https://issues.apache.org/jira/browse/HBASE-18843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16204063#comment-16204063
]
Josh Elser edited comment on HBASE-18843 at 10/13/17 7:34 PM:
--------------------------------------------------------------
Thanks, Vlad!
I had a chat with Vlad earlier today on this issue. Vlad's take was that Distcp
is busted in Hadoop3 presently -- stacktraces down in the weeds of Hadoop that
we haven't yet unraveled. I don't want us to be in a situation where this is
"held hostage" by Hadoop3 bugs that need to be worked out, but I also want to
make sure that we don't ignore Hadoop3 issues when we know about 'em.
My opinion is that we should get a follow-on issues filed (I guess here in
HBASE for now, can switch it to the appropriate Hadoop JIRA project after
investigation) for the Hadoop3 runtime issue, and get this committed.
_Edit_: oh, and +1 pending QA.
was (Author: elserj):
Thanks, Vlad!
I had a chat with Vlad earlier today on this issue. Vlad's take was that Distcp
is busted in Hadoop3 presently -- stacktraces down in the weeds of Hadoop that
we haven't yet unraveled. I don't want us to be in a situation where this is
"held hostage" by Hadoop3 bugs that need to be worked out, but I also want to
make sure that we don't ignore Hadoop3 issues when we know about 'em.
My opinion is that we should get a follow-on issues filed (I guess here in
HBASE for now, can switch it to the appropriate Hadoop JIRA project after
investigation) for the Hadoop3 runtime issue, and get this committed.
> Add DistCp support to incremental backup with bulk loading
> ----------------------------------------------------------
>
> Key: HBASE-18843
> URL: https://issues.apache.org/jira/browse/HBASE-18843
> Project: HBase
> Issue Type: Improvement
> Reporter: Vladimir Rodionov
> Assignee: Vladimir Rodionov
> Fix For: 2.0.0-beta-1
>
> Attachments: HBASE-18843-v1.patch, HBASE-18843-v2.patch,
> HBASE-18843-v4.patch, HBASE-18843-v5.patch, HBASE-18843-v6.patch,
> HBASE-18843-v7.patch, HBASE-18843-v8.patch
>
>
> Currently, we copy bulk loaded files to backup one-by-one on a client side
> (where backup create runs). This has to be replaced with DistCp copying.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
