[
https://issues.apache.org/jira/browse/HBASE-18843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16192192#comment-16192192
]
Ted Yu edited comment on HBASE-18843 at 10/5/17 11:31 PM:
----------------------------------------------------------
Building / installing 3.0.0-beta1 locally with HDFS-12599 and HADOOP-14930, I
was able to run TestIncrementalBackup with the following commands:
{code}
mvn clean install -DskipTests -Phadoop-3.0 -Dhadoop-three.version=3.0.0-beta1
-Dhadoop-two.version=3.0.0-beta1
mvn test -Dtest=TestIncrementalBackup -Phadoop-3.0
-Dhadoop-three.version=3.0.0-beta1 -Dhadoop-two.version=3.0.0-beta1
{code}
The test failed here (without Vlad's patch):
{code}
java.lang.NoSuchFieldException: inputOptions
at java.lang.Class.getDeclaredField(Class.java:2070)
at
org.apache.hadoop.hbase.backup.mapreduce.MapReduceBackupCopyJob$BackupDistCp.execute(MapReduceBackupCopyJob.java:168)
{code}
was (Author: [email protected]):
Even though the above error can be reproduced on command line, every time I
debug in Eclipse, hadoop 2.7.1 is used:
{code}
2017-10-04 16:16:36,709 INFO [main] log.Slf4jLog(67): Extract
jar:file:/Users/tyu/.m2/repository/org/apache/hadoop/hadoop-hdfs/2.7.1/hadoop-hdfs-2.7.1-tests.jar!/webapps/datanode
to
/var/folders/4g/2vdss5497xx9blpn2pbqc38r0000gn/T/Jetty_localhost_55722_datanode____.nq742/webapp
{code}
Still hunting for the cause.
> Add DistCp support to incremental backup with bulk loading
> ----------------------------------------------------------
>
> Key: HBASE-18843
> URL: https://issues.apache.org/jira/browse/HBASE-18843
> Project: HBase
> Issue Type: Improvement
> Reporter: Vladimir Rodionov
> Assignee: Vladimir Rodionov
> Fix For: 2.0.0-beta-1
>
> Attachments: HBASE-18843-v1.patch, HBASE-18843-v2.patch,
> HBASE-18843-v4.patch, HBASE-18843-v5.patch, HBASE-18843-v6.patch,
> HBASE-18843-v7.patch
>
>
> Currently, we copy bulk loaded files to backup one-by-one on a client side
> (where backup create runs). This has to be replaced with DistCp copying.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
