[
https://issues.apache.org/jira/browse/HBASE-16255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15450051#comment-15450051
]
Dima Spivak commented on HBASE-16255:
-------------------------------------
Interesting. Yeah, I dunno why the cluster you have set up passes, but it fails
reliably on my side. What do you see when you run {{hbase version}} on your
cluster, [~tedyu]? And how are you executing the test exactly? Here's what I'm
seeing:
{noformat}
[root@node-1 ~]# hbase org.apache.hadoop.hbase.IntegrationTestBackupRestore
2016-08-30 12:53:33,279 INFO [main] hbase.IntegrationTestBackupRestore: Parsed
Options{regions_per_rs=10, region_servers=2, rows_in_batch=20000}
2016-08-30 12:53:33,306 INFO [main] hbase.IntegrationTestBackupRestore:
Initializing cluster with 2 region servers.
2016-08-30 12:53:33,365 WARN [main] util.NativeCodeLoader: Unable to load
native-hadoop library for your platform... using builtin-java classes where
applicable
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:file:/hbase/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
2016-08-30 12:53:33,537 INFO [main] zookeeper.RecoverableZooKeeper: Process
identifier=hconnection-0x5aebe890 connecting to ZooKeeper
ensemble=node-1.network3783:2181
2016-08-30 12:53:33,543 INFO [main] zookeeper.ZooKeeper: Client
environment:zookeeper.version=3.4.6-1569965, built on 02/20/2014 09:09 GMT
2016-08-30 12:53:33,543 INFO [main] zookeeper.ZooKeeper: Client
environment:host.name=node-1.network3783
2016-08-30 12:53:33,543 INFO [main] zookeeper.ZooKeeper: Client
environment:java.version=1.8.0_91
2016-08-30 12:53:33,543 INFO [main] zookeeper.ZooKeeper: Client
environment:java.vendor=Oracle Corporation
2016-08-30 12:53:33,548 INFO [main] zookeeper.ZooKeeper: Client
environment:java.home=/java/jre
2016-08-30 12:53:33,548 INFO [main] zookeeper.ZooKeeper: Client
environment:java.class.path=/hbase/bin/../conf:/java/lib/tools.jar:/hbase/bin/..:/hbase/bin/../lib/activation-1.1.jar:/hbase/bin/../lib/antisamy-1.4.3.jar:/hbase/bin/../lib/aopalliance-1.0.jar:/hbase/bin/../lib/apacheds-i18n-2.0.0-M15.jar:/hbase/bin/../lib/apacheds-kerberos-codec-2.0.0-M15.jar:/hbase/bin/../lib/api-asn1-api-1.0.0-M20.jar:/hbase/bin/../lib/api-util-1.0.0-M20.jar:/hbase/bin/../lib/asm-3.1.jar:/hbase/bin/../lib/avro-1.7.4.jar:/hbase/bin/../lib/batik-css-1.7.jar:/hbase/bin/../lib/batik-ext-1.7.jar:/hbase/bin/../lib/batik-util-1.7.jar:/hbase/bin/../lib/bsh-core-2.0b4.jar:/hbase/bin/../lib/commons-beanutils-1.7.0.jar:/hbase/bin/../lib/commons-beanutils-core-1.7.0.jar:/hbase/bin/../lib/commons-cli-1.2.jar:/hbase/bin/../lib/commons-codec-1.9.jar:/hbase/bin/../lib/commons-collections-3.2.2.jar:/hbase/bin/../lib/commons-compress-1.4.1.jar:/hbase/bin/../lib/commons-configuration-1.6.jar:/hbase/bin/../lib/commons-daemon-1.0.13.jar:/hbase/bin/../lib/commons-digester-1.8.jar:/hbase/bin/../lib/commons-el-1.0.jar:/hbase/bin/../lib/commons-fileupload-1.2.jar:/hbase/bin/../lib/commons-httpclient-3.1.jar:/hbase/bin/../lib/commons-io-2.4.jar:/hbase/bin/../lib/commons-lang-2.6.jar:/hbase/bin/../lib/commons-logging-1.2.jar:/hbase/bin/../lib/commons-math-2.2.jar:/hbase/bin/../lib/commons-math3-3.1.1.jar:/hbase/bin/../lib/commons-net-3.1.jar:/hbase/bin/../lib/curator-client-2.7.1.jar:/hbase/bin/../lib/curator-framework-2.7.1.jar:/hbase/bin/../lib/curator-recipes-2.7.1.jar:/hbase/bin/../lib/disruptor-3.3.0.jar:/hbase/bin/../lib/esapi-2.1.0.jar:/hbase/bin/../lib/findbugs-annotations-1.3.9-1.jar:/hbase/bin/../lib/gson-2.2.4.jar:/hbase/bin/../lib/guava-12.0.1.jar:/hbase/bin/../lib/guice-3.0.jar:/hbase/bin/../lib/guice-servlet-3.0.jar:/hbase/bin/../lib/hadoop-annotations-2.7.1.jar:/hbase/bin/../lib/hadoop-auth-2.7.1.jar:/hbase/bin/../lib/hadoop-client-2.7.1.jar:/hbase/bin/../lib/hadoop-common-2.7.1.jar:/hbase/bin/../lib/hadoop-distcp-2.7.1.jar:/hbase/bin/../lib/hadoop-hdfs-2.7.1.jar:/hbase/bin/../lib/hadoop-mapreduce-client-app-2.7.1.jar:/hbase/bin/../lib/hadoop-mapreduce-client-common-2.7.1.jar:/hbase/bin/../lib/hadoop-mapreduce-client-core-2.7.1.jar:/hbase/bin/../lib/hadoop-mapreduce-client-jobclient-2.7.1.jar:/hbase/bin/../lib/hadoop-mapreduce-client-shuffle-2.7.1.jar:/hbase/bin/../lib/hadoop-yarn-api-2.7.1.jar:/hbase/bin/../lib/hadoop-yarn-client-2.7.1.jar:/hbase/bin/../lib/hadoop-yarn-common-2.7.1.jar:/hbase/bin/../lib/hadoop-yarn-server-common-2.7.1.jar:/hbase/bin/../lib/hbase-annotations-2.0.0-SNAPSHOT.jar:/hbase/bin/../lib/hbase-annotations-2.0.0-SNAPSHOT-tests.jar:/hbase/bin/../lib/hbase-client-2.0.0-SNAPSHOT.jar:/hbase/bin/../lib/hbase-common-2.0.0-SNAPSHOT.jar:/hbase/bin/../lib/hbase-common-2.0.0-SNAPSHOT-tests.jar:/hbase/bin/../lib/hbase-examples-2.0.0-SNAPSHOT.jar:/hbase/bin/../lib/hbase-external-blockcache-2.0.0-SNAPSHOT.jar:/hbase/bin/../lib/hbase-hadoop2-compat-2.0.0-SNAPSHOT.jar:/hbase/bin/../lib/hbase-hadoop-compat-2.0.0-SNAPSHOT.jar:/hbase/bin/../lib/hbase-it-2.0.0-SNAPSHOT.jar:/hbase/bin/../lib/hbase-it-2.0.0-SNAPSHOT-tests.jar:/hbase/bin/../lib/hbase-prefix-tree-2.0.0-SNAPSHOT.jar:/hbase/bin/../lib/hbase-procedure-2.0.0-SNAPSHOT.jar:/hbase/bin/../lib/hbase-protocol-2.0.0-SNAPSHOT.jar:/hbase/bin/../lib/hbase-resource-bundle-2.0.0-SNAPSHOT.jar:/hbase/bin/../lib/hbase-rest-2.0.0-SNAPSHOT.jar:/hbase/bin/../lib/hbase-server-2.0.0-SNAPSHOT.jar:/hbase/bin/../lib/hbase-server-2.0.0-SNAPSHOT-tests.jar:/hbase/bin/../lib/hbase-shell-2.0.0-SNAPSHOT.jar:/hbase/bin/../lib/hbase-spark-2.0.0-SNAPSHOT.jar:/hbase/bin/../lib/hbase-thrift-2.0.0-SNAPSHOT.jar:/hbase/bin/../lib/htrace-core-3.1.0-incubating.jar:/hbase/bin/../lib/httpclient-4.2.5.jar:/hbase/bin/../lib/httpcore-4.4.1.jar:/hbase/bin/../lib/jackson-core-asl-1.9.13.jar:/hbase/bin/../lib/jackson-jaxrs-1.9.13.jar:/hbase/bin/../lib/jackson-mapper-asl-1.9.13.jar:/hbase/bin/../lib/jackson-xc-1.9.13.jar:/hbase/bin/../lib/jamon-runtime-2.4.1.jar:/hbase/bin/../lib/jasper-compiler-5.5.23.jar:/hbase/bin/../lib/jasper-runtime-5.5.23.jar:/hbase/bin/../lib/javax.inject-1.jar:/hbase/bin/../lib/java-xmlbuilder-0.4.jar:/hbase/bin/../lib/jaxb-api-2.2.2.jar:/hbase/bin/../lib/jaxb-impl-2.2.3-1.jar:/hbase/bin/../lib/jcodings-1.0.8.jar:/hbase/bin/../lib/jersey-client-1.9.jar:/hbase/bin/../lib/jersey-core-1.9.jar:/hbase/bin/../lib/jersey-guice-1.9.jar:/hbase/bin/../lib/jersey-json-1.9.jar:/hbase/bin/../lib/jersey-server-1.9.jar:/hbase/bin/../lib/jets3t-0.9.0.jar:/hbase/bin/../lib/jettison-1.3.3.jar:/hbase/bin/../lib/jetty-6.1.26.jar:/hbase/bin/../lib/jetty-sslengine-6.1.26.jar:/hbase/bin/../lib/jetty-util-6.1.26.jar:/hbase/bin/../lib/joni-2.1.2.jar:/hbase/bin/../lib/jruby-complete-1.6.8.jar:/hbase/bin/../lib/jsch-0.1.42.jar:/hbase/bin/../lib/jsp-2.1-6.1.14.jar:/hbase/bin/../lib/jsp-api-2.1-6.1.14.jar:/hbase/bin/../lib/jsr305-1.3.9.jar:/hbase/bin/../lib/junit-4.12.jar:/hbase/bin/../lib/leveldbjni-all-1.8.jar:/hbase/bin/../lib/libthrift-0.9.3.jar:/hbase/bin/../lib/log4j-1.2.17.jar:/hbase/bin/../lib/metrics-core-3.1.2.jar:/hbase/bin/../lib/nekohtml-1.9.12.jar:/hbase/bin/../lib/netty-all-4.0.30.Final.jar:/hbase/bin/../lib/paranamer-2.3.jar:/hbase/bin/../lib/protobuf-java-2.5.0.jar:/hbase/bin/../lib/servlet-api-2.5-6.1.14.jar:/hbase/bin/../lib/servlet-api-2.5.jar:/hbase/bin/../lib/slf4j-api-1.7.7.jar:/hbase/bin/../lib/slf4j-log4j12-1.6.1.jar:/hbase/bin/../lib/snappy-java-1.1.2.jar:/hbase/bin/../lib/spymemcached-2.11.6.jar:/hbase/bin/../lib/xalan-2.7.0.jar:/hbase/bin/../lib/xercesImpl-2.9.1.jar:/hbase/bin/../lib/xml-apis-1.3.03.jar:/hbase/bin/../lib/xml-apis-ext-1.3.04.jar:/hbase/bin/../lib/xmlenc-0.52.jar:/hbase/bin/../lib/xom-1.2.5.jar:/hbase/bin/../lib/xz-1.0.jar:/hbase/bin/../lib/zookeeper-3.4.6.jar:/hadoop/etc/hadoop:/hadoop/share/hadoop/common/lib/jets3t-0.9.0.jar:/hadoop/share/hadoop/common/lib/servlet-api-2.5.jar:/hadoop/share/hadoop/common/lib/hamcrest-core-1.3.jar:/hadoop/share/hadoop/common/lib/commons-compress-1.4.1.jar:/hadoop/share/hadoop/common/lib/htrace-core-3.1.0-incubating.jar:/hadoop/share/hadoop/common/lib/mockito-all-1.8.5.jar:/hadoop/share/hadoop/common/lib/hadoop-auth-2.7.1.jar:/hadoop/share/hadoop/common/lib/netty-3.6.2.Final.jar:/hadoop/share/hadoop/common/lib/commons-logging-1.1.3.jar:/hadoop/share/hadoop/common/lib/commons-httpclient-3.1.jar:/hadoop/share/hadoop/common/lib/commons-codec-1.4.jar:/hadoop/share/hadoop/common/lib/paranamer-2.3.jar:/hadoop/share/hadoop/common/lib/curator-client-2.7.1.jar:/hadoop/share/hadoop/common/lib/log4j-1.2.17.jar:/hadoop/share/hadoop/common/lib/zookeeper-3.4.6.jar:/hadoop/share/hadoop/common/lib/jetty-6.1.26.jar:/hadoop/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/hadoop/share/hadoop/common/lib/snappy-java-1.0.4.1.jar:/hadoop/share/hadoop/common/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/hadoop/share/hadoop/common/lib/apacheds-i18n-2.0.0-M15.jar:/hadoop/share/hadoop/common/lib/commons-collections-3.2.1.jar:/hadoop/share/hadoop/common/lib/jackson-mapper-asl-1.9.13.jar:/hadoop/share/hadoop/common/lib/jersey-server-1.9.jar:/hadoop/share/hadoop/common/lib/commons-configuration-1.6.jar:/hadoop/share/hadoop/common/lib/jsch-0.1.42.jar:/hadoop/share/hadoop/common/lib/commons-beanutils-core-1.8.0.jar:/hadoop/share/hadoop/common/lib/api-util-1.0.0-M20.jar:/hadoop/share/hadoop/common/lib/xz-1.0.jar:/hadoop/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/hadoop/share/hadoop/common/lib/httpclient-4.2.5.jar:/hadoop/share/hadoop/common/lib/httpcore-4.2.5.jar:/hadoop/share/hadoop/common/lib/commons-math3-3.1.1.jar:/hadoop/share/hadoop/common/lib/java-xmlbuilder-0.4.jar:/hadoop/share/hadoop/common/lib/gson-2.2.4.jar:/hadoop/share/hadoop/common/lib/commons-cli-1.2.jar:/hadoop/share/hadoop/common/lib/activation-1.1.jar:/hadoop/share/hadoop/common/lib/jsr305-3.0.0.jar:/hadoop/share/hadoop/common/lib/xmlenc-0.52.jar:/hadoop/share/hadoop/common/lib/commons-digester-1.8.jar:/hadoop/share/hadoop/common/lib/commons-lang-2.6.jar:/hadoop/share/hadoop/common/lib/jersey-json-1.9.jar:/hadoop/share/hadoop/common/lib/junit-4.11.jar:/hadoop/share/hadoop/common/lib/jackson-jaxrs-1.9.13.jar:/hadoop/share/hadoop/common/lib/hadoop-annotations-2.7.1.jar:/hadoop/share/hadoop/common/lib/commons-net-3.1.jar:/hadoop/share/hadoop/common/lib/jackson-core-asl-1.9.13.jar:/hadoop/share/hadoop/common/lib/jackson-xc-1.9.13.jar:/hadoop/share/hadoop/common/lib/avro-1.7.4.jar:/hadoop/share/hadoop/common/lib/jaxb-api-2.2.2.jar:/hadoop/share/hadoop/common/lib/slf4j-api-1.7.10.jar:/hadoop/share/hadoop/common/lib/stax-api-1.0-2.jar:/hadoop/share/hadoop/common/lib/guava-11.0.2.jar:/hadoop/share/hadoop/common/lib/curator-recipes-2.7.1.jar:/hadoop/share/hadoop/common/lib/commons-beanutils-1.7.0.jar:/hadoop/share/hadoop/common/lib/jsp-api-2.1.jar:/hadoop/share/hadoop/common/lib/commons-io-2.4.jar:/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar:/hadoop/share/hadoop/common/lib/jetty-util-6.1.26.jar:/hadoop/share/hadoop/common/lib/jersey-core-1.9.jar:/hadoop/share/hadoop/common/lib/api-asn1-api-1.0.0-M20.jar:/hadoop/share/hadoop/common/lib/jettison-1.1.jar:/hadoop/share/hadoop/common/lib/curator-framework-2.7.1.jar:/hadoop/share/hadoop/common/lib/asm-3.2.jar:/hadoop/share/hadoop/common/hadoop-common-2.7.1-tests.jar:/hadoop/share/hadoop/common/hadoop-common-2.7.1.jar:/hadoop/share/hadoop/common/hadoop-nfs-2.7.1.jar:/hadoop/share/hadoop/hdfs:/hadoop/share/hadoop/hdfs/lib/leveldbjni-all-1.8.jar:/hadoop/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/hadoop/share/hadoop/hdfs/lib/servlet-api-2.5.jar:/hadoop/share/hadoop/hdfs/lib/htrace-core-3.1.0-incubating.jar:/hadoop/share/hadoop/hdfs/lib/netty-3.6.2.Final.jar:/hadoop/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar:/hadoop/share/hadoop/hdfs/lib/commons-codec-1.4.jar:/hadoop/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/hadoop/share/hadoop/hdfs/lib/jetty-6.1.26.jar:/hadoop/share/hadoop/hdfs/lib/jackson-mapper-asl-1.9.13.jar:/hadoop/share/hadoop/hdfs/lib/jersey-server-1.9.jar:/hadoop/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/hadoop/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/hadoop/share/hadoop/hdfs/lib/jsr305-3.0.0.jar:/hadoop/share/hadoop/hdfs/lib/xmlenc-0.52.jar:/hadoop/share/hadoop/hdfs/lib/commons-lang-2.6.jar:/hadoop/share/hadoop/hdfs/lib/jackson-core-asl-1.9.13.jar:/hadoop/share/hadoop/hdfs/lib/xercesImpl-2.9.1.jar:/hadoop/share/hadoop/hdfs/lib/guava-11.0.2.jar:/hadoop/share/hadoop/hdfs/lib/xml-apis-1.3.04.jar:/hadoop/share/hadoop/hdfs/lib/commons-io-2.4.jar:/hadoop/share/hadoop/hdfs/lib/jetty-util-6.1.26.jar:/hadoop/share/hadoop/hdfs/lib/jersey-core-1.9.jar:/hadoop/share/hadoop/hdfs/lib/netty-all-4.0.23.Final.jar:/hadoop/share/hadoop/hdfs/lib/asm-3.2.jar:/hadoop/share/hadoop/hdfs/hadoop-hdfs-2.7.1.jar:/hadoop/share/hadoop/hdfs/hadoop-hdfs-2.7.1-tests.jar:/hadoop/share/hadoop/hdfs/hadoop-hdfs-nfs-2.7.1.jar:/hadoop/share/hadoop/yarn/lib/leveldbjni-all-1.8.jar:/hadoop/share/hadoop/yarn/lib/servlet-api-2.5.jar:/hadoop/share/hadoop/yarn/lib/commons-compress-1.4.1.jar:/hadoop/share/hadoop/yarn/lib/netty-3.6.2.Final.jar:/hadoop/share/hadoop/yarn/lib/commons-logging-1.1.3.jar:/hadoop/share/hadoop/yarn/lib/commons-codec-1.4.jar:/hadoop/share/hadoop/yarn/lib/jersey-client-1.9.jar:/hadoop/share/hadoop/yarn/lib/log4j-1.2.17.jar:/hadoop/share/hadoop/yarn/lib/zookeeper-3.4.6.jar:/hadoop/share/hadoop/yarn/lib/jetty-6.1.26.jar:/hadoop/share/hadoop/yarn/lib/jaxb-impl-2.2.3-1.jar:/hadoop/share/hadoop/yarn/lib/commons-collections-3.2.1.jar:/hadoop/share/hadoop/yarn/lib/zookeeper-3.4.6-tests.jar:/hadoop/share/hadoop/yarn/lib/jackson-mapper-asl-1.9.13.jar:/hadoop/share/hadoop/yarn/lib/jersey-server-1.9.jar:/hadoop/share/hadoop/yarn/lib/xz-1.0.jar:/hadoop/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar:/hadoop/share/hadoop/yarn/lib/commons-cli-1.2.jar:/hadoop/share/hadoop/yarn/lib/activation-1.1.jar:/hadoop/share/hadoop/yarn/lib/jsr305-3.0.0.jar:/hadoop/share/hadoop/yarn/lib/guice-3.0.jar:/hadoop/share/hadoop/yarn/lib/commons-lang-2.6.jar:/hadoop/share/hadoop/yarn/lib/javax.inject-1.jar:/hadoop/share/hadoop/yarn/lib/jersey-json-1.9.jar:/hadoop/share/hadoop/yarn/lib/jackson-jaxrs-1.9.13.jar:/hadoop/share/hadoop/yarn/lib/jackson-core-asl-1.9.13.jar:/hadoop/share/hadoop/yarn/lib/jackson-xc-1.9.13.jar:/hadoop/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/hadoop/share/hadoop/yarn/lib/jaxb-api-2.2.2.jar:/hadoop/share/hadoop/yarn/lib/jersey-guice-1.9.jar:/hadoop/share/hadoop/yarn/lib/stax-api-1.0-2.jar:/hadoop/share/hadoop/yarn/lib/guava-11.0.2.jar:/hadoop/share/hadoop/yarn/lib/commons-io-2.4.jar:/hadoop/share/hadoop/yarn/lib/aopalliance-1.0.jar:/hadoop/share/hadoop/yarn/lib/jetty-util-6.1.26.jar:/hadoop/share/hadoop/yarn/lib/jersey-core-1.9.jar:/hadoop/share/hadoop/yarn/lib/jettison-1.1.jar:/hadoop/share/hadoop/yarn/lib/asm-3.2.jar:/hadoop/share/hadoop/yarn/hadoop-yarn-api-2.7.1.jar:/hadoop/share/hadoop/yarn/hadoop-yarn-registry-2.7.1.jar:/hadoop/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.7.1.jar:/hadoop/share/hadoop/yarn/hadoop-yarn-client-2.7.1.jar:/hadoop/share/hadoop/yarn/hadoop-yarn-server-tests-2.7.1.jar:/hadoop/share/hadoop/yarn/hadoop-yarn-common-2.7.1.jar:/hadoop/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.7.1.jar:/hadoop/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.7.1.jar:/hadoop/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.7.1.jar:/hadoop/share/hadoop/yarn/hadoop-yarn-server-common-2.7.1.jar:/hadoop/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.7.1.jar:/hadoop/share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-2.7.1.jar:/hadoop/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.7.1.jar:/hadoop/share/hadoop/mapreduce/lib/leveldbjni-all-1.8.jar:/hadoop/share/hadoop/mapreduce/lib/hamcrest-core-1.3.jar:/hadoop/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar:/hadoop/share/hadoop/mapreduce/lib/netty-3.6.2.Final.jar:/hadoop/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/hadoop/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/hadoop/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar:/hadoop/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.9.13.jar:/hadoop/share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/hadoop/share/hadoop/mapreduce/lib/xz-1.0.jar:/hadoop/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar:/hadoop/share/hadoop/mapreduce/lib/guice-3.0.jar:/hadoop/share/hadoop/mapreduce/lib/javax.inject-1.jar:/hadoop/share/hadoop/mapreduce/lib/junit-4.11.jar:/hadoop/share/hadoop/mapreduce/lib/hadoop-annotations-2.7.1.jar:/hadoop/share/hadoop/mapreduce/lib/jackson-core-asl-1.9.13.jar:/hadoop/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/hadoop/share/hadoop/mapreduce/lib/avro-1.7.4.jar:/hadoop/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/hadoop/share/hadoop/mapreduce/lib/commons-io-2.4.jar:/hadoop/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/hadoop/share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/hadoop/share/hadoop/mapreduce/lib/asm-3.2.jar:/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.7.1.jar:/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.1.jar:/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.7.1.jar:/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.7.1.jar:/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.7.1.jar:/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.7.1.jar:/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.7.1.jar:/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.7.1.jar:/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.7.1-tests.jar:/contrib/capacity-scheduler/*.jar
2016-08-30 12:53:33,548 INFO [main] zookeeper.ZooKeeper: Client
environment:java.library.path=/hadoop/lib/native
2016-08-30 12:53:33,549 INFO [main] zookeeper.ZooKeeper: Client
environment:java.io.tmpdir=/tmp
2016-08-30 12:53:33,549 INFO [main] zookeeper.ZooKeeper: Client
environment:java.compiler=<NA>
2016-08-30 12:53:33,549 INFO [main] zookeeper.ZooKeeper: Client
environment:os.name=Linux
2016-08-30 12:53:33,549 INFO [main] zookeeper.ZooKeeper: Client
environment:os.arch=amd64
2016-08-30 12:53:33,549 INFO [main] zookeeper.ZooKeeper: Client
environment:os.version=3.13.0-85-generic
2016-08-30 12:53:33,549 INFO [main] zookeeper.ZooKeeper: Client
environment:user.name=root
2016-08-30 12:53:33,549 INFO [main] zookeeper.ZooKeeper: Client
environment:user.home=/root
2016-08-30 12:53:33,549 INFO [main] zookeeper.ZooKeeper: Client
environment:user.dir=/root
2016-08-30 12:53:33,549 INFO [main] zookeeper.ZooKeeper: Initiating client
connection, connectString=node-1.network3783:2181 sessionTimeout=90000
watcher=hconnection-0x5aebe8900x0, quorum=node-1.network3783:2181,
baseZNode=/hbase
2016-08-30 12:53:33,566 INFO [main-SendThread(node-1.network3783:2181)]
zookeeper.ClientCnxn: Opening socket connection to server
node-1.network3783/192.168.127.2:2181. Will not attempt to authenticate using
SASL (unknown error)
2016-08-30 12:53:33,571 INFO [main-SendThread(node-1.network3783:2181)]
zookeeper.ClientCnxn: Socket connection established to
node-1.network3783/192.168.127.2:2181, initiating session
2016-08-30 12:53:33,577 INFO [main-SendThread(node-1.network3783:2181)]
zookeeper.ClientCnxn: Session establishment complete on server
node-1.network3783/192.168.127.2:2181, sessionid = 0x156dd0352f20007,
negotiated timeout = 90000
2016-08-30 12:53:34,339 INFO [main] zookeeper.RecoverableZooKeeper: Process
identifier=hconnection-0x4ba534b0 connecting to ZooKeeper
ensemble=node-1.network3783:2181
2016-08-30 12:53:34,339 INFO [main] zookeeper.ZooKeeper: Initiating client
connection, connectString=node-1.network3783:2181 sessionTimeout=90000
watcher=hconnection-0x4ba534b00x0, quorum=node-1.network3783:2181,
baseZNode=/hbase
2016-08-30 12:53:34,340 INFO [main-SendThread(node-1.network3783:2181)]
zookeeper.ClientCnxn: Opening socket connection to server
node-1.network3783/192.168.127.2:2181. Will not attempt to authenticate using
SASL (unknown error)
2016-08-30 12:53:34,340 INFO [main-SendThread(node-1.network3783:2181)]
zookeeper.ClientCnxn: Socket connection established to
node-1.network3783/192.168.127.2:2181, initiating session
2016-08-30 12:53:34,342 INFO [main-SendThread(node-1.network3783:2181)]
zookeeper.ClientCnxn: Session establishment complete on server
node-1.network3783/192.168.127.2:2181, sessionid = 0x156dd0352f20008,
negotiated timeout = 90000
2016-08-30 12:53:34,349 INFO [main] hbase.IntegrationTestBackupRestore:
Cluster initialized
2016-08-30 12:53:34,354 INFO [main] client.HBaseAdmin: Started disable of
IntegrationTestBackupRestore.table1
2016-08-30 12:53:34,802 INFO [main] client.HBaseAdmin: Operation: DISABLE,
Table Name: default:IntegrationTestBackupRestore.table1 failed with
IntegrationTestBackupRestore.table1
2016-08-30 12:53:34,802 INFO [main] client.HBaseAdmin: Started disable of
IntegrationTestBackupRestore.table2
2016-08-30 12:53:35,217 INFO [main] client.HBaseAdmin: Operation: DISABLE,
Table Name: default:IntegrationTestBackupRestore.table2 failed with
IntegrationTestBackupRestore.table2
2016-08-30 12:53:35,222 INFO [main] hbase.Waiter: Waiting up to [30,000]
milli-secs(wait.for.ratio=[1])
2016-08-30 12:53:35,396 INFO [main] zookeeper.RecoverableZooKeeper: Process
identifier=hbase-admin-on-hconnection-0x4ba534b0 connecting to ZooKeeper
ensemble=node-1.network3783:2181
2016-08-30 12:53:35,396 INFO [main] zookeeper.ZooKeeper: Initiating client
connection, connectString=node-1.network3783:2181 sessionTimeout=90000
watcher=hbase-admin-on-hconnection-0x4ba534b00x0,
quorum=node-1.network3783:2181, baseZNode=/hbase
2016-08-30 12:53:35,397 INFO [main-SendThread(node-1.network3783:2181)]
zookeeper.ClientCnxn: Opening socket connection to server
node-1.network3783/192.168.127.2:2181. Will not attempt to authenticate using
SASL (unknown error)
2016-08-30 12:53:35,397 INFO [main-SendThread(node-1.network3783:2181)]
zookeeper.ClientCnxn: Socket connection established to
node-1.network3783/192.168.127.2:2181, initiating session
2016-08-30 12:53:35,399 INFO [main-SendThread(node-1.network3783:2181)]
zookeeper.ClientCnxn: Session establishment complete on server
node-1.network3783/192.168.127.2:2181, sessionid = 0x156dd0352f20009,
negotiated timeout = 90000
2016-08-30 12:53:35,404 INFO [main] zookeeper.ZooKeeper: Session:
0x156dd0352f20009 closed
2016-08-30 12:53:35,404 INFO [main-EventThread] zookeeper.ClientCnxn:
EventThread shut down
2016-08-30 12:53:35,458 INFO [pool-5-thread-1] tool.Canary: read from region
hbase:backup,,1472586809239.42c296ae4fcb242c81ce6badfb0a1bb9. column family
meta in 47ms
2016-08-30 12:53:35,460 INFO [pool-5-thread-1] tool.Canary: read from region
hbase:backup,,1472586809239.42c296ae4fcb242c81ce6badfb0a1bb9. column family
session in 2ms
2016-08-30 12:53:35,460 INFO [main] hbase.IntegrationTestBackupRestore:
Cluster ready
2016-08-30 12:53:35,471 INFO [main] fs.HFileSystem: Added intercepting call to
namenode#getBlockLocations so can do block reordering using class class
org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks
2016-08-30 12:53:35,474 INFO [main] fs.HFileSystem: Added intercepting call to
namenode#getBlockLocations so can do block reordering using class class
org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks
2016-08-30 12:53:35,515 INFO [main] hbase.IntegrationTestBackupRestore:
Creating table IntegrationTestBackupRestore.table1 with 10 splits.
2016-08-30 12:53:35,515 INFO [main] zookeeper.RecoverableZooKeeper: Process
identifier=hconnection-0x407cf41 connecting to ZooKeeper
ensemble=node-1.network3783:2181
2016-08-30 12:53:35,515 INFO [main] zookeeper.ZooKeeper: Initiating client
connection, connectString=node-1.network3783:2181 sessionTimeout=90000
watcher=hconnection-0x407cf410x0, quorum=node-1.network3783:2181,
baseZNode=/hbase
2016-08-30 12:53:35,516 INFO [main-SendThread(node-1.network3783:2181)]
zookeeper.ClientCnxn: Opening socket connection to server
node-1.network3783/192.168.127.2:2181. Will not attempt to authenticate using
SASL (unknown error)
2016-08-30 12:53:35,516 INFO [main-SendThread(node-1.network3783:2181)]
zookeeper.ClientCnxn: Socket connection established to
node-1.network3783/192.168.127.2:2181, initiating session
2016-08-30 12:53:35,518 INFO [main-SendThread(node-1.network3783:2181)]
zookeeper.ClientCnxn: Session establishment complete on server
node-1.network3783/192.168.127.2:2181, sessionid = 0x156dd0352f2000a,
negotiated timeout = 90000
2016-08-30 12:53:35,525 INFO [main] hbase.HBaseCommonTestingUtility: Number of
live regionservers: 2, pre-splitting table into 20 regions (regions per server:
10)
2016-08-30 12:53:37,764 INFO [main] client.HBaseAdmin: Operation: CREATE,
Table Name: default:IntegrationTestBackupRestore.table1 completed
2016-08-30 12:53:37,765 INFO [main] client.ConnectionImplementation: Closing
master protocol: MasterService
2016-08-30 12:53:37,765 INFO [main] client.ConnectionImplementation: Closing
zookeeper sessionid=0x156dd0352f2000a
2016-08-30 12:53:37,766 INFO [main] zookeeper.ZooKeeper: Session:
0x156dd0352f2000a closed
2016-08-30 12:53:37,766 INFO [main-EventThread] zookeeper.ClientCnxn:
EventThread shut down
2016-08-30 12:53:37,767 INFO [main] hbase.Waiter: Waiting up to [30,000]
milli-secs(wait.for.ratio=[1])
2016-08-30 12:53:37,792 INFO [main] zookeeper.RecoverableZooKeeper: Process
identifier=hbase-admin-on-hconnection-0x4ba534b0 connecting to ZooKeeper
ensemble=node-1.network3783:2181
2016-08-30 12:53:37,792 INFO [main] zookeeper.ZooKeeper: Initiating client
connection, connectString=node-1.network3783:2181 sessionTimeout=90000
watcher=hbase-admin-on-hconnection-0x4ba534b00x0,
quorum=node-1.network3783:2181, baseZNode=/hbase
2016-08-30 12:53:37,793 INFO [main-SendThread(node-1.network3783:2181)]
zookeeper.ClientCnxn: Opening socket connection to server
node-1.network3783/192.168.127.2:2181. Will not attempt to authenticate using
SASL (unknown error)
2016-08-30 12:53:37,793 INFO [main-SendThread(node-1.network3783:2181)]
zookeeper.ClientCnxn: Socket connection established to
node-1.network3783/192.168.127.2:2181, initiating session
2016-08-30 12:53:37,797 INFO [main-SendThread(node-1.network3783:2181)]
zookeeper.ClientCnxn: Session establishment complete on server
node-1.network3783/192.168.127.2:2181, sessionid = 0x156dd0352f2000b,
negotiated timeout = 90000
2016-08-30 12:53:37,809 INFO [main] zookeeper.ZooKeeper: Session:
0x156dd0352f2000b closed
2016-08-30 12:53:37,809 INFO [main-EventThread] zookeeper.ClientCnxn:
EventThread shut down
2016-08-30 12:53:37,898 INFO [pool-6-thread-1] tool.Canary: read from region
IntegrationTestBackupRestore.table1,,1472586815541.4b8b7d6abffb52b6303297593ff9b160.
column family f in 84ms
2016-08-30 12:53:37,909 INFO [pool-6-thread-1] tool.Canary: read from region
IntegrationTestBackupRestore.table1,\x0C\xCC\xCC\xCC\xCC\xCC\xCC\xCC,1472586815541.90d6dea86f397319aa630eb0adf173a2.
column family f in 9ms
2016-08-30 12:53:37,913 INFO [pool-6-thread-1] tool.Canary: read from region
IntegrationTestBackupRestore.table1,\x19\x99\x99\x99\x99\x99\x99\x98,1472586815541.286bfbdfb742e98e033f2d0b002f726b.
column family f in 2ms
2016-08-30 12:53:37,917 INFO [pool-6-thread-1] tool.Canary: read from region
IntegrationTestBackupRestore.table1,&ffffffd,1472586815541.0f2feb147f144f8e26501ef94c3f0616.
column family f in 2ms
2016-08-30 12:53:37,921 INFO [pool-6-thread-1] tool.Canary: read from region
IntegrationTestBackupRestore.table1,33333330,1472586815541.c08bd7761aeab01fd009b3a9fe83d631.
column family f in 1ms
2016-08-30 12:53:37,925 INFO [pool-6-thread-1] tool.Canary: read from region
IntegrationTestBackupRestore.table1,?\xFF\xFF\xFF\xFF\xFF\xFF\xFC,1472586815541.813641f9cbaefdb9597de03f115ae78c.
column family f in 2ms
2016-08-30 12:53:37,928 INFO [pool-6-thread-1] tool.Canary: read from region
IntegrationTestBackupRestore.table1,L\xCC\xCC\xCC\xCC\xCC\xCC\xC8,1472586815541.785a28fe24124b0764f45bd1a3752e7e.
column family f in 1ms
2016-08-30 12:53:37,932 INFO [pool-6-thread-1] tool.Canary: read from region
IntegrationTestBackupRestore.table1,Y\x99\x99\x99\x99\x99\x99\x94,1472586815541.488d9d8750b7bf1ecd2f8495b141ebaa.
column family f in 2ms
2016-08-30 12:53:37,936 INFO [pool-6-thread-1] tool.Canary: read from region
IntegrationTestBackupRestore.table1,fffffff`,1472586815541.80dc4db4f4327732752d042afc3087c0.
column family f in 2ms
2016-08-30 12:53:37,939 INFO [pool-6-thread-1] tool.Canary: read from region
IntegrationTestBackupRestore.table1,s333333,,1472586815541.7a2847dac90ecb8dc7e0cdfd6c904a4e.
column family f in 2ms
2016-08-30 12:53:37,942 INFO [pool-6-thread-1] tool.Canary: read from region
IntegrationTestBackupRestore.table1,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xF8,1472586815541.11dfd02ca92d9c0fef970d883e5db001.
column family f in 2ms
2016-08-30 12:53:37,945 INFO [pool-6-thread-1] tool.Canary: read from region
IntegrationTestBackupRestore.table1,\x8C\xCC\xCC\xCC\xCC\xCC\xCC\xC4,1472586815541.a55d6e65b8401e39bb049b6b1869bffe.
column family f in 1ms
2016-08-30 12:53:37,948 INFO [pool-6-thread-1] tool.Canary: read from region
IntegrationTestBackupRestore.table1,\x99\x99\x99\x99\x99\x99\x99\x90,1472586815541.4fd2630e097c60033470f986bc13a07a.
column family f in 1ms
2016-08-30 12:53:37,951 INFO [pool-6-thread-1] tool.Canary: read from region
IntegrationTestBackupRestore.table1,\xA6ffffff\x5C,1472586815541.70d150e93cc188648d5b767db55904b4.
column family f in 1ms
2016-08-30 12:53:37,954 INFO [pool-6-thread-1] tool.Canary: read from region
IntegrationTestBackupRestore.table1,\xB3333333(,1472586815541.5fd5b779123d1b45ea812d89bf1fd9a2.
column family f in 1ms
2016-08-30 12:53:37,957 INFO [pool-6-thread-1] tool.Canary: read from region
IntegrationTestBackupRestore.table1,\xBF\xFF\xFF\xFF\xFF\xFF\xFF\xF4,1472586815541.303a0016b7bcabb50757339032857c81.
column family f in 1ms
2016-08-30 12:53:37,960 INFO [pool-6-thread-1] tool.Canary: read from region
IntegrationTestBackupRestore.table1,\xCC\xCC\xCC\xCC\xCC\xCC\xCC\xC0,1472586815541.bb1adbe9e2d0c8fa4be20c8413359389.
column family f in 1ms
2016-08-30 12:53:37,962 INFO [pool-6-thread-1] tool.Canary: read from region
IntegrationTestBackupRestore.table1,\xD9\x99\x99\x99\x99\x99\x99\x8C,1472586815541.bf269994f324da27f6305a09461338b6.
column family f in 1ms
2016-08-30 12:53:37,965 INFO [pool-6-thread-1] tool.Canary: read from region
IntegrationTestBackupRestore.table1,\xE6ffffffX,1472586815541.46f25283869d4d9b780e2edeb579079f.
column family f in 1ms
2016-08-30 12:53:37,968 INFO [pool-6-thread-1] tool.Canary: read from region
IntegrationTestBackupRestore.table1,\xF3333333$,1472586815541.4bb0c0afdc6b92cbdfdc6172e63c600c.
column family f in 1ms
2016-08-30 12:53:37,968 INFO [main] hbase.IntegrationTestBackupRestore:
Pre-split table created successfully in 2453ms.
2016-08-30 12:53:37,969 INFO [main] hbase.IntegrationTestBackupRestore:
Creating table IntegrationTestBackupRestore.table2 with 10 splits.
2016-08-30 12:53:37,969 INFO [main] zookeeper.RecoverableZooKeeper: Process
identifier=hconnection-0x1b5bc39d connecting to ZooKeeper
ensemble=node-1.network3783:2181
2016-08-30 12:53:37,969 INFO [main] zookeeper.ZooKeeper: Initiating client
connection, connectString=node-1.network3783:2181 sessionTimeout=90000
watcher=hconnection-0x1b5bc39d0x0, quorum=node-1.network3783:2181,
baseZNode=/hbase
2016-08-30 12:53:37,970 INFO [main-SendThread(node-1.network3783:2181)]
zookeeper.ClientCnxn: Opening socket connection to server
node-1.network3783/192.168.127.2:2181. Will not attempt to authenticate using
SASL (unknown error)
2016-08-30 12:53:37,971 INFO [main-SendThread(node-1.network3783:2181)]
zookeeper.ClientCnxn: Socket connection established to
node-1.network3783/192.168.127.2:2181, initiating session
2016-08-30 12:53:37,973 INFO [main-SendThread(node-1.network3783:2181)]
zookeeper.ClientCnxn: Session establishment complete on server
node-1.network3783/192.168.127.2:2181, sessionid = 0x156dd0352f2000c,
negotiated timeout = 90000
2016-08-30 12:53:37,979 INFO [main] hbase.HBaseCommonTestingUtility: Number of
live regionservers: 2, pre-splitting table into 20 regions (regions per server:
10)
2016-08-30 12:53:40,196 INFO [main] client.HBaseAdmin: Operation: CREATE,
Table Name: default:IntegrationTestBackupRestore.table2 completed
2016-08-30 12:53:40,196 INFO [main] client.ConnectionImplementation: Closing
master protocol: MasterService
2016-08-30 12:53:40,196 INFO [main] client.ConnectionImplementation: Closing
zookeeper sessionid=0x156dd0352f2000c
2016-08-30 12:53:40,198 INFO [main] zookeeper.ZooKeeper: Session:
0x156dd0352f2000c closed
2016-08-30 12:53:40,198 INFO [main-EventThread] zookeeper.ClientCnxn:
EventThread shut down
2016-08-30 12:53:40,199 INFO [main] hbase.Waiter: Waiting up to [30,000]
milli-secs(wait.for.ratio=[1])
2016-08-30 12:53:40,214 INFO [main] zookeeper.RecoverableZooKeeper: Process
identifier=hbase-admin-on-hconnection-0x4ba534b0 connecting to ZooKeeper
ensemble=node-1.network3783:2181
2016-08-30 12:53:40,214 INFO [main] zookeeper.ZooKeeper: Initiating client
connection, connectString=node-1.network3783:2181 sessionTimeout=90000
watcher=hbase-admin-on-hconnection-0x4ba534b00x0,
quorum=node-1.network3783:2181, baseZNode=/hbase
2016-08-30 12:53:40,215 INFO [main-SendThread(node-1.network3783:2181)]
zookeeper.ClientCnxn: Opening socket connection to server
node-1.network3783/192.168.127.2:2181. Will not attempt to authenticate using
SASL (unknown error)
2016-08-30 12:53:40,215 INFO [main-SendThread(node-1.network3783:2181)]
zookeeper.ClientCnxn: Socket connection established to
node-1.network3783/192.168.127.2:2181, initiating session
2016-08-30 12:53:40,217 INFO [main-SendThread(node-1.network3783:2181)]
zookeeper.ClientCnxn: Session establishment complete on server
node-1.network3783/192.168.127.2:2181, sessionid = 0x156dd0352f2000d,
negotiated timeout = 90000
2016-08-30 12:53:40,226 INFO [main] zookeeper.ZooKeeper: Session:
0x156dd0352f2000d closed
2016-08-30 12:53:40,226 INFO [main-EventThread] zookeeper.ClientCnxn:
EventThread shut down
2016-08-30 12:53:40,284 INFO [pool-7-thread-1] tool.Canary: read from region
IntegrationTestBackupRestore.table2,,1472586817981.0552a7e8239ff59cffdd52dbc459377a.
column family f in 56ms
2016-08-30 12:53:40,288 INFO [pool-7-thread-1] tool.Canary: read from region
IntegrationTestBackupRestore.table2,\x0C\xCC\xCC\xCC\xCC\xCC\xCC\xCC,1472586817981.5e37595008fb97e2b4087384be4ee43c.
column family f in 1ms
2016-08-30 12:53:40,291 INFO [pool-7-thread-1] tool.Canary: read from region
IntegrationTestBackupRestore.table2,\x19\x99\x99\x99\x99\x99\x99\x98,1472586817981.2dc76f940f31e6cd73d5e3b457edd809.
column family f in 2ms
2016-08-30 12:53:40,294 INFO [pool-7-thread-1] tool.Canary: read from region
IntegrationTestBackupRestore.table2,&ffffffd,1472586817981.7cd15b956c568d8fe2c271d0f7529dc6.
column family f in 1ms
2016-08-30 12:53:40,297 INFO [pool-7-thread-1] tool.Canary: read from region
IntegrationTestBackupRestore.table2,33333330,1472586817981.c52826f5d784ab6f377b9bfff1512bdf.
column family f in 1ms
2016-08-30 12:53:40,300 INFO [pool-7-thread-1] tool.Canary: read from region
IntegrationTestBackupRestore.table2,?\xFF\xFF\xFF\xFF\xFF\xFF\xFC,1472586817981.def8387cd8d5cad27587c816e00f4ccd.
column family f in 1ms
2016-08-30 12:53:40,303 INFO [pool-7-thread-1] tool.Canary: read from region
IntegrationTestBackupRestore.table2,L\xCC\xCC\xCC\xCC\xCC\xCC\xC8,1472586817981.cba27916cc13462aa84b35da56771bdc.
column family f in 1ms
2016-08-30 12:53:40,306 INFO [pool-7-thread-1] tool.Canary: read from region
IntegrationTestBackupRestore.table2,Y\x99\x99\x99\x99\x99\x99\x94,1472586817981.1afa3f797d1caf2880528e48dd729201.
column family f in 1ms
2016-08-30 12:53:40,309 INFO [pool-7-thread-1] tool.Canary: read from region
IntegrationTestBackupRestore.table2,fffffff`,1472586817981.c8e234c6b46416b04b987868ef77ebec.
column family f in 1ms
2016-08-30 12:53:40,312 INFO [pool-7-thread-1] tool.Canary: read from region
IntegrationTestBackupRestore.table2,s333333,,1472586817981.929dcc6d17f216d2fd0585d6657a3e83.
column family f in 1ms
2016-08-30 12:53:40,315 INFO [pool-7-thread-1] tool.Canary: read from region
IntegrationTestBackupRestore.table2,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xF8,1472586817981.760b91ced3e95329071c72163e6a75f2.
column family f in 0ms
2016-08-30 12:53:40,318 INFO [pool-7-thread-1] tool.Canary: read from region
IntegrationTestBackupRestore.table2,\x8C\xCC\xCC\xCC\xCC\xCC\xCC\xC4,1472586817981.9724204ccf52e88a384dcb65bf4eaee6.
column family f in 2ms
2016-08-30 12:53:40,321 INFO [pool-7-thread-1] tool.Canary: read from region
IntegrationTestBackupRestore.table2,\x99\x99\x99\x99\x99\x99\x99\x90,1472586817981.e30f9ac8f614620d815afb1029e661f7.
column family f in 1ms
2016-08-30 12:53:40,324 INFO [pool-7-thread-1] tool.Canary: read from region
IntegrationTestBackupRestore.table2,\xA6ffffff\x5C,1472586817981.8143586be9da0d86e206c5d77a15e708.
column family f in 1ms
2016-08-30 12:53:40,326 INFO [pool-7-thread-1] tool.Canary: read from region
IntegrationTestBackupRestore.table2,\xB3333333(,1472586817981.2c5f69f1be0c7ec31d637e3de6529b59.
column family f in 1ms
2016-08-30 12:53:40,328 INFO [pool-7-thread-1] tool.Canary: read from region
IntegrationTestBackupRestore.table2,\xBF\xFF\xFF\xFF\xFF\xFF\xFF\xF4,1472586817981.9af58b536d7eca0787b708dc54c1590b.
column family f in 1ms
2016-08-30 12:53:40,331 INFO [pool-7-thread-1] tool.Canary: read from region
IntegrationTestBackupRestore.table2,\xCC\xCC\xCC\xCC\xCC\xCC\xCC\xC0,1472586817981.6a3d221918df3822d99e2e2ee225f379.
column family f in 1ms
2016-08-30 12:53:40,333 INFO [pool-7-thread-1] tool.Canary: read from region
IntegrationTestBackupRestore.table2,\xD9\x99\x99\x99\x99\x99\x99\x8C,1472586817981.0ba6877668554092cf1da836eb7b4133.
column family f in 1ms
2016-08-30 12:53:40,336 INFO [pool-7-thread-1] tool.Canary: read from region
IntegrationTestBackupRestore.table2,\xE6ffffffX,1472586817981.f9774ec68f96d43f25985b89328a0f20.
column family f in 1ms
2016-08-30 12:53:40,338 INFO [pool-7-thread-1] tool.Canary: read from region
IntegrationTestBackupRestore.table2,\xF3333333$,1472586817981.5f8221705fd626fb12fda15f62a49fa2.
column family f in 1ms
2016-08-30 12:53:40,338 INFO [main] hbase.IntegrationTestBackupRestore:
Pre-split table created successfully in 2369ms.
2016-08-30 12:54:05,095 INFO [main] hbase.IntegrationTestBackupRestore: create
full backup image for all tables
2016-08-30 12:54:05,104 INFO [main] util.BackupClientUtil: Backup root dir
hdfs://node-1.network3783:8020/user/root/test-data/0919b2b6-c990-4d3e-9aa4-c0d249014545/backupIT
does not exist. Will be created.
2016-08-30 12:54:53,367 INFO [main] client.HBaseAdmin: Operation: BACKUP,
Table Name: hbase:backup failed with Failed of exporting snapshot
snapshot_1472586852315_default_IntegrationTestBackupRestore.table2 to
hdfs://node-1.network3783:8020/user/root/test-data/0919b2b6-c990-4d3e-9aa4-c0d249014545/backupIT/backup_1472586845117/default/IntegrationTestBackupRestore.table2/
with reason code 1
2016-08-30 12:54:53,368 ERROR [main] util.AbstractHBaseTool: Error running
command-line tool
java.io.IOException: Failed of exporting snapshot
snapshot_1472586852315_default_IntegrationTestBackupRestore.table2 to
hdfs://node-1.network3783:8020/user/root/test-data/0919b2b6-c990-4d3e-9aa4-c0d249014545/backupIT/backup_1472586845117/default/IntegrationTestBackupRestore.table2/
with reason code 1
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at
org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:106)
at
org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:95)
at
org.apache.hadoop.hbase.util.ForeignExceptionUtil.toIOException(ForeignExceptionUtil.java:45)
at
org.apache.hadoop.hbase.client.HBaseAdmin$TableBackupFuture.convertResult(HBaseAdmin.java:1619)
at
org.apache.hadoop.hbase.client.HBaseAdmin$TableBackupFuture.convertResult(HBaseAdmin.java:1598)
at
org.apache.hadoop.hbase.client.HBaseAdmin$ProcedureFuture.waitProcedureResult(HBaseAdmin.java:3123)
at
org.apache.hadoop.hbase.client.HBaseAdmin$ProcedureFuture.get(HBaseAdmin.java:3057)
at org.apache.hadoop.hbase.client.HBaseAdmin.get(HBaseAdmin.java:1837)
at
org.apache.hadoop.hbase.client.HBaseAdmin.backupTables(HBaseAdmin.java:1592)
at
org.apache.hadoop.hbase.client.HBaseBackupAdmin.backupTables(HBaseBackupAdmin.java:418)
at
org.apache.hadoop.hbase.IntegrationTestBackupRestore.runTest(IntegrationTestBackupRestore.java:165)
at
org.apache.hadoop.hbase.IntegrationTestBackupRestore.testBackupRestore(IntegrationTestBackupRestore.java:123)
at
org.apache.hadoop.hbase.IntegrationTestBackupRestore.runTestFromCommandLine(IntegrationTestBackupRestore.java:248)
at
org.apache.hadoop.hbase.IntegrationTestBase.doWork(IntegrationTestBase.java:123)
at
org.apache.hadoop.hbase.util.AbstractHBaseTool.run(AbstractHBaseTool.java:112)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at
org.apache.hadoop.hbase.IntegrationTestBackupRestore.main(IntegrationTestBackupRestore.java:292)
Caused by: org.apache.hadoop.ipc.RemoteException(java.io.IOException): Failed
of exporting snapshot
snapshot_1472586852315_default_IntegrationTestBackupRestore.table2 to
hdfs://node-1.network3783:8020/user/root/test-data/0919b2b6-c990-4d3e-9aa4-c0d249014545/backupIT/backup_1472586845117/default/IntegrationTestBackupRestore.table2/
with reason code 1
at
org.apache.hadoop.hbase.backup.master.FullTableBackupProcedure.snapshotCopy(FullTableBackupProcedure.java:323)
at
org.apache.hadoop.hbase.backup.master.FullTableBackupProcedure.executeFromState(FullTableBackupProcedure.java:579)
at
org.apache.hadoop.hbase.backup.master.FullTableBackupProcedure.executeFromState(FullTableBackupProcedure.java:70)
at
org.apache.hadoop.hbase.procedure2.StateMachineProcedure.execute(StateMachineProcedure.java:119)
at
org.apache.hadoop.hbase.procedure2.Procedure.doExecute(Procedure.java:452)
at
org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1066)
at
org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execLoop(ProcedureExecutor.java:855)
at
org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execLoop(ProcedureExecutor.java:808)
at
org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$400(ProcedureExecutor.java:75)
at
org.apache.hadoop.hbase.procedure2.ProcedureExecutor$2.run(ProcedureExecutor.java:494)
{noformat}
> Backup/Restore IT
> -----------------
>
> Key: HBASE-16255
> URL: https://issues.apache.org/jira/browse/HBASE-16255
> Project: HBase
> Issue Type: Task
> Reporter: Vladimir Rodionov
> Assignee: Vladimir Rodionov
> Labels: backup
> Attachments: 16255-addendum.3.txt, 16255.addendum, 16255.addendum2,
> 16255.addendum4, 16255.addendum5, 16255.addendum6, HBASE-16255-v1.patch,
> HBASE-16255-v2.patch, HBASE-16255-v3.patch, HBASE-16255-v4.patch,
> HBASE-16255-v5.patch, HBASE-16255-v6.patch, backup-it-8-30.out,
> backup-it-success.out
>
>
> Integration test for backup restore.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
