[
https://issues.apache.org/jira/browse/BIGTOP-1178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13938443#comment-13938443
]
jay vyas commented on BIGTOP-1178:
----------------------------------
Okay, it works ! +1 :)
I tested this by doing :
0) install the plugin as per your README
1) vagrant up
2) "vagrant ssh" into bigtop1
3) "vagrant ssh" into bigtop2
4) creating a hbase table "t2" in bigtop2
5) listing contents in hbase table FROM bigtop1.
And so its pretty clear that, at least, hbase is working on both servers .
So, +1 from me, but would like feedback from others - any other tests required?
I think after this, lets automate some running of smoke tests on the VMs so
that we dont have to do manual testing of the vagrant patches anymore.
Two minor comments:
- looks like the default mode is clusterized. Id suggest that maybe we have
cluster be an option, or do you think it should be the default? Starting a 4
node cluster takes a lot longer than just a one node. Can you implement some
logic that turns clustering on/off , defaulting to "off" ?
- There is a whitespace warning when applying the patch
{noformat}
[vagrant@bigtop1 ~]$ hbase shell -d <<EOF
> scan 't2'
> EOF
Setting DEBUG log level...
14/03/17 21:53:31 WARN conf.Configuration: hadoop.native.lib is deprecated.
Instead, use io.native.lib.available
HBase Shell; enter 'help<RETURN>' for list of supported commands.
Type "exit<RETURN>" to leave the HBase Shell
Version 0.94.12, rUnknown, Thu Oct 31 04:44:54 EDT 2013
scan 't2'
ROW COLUMN+CELL
14/03/17 21:53:34 DEBUG zookeeper.ZKUtil: hconnection opening connection to
ZooKeeper with ensemble (bigtop1.vagrant:2181)
14/03/17 21:53:34 INFO zookeeper.ZooKeeper: Client
environment:zookeeper.version=3.4.5--1, built on 10/31/2013 08:19 GMT
14/03/17 21:53:34 INFO zookeeper.ZooKeeper: Client
environment:host.name=bigtop1.vagrant
14/03/17 21:53:34 INFO zookeeper.ZooKeeper: Client
environment:java.version=1.7.0_51
14/03/17 21:53:34 INFO zookeeper.ZooKeeper: Client
environment:java.vendor=Oracle Corporation
14/03/17 21:53:34 INFO zookeeper.ZooKeeper: Client
environment:java.home=/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.51.x86_64/jre
14/03/17 21:53:34 INFO zookeeper.ZooKeeper: Client
environment:java.class.path=/etc/hadoop/conf:/etc/hbase/conf:/usr/lib/jvm/java-openjdk/lib/tools.jar:/usr/lib/hbase:/usr/lib/hbase/hbase-0.94.12.jar:/usr/lib/hbase/hbase-0.94.12-tests.jar:/usr/lib/hbase/hbase.jar:/usr/lib/hbase/lib/activation-1.1.jar:/usr/lib/hbase/lib/aopalliance-1.0.jar:/usr/lib/hbase/lib/asm-3.1.jar:/usr/lib/hbase/lib/avro-1.5.3.jar:/usr/lib/hbase/lib/avro-ipc-1.5.3.jar:/usr/lib/hbase/lib/commons-beanutils-1.7.0.jar:/usr/lib/hbase/lib/commons-beanutils-core-1.8.0.jar:/usr/lib/hbase/lib/commons-cli-1.2.jar:/usr/lib/hbase/lib/commons-codec-1.4.jar:/usr/lib/hbase/lib/commons-collections-3.2.1.jar:/usr/lib/hbase/lib/commons-configuration-1.6.jar:/usr/lib/hbase/lib/commons-daemon-1.0.13.jar:/usr/lib/hbase/lib/commons-digester-1.8.jar:/usr/lib/hbase/lib/commons-el-1.0.jar:/usr/lib/hbase/lib/commons-httpclient-3.1.jar:/usr/lib/hbase/lib/commons-io-2.1.jar:/usr/lib/hbase/lib/commons-lang-2.5.jar:/usr/lib/hbase/lib/commons-logging-1.1.1.jar:/usr/lib/hbase/lib/commons-math-2.1.jar:/usr/lib/hbase/lib/commons-net-3.1.jar:/usr/lib/hbase/lib/core-3.1.1.jar:/usr/lib/hbase/lib/gmbal-api-only-3.0.0-b023.jar:/usr/lib/hbase/lib/grizzly-framework-2.1.1.jar:/usr/lib/hbase/lib/grizzly-framework-2.1.1-tests.jar:/usr/lib/hbase/lib/grizzly-http-2.1.1.jar:/usr/lib/hbase/lib/grizzly-http-server-2.1.1.jar:/usr/lib/hbase/lib/grizzly-http-servlet-2.1.1.jar:/usr/lib/hbase/lib/grizzly-rcm-2.1.1.jar:/usr/lib/hbase/lib/guava-11.0.2.jar:/usr/lib/hbase/lib/guice-3.0.jar:/usr/lib/hbase/lib/guice-servlet-3.0.jar:/usr/lib/hbase/lib/high-scale-lib-1.1.1.jar:/usr/lib/hbase/lib/httpclient-4.1.2.jar:/usr/lib/hbase/lib/httpcore-4.1.3.jar:/usr/lib/hbase/lib/jackson-core-asl-1.8.8.jar:/usr/lib/hbase/lib/jackson-jaxrs-1.8.8.jar:/usr/lib/hbase/lib/jackson-mapper-asl-1.8.8.jar:/usr/lib/hbase/lib/jackson-xc-1.8.8.jar:/usr/lib/hbase/lib/jamon-runtime-2.3.1.jar:/usr/lib/hbase/lib/jasper-compiler-5.5.23.jar:/usr/lib/hbase/lib/jasper-runtime-5.5.23.jar:/usr/lib/hbase/lib/javax.inject-1.jar:/usr/lib/hbase/lib/javax.servlet-3.0.jar:/usr/lib/hbase/lib/jaxb-api-2.1.jar:/usr/lib/hbase/lib/jaxb-impl-2.2.3-1.jar:/usr/lib/hbase/lib/jersey-client-1.8.jar:/usr/lib/hbase/lib/jersey-core-1.8.jar:/usr/lib/hbase/lib/jersey-grizzly2-1.8.jar:/usr/lib/hbase/lib/jersey-guice-1.8.jar:/usr/lib/hbase/lib/jersey-json-1.8.jar:/usr/lib/hbase/lib/jersey-server-1.8.jar:/usr/lib/hbase/lib/jersey-test-framework-core-1.8.jar:/usr/lib/hbase/lib/jersey-test-framework-grizzly2-1.8.jar:/usr/lib/hbase/lib/jets3t-0.6.1.jar:/usr/lib/hbase/lib/jettison-1.1.jar:/usr/lib/hbase/lib/jetty-6.1.26.jar:/usr/lib/hbase/lib/jetty-util-6.1.26.jar:/usr/lib/hbase/lib/jruby-complete-1.6.5.jar:/usr/lib/hbase/lib/jsch-0.1.42.jar:/usr/lib/hbase/lib/jsp-2.1-6.1.14.jar:/usr/lib/hbase/lib/jsp-api-2.1-6.1.14.jar:/usr/lib/hbase/lib/jsp-api-2.1.jar:/usr/lib/hbase/lib/jsr305-1.3.9.jar:/usr/lib/hbase/lib/junit-4.10-HBASE-1.jar:/usr/lib/hbase/lib/kfs-0.3.jar:/usr/lib/hbase/lib/libthrift-0.8.0.jar:/usr/lib/hbase/lib/log4j-1.2.16.jar:/usr/lib/hbase/lib/management-api-3.0.0-b012.jar:/usr/lib/hbase/lib/metrics-core-2.1.2.jar:/usr/lib/hbase/lib/netty-3.2.4.Final.jar:/usr/lib/hbase/lib/netty-3.5.11.Final.jar:/usr/lib/hbase/lib/protobuf-java-2.4.0a.jar:/usr/lib/hbase/lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hbase/lib/servlet-api-2.5.jar:/usr/lib/hbase/lib/slf4j-api-1.6.1.jar:/usr/lib/hbase/lib/snappy-java-1.0.3.2.jar:/usr/lib/hbase/lib/stax-api-1.0.1.jar:/usr/lib/hbase/lib/velocity-1.7.jar:/usr/lib/hbase/lib/xmlenc-0.52.jar:/usr/lib/hbase/lib/zookeeper.jar:/etc/hadoop/conf:/usr/lib/hadoop/lib/jackson-jaxrs-1.8.8.jar:/usr/lib/hadoop/lib/commons-beanutils-core-1.8.0.jar:/usr/lib/hadoop/lib/jetty-util-6.1.26.jar:/usr/lib/hadoop/lib/jets3t-0.6.1.jar:/usr/lib/hadoop/lib/activation-1.1.jar:/usr/lib/hadoop/lib/jersey-json-1.8.jar:/usr/lib/hadoop/lib/xmlenc-0.52.jar:/usr/lib/hadoop/lib/paranamer-2.3.jar:/usr/lib/hadoop/lib/commons-logging-1.1.1.jar:/usr/lib/hadoop/lib/jackson-mapper-asl-1.8.8.jar:/usr/lib/hadoop/lib/log4j-1.2.17.jar:/usr/lib/hadoop/lib/jsp-api-2.1.jar:/usr/lib/hadoop/lib/commons-configuration-1.6.jar:/usr/lib/hadoop/lib/jackson-core-asl-1.8.8.jar:/usr/lib/hadoop/lib/jersey-core-1.8.jar:/usr/lib/hadoop/lib/slf4j-log4j12-1.6.1.jar:/usr/lib/hadoop/lib/commons-digester-1.8.jar:/usr/lib/hadoop/lib/jersey-server-1.8.jar:/usr/lib/hadoop/lib/jsch-0.1.42.jar:/usr/lib/hadoop/lib/commons-io-2.1.jar:/usr/lib/hadoop/lib/commons-lang-2.5.jar:/usr/lib/hadoop/lib/guava-11.0.2.jar:/usr/lib/hadoop/lib/asm-3.2.jar:/usr/lib/hadoop/lib/commons-beanutils-1.7.0.jar:/usr/lib/hadoop/lib/slf4j-api-1.6.1.jar:/usr/lib/hadoop/lib/jsr305-1.3.9.jar:/usr/lib/hadoop/lib/jasper-runtime-5.5.23.jar:/usr/lib/hadoop/lib/jaxb-api-2.2.2.jar:/usr/lib/hadoop/lib/snappy-java-1.0.3.2.jar:/usr/lib/hadoop/lib/commons-collections-3.2.1.jar:/usr/lib/hadoop/lib/avro-1.5.3.jar:/usr/lib/hadoop/lib/commons-el-1.0.jar:/usr/lib/hadoop/lib/kfs-0.3.jar:/usr/lib/hadoop/lib/jackson-xc-1.8.8.jar:/usr/lib/hadoop/lib/commons-httpclient-3.1.jar:/usr/lib/hadoop/lib/commons-math-2.1.jar:/usr/lib/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/lib/hadoop/lib/servlet-api-2.5.jar:/usr/lib/hadoop/lib/zookeeper-3.4.2.jar:/usr/lib/hadoop/lib/commons-net-3.1.jar:/usr/lib/hadoop/lib/jetty-6.1.26.jar:/usr/lib/hadoop/lib/jasper-compiler-5.5.23.jar:/usr/lib/hadoop/lib/protobuf-java-2.4.0a.jar:/usr/lib/hadoop/lib/stax-api-1.0.1.jar:/usr/lib/hadoop/lib/commons-codec-1.4.jar:/usr/lib/hadoop/lib/commons-cli-1.2.jar:/usr/lib/hadoop/lib/jettison-1.1.jar:/usr/lib/hadoop/.//hadoop-annotations.jar:/usr/lib/hadoop/.//hadoop-common-2.0.6-alpha-tests.jar:/usr/lib/hadoop/.//hadoop-auth-2.0.6-alpha.jar:/usr/lib/hadoop/.//hadoop-common.jar:/usr/lib/hadoop/.//hadoop-common-2.0.6-alpha.jar:/usr/lib/hadoop/.//hadoop-auth.jar:/usr/lib/hadoop/.//hadoop-annotations-2.0.6-alpha.jar:/usr/lib/hadoop-hdfs/./:/usr/lib/hadoop-hdfs/lib/jetty-util-6.1.26.jar:/usr/lib/hadoop-hdfs/lib/xmlenc-0.52.jar:/usr/lib/hadoop-hdfs/lib/commons-logging-1.1.1.jar:/usr/lib/hadoop-hdfs/lib/jackson-mapper-asl-1.8.8.jar:/usr/lib/hadoop-hdfs/lib/log4j-1.2.17.jar:/usr/lib/hadoop-hdfs/lib/jsp-api-2.1.jar:/usr/lib/hadoop-hdfs/lib/jackson-core-asl-1.8.8.jar:/usr/lib/hadoop-hdfs/lib/jersey-core-1.8.jar:/usr/lib/hadoop-hdfs/lib/jersey-server-1.8.jar:/usr/lib/hadoop-hdfs/lib/commons-io-2.1.jar:/usr/lib/hadoop-hdfs/lib/commons-lang-2.5.jar:/usr/lib/hadoop-hdfs/lib/guava-11.0.2.jar:/usr/lib/hadoop-hdfs/lib/asm-3.2.jar:/usr/lib/hadoop-hdfs/lib/jsr305-1.3.9.jar:/usr/lib/hadoop-hdfs/lib/jasper-runtime-5.5.23.jar:/usr/lib/hadoop-hdfs/lib/commons-el-1.0.jar:/usr/lib/hadoop-hdfs/lib/servlet-api-2.5.jar:/usr/lib/hadoop-hdfs/lib/jetty-6.1.26.jar:/usr/lib/hadoop-hdfs/lib/protobuf-java-2.4.0a.jar:/usr/lib/hadoop-hdfs/lib/commons-daemon-1.0.13.jar:/usr/lib/hadoop-hdfs/lib/commons-codec-1.4.jar:/usr/lib/hadoop-hdfs/lib/commons-cli-1.2.jar:/usr/lib/hadoop-hdfs/.//hadoop-hdfs.jar:/usr/lib/hadoop-hdfs/.//hadoop-hdfs-2.0.6-alpha-tests.jar:/usr/lib/hadoop-hdfs/.//hadoop-hdfs-2.0.6-alpha.jar:/usr/lib/hadoop-yarn/lib/paranamer-2.3.jar:/usr/lib/hadoop-yarn/lib/jackson-mapper-asl-1.8.8.jar:/usr/lib/hadoop-yarn/lib/log4j-1.2.17.jar:/usr/lib/hadoop-yarn/lib/jackson-core-asl-1.8.8.jar:/usr/lib/hadoop-yarn/lib/jersey-core-1.8.jar:/usr/lib/hadoop-yarn/lib/javax.inject-1.jar:/usr/lib/hadoop-yarn/lib/jersey-server-1.8.jar:/usr/lib/hadoop-yarn/lib/commons-io-2.1.jar:/usr/lib/hadoop-yarn/lib/jersey-guice-1.8.jar:/usr/lib/hadoop-yarn/lib/guice-3.0.jar:/usr/lib/hadoop-yarn/lib/asm-3.2.jar:/usr/lib/hadoop-yarn/lib/snappy-java-1.0.3.2.jar:/usr/lib/hadoop-yarn/lib/avro-1.5.3.jar:/usr/lib/hadoop-yarn/lib/guice-servlet-3.0.jar:/usr/lib/hadoop-yarn/lib/protobuf-java-2.4.0a.jar:/usr/lib/hadoop-yarn/lib/junit-4.8.2.jar:/usr/lib/hadoop-yarn/lib/netty-3.5.11.Final.jar:/usr/lib/hadoop-yarn/lib/aopalliance-1.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-client-2.0.6-alpha.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-common.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-client.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-web-proxy.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-nodemanager.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-tests.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-site.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-resourcemanager.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-web-proxy-2.0.6-alpha.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-api.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-tests-2.0.6-alpha.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-resourcemanager-2.0.6-alpha.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-common-2.0.6-alpha.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-applications-distributedshell.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-common.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-api-2.0.6-alpha.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-site-2.0.6-alpha.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-nodemanager-2.0.6-alpha.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher-2.0.6-alpha.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-applications-distributedshell-2.0.6-alpha.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-common-2.0.6-alpha.jar:/usr/lib/hadoop-mapreduce/lib/paranamer-2.3.jar:/usr/lib/hadoop-mapreduce/lib/jackson-mapper-asl-1.8.8.jar:/usr/lib/hadoop-mapreduce/lib/log4j-1.2.17.jar:/usr/lib/hadoop-mapreduce/lib/jackson-core-asl-1.8.8.jar:/usr/lib/hadoop-mapreduce/lib/jersey-core-1.8.jar:/usr/lib/hadoop-mapreduce/lib/javax.inject-1.jar:/usr/lib/hadoop-mapreduce/lib/jersey-server-1.8.jar:/usr/lib/hadoop-mapreduce/lib/commons-io-2.1.jar:/usr/lib/hadoop-mapreduce/lib/jersey-guice-1.8.jar:/usr/lib/hadoop-mapreduce/lib/guice-3.0.jar:/usr/lib/hadoop-mapreduce/lib/asm-3.2.jar:/usr/lib/hadoop-mapreduce/lib/snappy-java-1.0.3.2.jar:/usr/lib/hadoop-mapreduce/lib/avro-1.5.3.jar:/usr/lib/hadoop-mapreduce/lib/guice-servlet-3.0.jar:/usr/lib/hadoop-mapreduce/lib/protobuf-java-2.4.0a.jar:/usr/lib/hadoop-mapreduce/lib/junit-4.8.2.jar:/usr/lib/hadoop-mapreduce/lib/netty-3.5.11.Final.jar:/usr/lib/hadoop-mapreduce/lib/aopalliance-1.0.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-examples-2.0.6-alpha.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-2.0.6-alpha.jar:/usr/lib/hadoop-mapreduce/.//hadoop-streaming.jar:/usr/lib/hadoop-mapreduce/.//hadoop-rumen.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-core-2.0.6-alpha.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-2.0.6-alpha-tests.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle-2.0.6-alpha.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-common-2.0.6-alpha.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-app.jar:/usr/lib/hadoop-mapreduce/.//hadoop-archives.jar:/usr/lib/hadoop-mapreduce/.//hadoop-gridmix.jar:/usr/lib/hadoop-mapreduce/.//hadoop-extras.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins-2.0.6-alpha.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-2.0.6-alpha.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-common.jar:/usr/lib/hadoop-mapreduce/.//hadoop-archives-2.0.6-alpha.jar:/usr/lib/hadoop-mapreduce/.//hadoop-datajoin.jar:/usr/lib/hadoop-mapreduce/.//hadoop-streaming-2.0.6-alpha.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-examples.jar:/usr/lib/hadoop-mapreduce/.//hadoop-gridmix-2.0.6-alpha.jar:/usr/lib/hadoop-mapreduce/.//hadoop-datajoin-2.0.6-alpha.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-core.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient.jar:/usr/lib/hadoop-mapreduce/.//hadoop-distcp-2.0.6-alpha.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-app-2.0.6-alpha.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-hs.jar:/usr/lib/hadoop-mapreduce/.//hadoop-distcp.jar:/usr/lib/hadoop-mapreduce/.//hadoop-extras-2.0.6-alpha.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle.jar:/usr/lib/hadoop-mapreduce/.//hadoop-rumen-2.0.6-alpha.jar
14/03/17 21:53:34 INFO zookeeper.ZooKeeper: Client
environment:java.library.path=/usr/lib/hadoop/lib/native:/usr/lib/hbase/lib/native/Linux-amd64-64
14/03/17 21:53:34 INFO zookeeper.ZooKeeper: Client
environment:java.io.tmpdir=/tmp
14/03/17 21:53:34 INFO zookeeper.ZooKeeper: Client
environment:java.compiler=<NA>
14/03/17 21:53:34 INFO zookeeper.ZooKeeper: Client environment:os.name=Linux
14/03/17 21:53:34 INFO zookeeper.ZooKeeper: Client environment:os.arch=amd64
14/03/17 21:53:34 INFO zookeeper.ZooKeeper: Client
environment:os.version=2.6.32-358.el6.x86_64
14/03/17 21:53:34 INFO zookeeper.ZooKeeper: Client environment:user.name=vagrant
14/03/17 21:53:34 INFO zookeeper.ZooKeeper: Client
environment:user.home=/home/vagrant
14/03/17 21:53:34 INFO zookeeper.ZooKeeper: Client
environment:user.dir=/home/vagrant
14/03/17 21:53:35 INFO zookeeper.ZooKeeper: Initiating client connection,
connectString=bigtop1.vagrant:2181 sessionTimeout=180000 watcher=hconnection
14/03/17 21:53:35 DEBUG zookeeper.ClientCnxn: zookeeper.disableAutoWatchReset
is false
14/03/17 21:53:35 INFO zookeeper.RecoverableZooKeeper: The identifier of this
process is [email protected]
14/03/17 21:53:35 INFO zookeeper.ClientCnxn: Opening socket connection to
server bigtop1.vagrant/10.10.10.12:2181. Will not attempt to authenticate using
SASL (unknown error)
14/03/17 21:53:35 INFO zookeeper.ClientCnxn: Socket connection established to
bigtop1.vagrant/10.10.10.12:2181, initiating session
14/03/17 21:53:35 DEBUG zookeeper.ClientCnxn: Session establishment request
sent on bigtop1.vagrant/10.10.10.12:2181
14/03/17 21:53:35 INFO zookeeper.ClientCnxn: Session establishment complete on
server bigtop1.vagrant/10.10.10.12:2181, sessionid = 0x144d1c2d6dc0010,
negotiated timeout = 40000
14/03/17 21:53:35 DEBUG zookeeper.ZooKeeperWatcher: hconnection Received
ZooKeeper Event, type=None, state=SyncConnected, path=null
14/03/17 21:53:35 DEBUG zookeeper.ZooKeeperWatcher:
hconnection-0x144d1c2d6dc0010 connected
14/03/17 21:53:35 DEBUG zookeeper.ClientCnxn: Reading reply
sessionid:0x144d1c2d6dc0010, packet:: clientPath:null serverPath:null
finished:false header:: 1,3 replyHeader:: 1,87,0 request:: '/hbase/hbaseid,F
response:: s{13,13,1395088901425,1395088901425,0,0,0,0,62,0,13}
14/03/17 21:53:35 DEBUG zookeeper.ClientCnxn: Reading reply
sessionid:0x144d1c2d6dc0010, packet:: clientPath:null serverPath:null
finished:false header:: 2,4 replyHeader:: 2,87,0 request:: '/hbase/hbaseid,F
response::
#ffffffff00015313231333940626967746f70312e76616772616e7462373539303362332d363166322d343432322d393935382d343162653135643061643465,s{13,13,1395088901425,1395088901425,0,0,0,0,62,0,13}
14/03/17 21:53:35 DEBUG zookeeper.ZKUtil: hconnection-0x144d1c2d6dc0010
Retrieved 36 byte(s) of data from znode /hbase/hbaseid;
data=b75903b3-61f2-4422-9958-41be1...
14/03/17 21:53:35 DEBUG zookeeper.ClientCnxn: Reading reply
sessionid:0x144d1c2d6dc0010, packet:: clientPath:null serverPath:null
finished:false header:: 3,3 replyHeader:: 3,87,0 request:: '/hbase/master,T
response:: s{11,11,1395088898894,1395088898894,0,0,0,91428527212855297,63,0,11}
14/03/17 21:53:35 DEBUG zookeeper.ZKUtil: hconnection-0x144d1c2d6dc0010 Set
watcher on existing znode /hbase/master
14/03/17 21:53:35 DEBUG zookeeper.ClientCnxn: Reading reply
sessionid:0x144d1c2d6dc0010, packet:: clientPath:null serverPath:null
finished:false header:: 4,4 replyHeader:: 4,87,0 request:: '/hbase/master,T
response::
#ffffffff00015313231333940626967746f70312e76616772616e7400626967746f70312e76616772616e742c36303030302c31333935303838383936373336,s{11,11,1395088898894,1395088898894,0,0,0,91428527212855297,63,0,11}
14/03/17 21:53:35 DEBUG zookeeper.ZKUtil: hconnection-0x144d1c2d6dc0010
Retrieved 37 byte(s) of data from znode /hbase/master and set watcher;
\x00\x00bigtop1.vagrant,60000...
14/03/17 21:53:35 DEBUG zookeeper.ClientCnxn: Reading reply
sessionid:0x144d1c2d6dc0010, packet:: clientPath:null serverPath:null
finished:false header:: 5,3 replyHeader:: 5,87,0 request::
'/hbase/root-region-server,T response::
s{31,31,1395088910567,1395088910567,0,0,0,0,61,0,31}
14/03/17 21:53:35 DEBUG zookeeper.ZKUtil: hconnection-0x144d1c2d6dc0010 Set
watcher on existing znode /hbase/root-region-server
14/03/17 21:53:35 DEBUG zookeeper.ClientCnxn: Reading reply
sessionid:0x144d1c2d6dc0010, packet:: clientPath:null serverPath:null
finished:false header:: 6,4 replyHeader:: 6,87,0 request::
'/hbase/root-region-server,T response::
#ffffffff00015313137323040626967746f70312e76616772616e74626967746f70312e76616772616e742c36303032302c31333935303838383839383936,s{31,31,1395088910567,1395088910567,0,0,0,0,61,0,31}
14/03/17 21:53:35 DEBUG zookeeper.ZKUtil: hconnection-0x144d1c2d6dc0010
Retrieved 35 byte(s) of data from znode /hbase/root-region-server and set
watcher; bigtop1.vagrant,60020,1395088...
14/03/17 21:53:35 DEBUG zookeeper.ClientCnxn: Reading reply
sessionid:0x144d1c2d6dc0010, packet:: clientPath:null serverPath:null
finished:false header:: 7,3 replyHeader:: 7,87,0 request:: '/hbase,F
response:: s{3,3,1395088897993,1395088897993,0,12,0,0,0,12,31}
14/03/17 21:53:35 DEBUG zookeeper.ClientCnxn: Reading reply
sessionid:0x144d1c2d6dc0010, packet:: clientPath:null serverPath:null
finished:false header:: 8,4 replyHeader:: 8,87,0 request::
'/hbase/root-region-server,T response::
#ffffffff00015313137323040626967746f70312e76616772616e74626967746f70312e76616772616e742c36303032302c31333935303838383839383936,s{31,31,1395088910567,1395088910567,0,0,0,0,61,0,31}
14/03/17 21:53:35 DEBUG zookeeper.ZKUtil: hconnection-0x144d1c2d6dc0010
Retrieved 35 byte(s) of data from znode /hbase/root-region-server and set
watcher; bigtop1.vagrant,60020,1395088...
14/03/17 21:53:35 DEBUG client.HConnectionManager$HConnectionImplementation:
Looked up root region location,
connection=org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@1e04d31e;
serverName=bigtop1.vagrant,60020,1395088889896
14/03/17 21:53:35 DEBUG client.HConnectionManager$HConnectionImplementation:
Cached location for .META.,,1.1028785192 is bigtop1.vagrant:60020
14/03/17 21:53:35 DEBUG client.MetaScanner: Scanning .META. starting at
row=t2,,00000000000000 for max=10 rows using
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@1e04d31e
14/03/17 21:53:35 DEBUG client.HConnectionManager$HConnectionImplementation:
Cached location for t2,,1395092997797.5fa8b01d30eb2bc84fa91a624a2606eb. is
10.10.10.13:60020
14/03/17 21:53:35 DEBUG client.ClientScanner: Creating scanner over t2 starting
at key ''
14/03/17 21:53:35 DEBUG client.ClientScanner: Advancing internal scanner to
startKey at ''
row2 column=f2:a,
timestamp=1395092999169, value=val2
14/03/17 21:53:35 DEBUG client.ClientScanner: Finished with scanning at {NAME
=> 't2,,1395092997797.5fa8b01d30eb2bc84fa91a624a2606eb.', STARTKEY => '',
ENDKEY => '', ENCODED => 5fa8b01d30eb2bc84fa91a624a2606eb,}
1 row(s) in 1.7930 seconds
[vagrant@bigtop1 ~]$
{noformat}
> Clusterize the puppetized vagrant deployer.
> -------------------------------------------
>
> Key: BIGTOP-1178
> URL: https://issues.apache.org/jira/browse/BIGTOP-1178
> Project: Bigtop
> Issue Type: Improvement
> Components: Deployment
> Reporter: jay vyas
> Priority: Minor
> Attachments: BIGTOP-1178.1.patch, BIGTOP-1178.2.patch
>
>
> Now that https://issues.apache.org/jira/browse/BIGTOP-1171 is nearing
> completion (puppetization of vagrant), we can move towards setting up a real
> hadoop "cluster".
> The goal here will be to allow us to do more with vagrant than just spinning
> up a single VM. To scale the vagrantfile, we can do something like :
> {noformat}
> if ARGV[1] == 'cluster'
> cluster = true
> else
> cluster = false
> end
> {noformat}
> I think the Vagrantfile can look something like this:
> {noformat}
> Vagrant.configure(VAGRANT_API_VERSION) do |config|
> # Head node
> config.vm.define :bigtop1 do |bigtop1|
>
> # If "cluster" then add a bunch of slaves also
> if cluster == true
> # Slave nodes ....
> config.vm.define :bigtop2 do |bigtop2|
> config.vm.define :bigtop3 do |bigtop3|
> config.vm.define :bigtop4 do |bigtop4|
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
