HI Ted , Can you please advice what changes that i need in Hbase? because hbase starts with own zookeeper. I need hbase should run with external zookeeper
Thanks Beeshma On Wed, Oct 21, 2015 at 9:51 AM, beeshma r <beeshm...@gmail.com> wrote: > Hi > > i just want to hbase as a replication mode.As per documentation zookeeper > must not be managed by HBase > > so created below settings > > *zookeeper zoo.cfg(/home/beeshma/zookeeper-3.4.6/cfg)* > > tickTime=2000 > dataDir=/home/beeshma/zookeeper > clientPort=2181 > initLimit=5 > syncLimit=2 > > *hbase-site.xml* > > <configuration> > <property> > <name>hbase.master</name> > <value>master:9000</value> > </property> > <property> > <name>hbase.rootdir</name> > <value>hdfs://localhost:9000/hbase</value> > </property> > <property> > <name>hbase.zookeeper.property.dataDir</name> > <value>/home/beeshma/zookeeper-3.4.6/conf</value> > </property> > <!-- Zookeeepr external--> > <property> > <name>hbase.cluster.distributed</name> > <value>true</value> > </property> > <!-- Zookeeepr external--> > <property> > <name>hbase.zookeeper.property.clientPort</name> > <value>2181</value> > </property> > <property> > <name>hbase.zookeeper.quorum</name> > <value>localhost</value> > </property> > <!-- Zookeeepr external- --> > <!-- SEP is basically replication, so enable it --> > <property> > <name>hbase.replication</name> > <value>true</value> > </property> > <!-- Source ratio of 100% makes sure that each SEP consumer is actually > used (otherwise, some can sit idle, especially with small clusters) > --> > <property> > <name>replication.source.ratio</name> > <value>1.0</value> > </property> > <!-- Maximum number of hlog entries to replicate in one go. If this is > large, and a consumer takes a while to process the events, the > HBase rpc call will time out. --> > <property> > <name>replication.source.nb.capacity</name> > <value>1000</value> > </property> > <!-- A custom replication source that fixes a few things and adds > some functionality (doesn't interfere with normal replication > usage). --> > <property> > <name>replication.replicationsource.implementation</name> > <value>com.ngdata.sep.impl.SepReplicationSource</value> > </property> > </configuration> > > > *in hbase-env.shexport HBASE_MANAGES_ZK=false* > > when i start zookeeper and hbase ,i abale to see fallowing confusions > zookeeper started with fallowing specifications > 2015-10-21 04:22:13,810 [myid:] - INFO [main:Environment@100] - Server > environment:java.io.tmpdir=/tmp > 2015-10-21 04:22:13,810 [myid:] - INFO [main:Environment@100] - Server > environment:java.compiler=<NA> > 2015-10-21 04:22:13,813 [myid:] - INFO [main:Environment@100] - Server > environment:os.name=Linux > 2015-10-21 04:22:13,814 [myid:] - INFO [main:Environment@100] - Server > environment:os.arch=amd64 > 2015-10-21 04:22:13,814 [myid:] - INFO [main:Environment@100] - Server > environment:os.version=3.11.0-12-generic > 2015-10-21 04:22:13,814 [myid:] - INFO [main:Environment@100] - Server > environment:user.name=beeshma > 2015-10-21 04:22:13,814 [myid:] - INFO [main:Environment@100] - Server > environment:user.home=/home/beeshma > 2015-10-21 04:22:13,814 [myid:] - INFO [main:Environment@100] - Server > environment:user.dir=/home/beeshma/zookeeper-3.4.6/bin > 2015-10-21 04:22:13,827 [myid:] - INFO [main:ZooKeeperServer@755] - > tickTime set to 2000 > 2015-10-21 04:22:13,827 [myid:] - INFO [main:ZooKeeperServer@764] - > minSessionTimeout set to -1 > 2015-10-21 04:22:13,827 [myid:] - INFO [main:ZooKeeperServer@773] - > maxSessionTimeout set to -1 > 2015-10-21 04:22:13,893 [myid:] - INFO [main:NIOServerCnxnFactory@94] - > binding to port 0.0.0.0/0.0.0.0:2181 > > But Hbase starts with own zookeeper > in hbase zookeeper log > 2015-10-21 04:25:12,345 INFO [main] server.ZooKeeperServer: Server > environment:java.io.tmpdir=/tmp > 2015-10-21 04:25:12,345 INFO [main] server.ZooKeeperServer: Server > environment:java.compiler=<NA> > 2015-10-21 04:25:12,345 INFO [main] server.ZooKeeperServer: Server > environment:os.name=Linux > 2015-10-21 04:25:12,345 INFO [main] server.ZooKeeperServer: Server > environment:os.arch=amd64 > 2015-10-21 04:25:12,357 INFO [main] server.ZooKeeperServer: Server > environment:os.version=3.11.0-12-generic > 2015-10-21 04:25:12,358 INFO [main] server.ZooKeeperServer: Server > environment:user.name=beeshma > 2015-10-21 04:25:12,358 INFO [main] server.ZooKeeperServer: Server > environment:user.home=/home/beeshma > 2015-10-21 04:25:12,358 INFO [main] server.ZooKeeperServer: Server > environment:user.dir=/home/beeshma/hbase-0.98.6.1-hadoop2 > 2015-10-21 04:25:12,423 INFO [main] server.ZooKeeperServer: tickTime set > to 3000 > 2015-10-21 04:25:12,423 INFO [main] server.ZooKeeperServer: > minSessionTimeout set to -1 > 2015-10-21 04:25:12,423 INFO [main] server.ZooKeeperServer: > maxSessionTimeout set to 90000 > 2015-10-21 04:25:12,493 INFO [main] server.NIOServerCnxnFactory: binding > to port 0.0.0.0/0.0.0.0:2181 > > Also already port 0.0.0.0/0.0.0.0:2181 binded with zookeeper so in hbase > fallowing error occuring > > *hbase-beeshma-zookeeper-ubuntu.out* > > java.net.BindException: Address already in use > at sun.nio.ch.Net.bind0(Native Method) > at sun.nio.ch.Net.bind(Net.java:444) > at sun.nio.ch.Net.bind(Net.java:436) > at > sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:214) > at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74) > at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:67) > at > org.apache.zookeeper.server.NIOServerCnxnFactory.configure(NIOServerCnxnFactory.java:95) > at > org.apache.zookeeper.server.ZooKeeperServerMain.runFromConfig(ZooKeeperServerMain.java:111) > at > org.apache.hadoop.hbase.zookeeper.HQuorumPeer.runZKServer(HQuorumPeer.java:91) > at > org.apache.hadoop.hbase.zookeeper.HQuorumPeer.main(HQuorumPeer.java:76) > > > So what are settings i need to change? > > > Thanks > Beeshma > > --
