One possibility was that there was leftover data in zookeeper. Try clearing zookeeper should allow cluster to start.
Cheers On Aug 19, 2014, at 2:49 AM, Ayache Khettar <[email protected]> wrote: > Hi > > I am upgrading base from 0.94.6 to hbase-0.98.5-hadoop2. I am running in a > pseudo distributed mode (One master and one region server ) with an > external zookeeper (but all running locally). I start base master first > all well, then as soon as I start the regionserver node the master gets > aborted - see below the logs from the master node and config set up. Am I > missing anything? > > Kind regards, > > > *CONFIG SET UP:* > > *hbase-site.xml* > > <?xml version="1.0"?> > <?xml-stylesheet type="text/xsl" href="configuration.xsl"?> > <!-- > /** > * Copyright 2010 The Apache Software Foundation > * > * Licensed to the Apache Software Foundation (ASF) under one > * or more contributor license agreements. See the NOTICE file > * distributed with this work for additional information > * regarding copyright ownership. The ASF licenses this file > * to you under the Apache License, Version 2.0 (the > * "License"); you may not use this file except in compliance > * with the License. You may obtain a copy of the License at > * > * http://www.apache.org/licenses/LICENSE-2.0 > * > * Unless required by applicable law or agreed to in writing, software > * distributed under the License is distributed on an "AS IS" BASIS, > * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. > * See the License for the specific language governing permissions and > * limitations under the License. > */ > --> > <configuration> > <!-- > <property> > <name>hbase.rootdir</name> > <value>/usr/local/hbase/data</value> > </property> > --> > <property> > <name>hbase.security.authentication</name> > <value>simple</value> > </property> > <property> > <name>hbase.cluster.distributed</name> > <value>true</value> > </property> > <property> > <name>hbase.zookeeper.property.clientPort</name> > <value>2181</value> > </property> > <property> > <name>hbase.zookeeper.quorum</name> > <value>akhettar</value> > </property> > <property> > <name>hbase.security.authentication</name> > <value>simple</value> > </property> > <property> > <name>hbase.security.authorization</name> > <value>true</value> > </property> > <property> > <name>hbase.coprocessor.master.classes</name> > <value>org.apache.hadoop.hbase.security.access.AccessController</value> > </property> > <property> > <name>hbase.coprocessor.region.classes</name> > <value>org.apache.hadoop.hbase.security.access.AccessController</value> > </property> > </configuration> > > *hbase-policy.xml* > > <?xml version="1.0"?> > <?xml-stylesheet type="text/xsl" href="configuration.xsl"?> > <!-- > /** > * Licensed to the Apache Software Foundation (ASF) under one > * or more contributor license agreements. See the NOTICE file > * distributed with this work for additional information > * regarding copyright ownership. The ASF licenses this file > * to you under the Apache License, Version 2.0 (the > * "License"); you may not use this file except in compliance > * with the License. You may obtain a copy of the License at > * > * http://www.apache.org/licenses/LICENSE-2.0 > * > * Unless required by applicable law or agreed to in writing, software > * distributed under the License is distributed on an "AS IS" BASIS, > * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. > * See the License for the specific language governing permissions and > * limitations under the License. > */ > --> > > <configuration> > > <property> > <name>security.client.protocol.acl</name> > <value>*</value> > <description>ACL for ClientProtocol and AdminProtocol implementations > (ie. > clients talking to HRegionServers) > The ACL is a comma-separated list of user and group names. The user and > group list is separated by a blank. For e.g. "alice,bob users,wheel". > A special value of "*" means all users are allowed.</description> > </property> > > <property> > <name>security.admin.protocol.acl</name> > <value>*</value> > <description>ACL for HMasterInterface protocol implementation (ie. > clients talking to HMaster for admin operations). > The ACL is a comma-separated list of user and group names. The user and > group list is separated by a blank. For e.g. "alice,bob users,wheel". > A special value of "*" means all users are allowed.</description> > </property> > > <property> > <name>security.masterregion.protocol.acl</name> > <value>*</value> > <description>ACL for HMasterRegionInterface protocol implementations > (for HRegionServers communicating with HMaster) > The ACL is a comma-separated list of user and group names. The user and > group list is separated by a blank. For e.g. "alice,bob users,wheel". > A special value of "*" means all users are allowed.</description> > </property> > </configuration> > > *hbase-env.sh* > > # > #/** > # * Copyright 2007 The Apache Software Foundation > # * > # * Licensed to the Apache Software Foundation (ASF) under one > # * or more contributor license agreements. See the NOTICE file > # * distributed with this work for additional information > # * regarding copyright ownership. The ASF licenses this file > # * to you under the Apache License, Version 2.0 (the > # * "License"); you may not use this file except in compliance > # * with the License. You may obtain a copy of the License at > # * > # * http://www.apache.org/licenses/LICENSE-2.0 > # * > # * Unless required by applicable law or agreed to in writing, software > # * distributed under the License is distributed on an "AS IS" BASIS, > # * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. > # * See the License for the specific language governing permissions and > # * limitations under the License. > # */ > > # Set environment variables here. > > # This script sets variables multiple times over the course of starting an > hbase process, > # so try to keep things idempotent unless you want to take an even deeper > look > # into the startup scripts (bin/hbase, etc.) > > # The java implementation to use. Java 1.6 required. > # export JAVA_HOME=/usr/java/jdk1.6.0/ > > # Extra Java CLASSPATH elements. Optional. > # export HBASE_CLASSPATH= > > # The maximum amount of heap to use, in MB. Default is 1000. > # export HBASE_HEAPSIZE=1000 > > # Extra Java runtime options. > # Below are what we set by default. May only work with SUN JVM. > # For more on why as well as other possible settings, > # see http://wiki.apache.org/hadoop/PerformanceTuning > export HBASE_OPTS="-XX:+UseConcMarkSweepGC" > > # Uncomment one of the below three options to enable java garbage > collection logging for the server-side processes. > > # This enables basic gc logging to the .out file. > # export SERVER_GC_OPTS="-verbose:gc -XX:+PrintGCDetails > -XX:+PrintGCDateStamps" > > # This enables basic gc logging to its own file. > # If FILE-PATH is not replaced, the log file(.gc) would still be generated > in the HBASE_LOG_DIR . > # export SERVER_GC_OPTS="-verbose:gc -XX:+PrintGCDetails > -XX:+PrintGCDateStamps -Xloggc:<FILE-PATH>" > > # This enables basic GC logging to its own file with automatic log rolling. > Only applies to jdk 1.6.0_34+ and 1.7.0_2+. > # If FILE-PATH is not replaced, the log file(.gc) would still be generated > in the HBASE_LOG_DIR . > # export SERVER_GC_OPTS="-verbose:gc -XX:+PrintGCDetails > -XX:+PrintGCDateStamps -Xloggc:<FILE-PATH> -XX:+UseGCLogFileRotation > -XX:NumberOfGCLogFiles=1 -XX:GCLogFileSize=512M" > > # Uncomment one of the below three options to enable java garbage > collection logging for the client processes. > > # This enables basic gc logging to the .out file. > # export CLIENT_GC_OPTS="-verbose:gc -XX:+PrintGCDetails > -XX:+PrintGCDateStamps" > > # This enables basic gc logging to its own file. > # If FILE-PATH is not replaced, the log file(.gc) would still be generated > in the HBASE_LOG_DIR . > # export CLIENT_GC_OPTS="-verbose:gc -XX:+PrintGCDetails > -XX:+PrintGCDateStamps -Xloggc:<FILE-PATH>" > > # This enables basic GC logging to its own file with automatic log rolling. > Only applies to jdk 1.6.0_34+ and 1.7.0_2+. > # If FILE-PATH is not replaced, the log file(.gc) would still be generated > in the HBASE_LOG_DIR . > # export CLIENT_GC_OPTS="-verbose:gc -XX:+PrintGCDetails > -XX:+PrintGCDateStamps -Xloggc:<FILE-PATH> -XX:+UseGCLogFileRotation > -XX:NumberOfGCLogFiles=1 -XX:GCLogFileSize=512M" > > # Uncomment below if you intend to use the EXPERIMENTAL off heap cache. > # export HBASE_OPTS="$HBASE_OPTS -XX:MaxDirectMemorySize=" > # Set hbase.offheapcache.percentage in hbase-site.xml to a nonzero value. > > > # Uncomment and adjust to enable JMX exporting > # See jmxremote.password and jmxremote.access in $JRE_HOME/lib/management > to configure remote password access. > # More details at: > http://java.sun.com/javase/6/docs/technotes/guides/management/agent.html > # NOTE: HBase provides an alternative JMX implementation to fix the random > ports issue, please see JMX > # section in HBase Reference Guide for instructions. > > # export HBASE_JMX_BASE="-Dcom.sun.management.jmxremote.ssl=false > -Dcom.sun.management.jmxremote.authenticate=false" > # export HBASE_MASTER_OPTS="$HBASE_MASTER_OPTS $HBASE_JMX_BASE > -Dcom.sun.management.jmxremote.port=10101" > # export HBASE_REGIONSERVER_OPTS="$HBASE_REGIONSERVER_OPTS $HBASE_JMX_BASE > -Dcom.sun.management.jmxremote.port=10102" > # export HBASE_THRIFT_OPTS="$HBASE_THRIFT_OPTS $HBASE_JMX_BASE > -Dcom.sun.management.jmxremote.port=10103" > # export HBASE_ZOOKEEPER_OPTS="$HBASE_ZOOKEEPER_OPTS $HBASE_JMX_BASE > -Dcom.sun.management.jmxremote.port=10104" > # export HBASE_REST_OPTS="$HBASE_REST_OPTS $HBASE_JMX_BASE > -Dcom.sun.management.jmxremote.port=10105" > > # File naming hosts on which HRegionServers will run. > $HBASE_HOME/conf/regionservers by default. > # export HBASE_REGIONSERVERS=${HBASE_HOME}/conf/regionservers > > # Uncomment and adjust to keep all the Region Server pages mapped to be > memory resident > #HBASE_REGIONSERVER_MLOCK=true > #HBASE_REGIONSERVER_UID="hbase" > > # File naming hosts on which backup HMaster will run. > $HBASE_HOME/conf/backup-masters by default. > # export HBASE_BACKUP_MASTERS=${HBASE_HOME}/conf/backup-masters > > # Extra ssh options. Empty by default. > # export HBASE_SSH_OPTS="-o ConnectTimeout=1 -o SendEnv=HBASE_CONF_DIR" > > # Where log files are stored. $HBASE_HOME/logs by default. > # export HBASE_LOG_DIR=${HBASE_HOME}/logs > > # Enable remote JDWP debugging of major HBase processes. Meant for Core > Developers > # export HBASE_MASTER_OPTS="$HBASE_MASTER_OPTS -Xdebug > -Xrunjdwp:transport=dt_socket,server=y,suspend=n,address=8070" > # export HBASE_REGIONSERVER_OPTS="$HBASE_REGIONSERVER_OPTS -Xdebug > -Xrunjdwp:transport=dt_socket,server=y,suspend=n,address=8071" > # export HBASE_THRIFT_OPTS="$HBASE_THRIFT_OPTS -Xdebug > -Xrunjdwp:transport=dt_socket,server=y,suspend=n,address=8072" > # export HBASE_ZOOKEEPER_OPTS="$HBASE_ZOOKEEPER_OPTS -Xdebug > -Xrunjdwp:transport=dt_socket,server=y,suspend=n,address=8073" > > # A string representing this instance of hbase. $USER by default. > # export HBASE_IDENT_STRING=$USER > > # The scheduling priority for daemon processes. See 'man nice'. > # export HBASE_NICENESS=10 > > # The directory where pid files are stored. /tmp by default. > # export HBASE_PID_DIR=/var/hadoop/pids > > # Seconds to sleep between slave commands. Unset by default. This > # can be useful in large clusters, where, e.g., slave rsyncs can > # otherwise arrive faster than the master can service them. > # export HBASE_SLAVE_SLEEP=0.1 > > # Tell HBase whether it should manage it's own instance of Zookeeper or not. > export HBASE_MANAGES_ZK=false > > # The default log rolling policy is RFA, where the log file is rolled as > per the size defined for the > # RFA appender. Please refer to the log4j.properties file to see more > details on this appender. > # In case one needs to do log rolling on a date change, one should set the > environment property > # HBASE_ROOT_LOGGER to "<DESIRED_LOG LEVEL>,DRFA". > # For example: > # HBASE_ROOT_LOGGER=INFO,DRFA > # The reason for changing default to RFA is to avoid the boundary case of > filling out disk space as > # DRFA doesn't put any cap on the log size. Please refer to HBase-5655 for > more context. > > > *LOGS:* > > 2014-08-19 10:36:10,142 DEBUG [master:localhost:60000] > cleaner.CleanerChore: initialize > cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner > 2014-08-19 10:36:10,142 INFO [master:localhost:60000] > master.ServerManager: Waiting for region servers count to settle; currently > checked in 0, slept for 0 ms, expecting minimum of 1, maximum of > 2147483647, timeout of 4500 ms, interval of 1500 ms. > 2014-08-19 10:36:11,659 INFO [master:localhost:60000] > master.ServerManager: Waiting for region servers count to settle; currently > checked in 0, slept for 1517 ms, expecting minimum of 1, maximum of > 2147483647, timeout of 4500 ms, interval of 1500 ms. > 2014-08-19 10:36:13,176 INFO [master:localhost:60000] > master.ServerManager: Waiting for region servers count to settle; currently > checked in 0, slept for 3034 ms, expecting minimum of 1, maximum of > 2147483647, timeout of 4500 ms, interval of 1500 ms. > 2014-08-19 10:36:14,691 INFO [master:localhost:60000] > master.ServerManager: Waiting for region servers count to settle; currently > checked in 0, slept for 4549 ms, expecting minimum of 1, maximum of > 2147483647, timeout of 4500 ms, interval of 1500 ms. > 2014-08-19 10:36:16,209 INFO [master:localhost:60000] > master.ServerManager: Waiting for region servers count to settle; currently > checked in 0, slept for 6067 ms, expecting minimum of 1, maximum of > 2147483647, timeout of 4500 ms, interval of 1500 ms. > 2014-08-19 10:36:16,363 INFO [FifoRpcScheduler.handler1-thread-1] > master.ServerManager: Registering server=localhost,60020,1408440975356 > 2014-08-19 10:36:16,367 INFO [FifoRpcScheduler.handler1-thread-1] > Configuration.deprecation: fs.default.name is deprecated. Instead, use > fs.defaultFS > 2014-08-19 10:36:16,388 DEBUG [main-EventThread] > zookeeper.RegionServerTracker: RS node: > /hbase/rs/localhost,60020,1408440975356 data: PBU�� > 2014-08-19 10:36:16,411 INFO [master:localhost:60000] > master.ServerManager: Waiting for region servers count to settle; currently > checked in 1, slept for 6269 ms, expecting minimum of 1, maximum of > 2147483647, timeout of 4500 ms, interval of 1500 ms. > 2014-08-19 10:36:17,925 INFO [master:localhost:60000] > master.ServerManager: Finished waiting for region servers count to settle; > checked in 1, slept for 7783 ms, expecting minimum of 1, maximum of > 2147483647, master is running. > 2014-08-19 10:36:17,925 INFO [master:localhost:60000] > master.MasterFileSystem: Log folder > file:/var/folders/ww/z3_504fn3yd0n92snzyh7sz40000gn/T/hbase-akhettar/hbase/WALs/localhost,60020,1408439710636 > doesn't belong to a known region server, splitting > 2014-08-19 10:36:17,926 INFO [master:localhost:60000] > master.MasterFileSystem: Log folder > file:/var/folders/ww/z3_504fn3yd0n92snzyh7sz40000gn/T/hbase-akhettar/hbase/WALs/localhost,60020,1408440975356 > belongs to an existing region server > 2014-08-19 10:36:18,001 INFO [master:localhost:60000] > catalog.CatalogTracker: Failed verification of hbase:meta,,1 at > address=localhost,60020,1408440930437, > exception=org.apache.hadoop.hbase.NotServingRegionException: > org.apache.hadoop.hbase.NotServingRegionException: Region hbase:meta,,1 is > not online on localhost,60020,1408440975356 > at > org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionByEncodedName(HRegionServer.java:2695) > at > org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:4139) > at > org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionInfo(HRegionServer.java:3506) > at > org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$2.callBlockingMethod(AdminProtos.java:20158) > at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2026) > at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:98) > at > org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:114) > at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:94) > at java.lang.Thread.run(Thread.java:745) > > 2014-08-19 10:36:18,003 INFO [master:localhost:60000] > master.MasterFileSystem: Log dir for server localhost,60020,1408440930437 > does not exist > 2014-08-19 10:36:18,003 INFO [master:localhost:60000] > master.SplitLogManager: dead splitlog workers > [localhost,60020,1408440930437] > 2014-08-19 10:36:18,003 DEBUG [master:localhost:60000] > master.SplitLogManager: Scheduling batch of logs to split > 2014-08-19 10:36:18,004 INFO [master:localhost:60000] > master.SplitLogManager: started splitting 0 logs in [] > 2014-08-19 10:36:18,004 INFO [master:localhost:60000] > master.SplitLogManager: finished splitting (more than or equal to) 0 bytes > in 0 log files in [] in 0ms > 2014-08-19 10:36:18,004 INFO [master:localhost:60000] > zookeeper.ZooKeeperNodeTracker: Unsetting hbase:meta region location in > ZooKeeper > 2014-08-19 10:36:18,007 DEBUG [master:localhost:60000] > master.AssignmentManager: No previous transition plan found (or ignoring an > existing plan) for hbase:meta,,1.1588230740; generated random > plan=hri=hbase:meta,,1.1588230740, src=, > dest=localhost,60020,1408440975356; 1 (online=1, available=1) available > servers, forceNewPlan=false > 2014-08-19 10:36:18,007 DEBUG [master:localhost:60000] zookeeper.ZKAssign: > master:60000-0x147ed8a761c0014, quorum=akhettar:2181, baseZNode=/hbase > Creating (or updating) unassigned node 1588230740 with OFFLINE state > 2014-08-19 10:36:18,013 INFO [master:localhost:60000] > master.AssignmentManager: Assigning hbase:meta,,1.1588230740 to > localhost,60020,1408440975356 > 2014-08-19 10:36:18,014 INFO [master:localhost:60000] master.RegionStates: > Transitioned {1588230740 state=OFFLINE, ts=1408440978007, server=null} to > {1588230740 state=PENDING_OPEN, ts=1408440978014, > server=localhost,60020,1408440975356} > 2014-08-19 10:36:18,014 DEBUG [master:localhost:60000] > master.ServerManager: New admin connection to localhost,60020,1408440975356 > 2014-08-19 10:36:18,152 INFO [master:localhost:60000] > master.ServerManager: AssignmentManager hasn't finished failover cleanup; > waiting > 2014-08-19 10:36:18,165 DEBUG [AM.ZK.Worker-pool2-t1] > master.AssignmentManager: Handling RS_ZK_REGION_OPENING, > server=localhost,60020,1408440975356, region=1588230740, > current_state={1588230740 state=PENDING_OPEN, ts=1408440978014, > server=localhost,60020,1408440975356} > 2014-08-19 10:36:18,166 INFO [AM.ZK.Worker-pool2-t1] master.RegionStates: > Transitioned {1588230740 state=PENDING_OPEN, ts=1408440978014, > server=localhost,60020,1408440975356} to {1588230740 state=OPENING, > ts=1408440978166, server=localhost,60020,1408440975356} > 2014-08-19 10:36:18,330 DEBUG [AM.ZK.Worker-pool2-t2] > master.AssignmentManager: Handling RS_ZK_REGION_OPENED, > server=localhost,60020,1408440975356, region=1588230740, > current_state={1588230740 state=OPENING, ts=1408440978166, > server=localhost,60020,1408440975356} > 2014-08-19 10:36:18,330 INFO [AM.ZK.Worker-pool2-t2] master.RegionStates: > Transitioned {1588230740 state=OPENING, ts=1408440978166, > server=localhost,60020,1408440975356} to {1588230740 state=OPEN, > ts=1408440978330, server=localhost,60020,1408440975356} > 2014-08-19 10:36:18,332 INFO [AM.ZK.Worker-pool2-t2] > handler.OpenedRegionHandler: Handling OPENED of 1588230740 from > localhost,60020,1408440975356; deleting unassigned node > 2014-08-19 10:36:18,334 DEBUG [AM.ZK.Worker-pool2-t2] zookeeper.ZKAssign: > master:60000-0x147ed8a761c0014, quorum=akhettar:2181, baseZNode=/hbase > Deleted unassigned node 1588230740 in expected state RS_ZK_REGION_OPENED > 2014-08-19 10:36:18,334 DEBUG [AM.ZK.Worker-pool2-t3] > master.AssignmentManager: Znode hbase:meta,,1.1588230740 deleted, state: > {1588230740 state=OPEN, ts=1408440978330, > server=localhost,60020,1408440975356} > 2014-08-19 10:36:18,335 INFO [AM.ZK.Worker-pool2-t3] master.RegionStates: > Onlined 1588230740 on localhost,60020,1408440975356 > 2014-08-19 10:36:18,335 INFO [master:localhost:60000] master.HMaster: > hbase:meta assigned=1, rit=false, location=localhost,60020,1408440975356 > 2014-08-19 10:36:18,395 INFO [master:localhost:60000] > catalog.MetaMigrationConvertingToPB: hbase:meta doesn't have any entries to > update. > 2014-08-19 10:36:18,395 INFO [master:localhost:60000] > catalog.MetaMigrationConvertingToPB: META already up-to date with PB > serialization > 2014-08-19 10:36:18,410 INFO [master:localhost:60000] > master.AssignmentManager: Found regions out on cluster or in RIT; presuming > failover > 2014-08-19 10:36:18,418 INFO [MASTER_SERVER_OPERATIONS-localhost:60000-0] > handler.ServerShutdownHandler: Splitting logs for > localhost,60020,1408439710636 before assignment. > 2014-08-19 10:36:18,419 DEBUG [MASTER_SERVER_OPERATIONS-localhost:60000-0] > master.MasterFileSystem: Renamed region directory: > file:/var/folders/ww/z3_504fn3yd0n92snzyh7sz40000gn/T/hbase-akhettar/hbase/WALs/localhost,60020,1408439710636-splitting > 2014-08-19 10:36:18,419 INFO [MASTER_SERVER_OPERATIONS-localhost:60000-0] > master.SplitLogManager: dead splitlog workers > [localhost,60020,1408439710636] > 2014-08-19 10:36:18,420 DEBUG [MASTER_SERVER_OPERATIONS-localhost:60000-0] > master.SplitLogManager: Scheduling batch of logs to split > 2014-08-19 10:36:18,421 INFO [MASTER_SERVER_OPERATIONS-localhost:60000-0] > master.SplitLogManager: started splitting 1 logs in > [file:/var/folders/ww/z3_504fn3yd0n92snzyh7sz40000gn/T/hbase-akhettar/hbase/WALs/localhost,60020,1408439710636-splitting] > 2014-08-19 10:36:18,431 DEBUG [main-EventThread] master.SplitLogManager: > put up splitlog task at znode > /hbase/splitWAL/WALs%2Flocalhost%2C60020%2C1408439710636-splitting%2Flocalhost%252C60020%252C1408439710636.1408439711728 > 2014-08-19 10:36:18,432 INFO [master:localhost:60000] > master.TableNamespaceManager: Namespace table not found. Creating... > 2014-08-19 10:36:18,433 DEBUG [main-EventThread] master.SplitLogManager: > task not yet acquired > /hbase/splitWAL/WALs%2Flocalhost%2C60020%2C1408439710636-splitting%2Flocalhost%252C60020%252C1408439710636.1408439711728 > ver = 0 > 2014-08-19 10:36:18,439 INFO [main-EventThread] master.SplitLogManager: > task > /hbase/splitWAL/WALs%2Flocalhost%2C60020%2C1408439710636-splitting%2Flocalhost%252C60020%252C1408439710636.1408439711728 > acquired by localhost,60020,1408440975356 > 2014-08-19 10:36:18,448 DEBUG [master:localhost:60000] > lock.ZKInterProcessLockBase: Acquired a lock for > /hbase/table-lock/hbase:namespace/write-master:600000000000009 > 2014-08-19 10:36:18,455 DEBUG [master:localhost:60000] > lock.ZKInterProcessLockBase: Released > /hbase/table-lock/hbase:namespace/write-master:600000000000009 > 2014-08-19 10:36:18,455 FATAL [master:localhost:60000] master.HMaster: > Master server abort: loaded coprocessors are: > [org.apache.hadoop.hbase.security.access.AccessController] > 2014-08-19 10:36:18,455 FATAL [master:localhost:60000] master.HMaster: > Unhandled exception. Starting shutdown. > org.apache.hadoop.hbase.TableExistsException: hbase:namespace > at > org.apache.hadoop.hbase.master.handler.CreateTableHandler.prepare(CreateTableHandler.java:120) > at > org.apache.hadoop.hbase.master.TableNamespaceManager.createNamespaceTable(TableNamespaceManager.java:232) > at > org.apache.hadoop.hbase.master.TableNamespaceManager.start(TableNamespaceManager.java:86) > at org.apache.hadoop.hbase.master.HMaster.initNamespace(HMaster.java:1052) > at > org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:915) > at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:603) > at java.lang.Thread.run(Thread.java:745) > 2014-08-19 10:36:18,457 INFO [master:localhost:60000] master.HMaster: > Aborting > 2014-08-19 10:36:18,457 DEBUG [master:localhost:60000] master.HMaster: > Stopping service threads > 2014-08-19 10:36:18,457 INFO [master:localhost:60000] ipc.RpcServer: > Stopping server on 60000 > 2014-08-19 10:36:18,457 INFO [localhost,60000,1408440968698-BalancerChore] > balancer.BalancerChore: localhost,60000,1408440968698-Balanc
