Hi All, I have a DR cluster setup on GCP . It is replicating hbase version 1.2 from prod . Once the replication starts ,Hbase master dies and takes down all Region servers with it . I added /hbase-inscure option to zookeeper.znode.parent. parameter ,once I do that It gets cluster ID to region servers but not to zookeeper. There is not info on the cloudera blog or anywhere else on this topic . I have restarted cluster ,hbase master/RS multiple times without any luck .Replication is disabled now ,just need to get Hbase master back online .
Below is the Log output from Hbase master after trying to restart it . 2019-04-01 08:05:12,690 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: ClusterId : edb908eb-1621-444d-92c8-92c0fef54fcd ( cluster ID comes and RS starts vafter adding /hbase-unsecure but not mastewr ) 2019-04-01 08:05:21,258 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: ClusterId : edb908eb-1621-444d-92c8-92c0fef54fcd 2019-04-01 08:05:32,146 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: ClusterId : edb908eb-1621-444d-92c8-92c0fef54fcd 2019-04-01 08:05:43,851 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: ClusterId : edb908eb-1621-444d-92c8-92c0fef54fcd 2019-04-01 08:19:21,801 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: ClusterId : edb908eb-1621-444d-92c8-92c0fef54fcd 2019-04-01 08:19:33,121 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: ClusterId : edb908eb-1621-444d-92c8-92c0fef54fcd 2019-04-01 08:19:44,018 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: ClusterId : edb908eb-1621-444d-92c8-92c0fef54fcd 2019-04-01 08:19:56,362 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: ClusterId : edb908eb-1621-444d-92c8-92c0fef54fcd 2019-04-01 08:35:37,043 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: ClusterId : edb908eb-1621-444d-92c8-92c0fef54fcd 2019-04-01 08:35:46,746 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: ClusterId : edb908eb-1621-444d-92c8-92c0fef54fcd 2019-04-01 08:35:57,596 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: ClusterId : edb908eb-1621-444d-92c8-92c0fef54fcd 2019-04-01 08:36:09,741 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: ClusterId : edb908eb-1621-444d-92c8-92c0fef54fcd 2019-04-01 08:46:52,534 INFO org.apache.hadoop.hbase.client.ZooKeeperRegistry: ClusterId read in ZooKeeper is null 2019-04-01 08:46:52,550 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: ClusterId : null 2019-04-01 08:47:02,682 INFO org.apache.hadoop.hbase.client.ZooKeeperRegistry: ClusterId read in ZooKeeper is null 2019-04-01 08:47:02,702 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: ClusterId : null 2019-04-01 08:47:12,832 INFO org.apache.hadoop.hbase.client.ZooKeeperRegistry: ClusterId read in ZooKeeper is null 2019-04-01 08:47:12,851 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: ClusterId : null 2019-04-01 08:47:24,290 INFO org.apache.hadoop.hbase.client.ZooKeeperRegistry: ClusterId read in ZooKeeper is null 2019-04-01 08:47:24,306 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: ClusterId : null 2019-04-01 10:23:40,391 INFO org.apache.hadoop.hbase.client.ZooKeeperRegistry: ClusterId read in ZooKeeper is null 2019-04-01 10:23:40,412 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: ClusterId : null 2019-04-01 10:23:49,471 INFO org.apache.hadoop.hbase.client.ZooKeeperRegistry: ClusterId read in ZooKeeper is null 2019-04-01 10:23:49,485 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: ClusterId : null 2019-04-01 10:23:59,206 INFO org.apache.hadoop.hbase.client.ZooKeeperRegistry: ClusterId read in ZooKeeper is null 2019-04-01 10:23:59,222 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: ClusterId : null 2019-04-01 10:24:10,989 INFO org.apache.hadoop.hbase.client.ZooKeeperRegistry: ClusterId read in ZooKeeper is null 2019-04-01 10:24:11,004 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: ClusterId : null 2019-04-01 10:40:06,338 INFO org.apache.hadoop.hbase.client.ZooKeeperRegistry: ClusterId read in ZooKeeper is null 2019-04-01 10:40:06,352 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: ClusterId : null 2019-04-01 10:40:15,027 INFO org.apache.hadoop.hbase.client.ZooKeeperRegistry: ClusterId read in ZooKeeper is null 2019-04-01 10:40:15,044 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: ClusterId : null 2019-04-01 10:40:24,497 INFO org.apache.hadoop.hbase.client.ZooKeeperRegistry: ClusterId read in ZooKeeper is null 2019-04-01 10:40:24,533 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: ClusterId : null 2019-04-01 10:40:35,192 INFO org.apache.hadoop.hbase.client.ZooKeeperRegistry: ClusterId read in ZooKeeper is null 2019-04-01 10:40:35,207 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: ClusterId : null 2019-04-01 11:05:26,507 INFO org.apache.hadoop.hbase.client.ZooKeeperRegistry: ClusterId read in ZooKeeper is null 2019-04-01 11:05:26,523 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: ClusterId : null 2019-04-01 11:05:35,371 INFO org.apache.hadoop.hbase.client.ZooKeeperRegistry: ClusterId read in ZooKeeper is null 2019-04-01 11:05:35,387 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: ClusterId : null 2019-04-01 11:05:45,604 INFO org.apache.hadoop.hbase.client.ZooKeeperRegistry: ClusterId read in ZooKeeper is null 2019-04-01 11:05:45,616 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: ClusterId : null 2019-04-01 11:05:57,217 INFO org.apache.hadoop.hbase.client.ZooKeeperRegistry: ClusterId read in ZooKeeper is null 2019-04-01 11:05:57,229 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: ClusterId : null 2019-04-01 11:11:08,555 INFO org.apache.hadoop.hbase.client.ZooKeeperRegistry: ClusterId read in ZooKeeper is null 2019-04-01 11:11:08,571 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: ClusterId : null 2019-04-01 11:11:18,368 INFO org.apache.hadoop.hbase.client.ZooKeeperRegistry: ClusterId read in ZooKeeper is null 2019-04-01 11:11:18,384 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: ClusterId : null 2019-04-01 11:11:28,845 INFO org.apache.hadoop.hbase.client.ZooKeeperRegistry: ClusterId read in ZooKeeper is null 2019-04-01 11:11:28,890 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: ClusterId : null 2019-04-01 11:11:40,810 INFO org.apache.hadoop.hbase.client.ZooKeeperRegistry: ClusterId read in ZooKeeper is null 2019-04-01 11:11:40,827 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: ClusterId : null PROD [root@h-mgmt1-gcp-use1b hbase]# 2019-04-01 11:11:24,313 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:CDH_KAFKA_HOME=/usr/lib/kafka 2019-04-01 11:11:24,313 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:CLOUDERA_ORACLE_CONNECTOR_JAR=/usr/share/java/oracle-connector-java.jar 2019-04-01 11:11:24,313 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:CDH_HADOOP_BIN=/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/bin/hadoop 2019-04-01 11:11:24,313 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:HADOOP_CONF=/run/cloudera-scm-agent/process/89633-hbase-MASTER 2019-04-01 11:11:24,313 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:CDH_MR1_HOME=/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop-0.20-mapreduce 2019-04-01 11:11:24,314 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:CM_STATUS_CODES=STATUS_NONE HDFS_DFS_DIR_NOT_EMPTY HBASE_TABLE_DISABLED HBASE_TABLE_ENABLED JOBTRACKER_IN_STANDBY_MODE YARN_RM_IN_STANDBY_MODE 2019-04-01 11:11:24,314 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:CDH_YARN_HOME=/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop-yarn 2019-04-01 11:11:24,314 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:KEYTRUSTEE_KP_HOME=/usr/share/keytrustee-keyprovider 2019-04-01 11:11:24,314 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:SEARCH_HOME=/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/search 2019-04-01 11:11:24,314 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:HBASE_THRIFT_OPTS= 2019-04-01 11:11:24,314 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:HBASE_HOME=/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hbase 2019-04-01 11:11:24,314 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:CDH_SPARK_HOME=/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/spark 2019-04-01 11:11:24,314 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:HOME=/var/lib/hbase 2019-04-01 11:11:24,314 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:CGROUP_GROUP_CPUACCT= 2019-04-01 11:11:24,314 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:MALLOC_ARENA_MAX=4 2019-04-01 11:11:24,316 INFO org.apache.hadoop.hbase.util.ServerCommandLine: vmName=Java HotSpot(TM) 64-Bit Server VM, vmVendor=Oracle Corporation, vmVersion=25.181-b13 2019-04-01 11:11:24,316 INFO org.apache.hadoop.hbase.util.ServerCommandLine: vmInputArguments=[-Dproc_master, -XX:OnOutOfMemoryError=kill -9 %p, -Djava.net.preferIPv4Stack=true, -Djava.security.auth.login.config=/run/cloudera-scm-agent/process/89633-hbase-MASTER/jaas.conf, -Xms17179869184, -Xmx17179869184, -XX:+UseParNewGC, -XX:+UseConcMarkSweepGC, -XX:CMSInitiatingOccupancyFraction=70, -XX:+CMSParallelRemarkEnabled, -XX:ReservedCodeCacheSize=256m, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=/tmp/hbase_hbase-MASTER-5e2a4b659a42701aef349571d76be81a_pid12588.hprof, -XX:OnOutOfMemoryError=/usr/lib64/cmf/service/common/killparent.sh, -Dhbase.log.dir=/var/log/hbase, -Dhbase.log.file=hbase-cmf-hbase-MASTER-h-mgmt1-gcp-use1b.inf-impact.net.log.out, -Dhbase.home.dir=/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hbase, -Dhbase.id.str=, -Dhbase.root.logger=INFO,RFA, -Djava.library.path=/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/native:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hbase/lib/native/Linux-amd64-64, -Dhbase.security.logger=INFO,RFAS] 2019-04-01 11:11:24,674 INFO org.apache.hadoop.hbase.regionserver.RSRpcServices: master/ h-mgmt1-gcp-use1b.inf-impact.net/10.36.4.20:60000 server-side HConnection retries=350 2019-04-01 11:11:24,812 INFO org.apache.hadoop.hbase.ipc.SimpleRpcScheduler: Using fifo as user call queue, count=4 2019-04-01 11:11:24,829 INFO org.apache.hadoop.hbase.ipc.RpcServer: master/ h-mgmt1-gcp-use1b.inf-impact.net/10.36.4.20:60000: started 10 reader(s) listening on port=60000 2019-04-01 11:11:24,903 INFO org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from hadoop-metrics2.properties 2019-04-01 11:11:24,987 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s). 2019-04-01 11:11:24,988 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: HBase metrics system started 2019-04-01 11:11:25,591 INFO org.apache.hadoop.security.UserGroupInformation: Login successful for user hbase/[email protected] using keytab file hbase.keytab 2019-04-01 11:11:25,598 INFO org.apache.hadoop.hbase.io.hfile.CacheConfig: Allocating LruBlockCache size=6.37 GB, blockSize=64 KB 2019-04-01 11:11:25,604 INFO org.apache.hadoop.hbase.io.hfile.CacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=7019208, freeSize=6837036344, maxSize=6844055552, heapSize=7019208, minSize=6501852672, minFactor=0.95, multiSize=3250926336, multiFactor=0.5, singleSize=1625463168, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2019-04-01 11:11:25,606 INFO org.apache.hadoop.hbase.io.hfile.CacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=7019208, freeSize=6837036344, maxSize=6844055552, heapSize=7019208, minSize=6501852672, minFactor=0.95, multiSize=3250926336, multiFactor=0.5, singleSize=1625463168, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2019-04-01 11:11:25,610 INFO org.apache.hadoop.hbase.mob.MobFileCache: MobFileCache is initialized, and the cache size is 1000 2019-04-01 11:11:26,544 INFO org.apache.hadoop.conf.Configuration.deprecation: fs.default.name is deprecated. Instead, use fs.defaultFS 2019-04-01 11:11:26,562 INFO org.apache.hadoop.hbase.fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2019-04-01 11:11:26,571 INFO org.apache.hadoop.hbase.fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2019-04-01 11:11:26,625 INFO org.apache.hadoop.conf.Configuration.deprecation: hadoop.native.lib is deprecated. Instead, use io.native.lib.available 2019-04-01 11:11:26,815 INFO org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper: Process identifier=master:60000 connecting to ZooKeeper ensemble= h-mgmt3-gcp-use1b.inf-impact.net:2181,h-mgmt2-gcp-use1c.inf-impact.net:2181, h-mgmt1-gcp-use1b.inf-impact.net:2181 2019-04-01 11:11:26,821 INFO org.apache.zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.5-cdh5.15.1--1, built on 08/09/2018 16:19 GMT 2019-04-01 11:11:26,821 INFO org.apache.zookeeper.ZooKeeper: Client environment:host.name=h-mgmt1-gcp-use1b.inf-impact.net 2019-04-01 11:11:26,821 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.version=1.8.0_181 2019-04-01 11:11:26,821 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation 2019-04-01 11:11:26,821 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.home=/usr/java/jdk1.8.0_181-amd64/jre 2019-04-01 11:11:26,821 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.class.path=/run/cloudera-scm-agent/process/89633-hbase-MASTER:/usr/java/jdk1.8.0_181-1.cdh5.15.1.p0.4/lib/hadoop/libexec/../../hadoop-mapreduce/.//jersey-core-1.9.jar:/run/cloudera-scm-agent/process/89633-hbase-MASTER:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/hadoop-annotations.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/hadoop-auth.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/hadoop-aws.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/hadoop-azure-datalake.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/hadoop-common-tests.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/hadoop-common.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/hadoop-nfs.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/hadoop-nfs-2.6.0-cdh5.15.1.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/hadoop-common-2.6.0-cdh5.15.1.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/hadoop-common-2.6.0-cdh5.15.1-tests.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/hadoop-azure-datalake-2.6.0-cdh5.15.1.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/hadoop-aws-2.6.0-cdh5.15.1.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/hadoop-auth-2.6.0-cdh5.15.1.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/hadoop-annotations-2.6.0-cdh5.15.1.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/parquet-tools.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/parquet-thrift.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/parquet-test-hadoop2.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/parquet-scrooge_2.10.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/parquet-scala_2.10.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/parquet-protobuf.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/parquet-pig.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/parquet-pig-bundle.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/parquet-jackson.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/parquet-hadoop.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/parquet-hadoop-bundle.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/parquet-generator.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/parquet-encoding.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/parquet-common.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/parquet-column.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/parquet-cascading.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/parquet-avro.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/parquet-format.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/parquet-format-sources.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/parquet-format-javadoc.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/commons-configuration-1.6.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/commons-httpclient-3.1.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/commons-el-1.0.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/commons-math3-3.1.1.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/commons-logging-1.1.3.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/curator-recipes-2.7.1.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/commons-digester-1.8.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/htrace-core4-4.0.1-incubating.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/guava-11.0.2.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/commons-compress-1.4.1.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/jasper-compiler-5.5.23.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/curator-client-2.7.1.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/jaxb-impl-2.2.3-1.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/jasper-runtime-5.5.23.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/gson-2.2.4.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/jetty-6.1.26.cloudera.4.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/jersey-core-1.9.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/httpcore-4.2.5.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/commons-net-3.1.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/log4j-1.2.17.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/jsr305-3.0.0.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/jettison-1.1.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/jersey-json-1.9.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/jackson-xc-1.8.8.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/curator-framework-2.7.1.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/logredactor-1.0.3.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/jsch-0.1.42.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/jersey-server-1.9.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/jackson-jaxrs-1.8.8.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/commons-lang-2.6.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/api-asn1-api-1.0.0-M20.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/apacheds-i18n-2.0.0-M15.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/zookeeper.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/avro.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/xz-1.0.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/stax-api-1.0-2.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/protobuf-java-2.5.0.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/mockito-all-1.8.5.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/jsp-api-2.1.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/jets3t-0.9.0.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/jaxb-api-2.2.2.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/httpclient-4.2.5.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/commons-io-2.4.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/xmlenc-0.52.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/snappy-java-1.0.4.1.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/servlet-api-2.5.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/paranamer-2.3.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/commons-collections-3.2.2.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/commons-codec-1.4.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/commons-cli-1.2.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/commons-beanutils-core-1.8.0.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/commons-beanutils-1.9.2.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/azure-data-lake-store-sdk-2.2.9.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/aws-java-sdk-bundle-1.11.134.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/asm-3.2.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/api-util-1.0.0-M20.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/activation-1.1.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/slf4j-log4j12.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/hue-plugins-3.9.0-cdh5.15.1.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/slf4j-api-1.7.5.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/netty-3.10.5.Final.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/junit-4.11.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/jetty-util-6.1.26.cloudera.4.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/java-xmlbuilder-0.4.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/hamcrest-core-1.3.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin/../lib/zookeeper/zookeeper.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin/../lib/zookeeper/zookeeper-3.4.5-cdh5.15.1.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin/../lib/zookeeper/lib/slf4j-log4j12.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin/../lib/zookeeper/lib/slf4j-log4j12-1.7.5.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin/../lib/zookeeper/lib/slf4j-api-1.7.5.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin/../lib/zookeeper/lib/netty-3.10.5.Final.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin/../lib/zookeeper/lib/log4j-1.2.16.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin/../lib/zookeeper/lib/jline-2.11.jar:/usr/share/cmf/lib/plugins/event-publish-5.15.1-shaded.jar:/usr/share/cmf/lib/plugins/tt-instrumentation-5.15.1.jar:/usr/share/cmf/lib/plugins/navigator/cdh57/audit-plugin-cdh57-2.14.1-shaded.jar 2019-04-01 11:11:26,822 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.library.path=/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/native:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hbase/lib/native/Linux-amd64-64 2019-04-01 11:11:26,822 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/tmp 2019-04-01 11:11:26,822 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.compiler=<NA> 2019-04-01 11:11:26,822 INFO org.apache.zookeeper.ZooKeeper: Client environment:os.name=Linux 2019-04-01 11:11:26,822 INFO org.apache.zookeeper.ZooKeeper: Client environment:os.arch=amd64 2019-04-01 11:11:26,822 INFO org.apache.zookeeper.ZooKeeper: Client environment:os.version=3.10.0-862.11.6.el7.x86_64 2019-04-01 11:11:26,822 INFO org.apache.zookeeper.ZooKeeper: Client environment:user.name=hbase 2019-04-01 11:11:26,822 INFO org.apache.zookeeper.ZooKeeper: Client environment:user.home=/var/lib/hbase 2019-04-01 11:11:26,823 INFO org.apache.zookeeper.ZooKeeper: Client environment:user.dir=/run/cloudera-scm-agent/process/89633-hbase-MASTER 2019-04-01 11:11:26,824 INFO org.apache.zookeeper.ZooKeeper: Initiating client connection, connectString=h-mgmt3-gcp-use1b.inf-impact.net:2181, h-mgmt2-gcp-use1c.inf-impact.net:2181,h-mgmt1-gcp-use1b.inf-impact.net:2181 sessionTimeout=60000 watcher=master:600000x0, quorum= h-mgmt3-gcp-use1b.inf-impact.net:2181,h-mgmt2-gcp-use1c.inf-impact.net:2181, h-mgmt1-gcp-use1b.inf-impact.net:2181, baseZNode=/hbase 2019-04-01 11:11:26,974 INFO org.apache.zookeeper.Login: Client successfully logged in. 2019-04-01 11:11:26,976 INFO org.apache.zookeeper.Login: TGT refresh thread started. 2019-04-01 11:11:26,982 INFO org.apache.zookeeper.Login: TGT valid starting at: Mon Apr 01 11:11:26 EDT 2019 2019-04-01 11:11:26,982 INFO org.apache.zookeeper.Login: TGT expires: Tue Apr 02 11:11:26 EDT 2019 2019-04-01 11:11:26,983 INFO org.apache.zookeeper.Login: TGT refresh sleeping until: Tue Apr 02 06:34:41 EDT 2019 2019-04-01 11:11:26,983 INFO org.apache.zookeeper.client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2019-04-01 11:11:26,989 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server h-mgmt2-gcp-use1c.inf-impact.net/10.36.4.21:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2019-04-01 11:11:27,001 INFO org.apache.zookeeper.ClientCnxn: Socket connection established, initiating session, client: /10.36.4.20:56012, server: h-mgmt2-gcp-use1c.inf-impact.net/10.36.4.21:2181 2019-04-01 11:11:27,011 INFO org.apache.zookeeper.ClientCnxn: Session establishment complete on server h-mgmt2-gcp-use1c.inf-impact.net/10.36.4.21:2181, sessionid = 0x269d97284840007, negotiated timeout = 60000 2019-04-01 11:11:27,473 INFO org.apache.hadoop.hbase.zookeeper.ZKLeaderManager: Found existing leader with ID: h-mgmt1-gcp-use1b.inf-impact.net,60000,1554131485016 2019-04-01 11:11:27,518 INFO org.apache.hadoop.hbase.ipc.RpcServer: RpcServer.responder: starting 2019-04-01 11:11:27,629 INFO org.apache.hadoop.hbase.ipc.RpcServer: RpcServer.listener,port=60000: starting 2019-04-01 11:11:28,066 INFO org.mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2019-04-01 11:11:28,071 INFO org.apache.hadoop.hbase.http.HttpRequestLog: Http request log for http.requests.master is not defined 2019-04-01 11:11:28,086 INFO org.apache.hadoop.hbase.http.HttpServer: Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2019-04-01 11:11:28,087 INFO org.apache.hadoop.hbase.http.HttpServer: Added global filter 'clickjackingprevention' (class=org.apache.hadoop.hbase.http.ClickjackingPreventionFilter) 2019-04-01 11:11:28,089 INFO org.apache.hadoop.hbase.http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context master 2019-04-01 11:11:28,089 INFO org.apache.hadoop.hbase.http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2019-04-01 11:11:28,089 INFO org.apache.hadoop.hbase.http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2019-04-01 11:11:28,155 INFO org.apache.hadoop.hbase.http.HttpServer: Jetty bound to port 60010 2019-04-01 11:11:28,155 INFO org.mortbay.log: jetty-6.1.26.cloudera.4 2019-04-01 11:11:28,522 INFO org.mortbay.log: Started [email protected]:60010 2019-04-01 11:11:28,526 INFO org.apache.hadoop.hbase.master.HMaster: hbase.rootdir=hdfs://drnameservice/hbase, hbase.cluster.distributed=true 2019-04-01 11:11:28,541 INFO org.apache.hadoop.hbase.master.HMaster: Adding backup master ZNode /hbase/backup-masters/h-mgmt1-gcp-use1b.inf-impact.net ,60000,1554131485016 2019-04-01 11:11:28,618 INFO org.apache.hadoop.hbase.zookeeper.ZKLeaderManager: Leader change, but no new leader found 2019-04-01 11:11:28,627 INFO org.apache.hadoop.hbase.zookeeper.ZKLeaderManager: Found new leader for znode: /hbase/tokenauth/keymaster 2019-04-01 11:11:28,634 INFO org.apache.hadoop.hbase.master.ActiveMasterManager: Deleting ZNode for /hbase/backup-masters/h-mgmt1-gcp-use1b.inf-impact.net,60000,1554131485016 from backup master directory 2019-04-01 11:11:28,665 INFO org.apache.hadoop.hbase.master.ActiveMasterManager: Registered Active Master=h-mgmt1-gcp-use1b.inf-impact.net,60000,1554131485016 2019-04-01 11:11:28,676 INFO org.apache.hadoop.conf.Configuration.deprecation: fs.default.name is deprecated. Instead, use fs.defaultFS 2019-04-01 11:11:28,694 INFO org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x6d769d56 connecting to ZooKeeper ensemble= h-mgmt3-gcp-use1b.inf-impact.net:2181,h-mgmt2-gcp-use1c.inf-impact.net:2181, h-mgmt1-gcp-use1b.inf-impact.net:2181 2019-04-01 11:11:28,694 INFO org.apache.zookeeper.ZooKeeper: Initiating client connection, connectString=h-mgmt3-gcp-use1b.inf-impact.net:2181, h-mgmt2-gcp-use1c.inf-impact.net:2181,h-mgmt1-gcp-use1b.inf-impact.net:2181 sessionTimeout=60000 watcher=hconnection-0x6d769d560x0, quorum= h-mgmt3-gcp-use1b.inf-impact.net:2181,h-mgmt2-gcp-use1c.inf-impact.net:2181, h-mgmt1-gcp-use1b.inf-impact.net:2181, baseZNode=/hbase 2019-04-01 11:11:28,697 INFO org.apache.zookeeper.client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2019-04-01 11:11:28,698 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server h-mgmt1-gcp-use1b.inf-impact.net/10.36.4.20:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2019-04-01 11:11:28,701 INFO org.apache.zookeeper.ClientCnxn: Socket connection established, initiating session, client: /10.36.4.20:44084, server: h-mgmt1-gcp-use1b.inf-impact.net/10.36.4.20:2181 2019-04-01 11:11:28,708 INFO org.apache.zookeeper.ClientCnxn: Session establishment complete on server h-mgmt1-gcp-use1b.inf-impact.net/10.36.4.20:2181, sessionid = 0x369d972814b0006, negotiated timeout = 60000 2019-04-01 11:11:28,845 INFO org.apache.hadoop.hbase.client.ZooKeeperRegistry: ClusterId read in ZooKeeper is null 2019-04-01 11:11:28,889 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: STOPPED: Stopped by master/h-mgmt1-gcp-use1b.inf-impact.net/10.36.4.20:60000 2019-04-01 11:11:28,890 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: ClusterId : null 2019-04-01 11:11:28,890 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: Stopping infoServer 2019-04-01 11:11:28,896 INFO org.mortbay.log: Stopped [email protected]:60010 2019-04-01 11:11:28,998 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: stopping server h-mgmt1-gcp-use1b.inf-impact.net,60000,1554131485016 2019-04-01 11:11:28,999 INFO org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation: Closing zookeeper sessionid=0x369d972814b0006 2019-04-01 11:11:29,002 INFO org.apache.zookeeper.ZooKeeper: Session: 0x369d972814b0006 closed 2019-04-01 11:11:29,002 INFO org.apache.zookeeper.ClientCnxn: EventThread shut down 2019-04-01 11:11:29,005 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: stopping server h-mgmt1-gcp-use1b.inf-impact.net,60000,1554131485016; all regions closed. 2019-04-01 11:11:29,006 INFO org.apache.hadoop.hbase.ChoreService: Chore service for: h-mgmt1-gcp-use1b.inf-impact.net,60000,1554131485016 had [] on shutdown 2019-04-01 11:11:29,011 INFO org.apache.hadoop.hbase.ipc.RpcServer: Stopping server on 60000 2019-04-01 11:11:29,012 INFO org.apache.hadoop.hbase.zookeeper.ZKLeaderManager: Stepping down as leader 2019-04-01 11:11:29,014 INFO org.apache.hadoop.hbase.security.token.AuthenticationTokenSecretManager: Stopping leader election, because: SecretManager stopping 2019-04-01 11:11:29,015 INFO org.apache.hadoop.hbase.ipc.RpcServer: RpcServer.listener,port=60000: stopping 2019-04-01 11:11:29,083 INFO org.apache.hadoop.hbase.ipc.RpcServer: RpcServer.responder: stopped 2019-04-01 11:11:29,083 INFO org.apache.hadoop.hbase.ipc.RpcServer: RpcServer.responder: stopping 2019-04-01 11:11:29,091 INFO org.apache.zookeeper.ZooKeeper: Session: 0x269d97284840007 closed 2019-04-01 11:11:29,091 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: stopping server h-mgmt1-gcp-use1b.inf-impact.net,60000,1554131485016; zookeeper connection closed. 2019-04-01 11:11:29,092 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: master/ h-mgmt1-gcp-use1b.inf-impact.net/10.36.4.20:60000 exiting 2019-04-01 11:11:29,091 INFO org.apache.zookeeper.ClientCnxn: EventThread shut down 2019-04-01 11:11:35,823 INFO org.apache.hadoop.hbase.util.VersionInfo: HBase 1.2.0-cdh5.15.1 2019-04-01 11:11:35,840 INFO org.apache.hadoop.hbase.util.VersionInfo: Source code repository file:///data/jenkins/workspace/generic-package-centos64-7-0/topdir/BUILD/hbase-1.2.0-cdh5.15.1 revision=Unknown 2019-04-01 11:11:35,840 INFO org.apache.hadoop.hbase.util.VersionInfo: Compiled by jenkins on Thu Aug 9 09:07:41 PDT 2018 2019-04-01 11:11:35,840 INFO org.apache.hadoop.hbase.util.VersionInfo: From source with checksum 1309177973f3ca5da342a75775f3edc5 2019-04-01 11:11:36,143 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:PATH=/sbin:/usr/sbin:/bin:/usr/bin 2019-04-01 11:11:36,143 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:CDH_LLAMA_HOME=/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/llama 2019-04-01 11:11:36,143 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:HADOOP_CONF_DIR=/run/cloudera-scm-agent/process/89633-hbase-MASTER 2019-04-01 11:11:36,143 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:SUPERVISOR_ENABLED=1 2019-04-01 11:11:36,143 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:CDH_KUDU_HOME=/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/kudu 2019-04-01 11:11:36,144 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:PARCELS_ROOT=/opt/cloudera/parcels 2019-04-01 11:11:36,144 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:SCM_KERBEROS_PRINCIPAL=hbase/ [email protected] 2019-04-01 11:11:36,144 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:HBASE_REGIONSERVER_OPTS= 2019-04-01 11:11:36,144 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:KEYTRUSTEE_SERVER_HOME=/usr/lib/keytrustee-server 2019-04-01 11:11:36,144 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:CGROUP_GROUP_MEMORY= 2019-04-01 11:11:36,144 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:CDH_HBASE_INDEXER_HOME=/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hbase-solr 2019-04-01 11:11:36,144 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:HBASE_CONF_DIR=/run/cloudera-scm-agent/process/89633-hbase-MASTER 2019-04-01 11:11:36,144 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:CM_ADD_TO_CP_DIRS=navigator/cdh57 2019-04-01 11:11:36,144 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:KRB5CCNAME=/run/cloudera-scm-agent/process/89633-hbase-MASTER/krb5cc_261 2019-04-01 11:11:36,144 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:LD_LIBRARY_PATH=:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/native:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hbase/lib/native/Linux-amd64-64 2019-04-01 11:11:36,144 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:CDH_HBASE_HOME=/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hbase 2019-04-01 11:11:36,145 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:HBASE_REST_OPTS= 2019-04-01 11:11:36,145 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:CDH_MR2_HOME=/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop-mapreduce 2019-04-01 11:11:36,145 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:JSVC_HOME=/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/bigtop-utils 2019-04-01 11:11:36,145 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:TOMCAT_HOME=/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/bigtop-tomcat 2019-04-01 11:11:36,145 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:PWD=/run/cloudera-scm-agent/process/89633-hbase-MASTER 2019-04-01 11:11:36,145 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:CDH_HTTPFS_HOME=/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop-httpfs 2019-04-01 11:11:36,145 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:CDH_PIG_HOME=/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/pig 2019-04-01 11:11:36,145 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:CDH_FLUME_HOME=/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/flume-ng 2019-04-01 11:11:36,145 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:CDH_PARQUET_HOME=/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/parquet 2019-04-01 11:11:36,145 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:HBASE_ROOT_LOGGER=INFO,RFA 2019-04-01 11:11:36,145 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:SHELL=/bin/bash 2019-04-01 11:11:36,145 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:CDH_ZOOKEEPER_HOME=/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/zookeeper 2019-04-01 11:11:36,146 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:CDH_HADOOP_HOME=/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop 2019-04-01 11:11:36,146 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:CLOUDERA_POSTGRESQL_JDBC_JAR=/usr/share/cmf/lib/postgresql-42.1.4.jre7.jar 2019-04-01 11:11:36,146 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:PARCEL_DIRNAMES=CDH-5.15.1-1.cdh5.15.1.p0.4 2019-04-01 11:11:36,146 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:HBASE_MASTER_OPTS=-Djava.security.auth.login.config=/run/cloudera-scm-agent/process/89633-hbase-MASTER/jaas.conf -Xms17179869184 -Xmx17179869184 -XX:+UseParNewGC -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled -XX:ReservedCodeCacheSize=256m -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/tmp/hbase_hbase-MASTER-5e2a4b659a42701aef349571d76be81a_pid12892.hprof -XX:OnOutOfMemoryError=/usr/lib64/cmf/service/common/killparent.sh 2019-04-01 11:11:36,146 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:HBASE_MANAGES_ZK=false 2019-04-01 11:11:36,146 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:SUPERVISOR_SERVER_URL=unix:///run/cloudera-scm-agent/supervisor/supervisord.sock 2019-04-01 11:11:36,146 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:CLOUDERA_MYSQL_CONNECTOR_JAR=/usr/share/java/mysql-connector-java.jar 2019-04-01 11:11:36,147 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:WEBHCAT_DEFAULT_XML=/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/hive-webhcat/conf.dist/webhcat-default.xml 2019-04-01 11:11:36,147 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:CDH_HUE_HOME=/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hue 2019-04-01 11:11:36,147 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:CDH_CRUNCH_HOME=/usr/lib/crunch 2019-04-01 11:11:36,147 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:SUPERVISOR_PROCESS_NAME=89633-hbase-MASTER 2019-04-01 11:11:36,147 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:SUPERVISOR_GROUP_NAME=89633-hbase-MASTER 2019-04-01 11:11:36,147 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:BIGTOP_DEFAULTS_DIR= 2019-04-01 11:11:36,147 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:JAAS_FILE=jaas.conf 2019-04-01 11:11:36,147 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:HADOOP_HOME=/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop 2019-04-01 11:11:36,147 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:HIVE_DEFAULT_XML=/etc/hive/conf.dist/hive-default.xml 2019-04-01 11:11:36,147 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:CGROUP_ROOT_BLKIO=/sys/fs/cgroup/blkio 2019-04-01 11:11:36,147 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:HBASE_OPTS=-Djava.net.preferIPv4Stack=true -Djava.security.auth.login.config=/run/cloudera-scm-agent/process/89633-hbase-MASTER/jaas.conf -Xms17179869184 -Xmx17179869184 -XX:+UseParNewGC -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled -XX:ReservedCodeCacheSize=256m -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/tmp/hbase_hbase-MASTER-5e2a4b659a42701aef349571d76be81a_pid12892.hprof -XX:OnOutOfMemoryError=/usr/lib64/cmf/service/common/killparent.sh -Dhbase.log.dir=/var/log/hbase -Dhbase.log.file=hbase-cmf-hbase-MASTER-h-mgmt1-gcp-use1b.inf-impact.net.log.out -Dhbase.home.dir=/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hbase -Dhbase.id.str= -Dhbase.root.logger=INFO,RFA -Djava.library.path=/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/native:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hbase/lib/native/Linux-amd64-64 -Dhbase.security.logger=INFO,RFAS 2019-04-01 11:11:36,148 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:CDH_SOLR_HOME=/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/solr 2019-04-01 11:11:36,148 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:CDH_HCAT_HOME=/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hive-hcatalog 2019-04-01 11:11:36,148 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:SHLVL=2 2019-04-01 11:11:36,148 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:ZOOKEEPER_HOME=/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin/../lib/zookeeper 2019-04-01 11:11:36,148 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:HBASE_LOGFILE=hbase-cmf-hbase-MASTER-h-mgmt1-gcp-use1b.inf-impact.net.log.out 2019-04-01 11:11:36,148 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:CDH_OOZIE_HOME=/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/oozie 2019-04-01 11:11:36,148 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:CDH_SENTRY_HOME=/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/sentry 2019-04-01 11:11:36,148 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:CMF_PACKAGE_DIR=/usr/lib64/cmf/service 2019-04-01 11:11:36,148 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:CGROUP_ROOT_CPU=/sys/fs/cgroup/cpu,cpuacct 2019-04-01 11:11:36,148 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:JAVA_HOME=/usr/java/jdk1.8.0_181-amd64 2019-04-01 11:11:36,148 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:CMF_CONF_DIR=/etc/cloudera-scm-agent 2019-04-01 11:11:36,148 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:CONF_DIR=/run/cloudera-scm-agent/process/89633-hbase-MASTER 2019-04-01 11:11:36,148 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:CDH_HDFS_HOME=/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop-hdfs 2019-04-01 11:11:36,148 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:LANG=en_US.UTF-8 2019-04-01 11:11:36,148 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:CGROUP_ROOT_MEMORY=/sys/fs/cgroup/memory 2019-04-01 11:11:36,148 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:SCM_DEFINES_SCRIPTS=/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/meta/cdh_env.sh 2019-04-01 11:11:36,148 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:CGROUP_GROUP_CPU= 2019-04-01 11:11:36,148 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:ORACLE_HOME=/usr/share/oracle/instantclient 2019-04-01 11:11:36,148 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:CDH_SQOOP2_HOME=/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/sqoop2 2019-04-01 11:11:36,149 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:CGROUP_ROOT_CPUACCT=/sys/fs/cgroup/cpu,cpuacct 2019-04-01 11:11:36,149 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:HBASE_CLASSPATH=/run/cloudera-scm-agent/process/89633-hbase-MASTER:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/*:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop/lib/*:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin/../lib/zookeeper/*:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin/../lib/zookeeper/lib/*:/usr/share/cmf/lib/plugins/event-publish-5.15.1-shaded.jar:/usr/share/cmf/lib/plugins/tt-instrumentation-5.15.1.jar:/usr/share/cmf/lib/plugins/navigator/cdh57/audit-plugin-cdh57-2.14.1-shaded.jar 2019-04-01 11:11:36,149 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:MGMT_HOME=/usr/share/cmf 2019-04-01 11:11:36,149 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:CGROUP_GROUP_BLKIO= 2019-04-01 11:11:36,149 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:CDH_HIVE_HOME=/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hive 2019-04-01 11:11:36,149 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:CDH_KMS_HOME=/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop-kms 2019-04-01 11:11:36,149 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:CDH_IMPALA_HOME=/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/impala 2019-04-01 11:11:36,149 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:HBASE_ZNODE_FILE=/run/cloudera-scm-agent/process/89633-hbase-MASTER/znode12892 2019-04-01 11:11:36,149 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:CDH_AVRO_HOME=/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/avro 2019-04-01 11:11:36,149 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:CDH_SQOOP_HOME=/usr/lib/sqoop 2019-04-01 11:11:36,149 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:HBASE_LOG_DIR=/var/log/hbase 2019-04-01 11:11:36,149 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:CDH_HUE_PLUGINS_HOME=/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hadoop 2019-04-01 11:11:36,149 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:CDH_VERSION=5 2019-04-01 11:11:36,150 INFO org.apache.hadoop.hbase.util.ServerCommandLine: env:CLASSPATH=/run/cloudera-scm-agent/process/89633-hbase-MASTER:/usr/java/jdk1.8.0_181-amd64/lib/tools.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hbase:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hbase/lib/activation-1.1.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hbase/lib/apacheds-i18n-2.0.0-M15.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hbase/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hbase/lib/api-asn1-api-1.0.0-M20.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hbase/lib/api-util-1.0.0-M20.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hbase/lib/asm-3.2.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hbase/lib/avro.jar:/opt/cloudera/parcels/CDH-5.15.1- Thanks SD
