Re: [DISCUSS] Merge branch HBASE-21512 to master

2019-06-03 Thread Shekhar Dhotre
how to unsubscribe ? Thanks



On Mon, Jun 3, 2019 at 3:24 PM 张铎(Duo Zhang)  wrote:

> The main work for HBASE-21512 has been done, though there are still several
> flaky UTs need to addressed. I think it is time to discuss how to merge it
> back to master so we can ship it in 3.0.0 release.
>
> Opened a PR here, see
>
> https://github.com/apache/hbase/pull/287
>
> Comments are welcomed.
>
> Thanks.
>


Re: [jira] [Resolved] (HBASE-22522) The integration test in master branch's nightly job has error "ERROR: Only found 1050 rows."

2019-06-03 Thread Shekhar Dhotre
unsubscribe



On Sun, Jun 2, 2019 at 7:45 PM Guanghao Zhang (JIRA) 
wrote:

>
>  [
> https://issues.apache.org/jira/browse/HBASE-22522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
> ]
>
> Guanghao Zhang resolved HBASE-22522.
> 
>Resolution: Fixed
> Fix Version/s: 2.1.6
>2.3.0
>2.2.0
>3.0.0
>
> > The integration test in master branch's nightly job has error "ERROR:
> Only found 1050 rows."
> >
> 
> >
> > Key: HBASE-22522
> > URL: https://issues.apache.org/jira/browse/HBASE-22522
> > Project: HBase
> >  Issue Type: Bug
> >Affects Versions: 3.0.0
> >Reporter: Guanghao Zhang
> >Assignee: Guanghao Zhang
> >Priority: Major
> > Fix For: 3.0.0, 2.2.0, 2.3.0, 2.1.6
> >
> > Attachments: HBASE-22522.branch-2.001.patch,
> HBASE-22522.master.001.patch
> >
> >
> > [
> https://builds.apache.org/job/HBase%20Nightly/job/master/1075/artifact/output-integration/hadoop-2.log
> ]
> > [
> https://builds.apache.org/job/HBase%20Nightly/job/master/1075/artifact/output-integration/hadoop-3.log
> ]
>
>
>
> --
> This message was sent by Atlassian JIRA
> (v7.6.3#76005)
>


Re: Hbase master down due to null cluster ID

2019-04-02 Thread Shekhar Dhotre
Update : It was due to corrupt znode. I deleted it and recreated .. Hbase
master in CM shows up but at Hbase shell : status shows it’s starting for
long time . Restarted cluster ,etc

Cannot create Table .


Shekhar


On Mon, 1 Apr 2019 at 1:31 PM, Shekhar Dhotre <
shekhar.dho...@clairvoyantsoft.com> wrote:

> Hi All ,
> I have a cluster which is setup to replicate to GCP . In the log its
> showing cluster ID null so found this document which shows how to setup
> cluster ID .but that is for a third party product called FusionInsight
> Manager.
>
>
> http://support-it.huawei.com/docs/en-us/fusioninsight-all/maintenance-guide/en-us_topic_0087315479.html
>
>
> Where can I setup the below in Cloudera ?
>
> HBase Startup Failure Due to cluster.id Not Configured
>
> Region severs starts but as soon as I try to start master ,it brings down
> all RS and master also doesnt come up .
>
> Thanks for your help in advance .
> SD
> Hadoop Admin .
> --
>
> Thank you !
>
>
> * Shekhar Dhotre.*
>
> senior Hadoop Administrator
>
> shekhar.dho...@clairvoyantsoft.com 
>
> clairvoyantsoft.com/insight
>
-- 

Regards

* Shekhar Dhotre.*

*S*enior Hadoop Administrator

shekhar.dho...@clairvoyantsoft.com 

clairvoyantsoft.com/insight


Re: Hbase master nmot starting with ClusterId read in ZooKeeper is null error .

2019-04-02 Thread Shekhar Dhotre
PROD [root@h-mgmt1-gcp-use1b conf]# zookeeper-client -server
h-mgmt1-gcp-use1b

Connecting to h-mgmt1-gcp-use1b

2019-04-02 02:50:47,484 [myid:] - INFO  [main:Environment@100] - Client
environment:zookeeper.version=3.4.5-cdh5.15.1--1, built on 08/09/2018 16:19
GMT

2019-04-02 02:50:47,487 [myid:] - INFO  [main:Environment@100] - Client
environment:host.name=h-mgmt1-gcp-use1b.inf-impact.net

2019-04-02 02:50:47,487 [myid:] - INFO  [main:Environment@100] - Client
environment:java.version=1.8.0_181

2019-04-02 02:50:47,489 [myid:] - INFO  [main:Environment@100] - Client
environment:java.vendor=Oracle Corporation

2019-04-02 02:50:47,489 [myid:] - INFO  [main:Environment@100] - Client
environment:java.home=/usr/java/jdk1.8.0_181-amd64/jre

2019-04-02 02:50:47,489 [myid:] - INFO  [main:Environment@100] - Client
environment:java.class.path=/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/zookeeper/bin/../build/classes:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/zookeeper/bin/../build/lib/*.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/zookeeper/bin/../lib/slf4j-log4j12.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/zookeeper/bin/../lib/slf4j-log4j12-1.7.5.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/zookeeper/bin/../lib/slf4j-api-1.7.5.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/zookeeper/bin/../lib/netty-3.10.5.Final.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/zookeeper/bin/../lib/log4j-1.2.16.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/zookeeper/bin/../lib/jline-2.11.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/zookeeper/bin/../zookeeper-3.4.5-cdh5.15.1.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/zookeeper/bin/../src/java/lib/*.jar:/etc/zookeeper/conf::/etc/zookeeper/conf:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin/../lib/zookeeper/zookeeper.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin/../lib/zookeeper/zookeeper-3.4.5-cdh5.15.1.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin/../lib/zookeeper/lib/slf4j-log4j12.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin/../lib/zookeeper/lib/slf4j-log4j12-1.7.5.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin/../lib/zookeeper/lib/slf4j-api-1.7.5.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin/../lib/zookeeper/lib/netty-3.10.5.Final.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin/../lib/zookeeper/lib/log4j-1.2.16.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin/../lib/zookeeper/lib/jline-2.11.jar

2019-04-02 02:50:47,489 [myid:] - INFO  [main:Environment@100] - Client
environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib

2019-04-02 02:50:47,489 [myid:] - INFO  [main:Environment@100] - Client
environment:java.io.tmpdir=/tmp

2019-04-02 02:50:47,489 [myid:] - INFO  [main:Environment@100] - Client
environment:java.compiler=

2019-04-02 02:50:47,490 [myid:] - INFO  [main:Environment@100] - Client
environment:os.name=Linux

2019-04-02 02:50:47,490 [myid:] - INFO  [main:Environment@100] - Client
environment:os.arch=amd64

2019-04-02 02:50:47,490 [myid:] - INFO  [main:Environment@100] - Client
environment:os.version=3.10.0-862.11.6.el7.x86_64

2019-04-02 02:50:47,490 [myid:] - INFO  [main:Environment@100] - Client
environment:user.name=root

2019-04-02 02:50:47,490 [myid:] - INFO  [main:Environment@100] - Client
environment:user.home=/root

2019-04-02 02:50:47,490 [myid:] - INFO  [main:Environment@100] - Client
environment:user.dir=/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/etc/zookeeper/conf.dist

2019-04-02 02:50:47,491 [myid:] - INFO  [main:ZooKeeper@438] - Initiating
client connection, connectString=h-mgmt1-gcp-use1b sessionTimeout=3
watcher=org.apache.zookeeper.ZooKeeperMain$MyWatcher@1a86f2f1

Welcome to ZooKeeper!

*2019-04-02 02:50:47,509 [myid:] - INFO
[main-SendThread(h-mgmt1-gcp-use1b.inf-impact.net:2181):ClientCnxn$SendThread@975]
- Opening socket connection to server
h-mgmt1-gcp-use1b.inf-impact.net/10.36.4.20:2181
<http://h-mgmt1-gcp-use1b.inf-impact.net/10.36.4.20:2181>. Will not attempt
to authenticate using SASL (unknown error)*

*JLine support is enabled*

2019-04-02 02:50:47,564 [myid:] - INFO
[main-SendThread(h-mgmt1-gcp-use1b.inf-impact.net:2181
):ClientCnxn$SendThread@852] - Socket connection established, initiating
session, client: /10.36.4.20:57028, server:
h-mgmt1-gcp-use1b.inf-impact.net/10.36.4.20:2181

2019-04-02 02:50:47,572 [myid:] - INFO
[main-SendThread(h-mgmt1-gcp-use1b.inf-impact.net:2181
):ClientCnxn$SendThread@1235] - Session establishment complete on server
h-mgmt1-gcp-use1b.inf-impact.net/10.36.4.20:2181, sessionid =
0x369d972814b063c, negotiated timeout = 3



WATCHER::



WatchedEvent state:SyncConnected type:None path:null



On Tue, Apr 2, 2019 at 12:07 PM Shekhar Dhotre <
shekhar.dho...@clairvoyantsoft.com> wrote:

> Hi All,
> I have a DR cluster setup on GCP . It is

Hbase master nmot starting with ClusterId read in ZooKeeper is null error .

2019-04-02 Thread Shekhar Dhotre
Hi All,
I have a DR cluster setup on GCP . It is replicating hbase version 1.2 from
prod . Once the replication starts ,Hbase master dies and takes down all
Region servers with it .
I added /hbase-inscure option  to   zookeeper.znode.parent.   parameter
,once I do that It gets cluster ID to region servers but not to zookeeper.
There is not info on the cloudera blog or anywhere else on this topic .  I
have restarted cluster ,hbase master/RS multiple times without any luck
.Replication is disabled now ,just need to get Hbase master back online .

Below is the Log output  from Hbase master after trying to restart it .


2019-04-01 08:05:12,690 INFO
org.apache.hadoop.hbase.regionserver.HRegionServer: ClusterId :
edb908eb-1621-444d-92c8-92c0fef54fcd  ( cluster ID comes  and RS starts
vafter adding /hbase-unsecure but not mastewr )
2019-04-01 08:05:21,258 INFO
org.apache.hadoop.hbase.regionserver.HRegionServer: ClusterId :
edb908eb-1621-444d-92c8-92c0fef54fcd
2019-04-01 08:05:32,146 INFO
org.apache.hadoop.hbase.regionserver.HRegionServer: ClusterId :
edb908eb-1621-444d-92c8-92c0fef54fcd
2019-04-01 08:05:43,851 INFO
org.apache.hadoop.hbase.regionserver.HRegionServer: ClusterId :
edb908eb-1621-444d-92c8-92c0fef54fcd
2019-04-01 08:19:21,801 INFO
org.apache.hadoop.hbase.regionserver.HRegionServer: ClusterId :
edb908eb-1621-444d-92c8-92c0fef54fcd
2019-04-01 08:19:33,121 INFO
org.apache.hadoop.hbase.regionserver.HRegionServer: ClusterId :
edb908eb-1621-444d-92c8-92c0fef54fcd
2019-04-01 08:19:44,018 INFO
org.apache.hadoop.hbase.regionserver.HRegionServer: ClusterId :
edb908eb-1621-444d-92c8-92c0fef54fcd
2019-04-01 08:19:56,362 INFO
org.apache.hadoop.hbase.regionserver.HRegionServer: ClusterId :
edb908eb-1621-444d-92c8-92c0fef54fcd
2019-04-01 08:35:37,043 INFO
org.apache.hadoop.hbase.regionserver.HRegionServer: ClusterId :
edb908eb-1621-444d-92c8-92c0fef54fcd
2019-04-01 08:35:46,746 INFO
org.apache.hadoop.hbase.regionserver.HRegionServer: ClusterId :
edb908eb-1621-444d-92c8-92c0fef54fcd
2019-04-01 08:35:57,596 INFO
org.apache.hadoop.hbase.regionserver.HRegionServer: ClusterId :
edb908eb-1621-444d-92c8-92c0fef54fcd
2019-04-01 08:36:09,741 INFO
org.apache.hadoop.hbase.regionserver.HRegionServer: ClusterId :
edb908eb-1621-444d-92c8-92c0fef54fcd
2019-04-01 08:46:52,534 INFO
org.apache.hadoop.hbase.client.ZooKeeperRegistry: ClusterId read in
ZooKeeper is null
2019-04-01 08:46:52,550 INFO
org.apache.hadoop.hbase.regionserver.HRegionServer: ClusterId : null
2019-04-01 08:47:02,682 INFO
org.apache.hadoop.hbase.client.ZooKeeperRegistry: ClusterId read in
ZooKeeper is null
2019-04-01 08:47:02,702 INFO
org.apache.hadoop.hbase.regionserver.HRegionServer: ClusterId : null
2019-04-01 08:47:12,832 INFO
org.apache.hadoop.hbase.client.ZooKeeperRegistry: ClusterId read in
ZooKeeper is null
2019-04-01 08:47:12,851 INFO
org.apache.hadoop.hbase.regionserver.HRegionServer: ClusterId : null
2019-04-01 08:47:24,290 INFO
org.apache.hadoop.hbase.client.ZooKeeperRegistry: ClusterId read in
ZooKeeper is null
2019-04-01 08:47:24,306 INFO
org.apache.hadoop.hbase.regionserver.HRegionServer: ClusterId : null
2019-04-01 10:23:40,391 INFO
org.apache.hadoop.hbase.client.ZooKeeperRegistry: ClusterId read in
ZooKeeper is null
2019-04-01 10:23:40,412 INFO
org.apache.hadoop.hbase.regionserver.HRegionServer: ClusterId : null
2019-04-01 10:23:49,471 INFO
org.apache.hadoop.hbase.client.ZooKeeperRegistry: ClusterId read in
ZooKeeper is null
2019-04-01 10:23:49,485 INFO
org.apache.hadoop.hbase.regionserver.HRegionServer: ClusterId : null
2019-04-01 10:23:59,206 INFO
org.apache.hadoop.hbase.client.ZooKeeperRegistry: ClusterId read in
ZooKeeper is null
2019-04-01 10:23:59,222 INFO
org.apache.hadoop.hbase.regionserver.HRegionServer: ClusterId : null
2019-04-01 10:24:10,989 INFO
org.apache.hadoop.hbase.client.ZooKeeperRegistry: ClusterId read in
ZooKeeper is null
2019-04-01 10:24:11,004 INFO
org.apache.hadoop.hbase.regionserver.HRegionServer: ClusterId : null
2019-04-01 10:40:06,338 INFO
org.apache.hadoop.hbase.client.ZooKeeperRegistry: ClusterId read in
ZooKeeper is null
2019-04-01 10:40:06,352 INFO
org.apache.hadoop.hbase.regionserver.HRegionServer: ClusterId : null
2019-04-01 10:40:15,027 INFO
org.apache.hadoop.hbase.client.ZooKeeperRegistry: ClusterId read in
ZooKeeper is null
2019-04-01 10:40:15,044 INFO
org.apache.hadoop.hbase.regionserver.HRegionServer: ClusterId : null
2019-04-01 10:40:24,497 INFO
org.apache.hadoop.hbase.client.ZooKeeperRegistry: ClusterId read in
ZooKeeper is null
2019-04-01 10:40:24,533 INFO
org.apache.hadoop.hbase.regionserver.HRegionServer: ClusterId : null
2019-04-01 10:40:35,192 INFO
org.apache.hadoop.hbase.client.ZooKeeperRegistry: ClusterId read in
ZooKeeper is null
2019-04-01 10:40:35,207 INFO
org.apache.hadoop.hbase.regionserver.HRegionServer: ClusterId : null
2019-04-01 11:05:26,507 INFO
org.apache.hadoop.hbase.client.ZooKeeperRegistry: ClusterId read in
ZooKeeper is null
2019-04-01 11:05:26,523 INFO

Re: [VOTE] HBase Thirdparty 2.2.0 RC1

2019-04-01 Thread Shekhar Dhotre
Sure ,I will repost question and logs with new thread . Thanks

On Mon, 1 Apr 2019 at 11:59 PM, Stack  wrote:

> Shekar:
>
> You put your note on a VOTE thread. Please redo your query in its own
> thread to hbase dev.
>
> Can you paste some log when you redo your message on the dev list?
>
> Thanks,
> S
>
> On Mon, Apr 1, 2019 at 12:33 AM Shekhar Dhotre <
> shekhar.dho...@clairvoyantsoft.com> wrote:
>
> > Hi All ,
> > I have a cluster which is setup to replicate to GCP . In the log its
> > showing cluster ID null so found this document which shows how to setup
> > cluster ID .but that is for a third party product called FusionInsight
> > Manager.
> >
> >
> >
> http://support-it.huawei.com/docs/en-us/fusioninsight-all/maintenance-guide/en-us_topic_0087315479.html
> >
> >
> > Where can I setup the below in Cloudera ?
> >
> > HBase Startup Failure Due to cluster.id Not Configured
> >
> > Region severs starts but as soon as I try to start master ,it brings down
> > all RS and master also doesnt come up .
> >
> > Thanks for your help in advance .
> > SD
> > Hadoop Admin .
> >
>
-- 

Thank you !


* Shekhar Dhotre.*

senior Hadoop Administrator

shekhar.dho...@clairvoyantsoft.com 

clairvoyantsoft.com/insight


Hbase master down due to null cluster ID

2019-04-01 Thread Shekhar Dhotre
Hi All ,
I have a cluster which is setup to replicate to GCP . In the log its
showing cluster ID null so found this document which shows how to setup
cluster ID .but that is for a third party product called FusionInsight
Manager.

http://support-it.huawei.com/docs/en-us/fusioninsight-all/maintenance-guide/en-us_topic_0087315479.html


Where can I setup the below in Cloudera ?

HBase Startup Failure Due to cluster.id Not Configured

Region severs starts but as soon as I try to start master ,it brings down
all RS and master also doesnt come up .

Thanks for your help in advance .
SD
Hadoop Admin .
-- 

Thank you !


* Shekhar Dhotre.*

senior Hadoop Administrator

shekhar.dho...@clairvoyantsoft.com 

clairvoyantsoft.com/insight


Re: [VOTE] HBase Thirdparty 2.2.0 RC1

2019-04-01 Thread Shekhar Dhotre
Hi All ,
I have a cluster which is setup to replicate to GCP . In the log its
showing cluster ID null so found this document which shows how to setup
cluster ID .but that is for a third party product called FusionInsight
Manager.

http://support-it.huawei.com/docs/en-us/fusioninsight-all/maintenance-guide/en-us_topic_0087315479.html


Where can I setup the below in Cloudera ?

HBase Startup Failure Due to cluster.id Not Configured

Region severs starts but as soon as I try to start master ,it brings down
all RS and master also doesnt come up .

Thanks for your help in advance .
SD
Hadoop Admin .