Nigel,
To get rid of “Connection refused” WARN logs, please set the following property in conf/atlas-application.properties and start Atlas : atlas.server.ha.zookeeper.connect=localhost:2181 Not sure what causes HBase error “ConnectionLoss for /hbase/meta-region-server” in your environment though. By any chance, is there another zookeeper running in your env? Thanks, Madhan From: Nigel Jones <[email protected]> on behalf of Nigel Jones <[email protected]> Reply-To: Nigel Jones <[email protected]> Date: Thursday, November 30, 2017 at 4:19 PM To: Apoorv Naik <[email protected]>, Madhan Neethiraj <[email protected]>, Ashutosh Mestry <[email protected]> Cc: Nigel Jones <[email protected]>, atlas <[email protected]>, Sarath Subramanian <[email protected]> Subject: Re: Review Request 64141: [ATLAS-2287]: Include lucene libraries when building atlas distribution with Janus profile This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/64141/ I tried the new patch (2287.2) - mvn command as above (janus). Build is clean, but I still get errors when starting the server in application.log, the UI is now giving me error 503. It still looks like zookeeper & hbase issues 2017-12-01 00:14:58,069 WARN - [main-SendThread(localhost:2181):] ~ Session 0x0 for server null, unexpected error, closing socket connecti on and attempting reconnect (ClientCnxn$SendThread:1102) java.net.ConnectException: Connection refused at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081) Also 2017-12-01 00:12:41,095 WARN - [main:] ~ Possibly transient ZooKeeper, quorum=localhost:2181, exception=org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase/meta-region-server (RecoverableZooKeeper:275) 2017-12-01 00:12:41,095 ERROR - [main:] ~ ZooKeeper getData failed after 4 attempts (RecoverableZooKeeper:277) 2017-12-01 00:12:41,096 WARN - [main:] ~ hconnection-0x23b8d9f30x0, quorum=localhost:2181, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server (ZKUtil:753) org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase/meta-region-server at org.apache.zookeeper.KeeperException.create(KeeperException.java:99) at org.apache.zookeeper.KeeperException.create(KeeperException.java:51) at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155) at org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.getData(RecoverableZooKeeper.java:359) at org.apache.hadoop.hbase.zookeeper.ZKUtil.getData(ZKUtil.java:745) at org.apache.hadoop.hbase.zookeeper.MetaTableLocator.getMetaRegionState(MetaTableLocator.java:482) at org.apache.hadoop.hbase.zookeeper.MetaTableLocator.getMetaRegionLocation(MetaTableLocator.java:168) at org.apache.hadoop.hbase.zookeeper.MetaTableLocator.blockUntilAvailable(MetaTableLocator.java:600) at org.apache.hadoop.hbase.zookeeper.MetaTableLocator.blockUntilAvailable(MetaTableLocator.java:580) at org.apache.hadoop.hbase.zookeeper.MetaTableLocator.blockUntilAvailable(MetaTableLocator.java:559) at org.apache.hadoop.hbase.client.ZooKeeperRegistry.getMetaRegionLocation(ZooKeeperRegistry.java:61) at .... And some of these: 2017-12-01 00:12:41,096 ERROR - [main:] ~ hconnection-0x23b8d9f30x0, quorum=localhost:2181, baseZNode=/hbase Received unexpected KeeperExce ption, re-throwing exception (ZooKeeperWatcher:648) org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase/meta-region-server at org.apache.zookeeper.KeeperException.create(KeeperException.java:99) at org.apache.zookeeper.KeeperException.create(KeeperException.java:51) at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155) at org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.getData(RecoverableZooKeeper.java:359) at org.apache.hadoop.hbase.zookeeper.ZKUtil.getData(ZKUtil.java:745) at org.apache.hadoop.hbase.zookeeper.MetaTableLocator.getMetaRegionState(MetaTableLocator.java:482) at org.apache.hadoop.hbase.zookeeper.MetaTableLocator.getMetaRegionLocation(MetaTableLocator.java:168) at org.apache.hadoop.hbase.zookeeper.MetaTableLocator.blockUntilAvailable(MetaTableLocator.java:600) at org.apache.hadoop.hbase.zookeeper.MetaTableLocator.blockUntilAvailable(MetaTableLocator.java:580) at org.apache.hadoop.hbase.zookeeper.MetaTableLocator.blockUntilAvailable(MetaTableLocator.java:559) at org.apache.hadoop.hbase.client.ZooKeeperRegistry.getMetaRegionLocation(ZooKeeperRegistry.java:61) at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateMeta(ConnectionManager.java:1185) at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegion(ConnectionManager.java:1152) at org.apache.hadoop.hbase.client.RpcRetryingCallerWithReadReplicas.getRegionLocations(RpcRetryingCallerWithReadReplicas.java:300) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:151) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:59) at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithoutRetries(RpcRetryingCaller.java:200) - Nigel Jones On November 30th, 2017, 8:59 p.m. GMT, Sarath Subramanian wrote: Review request for atlas, Apoorv Naik, Ashutosh Mestry, and Madhan Neethiraj. By Sarath Subramanian. Updated Nov. 30, 2017, 8:59 p.m.Bugs: ATLAS-2287 Repository: atlas Description When Atlas is build using -Pdist profile, lucene jars are excluded during packaging of the war file. Since we are not shading graphdb module for janus profile, these jars are needed as run time dependency.Titan's shaded jar includes the lucene libraries and hence were excluded during packaging of war to avoid duplicate dependencies. Testing validated building atlas distribution using both janus and titan0 profile. Atlas starts fine and basic functionalities working. mvn clean install -DskipTests -Pdist,embedded-hbase-solrmvn clean install -DskipTests -Pdist,embedded-hbase-solr -DGRAPH-PROVIDER=titan0 Diffs distro/pom.xml (eea256d8) graphdb/janus/src/test/resources/atlas-application.properties (ebc74ff3) intg/src/test/resources/atlas-application.properties (ce9351a6) pom.xml (3720c1f5) repository/pom.xml (e24122e5) webapp/pom.xml (b4a96d36) View Diff
