Sangjin Lee created YARN-5379: --------------------------------- Summary: TestHBaseTimelineStorage. testWriteApplicationToHBase() fails intermittently Key: YARN-5379 URL: https://issues.apache.org/jira/browse/YARN-5379 Project: Hadoop YARN Issue Type: Bug Components: test, timelineserver Affects Versions: 3.0.0-alpha1 Reporter: Sangjin Lee Priority: Minor
The {{TestHBaseTimelineStorage. testWriteApplicationToHBase()}} test seems to fail intermittently: {noformat} java.lang.AssertionError: null at org.junit.Assert.fail(Assert.java:86) at org.junit.Assert.assertTrue(Assert.java:41) at org.junit.Assert.assertTrue(Assert.java:52) at org.apache.hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorage.testWriteApplicationToHBase(TestHBaseTimelineStorage.java:817) {noformat} The stdout output: {noformat} 2016-07-13 00:15:48,883 INFO [main] zookeeper.RecoverableZooKeeper (RecoverableZooKeeper.java:<init>(120)) - Process identifier=hconnection-0x2b7962a2 connecting to ZooKeeper ensemble=localhost:53474 2016-07-13 00:15:48,883 INFO [main] zookeeper.ZooKeeper (ZooKeeper.java:<init>(438)) - Initiating client connection, connectString=localhost:53474 sessionTimeout=90000 watcher=hconnection-0x2b7962a20x0, quorum=localhost:53474, baseZNode=/hbase 2016-07-13 00:15:48,886 INFO [main-SendThread(localhost:53474)] zookeeper.ClientCnxn (ClientCnxn.java:logStartConnect(975)) - Opening socket connection to server localhost/127.0.0.1:53474. Will not attempt to authenticate using SASL (unknown error) 2016-07-13 00:15:48,887 INFO [main-SendThread(localhost:53474)] zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(852)) - Socket connection established to localhost/127.0.0.1:53474, initiating session 2016-07-13 00:15:48,887 INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:53474] server.NIOServerCnxnFactory (NIOServerCnxnFactory.java:run(197)) - Accepted socket connection from /127.0.0.1:38097 2016-07-13 00:15:48,887 INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:53474] server.ZooKeeperServer (ZooKeeperServer.java:processConnectRequest(868)) - Client attempting to establish new session at /127.0.0.1:38097 2016-07-13 00:15:48,896 INFO [SyncThread:0] server.ZooKeeperServer (ZooKeeperServer.java:finishSessionInit(617)) - Established session 0x155e19baa520025 with negotiated timeout 40000 for client /127.0.0.1:38097 2016-07-13 00:15:48,896 INFO [main-SendThread(localhost:53474)] zookeeper.ClientCnxn (ClientCnxn.java:onConnected(1235)) - Session establishment complete on server localhost/127.0.0.1:53474, sessionid = 0x155e19baa520025, negotiated timeout = 40000 2016-07-13 00:15:48,911 INFO [main] zookeeper.RecoverableZooKeeper (RecoverableZooKeeper.java:<init>(120)) - Process identifier=hconnection-0x32130e61 connecting to ZooKeeper ensemble=localhost:53474 2016-07-13 00:15:48,912 INFO [main] zookeeper.ZooKeeper (ZooKeeper.java:<init>(438)) - Initiating client connection, connectString=localhost:53474 sessionTimeout=90000 watcher=hconnection-0x32130e610x0, quorum=localhost:53474, baseZNode=/hbase 2016-07-13 00:15:48,917 INFO [main-SendThread(localhost:53474)] zookeeper.ClientCnxn (ClientCnxn.java:logStartConnect(975)) - Opening socket connection to server localhost/127.0.0.1:53474. Will not attempt to authenticate using SASL (unknown error) 2016-07-13 00:15:48,918 INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:53474] server.NIOServerCnxnFactory (NIOServerCnxnFactory.java:run(197)) - Accepted socket connection from /127.0.0.1:38098 2016-07-13 00:15:48,921 INFO [main-SendThread(localhost:53474)] zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(852)) - Socket connection established to localhost/127.0.0.1:53474, initiating session 2016-07-13 00:15:48,921 INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:53474] server.ZooKeeperServer (ZooKeeperServer.java:processConnectRequest(868)) - Client attempting to establish new session at /127.0.0.1:38098 2016-07-13 00:15:48,929 INFO [SyncThread:0] server.ZooKeeperServer (ZooKeeperServer.java:finishSessionInit(617)) - Established session 0x155e19baa520026 with negotiated timeout 40000 for client /127.0.0.1:38098 2016-07-13 00:15:48,929 INFO [main-SendThread(localhost:53474)] zookeeper.ClientCnxn (ClientCnxn.java:onConnected(1235)) - Session establishment complete on server localhost/127.0.0.1:53474, sessionid = 0x155e19baa520026, negotiated timeout = 40000 2016-07-13 00:15:48,938 INFO [main] storage.HBaseTimelineWriterImpl (HBaseTimelineWriterImpl.java:serviceStop(541)) - closing the entity table 2016-07-13 00:15:48,938 INFO [main] storage.HBaseTimelineWriterImpl (HBaseTimelineWriterImpl.java:serviceStop(546)) - closing the app_flow table 2016-07-13 00:15:48,938 INFO [main] storage.HBaseTimelineWriterImpl (HBaseTimelineWriterImpl.java:serviceStop(551)) - closing the application table 2016-07-13 00:15:48,941 INFO [RpcServer.reader=1,bindAddress=2588a1932efe,port=37493] hbase.Server (RpcServer.java:processConnectionHeader(1678)) - Connection from 172.17.0.3 port: 35467 with version info: version: "1.1.3" url: "git://diocles.local/Volumes/hbase-1.1.3RC1/hbase" revision: "72bc50f5fafeb105b2139e42bbee3d61ca724989" user: "ndimiduk" date: "Sat Jan 16 18:31:39 PST 2016" src_checksum: "72c910d76fba182fa4e3c7e048275ca3" 2016-07-13 00:15:48,950 INFO [main] storage.HBaseTimelineWriterImpl (HBaseTimelineWriterImpl.java:serviceStop(555)) - closing the flow run table 2016-07-13 00:15:48,957 INFO [main] storage.HBaseTimelineWriterImpl (HBaseTimelineWriterImpl.java:serviceStop(560)) - closing the flowActivityTable table 2016-07-13 00:15:48,957 INFO [main] storage.HBaseTimelineWriterImpl (HBaseTimelineWriterImpl.java:serviceStop(565)) - closing the hbase Connection 2016-07-13 00:15:48,958 INFO [main] client.ConnectionManager$HConnectionImplementation (ConnectionManager.java:closeZooKeeperWatcher(1677)) - Closing zookeeper sessionid=0x155e19baa520026 2016-07-13 00:15:48,958 INFO [ProcessThread(sid:0 cport:-1):] server.PrepRequestProcessor (PrepRequestProcessor.java:pRequest2Txn(494)) - Processed session termination for sessionid: 0x155e19baa520026 2016-07-13 00:15:48,968 INFO [main] zookeeper.ZooKeeper (ZooKeeper.java:close(684)) - Session: 0x155e19baa520026 closed 2016-07-13 00:15:48,968 INFO [main-EventThread] zookeeper.ClientCnxn (ClientCnxn.java:run(512)) - EventThread shut down 2016-07-13 00:15:48,968 INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:53474] server.NIOServerCnxn (NIOServerCnxn.java:closeSock(1007)) - Closed socket connection for client /127.0.0.1:38098 which had sessionid 0x155e19baa520026 2016-07-13 00:15:48,979 INFO [main] zookeeper.RecoverableZooKeeper (RecoverableZooKeeper.java:<init>(120)) - Process identifier=hconnection-0x4596f8f3 connecting to ZooKeeper ensemble=localhost:53474 2016-07-13 00:15:48,979 INFO [main] zookeeper.ZooKeeper (ZooKeeper.java:<init>(438)) - Initiating client connection, connectString=localhost:53474 sessionTimeout=90000 watcher=hconnection-0x4596f8f30x0, quorum=localhost:53474, baseZNode=/hbase 2016-07-13 00:15:48,980 INFO [main-SendThread(localhost:53474)] zookeeper.ClientCnxn (ClientCnxn.java:logStartConnect(975)) - Opening socket connection to server localhost/127.0.0.1:53474. Will not attempt to authenticate using SASL (unknown error) 2016-07-13 00:15:48,981 INFO [main-SendThread(localhost:53474)] zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(852)) - Socket connection established to localhost/127.0.0.1:53474, initiating session 2016-07-13 00:15:48,981 INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:53474] server.NIOServerCnxnFactory (NIOServerCnxnFactory.java:run(197)) - Accepted socket connection from /127.0.0.1:38100 2016-07-13 00:15:48,981 INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:53474] server.ZooKeeperServer (ZooKeeperServer.java:processConnectRequest(868)) - Client attempting to establish new session at /127.0.0.1:38100 2016-07-13 00:15:48,987 INFO [SyncThread:0] server.ZooKeeperServer (ZooKeeperServer.java:finishSessionInit(617)) - Established session 0x155e19baa520027 with negotiated timeout 40000 for client /127.0.0.1:38100 2016-07-13 00:15:48,988 INFO [main-SendThread(localhost:53474)] zookeeper.ClientCnxn (ClientCnxn.java:onConnected(1235)) - Session establishment complete on server localhost/127.0.0.1:53474, sessionid = 0x155e19baa520027, negotiated timeout = 40000 2016-07-13 00:15:48,992 INFO [RpcServer.reader=2,bindAddress=2588a1932efe,port=37493] hbase.Server (RpcServer.java:processConnectionHeader(1678)) - Connection from 172.17.0.3 port: 35470 with version info: version: "1.1.3" url: "git://diocles.local/Volumes/hbase-1.1.3RC1/hbase" revision: "72bc50f5fafeb105b2139e42bbee3d61ca724989" user: "ndimiduk" date: "Sat Jan 16 18:31:39 PST 2016" src_checksum: "72c910d76fba182fa4e3c7e048275ca3" 2016-07-13 00:15:49,001 INFO [RpcServer.reader=3,bindAddress=2588a1932efe,port=37493] hbase.Server (RpcServer.java:processConnectionHeader(1678)) - Connection from 172.17.0.3 port: 35472 with version info: version: "1.1.3" url: "git://diocles.local/Volumes/hbase-1.1.3RC1/hbase" revision: "72bc50f5fafeb105b2139e42bbee3d61ca724989" user: "ndimiduk" date: "Sat Jan 16 18:31:39 PST 2016" src_checksum: "72c910d76fba182fa4e3c7e048275ca3" 2016-07-13 00:15:49,010 INFO [main] storage.HBaseTimelineReaderImpl (HBaseTimelineReaderImpl.java:serviceStop(64)) - closing the hbase Connection 2016-07-13 00:15:49,010 INFO [main] client.ConnectionManager$HConnectionImplementation (ConnectionManager.java:closeZooKeeperWatcher(1677)) - Closing zookeeper sessionid=0x155e19baa520025 2016-07-13 00:15:49,011 INFO [ProcessThread(sid:0 cport:-1):] server.PrepRequestProcessor (PrepRequestProcessor.java:pRequest2Txn(494)) - Processed session termination for sessionid: 0x155e19baa520025 2016-07-13 00:15:49,021 INFO [main] zookeeper.ZooKeeper (ZooKeeper.java:close(684)) - Session: 0x155e19baa520025 closed 2016-07-13 00:15:49,021 INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:53474] server.NIOServerCnxn (NIOServerCnxn.java:closeSock(1007)) - Closed socket connection for client /127.0.0.1:38097 which had sessionid 0x155e19baa520025 2016-07-13 00:15:49,021 INFO [main-EventThread] zookeeper.ClientCnxn (ClientCnxn.java:run(512)) - EventThread shut down 0.16 sec 1 {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org