Hello I'm running Hortonworks data platform 2.5.0.0 with included hive. I'm using storm hive bolt to load data into my hive. But launching many hive bolt always leads me to TimeoutException on calling hive metastore. Metastore logs full of Exception like this:
2017-03-15 18:46:12,436 ERROR [pool-5-thread-11]: txn.TxnHandler (TxnHandler.java:getDbConn(1834)) - There is a problem with a connection from the pool, retrying(rc=7): Timed out waiting for a free available connection. (SQLState=08001, ErrorCode=0) java.sql.SQLException: Timed out waiting for a free available connection. at com.jolbox.bonecp.DefaultConnectionStrategy.getConnectionInternal(DefaultConnectionStrategy.java:88) at com.jolbox.bonecp.AbstractConnectionStrategy.getConnection(AbstractConnectionStrategy.java:90) at com.jolbox.bonecp.BoneCP.getConnection(BoneCP.java:553) at com.jolbox.bonecp.BoneCPDataSource.getConnection(BoneCPDataSource.java:131) at org.apache.hadoop.hive.metastore.txn.TxnHandler.getDbConn(TxnHandler.java:1827) at org.apache.hadoop.hive.metastore.txn.TxnHandler.enqueueLockWithRetry(TxnHandler.java:873) at org.apache.hadoop.hive.metastore.txn.TxnHandler.lock(TxnHandler.java:814) at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.lock(HiveMetaStore.java:5751) After looking through code I found out 1) TxnHandler class uses connection pool to get db connections and it's size is 10. 2) TxnHandler::lock method requset new connection whe executing this line of code:
