Rajesh Balamohan created HIVE-14764: ---------------------------------------
Summary: Enabling "hive.metastore.metrics.enabled" throws OOM in HiveMetastore Key: HIVE-14764 URL: https://issues.apache.org/jira/browse/HIVE-14764 Project: Hive Issue Type: Bug Components: Metastore Reporter: Rajesh Balamohan Assignee: Rajesh Balamohan Priority: Minor After running some queries with metrics enabled, metastore starts throwing the following messages. {noformat} Caused by: java.sql.SQLException: java.lang.OutOfMemoryError: GC overhead limit exceeded at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1075) at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:989) at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:984) at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:929) at com.mysql.jdbc.Util.handleNewInstance(Util.java:433) at com.mysql.jdbc.PreparedStatement.getInstance(PreparedStatement.java:877) at com.mysql.jdbc.ConnectionImpl.clientPrepareStatement(ConnectionImpl.java:1489) at com.mysql.jdbc.ConnectionImpl.prepareStatement(ConnectionImpl.java:4343) at com.mysql.jdbc.ConnectionImpl.prepareStatement(ConnectionImpl.java:4242) at com.jolbox.bonecp.ConnectionHandle.prepareStatement(ConnectionHandle.java:1024) at org.datanucleus.store.rdbms.SQLController.getStatementForQuery(SQLController.java:350) at org.datanucleus.store.rdbms.SQLController.getStatementForQuery(SQLController.java:295) at org.datanucleus.store.rdbms.scostore.JoinListStore.listIterator(JoinListStore.java:761) ... 36 more Nested Throwables StackTrace: java.sql.SQLException: java.lang.OutOfMemoryError: GC overhead limit exceeded at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1075) at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:989) at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:984) at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:929) at com.mysql.jdbc.Util.handleNewInstance(Util.java:433) at com.mysql.jdbc.PreparedStatement.getInstance(PreparedStatement.java:877) at com.mysql.jdbc.ConnectionImpl.clientPrepareStatement(ConnectionImpl.java:1489) at com.mysql.jdbc.ConnectionImpl.prepareStatement(ConnectionImpl.java:4343) at com.mysql.jdbc.ConnectionImpl.prepareStatement(ConnectionImpl.java:4242) at com.jolbox.bonecp.ConnectionHandle.prepareStatement(ConnectionHandle.java:1024) at org.datanucleus.store.rdbms.SQLController.getStatementForQuery(SQLController.java:350) at org.datanucleus.store.rdbms.SQLController.getStatementForQuery(SQLController.java:295) at org.datanucleus.store.rdbms.scostore.JoinListStore.listIterator(JoinListStore.java:761) at org.datanucleus.store.rdbms.scostore.AbstractListStore.listIterator(AbstractListStore.java:93) at org.datanucleus.store.rdbms.scostore.AbstractListStore.iterator(AbstractListStore.java:83) at org.datanucleus.store.types.wrappers.backed.List.loadFromStore(List.java:264) at org.datanucleus.store.types.wrappers.backed.List.iterator(List.java:492) at org.apache.hadoop.hive.metastore.ObjectStore.convertToFieldSchemas(ObjectStore.java:1199) at org.apache.hadoop.hive.metastore.ObjectStore.convertToStorageDescriptor(ObjectStore.java:1266) at org.apache.hadoop.hive.metastore.ObjectStore.convertToStorageDescriptor(ObjectStore.java:1281) at org.apache.hadoop.hive.metastore.ObjectStore.convertToTable(ObjectStore.java:1138) at org.apache.hadoop.hive.metastore.ObjectStore.ensureGetTable(ObjectStore.java:2651) at org.apache.hadoop.hive.metastore.ObjectStore.updatePartitionColumnStatistics(ObjectStore.java:6141) {noformat} HiveMetastore uses start/end functions for starting/ending the scope in MetricsFactory. In some places in HiveMetastore the function names are not matching causing gradual memory leak in metastore with metrics enabled. -- This message was sent by Atlassian JIRA (v6.3.4#6332)