[ https://issues.apache.org/jira/browse/HIVE-19136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vihang Karajgaonkar reassigned HIVE-19136: ------------------------------------------ > DbNotifications clean up throws NPE on mysql databases > ------------------------------------------------------ > > Key: HIVE-19136 > URL: https://issues.apache.org/jira/browse/HIVE-19136 > Project: Hive > Issue Type: Bug > Components: Metastore > Affects Versions: 3.0.0 > Reporter: Vihang Karajgaonkar > Assignee: Vihang Karajgaonkar > Priority: Major > > I see following stack trace in HMS logs when db notification cleaner thread > tries to clean the old notification. > {noformat} > Exception in thread "CleanerThread" javax.jdo.JDODataStoreException: > Transaction failed to commit > at > org.datanucleus.api.jdo.NucleusJDOHelper.getJDOExceptionForNucleusException(NucleusJDOHelper.java:543) > at > org.datanucleus.api.jdo.JDOTransaction.rollback(JDOTransaction.java:189) > at > org.apache.hadoop.hive.metastore.ObjectStore.rollbackTransaction(ObjectStore.java:790) > at > org.apache.hadoop.hive.metastore.ObjectStore.rollbackAndCleanup(ObjectStore.java:10425) > at > org.apache.hadoop.hive.metastore.ObjectStore.cleanNotificationEvents(ObjectStore.java:9258) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:498) > at > org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:97) > at com.sun.proxy.$Proxy22.cleanNotificationEvents(Unknown Source) > at > org.apache.hive.hcatalog.listener.DbNotificationListener$CleanerThread.run(DbNotificationListener.java:737) > NestedThrowablesStackTrace: > Unexpected exception encountered during query. > org.datanucleus.exceptions.NucleusDataStoreException: Unexpected exception > encountered during query. > at > org.datanucleus.store.rdbms.ConnectionFactoryImpl$ManagedConnectionImpl.close(ConnectionFactoryImpl.java:569) > at > org.datanucleus.store.connection.ConnectionManagerImpl$2.transactionRolledBack(ConnectionManagerImpl.java:400) > at > org.datanucleus.TransactionImpl.internalRollback(TransactionImpl.java:534) > at org.datanucleus.TransactionImpl.rollback(TransactionImpl.java:451) > at > org.datanucleus.api.jdo.JDOTransaction.rollback(JDOTransaction.java:185) > at > org.apache.hadoop.hive.metastore.ObjectStore.rollbackTransaction(ObjectStore.java:790) > at > org.apache.hadoop.hive.metastore.ObjectStore.rollbackAndCleanup(ObjectStore.java:10425) > at > org.apache.hadoop.hive.metastore.ObjectStore.cleanNotificationEvents(ObjectStore.java:9258) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:498) > at > org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:97) > at com.sun.proxy.$Proxy22.cleanNotificationEvents(Unknown Source) > at > org.apache.hive.hcatalog.listener.DbNotificationListener$CleanerThread.run(DbNotificationListener.java:737) > Caused by: java.sql.SQLException: Unexpected exception encountered during > query. > at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:963) > at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:896) > at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:885) > at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:860) > at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2582) > at > com.mysql.jdbc.ConnectionImpl.rollbackNoChecks(ConnectionImpl.java:4698) > at com.mysql.jdbc.ConnectionImpl.rollback(ConnectionImpl.java:4590) > at > com.zaxxer.hikari.pool.ProxyConnection.close(ProxyConnection.java:233) > at > org.datanucleus.store.rdbms.ConnectionFactoryImpl$ManagedConnectionImpl.close(ConnectionFactoryImpl.java:557) > ... 14 more > Caused by: java.lang.NullPointerException > at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2545) > ... 18 more > Nested Throwables StackTrace: > java.sql.SQLException: Unexpected exception encountered during query. > at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:963) > at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:896) > at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:885) > at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:860) > at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2582) > at > com.mysql.jdbc.ConnectionImpl.rollbackNoChecks(ConnectionImpl.java:4698) > at com.mysql.jdbc.ConnectionImpl.rollback(ConnectionImpl.java:4590) > at > com.zaxxer.hikari.pool.ProxyConnection.close(ProxyConnection.java:233) > at > org.datanucleus.store.rdbms.ConnectionFactoryImpl$ManagedConnectionImpl.close(ConnectionFactoryImpl.java:557) > at > org.datanucleus.store.connection.ConnectionManagerImpl$2.transactionRolledBack(ConnectionManagerImpl.java:400) > at > org.datanucleus.TransactionImpl.internalRollback(TransactionImpl.java:534) > at org.datanucleus.TransactionImpl.rollback(TransactionImpl.java:451) > at > org.datanucleus.api.jdo.JDOTransaction.rollback(JDOTransaction.java:185) > at > org.apache.hadoop.hive.metastore.ObjectStore.rollbackTransaction(ObjectStore.java:790) > at > org.apache.hadoop.hive.metastore.ObjectStore.rollbackAndCleanup(ObjectStore.java:10425) > at > org.apache.hadoop.hive.metastore.ObjectStore.cleanNotificationEvents(ObjectStore.java:9258) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:498) > at > org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:97) > at com.sun.proxy.$Proxy22.cleanNotificationEvents(Unknown Source) > at > org.apache.hive.hcatalog.listener.DbNotificationListener$CleanerThread.run(DbNotificationListener.java:737) > Caused by: java.lang.NullPointerException > at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2545) > ... 18 more > {noformat} -- This message was sent by Atlassian JIRA (v7.6.3#76005)