[ 
https://issues.apache.org/jira/browse/HIVE-14764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15492972#comment-15492972
 ] 

Hive QA commented on HIVE-14764:
--------------------------------



Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12828609/HIVE-14764.1.patch

{color:red}ERROR:{color} -1 due to no test(s) being added or modified.

{color:red}ERROR:{color} -1 due to 8 failed/errored test(s), 10543 tests 
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[acid_mapjoin]
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[auto_sortmerge_join_2]
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[stats0]
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[vector_join_part_col_char]
org.apache.hadoop.hive.cli.TestMiniLlapCliDriver.testCliDriver[acid_bucket_pruning]
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver[explainuser_3]
org.apache.hive.jdbc.TestJdbcWithMiniHS2.testAddJarConstructorUnCaching
org.apache.hive.spark.client.TestSparkClient.testJobSubmission
{noformat}

Test results: 
https://builds.apache.org/job/PreCommit-HIVE-MASTER-Build/1198/testReport
Console output: 
https://builds.apache.org/job/PreCommit-HIVE-MASTER-Build/1198/console
Test logs: 
http://ec2-204-236-174-241.us-west-1.compute.amazonaws.com/logs/PreCommit-HIVE-MASTER-Build-1198/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 8 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12828609 - PreCommit-HIVE-MASTER-Build

> Enabling "hive.metastore.metrics.enabled" throws OOM in HiveMetastore
> ---------------------------------------------------------------------
>
>                 Key: HIVE-14764
>                 URL: https://issues.apache.org/jira/browse/HIVE-14764
>             Project: Hive
>          Issue Type: Bug
>          Components: Metastore
>            Reporter: Rajesh Balamohan
>            Assignee: Rajesh Balamohan
>            Priority: Minor
>         Attachments: HIVE-14764.1.patch, hd_1.png, hd_2.png
>
>
> After running some queries with metrics enabled, metastore starts throwing 
> the following messages.
> {noformat}
> Caused by: java.sql.SQLException: java.lang.OutOfMemoryError: GC overhead 
> limit exceeded
>         at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1075)
>         at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:989)
>         at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:984)
>         at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:929)
>         at com.mysql.jdbc.Util.handleNewInstance(Util.java:433)
>         at 
> com.mysql.jdbc.PreparedStatement.getInstance(PreparedStatement.java:877)
>         at 
> com.mysql.jdbc.ConnectionImpl.clientPrepareStatement(ConnectionImpl.java:1489)
>         at 
> com.mysql.jdbc.ConnectionImpl.prepareStatement(ConnectionImpl.java:4343)
>         at 
> com.mysql.jdbc.ConnectionImpl.prepareStatement(ConnectionImpl.java:4242)
>         at 
> com.jolbox.bonecp.ConnectionHandle.prepareStatement(ConnectionHandle.java:1024)
>         at 
> org.datanucleus.store.rdbms.SQLController.getStatementForQuery(SQLController.java:350)
>         at 
> org.datanucleus.store.rdbms.SQLController.getStatementForQuery(SQLController.java:295)
>         at 
> org.datanucleus.store.rdbms.scostore.JoinListStore.listIterator(JoinListStore.java:761)
>         ... 36 more
> Nested Throwables StackTrace:
> java.sql.SQLException: java.lang.OutOfMemoryError: GC overhead limit exceeded
>         at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1075)
>         at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:989)
>         at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:984)
>         at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:929)
>         at com.mysql.jdbc.Util.handleNewInstance(Util.java:433)
>         at 
> com.mysql.jdbc.PreparedStatement.getInstance(PreparedStatement.java:877)
>         at 
> com.mysql.jdbc.ConnectionImpl.clientPrepareStatement(ConnectionImpl.java:1489)
>         at 
> com.mysql.jdbc.ConnectionImpl.prepareStatement(ConnectionImpl.java:4343)
>         at 
> com.mysql.jdbc.ConnectionImpl.prepareStatement(ConnectionImpl.java:4242)
>         at 
> com.jolbox.bonecp.ConnectionHandle.prepareStatement(ConnectionHandle.java:1024)
>         at 
> org.datanucleus.store.rdbms.SQLController.getStatementForQuery(SQLController.java:350)
>         at 
> org.datanucleus.store.rdbms.SQLController.getStatementForQuery(SQLController.java:295)
>         at 
> org.datanucleus.store.rdbms.scostore.JoinListStore.listIterator(JoinListStore.java:761)
>         at 
> org.datanucleus.store.rdbms.scostore.AbstractListStore.listIterator(AbstractListStore.java:93)
>         at 
> org.datanucleus.store.rdbms.scostore.AbstractListStore.iterator(AbstractListStore.java:83)
>         at 
> org.datanucleus.store.types.wrappers.backed.List.loadFromStore(List.java:264)
>         at 
> org.datanucleus.store.types.wrappers.backed.List.iterator(List.java:492)
>         at 
> org.apache.hadoop.hive.metastore.ObjectStore.convertToFieldSchemas(ObjectStore.java:1199)
>         at 
> org.apache.hadoop.hive.metastore.ObjectStore.convertToStorageDescriptor(ObjectStore.java:1266)
>         at 
> org.apache.hadoop.hive.metastore.ObjectStore.convertToStorageDescriptor(ObjectStore.java:1281)
>         at 
> org.apache.hadoop.hive.metastore.ObjectStore.convertToTable(ObjectStore.java:1138)
>         at 
> org.apache.hadoop.hive.metastore.ObjectStore.ensureGetTable(ObjectStore.java:2651)
>         at 
> org.apache.hadoop.hive.metastore.ObjectStore.updatePartitionColumnStatistics(ObjectStore.java:6141)
> {noformat}
> HiveMetastore uses start/end functions for starting/ending the scope in 
> MetricsFactory. In some places in HiveMetastore the function names are not 
> matching causing gradual memory leak in metastore with metrics enabled.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to