[
https://issues.apache.org/jira/browse/HIVE-22097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16947032#comment-16947032
]
Hive QA commented on HIVE-22097:
--------------------------------
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12982497/HIVE-22097.1.branch-3.1.patch
{color:red}ERROR:{color} -1 due to no test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 139 failed/errored test(s), 14415 tests
executed
*Failed tests:*
{noformat}
TestAddPartitions - did not produce a TEST-*.xml file (likely timed out)
(batchId=226)
TestAddPartitionsFromPartSpec - did not produce a TEST-*.xml file (likely timed
out) (batchId=228)
TestAdminUser - did not produce a TEST-*.xml file (likely timed out)
(batchId=235)
TestAggregateStatsCache - did not produce a TEST-*.xml file (likely timed out)
(batchId=230)
TestAlterPartitions - did not produce a TEST-*.xml file (likely timed out)
(batchId=228)
TestAppendPartitions - did not produce a TEST-*.xml file (likely timed out)
(batchId=228)
TestBeeLineDriver - did not produce a TEST-*.xml file (likely timed out)
(batchId=274)
TestCachedStore - did not produce a TEST-*.xml file (likely timed out)
(batchId=235)
TestCatalogCaching - did not produce a TEST-*.xml file (likely timed out)
(batchId=235)
TestCatalogNonDefaultClient - did not produce a TEST-*.xml file (likely timed
out) (batchId=226)
TestCatalogNonDefaultSvr - did not produce a TEST-*.xml file (likely timed out)
(batchId=235)
TestCatalogOldClient - did not produce a TEST-*.xml file (likely timed out)
(batchId=226)
TestCatalogs - did not produce a TEST-*.xml file (likely timed out)
(batchId=228)
TestChainFilter - did not produce a TEST-*.xml file (likely timed out)
(batchId=230)
TestCheckConstraint - did not produce a TEST-*.xml file (likely timed out)
(batchId=226)
TestCloseableThreadLocal - did not produce a TEST-*.xml file (likely timed out)
(batchId=333)
TestCustomQueryFilter - did not produce a TEST-*.xml file (likely timed out)
(batchId=230)
TestDataSourceProviderFactory - did not produce a TEST-*.xml file (likely timed
out) (batchId=237)
TestDatabaseName - did not produce a TEST-*.xml file (likely timed out)
(batchId=195)
TestDatabases - did not produce a TEST-*.xml file (likely timed out)
(batchId=228)
TestDeadline - did not produce a TEST-*.xml file (likely timed out)
(batchId=235)
TestDefaultConstraint - did not produce a TEST-*.xml file (likely timed out)
(batchId=228)
TestDropPartitions - did not produce a TEST-*.xml file (likely timed out)
(batchId=226)
TestDummy - did not produce a TEST-*.xml file (likely timed out) (batchId=274)
TestEmbeddedHiveMetaStore - did not produce a TEST-*.xml file (likely timed
out) (batchId=229)
TestExchangePartitions - did not produce a TEST-*.xml file (likely timed out)
(batchId=228)
TestFMSketchSerialization - did not produce a TEST-*.xml file (likely timed
out) (batchId=238)
TestFilterHooks - did not produce a TEST-*.xml file (likely timed out)
(batchId=226)
TestForeignKey - did not produce a TEST-*.xml file (likely timed out)
(batchId=228)
TestFunctions - did not produce a TEST-*.xml file (likely timed out)
(batchId=226)
TestGetPartitions - did not produce a TEST-*.xml file (likely timed out)
(batchId=228)
TestGetPartitionsUsingProjectionAndFilterSpecs - did not produce a TEST-*.xml
file (likely timed out) (batchId=228)
TestGetTableMeta - did not produce a TEST-*.xml file (likely timed out)
(batchId=226)
TestGroupFilter - did not produce a TEST-*.xml file (likely timed out)
(batchId=230)
TestHLLNoBias - did not produce a TEST-*.xml file (likely timed out)
(batchId=237)
TestHLLSerialization - did not produce a TEST-*.xml file (likely timed out)
(batchId=237)
TestHdfsUtils - did not produce a TEST-*.xml file (likely timed out)
(batchId=235)
TestHiveAlterHandler - did not produce a TEST-*.xml file (likely timed out)
(batchId=226)
TestHiveMetaStoreGetMetaConf - did not produce a TEST-*.xml file (likely timed
out) (batchId=237)
TestHiveMetaStorePartitionSpecs - did not produce a TEST-*.xml file (likely
timed out) (batchId=228)
TestHiveMetaStoreSchemaMethods - did not produce a TEST-*.xml file (likely
timed out) (batchId=235)
TestHiveMetaStoreTimeout - did not produce a TEST-*.xml file (likely timed out)
(batchId=237)
TestHiveMetaStoreTxns - did not produce a TEST-*.xml file (likely timed out)
(batchId=237)
TestHiveMetaStoreWithEnvironmentContext - did not produce a TEST-*.xml file
(likely timed out) (batchId=232)
TestHiveMetaToolCommandLine - did not produce a TEST-*.xml file (likely timed
out) (batchId=230)
TestHiveMetastoreCli - did not produce a TEST-*.xml file (likely timed out)
(batchId=226)
TestHmsServerAuthorization - did not produce a TEST-*.xml file (likely timed
out) (batchId=235)
TestHyperLogLog - did not produce a TEST-*.xml file (likely timed out)
(batchId=238)
TestHyperLogLogDense - did not produce a TEST-*.xml file (likely timed out)
(batchId=237)
TestHyperLogLogMerge - did not produce a TEST-*.xml file (likely timed out)
(batchId=237)
TestHyperLogLogSparse - did not produce a TEST-*.xml file (likely timed out)
(batchId=237)
TestJSONMessageDeserializer - did not produce a TEST-*.xml file (likely timed
out) (batchId=235)
TestKuduCliDriver - did not produce a TEST-*.xml file (likely timed out)
(batchId=265)
TestKuduInputFormat - did not produce a TEST-*.xml file (likely timed out)
(batchId=331)
TestKuduNegativeCliDriver - did not produce a TEST-*.xml file (likely timed
out) (batchId=265)
TestKuduOutputFormat - did not produce a TEST-*.xml file (likely timed out)
(batchId=331)
TestKuduPredicateHandler - did not produce a TEST-*.xml file (likely timed out)
(batchId=331)
TestKuduSerDe - did not produce a TEST-*.xml file (likely timed out)
(batchId=331)
TestLdapAtnProviderWithMiniDS - did not produce a TEST-*.xml file (likely timed
out) (batchId=237)
TestLdapSearch - did not produce a TEST-*.xml file (likely timed out)
(batchId=230)
TestLdapUtils - did not produce a TEST-*.xml file (likely timed out)
(batchId=230)
TestListPartitions - did not produce a TEST-*.xml file (likely timed out)
(batchId=226)
TestLockRequestBuilder - did not produce a TEST-*.xml file (likely timed out)
(batchId=226)
TestMarkPartition - did not produce a TEST-*.xml file (likely timed out)
(batchId=237)
TestMarkPartitionRemote - did not produce a TEST-*.xml file (likely timed out)
(batchId=237)
TestMetaStoreConnectionUrlHook - did not produce a TEST-*.xml file (likely
timed out) (batchId=230)
TestMetaStoreEndFunctionListener - did not produce a TEST-*.xml file (likely
timed out) (batchId=228)
TestMetaStoreEventListener - did not produce a TEST-*.xml file (likely timed
out) (batchId=233)
TestMetaStoreEventListenerOnlyOnCommit - did not produce a TEST-*.xml file
(likely timed out) (batchId=235)
TestMetaStoreEventListenerWithOldConf - did not produce a TEST-*.xml file
(likely timed out) (batchId=237)
TestMetaStoreInitListener - did not produce a TEST-*.xml file (likely timed
out) (batchId=237)
TestMetaStoreLdapAuthenticationProviderImpl - did not produce a TEST-*.xml file
(likely timed out) (batchId=235)
TestMetaStoreListenersError - did not produce a TEST-*.xml file (likely timed
out) (batchId=235)
TestMetaStoreSchemaFactory - did not produce a TEST-*.xml file (likely timed
out) (batchId=235)
TestMetaStoreSchemaInfo - did not produce a TEST-*.xml file (likely timed out)
(batchId=235)
TestMetaStoreServerUtils - did not produce a TEST-*.xml file (likely timed out)
(batchId=235)
TestMetaToolTaskExecuteJDOQLQuery - did not produce a TEST-*.xml file (likely
timed out) (batchId=230)
TestMetaToolTaskListFSRoot - did not produce a TEST-*.xml file (likely timed
out) (batchId=230)
TestMetaToolTaskUpdateLocation - did not produce a TEST-*.xml file (likely
timed out) (batchId=230)
TestMetastoreConf - did not produce a TEST-*.xml file (likely timed out)
(batchId=228)
TestMetastoreSchemaTool - did not produce a TEST-*.xml file (likely timed out)
(batchId=230)
TestMetrics - did not produce a TEST-*.xml file (likely timed out) (batchId=228)
TestMiniDruidCliDriver - did not produce a TEST-*.xml file (likely timed out)
(batchId=274)
TestMiniDruidKafkaCliDriver - did not produce a TEST-*.xml file (likely timed
out) (batchId=274)
TestMsckCheckPartitions - did not produce a TEST-*.xml file (likely timed out)
(batchId=230)
TestNotNullConstraint - did not produce a TEST-*.xml file (likely timed out)
(batchId=228)
TestObjectStore - did not produce a TEST-*.xml file (likely timed out)
(batchId=237)
TestObjectStoreInitRetry - did not produce a TEST-*.xml file (likely timed out)
(batchId=235)
TestObjectStoreSchemaMethods - did not produce a TEST-*.xml file (likely timed
out) (batchId=237)
TestObjectStoreStatementVerify - did not produce a TEST-*.xml file (likely
timed out) (batchId=228)
TestOldSchema - did not produce a TEST-*.xml file (likely timed out)
(batchId=235)
TestPartitionManagement - did not produce a TEST-*.xml file (likely timed out)
(batchId=226)
TestPartitionNameWhitelistValidation - did not produce a TEST-*.xml file
(likely timed out) (batchId=228)
TestPartitionProjectionEvaluator - did not produce a TEST-*.xml file (likely
timed out) (batchId=237)
TestPreUpgradeTool - did not produce a TEST-*.xml file (likely timed out)
(batchId=333)
TestPrimaryKey - did not produce a TEST-*.xml file (likely timed out)
(batchId=228)
TestQuery - did not produce a TEST-*.xml file (likely timed out) (batchId=235)
TestQueryFactory - did not produce a TEST-*.xml file (likely timed out)
(batchId=230)
TestRawStoreProxy - did not produce a TEST-*.xml file (likely timed out)
(batchId=226)
TestRemoteHiveMetaStore - did not produce a TEST-*.xml file (likely timed out)
(batchId=231)
TestRemoteHiveMetaStoreCustomAuth - did not produce a TEST-*.xml file (likely
timed out) (batchId=235)
TestRemoteHiveMetaStoreIpAddress - did not produce a TEST-*.xml file (likely
timed out) (batchId=224)
TestRemoteHiveMetaStoreZK - did not produce a TEST-*.xml file (likely timed
out) (batchId=230)
TestRemoteHiveMetaStoreZKBindHost - did not produce a TEST-*.xml file (likely
timed out) (batchId=237)
TestRemoteUGIHiveMetaStoreIpAddress - did not produce a TEST-*.xml file (likely
timed out) (batchId=234)
TestRetriesInRetryingHMSHandler - did not produce a TEST-*.xml file (likely
timed out) (batchId=237)
TestRetryingHMSHandler - did not produce a TEST-*.xml file (likely timed out)
(batchId=235)
TestRunOptions - did not produce a TEST-*.xml file (likely timed out)
(batchId=333)
TestRuntimeStats - did not produce a TEST-*.xml file (likely timed out)
(batchId=226)
TestSchemaToolForMetastore - did not produce a TEST-*.xml file (likely timed
out) (batchId=230)
TestSchemaToolTaskDrop - did not produce a TEST-*.xml file (likely timed out)
(batchId=230)
TestSearchResultHandler - did not produce a TEST-*.xml file (likely timed out)
(batchId=230)
TestSetUGIOnBothClientServer - did not produce a TEST-*.xml file (likely timed
out) (batchId=227)
TestSetUGIOnOnlyClient - did not produce a TEST-*.xml file (likely timed out)
(batchId=225)
TestSetUGIOnOnlyServer - did not produce a TEST-*.xml file (likely timed out)
(batchId=236)
TestSparseEncodeHash - did not produce a TEST-*.xml file (likely timed out)
(batchId=238)
TestStats - did not produce a TEST-*.xml file (likely timed out) (batchId=228)
TestStatsSetupConst - did not produce a TEST-*.xml file (likely timed out)
(batchId=238)
TestTableIterable - did not produce a TEST-*.xml file (likely timed out)
(batchId=237)
TestTableName - did not produce a TEST-*.xml file (likely timed out)
(batchId=195)
TestTablesCreateDropAlterTruncate - did not produce a TEST-*.xml file (likely
timed out) (batchId=226)
TestTablesGetExists - did not produce a TEST-*.xml file (likely timed out)
(batchId=228)
TestTablesList - did not produce a TEST-*.xml file (likely timed out)
(batchId=226)
TestTezPerfCliDriver - did not produce a TEST-*.xml file (likely timed out)
(batchId=274)
TestTxnHandlerNegative - did not produce a TEST-*.xml file (likely timed out)
(batchId=226)
TestTxnUtils - did not produce a TEST-*.xml file (likely timed out)
(batchId=226)
TestUniqueConstraint - did not produce a TEST-*.xml file (likely timed out)
(batchId=226)
TestUserFilter - did not produce a TEST-*.xml file (likely timed out)
(batchId=230)
TestUserSearchFilter - did not produce a TEST-*.xml file (likely timed out)
(batchId=230)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[load_static_ptn_into_bucketed_table]
(batchId=21)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[load_data_using_job]
(batchId=159)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[results_cache_2]
(batchId=177)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[results_cache_with_masking]
(batchId=173)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[sharedwork]
(batchId=174)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[subquery_views]
(batchId=159)
org.apache.hadoop.hive.cli.TestMiniSparkOnYarnCliDriver.testCliDriver[orc_merge9]
(batchId=185)
org.apache.hadoop.hive.ql.TestWarehouseExternalDir.testManagedPaths
(batchId=250)
org.apache.hive.service.TestHS2ImpersonationWithRemoteMS.testImpersonation
(batchId=259)
org.apache.hive.spark.client.rpc.TestRpc.testServerPort (batchId=326)
{noformat}
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/18910/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/18910/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-18910/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 139 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12982497 - PreCommit-HIVE-Build
> Incompatible java.util.ArrayList for java 11
> --------------------------------------------
>
> Key: HIVE-22097
> URL: https://issues.apache.org/jira/browse/HIVE-22097
> Project: Hive
> Issue Type: Improvement
> Components: Query Processor
> Affects Versions: 3.0.0, 3.1.1
> Reporter: Yuming Wang
> Assignee: Attila Magyar
> Priority: Major
> Fix For: 4.0.0
>
> Attachments: HIVE-22097.1.branch-3.1.patch,
> HIVE-22097.1.branch-3.patch, HIVE-22097.1.patch, JDK1.8.png, JDK11.png
>
>
> {noformat}
> export JAVA_HOME=/usr/lib/jdk-11.0.3
> export PATH=${JAVA_HOME}/bin:${PATH}
> hive> create table t(id int);
> Time taken: 0.035 seconds
> hive> insert into t values(1);
> Query ID = root_20190811155400_7c0e0494-eecb-4c54-a9fd-942ab52a0794
> Total jobs = 3
> Launching Job 1 out of 3
> Number of reduce tasks determined at compile time: 1
> In order to change the average load for a reducer (in bytes):
> set hive.exec.reducers.bytes.per.reducer=<number>
> In order to limit the maximum number of reducers:
> set hive.exec.reducers.max=<number>
> In order to set a constant number of reducers:
> set mapreduce.job.reduces=<number>
> java.lang.RuntimeException: java.lang.NoSuchFieldException: parentOffset
> at
> org.apache.hadoop.hive.ql.exec.SerializationUtilities$ArrayListSubListSerializer.<init>(SerializationUtilities.java:390)
> at
> org.apache.hadoop.hive.ql.exec.SerializationUtilities$1.create(SerializationUtilities.java:235)
> at
> org.apache.hive.com.esotericsoftware.kryo.pool.KryoPoolQueueImpl.borrow(KryoPoolQueueImpl.java:48)
> at
> org.apache.hadoop.hive.ql.exec.SerializationUtilities.borrowKryo(SerializationUtilities.java:280)
> at
> org.apache.hadoop.hive.ql.exec.Utilities.setBaseWork(Utilities.java:595)
> at
> org.apache.hadoop.hive.ql.exec.Utilities.setMapWork(Utilities.java:587)
> at
> org.apache.hadoop.hive.ql.exec.Utilities.setMapRedWork(Utilities.java:579)
> at
> org.apache.hadoop.hive.ql.exec.mr.ExecDriver.execute(ExecDriver.java:357)
> at
> org.apache.hadoop.hive.ql.exec.mr.MapRedTask.execute(MapRedTask.java:159)
> at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:212)
> at
> org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:103)
> at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:2317)
> at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1969)
> at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1636)
> at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1396)
> at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1390)
> at
> org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:162)
> at
> org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:223)
> at
> org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:242)
> at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:189)
> at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:408)
> at
> org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:838)
> at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:777)
> at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:696)
> at
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.base/java.lang.reflect.Method.invoke(Method.java:566)
> at org.apache.hadoop.util.RunJar.run(RunJar.java:323)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:236)
> Caused by: java.lang.NoSuchFieldException: parentOffset
> at java.base/java.lang.Class.getDeclaredField(Class.java:2412)
> at
> org.apache.hadoop.hive.ql.exec.SerializationUtilities$ArrayListSubListSerializer.<init>(SerializationUtilities.java:384)
> ... 29 more
> Job Submission failed with exception
> 'java.lang.RuntimeException(java.lang.NoSuchFieldException: parentOffset)'
> FAILED: Execution Error, return code 1 from
> org.apache.hadoop.hive.ql.exec.mr.MapRedTask. java.lang.NoSuchFieldException:
> parentOffset
> {noformat}
> The reason is Java removed {{parentOffset}}:
> !JDK1.8.png!
> !JDK11.png!
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
