[
https://issues.apache.org/jira/browse/HIVE-15527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15816676#comment-15816676
]
Hive QA commented on HIVE-15527:
--------------------------------
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12846683/HIVE-15527.7.patch
{color:red}ERROR:{color} -1 due to no test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 281 failed/errored test(s), 8212 tests
executed
*Failed tests:*
{noformat}
TestAccumuloCliDriver - did not produce a TEST-*.xml file (likely timed out)
(batchId=217)
TestAccumuloConnectionParameters - did not produce a TEST-*.xml file (likely
timed out) (batchId=165)
TestAccumuloHiveRow - did not produce a TEST-*.xml file (likely timed out)
(batchId=165)
TestAccumuloPredicateHandler - did not produce a TEST-*.xml file (likely timed
out) (batchId=165)
TestAccumuloRangeGenerator - did not produce a TEST-*.xml file (likely timed
out) (batchId=165)
TestAccumuloRowSerializer - did not produce a TEST-*.xml file (likely timed
out) (batchId=165)
TestAccumuloSerDe - did not produce a TEST-*.xml file (likely timed out)
(batchId=165)
TestAccumuloSerDeParameters - did not produce a TEST-*.xml file (likely timed
out) (batchId=165)
TestAccumuloStorageHandler - did not produce a TEST-*.xml file (likely timed
out) (batchId=165)
TestAcidOnTez - did not produce a TEST-*.xml file (likely timed out)
(batchId=202)
TestAcidOnTezWithSplitUpdate - did not produce a TEST-*.xml file (likely timed
out) (batchId=205)
TestAddResource - did not produce a TEST-*.xml file (likely timed out)
(batchId=269)
TestAdminUser - did not produce a TEST-*.xml file (likely timed out)
(batchId=197)
TestAggregateStatsCache - did not produce a TEST-*.xml file (likely timed out)
(batchId=186)
TestAvroHCatLoader - did not produce a TEST-*.xml file (likely timed out)
(batchId=172)
TestAvroHCatStorer - did not produce a TEST-*.xml file (likely timed out)
(batchId=172)
TestBeeLineExceptionHandling - did not produce a TEST-*.xml file (likely timed
out) (batchId=167)
TestBeeLineHistory - did not produce a TEST-*.xml file (likely timed out)
(batchId=167)
TestBeelineArgParsing - did not produce a TEST-*.xml file (likely timed out)
(batchId=167)
TestBlobstoreCliDriver - did not produce a TEST-*.xml file (likely timed out)
(batchId=229)
TestBlobstoreNegativeCliDriver - did not produce a TEST-*.xml file (likely
timed out) (batchId=229)
TestCLIAuthzSessionContext - did not produce a TEST-*.xml file (likely timed
out) (batchId=215)
TestCleaner2 - did not produce a TEST-*.xml file (likely timed out)
(batchId=248)
TestClientCommandHookFactory - did not produce a TEST-*.xml file (likely timed
out) (batchId=167)
TestColumnAccess - did not produce a TEST-*.xml file (likely timed out)
(batchId=256)
TestColumnEncoding - did not produce a TEST-*.xml file (likely timed out)
(batchId=165)
TestColumnMapper - did not produce a TEST-*.xml file (likely timed out)
(batchId=165)
TestColumnMappingFactory - did not produce a TEST-*.xml file (likely timed out)
(batchId=165)
TestCommandProcessorFactory - did not produce a TEST-*.xml file (likely timed
out) (batchId=274)
TestCompileProcessor - did not produce a TEST-*.xml file (likely timed out)
(batchId=274)
TestConditionalResolverCommonJoin - did not produce a TEST-*.xml file (likely
timed out) (batchId=270)
TestContext - did not produce a TEST-*.xml file (likely timed out) (batchId=261)
TestContribCliDriver - did not produce a TEST-*.xml file (likely timed out)
(batchId=220)
TestCreateMacroDesc - did not produce a TEST-*.xml file (likely timed out)
(batchId=270)
TestCuckooSet - did not produce a TEST-*.xml file (likely timed out)
(batchId=263)
TestDbTxnManager - did not produce a TEST-*.xml file (likely timed out)
(batchId=274)
TestDeadline - did not produce a TEST-*.xml file (likely timed out)
(batchId=187)
TestDefaultAccumuloRowIdFactory - did not produce a TEST-*.xml file (likely
timed out) (batchId=165)
TestDerbyConnector - did not produce a TEST-*.xml file (likely timed out)
(batchId=233)
TestDoubleCompare - did not produce a TEST-*.xml file (likely timed out)
(batchId=165)
TestDropMacroDesc - did not produce a TEST-*.xml file (likely timed out)
(batchId=270)
TestDummy - did not produce a TEST-*.xml file (likely timed out) (batchId=217)
TestDummyTxnManager - did not produce a TEST-*.xml file (likely timed out)
(batchId=274)
TestE2EScenarios - did not produce a TEST-*.xml file (likely timed out)
(batchId=172)
TestEmbeddedLockManager - did not produce a TEST-*.xml file (likely timed out)
(batchId=273)
TestEmbeddedThriftBinaryCLIService - did not produce a TEST-*.xml file (likely
timed out) (batchId=211)
TestEncryptedHDFSCliDriver - did not produce a TEST-*.xml file (likely timed
out) (batchId=156)
[encryption_ctas.q,encryption_move_tbl.q,encryption_insert_values.q,encryption_load_data_to_encrypted_tables.q,encryption_unencrypted_nonhdfs_external_tables.q,encryption_drop_partition.q]
TestEximUtil - did not produce a TEST-*.xml file (likely timed out)
(batchId=255)
TestExtendedAcls - did not produce a TEST-*.xml file (likely timed out)
(batchId=218)
TestFileDump - did not produce a TEST-*.xml file (likely timed out)
(batchId=234)
TestFirstInFirstOutComparator - did not produce a TEST-*.xml file (likely timed
out) (batchId=281)
TestGenTezWork - did not produce a TEST-*.xml file (likely timed out)
(batchId=255)
TestHBaseAggrStatsCacheIntegration - did not produce a TEST-*.xml file (likely
timed out) (batchId=197)
TestHBaseAggregateStatsCache - did not produce a TEST-*.xml file (likely timed
out) (batchId=186)
TestHBaseAggregateStatsCacheWithBitVector - did not produce a TEST-*.xml file
(likely timed out) (batchId=187)
TestHBaseAggregateStatsExtrapolation - did not produce a TEST-*.xml file
(likely timed out) (batchId=187)
TestHBaseAggregateStatsNDVUniformDist - did not produce a TEST-*.xml file
(likely timed out) (batchId=187)
TestHBaseFilterPlanUtil - did not produce a TEST-*.xml file (likely timed out)
(batchId=186)
TestHBaseImport - did not produce a TEST-*.xml file (likely timed out)
(batchId=197)
TestHBaseMetastoreMetrics - did not produce a TEST-*.xml file (likely timed
out) (batchId=197)
TestHBaseMetastoreSql - did not produce a TEST-*.xml file (likely timed out)
(batchId=193)
TestHBaseSchemaTool - did not produce a TEST-*.xml file (likely timed out)
(batchId=193)
TestHBaseSchemaTool2 - did not produce a TEST-*.xml file (likely timed out)
(batchId=197)
TestHBaseSerDe - did not produce a TEST-*.xml file (likely timed out)
(batchId=163)
TestHBaseStore - did not produce a TEST-*.xml file (likely timed out)
(batchId=186)
TestHBaseStoreBitVector - did not produce a TEST-*.xml file (likely timed out)
(batchId=186)
TestHBaseStoreCached - did not produce a TEST-*.xml file (likely timed out)
(batchId=187)
TestHBaseStoreIntegration - did not produce a TEST-*.xml file (likely timed
out) (batchId=193)
TestHCatAuthUtil - did not produce a TEST-*.xml file (likely timed out)
(batchId=174)
TestHCatLoaderComplexSchema - did not produce a TEST-*.xml file (likely timed
out) (batchId=172)
TestHCatLoaderEncryption - did not produce a TEST-*.xml file (likely timed out)
(batchId=172)
TestHCatLoaderStorer - did not produce a TEST-*.xml file (likely timed out)
(batchId=172)
TestHCatNonPartitioned - did not produce a TEST-*.xml file (likely timed out)
(batchId=174)
TestHCatPartitionPublish - did not produce a TEST-*.xml file (likely timed out)
(batchId=174)
TestHCatPartitioned - did not produce a TEST-*.xml file (likely timed out)
(batchId=174)
TestHCatStorerMulti - did not produce a TEST-*.xml file (likely timed out)
(batchId=172)
TestHCatStorerWrapper - did not produce a TEST-*.xml file (likely timed out)
(batchId=172)
TestHS2ClearDanglingScratchDir - did not produce a TEST-*.xml file (likely
timed out) (batchId=211)
TestHS2ImpersonationWithRemoteMS - did not produce a TEST-*.xml file (likely
timed out) (batchId=211)
TestHadoopAuthBridge23 - did not produce a TEST-*.xml file (likely timed out)
(batchId=218)
TestHiveAccumuloColumnMapping - did not produce a TEST-*.xml file (likely timed
out) (batchId=165)
TestHiveAccumuloHelper - did not produce a TEST-*.xml file (likely timed out)
(batchId=165)
TestHiveAccumuloTableInputFormat - did not produce a TEST-*.xml file (likely
timed out) (batchId=165)
TestHiveAccumuloTableOutputFormat - did not produce a TEST-*.xml file (likely
timed out) (batchId=165)
TestHiveAccumuloTypes - did not produce a TEST-*.xml file (likely timed out)
(batchId=165)
TestHiveAuthFactory - did not produce a TEST-*.xml file (likely timed out)
(batchId=227)
TestHiveAuthorizationTaskFactory - did not produce a TEST-*.xml file (likely
timed out) (batchId=256)
TestHiveCli - did not produce a TEST-*.xml file (likely timed out) (batchId=167)
TestHiveCopyFiles - did not produce a TEST-*.xml file (likely timed out)
(batchId=261)
TestHiveCredentialProviders - did not produce a TEST-*.xml file (likely timed
out) (batchId=261)
TestHiveDecimalParse - did not produce a TEST-*.xml file (likely timed out)
(batchId=255)
TestHiveInputSplitComparator - did not produce a TEST-*.xml file (likely timed
out) (batchId=274)
TestHiveLockObject - did not produce a TEST-*.xml file (likely timed out)
(batchId=273)
TestHiveMetaStoreChecker - did not produce a TEST-*.xml file (likely timed out)
(batchId=261)
TestHiveMetaStoreGetMetaConf - did not produce a TEST-*.xml file (likely timed
out) (batchId=187)
TestHiveMetaStorePartitionSpecs - did not produce a TEST-*.xml file (likely
timed out) (batchId=186)
TestHiveMetaStoreStatsMerge - did not produce a TEST-*.xml file (likely timed
out) (batchId=193)
TestHiveMetaStoreTimeout - did not produce a TEST-*.xml file (likely timed out)
(batchId=187)
TestHiveMetastoreCli - did not produce a TEST-*.xml file (likely timed out)
(batchId=186)
TestHiveOperationType - did not produce a TEST-*.xml file (likely timed out)
(batchId=270)
TestHiveRowIdColumnMapping - did not produce a TEST-*.xml file (likely timed
out) (batchId=165)
TestHiveSQLException - did not produce a TEST-*.xml file (likely timed out)
(batchId=184)
TestHiveSessionImpl - did not produce a TEST-*.xml file (likely timed out)
(batchId=211)
TestHooks - did not produce a TEST-*.xml file (likely timed out) (batchId=269)
TestHs2HooksWithMiniKdc - did not produce a TEST-*.xml file (likely timed out)
(batchId=227)
TestIUD - did not produce a TEST-*.xml file (likely timed out) (batchId=256)
TestIncrementalObjectSizeEstimator - did not produce a TEST-*.xml file (likely
timed out) (batchId=281)
TestIndexType - did not produce a TEST-*.xml file (likely timed out)
(batchId=274)
TestInitiator - did not produce a TEST-*.xml file (likely timed out)
(batchId=248)
TestIntCompare - did not produce a TEST-*.xml file (likely timed out)
(batchId=165)
TestJdbcDriver2 - did not produce a TEST-*.xml file (likely timed out)
(batchId=213)
TestJdbcNonKrbSASLWithMiniKdc - did not produce a TEST-*.xml file (likely timed
out) (batchId=227)
TestJdbcWithDBTokenStore - did not produce a TEST-*.xml file (likely timed out)
(batchId=227)
TestJdbcWithLocalClusterSpark - did not produce a TEST-*.xml file (likely timed
out) (batchId=215)
TestJdbcWithMiniHS2 - did not produce a TEST-*.xml file (likely timed out)
(batchId=215)
TestJdbcWithMiniKdc - did not produce a TEST-*.xml file (likely timed out)
(batchId=227)
TestJdbcWithMiniKdcCookie - did not produce a TEST-*.xml file (likely timed
out) (batchId=227)
TestJdbcWithMiniKdcSQLAuthHttp - did not produce a TEST-*.xml file (likely
timed out) (batchId=227)
TestJdbcWithMiniLlap - did not produce a TEST-*.xml file (likely timed out)
(batchId=215)
TestJdbcWithSQLAuthUDFBlacklist - did not produce a TEST-*.xml file (likely
timed out) (batchId=215)
TestJobHandle - did not produce a TEST-*.xml file (likely timed out)
(batchId=276)
TestJsonFileDump - did not produce a TEST-*.xml file (likely timed out)
(batchId=234)
TestKryoMessageCodec - did not produce a TEST-*.xml file (likely timed out)
(batchId=276)
TestLazyAccumuloMap - did not produce a TEST-*.xml file (likely timed out)
(batchId=165)
TestLazyAccumuloRow - did not produce a TEST-*.xml file (likely timed out)
(batchId=165)
TestLazyHBaseObject - did not produce a TEST-*.xml file (likely timed out)
(batchId=163)
TestLdapAtnProviderWithMiniDS - did not produce a TEST-*.xml file (likely timed
out) (batchId=184)
TestLlapDaemonProtocolServerImpl - did not produce a TEST-*.xml file (likely
timed out) (batchId=281)
TestLlapSignerImpl - did not produce a TEST-*.xml file (likely timed out)
(batchId=281)
TestLlapTaskCommunicator - did not produce a TEST-*.xml file (likely timed out)
(batchId=231)
TestLlapTaskSchedulerService - did not produce a TEST-*.xml file (likely timed
out) (batchId=231)
TestLlapTokenChecker - did not produce a TEST-*.xml file (likely timed out)
(batchId=281)
TestLlapWebServices - did not produce a TEST-*.xml file (likely timed out)
(batchId=281)
TestLockRequestBuilder - did not produce a TEST-*.xml file (likely timed out)
(batchId=186)
TestLog4j2Appenders - did not produce a TEST-*.xml file (likely timed out)
(batchId=261)
TestLongComparison - did not produce a TEST-*.xml file (likely timed out)
(batchId=165)
TestLowLevelLrfuCachePolicy - did not produce a TEST-*.xml file (likely timed
out) (batchId=281)
TestMTQueries - did not produce a TEST-*.xml file (likely timed out)
(batchId=204)
TestMapWork - did not produce a TEST-*.xml file (likely timed out) (batchId=270)
TestMarkPartitionRemote - did not produce a TEST-*.xml file (likely timed out)
(batchId=201)
TestMetaStoreConnectionUrlHook - did not produce a TEST-*.xml file (likely
timed out) (batchId=193)
TestMetaStoreEndFunctionListener - did not produce a TEST-*.xml file (likely
timed out) (batchId=193)
TestMetaStoreSchemaInfo - did not produce a TEST-*.xml file (likely timed out)
(batchId=187)
TestMetastoreVersion - did not produce a TEST-*.xml file (likely timed out)
(batchId=197)
TestMetricsCollection - did not produce a TEST-*.xml file (likely timed out)
(batchId=276)
TestMiniHiveKdc - did not produce a TEST-*.xml file (likely timed out)
(batchId=227)
TestMiniLlapLocalCliDriver - did not produce a TEST-*.xml file (likely timed
out) (batchId=146)
[load_dyn_part5.q,vector_complex_join.q,orc_llap.q,vectorization_7.q,vectorization_pushdown.q,cbo_gby.q,mapjoin3.q,auto_sortmerge_join_1.q,lineage3.q,cross_product_check_1.q,cbo_join.q,vector_struct_in.q,bucketmapjoin3.q,current_date_timestamp.q,orc_ppd_schema_evol_2a.q,groupby2.q,schema_evol_text_vec_table.q,vectorized_join46.q,orc_ppd_date.q,multiMapJoin1.q,sample10.q,vector_outer_join1.q,vector_char_simple.q,dynpart_sort_optimization_acid.q,auto_sortmerge_join_2.q,bucketizedhiveinputformat.q,leftsemijoin.q,special_character_in_tabnames_1.q,cte_mat_2.q,vectorization_8.q]
TestMiniLlapLocalCliDriver - did not produce a TEST-*.xml file (likely timed
out) (batchId=150)
[vector_interval_2.q,schema_evol_orc_acid_table_update.q,schema_evol_orc_acid_part_update.q,orc_ppd_varchar.q,metadataonly1.q,limit_pushdown.q,auto_join_nulls.q,metadata_only_queries_with_filters.q,vector_inner_join.q,subquery_notin.q,schema_evol_text_nonvec_part_all_complex.q,alter_merge_orc.q,vector_between_columns.q,vector_char_cast.q,join_filters.q,udaf_collect_set_2.q,update_after_multiple_inserts.q,offset_limit_ppd_optimizer.q,mapjoin_decimal.q,orc_merge_incompat1.q,columnstats_part_coltype.q,vectorized_parquet_types.q,union7.q,vectorization_nested_udf.q,vector_char_2.q,schema_evol_orc_acidvec_part.q,vector_groupby_3.q,cbo_rp_gby.q,extrapolate_part_stats_partial_ndv.q,auto_sortmerge_join_9.q]
TestMiniLlapLocalCliDriver - did not produce a TEST-*.xml file (likely timed
out) (batchId=152)
[tez_union_group_by.q,auto_join1.q,tez_dynpart_hashjoin_1.q,vectorized_timestamp.q,cbo_subq_exists.q,vector_binary_join_groupby.q,lateral_view.q,schema_evol_orc_vec_part_all_primitive.q,infer_bucket_sort_bucketed_table.q,optimize_nullscan.q,nonmr_fetch_threshold.q,vectorization_decimal_date.q,vectorized_casts.q,schema_evol_orc_vec_part.q,tez_self_join.q,vector_partitioned_date_time.q,schema_evol_text_vecrow_part_all_complex.q,tez_fsstat.q,stats11.q,vector_mapjoin_reduce.q,tez_join_tests.q,join_acid_non_acid.q,empty_join.q,auto_join21.q,vectorization_3.q,schema_evol_text_vecrow_part.q,disable_merge_for_bucketing.q,orc_ppd_timestamp.q,vector_decimal_1.q,vector_adaptor_usage_mode.q]
TestMiniSparkOnYarnCliDriver - did not produce a TEST-*.xml file (likely timed
out) (batchId=159)
[infer_bucket_sort_reducers_power_two.q,list_bucket_dml_10.q,orc_merge9.q,orc_merge6.q,leftsemijoin_mr.q,bucket6.q,bucketmapjoin7.q,uber_reduce.q,empty_dir_in_table.q,vector_outer_join3.q,index_bitmap_auto.q,vector_outer_join2.q,vector_outer_join1.q,orc_merge1.q,orc_merge_diff_fs.q,load_hdfs_file_with_space_in_the_name.q,scriptfile1_win.q,quotedid_smb.q,truncate_column_buckets.q,orc_merge3.q]
TestMiniSparkOnYarnCliDriver - did not produce a TEST-*.xml file (likely timed
out) (batchId=161)
[scriptfile1.q,vector_outer_join5.q,file_with_header_footer.q,bucket4.q,input16_cc.q,bucket5.q,infer_bucket_sort_merge.q,constprog_partitioner.q,orc_merge2.q,reduce_deduplicate.q,schemeAuthority2.q,load_fs2.q,orc_merge8.q,orc_merge_incompat2.q,infer_bucket_sort_bucketed_table.q,vector_outer_join4.q,disable_merge_for_bucketing.q,vector_inner_join.q,orc_merge7.q]
TestMultiSessionsHS2WithLocalClusterSpark - did not produce a TEST-*.xml file
(likely timed out) (batchId=215)
TestMutations - did not produce a TEST-*.xml file (likely timed out)
(batchId=181)
TestNoSaslAuth - did not produce a TEST-*.xml file (likely timed out)
(batchId=215)
TestObjectStore - did not produce a TEST-*.xml file (likely timed out)
(batchId=187)
TestObjectStoreInitRetry - did not produce a TEST-*.xml file (likely timed out)
(batchId=197)
TestOperation2Privilege - did not produce a TEST-*.xml file (likely timed out)
(batchId=256)
TestOperationLoggingAPIWithMr - did not produce a TEST-*.xml file (likely timed
out) (batchId=211)
TestOperationLoggingAPIWithTez - did not produce a TEST-*.xml file (likely
timed out) (batchId=210)
TestOperationLoggingLayout - did not produce a TEST-*.xml file (likely timed
out) (batchId=211)
TestOperators - did not produce a TEST-*.xml file (likely timed out)
(batchId=261)
TestOrcFile - did not produce a TEST-*.xml file (likely timed out) (batchId=252)
TestOrcHCatLoader - did not produce a TEST-*.xml file (likely timed out)
(batchId=172)
TestOrcHCatStorer - did not produce a TEST-*.xml file (likely timed out)
(batchId=172)
TestOrcMetadataCache - did not produce a TEST-*.xml file (likely timed out)
(batchId=281)
TestOrcNullOptimization - did not produce a TEST-*.xml file (likely timed out)
(batchId=234)
TestOrcTimezone1 - did not produce a TEST-*.xml file (likely timed out)
(batchId=234)
TestOrcTimezone3 - did not produce a TEST-*.xml file (likely timed out)
(batchId=234)
TestParquetHCatLoader - did not produce a TEST-*.xml file (likely timed out)
(batchId=172)
TestParquetHCatStorer - did not produce a TEST-*.xml file (likely timed out)
(batchId=172)
TestPartitionNameWhitelistValidation - did not produce a TEST-*.xml file
(likely timed out) (batchId=193)
TestPassProperties - did not produce a TEST-*.xml file (likely timed out)
(batchId=174)
TestPasswordWithCredentialProvider - did not produce a TEST-*.xml file (likely
timed out) (batchId=218)
TestPerfCliDriver - did not produce a TEST-*.xml file (likely timed out)
(batchId=221)
TestPermsGrp - did not produce a TEST-*.xml file (likely timed out)
(batchId=174)
TestPigHCatUtil - did not produce a TEST-*.xml file (likely timed out)
(batchId=172)
TestPrimitiveComparisonFilter - did not produce a TEST-*.xml file (likely timed
out) (batchId=165)
TestPrivilegesV1 - did not produce a TEST-*.xml file (likely timed out)
(batchId=256)
TestPrivilegesV2 - did not produce a TEST-*.xml file (likely timed out)
(batchId=256)
TestPutResultWritable - did not produce a TEST-*.xml file (likely timed out)
(batchId=163)
TestQBCompact - did not produce a TEST-*.xml file (likely timed out)
(batchId=255)
TestQBJoinTreeApplyPredicate - did not produce a TEST-*.xml file (likely timed
out) (batchId=255)
TestQBSubQuery - did not produce a TEST-*.xml file (likely timed out)
(batchId=256)
TestQueryDisplay - did not produce a TEST-*.xml file (likely timed out)
(batchId=211)
TestQueryHooks - did not produce a TEST-*.xml file (likely timed out)
(batchId=269)
TestQueryIdentifier - did not produce a TEST-*.xml file (likely timed out)
(batchId=281)
TestRCFileHCatLoader - did not produce a TEST-*.xml file (likely timed out)
(batchId=172)
TestRCFileHCatStorer - did not produce a TEST-*.xml file (likely timed out)
(batchId=172)
TestRawStoreProxy - did not produce a TEST-*.xml file (likely timed out)
(batchId=186)
TestReadEntityDirect - did not produce a TEST-*.xml file (likely timed out)
(batchId=273)
TestReplChangeManager - did not produce a TEST-*.xml file (likely timed out)
(batchId=193)
TestRetryingHMSHandler - did not produce a TEST-*.xml file (likely timed out)
(batchId=197)
TestRpc - did not produce a TEST-*.xml file (likely timed out) (batchId=276)
TestRuleRegExp - did not produce a TEST-*.xml file (likely timed out)
(batchId=274)
TestSQLStdHiveAccessControllerCLI - did not produce a TEST-*.xml file (likely
timed out) (batchId=270)
TestSQLStdHiveAccessControllerHS2 - did not produce a TEST-*.xml file (likely
timed out) (batchId=270)
TestSchedulerQueue - did not produce a TEST-*.xml file (likely timed out)
(batchId=218)
TestSemanticAnalysis - did not produce a TEST-*.xml file (likely timed out)
(batchId=174)
TestSemanticAnalyzer - did not produce a TEST-*.xml file (likely timed out)
(batchId=255)
TestSequenceFileHCatStorer - did not produce a TEST-*.xml file (likely timed
out) (batchId=172)
TestServerSpecificConfig - did not produce a TEST-*.xml file (likely timed out)
(batchId=197)
TestServiceDiscovery - did not produce a TEST-*.xml file (likely timed out)
(batchId=215)
TestSessionCleanup - did not produce a TEST-*.xml file (likely timed out)
(batchId=184)
TestSessionGlobalInitFile - did not produce a TEST-*.xml file (likely timed
out) (batchId=184)
TestSessionState - did not produce a TEST-*.xml file (likely timed out)
(batchId=270)
TestSessionUserName - did not produce a TEST-*.xml file (likely timed out)
(batchId=256)
TestSetProcessor - did not produce a TEST-*.xml file (likely timed out)
(batchId=274)
TestSharedStorageDescriptor - did not produce a TEST-*.xml file (likely timed
out) (batchId=187)
TestShortestJobFirstComparator - did not produce a TEST-*.xml file (likely
timed out) (batchId=281)
TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out)
(batchId=101)
[limit_pushdown2.q,skewjoin_noskew.q,leftsemijoin_mr.q,bucket3.q,skewjoinopt13.q,bucketmapjoin9.q,auto_join15.q,ptf.q,join22.q,vectorized_nested_mapjoin.q,sample4.q,union18.q,multi_insert_gby.q,join33.q,join_cond_pushdown_unqual2.q]
TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out)
(batchId=108)
[union_remove_1.q,ppd_outer_join2.q,date_udf.q,groupby1_noskew.q,join20.q,smb_mapjoin_13.q,groupby_rollup1.q,temp_table_gb1.q,vector_string_concat.q,smb_mapjoin_6.q,metadata_only_queries.q,auto_sortmerge_join_12.q,groupby_bigdata.q,groupby3_map_multi_distinct.q,innerjoin.q]
TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out)
(batchId=114)
[escape_distributeby1.q,join9.q,groupby2.q,groupby4_map.q,udf_max.q,vectorization_pushdown.q,cbo_gby_empty.q,join_cond_pushdown_unqual3.q,vectorization_short_regress.q,join8.q,sample10.q,cross_product_check_1.q,auto_join_stats.q,input_part2.q,groupby_multi_single_reducer3.q]
TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out)
(batchId=115)
[groupby_map_ppr_multi_distinct.q,vectorization_13.q,mapjoin_mapjoin.q,union2.q,join41.q,groupby8_map.q,cbo_subq_not_in.q,identity_project_remove_skip.q,stats5.q,groupby8_map_skew.q,nullgroup2.q,mapjoin_subquery.q,bucket2.q,smb_mapjoin_1.q,union_remove_8.q]
TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out)
(batchId=117)
[timestamp_lazy.q,union29.q,runtime_skewjoin_mapjoin_spark.q,auto_join22.q,union8.q,groupby5_map.q,dynamic_rdd_cache.q,auto_join29.q,groupby6.q,merge1.q,mapjoin_distinct.q,vector_decimal_mapjoin.q,sample5.q,multi_insert_move_tasks_share_dependencies.q,join_array.q]
TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out)
(batchId=120)
[stats12.q,groupby4.q,union_top_level.q,stats2.q,groupby10.q,mapjoin_filter_on_outerjoin.q,auto_sortmerge_join_4.q,limit_partition_metadataonly.q,load_dyn_part4.q,union3.q,groupby_multi_single_reducer.q,smb_mapjoin_14.q,groupby3_noskew_multi_distinct.q,stats18.q,union_remove_21.q]
TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out)
(batchId=123)
[groupby_complex_types.q,multigroupby_singlemr.q,union11.q,groupby7.q,join5.q,bucketmapjoin_negative2.q,vectorization_div0.q,union_script.q,add_part_multiple.q,limit_pushdown.q,union_remove_17.q,uniquejoin.q,metadata_only_queries_with_filters.q,union25.q,load_dyn_part13.q]
TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out)
(batchId=126)
[smb_mapjoin_15.q,script_pipe.q,auto_join24.q,filter_join_breaktask.q,bucket4.q,ppd_multi_insert.q,skewjoinopt20.q,join_thrift.q,multi_insert_gby3.q,groupby8.q,join_map_ppr.q,auto_sortmerge_join_8.q,escape_clusterby1.q,groupby_multi_insert_common_distinct.q,join6.q]
TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out)
(batchId=131)
[join2.q,join36.q,avro_joins_native.q,join18.q,smb_mapjoin_10.q,temp_table.q,union_remove_13.q,auto_sortmerge_join_5.q,groupby5_noskew.q,auto_join0.q,vectorization_17.q,auto_join_stats2.q,skewjoin_union_remove_1.q,union16.q,join_literals.q]
TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out)
(batchId=94)
[bucketmapjoin4.q,bucket_map_join_spark4.q,union21.q,groupby2_noskew.q,timestamp_2.q,date_join1.q,mergejoins.q,smb_mapjoin_11.q,auto_sortmerge_join_3.q,mapjoin_test_outer.q,vectorization_9.q,merge2.q,groupby6_noskew.q,auto_join_without_localtask.q,multi_join_union.q]
TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out)
(batchId=98)
[groupby_map_ppr.q,nullgroup4_multi_distinct.q,join_rc.q,union14.q,smb_mapjoin_12.q,vector_cast_constant.q,union_remove_4.q,auto_join11.q,load_dyn_part7.q,udaf_collect_set.q,vectorization_12.q,groupby_sort_skew_1.q,groupby_sort_skew_1_23.q,smb_mapjoin_25.q,skewjoinopt12.q]
TestSparkClient - did not produce a TEST-*.xml file (likely timed out)
(batchId=276)
TestSparkNegativeCliDriver - did not produce a TEST-*.xml file (likely timed
out) (batchId=228)
TestSplitFilter - did not produce a TEST-*.xml file (likely timed out)
(batchId=274)
TestSplitSample - did not produce a TEST-*.xml file (likely timed out)
(batchId=255)
TestStorageBasedMetastoreAuthorizationProviderWithACL - did not produce a
TEST-*.xml file (likely timed out) (batchId=218)
TestStorageDescriptorSharing - did not produce a TEST-*.xml file (likely timed
out) (batchId=193)
TestStreaming - did not produce a TEST-*.xml file (likely timed out)
(batchId=181)
TestStreamingAvg - did not produce a TEST-*.xml file (likely timed out)
(batchId=273)
TestStreamingMax - did not produce a TEST-*.xml file (likely timed out)
(batchId=273)
TestStreamingMin - did not produce a TEST-*.xml file (likely timed out)
(batchId=273)
TestStreamingSum - did not produce a TEST-*.xml file (likely timed out)
(batchId=273)
TestStringCompare - did not produce a TEST-*.xml file (likely timed out)
(batchId=165)
TestTableIterable - did not produce a TEST-*.xml file (likely timed out)
(batchId=261)
TestTableOutputFormat - did not produce a TEST-*.xml file (likely timed out)
(batchId=167)
TestTaskExecutorService - did not produce a TEST-*.xml file (likely timed out)
(batchId=281)
TestTextFileHCatLoader - did not produce a TEST-*.xml file (likely timed out)
(batchId=172)
TestTextFileHCatStorer - did not produce a TEST-*.xml file (likely timed out)
(batchId=172)
TestTezWorkConcurrency - did not produce a TEST-*.xml file (likely timed out)
(batchId=270)
TestThriftCLIServiceWithBinary - did not produce a TEST-*.xml file (likely
timed out) (batchId=211)
TestThriftCLIServiceWithHttp - did not produce a TEST-*.xml file (likely timed
out) (batchId=211)
TestTransactionStatement - did not produce a TEST-*.xml file (likely timed out)
(batchId=255)
TestTxnCommands - did not produce a TEST-*.xml file (likely timed out)
(batchId=273)
TestTxnCommands2 - did not produce a TEST-*.xml file (likely timed out)
(batchId=261)
TestTxnUtils - did not produce a TEST-*.xml file (likely timed out)
(batchId=186)
TestUnpermittedCharsInColumnNameCreateTableNegative - did not produce a
TEST-*.xml file (likely timed out) (batchId=255)
TestUnrolledBitPack - did not produce a TEST-*.xml file (likely timed out)
(batchId=234)
TestUpdateDeleteSemanticAnalyzer - did not produce a TEST-*.xml file (likely
timed out) (batchId=255)
TestUseDatabase - did not produce a TEST-*.xml file (likely timed out)
(batchId=174)
TestUtil - did not produce a TEST-*.xml file (likely timed out) (batchId=172)
TestValidCompactorTxnList - did not produce a TEST-*.xml file (likely timed
out) (batchId=186)
TestVectorExpressionWriters - did not produce a TEST-*.xml file (likely timed
out) (batchId=263)
TestVectorOrcFile - did not produce a TEST-*.xml file (likely timed out)
(batchId=234)
TestViewEntity - did not produce a TEST-*.xml file (likely timed out)
(batchId=270)
TestWorker - did not produce a TEST-*.xml file (likely timed out) (batchId=248)
TestWorker2 - did not produce a TEST-*.xml file (likely timed out) (batchId=248)
TestXSRFFilter - did not produce a TEST-*.xml file (likely timed out)
(batchId=215)
TestZookeeperLockManager - did not produce a TEST-*.xml file (likely timed out)
(batchId=273)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[case_sensitivity]
(batchId=61)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[input_testxpath]
(batchId=28)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[udf_coalesce]
(batchId=75)
org.apache.hadoop.hive.cli.TestCompareCliDriver.org.apache.hadoop.hive.cli.TestCompareCliDriver
(batchId=222)
org.apache.hadoop.hive.cli.TestContribNegativeCliDriver.org.apache.hadoop.hive.cli.TestContribNegativeCliDriver
(batchId=223)
org.apache.hadoop.hive.cli.TestEncryptedHDFSCliDriver.org.apache.hadoop.hive.cli.TestEncryptedHDFSCliDriver
(batchId=158)
org.apache.hadoop.hive.cli.TestMiniLlapCliDriver.testCliDriver[orc_ppd_basic]
(batchId=134)
org.apache.hadoop.hive.cli.TestMiniLlapCliDriver.testCliDriver[orc_ppd_schema_evol_3a]
(batchId=135)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[schema_evol_text_vec_part]
(batchId=148)
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver[groupby7_noskew_multi_single_reducer]
(batchId=119)
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver[multi_insert_with_join]
(batchId=122)
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver[vectorized_ptf]
(batchId=121)
org.apache.hadoop.hive.ql.txn.compactor.TestCleaner.blockedByLockPartition
(batchId=248)
org.apache.hadoop.hive.ql.txn.compactor.TestCleaner.blockedByLockTable
(batchId=248)
org.apache.hadoop.hive.ql.txn.compactor.TestCleaner.cleanupAfterMajorPartitionCompaction
(batchId=248)
org.apache.hadoop.hive.ql.txn.compactor.TestCleaner.cleanupAfterMajorPartitionCompactionNoBase
(batchId=248)
org.apache.hadoop.hive.ql.txn.compactor.TestCleaner.cleanupAfterMajorTableCompaction
(batchId=248)
org.apache.hadoop.hive.ql.txn.compactor.TestCleaner.cleanupAfterMinorPartitionCompaction
(batchId=248)
org.apache.hadoop.hive.ql.txn.compactor.TestCleaner.cleanupAfterMinorTableCompaction
(batchId=248)
org.apache.hadoop.hive.ql.txn.compactor.TestCleaner.droppedPartition
(batchId=248)
org.apache.hadoop.hive.ql.txn.compactor.TestCleaner.droppedTable (batchId=248)
org.apache.hadoop.hive.ql.txn.compactor.TestCleaner.notBlockedBySubsequentLock
(batchId=248)
org.apache.hadoop.hive.ql.txn.compactor.TestCleaner.nothing (batchId=248)
org.apache.hadoop.hive.ql.txn.compactor.TestCleaner.partitionNotBlockedBySubsequentLock
(batchId=248)
{noformat}
Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/2867/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/2867/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-2867/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 281 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12846683 - PreCommit-HIVE-Build
> Memory usage is unbound in SortByShuffler for Spark
> ---------------------------------------------------
>
> Key: HIVE-15527
> URL: https://issues.apache.org/jira/browse/HIVE-15527
> Project: Hive
> Issue Type: Improvement
> Components: Spark
> Affects Versions: 1.1.0
> Reporter: Xuefu Zhang
> Assignee: Chao Sun
> Attachments: HIVE-15527.0.patch, HIVE-15527.0.patch,
> HIVE-15527.1.patch, HIVE-15527.2.patch, HIVE-15527.3.patch,
> HIVE-15527.4.patch, HIVE-15527.5.patch, HIVE-15527.6.patch,
> HIVE-15527.7.patch, HIVE-15527.patch
>
>
> In SortByShuffler.java, an ArrayList is used to back the iterator for values
> that have the same key in shuffled result produced by spark transformation
> sortByKey. It's possible that memory can be exhausted because of a large key
> group.
> {code}
> @Override
> public Tuple2<HiveKey, Iterable<BytesWritable>> next() {
> // TODO: implement this by accumulating rows with the same key
> into a list.
> // Note that this list needs to improved to prevent excessive
> memory usage, but this
> // can be done in later phase.
> while (it.hasNext()) {
> Tuple2<HiveKey, BytesWritable> pair = it.next();
> if (curKey != null && !curKey.equals(pair._1())) {
> HiveKey key = curKey;
> List<BytesWritable> values = curValues;
> curKey = pair._1();
> curValues = new ArrayList<BytesWritable>();
> curValues.add(pair._2());
> return new Tuple2<HiveKey, Iterable<BytesWritable>>(key,
> values);
> }
> curKey = pair._1();
> curValues.add(pair._2());
> }
> if (curKey == null) {
> throw new NoSuchElementException();
> }
> // if we get here, this should be the last element we have
> HiveKey key = curKey;
> curKey = null;
> return new Tuple2<HiveKey, Iterable<BytesWritable>>(key,
> curValues);
> }
> {code}
> Since the output from sortByKey is already sorted on key, it's possible to
> backup the value iterable using the same input iterator.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
