[ https://issues.apache.org/jira/browse/HIVE-17994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16264023#comment-16264023 ]
Hive QA commented on HIVE-17994: -------------------------------- Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12899009/HIVE-17994.02.patch {color:red}ERROR:{color} -1 due to no test(s) being added or modified. {color:red}ERROR:{color} -1 due to 43 failed/errored test(s), 11410 tests executed *Failed tests:* {noformat} org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[hybridgrace_hashjoin_2] (batchId=154) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[insert_values_orig_table_use_metadata] (batchId=162) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[llap_acid_fast] (batchId=157) org.apache.hadoop.hive.ql.io.sarg.TestConvertAstToSearchArg.TestBigintSarg (batchId=264) org.apache.hadoop.hive.ql.io.sarg.TestConvertAstToSearchArg.TestBooleanSarg (batchId=264) org.apache.hadoop.hive.ql.io.sarg.TestConvertAstToSearchArg.TestCharSarg (batchId=264) org.apache.hadoop.hive.ql.io.sarg.TestConvertAstToSearchArg.TestDateSarg (batchId=264) org.apache.hadoop.hive.ql.io.sarg.TestConvertAstToSearchArg.TestDecimalSarg (batchId=264) org.apache.hadoop.hive.ql.io.sarg.TestConvertAstToSearchArg.TestDoubleSarg (batchId=264) org.apache.hadoop.hive.ql.io.sarg.TestConvertAstToSearchArg.TestFloatSarg (batchId=264) org.apache.hadoop.hive.ql.io.sarg.TestConvertAstToSearchArg.TestTimestampSarg (batchId=264) org.apache.hadoop.hive.ql.io.sarg.TestConvertAstToSearchArg.TestVarcharSarg (batchId=264) org.apache.hadoop.hive.ql.io.sarg.TestConvertAstToSearchArg.testExpression1 (batchId=264) org.apache.hadoop.hive.ql.io.sarg.TestConvertAstToSearchArg.testExpression10 (batchId=264) org.apache.hadoop.hive.ql.io.sarg.TestConvertAstToSearchArg.testExpression2 (batchId=264) org.apache.hadoop.hive.ql.io.sarg.TestConvertAstToSearchArg.testExpression3 (batchId=264) org.apache.hadoop.hive.ql.io.sarg.TestConvertAstToSearchArg.testExpression4 (batchId=264) org.apache.hadoop.hive.ql.io.sarg.TestConvertAstToSearchArg.testExpression5 (batchId=264) org.apache.hadoop.hive.ql.io.sarg.TestConvertAstToSearchArg.testExpression7 (batchId=264) org.apache.hadoop.hive.ql.io.sarg.TestConvertAstToSearchArg.testExpression9 (batchId=264) org.apache.hadoop.hive.ql.parse.TestReplicationScenarios.testConstraints (batchId=224) org.apache.hive.hcatalog.pig.TestTextFileHCatStorer.testMultiPartColsInData (batchId=188) org.apache.hive.jdbc.TestSSL.testConnectionMismatch (batchId=230) org.apache.hive.jdbc.TestSSL.testConnectionWrongCertCN (batchId=230) org.apache.hive.jdbc.TestSSL.testMetastoreConnectionWrongCertCN (batchId=230) org.apache.hive.jdbc.TestTriggersWorkloadManager.testMultipleTriggers1 (batchId=231) org.apache.hive.jdbc.TestTriggersWorkloadManager.testMultipleTriggers2 (batchId=231) org.apache.hive.jdbc.TestTriggersWorkloadManager.testTriggerCustomCreatedDynamicPartitions (batchId=231) org.apache.hive.jdbc.TestTriggersWorkloadManager.testTriggerCustomCreatedDynamicPartitionsMultiInsert (batchId=231) org.apache.hive.jdbc.TestTriggersWorkloadManager.testTriggerCustomCreatedDynamicPartitionsUnionAll (batchId=231) org.apache.hive.jdbc.TestTriggersWorkloadManager.testTriggerCustomCreatedFiles (batchId=231) org.apache.hive.jdbc.TestTriggersWorkloadManager.testTriggerCustomNonExistent (batchId=231) org.apache.hive.jdbc.TestTriggersWorkloadManager.testTriggerHighBytesRead (batchId=231) org.apache.hive.jdbc.TestTriggersWorkloadManager.testTriggerHighShuffleBytes (batchId=231) org.apache.hive.jdbc.TestTriggersWorkloadManager.testTriggerSlowQueryElapsedTime (batchId=231) org.apache.hive.jdbc.TestTriggersWorkloadManager.testTriggerSlowQueryExecutionTime (batchId=231) org.apache.hive.jdbc.TestTriggersWorkloadManager.testTriggerTotalTasks (batchId=231) org.apache.hive.storage.jdbc.TestQueryConditionBuilder.testMultipleConditions_noTranslation (batchId=205) org.apache.hive.storage.jdbc.TestQueryConditionBuilder.testMultipleConditions_withTranslation (batchId=205) org.apache.hive.storage.jdbc.TestQueryConditionBuilder.testSimpleCondition_noTranslation (batchId=205) org.apache.hive.storage.jdbc.TestQueryConditionBuilder.testSimpleCondition_withDateType (batchId=205) org.apache.hive.storage.jdbc.TestQueryConditionBuilder.testSimpleCondition_withTranslation (batchId=205) org.apache.hive.storage.jdbc.TestQueryConditionBuilder.testSimpleCondition_withVariedCaseMappings (batchId=205) {noformat} Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/7984/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/7984/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-7984/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.YetusPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 43 tests failed {noformat} This message is automatically generated. ATTACHMENT ID: 12899009 - PreCommit-HIVE-Build > Vectorization: Serialization bottlenecked on irrelevant hashmap lookup > ---------------------------------------------------------------------- > > Key: HIVE-17994 > URL: https://issues.apache.org/jira/browse/HIVE-17994 > Project: Hive > Issue Type: Bug > Reporter: Gopal V > Assignee: Matt McCline > Priority: Minor > Attachments: HIVE-17994.01.patch, HIVE-17994.02.patch, > vec-serialize-hashmap.png > > > On machines with slower NUMA, the hashmap lookup for > TypeInfo::getPrimitiveCategory is the slowest part of the vectorized > serialization loops. The static object references run hot with the NUMA > access speeds penalizing half the threads. > This lookup is done for every column, for every row - though vectorization > enforces that this type cannot change at all. > !vec-serialize-hashmap.png! -- This message was sent by Atlassian JIRA (v6.4.14#64029)