[ 
https://issues.apache.org/jira/browse/HIVE-20113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16934158#comment-16934158
 ] 

Hive QA commented on HIVE-20113:
--------------------------------



Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12980777/HIVE-20113.10.patch

{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.

{color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 16803 tests 
executed
*Failed tests:*
{noformat}
TestMiniLlapLocalCliDriver - did not produce a TEST-*.xml file (likely timed 
out) (batchId=177)
        
[groupby_rollup_empty.q,schema_evol_orc_acidvec_table_llap_io.q,parquet_types.q,vectorization_5.q,schema_evol_stats.q,subquery_corr.q,jdbc_handler.q,column_access_stats.q,vector_between_in.q,merge1.q,cbo_rp_join.q,subquery_ANY.q,vector_coalesce_3.q,sample10_mm.q,stats_noscan_1.q,vector_partition_diff_num_cols.q,vector_decimal_10_0.q,orc_merge5.q,schema_evol_text_vec_part.q,vector_groupby_reduce.q,union8.q,lineage2.q,auto_join29.q,insert_values_orig_table.q,correlationoptimizer1.q,vector_decimal_mapjoin.q,schema_evol_undecorated.q,vectorized_case.q,vector_windowing_rank.q,materialized_view_rewrite_8.q]
{noformat}

Test results: 
https://builds.apache.org/job/PreCommit-HIVE-Build/18661/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/18661/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-18661/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 1 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12980777 - PreCommit-HIVE-Build

> Shuffle avoidance: Disable 1-1 edges for sorted shuffle 
> --------------------------------------------------------
>
>                 Key: HIVE-20113
>                 URL: https://issues.apache.org/jira/browse/HIVE-20113
>             Project: Hive
>          Issue Type: Bug
>          Components: Tez
>            Reporter: Gopal V
>            Assignee: Vineet Garg
>            Priority: Major
>              Labels: Branch3Candidate
>         Attachments: HIVE-20113.1.patch, HIVE-20113.10.patch, 
> HIVE-20113.2.patch, HIVE-20113.3.patch, HIVE-20113.4.patch, 
> HIVE-20113.4.patch, HIVE-20113.5.patch, HIVE-20113.6.patch, 
> HIVE-20113.7.patch, HIVE-20113.8.patch, HIVE-20113.9.patch
>
>
> The sorted shuffle avoidance can have some issues when the shuffle data gets 
> broken up into multiple chunks on disk.
> The 1-1 edge cannot skip the tez final merge - there's no reason for 1-1 to 
> have a final merge at all, it should open a single compressed file and write 
> a single index entry.
> Until the shuffle issue is resolved & a lot more testing, it is prudent to 
> disable the optimization for sorted shuffle edges and stop rewriting the 
> RS(sorted) = = = RS(sorted) into RS(sorted) = = = RS(FORWARD).



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to