Jesus Camacho Rodriguez created HIVE-24073:
----------------------------------------------

             Summary: Execution exception in sort-merge semijoin
                 Key: HIVE-24073
                 URL: https://issues.apache.org/jira/browse/HIVE-24073
             Project: Hive
          Issue Type: Bug
          Components: Operators
            Reporter: Jesus Camacho Rodriguez
            Assignee: mahesh kumar behera


Working on HIVE-24001, we trigger an additional SJ conversion that leads to 
this exception at execution time:

{code}
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: 
org.apache.hadoop.hive.ql.metadata.HiveException: 
org.apache.hadoop.hive.ql.metadata.HiveException: Attempting to overwrite 
nextKeyWritables[1]
        at 
org.apache.hadoop.hive.ql.exec.GroupByOperator.closeOp(GroupByOperator.java:1063)
        at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:685)
        at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:707)
        at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:707)
        at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:707)
        at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:707)
        at 
org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.close(MapRecordProcessor.java:462)
        ... 16 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: 
org.apache.hadoop.hive.ql.metadata.HiveException: Attempting to overwrite 
nextKeyWritables[1]
        at 
org.apache.hadoop.hive.ql.exec.GroupByOperator.flush(GroupByOperator.java:1037)
        at 
org.apache.hadoop.hive.ql.exec.GroupByOperator.closeOp(GroupByOperator.java:1060)
        ... 22 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Attempting to 
overwrite nextKeyWritables[1]
        at 
org.apache.hadoop.hive.ql.exec.CommonMergeJoinOperator.processKey(CommonMergeJoinOperator.java:564)
        at 
org.apache.hadoop.hive.ql.exec.CommonMergeJoinOperator.process(CommonMergeJoinOperator.java:243)
        at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:887)
        at 
org.apache.hadoop.hive.ql.exec.TezDummyStoreOperator.process(TezDummyStoreOperator.java:49)
        at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:887)
        at 
org.apache.hadoop.hive.ql.exec.GroupByOperator.forward(GroupByOperator.java:1003)
        at 
org.apache.hadoop.hive.ql.exec.GroupByOperator.flush(GroupByOperator.java:1020)
        ... 23 more
{code}

To reproduce, just set {{hive.auto.convert.sortmerge.join}} to {{true}} in the 
last query in {{auto_sortmerge_join_10.q}} after HIVE-24041 has been merged.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to