[
https://issues.apache.org/jira/browse/HIVE-10462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14515151#comment-14515151
]
Laljo John Pullokkaran commented on HIVE-10462:
-----------------------------------------------
[~jcamachorodriguez] If hive.cbo.enable is false and hive.co.returnpath=true
then this optimization would kick in. Its quiet possible that in customer env
they might end up in these scenarios. Its an easy fix why not prevent it?
Also Trivial ProjectRemoval rule we disable it if return path is on; there also
we need to check if cbo is enabled.
> CBO (Calcite Return Path): MapJoin and SMBJoin conversion not triggered
> -----------------------------------------------------------------------
>
> Key: HIVE-10462
> URL: https://issues.apache.org/jira/browse/HIVE-10462
> Project: Hive
> Issue Type: Sub-task
> Components: CBO
> Reporter: Jesus Camacho Rodriguez
> Assignee: Jesus Camacho Rodriguez
> Fix For: 1.2.0
>
> Attachments: HIVE-10462.01.patch, HIVE-10462.02.patch,
> HIVE-10462.03.patch, HIVE-10462.patch
>
>
> When the return path is on, the mapjoin conversion optimization fails as some
> DS in the Join descriptor have not been initialized properly.
> The failure can be reproduced with auto_join4.q. In particular, the following
> Exception is thrown:
> {noformat}
> org.apache.hadoop.hive.ql.parse.SemanticException: Generate Map Join Task
> Error: null
> at
> org.apache.hadoop.hive.ql.optimizer.physical.CommonJoinTaskDispatcher.processCurrentTask(CommonJoinTaskDispatcher.java:516)
> at
> org.apache.hadoop.hive.ql.optimizer.physical.AbstractJoinTaskDispatcher.dispatch(AbstractJoinTaskDispatcher.java:179)
> at
> org.apache.hadoop.hive.ql.lib.TaskGraphWalker.dispatch(TaskGraphWalker.java:111)
> at
> org.apache.hadoop.hive.ql.lib.TaskGraphWalker.walk(TaskGraphWalker.java:180)
> at
> org.apache.hadoop.hive.ql.lib.TaskGraphWalker.startWalking(TaskGraphWalker.java:125)
> at
> org.apache.hadoop.hive.ql.optimizer.physical.CommonJoinResolver.resolve(CommonJoinResolver.java:79)
> at
> org.apache.hadoop.hive.ql.optimizer.physical.PhysicalOptimizer.optimize(PhysicalOptimizer.java:107)
> at
> org.apache.hadoop.hive.ql.parse.MapReduceCompiler.optimizeTaskPlan(MapReduceCompiler.java:270)
> at
> org.apache.hadoop.hive.ql.parse.TaskCompiler.compile(TaskCompiler.java:227)
> at
> org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:10084)
> at
> org.apache.hadoop.hive.ql.parse.CalcitePlanner.analyzeInternal(CalcitePlanner.java:203)
> at
> org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:225)
> at
> org.apache.hadoop.hive.ql.parse.ExplainSemanticAnalyzer.analyzeInternal(ExplainSemanticAnalyzer.java:74)
> at
> org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:225)
> ...
> {noformat}
> SMBJoin conversion is not triggered either.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
