[
https://issues.apache.org/jira/browse/HIVE-8911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14243285#comment-14243285
]
Szehon Ho commented on HIVE-8911:
---------------------------------
This looks ok for now to me. We might consider cleaning this up as part of SMB
hint JIRA, such that we have Spark versions of MapJoinProcessor,
BucketMapJoinOptimizer, and SortedMergeBucketMapjoinProc and we run them later
in our own SparkCompiler. Then here, we will just disable MapJoinProcessor.
> Enable mapjoin hints [Spark Branch]
> -----------------------------------
>
> Key: HIVE-8911
> URL: https://issues.apache.org/jira/browse/HIVE-8911
> Project: Hive
> Issue Type: Sub-task
> Components: Spark
> Affects Versions: spark-branch
> Reporter: Szehon Ho
> Assignee: Chao
> Attachments: HIVE-8911.1-spark.patch, HIVE-8911.2-spark.patch,
> HIVE-8911.3-spark.patch
>
>
> Currently the big table selection in a mapjoin is based on stats.
> We should also enable the big-table selection based on hints. See class
> MapJoinProcessor. This is a logical-optimizer class, so we should be able to
> re-use this without too many changes to hook up with SparkMapJoinResolver.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
