Rui Li created HIVE-10989:
-----------------------------
Summary: Spark can't control number of map tasks for runtime skew
join [Spark Branch]
Key: HIVE-10989
URL: https://issues.apache.org/jira/browse/HIVE-10989
Project: Hive
Issue Type: Sub-task
Reporter: Rui Li
Assignee: Rui Li
Flags {{hive.skewjoin.mapjoin.map.tasks}} and
{{hive.skewjoin.mapjoin.min.split}} are used to control the number of map tasks
for the map join of runtime skew join. They work well for MR but have no effect
for spark.
This makes runtime skew join less useful, i.e. we just end up with slow mappers
instead of reducers.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)