Rui Li created HIVE-10989: ----------------------------- Summary: Spark can't control number of map tasks for runtime skew join [Spark Branch] Key: HIVE-10989 URL: https://issues.apache.org/jira/browse/HIVE-10989 Project: Hive Issue Type: Sub-task Reporter: Rui Li Assignee: Rui Li
Flags {{hive.skewjoin.mapjoin.map.tasks}} and {{hive.skewjoin.mapjoin.min.split}} are used to control the number of map tasks for the map join of runtime skew join. They work well for MR but have no effect for spark. This makes runtime skew join less useful, i.e. we just end up with slow mappers instead of reducers. -- This message was sent by Atlassian JIRA (v6.3.4#6332)