[
https://issues.apache.org/jira/browse/SPARK-6170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-6170.
------------------------------
Resolution: Won't Fix
Given there's no activity and the proposer isn't going to implement, I think
this is WontFix for the foreseeable future.
> Add support for skew join
> --------------------------
>
> Key: SPARK-6170
> URL: https://issues.apache.org/jira/browse/SPARK-6170
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core
> Reporter: Mridul Muralidharan
> Priority: Minor
>
> Do an efficient skew join - current spark join does fairly horribly when
> there are bad skews in the data. There is sufficient literature on how to
> solve this (including impl in pig and hive which have tackled this IIRC).
> I wont be able to work/contribute on this unfortunately, would be great if
> someone else can pick this up - wanted to ensure this task is not missed out.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
