[
https://issues.apache.org/jira/browse/SPARK-4849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Davies Liu updated SPARK-4849:
------------------------------
Priority: Critical (was: Minor)
> Pass partitioning information (distribute by) to In-memory caching
> ------------------------------------------------------------------
>
> Key: SPARK-4849
> URL: https://issues.apache.org/jira/browse/SPARK-4849
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 1.2.0
> Reporter: Nitin Goyal
> Priority: Critical
>
> HQL "distribute by <column_name>" partitions data based on specified column
> values. We can pass this information to in-memory caching for further
> performance improvements. e..g. in Joins, an extra partition step can be
> saved based on this information.
> Refer -
> http://apache-spark-user-list.1001560.n3.nabble.com/SchemaRDD-partition-on-specific-column-values-td20350.html
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
