Davies Liu created SPARK-13523:
----------------------------------
Summary: Reuse the exchanges in a query
Key: SPARK-13523
URL: https://issues.apache.org/jira/browse/SPARK-13523
Project: Spark
Issue Type: New Feature
Components: SQL
Reporter: Davies Liu
In exchange, the RDD will be materialized (shuffled or collected), it's a good
point to eliminate common part of a query.
In some TPCDS queries (for example, Q64), the same exchange (ShuffleExchange or
BroadcastExchange) could be used multiple times, we should re-use them to avoid
the duplicated work and reduce the memory for broadcast.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
