Liang-Chi Hsieh created SPARK-17574:

             Summary: Cache ShuffleExchange RDD when the exchange is reused
                 Key: SPARK-17574
             Project: Spark
          Issue Type: Improvement
          Components: SQL
            Reporter: Liang-Chi Hsieh

We have the rule ReuseExchange to reuse exchange in the physical plan. However, 
for a ShuffleExchange we still need to retrieve remote blocks again when the 
shuffle exchange is reused. We can cache the RDD of the reused ShuffleExchange 
to avoid transferring remote blocks again.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

Reply via email to