[
https://issues.apache.org/jira/browse/SPARK-4452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14214903#comment-14214903
]
Apache Spark commented on SPARK-4452:
-
User 'tsdeng' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-4452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14214962#comment-14214962
]
tianshuo commented on SPARK-4452:
-
Originally, we found this problem by seeing Too Many
[
https://issues.apache.org/jira/browse/SPARK-4452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14215018#comment-14215018
]
Sandy Ryza commented on SPARK-4452:
---
I haven't thought the implications out fully, but
[
https://issues.apache.org/jira/browse/SPARK-4452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14215047#comment-14215047
]
Sandy Ryza commented on SPARK-4452:
---
A third possible fix would be to have the shuffle
[
https://issues.apache.org/jira/browse/SPARK-4452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14215222#comment-14215222
]
tianshuo commented on SPARK-4452:
-
Hi, [~sandyr]:
Your concern about data structures
[
https://issues.apache.org/jira/browse/SPARK-4452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14215233#comment-14215233
]
tianshuo commented on SPARK-4452:
-
Currently, the two instances of Spillable,