[
https://issues.apache.org/jira/browse/SPARK-17930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15581668#comment-15581668
]
Apache Spark commented on SPARK-17930:
--
User 'witgo' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-17930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15581119#comment-15581119
]
Guoqiang Li commented on SPARK-17930:
-
TPC-DS 2T data (Parquet) and the SQL(query 2) =>
{noformat}
[
https://issues.apache.org/jira/browse/SPARK-17930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15577852#comment-15577852
]
Sean Owen commented on SPARK-17930:
---
Maybe so; I think the question is whether this would cause it to
[
https://issues.apache.org/jira/browse/SPARK-17930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15577506#comment-15577506
]
Guoqiang Li commented on SPARK-17930:
-
If a stage contains a lot of tasks, eg one million tasks, the
[
https://issues.apache.org/jira/browse/SPARK-17930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15575123#comment-15575123
]
Sean Owen commented on SPARK-17930:
---
But this code is only ever called once per object. Reuse doesn't