[
https://issues.apache.org/jira/browse/SPARK-18367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nicholas Chammas updated SPARK-18367:
-
Attachment: spark-lsof.txt
Here is the output of {{lsof}} on all the pids owned by Spark
[
https://issues.apache.org/jira/browse/SPARK-18367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nicholas Chammas updated SPARK-18367:
-
Description:
I have a moderately complex DataFrame query that spawns north of 10K open
[
https://issues.apache.org/jira/browse/SPARK-18367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nicholas Chammas updated SPARK-18367:
-
Description:
I have a moderately complex DataFrame query that spawns north of 10K open
[
https://issues.apache.org/jira/browse/SPARK-18367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nicholas Chammas updated SPARK-18367:
-
Description:
I have a moderately complex DataFrame query that spawns north of 10K open
[
https://issues.apache.org/jira/browse/SPARK-18367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nicholas Chammas updated SPARK-18367:
-
Attachment: (was: plan-with-limit.txt)
> DataFrame join spawns unreasonably high
[
https://issues.apache.org/jira/browse/SPARK-18367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nicholas Chammas updated SPARK-18367:
-
Attachment: (was: plan-without-limit.txt)
> DataFrame join spawns unreasonably high
[
https://issues.apache.org/jira/browse/SPARK-18367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nicholas Chammas updated SPARK-18367:
-
Summary: DataFrame join spawns unreasonably high number of open files
(was: limit()
