[jira] [Updated] (SPARK-32172) Use createDirectory instead of mkdir

2020-07-05 Thread Zuo Dao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zuo Dao updated SPARK-32172: Description: Use Files.createDirectory() to create local directory instead of File.mkdir() in DiskBlockMa

[jira] [Created] (SPARK-32172) Use createDirectory instead of mkdir

2020-07-04 Thread Zuo Dao (Jira)
Zuo Dao created SPARK-32172: --- Summary: Use createDirectory instead of mkdir Key: SPARK-32172 URL: https://issues.apache.org/jira/browse/SPARK-32172 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-32104) Avoid full outer join OOM on skewed dataset

2020-06-27 Thread Zuo Dao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17146839#comment-17146839 ] Zuo Dao commented on SPARK-32104: - Yes, same problem. [~viirya] > Avoid full outer join

[jira] [Updated] (SPARK-32104) Avoid full outer join OOM on skewed dataset

2020-06-26 Thread Zuo Dao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zuo Dao updated SPARK-32104: Description: SPARK-24985 changed {{SortMergeJoinExec}} to use  {{ExternalAppendOnlyUnsafeRowArray}} on {{S

[jira] [Created] (SPARK-32104) Avoid full outer join OOM on skewed dataset

2020-06-26 Thread Zuo Dao (Jira)
Zuo Dao created SPARK-32104: --- Summary: Avoid full outer join OOM on skewed dataset Key: SPARK-32104 URL: https://issues.apache.org/jira/browse/SPARK-32104 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-32075) Fix a few issues in parameters table

2020-06-23 Thread Zuo Dao (Jira)
Zuo Dao created SPARK-32075: --- Summary: Fix a few issues in parameters table Key: SPARK-32075 URL: https://issues.apache.org/jira/browse/SPARK-32075 Project: Spark Issue Type: Improvement