[jira] [Commented] (SPARK-21435) Empty files should be skipped while write to file

2017-07-18 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16092559#comment-16092559 ] Hyukjin Kwon commented on SPARK-21435: -- (cc [~cloud_fan], I don't mind reopening this and resolving

[jira] [Commented] (SPARK-21435) Empty files should be skipped while write to file

2017-07-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16089740#comment-16089740 ] Apache Spark commented on SPARK-21435: -- User 'xuanyuanking' has created a pull request for this

[jira] [Commented] (SPARK-21435) Empty files should be skipped while write to file

2017-07-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16089730#comment-16089730 ] Apache Spark commented on SPARK-21435: -- User 'xuanyuanking' has created a pull request for this

[jira] [Commented] (SPARK-21435) Empty files should be skipped while write to file

2017-07-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16089729#comment-16089729 ] Apache Spark commented on SPARK-21435: -- User 'xuanyuanking' has created a pull request for this

[jira] [Commented] (SPARK-21435) Empty files should be skipped while write to file

2017-07-17 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16089455#comment-16089455 ] Hyukjin Kwon commented on SPARK-21435: -- Yea, particularly, in this case, many issues are related I

[jira] [Commented] (SPARK-21435) Empty files should be skipped while write to file

2017-07-17 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16089453#comment-16089453 ] Hyukjin Kwon commented on SPARK-21435: -- I guess this is a duplicate of SPARK-20065 (issue itself

[jira] [Commented] (SPARK-21435) Empty files should be skipped while write to file

2017-07-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16089450#comment-16089450 ] Sean Owen commented on SPARK-21435: --- I don't think that's sufficient, not necessarily. You need to run

[jira] [Commented] (SPARK-21435) Empty files should be skipped while write to file

2017-07-17 Thread Li Yuanjian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16089442#comment-16089442 ] Li Yuanjian commented on SPARK-21435: - [~sowen] I tested the patch in our scenario and add a UT, I

[jira] [Commented] (SPARK-21435) Empty files should be skipped while write to file

2017-07-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16089438#comment-16089438 ] Apache Spark commented on SPARK-21435: -- User 'xuanyuanking' has created a pull request for this