[jira] [Commented] (SPARK-20107) Speed up FileOutputCommitter#commitJob for many output files

2017-03-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15943305#comment-15943305 ] Sean Owen commented on SPARK-20107: --- 11 minutes versus what? Does it work on stock Hadoop 2.6 (sounds

[jira] [Commented] (SPARK-20107) Speed up FileOutputCommitter#commitJob for many output files

2017-03-27 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15943220#comment-15943220 ] Yuming Wang commented on SPARK-20107: - I will create a PR later > Speed up