[jira] [Commented] (SPARK-19563) advoid unnecessary sort in FileFormatWriter

[ https://issues.apache.org/jira/browse/SPARK-19563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16176870#comment-16176870 ] Charles Pritchard commented on SPARK-19563: --- Did this make it into Spark 2.1.1? > advoid

[jira] [Commented] (SPARK-19352) Sorting issues on relatively big datasets

[ https://issues.apache.org/jira/browse/SPARK-19352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15963367#comment-15963367 ] Charles Pritchard commented on SPARK-19352: --- Does this fix the issue in SPARK-18934 ? >

[jira] [Commented] (SPARK-19352) Sorting issues on relatively big datasets

[ https://issues.apache.org/jira/browse/SPARK-19352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15963365#comment-15963365 ] Charles Pritchard commented on SPARK-19352: --- [~cloud_fan] Yes, Hive relies on sorting

[jira] [Commented] (SPARK-18934) Writing to dynamic partitions does not preserve sort order if spill occurs

[ https://issues.apache.org/jira/browse/SPARK-18934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15961390#comment-15961390 ] Charles Pritchard commented on SPARK-18934: --- Possibly fixed in:

[jira] [Commented] (SPARK-19352) Sorting issues on relatively big datasets

[ https://issues.apache.org/jira/browse/SPARK-19352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15961389#comment-15961389 ] Charles Pritchard commented on SPARK-19352: --- [~cloud_fan] Is there something on the roadmap to

[jira] [Commented] (SPARK-18934) Writing to dynamic partitions does not preserve sort order if spill occurs

[ https://issues.apache.org/jira/browse/SPARK-18934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15800323#comment-15800323 ] Charles Pritchard commented on SPARK-18934: --- Use case and other issues may be related to

[jira] [Commented] (SPARK-6593) Provide option for HadoopRDD to skip corrupted files

[ https://issues.apache.org/jira/browse/SPARK-6593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1543#comment-1543 ] Charles Pritchard commented on SPARK-6593: -- Something appears to have changed between 2.0 and

[jira] [Commented] (SPARK-14482) Change default compression codec for Parquet from gzip to snappy

[ https://issues.apache.org/jira/browse/SPARK-14482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488848#comment-15488848 ] Charles Pritchard commented on SPARK-14482: --- I don't think this fully made it into the manual;