[jira] [Commented] (SPARK-19111) S3 Mesos history upload fails silently if too large

[ https://issues.apache.org/jira/browse/SPARK-19111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056601#comment-16056601 ] Charles Allen commented on SPARK-19111: --- [~ste...@apache.org] It makes it unstable because the

[jira] [Commented] (SPARK-19111) S3 Mesos history upload fails silently if too large

[ https://issues.apache.org/jira/browse/SPARK-19111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056516#comment-16056516 ] Steve Loughran commented on SPARK-19111: Followup: [~drcrallen]; Hadoop 2.8 is out the door with

[jira] [Commented] (SPARK-19111) S3 Mesos history upload fails silently if too large

[ https://issues.apache.org/jira/browse/SPARK-19111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15848403#comment-15848403 ] Steve Loughran commented on SPARK-19111: Charles, you might also want to keep an eye on:

[jira] [Commented] (SPARK-19111) S3 Mesos history upload fails silently if too large

[ https://issues.apache.org/jira/browse/SPARK-19111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15840419#comment-15840419 ] Charles Allen commented on SPARK-19111: --- While switching to s3a helped the logs upload, it made the

[jira] [Commented] (SPARK-19111) S3 Mesos history upload fails silently if too large

[ https://issues.apache.org/jira/browse/SPARK-19111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15840418#comment-15840418 ] Charles Allen commented on SPARK-19111: --- We have a patch https://github.com/apache/spark/pull/16714

[jira] [Commented] (SPARK-19111) S3 Mesos history upload fails silently if too large

[ https://issues.apache.org/jira/browse/SPARK-19111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15832473#comment-15832473 ] Jisoo Kim commented on SPARK-19111: --- Related to https://issues.apache.org/jira/browse/SPARK-19316. >

[jira] [Commented] (SPARK-19111) S3 Mesos history upload fails silently if too large

[ https://issues.apache.org/jira/browse/SPARK-19111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15832458#comment-15832458 ] Jisoo Kim commented on SPARK-19111: --- Thanks [~ste...@apache.org] for information, using S3a helped with

[jira] [Commented] (SPARK-19111) S3 Mesos history upload fails silently if too large

[ https://issues.apache.org/jira/browse/SPARK-19111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15821773#comment-15821773 ] Steve Loughran commented on SPARK-19111: Just realised one more thing If the allocated threads

[jira] [Commented] (SPARK-19111) S3 Mesos history upload fails silently if too large

[ https://issues.apache.org/jira/browse/SPARK-19111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15812304#comment-15812304 ] Charles Allen commented on SPARK-19111: --- That's great information, thank you [~ste...@apache.org]

[jira] [Commented] (SPARK-19111) S3 Mesos history upload fails silently if too large

[ https://issues.apache.org/jira/browse/SPARK-19111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15812301#comment-15812301 ] Charles Allen commented on SPARK-19111: --- I was also going to have the folks here look at the

[jira] [Commented] (SPARK-19111) S3 Mesos history upload fails silently if too large

[ https://issues.apache.org/jira/browse/SPARK-19111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15812286#comment-15812286 ] Charles Allen commented on SPARK-19111: --- If you prefer "re-open on more data" then I can definitely

[jira] [Commented] (SPARK-19111) S3 Mesos history upload fails silently if too large

[ https://issues.apache.org/jira/browse/SPARK-19111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15811767#comment-15811767 ] Steve Loughran commented on SPARK-19111: What's happening here is that (a) S3n isn't uploading

[jira] [Commented] (SPARK-19111) S3 Mesos history upload fails silently if too large

[ https://issues.apache.org/jira/browse/SPARK-19111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15811469#comment-15811469 ] Sean Owen commented on SPARK-19111: --- In practice, there's almost no chance there will be a follow-up on

[jira] [Commented] (SPARK-19111) S3 Mesos history upload fails silently if too large

[ https://issues.apache.org/jira/browse/SPARK-19111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15809837#comment-15809837 ] Charles Allen commented on SPARK-19111: --- So to clarify, I agree this ticket is not actionable as

[jira] [Commented] (SPARK-19111) S3 Mesos history upload fails silently if too large

[ https://issues.apache.org/jira/browse/SPARK-19111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15807603#comment-15807603 ] Charles Allen commented on SPARK-19111: --- I have not been able to finish root cause stuff, but I

[jira] [Commented] (SPARK-19111) S3 Mesos history upload fails silently if too large

[ https://issues.apache.org/jira/browse/SPARK-19111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15807377#comment-15807377 ] Sean Owen commented on SPARK-19111: --- Is there any more detail on why? are you sure it's a size issue,