[jira] [Commented] (SPARK-10975) Shuffle files left behind on Mesos without dynamic allocation

2015-10-23 Thread Chris Bannister (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14971265#comment-14971265 ] Chris Bannister commented on SPARK-10975: - Spark will use MESOS_DIRECTORY sandbox when not using

[jira] [Updated] (SPARK-11695) Set s3a credentials by default similarly to s3 and s3n

2015-11-12 Thread Chris Bannister (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Bannister updated SPARK-11695: Component/s: Spark Core > Set s3a credentials by default similarly to s3 and s3n >

[jira] [Created] (SPARK-11695) Set s3a credentials by default similarly to s3 and s3n

2015-11-12 Thread Chris Bannister (JIRA)
Chris Bannister created SPARK-11695: --- Summary: Set s3a credentials by default similarly to s3 and s3n Key: SPARK-11695 URL: https://issues.apache.org/jira/browse/SPARK-11695 Project: Spark

[jira] [Created] (SPARK-10293) Add support for oversubscription in Mesos

2015-08-26 Thread Chris Bannister (JIRA)
Chris Bannister created SPARK-10293: --- Summary: Add support for oversubscription in Mesos Key: SPARK-10293 URL: https://issues.apache.org/jira/browse/SPARK-10293 Project: Spark Issue Type:

[jira] [Updated] (SPARK-10293) Add support for oversubscription in Mesos

2015-08-26 Thread Chris Bannister (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Bannister updated SPARK-10293: Description: Currently when running Spark on Mesos each executor will use all the CPU

[jira] [Commented] (SPARK-9708) Spark should create local temporary directories in Mesos sandbox when launched with Mesos

2015-09-03 Thread Chris Bannister (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14728864#comment-14728864 ] Chris Bannister commented on SPARK-9708: When the executor is killed by Mesos it does not

[jira] [Updated] (SPARK-14327) Scheduler holds locks which cause huge scheulder delays and executor timeouts

2016-04-01 Thread Chris Bannister (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Bannister updated SPARK-14327: Attachment: driver.jstack jstack of the driver > Scheduler holds locks which cause huge

[jira] [Issue Comment Deleted] (SPARK-1239) Improve fetching of map output statuses

2016-05-01 Thread Chris Bannister (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Bannister updated SPARK-1239: --- Comment: was deleted (was: Im seeing frequent job failures where the executors are unable to

[jira] [Commented] (SPARK-1239) Improve fetching of map output statuses

2016-05-01 Thread Chris Bannister (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15265756#comment-15265756 ] Chris Bannister commented on SPARK-1239: Im seeing frequent job failures where the executors are

[jira] [Commented] (SPARK-12787) Dataset to support custom encoder

2016-08-31 Thread Chris Bannister (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15451964#comment-15451964 ] Chris Bannister commented on SPARK-12787: - We would like to use spark-avro provided schema

[jira] [Created] (SPARK-17453) Broadcast block already exists in MemoryStore

2016-09-08 Thread Chris Bannister (JIRA)
Chris Bannister created SPARK-17453: --- Summary: Broadcast block already exists in MemoryStore Key: SPARK-17453 URL: https://issues.apache.org/jira/browse/SPARK-17453 Project: Spark Issue

[jira] [Updated] (SPARK-17453) Broadcast block already exists in MemoryStore

2016-09-08 Thread Chris Bannister (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Bannister updated SPARK-17453: Description: Whilst doing a broadcast join we reliably hit this exception, the code worked

[jira] [Created] (SPARK-17454) Add option to specify Mesos resource offer constraints

2016-09-08 Thread Chris Bannister (JIRA)
Chris Bannister created SPARK-17454: --- Summary: Add option to specify Mesos resource offer constraints Key: SPARK-17454 URL: https://issues.apache.org/jira/browse/SPARK-17454 Project: Spark

[jira] [Updated] (SPARK-17453) Broadcast block already exists in MemoryStore

2016-09-12 Thread Chris Bannister (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Bannister updated SPARK-17453: Component/s: Spark Core > Broadcast block already exists in MemoryStore >

[jira] [Commented] (SPARK-17454) Add option to specify Mesos resource offer constraints

2016-09-23 Thread Chris Bannister (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15516685#comment-15516685 ] Chris Bannister commented on SPARK-17454: - The scheduler will write the to mesos disk sandbox if

[jira] [Commented] (SPARK-17454) Add option to specify Mesos resource offer constraints

2016-09-26 Thread Chris Bannister (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15523003#comment-15523003 ] Chris Bannister commented on SPARK-17454: - Yep, it would be good to also provide isolation