[jira] [Commented] (SPARK-25024) Update mesos documentation to be clear about security supported

2018-08-06 Thread Susan X. Huynh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16570550#comment-16570550 ] Susan X. Huynh commented on SPARK-25024: Yes, I agree, the "Running on Mesos" page could

[jira] [Commented] (SPARK-22342) refactor schedulerDriver registration

2018-04-08 Thread Susan X. Huynh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16429950#comment-16429950 ] Susan X. Huynh commented on SPARK-22342: Good news: I found the root cause of the multiple

[jira] [Commented] (SPARK-19320) Allow guaranteed amount of GPU to be used when launching jobs

2018-04-02 Thread Susan X. Huynh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16423382#comment-16423382 ] Susan X. Huynh commented on SPARK-19320: Oh, looks like it does retain the old behavior in that

[jira] [Commented] (SPARK-19320) Allow guaranteed amount of GPU to be used when launching jobs

2018-04-02 Thread Susan X. Huynh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16423002#comment-16423002 ] Susan X. Huynh commented on SPARK-19320: [~yanji84] What happens if spark.mesos.executor.gpus is

[jira] [Commented] (SPARK-22342) refactor schedulerDriver registration

2018-03-23 Thread Susan X. Huynh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16411780#comment-16411780 ] Susan X. Huynh commented on SPARK-22342: The multiple re-registration issue can lead to

[jira] [Commented] (SPARK-23499) Mesos Cluster Dispatcher should support priority queues to submit drivers

2018-03-19 Thread Susan X. Huynh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16405586#comment-16405586 ] Susan X. Huynh commented on SPARK-23499: [~pgillet] Here's a different issue: in the proposed

[jira] [Commented] (SPARK-23499) Mesos Cluster Dispatcher should support priority queues to submit drivers

2018-03-14 Thread Susan X. Huynh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16398880#comment-16398880 ] Susan X. Huynh commented on SPARK-23499: To ensure a consistent policy, maybe the queue should

[jira] [Commented] (SPARK-23423) Application declines any offers when killed+active executors rich spark.dynamicAllocation.maxExecutors

2018-02-17 Thread Susan X. Huynh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16368331#comment-16368331 ] Susan X. Huynh commented on SPARK-23423: [~skonto] [~igor.berman] I got some info from a

[jira] [Commented] (SPARK-23423) Application declines any offers when killed+active executors rich spark.dynamicAllocation.maxExecutors

2018-02-17 Thread Susan X. Huynh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16368261#comment-16368261 ] Susan X. Huynh commented on SPARK-23423: I'll check if the task updates might be dropped under

[jira] [Updated] (SPARK-22336) When spark-submit cluster mode is run from a Mesos task, the job fails

2017-10-23 Thread Susan X. Huynh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Susan X. Huynh updated SPARK-22336: --- Description: In Mesos cluster mode, spark-submit passes all local MESOS_xxx env vars to the

[jira] [Created] (SPARK-22336) When spark-submit cluster mode is run from a Mesos task, the job fails

2017-10-23 Thread Susan X. Huynh (JIRA)
Susan X. Huynh created SPARK-22336: -- Summary: When spark-submit cluster mode is run from a Mesos task, the job fails Key: SPARK-22336 URL: https://issues.apache.org/jira/browse/SPARK-22336 Project:

[jira] [Commented] (SPARK-17419) Mesos virtual network support

2017-08-10 Thread Susan X. Huynh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122019#comment-16122019 ] Susan X. Huynh commented on SPARK-17419: SPARK-21694 allows the user to pass network labels to

[jira] [Commented] (SPARK-17419) Mesos virtual network support

2017-08-10 Thread Susan X. Huynh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122018#comment-16122018 ] Susan X. Huynh commented on SPARK-17419: SPARK-18232 adds the ability to launch containers

[jira] [Created] (SPARK-21694) Support Mesos CNI network labels

2017-08-10 Thread Susan X. Huynh (JIRA)
Susan X. Huynh created SPARK-21694: -- Summary: Support Mesos CNI network labels Key: SPARK-21694 URL: https://issues.apache.org/jira/browse/SPARK-21694 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-21458) Tear down the framework when failover_timeout > 0 (Mesos cluster mode)

2017-07-18 Thread Susan X. Huynh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Susan X. Huynh updated SPARK-21458: --- Description: When the driver failover_timeout was always set to zero, we relied on the Mesos

[jira] [Updated] (SPARK-21458) Tear down the framework when failover_timeout > 0 (Mesos cluster mode)

2017-07-18 Thread Susan X. Huynh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Susan X. Huynh updated SPARK-21458: --- Description: When the driver failover_timeout was always set to zero, we relied on the Mesos

[jira] [Updated] (SPARK-21458) Tear down the framework when failover_timeout > 0 (Mesos cluster mode)

2017-07-18 Thread Susan X. Huynh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Susan X. Huynh updated SPARK-21458: --- Description: When the driver failover_timeout was always set to zero, we relied on the Mesos

[jira] [Commented] (SPARK-21419) Support Mesos failover_timeout in driver (Mesos cluster mode)

2017-07-18 Thread Susan X. Huynh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16091657#comment-16091657 ] Susan X. Huynh commented on SPARK-21419: I split this into two sub-tasks: (1) making the

[jira] [Created] (SPARK-21458) Tear down the framework when failover_timeout > 0 (Mesos cluster mode)

2017-07-18 Thread Susan X. Huynh (JIRA)
Susan X. Huynh created SPARK-21458: -- Summary: Tear down the framework when failover_timeout > 0 (Mesos cluster mode) Key: SPARK-21458 URL: https://issues.apache.org/jira/browse/SPARK-21458 Project:

[jira] [Created] (SPARK-21456) Make the driver failover_timeout configurable (Mesos cluster mode)

2017-07-18 Thread Susan X. Huynh (JIRA)
Susan X. Huynh created SPARK-21456: -- Summary: Make the driver failover_timeout configurable (Mesos cluster mode) Key: SPARK-21456 URL: https://issues.apache.org/jira/browse/SPARK-21456 Project:

[jira] [Created] (SPARK-21419) Support Mesos failover_timeout in driver (Mesos cluster mode)

2017-07-14 Thread Susan X. Huynh (JIRA)
Susan X. Huynh created SPARK-21419: -- Summary: Support Mesos failover_timeout in driver (Mesos cluster mode) Key: SPARK-21419 URL: https://issues.apache.org/jira/browse/SPARK-21419 Project: Spark

[jira] [Commented] (SPARK-17966) Support Spark packages with R code on Mesos

2016-11-29 Thread Susan X. Huynh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15705635#comment-15705635 ] Susan X. Huynh commented on SPARK-17966: (Same question here) I'm not sure how to test this

[jira] [Commented] (SPARK-17968) Support using 3rd-party R packages on Mesos

2016-11-29 Thread Susan X. Huynh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15705629#comment-15705629 ] Susan X. Huynh commented on SPARK-17968: I'm not sure how to test this issue. Could you provide

[jira] [Commented] (SPARK-17965) Enable SparkR with Mesos cluster mode

2016-11-29 Thread Susan X. Huynh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15705619#comment-15705619 ] Susan X. Huynh commented on SPARK-17965: This issue was fixed at the same time as SPARK-17964:

[jira] [Commented] (SPARK-11524) Support SparkR with Mesos cluster

2016-10-16 Thread Susan X. Huynh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15581023#comment-15581023 ] Susan X. Huynh commented on SPARK-11524: Thanks for the advice and for breaking down the

[jira] [Commented] (SPARK-11524) Support SparkR with Mesos cluster

2016-10-15 Thread Susan X. Huynh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15578137#comment-15578137 ] Susan X. Huynh commented on SPARK-11524: I would like to work on this. What are the missing