[jira] [Closed] (SPARK-24380) argument quoting/escaping broken in mesos cluster scheduler

2018-05-25 Thread paul mackles (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] paul mackles closed SPARK-24380. > argument quoting/escaping broken in mesos cluster scheduler >

[jira] [Resolved] (SPARK-24380) argument quoting/escaping broken in mesos cluster scheduler

2018-05-25 Thread paul mackles (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] paul mackles resolved SPARK-24380. -- Resolution: Duplicate Dupe of SPARK-23941, just a different config > argument

[jira] [Created] (SPARK-24380) argument quoting/escaping broken

2018-05-24 Thread paul mackles (JIRA)
paul mackles created SPARK-24380: Summary: argument quoting/escaping broken Key: SPARK-24380 URL: https://issues.apache.org/jira/browse/SPARK-24380 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-24380) argument quoting/escaping broken in mesos cluster scheduler

2018-05-24 Thread paul mackles (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] paul mackles updated SPARK-24380: - Summary: argument quoting/escaping broken in mesos cluster scheduler (was: argument

[jira] [Created] (SPARK-23988) [Mesos] Improve handling of appResource in mesos dispatcher when using Docker

2018-04-15 Thread paul mackles (JIRA)
paul mackles created SPARK-23988: Summary: [Mesos] Improve handling of appResource in mesos dispatcher when using Docker Key: SPARK-23988 URL: https://issues.apache.org/jira/browse/SPARK-23988

[jira] [Updated] (SPARK-23943) Improve observability of MesosRestServer/MesosClusterDispatcher

2018-04-10 Thread paul mackles (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] paul mackles updated SPARK-23943: - Description: Two changes in this PR: * A /health endpoint for a quick binary indication on the

[jira] [Updated] (SPARK-23943) Improve observability of MesosRestServer/MesosClusterDispatcher

2018-04-09 Thread paul mackles (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] paul mackles updated SPARK-23943: - Description: Two changes: First, a more robust

[jira] [Updated] (SPARK-23943) Improve observability of MesosRestServer

2018-04-09 Thread paul mackles (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] paul mackles updated SPARK-23943: - Summary: Improve observability of MesosRestServer (was: Add more specific health check to

[jira] [Updated] (SPARK-23943) Improve observability of MesosRestServer/MesosClusterDispatcher

2018-04-09 Thread paul mackles (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] paul mackles updated SPARK-23943: - Summary: Improve observability of MesosRestServer/MesosClusterDispatcher (was: Improve

[jira] [Updated] (SPARK-23943) Add more specific health check to MesosRestServer

2018-04-09 Thread paul mackles (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] paul mackles updated SPARK-23943: - Description: Add a more robust health-check to MesosRestServer so that anyone who runs

[jira] [Updated] (SPARK-23943) Add more specific health check to MesosRestServer

2018-04-09 Thread paul mackles (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] paul mackles updated SPARK-23943: - Environment:     was: Added a more robust health-check to MesosRestServer so that anyone who

[jira] [Updated] (SPARK-23943) Add more specific health check to MesosRestServer

2018-04-09 Thread paul mackles (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] paul mackles updated SPARK-23943: - Summary: Add more specific health check to MesosRestServer (was: add more specific health check

[jira] [Created] (SPARK-23943) add more specific health check to MesosRestServer

2018-04-09 Thread paul mackles (JIRA)
paul mackles created SPARK-23943: Summary: add more specific health check to MesosRestServer Key: SPARK-23943 URL: https://issues.apache.org/jira/browse/SPARK-23943 Project: Spark Issue

[jira] [Commented] (SPARK-22256) Introduce spark.mesos.driver.memoryOverhead

2018-04-09 Thread paul mackles (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16430262#comment-16430262 ] paul mackles commented on SPARK-22256: -- created a PR on behalf of [~clehene] since he as moved on to

[jira] [Updated] (SPARK-22256) Introduce spark.mesos.driver.memoryOverhead

2018-04-09 Thread paul mackles (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] paul mackles updated SPARK-22256: - Fix Version/s: 2.4.0 2.3.1 > Introduce spark.mesos.driver.memoryOverhead >

[jira] [Updated] (SPARK-22256) Introduce spark.mesos.driver.memoryOverhead

2018-04-09 Thread paul mackles (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] paul mackles updated SPARK-22256: - Affects Version/s: 2.3.0 > Introduce spark.mesos.driver.memoryOverhead >

[jira] [Commented] (SPARK-11499) Spark History Server UI should respect protocol when doing redirection

2018-01-19 Thread paul mackles (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16332811#comment-16332811 ] paul mackles commented on SPARK-11499: -- We ran into this issue running the spark-history server as a

[jira] [Created] (SPARK-23088) History server not showing incomplete/running applications

2018-01-16 Thread paul mackles (JIRA)
paul mackles created SPARK-23088: Summary: History server not showing incomplete/running applications Key: SPARK-23088 URL: https://issues.apache.org/jira/browse/SPARK-23088 Project: Spark

[jira] [Commented] (SPARK-22528) History service and non-HDFS filesystems

2017-11-21 Thread paul mackles (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16260727#comment-16260727 ] paul mackles commented on SPARK-22528: -- In case anyone else bumps into this, I received some

[jira] [Updated] (SPARK-22528) History service and non-HDFS filesystems

2017-11-15 Thread paul mackles (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] paul mackles updated SPARK-22528: - Description: We are using Azure Data Lake (ADL) to store our event logs. This worked fine in

[jira] [Created] (SPARK-22528) History service and non-HDFS filesystems

2017-11-15 Thread paul mackles (JIRA)
paul mackles created SPARK-22528: Summary: History service and non-HDFS filesystems Key: SPARK-22528 URL: https://issues.apache.org/jira/browse/SPARK-22528 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-22287) [MESOS] SPARK_DAEMON_MEMORY not honored by MesosClusterDispatcher

2017-10-16 Thread paul mackles (JIRA)
paul mackles created SPARK-22287: Summary: [MESOS] SPARK_DAEMON_MEMORY not honored by MesosClusterDispatcher Key: SPARK-22287 URL: https://issues.apache.org/jira/browse/SPARK-22287 Project: Spark

[jira] [Updated] (SPARK-22287) SPARK_DAEMON_MEMORY not honored by MesosClusterDispatcher

2017-10-16 Thread paul mackles (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] paul mackles updated SPARK-22287: - Summary: SPARK_DAEMON_MEMORY not honored by MesosClusterDispatcher (was: [MESOS]

[jira] [Commented] (SPARK-12832) Mesos cluster mode should handle constraints

2017-09-30 Thread paul mackles (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16187059#comment-16187059 ] paul mackles commented on SPARK-12832: -- I am thinking this one should be closed. It appears to be a

[jira] [Commented] (SPARK-19606) Support constraints in spark-dispatcher

2017-09-30 Thread paul mackles (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16187058#comment-16187058 ] paul mackles commented on SPARK-19606: -- +1 to being able to constrain drivers and another +1 to

[jira] [Commented] (SPARK-22135) metrics in spark-dispatcher not being registered properly

2017-09-26 Thread paul mackles (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181804#comment-16181804 ] paul mackles commented on SPARK-22135: -- here is the PR: https://github.com/apache/spark/pull/19358

[jira] [Updated] (SPARK-22135) metrics in spark-dispatcher not being registered properly

2017-09-26 Thread paul mackles (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] paul mackles updated SPARK-22135: - Description: There is a bug in the way that the metrics in

[jira] [Created] (SPARK-22135) metrics in spark-dispatcher not being registered properly

2017-09-26 Thread paul mackles (JIRA)
paul mackles created SPARK-22135: Summary: metrics in spark-dispatcher not being registered properly Key: SPARK-22135 URL: https://issues.apache.org/jira/browse/SPARK-22135 Project: Spark