[jira] [Updated] (SPARK-12413) Mesos ZK persistence throws a

2015-12-17 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Gummelt updated SPARK-12413: Summary: Mesos ZK persistence throws a (was: Mesos ZK persistence is broken) > Mesos ZK

[jira] [Created] (SPARK-12413) Mesos ZK persistence is broken

2015-12-17 Thread Michael Gummelt (JIRA)
Michael Gummelt created SPARK-12413: --- Summary: Mesos ZK persistence is broken Key: SPARK-12413 URL: https://issues.apache.org/jira/browse/SPARK-12413 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-12413) Mesos ZK persistence throws a NotSerializableException

2015-12-17 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Gummelt updated SPARK-12413: Summary: Mesos ZK persistence throws a NotSerializableException (was: Mesos ZK

[jira] [Updated] (SPARK-12413) Mesos ZK persistence throws a NotSerializableException

2015-12-17 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Gummelt updated SPARK-12413: Description: This breaks ZK persistence due to

[jira] [Updated] (SPARK-12413) Mesos ZK persistence throws a NotSerializableException

2015-12-17 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Gummelt updated SPARK-12413: Description: https://github.com/apache/spark/pull/10359 breaks ZK persistence due to

[jira] [Updated] (SPARK-12413) Mesos ZK persistence throws a NotSerializableException

2015-12-17 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Gummelt updated SPARK-12413: Description: This breaks ZK persistence due to

[jira] [Commented] (SPARK-12413) Mesos ZK persistence throws a NotSerializableException

2015-12-17 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15063005#comment-15063005 ] Michael Gummelt commented on SPARK-12413: - Updated. Thanks > Mesos ZK persistence throws a

[jira] [Updated] (SPARK-12413) Mesos ZK persistence throws a NotSerializableException

2015-12-17 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Gummelt updated SPARK-12413: Description: https://github.com/apache/spark/pull/10359 breaks ZK persistence due to

[jira] [Updated] (SPARK-12413) Mesos ZK persistence throws a NotSerializableException

2015-12-17 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Gummelt updated SPARK-12413: Description: This breaks ZK persistence due to

[jira] [Commented] (SPARK-16194) No way to dynamically set env vars on driver in cluster mode

2016-06-24 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15348650#comment-15348650 ] Michael Gummelt commented on SPARK-16194: - Ah, yea, that's what I need. I'd like the make this

[jira] [Commented] (SPARK-16194) No way to dynamically set env vars on driver in cluster mode

2016-06-24 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15348645#comment-15348645 ] Michael Gummelt commented on SPARK-16194: - > Env variables are pretty much from outside Spark

[jira] [Created] (SPARK-16194) No way to dynamically set env vars on driver in cluster mode

2016-06-24 Thread Michael Gummelt (JIRA)
Michael Gummelt created SPARK-16194: --- Summary: No way to dynamically set env vars on driver in cluster mode Key: SPARK-16194 URL: https://issues.apache.org/jira/browse/SPARK-16194 Project: Spark

[jira] [Created] (SPARK-13258) --conf variables not honored in Mesos cluster mode

2016-02-09 Thread Michael Gummelt (JIRA)
Michael Gummelt created SPARK-13258: --- Summary: --conf variables not honored in Mesos cluster mode Key: SPARK-13258 URL: https://issues.apache.org/jira/browse/SPARK-13258 Project: Spark

[jira] [Updated] (SPARK-13258) --conf properties not honored in Mesos cluster mode

2016-02-09 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Gummelt updated SPARK-13258: Summary: --conf properties not honored in Mesos cluster mode (was: --conf variables not

[jira] [Updated] (SPARK-13258) --conf properties not honored in Mesos cluster mode

2016-02-09 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Gummelt updated SPARK-13258: Description: Spark properties set on {{spark-submit}} via the deprecated

[jira] [Created] (SPARK-13259) SPARK_HOME should not be used as the CWD in docker executors

2016-02-09 Thread Michael Gummelt (JIRA)
Michael Gummelt created SPARK-13259: --- Summary: SPARK_HOME should not be used as the CWD in docker executors Key: SPARK-13259 URL: https://issues.apache.org/jira/browse/SPARK-13259 Project: Spark

[jira] [Updated] (SPARK-13439) Document that spark.mesos.uris is comma-separated

2016-02-22 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Gummelt updated SPARK-13439: Description:

[jira] [Created] (SPARK-13439) Document that spark.mesos.uris is comma-separated

2016-02-22 Thread Michael Gummelt (JIRA)
Michael Gummelt created SPARK-13439: --- Summary: Document that spark.mesos.uris is comma-separated Key: SPARK-13439 URL: https://issues.apache.org/jira/browse/SPARK-13439 Project: Spark

[jira] [Updated] (SPARK-14180) Deadlock in CoarseGrainedExecutorBackend Shutdown

2016-03-26 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Gummelt updated SPARK-14180: Description: I'm fairly certain that https://github.com/apache/spark/pull/11031 introduced

[jira] [Created] (SPARK-14180) Deadlock in CoarseGrainedExecutorBackend Shutdown

2016-03-26 Thread Michael Gummelt (JIRA)
Michael Gummelt created SPARK-14180: --- Summary: Deadlock in CoarseGrainedExecutorBackend Shutdown Key: SPARK-14180 URL: https://issues.apache.org/jira/browse/SPARK-14180 Project: Spark

[jira] [Commented] (SPARK-14180) Deadlock in CoarseGrainedExecutorBackend Shutdown

2016-03-26 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15213184#comment-15213184 ] Michael Gummelt commented on SPARK-14180: - cc [~zsxwing] > Deadlock in

[jira] [Commented] (SPARK-13258) --conf properties not honored in Mesos cluster mode

2016-04-04 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15224690#comment-15224690 ] Michael Gummelt commented on SPARK-13258: - [~jayv] Does your PR fix this problem? > --conf

[jira] [Updated] (SPARK-14180) Deadlock in CoarseGrainedExecutorBackend Shutdown

2016-03-28 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Gummelt updated SPARK-14180: Affects Version/s: (was: 2.0.0) > Deadlock in CoarseGrainedExecutorBackend Shutdown >

[jira] [Updated] (SPARK-14180) Deadlock in CoarseGrainedExecutorBackend Shutdown

2016-03-28 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Gummelt updated SPARK-14180: Fix Version/s: 2.0.0 > Deadlock in CoarseGrainedExecutorBackend Shutdown >

[jira] [Created] (SPARK-14822) Add lazy executor startup to Mesos Scheduler

2016-04-21 Thread Michael Gummelt (JIRA)
Michael Gummelt created SPARK-14822: --- Summary: Add lazy executor startup to Mesos Scheduler Key: SPARK-14822 URL: https://issues.apache.org/jira/browse/SPARK-14822 Project: Spark Issue

[jira] [Commented] (SPARK-14977) Fine grained mode in Mesos is not fair

2016-04-28 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15263393#comment-15263393 ] Michael Gummelt commented on SPARK-14977: - I assume your first two jobs are long running? Mesos

[jira] [Commented] (SPARK-10643) Support HDFS application download in client mode spark submit

2016-05-10 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279318#comment-15279318 ] Michael Gummelt commented on SPARK-10643: - +1 to fix this. > Support HDFS application download

[jira] [Commented] (SPARK-15271) Allow force pulling executor docker images

2016-05-12 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15281838#comment-15281838 ] Michael Gummelt commented on SPARK-15271: - Much needed, thanks. > Allow force pulling executor

[jira] [Commented] (SPARK-14977) Fine grained mode in Mesos is not fair

2016-05-05 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273202#comment-15273202 ] Michael Gummelt commented on SPARK-14977: - [~lethalman]: Fine-grained mode only release cores,

[jira] [Closed] (SPARK-14977) Fine grained mode in Mesos is not fair

2016-05-05 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Gummelt closed SPARK-14977. --- Resolution: Not A Problem > Fine grained mode in Mesos is not fair >

[jira] [Commented] (SPARK-15142) Spark Mesos dispatcher becomes unusable when the Mesos master restarts

2016-05-06 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15274445#comment-15274445 ] Michael Gummelt commented on SPARK-15142: - I can't understand this sentence. Can you reword

[jira] [Commented] (SPARK-15142) Spark Mesos dispatcher becomes unusable when the Mesos master restarts

2016-05-06 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15274447#comment-15274447 ] Michael Gummelt commented on SPARK-15142: - Can you include the dispatcher logs? Does restarting

[jira] [Commented] (SPARK-15155) Optionally ignore default role resources

2016-05-06 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15274455#comment-15274455 ] Michael Gummelt commented on SPARK-15155: - Why do you want to avoid launching on the default

[jira] [Commented] (SPARK-15155) Optionally ignore default role resources

2016-05-06 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15274491#comment-15274491 ] Michael Gummelt commented on SPARK-15155: - Yes, I understand the effect, but not the motivation.

[jira] [Commented] (SPARK-15155) Optionally ignore default role resources

2016-05-06 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15274560#comment-15274560 ] Michael Gummelt commented on SPARK-15155: - Why not create a separate role for your ad-hoc work?

[jira] [Commented] (SPARK-15155) Optionally ignore default role resources

2016-05-06 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15274682#comment-15274682 ] Michael Gummelt commented on SPARK-15155: - Just have a single role for your batch jobs if you

[jira] [Commented] (SPARK-15155) Optionally ignore default role resources

2016-05-06 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15274505#comment-15274505 ] Michael Gummelt commented on SPARK-15155: - I'm still missing the "why". What is the downside of

[jira] [Commented] (SPARK-15155) Optionally ignore default role resources

2016-05-06 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15274576#comment-15274576 ] Michael Gummelt commented on SPARK-15155: - > they will again take resources from the default role

[jira] [Created] (SPARK-16742) Kerberos support for Spark on Mesos

2016-07-26 Thread Michael Gummelt (JIRA)
Michael Gummelt created SPARK-16742: --- Summary: Kerberos support for Spark on Mesos Key: SPARK-16742 URL: https://issues.apache.org/jira/browse/SPARK-16742 Project: Spark Issue Type: New

[jira] [Commented] (SPARK-16522) [MESOS] Spark application throws exception on exit

2016-07-14 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15377353#comment-15377353 ] Michael Gummelt commented on SPARK-16522: - [~srowen] I'm going to look into this now and resolve

[jira] [Commented] (SPARK-16522) [MESOS] Spark application throws exception on exit

2016-07-14 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15378178#comment-15378178 ] Michael Gummelt commented on SPARK-16522: - I don't think so. Please give me a couple hours to

[jira] [Updated] (SPARK-16687) build/mvn fails when fetching mvn

2016-07-22 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Gummelt updated SPARK-16687: Description: mvn 3.3.3 no longer exists in the apache.org mirror used by `build/mvn`

[jira] [Created] (SPARK-16687) build/mvn fails when fetching mvn

2016-07-22 Thread Michael Gummelt (JIRA)
Michael Gummelt created SPARK-16687: --- Summary: build/mvn fails when fetching mvn Key: SPARK-16687 URL: https://issues.apache.org/jira/browse/SPARK-16687 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-16687) build/mvn fails when fetching mvn

2016-07-22 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15390014#comment-15390014 ] Michael Gummelt commented on SPARK-16687: - thanks! > build/mvn fails when fetching mvn >

[jira] [Commented] (SPARK-16450) Build failes for Mesos 0.28.x

2016-07-27 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15396236#comment-15396236 ] Michael Gummelt commented on SPARK-16450: - I'll update soon. Though this pending PR updates to

[jira] [Closed] (SPARK-16783) make-distri

2016-07-28 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Gummelt closed SPARK-16783. --- Resolution: Not A Problem > make-distri > --- > > Key: SPARK-16783 >

[jira] [Created] (SPARK-16784) Configurable log4j settings

2016-07-28 Thread Michael Gummelt (JIRA)
Michael Gummelt created SPARK-16784: --- Summary: Configurable log4j settings Key: SPARK-16784 URL: https://issues.apache.org/jira/browse/SPARK-16784 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-16783) make-distri

2016-07-28 Thread Michael Gummelt (JIRA)
Michael Gummelt created SPARK-16783: --- Summary: make-distri Key: SPARK-16783 URL: https://issues.apache.org/jira/browse/SPARK-16783 Project: Spark Issue Type: Bug Reporter:

[jira] [Created] (SPARK-16808) History Server main page does not honor APPLICATION_WEB_PROXY_BASE

2016-07-29 Thread Michael Gummelt (JIRA)
Michael Gummelt created SPARK-16808: --- Summary: History Server main page does not honor APPLICATION_WEB_PROXY_BASE Key: SPARK-16808 URL: https://issues.apache.org/jira/browse/SPARK-16808 Project:

[jira] [Created] (SPARK-16809) Link Mesos Dispatcher and History Server

2016-07-29 Thread Michael Gummelt (JIRA)
Michael Gummelt created SPARK-16809: --- Summary: Link Mesos Dispatcher and History Server Key: SPARK-16809 URL: https://issues.apache.org/jira/browse/SPARK-16809 Project: Spark Issue Type:

[jira] [Comment Edited] (SPARK-16784) Configurable log4j settings

2016-08-11 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15417857#comment-15417857 ] Michael Gummelt edited comment on SPARK-16784 at 8/11/16 8:11 PM: --

[jira] [Reopened] (SPARK-16784) Configurable log4j settings

2016-08-11 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Gummelt reopened SPARK-16784: - `log4j.debug=true` only results in log4j printing its debugging messages. It doesn't turn

[jira] [Commented] (SPARK-16784) Configurable log4j settings

2016-08-11 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15417856#comment-15417856 ] Michael Gummelt commented on SPARK-16784: - `log4j.debug=true` only results in log4j printing its

[jira] [Comment Edited] (SPARK-16784) Configurable log4j settings

2016-08-11 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15417857#comment-15417857 ] Michael Gummelt edited comment on SPARK-16784 at 8/11/16 8:10 PM: --

[jira] [Issue Comment Deleted] (SPARK-16784) Configurable log4j settings

2016-08-11 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Gummelt updated SPARK-16784: Comment: was deleted (was: `log4j.debug=true` only results in log4j printing its debugging

[jira] [Created] (SPARK-16881) Migrate Mesos configs to use ConfigEntry

2016-08-03 Thread Michael Gummelt (JIRA)
Michael Gummelt created SPARK-16881: --- Summary: Migrate Mesos configs to use ConfigEntry Key: SPARK-16881 URL: https://issues.apache.org/jira/browse/SPARK-16881 Project: Spark Issue Type:

[jira] [Updated] (SPARK-16881) Migrate Mesos configs to use ConfigEntry

2016-08-03 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Gummelt updated SPARK-16881: Description: https://github.com/apache/spark/pull/14414#discussion_r73032190 We'd like to

[jira] [Created] (SPARK-17002) Document that spark.ssl.protocol. is required for SSL

2016-08-10 Thread Michael Gummelt (JIRA)
Michael Gummelt created SPARK-17002: --- Summary: Document that spark.ssl.protocol. is required for SSL Key: SPARK-17002 URL: https://issues.apache.org/jira/browse/SPARK-17002 Project: Spark

[jira] [Commented] (SPARK-16522) [MESOS] Spark application throws exception on exit

2016-07-13 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15376125#comment-15376125 ] Michael Gummelt commented on SPARK-16522: - I've seen some stack traces recently that might have

[jira] [Commented] (SPARK-13258) --conf properties not honored in Mesos cluster mode

2016-07-13 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15375797#comment-15375797 ] Michael Gummelt commented on SPARK-13258: - Nope, this is still a bug. > --conf properties not

[jira] [Commented] (SPARK-11183) enable support for mesos 0.24+

2016-07-19 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15384520#comment-15384520 ] Michael Gummelt commented on SPARK-11183: - Hey All. I just saw this JIRA. Sorry for the delay.

[jira] [Created] (SPARK-16627) --jars doesn't work in Mesos mode

2016-07-19 Thread Michael Gummelt (JIRA)
Michael Gummelt created SPARK-16627: --- Summary: --jars doesn't work in Mesos mode Key: SPARK-16627 URL: https://issues.apache.org/jira/browse/SPARK-16627 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-16637) Support Mesos Unified Containerizer

2016-07-19 Thread Michael Gummelt (JIRA)
Michael Gummelt created SPARK-16637: --- Summary: Support Mesos Unified Containerizer Key: SPARK-16637 URL: https://issues.apache.org/jira/browse/SPARK-16637 Project: Spark Issue Type: Task

[jira] [Commented] (SPARK-16522) [MESOS] Spark application throws exception on exit

2016-07-15 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15380130#comment-15380130 ] Michael Gummelt commented on SPARK-16522: - This shouldn't affect functionality > [MESOS] Spark

[jira] [Commented] (SPARK-16450) Build failes for Mesos 0.28.x

2016-07-11 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371562#comment-15371562 ] Michael Gummelt commented on SPARK-16450: - Once Mesos 1.0 is released, I'll submit a PR to

[jira] [Commented] (SPARK-16379) Spark on mesos is broken due to race condition in Logging

2016-07-05 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363013#comment-15363013 ] Michael Gummelt commented on SPARK-16379: - I traced back the addition of the `synchronized`

[jira] [Comment Edited] (SPARK-16379) Spark on mesos is broken due to race condition in Logging

2016-07-05 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363289#comment-15363289 ] Michael Gummelt edited comment on SPARK-16379 at 7/5/16 9:34 PM: - I say

[jira] [Comment Edited] (SPARK-16379) Spark on mesos is broken due to race condition in Logging

2016-07-05 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363289#comment-15363289 ] Michael Gummelt edited comment on SPARK-16379 at 7/5/16 9:33 PM: - I say

[jira] [Comment Edited] (SPARK-16379) Spark on mesos is broken due to race condition in Logging

2016-07-05 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363289#comment-15363289 ] Michael Gummelt edited comment on SPARK-16379 at 7/5/16 9:35 PM: - I say

[jira] [Commented] (SPARK-11857) Remove Mesos fine-grained mode subject to discussions

2016-07-05 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363367#comment-15363367 ] Michael Gummelt commented on SPARK-11857: - I'll give [~amcelwee] a couple days to respond.

[jira] [Commented] (SPARK-16379) Spark on mesos is broken due to race condition in Logging

2016-07-05 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363256#comment-15363256 ] Michael Gummelt commented on SPARK-16379: - > The previous code also involved acquiring a lock

[jira] [Commented] (SPARK-16379) Spark on mesos is broken due to race condition in Logging

2016-07-05 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363258#comment-15363258 ] Michael Gummelt commented on SPARK-16379: - > The previous code also involved acquiring a lock

[jira] [Commented] (SPARK-11857) Remove Mesos fine-grained mode subject to discussions

2016-07-05 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363345#comment-15363345 ] Michael Gummelt commented on SPARK-11857: - For completeness, here's my theoretical analysis to

[jira] [Commented] (SPARK-11857) Remove Mesos fine-grained mode subject to discussions

2016-07-05 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363410#comment-15363410 ] Michael Gummelt commented on SPARK-11857: - Thanks! > Remove Mesos fine-grained mode subject to

[jira] [Commented] (SPARK-16379) Spark on mesos is broken due to race condition in Logging

2016-07-05 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363289#comment-15363289 ] Michael Gummelt commented on SPARK-16379: - I say we add a new lock to synchronize on and be done

[jira] [Commented] (SPARK-16379) Spark on mesos is broken due to race condition in Logging

2016-07-05 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363290#comment-15363290 ] Michael Gummelt commented on SPARK-16379: - Hmmm, since that's a different lock, I don't see the

[jira] [Commented] (SPARK-11857) Remove Mesos fine-grained mode subject to discussions

2016-07-05 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363311#comment-15363311 ] Michael Gummelt commented on SPARK-11857: - I endorse the deprecation. Fine-grained mode would be

[jira] [Reopened] (SPARK-11857) Remove Mesos fine-grained mode subject to discussions

2016-07-05 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Gummelt reopened SPARK-11857: - > Remove Mesos fine-grained mode subject to discussions >

[jira] [Comment Edited] (SPARK-16379) Spark on mesos is broken due to race condition in Logging

2016-07-05 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363289#comment-15363289 ] Michael Gummelt edited comment on SPARK-16379 at 7/5/16 9:31 PM: - I say

[jira] [Issue Comment Deleted] (SPARK-16379) Spark on mesos is broken due to race condition in Logging

2016-07-05 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Gummelt updated SPARK-16379: Comment: was deleted (was: > The previous code also involved acquiring a lock Link? I

[jira] [Comment Edited] (SPARK-16379) Spark on mesos is broken due to race condition in Logging

2016-07-05 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363258#comment-15363258 ] Michael Gummelt edited comment on SPARK-16379 at 7/5/16 9:15 PM: - > it's

[jira] [Commented] (SPARK-11857) Remove Mesos fine-grained mode subject to discussions

2016-07-05 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363321#comment-15363321 ] Michael Gummelt commented on SPARK-11857: - [~amcelwee] Do you have any more input on this issue.

[jira] [Created] (SPARK-16923) Mesos cluster scheduler duplicates config vars by setting them in the environment and as --conf

2016-08-05 Thread Michael Gummelt (JIRA)
Michael Gummelt created SPARK-16923: --- Summary: Mesos cluster scheduler duplicates config vars by setting them in the environment and as --conf Key: SPARK-16923 URL:

[jira] [Commented] (SPARK-12909) Spark on Mesos accessing Secured HDFS w/Kerberos

2016-08-08 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412624#comment-15412624 ] Michael Gummelt commented on SPARK-12909: - DC/OS Spark has this functionality, and we'll be

[jira] [Commented] (SPARK-11638) Run Spark on Mesos with bridge networking

2016-08-08 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412461#comment-15412461 ] Michael Gummelt commented on SPARK-11638: - [~radekg] > The only advantage we had was using the

[jira] [Created] (SPARK-16927) Mesos Cluster Dispatcher default properties

2016-08-05 Thread Michael Gummelt (JIRA)
Michael Gummelt created SPARK-16927: --- Summary: Mesos Cluster Dispatcher default properties Key: SPARK-16927 URL: https://issues.apache.org/jira/browse/SPARK-16927 Project: Spark Issue

[jira] [Commented] (SPARK-11638) Run Spark on Mesos with bridge networking

2016-08-07 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15411277#comment-15411277 ] Michael Gummelt commented on SPARK-11638: - This JIRA is complex and a lot of it is out of date.

[jira] [Commented] (SPARK-16944) [MESOS] Improve data locality when launching new executors when dynamic allocation is enabled

2016-08-07 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15411309#comment-15411309 ] Michael Gummelt commented on SPARK-16944: - Since Mesos is offer based, it's up to the Spark

[jira] [Commented] (SPARK-16944) [MESOS] Improve data locality when launching new executors when dynamic allocation is enabled

2016-08-07 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15411307#comment-15411307 ] Michael Gummelt commented on SPARK-16944: - I think we can improve both with and without dynamic

[jira] [Commented] (SPARK-16944) [MESOS] Improve data locality when launching new executors when dynamic allocation is enabled

2016-08-07 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15411315#comment-15411315 ] Michael Gummelt commented on SPARK-16944: - Yea, we typically call it "delay scheduling". It was

[jira] [Commented] (SPARK-12909) Spark on Mesos accessing Secured HDFS w/Kerberos

2016-08-09 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413999#comment-15413999 ] Michael Gummelt commented on SPARK-12909: - I agree. I just spoke with Reynold about this. I'll

[jira] [Updated] (SPARK-16522) [MESOS] Spark application throws exception on exit

2016-08-09 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Gummelt updated SPARK-16522: Fix Version/s: (was: 2.1.0) 2.0.1 > [MESOS] Spark application

[jira] [Reopened] (SPARK-16522) [MESOS] Spark application throws exception on exit

2016-08-09 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Gummelt reopened SPARK-16522: - Reopening so we can track this until it's merged into the 2.0 branch. Also changed the fix

[jira] [Commented] (SPARK-16967) Collect Mesos support code into a module/profile

2016-08-09 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414004#comment-15414004 ] Michael Gummelt commented on SPARK-16967: - Will do > Collect Mesos support code into a

[jira] [Commented] (SPARK-11714) Make Spark on Mesos honor port restrictions

2016-07-01 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15359481#comment-15359481 ] Michael Gummelt commented on SPARK-11714: - [~drcrallen] Your solution isn't exactly clear to me,

[jira] [Created] (SPARK-17067) Revocable resource support

2016-08-15 Thread Michael Gummelt (JIRA)
Michael Gummelt created SPARK-17067: --- Summary: Revocable resource support Key: SPARK-17067 URL: https://issues.apache.org/jira/browse/SPARK-17067 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-19479) Spark Mesos artifact split causes spark-core dependency to not pull in mesos impl

2017-02-06 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15855091#comment-15855091 ] Michael Gummelt commented on SPARK-19479: - Yea, sorry for the inconvenience, but I announced this

[jira] (SPARK-16742) Kerberos support for Spark on Mesos

2017-01-30 Thread Michael Gummelt (JIRA)
Title: Message Title Michael Gummelt commented on SPARK-16742

[jira] (SPARK-16742) Kerberos support for Spark on Mesos

2017-01-30 Thread Michael Gummelt (JIRA)
Title: Message Title Michael Gummelt commented on SPARK-16742

[jira] (SPARK-16784) Configurable log4j settings

2017-01-29 Thread Michael Gummelt (JIRA)
Title: Message Title Michael Gummelt updated an issue

  1   2   >