[
https://issues.apache.org/jira/browse/SPARK-15155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15275057#comment-15275057
]
Chris Heller commented on SPARK-15155:
--
At present, Spark will accept resources from both the
[
https://issues.apache.org/jira/browse/SPARK-15155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15274613#comment-15274613
]
Chris Heller commented on SPARK-15155:
--
My point is that each time I add another Spark cluster to
[
https://issues.apache.org/jira/browse/SPARK-15155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15274570#comment-15274570
]
Chris Heller commented on SPARK-15155:
--
Some of that ad-hoc work being other Spark jobs, they will
[
https://issues.apache.org/jira/browse/SPARK-15155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15274523#comment-15274523
]
Chris Heller commented on SPARK-15155:
--
The downside for me is that I have two long running
[
https://issues.apache.org/jira/browse/SPARK-15155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15274493#comment-15274493
]
Chris Heller commented on SPARK-15155:
--
In my specific case I am running multiple spark clusters on
[
https://issues.apache.org/jira/browse/SPARK-15155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15274461#comment-15274461
]
Chris Heller edited comment on SPARK-15155 at 5/6/16 5:58 PM:
--
Under the
[
https://issues.apache.org/jira/browse/SPARK-15155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15274461#comment-15274461
]
Chris Heller commented on SPARK-15155:
--
Under the current implementation Spark will consider both
[
https://issues.apache.org/jira/browse/SPARK-15155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Heller updated SPARK-15155:
-
Description:
SPARK-6284 added support for Mesos roles, but the framework will still accept
[
https://issues.apache.org/jira/browse/SPARK-15155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Heller updated SPARK-15155:
-
Summary: Optionally ignore default role resources (was: Selectively accept
Mesos resources by
[
https://issues.apache.org/jira/browse/SPARK-15155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15272227#comment-15272227
]
Chris Heller commented on SPARK-15155:
--
I have started work on an implementation targeting the
Chris Heller created SPARK-15155:
Summary: Selectively accept Mesos resources by role
Key: SPARK-15155
URL: https://issues.apache.org/jira/browse/SPARK-15155
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-10854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15268635#comment-15268635
]
Chris Heller commented on SPARK-10854:
--
I wanted to bump this issue. I'm running into it from time
[
https://issues.apache.org/jira/browse/SPARK-11638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14999554#comment-14999554
]
Chris Heller commented on SPARK-11638:
--
Can't wait to try this out. +1
> Apache Spark in Docker
[
https://issues.apache.org/jira/browse/SPARK-8734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935043#comment-14935043
]
Chris Heller commented on SPARK-8734:
-
I agree on the goal. Without a total redesign of the Spark
[
https://issues.apache.org/jira/browse/SPARK-8734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14933353#comment-14933353
]
Chris Heller commented on SPARK-8734:
-
For something like marathon, it models parameters as a list of
[
https://issues.apache.org/jira/browse/SPARK-8734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14933193#comment-14933193
]
Chris Heller commented on SPARK-8734:
-
This approach eliminates the ability to pass values into the
[
https://issues.apache.org/jira/browse/SPARK-8734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14909541#comment-14909541
]
Chris Heller commented on SPARK-8734:
-
That's unfortunate the issue with the hash map. Embedding a
[
https://issues.apache.org/jira/browse/SPARK-8734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14907952#comment-14907952
]
Chris Heller commented on SPARK-8734:
-
Responsibilities have sort of pulled me away from focusing on
[
https://issues.apache.org/jira/browse/SPARK-8734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908050#comment-14908050
]
Chris Heller commented on SPARK-8734:
-
I pushed up to my branch some code for the parameters. Though
[
https://issues.apache.org/jira/browse/SPARK-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903260#comment-14903260
]
Chris Heller commented on SPARK-9442:
-
Curious if the issue seen here was with a parquet file created
[
https://issues.apache.org/jira/browse/SPARK-8734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14610289#comment-14610289
]
Chris Heller commented on SPARK-8734:
-
I've started work on this @
[
https://issues.apache.org/jira/browse/SPARK-2691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14608748#comment-14608748
]
Chris Heller commented on SPARK-2691:
-
Only a limited set of options were exposed in
Chris Heller created SPARK-8734:
---
Summary: Expose all Mesos DockerInfo options to Spark
Key: SPARK-8734
URL: https://issues.apache.org/jira/browse/SPARK-8734
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-8734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14608760#comment-14608760
]
Chris Heller commented on SPARK-8734:
-
This work will enhance the features added to
[
https://issues.apache.org/jira/browse/SPARK-8734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Heller updated SPARK-8734:
Priority: Minor (was: Major)
Expose all Mesos DockerInfo options to Spark
[
https://issues.apache.org/jira/browse/SPARK-8737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Heller closed SPARK-8737.
---
Resolution: Duplicate
One thing to note about --net, I believe Spark may have issues when running in
[
https://issues.apache.org/jira/browse/SPARK-2691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14608935#comment-14608935
]
Chris Heller commented on SPARK-2691:
-
I had already created SPARK-8734 to track this,
Chris Heller created SPARK-5964:
---
Summary: Allow spark-daemon.sh to support foreground operation
Key: SPARK-5964
URL: https://issues.apache.org/jira/browse/SPARK-5964
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-2691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14204764#comment-14204764
]
Chris Heller edited comment on SPARK-2691 at 11/10/14 1:28 PM:
[
https://issues.apache.org/jira/browse/SPARK-2691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14204764#comment-14204764
]
Chris Heller commented on SPARK-2691:
-
Just an update. I've been working on this patch
[
https://issues.apache.org/jira/browse/SPARK-2691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Heller updated SPARK-2691:
Attachment: spark-docker.patch
Here is the patch for the changes needed to support docker images in
[
https://issues.apache.org/jira/browse/SPARK-2691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194513#comment-14194513
]
Chris Heller edited comment on SPARK-2691 at 11/3/14 1:08 PM:
--
[
https://issues.apache.org/jira/browse/SPARK-2691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194632#comment-14194632
]
Chris Heller commented on SPARK-2691:
-
That seems reasonable. In fact, the volumes
[
https://issues.apache.org/jira/browse/SPARK-2691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194637#comment-14194637
]
Chris Heller commented on SPARK-2691:
-
+1 on passing in environment. great idea.
[
https://issues.apache.org/jira/browse/SPARK-2691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194679#comment-14194679
]
Chris Heller commented on SPARK-2691:
-
Ok here is the patch as a PR:
[
https://issues.apache.org/jira/browse/SPARK-2691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14190372#comment-14190372
]
Chris Heller commented on SPARK-2691:
-
This issue seems to have stalled out, but it is
36 matches
Mail list logo
