Timothy Chen created SPARK-25960:
Summary: Support subpath mounting with Kubernetes
Key: SPARK-25960
URL: https://issues.apache.org/jira/browse/SPARK-25960
Project: Spark
Issue Type: New
Timothy Chen created SPARK-25148:
Summary: Executors launched with Spark on K8s client mode should
prefix name with spark.app.name
Key: SPARK-25148
URL: https://issues.apache.org/jira/browse/SPARK-25148
[
https://issues.apache.org/jira/browse/SPARK-23953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Timothy Chen resolved SPARK-23953.
--
Resolution: Invalid
> Add get_json_scalar function
>
>
>
Timothy Chen created SPARK-23953:
Summary: Add get_json_scalar function
Key: SPARK-23953
URL: https://issues.apache.org/jira/browse/SPARK-23953
Project: Spark
Issue Type: New Feature
Timothy Chen created SPARK-19320:
Summary: Allow guaranteed amount of GPU to be used when launching
jobs
Key: SPARK-19320
URL: https://issues.apache.org/jira/browse/SPARK-19320
Project: Spark
Timothy Chen created SPARK-14645:
Summary: non local Python resource doesn't work with Mesos cluster
mode
Key: SPARK-14645
URL: https://issues.apache.org/jira/browse/SPARK-14645
Project: Spark
Timothy Chen created SPARK-14082:
Summary: Add support for GPU resource when running on Mesos
Key: SPARK-14082
URL: https://issues.apache.org/jira/browse/SPARK-14082
Project: Spark
Issue
Timothy Chen created SPARK-13414:
Summary: Add support for launching multiple Mesos dispatchers
Key: SPARK-13414
URL: https://issues.apache.org/jira/browse/SPARK-13414
Project: Spark
Issue
Timothy Chen created SPARK-13387:
Summary: Add support for SPARK_DAEMON_JAVA_OPTS with
MesosClusterDispatcher.
Key: SPARK-13387
URL: https://issues.apache.org/jira/browse/SPARK-13387
Project: Spark
Timothy Chen created SPARK-12892:
Summary: Support plugging in Spark scheduler
Key: SPARK-12892
URL: https://issues.apache.org/jira/browse/SPARK-12892
Project: Spark
Issue Type: Improvement
Timothy Chen created SPARK-12465:
Summary: Remove spark.deploy.mesos.zookeeper.dir and use
spark.deploy.zookeeper.dir
Key: SPARK-12465
URL: https://issues.apache.org/jira/browse/SPARK-12465
Project:
Timothy Chen created SPARK-12464:
Summary: Remove spark.deploy.mesos.zookeeper.url and use
spark.deploy.zookeeper.url
Key: SPARK-12464
URL: https://issues.apache.org/jira/browse/SPARK-12464
Project:
Timothy Chen created SPARK-12463:
Summary: Remove spark.deploy.mesos.recoveryMode and use
spark.deploy.recoveryMode
Key: SPARK-12463
URL: https://issues.apache.org/jira/browse/SPARK-12463
Project:
Timothy Chen created SPARK-12351:
Summary: Add documentation of submitting Mesos jobs with cluster
Key: SPARK-12351
URL: https://issues.apache.org/jira/browse/SPARK-12351
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-12351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Timothy Chen updated SPARK-12351:
-
Description:
Add more documentation around how to launch spark drivers with Mesos cluster
mode
Timothy Chen created SPARK-10749:
Summary: Support multiple roles with Spark Mesos dispatcher
Key: SPARK-10749
URL: https://issues.apache.org/jira/browse/SPARK-10749
Project: Spark
Issue
Timothy Chen created SPARK-10748:
Summary: Log error instead of crashing Spark Mesos dispatcher when
a job is misconfigured
Key: SPARK-10748
URL: https://issues.apache.org/jira/browse/SPARK-10748
[
https://issues.apache.org/jira/browse/SPARK-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14737453#comment-14737453
]
Timothy Chen commented on SPARK-9503:
-
Sorry this is indeed a bug and a fix is already in 1.5.
Please
Timothy Chen created SPARK-10313:
Summary: Support HA stateful driver on Mesos cluster mode
Key: SPARK-10313
URL: https://issues.apache.org/jira/browse/SPARK-10313
Project: Spark
Issue Type:
Timothy Chen created SPARK-10160:
Summary: Support Spark shell over Mesos Cluster Mode
Key: SPARK-10160
URL: https://issues.apache.org/jira/browse/SPARK-10160
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-10161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Timothy Chen updated SPARK-10161:
-
Component/s: (was: Spark Shell)
PySpark
Support Pyspark shell over Mesos
Timothy Chen created SPARK-10161:
Summary: Support Pyspark shell over Mesos Cluster Mode
Key: SPARK-10161
URL: https://issues.apache.org/jira/browse/SPARK-10161
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-10161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Timothy Chen updated SPARK-10161:
-
Description:
It's not possible to run Pyspark shell with cluster mode since the shell that
is
Timothy Chen created SPARK-10124:
Summary: Mesos cluster mode causes exception when multiple spark
apps are being scheduled
Key: SPARK-10124
URL: https://issues.apache.org/jira/browse/SPARK-10124
[
https://issues.apache.org/jira/browse/SPARK-10124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Timothy Chen updated SPARK-10124:
-
Target Version/s: 1.5.1
Mesos cluster mode causes exception when multiple spark apps are being
[
https://issues.apache.org/jira/browse/SPARK-10124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Timothy Chen updated SPARK-10124:
-
Target Version/s: 1.5.0 (was: 1.5.1)
Mesos cluster mode causes exception when multiple spark
[
https://issues.apache.org/jira/browse/SPARK-10124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Timothy Chen updated SPARK-10124:
-
Component/s: Mesos
Mesos cluster mode causes exception when multiple spark apps are being
Timothy Chen created SPARK-9873:
---
Summary: Cap the amount of executors launched in Mesos fine grain
mode
Key: SPARK-9873
URL: https://issues.apache.org/jira/browse/SPARK-9873
Project: Spark
Timothy Chen created SPARK-9708:
---
Summary: Spark should create local temporary directories in Mesos
sandbox when launched with Mesos
Key: SPARK-9708
URL: https://issues.apache.org/jira/browse/SPARK-9708
[
https://issues.apache.org/jira/browse/SPARK-7876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Timothy Chen resolved SPARK-7876.
-
Resolution: Fixed
Make Spark UI content paths non absolute paths
[
https://issues.apache.org/jira/browse/SPARK-7876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Timothy Chen resolved SPARK-7876.
-
Resolution: Fixed
Make Spark UI content paths non absolute paths
[
https://issues.apache.org/jira/browse/SPARK-7962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Timothy Chen closed SPARK-7962.
---
Mesos cluster mode is broken
Key: SPARK-7962
[
https://issues.apache.org/jira/browse/SPARK-7876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Timothy Chen reopened SPARK-7876:
-
Make Spark UI content paths non absolute paths
--
Timothy Chen created SPARK-9669:
---
Summary: Support PySpark with Mesos Cluster mode
Key: SPARK-9669
URL: https://issues.apache.org/jira/browse/SPARK-9669
Project: Spark
Issue Type: Improvement
Timothy Chen created SPARK-9575:
---
Summary: Add documentation around Mesos shuffle service and
dynamic allocation
Key: SPARK-9575
URL: https://issues.apache.org/jira/browse/SPARK-9575
Project: Spark
Timothy Chen created SPARK-8873:
---
Summary: Support cleaning up shuffle files for drivers launched
with Mesos
Key: SPARK-8873
URL: https://issues.apache.org/jira/browse/SPARK-8873
Project: Spark
Timothy Chen created SPARK-8798:
---
Summary: Allow additional uris to be fetched with mesos
Key: SPARK-8798
URL: https://issues.apache.org/jira/browse/SPARK-8798
Project: Spark
Issue Type: Bug
Timothy Chen created SPARK-8083:
---
Summary: Fix return to drivers link in Mesos driver page
Key: SPARK-8083
URL: https://issues.apache.org/jira/browse/SPARK-8083
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-7962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Timothy Chen updated SPARK-7962:
Summary: Rest submission client prepends extra spark:// for non standalone
master urls (was: est
Timothy Chen created SPARK-7962:
---
Summary: est submission client prepends extra spark:// for
Key: SPARK-7962
URL: https://issues.apache.org/jira/browse/SPARK-7962
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-7962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Timothy Chen updated SPARK-7962:
Component/s: Spark Submit
Rest submission client prepends extra spark:// for non standalone master
Timothy Chen created SPARK-7876:
---
Summary: Make Spark UI content paths non absolute paths
Key: SPARK-7876
URL: https://issues.apache.org/jira/browse/SPARK-7876
Project: Spark
Issue Type:
Timothy Chen created SPARK-7877:
---
Summary: Support non-persistent cluster mode
Key: SPARK-7877
URL: https://issues.apache.org/jira/browse/SPARK-7877
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-7831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556382#comment-14556382
]
Timothy Chen commented on SPARK-7831:
-
Hi Luc, actually that's the default behavior
Timothy Chen created SPARK-7373:
---
Summary: Support launching Spark drivers in Docker images with
Mesos cluster mode
Key: SPARK-7373
URL: https://issues.apache.org/jira/browse/SPARK-7373
Project: Spark
Timothy Chen created SPARK-7216:
---
Summary: Show driver details in Mesos cluster UI
Key: SPARK-7216
URL: https://issues.apache.org/jira/browse/SPARK-7216
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-6284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357180#comment-14357180
]
Timothy Chen commented on SPARK-6284:
-
https://github.com/apache/spark/pull/4960
Timothy Chen created SPARK-6284:
---
Summary: Support framework authentication and role in Mesos
framework
Key: SPARK-6284
URL: https://issues.apache.org/jira/browse/SPARK-6284
Project: Spark
Timothy Chen created SPARK-6081:
---
Summary: DriverRunner doesn't support pulling HTTP/HTTPS URIs
Key: SPARK-6081
URL: https://issues.apache.org/jira/browse/SPARK-6081
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-2628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Timothy Chen closed SPARK-2628.
---
Resolution: Won't Fix
Mesos backend throwing unable to find LoginModule
[
https://issues.apache.org/jira/browse/SPARK-2628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14327978#comment-14327978
]
Timothy Chen commented on SPARK-2628:
-
Seems like this is fixed post 1.0.4, somewhere
[
https://issues.apache.org/jira/browse/SPARK-5338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14294264#comment-14294264
]
Timothy Chen commented on SPARK-5338:
-
Started a doc to begin the design of this, will
[
https://issues.apache.org/jira/browse/SPARK-5338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Timothy Chen updated SPARK-5338:
Component/s: Mesos
Support cluster mode with Mesos
---
Timothy Chen created SPARK-5338:
---
Summary: Support cluster mode with Mesos
Key: SPARK-5338
URL: https://issues.apache.org/jira/browse/SPARK-5338
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-5095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14276094#comment-14276094
]
Timothy Chen commented on SPARK-5095:
-
[~joshdevins][~maasg]
I have a PR out now, I
[
https://issues.apache.org/jira/browse/SPARK-5095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14273244#comment-14273244
]
Timothy Chen commented on SPARK-5095:
-
[~joshdevins] [~gmaas] indeed capping the cores
[
https://issues.apache.org/jira/browse/SPARK-3619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14266459#comment-14266459
]
Timothy Chen commented on SPARK-3619:
-
[~jongyoul] please go ahead!
Upgrade to Mesos
[
https://issues.apache.org/jira/browse/SPARK-5095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14265796#comment-14265796
]
Timothy Chen commented on SPARK-5095:
-
I think instead of configuring the number of
[
https://issues.apache.org/jira/browse/SPARK-4940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14265802#comment-14265802
]
Timothy Chen commented on SPARK-4940:
-
So I assume you're specifiying coarse grain
[
https://issues.apache.org/jira/browse/SPARK-4940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Timothy Chen updated SPARK-4940:
Summary: Support more evenly distributing cores for Mesos mode (was:
Document or Support more
[
https://issues.apache.org/jira/browse/SPARK-5095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Timothy Chen updated SPARK-5095:
Description:
Currently in coarse grained mesos mode, it's expected that we only launch one
Mesos
Timothy Chen created SPARK-5095:
---
Summary: Support launching multiple mesos executors in coarse
grained mesos mode
Key: SPARK-5095
URL: https://issues.apache.org/jira/browse/SPARK-5095
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-5095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Timothy Chen updated SPARK-5095:
Component/s: Mesos
Support launching multiple mesos executors in coarse grained mesos mode
[
https://issues.apache.org/jira/browse/SPARK-4940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14258570#comment-14258570
]
Timothy Chen commented on SPARK-4940:
-
Potentially I think there are two ways to help
[
https://issues.apache.org/jira/browse/SPARK-4940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14258571#comment-14258571
]
Timothy Chen commented on SPARK-4940:
-
[~gmaas]
Document or Support more evenly
Timothy Chen created SPARK-4940:
---
Summary: Document or Support more evenly distributing cores for
Mesos mode
Key: SPARK-4940
URL: https://issues.apache.org/jira/browse/SPARK-4940
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-4286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Timothy Chen updated SPARK-4286:
Description:
With the new external shuffle service added, we need to also make the Mesos
Timothy Chen created SPARK-4286:
---
Summary: Support External Shuffle Service with Mesos integration
Key: SPARK-4286
URL: https://issues.apache.org/jira/browse/SPARK-4286
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-4286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Timothy Chen updated SPARK-4286:
Component/s: Mesos
Support External Shuffle Service with Mesos integration
[
https://issues.apache.org/jira/browse/SPARK-4286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14201312#comment-14201312
]
Timothy Chen commented on SPARK-4286:
-
Please assign to me, thanks.
Support External
[
https://issues.apache.org/jira/browse/SPARK-2616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Timothy Chen closed SPARK-2616.
---
Resolution: Fixed
SPARK-3619 is going to update to 0.21
Update Mesos to 0.19.1
[
https://issues.apache.org/jira/browse/SPARK-3619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14160436#comment-14160436
]
Timothy Chen commented on SPARK-3619:
-
I can do this, please assign it to me
Upgrade
[
https://issues.apache.org/jira/browse/SPARK-3619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14160437#comment-14160437
]
Timothy Chen commented on SPARK-3619:
-
[~matei]
Upgrade to Mesos 0.21 to work around
Timothy Chen created SPARK-3817:
---
Summary: BlockManagerMasterActor: Got two different block manager
registrations with Mesos
Key: SPARK-3817
URL: https://issues.apache.org/jira/browse/SPARK-3817
[
https://issues.apache.org/jira/browse/SPARK-2691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14149833#comment-14149833
]
Timothy Chen commented on SPARK-2691:
-
[~tstclair] sounds great! The integration
[
https://issues.apache.org/jira/browse/SPARK-2022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14117581#comment-14117581
]
Timothy Chen commented on SPARK-2022:
-
This should be resolved now,
[
https://issues.apache.org/jira/browse/SPARK-2921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14101383#comment-14101383
]
Timothy Chen commented on SPARK-2921:
-
This should be all addressed by the PR from the
[
https://issues.apache.org/jira/browse/SPARK-2022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14077109#comment-14077109
]
Timothy Chen commented on SPARK-2022:
-
Github PR:
Timothy Chen created SPARK-2691:
---
Summary: Allow Spark on Mesos to be launched with Docker
Key: SPARK-2691
URL: https://issues.apache.org/jira/browse/SPARK-2691
Project: Spark
Issue Type:
Timothy Chen created SPARK-2616:
---
Summary: Update Mesos to 0.19.1
Key: SPARK-2616
URL: https://issues.apache.org/jira/browse/SPARK-2616
Project: Spark
Issue Type: Improvement
Timothy Chen created SPARK-2628:
---
Summary: Mesos backend throwing unable to find LoginModule
Key: SPARK-2628
URL: https://issues.apache.org/jira/browse/SPARK-2628
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-2628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070826#comment-14070826
]
Timothy Chen commented on SPARK-2628:
-
[~pwendell] please assign to me, thanks!
[
https://issues.apache.org/jira/browse/SPARK-2628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Timothy Chen updated SPARK-2628:
Component/s: Mesos
Mesos backend throwing unable to find LoginModule
[
https://issues.apache.org/jira/browse/SPARK-2022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069508#comment-14069508
]
Timothy Chen commented on SPARK-2022:
-
this seems duplicate of SPARK-2020
Spark
[
https://issues.apache.org/jira/browse/SPARK-2269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14066879#comment-14066879
]
Timothy Chen commented on SPARK-2269:
-
Created a PR for this:
[
https://issues.apache.org/jira/browse/SPARK-872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14065703#comment-14065703
]
Timothy Chen commented on SPARK-872:
I'm not quite understanding your statement where
[
https://issues.apache.org/jira/browse/SPARK-1702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14065706#comment-14065706
]
Timothy Chen commented on SPARK-1702:
-
The PR is merged and closed already, is this
[
https://issues.apache.org/jira/browse/SPARK-1764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14065709#comment-14065709
]
Timothy Chen commented on SPARK-1764:
-
I'm not sure how this is related to Mesos, is
88 matches
Mail list logo
