[
https://issues.apache.org/jira/browse/SPARK-23146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anirudh Ramanathan updated SPARK-23146:
---
Issue Type: New Feature (was: Improvement)
> Support client mode for Kubernetes
Anirudh Ramanathan created SPARK-23146:
--
Summary: Support client mode for Kubernetes cluster backend
Key: SPARK-23146
URL: https://issues.apache.org/jira/browse/SPARK-23146
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-23137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16329731#comment-16329731
]
Anirudh Ramanathan commented on SPARK-23137:
Looks like consensus is - we can get rid of the
[
https://issues.apache.org/jira/browse/SPARK-23137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16329717#comment-16329717
]
Anirudh Ramanathan commented on SPARK-23137:
Good point - I think the option is useful, but
Anirudh Ramanathan created SPARK-23137:
--
Summary: spark.kubernetes.executor.podNamePrefix is ignored
Key: SPARK-23137
URL: https://issues.apache.org/jira/browse/SPARK-23137
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-23016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16329675#comment-16329675
]
Anirudh Ramanathan commented on SPARK-23016:
Works as expected with port forwarding in my
[
https://issues.apache.org/jira/browse/SPARK-23104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16329621#comment-16329621
]
Anirudh Ramanathan commented on SPARK-23104:
[~sameerag], this is a docs-only change, will
[
https://issues.apache.org/jira/browse/SPARK-23104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16329608#comment-16329608
]
Anirudh Ramanathan commented on SPARK-23104:
Thanks for opening this - is this simply a
Anirudh Ramanathan created SPARK-23136:
--
Summary: Mark packages as experimental
Key: SPARK-23136
URL: https://issues.apache.org/jira/browse/SPARK-23136
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-23016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anirudh Ramanathan updated SPARK-23016:
---
Priority: Minor (was: Major)
> Spark UI access and documentation
>
[
https://issues.apache.org/jira/browse/SPARK-19700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anirudh Ramanathan updated SPARK-19700:
---
Issue Type: Improvement (was: Bug)
> Design an API for pluggable scheduler
[
https://issues.apache.org/jira/browse/SPARK-23083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16326711#comment-16326711
]
Anirudh Ramanathan commented on SPARK-23083:
opened
[
https://issues.apache.org/jira/browse/SPARK-23083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16326631#comment-16326631
]
Anirudh Ramanathan commented on SPARK-23083:
Thanks. I'll create a PR against that repo.
Anirudh Ramanathan created SPARK-23083:
--
Summary: Adding Kubernetes as an option to
https://spark.apache.org/
Key: SPARK-23083
URL: https://issues.apache.org/jira/browse/SPARK-23083
Project:
Anirudh Ramanathan created SPARK-23067:
--
Summary: Allow for easier debugging of the docker container
Key: SPARK-23067
URL: https://issues.apache.org/jira/browse/SPARK-23067
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-23063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324917#comment-16324917
]
Anirudh Ramanathan commented on SPARK-23063:
This is likely something to be updated in
Anirudh Ramanathan created SPARK-23063:
--
Summary: Changes to publish the spark-kubernetes package
Key: SPARK-23063
URL: https://issues.apache.org/jira/browse/SPARK-23063
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-23016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319412#comment-16319412
]
Anirudh Ramanathan commented on SPARK-23016:
cc/ [~mccheah]
> Spark UI access and
Anirudh Ramanathan created SPARK-23016:
--
Summary: Spark UI access and documentation
Key: SPARK-23016
URL: https://issues.apache.org/jira/browse/SPARK-23016
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-22853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319119#comment-16319119
]
Anirudh Ramanathan commented on SPARK-22853:
It turns out this was a Kubernetes community
[
https://issues.apache.org/jira/browse/SPARK-23010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anirudh Ramanathan updated SPARK-23010:
---
Summary: Add integration testing for Kubernetes backend into the
apache/spark
Anirudh Ramanathan created SPARK-23010:
--
Summary: Add integration
Key: SPARK-23010
URL: https://issues.apache.org/jira/browse/SPARK-23010
Project: Spark
Issue Type: Sub-task
Anirudh Ramanathan created SPARK-22992:
--
Summary: Remove assumption of cluster domain in Kubernetes mode
Key: SPARK-22992
URL: https://issues.apache.org/jira/browse/SPARK-22992
Project: Spark
Anirudh Ramanathan created SPARK-22866:
--
Summary: Kubernetes dockerfile path needs update
Key: SPARK-22866
URL: https://issues.apache.org/jira/browse/SPARK-22866
Project: Spark
Issue
Anirudh Ramanathan created SPARK-22865:
--
Summary: Publish Official Apache Spark Docker images
Key: SPARK-22865
URL: https://issues.apache.org/jira/browse/SPARK-22865
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-22647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anirudh Ramanathan resolved SPARK-22647.
Resolution: Fixed
> Docker files for image creation
>
[
https://issues.apache.org/jira/browse/SPARK-22647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300810#comment-16300810
]
Anirudh Ramanathan commented on SPARK-22647:
The dockerfiles themselves have been checked in
[
https://issues.apache.org/jira/browse/SPARK-22853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300434#comment-16300434
]
Anirudh Ramanathan commented on SPARK-22853:
The CNCF owns the trademark for Kubernetes but
Anirudh Ramanathan created SPARK-22853:
--
Summary: K8s or Kubernetes?
Key: SPARK-22853
URL: https://issues.apache.org/jira/browse/SPARK-22853
Project: Spark
Issue Type: Sub-task
Anirudh Ramanathan created SPARK-22845:
--
Summary: Modify spark.kubernetes.allocation.batch.delay to take
time instead of int
Key: SPARK-22845
URL: https://issues.apache.org/jira/browse/SPARK-22845
[
https://issues.apache.org/jira/browse/SPARK-22842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anirudh Ramanathan updated SPARK-22842:
---
Priority: Minor (was: Critical)
> Support consuming oauth token and certs through
Anirudh Ramanathan created SPARK-22842:
--
Summary: Support consuming oauth token and certs through
environment variables
Key: SPARK-22842
URL: https://issues.apache.org/jira/browse/SPARK-22842
[
https://issues.apache.org/jira/browse/SPARK-22647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16294759#comment-16294759
]
Anirudh Ramanathan commented on SPARK-22647:
[~wangyang] libc6-compat is in there now. Can
[
https://issues.apache.org/jira/browse/SPARK-22807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anirudh Ramanathan updated SPARK-22807:
---
Summary: Change configuration options to use "container" instead of
"docker" (was:
Anirudh Ramanathan created SPARK-22807:
--
Summary: Change commandline options to use "container" instead of
"docker"
Key: SPARK-22807
URL: https://issues.apache.org/jira/browse/SPARK-22807
[
https://issues.apache.org/jira/browse/SPARK-22647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16292113#comment-16292113
]
Anirudh Ramanathan commented on SPARK-22647:
I think we haven't run that particular
[
https://issues.apache.org/jira/browse/SPARK-22778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16289881#comment-16289881
]
Anirudh Ramanathan commented on SPARK-22778:
Excellent - thanks for the quick debug Matt. Now
[
https://issues.apache.org/jira/browse/SPARK-22778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16289868#comment-16289868
]
Anirudh Ramanathan edited comment on SPARK-22778 at 12/13/17 8:41 PM:
[
https://issues.apache.org/jira/browse/SPARK-22778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16289868#comment-16289868
]
Anirudh Ramanathan commented on SPARK-22778:
I've verified that the image contains the right
[
https://issues.apache.org/jira/browse/SPARK-22778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16289818#comment-16289818
]
Anirudh Ramanathan edited comment on SPARK-22778 at 12/13/17 8:23 PM:
[
https://issues.apache.org/jira/browse/SPARK-22778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16289818#comment-16289818
]
Anirudh Ramanathan commented on SPARK-22778:
I submitted it as `k8s://https://xx.yy.zz.ww` to
[
https://issues.apache.org/jira/browse/SPARK-22778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anirudh Ramanathan updated SPARK-22778:
---
Description:
Building images based on master and deploying Spark PI results in the
[
https://issues.apache.org/jira/browse/SPARK-22778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16289808#comment-16289808
]
Anirudh Ramanathan commented on SPARK-22778:
[~mcheah] [~kimoonkim] [~ifilonenko] PTAL
>
[
https://issues.apache.org/jira/browse/SPARK-22778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anirudh Ramanathan updated SPARK-22778:
---
Summary: Kubernetes scheduler at master failing to run applications
successfully.
[
https://issues.apache.org/jira/browse/SPARK-22778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anirudh Ramanathan updated SPARK-22778:
---
Summary: Kubernetes scheduler at master failing to run applications
successfully
Anirudh Ramanathan created SPARK-22778:
--
Summary: Kubernetes scheduler at master failing tests
Key: SPARK-22778
URL: https://issues.apache.org/jira/browse/SPARK-22778
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-22647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16289805#comment-16289805
]
Anirudh Ramanathan commented on SPARK-22647:
[~mcheah] [~erikerlandson] PTAL
> Docker files
[
https://issues.apache.org/jira/browse/SPARK-22777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anirudh Ramanathan updated SPARK-22777:
---
Description:
Default docker images built thrown an error when trying to run on a
[
https://issues.apache.org/jira/browse/SPARK-22777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anirudh Ramanathan updated SPARK-22777:
---
Description:
Default docker images built thrown an error when trying to run on a
[
https://issues.apache.org/jira/browse/SPARK-22777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anirudh Ramanathan updated SPARK-22777:
---
Description:
Default docker images built thrown an error when trying to run on a
[
https://issues.apache.org/jira/browse/SPARK-22777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anirudh Ramanathan updated SPARK-22777:
---
Description:
Default docker images built thrown an error when trying to run on a
[
https://issues.apache.org/jira/browse/SPARK-22777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16289795#comment-16289795
]
Anirudh Ramanathan edited comment on SPARK-22777 at 12/13/17 8:02 PM:
[
https://issues.apache.org/jira/browse/SPARK-22777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anirudh Ramanathan updated SPARK-22777:
---
[~liyinan926] [~ssuchter]
> Docker container built for Kubernetes doesn't allow running
Anirudh Ramanathan created SPARK-22777:
--
Summary: Docker container built for Kubernetes doesn't allow
running entrypoint.sh
Key: SPARK-22777
URL: https://issues.apache.org/jira/browse/SPARK-22777
Anirudh Ramanathan created SPARK-22648:
--
Summary: Documentation for Kubernetes Scheduler Backend
Key: SPARK-22648
URL: https://issues.apache.org/jira/browse/SPARK-22648
Project: Spark
Anirudh Ramanathan created SPARK-22647:
--
Summary: Docker files for image creation
Key: SPARK-22647
URL: https://issues.apache.org/jira/browse/SPARK-22647
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-22646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anirudh Ramanathan updated SPARK-22646:
---
Description: The submission client is responsible for creating the
Kubernetes pod
Anirudh Ramanathan created SPARK-22646:
--
Summary: Spark on Kubernetes - basic submission client
Key: SPARK-22646
URL: https://issues.apache.org/jira/browse/SPARK-22646
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-22645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anirudh Ramanathan updated SPARK-22645:
---
Summary: Add Scheduler Backend with static allocation of executors (was:
Add
Anirudh Ramanathan created SPARK-22645:
--
Summary: Add Kubernetes Scheduler Backend
Key: SPARK-22645
URL: https://issues.apache.org/jira/browse/SPARK-22645
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-22645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anirudh Ramanathan resolved SPARK-22645.
Resolution: Fixed
Fixed by https://github.com/apache/spark/pull/19468
> Add
[
https://issues.apache.org/jira/browse/SPARK-18278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16183960#comment-16183960
]
Anirudh Ramanathan edited comment on SPARK-18278 at 9/28/17 10:17 AM:
[
https://issues.apache.org/jira/browse/SPARK-18278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16183960#comment-16183960
]
Anirudh Ramanathan commented on SPARK-18278:
An update on the plan -
2 days ago, we cut
[
https://issues.apache.org/jira/browse/SPARK-18278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16158100#comment-16158100
]
Anirudh Ramanathan commented on SPARK-18278:
The plan is to support k8s features (beta/GA) in
[
https://issues.apache.org/jira/browse/SPARK-18278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anirudh Ramanathan updated SPARK-18278:
---
Attachment: SPARK-18278 Spark on Kubernetes Design Proposal Revision 2
(1).pdf
[
https://issues.apache.org/jira/browse/SPARK-18278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anirudh Ramanathan updated SPARK-18278:
---
Summary: SPIP: Support native submission of spark jobs to a kubernetes
cluster
[
https://issues.apache.org/jira/browse/SPARK-18278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111546#comment-16111546
]
Anirudh Ramanathan edited comment on SPARK-18278 at 8/2/17 7:11 PM:
[
https://issues.apache.org/jira/browse/SPARK-18278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111546#comment-16111546
]
Anirudh Ramanathan commented on SPARK-18278:
FYI: sandflee's question was addressed in
[
https://issues.apache.org/jira/browse/SPARK-18278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15718478#comment-15718478
]
Anirudh Ramanathan commented on SPARK-18278:
There is a way to use a standard image that
[
https://issues.apache.org/jira/browse/SPARK-18662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anirudh Ramanathan updated SPARK-18662:
---
External issue URL: https://github.com/apache/spark/pull/16092
> Move cluster
Anirudh Ramanathan created SPARK-18662:
--
Summary: Move cluster managers into their own sub-directory
Key: SPARK-18662
URL: https://issues.apache.org/jira/browse/SPARK-18662
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-18278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15637602#comment-15637602
]
Anirudh Ramanathan commented on SPARK-18278:
Corresponding issue in kubernetes:
101 - 172 of 172 matches
Mail list logo