[
https://issues.apache.org/jira/browse/SPARK-26342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16721997#comment-16721997
]
Yinan Li commented on SPARK-26342:
--
Yes, that's true. Feel free to create a PR to add n
[
https://issues.apache.org/jira/browse/SPARK-26290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yinan Li resolved SPARK-26290.
--
Resolution: Not A Bug
> [K8s] Driver Pods no mounted volumes on submissions from older spark versions
[
https://issues.apache.org/jira/browse/SPARK-26342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16721894#comment-16721894
]
Yinan Li commented on SPARK-26342:
--
So basically what you want is a generic way to moun
[
https://issues.apache.org/jira/browse/SPARK-26344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16721893#comment-16721893
]
Yinan Li commented on SPARK-26344:
--
This is covered by SPARK-24434, which enables using
[
https://issues.apache.org/jira/browse/SPARK-25515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yinan Li resolved SPARK-25515.
--
Resolution: Fixed
Fix Version/s: 3.0.0
> Add a config property for disabling auto deletion of P
[
https://issues.apache.org/jira/browse/SPARK-25922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16677276#comment-16677276
]
Yinan Li commented on SPARK-25922:
--
The application ID used to set the {{spark-app-sele
[
https://issues.apache.org/jira/browse/SPARK-25787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16659593#comment-16659593
]
Yinan Li commented on SPARK-25787:
--
Support for data locality on k8s has not been porte
[
https://issues.apache.org/jira/browse/SPARK-25796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16659579#comment-16659579
]
Yinan Li commented on SPARK-25796:
--
See https://issues.apache.org/jira/browse/SPARK-244
[
https://issues.apache.org/jira/browse/SPARK-24432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yinan Li updated SPARK-24432:
-
Affects Version/s: 3.0.0
> Add support for dynamic resource allocation
> ---
[
https://issues.apache.org/jira/browse/SPARK-25742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16652064#comment-16652064
]
Yinan Li commented on SPARK-25742:
--
The k8s secrets you add through the {{spark.kuberne
[
https://issues.apache.org/jira/browse/SPARK-25682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16644198#comment-16644198
]
Yinan Li commented on SPARK-25682:
--
Cool, thanks!
> Docker images generated from dev b
[
https://issues.apache.org/jira/browse/SPARK-25682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16644157#comment-16644157
]
Yinan Li commented on SPARK-25682:
--
That looks like to me the only difference. {{bin}},
[
https://issues.apache.org/jira/browse/SPARK-25500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16625404#comment-16625404
]
Yinan Li edited comment on SPARK-25500 at 9/24/18 5:51 AM:
---
We
[
https://issues.apache.org/jira/browse/SPARK-25500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16625404#comment-16625404
]
Yinan Li commented on SPARK-25500:
--
We don't plan to add more configuration properties
[
https://issues.apache.org/jira/browse/SPARK-23200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yinan Li resolved SPARK-23200.
--
Resolution: Fixed
Fix Version/s: 2.4.0
Issue resolved by pull request 22392
[https://github.com
[
https://issues.apache.org/jira/browse/SPARK-25291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yinan Li resolved SPARK-25291.
--
Resolution: Fixed
Fix Version/s: 2.4.0
> Flakiness of tests in terms of executor memory (Secret
[
https://issues.apache.org/jira/browse/SPARK-25295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yinan Li resolved SPARK-25295.
--
Resolution: Fixed
Fix Version/s: 2.4.0
> Pod names conflicts in client mode, if previous submis
[
https://issues.apache.org/jira/browse/SPARK-25295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yinan Li updated SPARK-25295:
-
Comment: was deleted
(was: We made it clear in the documentation of the Kubernetes mode at
[https://git
[
https://issues.apache.org/jira/browse/SPARK-25282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16599310#comment-16599310
]
Yinan Li commented on SPARK-25282:
--
I'm not sure this is a bug and how this should be e
[
https://issues.apache.org/jira/browse/SPARK-25295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16599308#comment-16599308
]
Yinan Li commented on SPARK-25295:
--
We made it clear in the documentation of the Kubern
[
https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16599304#comment-16599304
]
Yinan Li commented on SPARK-24434:
--
[~skonto] we can understand your feeling and frustr
[
https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16594038#comment-16594038
]
Yinan Li commented on SPARK-24434:
--
It seemed I couldn't change the assignee.
> Suppor
[
https://issues.apache.org/jira/browse/SPARK-25162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16589286#comment-16589286
]
Yinan Li commented on SPARK-25162:
--
> Where the driver is running _outside-cluster clie
[
https://issues.apache.org/jira/browse/SPARK-25194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16589283#comment-16589283
]
Yinan Li commented on SPARK-25194:
--
The upcoming Spark 2.4 gets rid of the init-contain
[
https://issues.apache.org/jira/browse/SPARK-25162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16588014#comment-16588014
]
Yinan Li commented on SPARK-25162:
--
We actually moved away from using the IP address of
[
https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16586314#comment-16586314
]
Yinan Li commented on SPARK-24434:
--
[~skonto] I will make sure the assignee gets proper
[
https://issues.apache.org/jira/browse/SPARK-25066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16576555#comment-16576555
]
Yinan Li commented on SPARK-25066:
--
R support is still being worked on and will likely
[
https://issues.apache.org/jira/browse/SPARK-24724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16560436#comment-16560436
]
Yinan Li commented on SPARK-24724:
--
Sorry haven't got a chance to look into this. What
[
https://issues.apache.org/jira/browse/SPARK-24894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16554602#comment-16554602
]
Yinan Li commented on SPARK-24894:
--
[~mcheah]. We need to make sure the truncation lead
[
https://issues.apache.org/jira/browse/SPARK-24724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yinan Li updated SPARK-24724:
-
Component/s: Kubernetes
> Discuss necessary info and access in barrier mode + Kubernetes
> -
[
https://issues.apache.org/jira/browse/SPARK-24793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16542109#comment-16542109
]
Yinan Li edited comment on SPARK-24793 at 7/12/18 7:11 PM:
---
Oh
[
https://issues.apache.org/jira/browse/SPARK-24793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16542109#comment-16542109
]
Yinan Li commented on SPARK-24793:
--
Oh, yeah, {{kill}} and {{status}} are existing opti
[
https://issues.apache.org/jira/browse/SPARK-24793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16542003#comment-16542003
]
Yinan Li commented on SPARK-24793:
--
Good points, Erik. I think
[sparkctl|https://githu
[
https://issues.apache.org/jira/browse/SPARK-24432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16540252#comment-16540252
]
Yinan Li commented on SPARK-24432:
--
No one is working on this right now, but I think fo
[
https://issues.apache.org/jira/browse/SPARK-24765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16538999#comment-16538999
]
Yinan Li commented on SPARK-24765:
--
Check out https://issues.apache.org/jira/browse/SPA
[
https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16513064#comment-16513064
]
Yinan Li commented on SPARK-24434:
--
[~skonto] Thanks! Will take a look at the design do
[
https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16499220#comment-16499220
]
Yinan Li commented on SPARK-24434:
--
[~skonto] Thanks for the detailed thoughts! I agree
[
https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16498307#comment-16498307
]
Yinan Li edited comment on SPARK-24434 at 6/1/18 5:39 PM:
--
The
[
https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16498307#comment-16498307
]
Yinan Li edited comment on SPARK-24434 at 6/1/18 5:38 PM:
--
The
[
https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16498307#comment-16498307
]
Yinan Li commented on SPARK-24434:
--
The pod template is basically a pod specification a
[
https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16496967#comment-16496967
]
Yinan Li commented on SPARK-24434:
--
[~foxish] that sounds like the approach to go.
>
[
https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16495637#comment-16495637
]
Yinan Li commented on SPARK-24434:
--
[~eje] That's a good question. I think we need to c
Yinan Li created SPARK-24434:
Summary: Support user-specified driver and executor pod templates
Key: SPARK-24434
URL: https://issues.apache.org/jira/browse/SPARK-24434
Project: Spark
Issue Type:
Yinan Li created SPARK-24433:
Summary: Add Spark R support
Key: SPARK-24433
URL: https://issues.apache.org/jira/browse/SPARK-24433
Project: Spark
Issue Type: New Feature
Components: Kub
Yinan Li created SPARK-24432:
Summary: Support for dynamic resource allocation
Key: SPARK-24432
URL: https://issues.apache.org/jira/browse/SPARK-24432
Project: Spark
Issue Type: New Feature
[
https://issues.apache.org/jira/browse/SPARK-24432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yinan Li updated SPARK-24432:
-
Summary: Add support for dynamic resource allocation (was: Support for
dynamic resource allocation)
>
[
https://issues.apache.org/jira/browse/SPARK-24122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16491338#comment-16491338
]
Yinan Li commented on SPARK-24122:
--
The operator does cover automatic restart of an appl
[
https://issues.apache.org/jira/browse/SPARK-24091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16491279#comment-16491279
]
Yinan Li commented on SPARK-24091:
--
Thanks [~tmckay]! I think the first approach is a go
[
https://issues.apache.org/jira/browse/SPARK-24383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16491106#comment-16491106
]
Yinan Li commented on SPARK-24383:
--
OK, then garbage collection should kick in and delet
[
https://issues.apache.org/jira/browse/SPARK-24383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16489942#comment-16489942
]
Yinan Li commented on SPARK-24383:
--
You can use {{kubectl get service -o=yaml}} to get
[
https://issues.apache.org/jira/browse/SPARK-24383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16489776#comment-16489776
]
Yinan Li commented on SPARK-24383:
--
Can you double check if the services have an {{Owner
[
https://issues.apache.org/jira/browse/SPARK-24383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16489601#comment-16489601
]
Yinan Li commented on SPARK-24383:
--
The Kubernetes specific submission client adds an {{
[
https://issues.apache.org/jira/browse/SPARK-24248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16477825#comment-16477825
]
Yinan Li commented on SPARK-24248:
--
Re-sync is not a fallback nor a replacement, but a c
[
https://issues.apache.org/jira/browse/SPARK-24232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16472574#comment-16472574
]
Yinan Li commented on SPARK-24232:
--
As long as we document it clearly what is for, I thi
[
https://issues.apache.org/jira/browse/SPARK-24232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16472561#comment-16472561
]
Yinan Li edited comment on SPARK-24232 at 5/11/18 7:55 PM:
---
We
[
https://issues.apache.org/jira/browse/SPARK-24232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16472561#comment-16472561
]
Yinan Li commented on SPARK-24232:
--
We should keep the current semantics of
`spark.kube
[
https://issues.apache.org/jira/browse/SPARK-24248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16471479#comment-16471479
]
Yinan Li commented on SPARK-24248:
--
I think it's both more robust and easier to implemen
[
https://issues.apache.org/jira/browse/SPARK-24248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16471288#comment-16471288
]
Yinan Li commented on SPARK-24248:
--
Just realized one thing: solely replying on the watc
[
https://issues.apache.org/jira/browse/SPARK-24248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16471259#comment-16471259
]
Yinan Li commented on SPARK-24248:
--
Actually even if the fabric8 client does not support
[
https://issues.apache.org/jira/browse/SPARK-24248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16471244#comment-16471244
]
Yinan Li commented on SPARK-24248:
--
It's potentially possible to get rid of the in-memor
[
https://issues.apache.org/jira/browse/SPARK-24137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yinan Li updated SPARK-24137:
-
Fix Version/s: (was: 2.3.1)
> [K8s] Mount temporary directories in emptydir volumes
> ---
[
https://issues.apache.org/jira/browse/SPARK-24137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yinan Li updated SPARK-24137:
-
Fix Version/s: 2.3.1
> [K8s] Mount temporary directories in emptydir volumes
> --
[
https://issues.apache.org/jira/browse/SPARK-24135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16460066#comment-16460066
]
Yinan Li edited comment on SPARK-24135 at 5/1/18 7:53 PM:
--
I agr
[
https://issues.apache.org/jira/browse/SPARK-24135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16460066#comment-16460066
]
Yinan Li commented on SPARK-24135:
--
I agree that we should add detection for initializat
[
https://issues.apache.org/jira/browse/SPARK-24137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16459900#comment-16459900
]
Yinan Li commented on SPARK-24137:
--
Yeah, {{LocalDirectoryMountConfigurationStep}} was m
[
https://issues.apache.org/jira/browse/SPARK-24135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16459892#comment-16459892
]
Yinan Li commented on SPARK-24135:
--
I think it's fine detecting and deleting the executo
[
https://issues.apache.org/jira/browse/SPARK-24091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yinan Li updated SPARK-24091:
-
Affects Version/s: (was: 2.3.0)
2.4.0
> Internally used ConfigMap prevents use
Yinan Li created SPARK-24091:
Summary: Internally used ConfigMap prevents use of user-specified
ConfigMaps carrying Spark configs files
Key: SPARK-24091
URL: https://issues.apache.org/jira/browse/SPARK-24091
[
https://issues.apache.org/jira/browse/SPARK-23638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yinan Li resolved SPARK-23638.
--
Resolution: Not A Problem
> Spark on k8s: spark.kubernetes.initContainer.image has no effect
>
[
https://issues.apache.org/jira/browse/SPARK-24028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16444899#comment-16444899
]
Yinan Li commented on SPARK-24028:
--
2.3.0 does create a configmap for the init-container
[
https://issues.apache.org/jira/browse/SPARK-24028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16444890#comment-16444890
]
Yinan Li edited comment on SPARK-24028 at 4/19/18 10:14 PM:
I
[
https://issues.apache.org/jira/browse/SPARK-24028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16444890#comment-16444890
]
Yinan Li commented on SPARK-24028:
--
I run a 1.9.6 cluster. No, I was using the 2.3.0 rel
[
https://issues.apache.org/jira/browse/SPARK-24028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16444856#comment-16444856
]
Yinan Li commented on SPARK-24028:
--
I am also running a 1.9 cluster on GKE and I have ne
[
https://issues.apache.org/jira/browse/SPARK-23638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16440067#comment-16440067
]
Yinan Li commented on SPARK-23638:
--
Can this be closed?
> Spark on k8s: spark.kubernete
[
https://issues.apache.org/jira/browse/SPARK-23638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16402070#comment-16402070
]
Yinan Li commented on SPARK-23638:
--
The Kubernetes-specific submission client will only
[
https://issues.apache.org/jira/browse/SPARK-23571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yinan Li updated SPARK-23571:
-
Affects Version/s: 2.3.1
> Delete auxiliary Kubernetes resources upon application completion
> --
Yinan Li created SPARK-23571:
Summary: Delete auxiliary Kubernetes resources upon application
completion
Key: SPARK-23571
URL: https://issues.apache.org/jira/browse/SPARK-23571
Project: Spark
Is
[
https://issues.apache.org/jira/browse/SPARK-23485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374757#comment-16374757
]
Yinan Li edited comment on SPARK-23485 at 2/23/18 6:22 PM:
---
It'
[
https://issues.apache.org/jira/browse/SPARK-23485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374757#comment-16374757
]
Yinan Li commented on SPARK-23485:
--
It's not that I'm too confident on the capability of
[
https://issues.apache.org/jira/browse/SPARK-23485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374708#comment-16374708
]
Yinan Li commented on SPARK-23485:
--
In the Yarn case, yes, it's possible that a node is
[
https://issues.apache.org/jira/browse/SPARK-23485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16373620#comment-16373620
]
Yinan Li commented on SPARK-23485:
--
The Kubernetes scheduler backend simply creates exec
[
https://issues.apache.org/jira/browse/SPARK-23485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16373544#comment-16373544
]
Yinan Li commented on SPARK-23485:
--
I'm not sure if node blacklisting applies to Kuberne
[
https://issues.apache.org/jira/browse/SPARK-23285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16357500#comment-16357500
]
Yinan Li edited comment on SPARK-23285 at 2/8/18 8:22 PM:
--
Given
[
https://issues.apache.org/jira/browse/SPARK-23285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16357500#comment-16357500
]
Yinan Li commented on SPARK-23285:
--
Given the complexity and significant impact of the c
[
https://issues.apache.org/jira/browse/SPARK-23285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16347484#comment-16347484
]
Yinan Li commented on SPARK-23285:
--
Another option is to bypass that check for Kubernete
[
https://issues.apache.org/jira/browse/SPARK-23285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16347267#comment-16347267
]
Yinan Li commented on SPARK-23285:
--
FYI: we did this in our fork:
https://github.com/ap
[
https://issues.apache.org/jira/browse/SPARK-23257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16345488#comment-16345488
]
Yinan Li commented on SPARK-23257:
--
[~RJKeevil] AFAIK, no one is working on upstreaming
Yinan Li created SPARK-23153:
Summary: Support application dependencies in submission client's
local file system
Key: SPARK-23153
URL: https://issues.apache.org/jira/browse/SPARK-23153
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-22962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16331132#comment-16331132
]
Yinan Li commented on SPARK-22962:
--
I agree that before we upstream the staging server,
[
https://issues.apache.org/jira/browse/SPARK-23137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16329713#comment-16329713
]
Yinan Li commented on SPARK-23137:
--
It's actually marked as an \{{internal}} config prop
Yinan Li created SPARK-22998:
Summary: Value for SPARK_MOUNTED_CLASSPATH in executor pods is not
set
Key: SPARK-22998
URL: https://issues.apache.org/jira/browse/SPARK-22998
Project: Spark
Issue
Yinan Li created SPARK-22953:
Summary: Duplicated secret volumes in Spark pods when
init-containers are used
Key: SPARK-22953
URL: https://issues.apache.org/jira/browse/SPARK-22953
Project: Spark
Yinan Li created SPARK-22839:
Summary: Refactor Kubernetes code for configuring driver/executor
pods to use consistent and cleaner abstraction
Key: SPARK-22839
URL: https://issues.apache.org/jira/browse/SPARK-22839
[
https://issues.apache.org/jira/browse/SPARK-22778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16289907#comment-16289907
]
Yinan Li commented on SPARK-22778:
--
Just verified that the fix worked. I'm gonna send a
[
https://issues.apache.org/jira/browse/SPARK-22778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16289876#comment-16289876
]
Yinan Li commented on SPARK-22778:
--
Ah, yes, the PR missed that. OK, I'm gonna give that
[
https://issues.apache.org/jira/browse/SPARK-22778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16289822#comment-16289822
]
Yinan Li edited comment on SPARK-22778 at 12/13/17 8:24 PM:
J
[
https://issues.apache.org/jira/browse/SPARK-22778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16289822#comment-16289822
]
Yinan Li commented on SPARK-22778:
--
Just some background on this. The validation and par
[
https://issues.apache.org/jira/browse/SPARK-18278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yinan Li updated SPARK-18278:
-
Component/s: Kubernetes
> SPIP: Support native submission of spark jobs to a kubernetes cluster
> ---
[
https://issues.apache.org/jira/browse/SPARK-22757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16289378#comment-16289378
]
Yinan Li commented on SPARK-22757:
--
Yes, this is also targeting 2.3.
> Init-container
[
https://issues.apache.org/jira/browse/SPARK-22757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yinan Li updated SPARK-22757:
-
Component/s: Kubernetes
> Init-container in the driver/executor pods for downloading remote dependencies
1 - 100 of 107 matches
Mail list logo
