[jira] [Commented] (SPARK-27696) kubernetes driver pod not deleted after finish.

2020-02-17 Thread Henry Yu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17038778#comment-17038778 ] Henry Yu commented on SPARK-27696: -- Too muck un deleted pod will lead to Etcd heavy pressure. we have

[jira] [Updated] (SPARK-28022) k8s pod affinity to achieve cloud native friendly autoscaling

2019-06-13 Thread Henry Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Yu updated SPARK-28022: - Summary: k8s pod affinity to achieve cloud native friendly autoscaling (was: k8s pod affinity achieve

[jira] [Updated] (SPARK-27997) kubernetes client token expired

2019-06-12 Thread Henry Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Yu updated SPARK-27997: - Description: Hi , when I try to submit spark to k8s in cluster mode, I need an authtoken to talk with

[jira] [Updated] (SPARK-28022) k8s pod affinity achieve cloud native friendly autoscaling

2019-06-12 Thread Henry Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Yu updated SPARK-28022: - Description: Hi, in order to achieve cloud native friendly autoscaling , I propose to add a pod

[jira] [Updated] (SPARK-28022) k8s pod affinity achieve cloud native friendly autoscaling

2019-06-12 Thread Henry Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Yu updated SPARK-28022: - Description: Hi, in order to achieve cloud native friendly autoscaling , I propose to add a pod

[jira] [Updated] (SPARK-28022) k8s pod affinity achieve cloud native friendly autoscaling

2019-06-12 Thread Henry Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Yu updated SPARK-28022: - Summary: k8s pod affinity achieve cloud native friendly autoscaling (was: k8s pod affinity achieve

[jira] [Updated] (SPARK-27997) kubernetes client token expired

2019-06-12 Thread Henry Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Yu updated SPARK-27997: - Shepherd: Dongjoon Hyun > kubernetes client token expired > > >

[jira] [Updated] (SPARK-28022) k8s pod affinity achieve cloud native friendly auto scaling

2019-06-12 Thread Henry Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Yu updated SPARK-28022: - Description: Hi, in order to achieve cloud native friendly autoscaling , I propose to add a pod

[jira] [Updated] (SPARK-28022) k8s pod affinity achieve cloud native friendly auto scaling

2019-06-12 Thread Henry Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Yu updated SPARK-28022: - Description: Hi, in order to achieve cloud native friendly autoscaling , I propose to add a pod

[jira] [Updated] (SPARK-28022) k8s pod affinity achieve cloud native friendly auto scaling

2019-06-12 Thread Henry Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Yu updated SPARK-28022: - Description: Hi, in order to achieve cloud native friendly autoscaling , I propose to add a pod

[jira] [Updated] (SPARK-28022) k8s pod affinity achieve cloud native friendly auto scaling

2019-06-12 Thread Henry Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Yu updated SPARK-28022: - Description: Hi, in order to achieve cloud native friendly autoscaling , I propose to add a pod

[jira] [Updated] (SPARK-28022) k8s pod affinity achieve cloud native friendly auto scaling

2019-06-12 Thread Henry Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Yu updated SPARK-28022: - Description: Hi, in order to achieve cloud native friendly autoscaling , I propose to add a pod

[jira] [Updated] (SPARK-28022) k8s pod affinity achieve cloud native friendly auto scaling

2019-06-12 Thread Henry Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Yu updated SPARK-28022: - Description: Hi, in order to achieve cloud native friendly autoscaling , I propose to add a pod

[jira] [Created] (SPARK-28022) k8s pod affinity achieve cloud native friendly auto scaling

2019-06-12 Thread Henry Yu (JIRA)
Henry Yu created SPARK-28022: Summary: k8s pod affinity achieve cloud native friendly auto scaling Key: SPARK-28022 URL: https://issues.apache.org/jira/browse/SPARK-28022 Project: Spark Issue

[jira] [Commented] (SPARK-27812) kubernetes client import non-daemon thread which block jvm exit.

2019-06-11 Thread Henry Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16861728#comment-16861728 ] Henry Yu commented on SPARK-27812: -- OK [~dongjoon] > kubernetes client import non-daemon thread which

[jira] [Commented] (SPARK-27812) kubernetes client import non-daemon thread which block jvm exit.

2019-06-10 Thread Henry Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16860580#comment-16860580 ] Henry Yu commented on SPARK-27812: -- So, any other idea to fix it? or I will try to make pr with the 

[jira] [Created] (SPARK-27997) kubernetes client token expired

2019-06-10 Thread Henry Yu (JIRA)
Henry Yu created SPARK-27997: Summary: kubernetes client token expired Key: SPARK-27997 URL: https://issues.apache.org/jira/browse/SPARK-27997 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-27812) kubernetes client import non-daemon thread which block jvm exit.

2019-06-09 Thread Henry Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16859710#comment-16859710 ] Henry Yu edited comment on SPARK-27812 at 6/10/19 5:55 AM: --- In our private

[jira] [Commented] (SPARK-27697) KubernetesClientApplication alway exit with 0

2019-06-09 Thread Henry Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16859717#comment-16859717 ] Henry Yu commented on SPARK-27697: -- @[~dongjoon] I fix it by adding a pod phase judgement . If driver

[jira] [Commented] (SPARK-27812) kubernetes client import non-daemon thread which block jvm exit.

2019-06-09 Thread Henry Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16859712#comment-16859712 ] Henry Yu commented on SPARK-27812: -- According to Okhttp Committer 

[jira] [Commented] (SPARK-27812) kubernetes client import non-daemon thread which block jvm exit.

2019-06-09 Thread Henry Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16859710#comment-16859710 ] Henry Yu commented on SPARK-27812: -- In our private branch, I fix this and potential non-daemon thread

[jira] [Created] (SPARK-27812) kubernetes client import non-daemon thread which block jvm exit.

2019-05-23 Thread Henry Yu (JIRA)
Henry Yu created SPARK-27812: Summary: kubernetes client import non-daemon thread which block jvm exit. Key: SPARK-27812 URL: https://issues.apache.org/jira/browse/SPARK-27812 Project: Spark

[jira] [Commented] (SPARK-27705) kubernetes integration test break on osx when test PVTestsSuite

2019-05-23 Thread Henry Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16846458#comment-16846458 ] Henry Yu commented on SPARK-27705: -- [~dongjoon] That's great! Could you make a pr?  And I find spark

[jira] [Updated] (SPARK-27705) kubernetes integration test break on osx when test PVTestsSuite

2019-05-14 Thread Henry Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Yu updated SPARK-27705: - Priority: Minor (was: Major) > kubernetes integration test break on osx when test PVTestsSuite >

[jira] [Created] (SPARK-27705) kubernetes integration test break on osx when test PVTestsSuite

2019-05-14 Thread Henry Yu (JIRA)
Henry Yu created SPARK-27705: Summary: kubernetes integration test break on osx when test PVTestsSuite Key: SPARK-27705 URL: https://issues.apache.org/jira/browse/SPARK-27705 Project: Spark

[jira] [Updated] (SPARK-27696) kubernetes driver pod not deleted after finish.

2019-05-14 Thread Henry Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Yu updated SPARK-27696: - Priority: Minor (was: Major) > kubernetes driver pod not deleted after finish. >

[jira] [Updated] (SPARK-27697) KubernetesClientApplication alway exit with 0

2019-05-14 Thread Henry Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Yu updated SPARK-27697: - Priority: Minor (was: Major) > KubernetesClientApplication alway exit with 0 >

[jira] [Created] (SPARK-27697) KubernetesClientApplication alway exit with 0

2019-05-14 Thread Henry Yu (JIRA)
Henry Yu created SPARK-27697: Summary: KubernetesClientApplication alway exit with 0 Key: SPARK-27697 URL: https://issues.apache.org/jira/browse/SPARK-27697 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-27696) kubernetes driver pod not deleted after finish.

2019-05-14 Thread Henry Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Yu updated SPARK-27696: - Description: When submit to k8s, driver pod not deleted after job completion.  While k8s checks driver

[jira] [Created] (SPARK-27696) kubernetes driver pod not deleted after finish.

2019-05-14 Thread Henry Yu (JIRA)
Henry Yu created SPARK-27696: Summary: kubernetes driver pod not deleted after finish. Key: SPARK-27696 URL: https://issues.apache.org/jira/browse/SPARK-27696 Project: Spark Issue Type: Bug