[GitHub] [spark] ScrapCodes commented on pull request #28423: [SPARK-24266][k8s] Restart the watcher when we receive a version changed from k8s

2020-07-14 Thread GitBox
ScrapCodes commented on pull request #28423: URL: https://github.com/apache/spark/pull/28423#issuecomment-658153445 > > BTW, when do we receive a version changed from K8s? > > It happens when etcd compaction kicks in for example. On aws EKS I never saw this happening on EKS 1.14, but

[GitHub] [spark] ScrapCodes commented on pull request #28423: [SPARK-24266][k8s] Restart the watcher when we receive a version changed from k8s

2020-07-14 Thread GitBox
ScrapCodes commented on pull request #28423: URL: https://github.com/apache/spark/pull/28423#issuecomment-658117892 > @ScrapCodes the code in the 2.4.x is significantly different from the code here. But we can reuse the same idea as here. I guess it has to be a new PR Currently the J

[GitHub] [spark] ScrapCodes commented on pull request #28423: [SPARK-24266][k8s] Restart the watcher when we receive a version changed from k8s

2020-07-14 Thread GitBox
ScrapCodes commented on pull request #28423: URL: https://github.com/apache/spark/pull/28423#issuecomment-658117121 BTW, when do we receive a version changed from K8s? This is an automated message from the Apache Git Service.

[GitHub] [spark] ScrapCodes commented on pull request #28423: [SPARK-24266][k8s] Restart the watcher when we receive a version changed from k8s

2020-07-14 Thread GitBox
ScrapCodes commented on pull request #28423: URL: https://github.com/apache/spark/pull/28423#issuecomment-658115916 Hi Folks @dongjoon-hyun and @holdenk, do we plan to include this patch in 2.4.7 release? This is an