ScrapCodes commented on pull request #28423: URL: https://github.com/apache/spark/pull/28423#issuecomment-658153445
> > BTW, when do we receive a version changed from K8s? > > It happens when etcd compaction kicks in for example. On aws EKS I never saw this happening on EKS 1.14, but it happens roughly every hour on EKS 1.15. Meaning that longer spark application continued working but the watch failed. Okay makes sense, thank you for explaining. I am wondering how useful is the watch for longer running jobs, for example all it reports is that jobs is running, completed or errored. Probably, spark ui is more informative. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
