Github user ssaavedra commented on the issue:
https://github.com/apache/spark/pull/19469
The one I submitted here https://issues.apache.org/jira/browse/SPARK-22294
is not kubernetes-related as such, although it does affect deployments in
Kubernetes. It should affect any spark-submit done with a custom bindAddress.
But yes, there might be a k8s-related config at some point, just like there
is specific configuration for YARN already.
But the currently proposed PRs are just bugs caught at some point by other
PRs. Maybe they should be merged and then a more general architecture can be
proposed? This way we'll have all the properties known to need reloading
already in the code before refactoring.
Is there anything we should know about structured streaming in regards to
checkpoints?
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
