Github user skonto commented on a diff in the pull request:
https://github.com/apache/spark/pull/22392#discussion_r218002553
--- Diff:
streaming/src/main/scala/org/apache/spark/streaming/Checkpoint.scala ---
@@ -54,6 +54,10 @@ class Checkpoint(ssc: StreamingContext, val
checkpointTime: Time)
"spark.driver.bindAddress",
"spark.driver.port",
"spark.master",
+ "spark.kubernetes.driver.pod.name",
+ "spark.kubernetes.driver.limit.cores",
+ "spark.kubernetes.executor.limit.cores",
--- End diff --
Are there any other properties that need to be restored beyond that?
How about `spark.kubernetes.allocation.batch.size` ,
`spark.kubernetes.executor.lostCheck.maxAttempts`
`spark.kubernetes.report.interval`
`spark.kubernetes.executor.eventProcessingInterval`?
Also there are several other properties for Python and R, listed in the
[config](https://github.com/apache/spark/blob/master/resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Config.scala).
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
