zhouyifan279 commented on PR #40645: URL: https://github.com/apache/spark/pull/40645#issuecomment-1495658982
> I understand what you aim to achieve in this PR. In case of K8s Cluster Mode, the driver pod has a driver `ConfigMap` containing `spark.app.submitTime` already. So, you want to keep that. However, this is not safe because of the timezone between the user machine and the K8s control plane server. > > If we want to propose this improvement to include the driver pod pending time, we need to add a configuration to control this feature, @zhouyifan279 . Could you try to add a configuration and add an integration test case too? @dongjoon-hyun Can you elaborate about how timezone affects the computed driver pod pending time. As I understand, both `spark.app.submitTime` and `spark.app.startTime` is milliseconds between the current time and midnight, January 1, 1970 UTC. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
