Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/17937
@victor-wong can you please update the PR title like other PRs?
By seeing your description, seems the log is from old Spark version, in the
latest Spark there's no `ExecutorDelegationTokenUpdater` and it has renamed to
`CredentialUpdater`, also `CredentialUpdater` will not update the credential
immediately at start, it is controlled by `spark.yarn.credentials.updateTime`.
Can you please check if your problem still exists in latest master code, also
what exception will be met?
Also I would guess some more internal configurations should be excluded
from checkpoint, like "spark.yarn.credentials.renewalTime",
"spark.yarn.credentials.updateTime".
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
