Github user saturday-shi commented on the issue:
https://github.com/apache/spark/pull/18230
@jerryshao Sorry for the delay.
Currently, Spark checkpoint ALL the configurations no matter it is
"internal" or not. So we have to reload ones that should be updated at
launching. Probably not to checkpoint the "internal" ones may be a good idea,
but it is much like a new feature than a bug fix.
This PR attempt to fix the bug at least changing of codes, so it'll be
easily merged into any maintenance branches. I don't care adding more options
into the exclude-list, but you'll have to do an extra work to cherry-pick a
subset for branches before 2.1, as `spark.yarn.credentials.renewalTime` and
`spark.yarn.credentials.updateTime` don't exist in old branches.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
