steveloughran commented on PR #8118: URL: https://github.com/apache/hadoop/pull/8118#issuecomment-3611639133
> wondering if we should add a config to control this though I don't want to add another config option to doc/test/maintain. Now, ContainerCredentialsProvider has a hard coded time -look at `prefetchTime()` to see its logic, which is `minimum(oneHourFromNow, fifteenMinutesBeforeExpiration)`. It's doing a 15 minute advance fetch. So maybe 60s is too premature. 5 minutes? gives each thread a lot of time to backoff: if they haven't got credentials by then then they are part of a thundering herd and not going to recover at all. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
