Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/14728 For the definition of `maxAge`, currently from the code it is max age to latest file, people may misunderstand it is max age to current time, so it would be better to document the meaning. Another concern is that this patch changes the `MetadataLog` format, which will break upgrade compatibility, also user with old metadata log existed will encounter exception when using new code.
--- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org