LXin96 commented on PR #12580: URL: https://github.com/apache/hudi/pull/12580#issuecomment-2574586443
@danny0405 nice to get reply. yes, when table just left one shot, and the shot has many inputsplits, then once a inputsplit close, a split delay will get and use (now - splitlatestcommit). Of course, when the table's produce job is a flink job, and it cp interval is half an hour, down stream job read slow, then use (now - latestcommit) may bigger than the (issued instant - splitlatestcommit). so hope the reader operator may hold a variable to record the max issued instant and use (maxLatestcommitTime - splitlatestcommit) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
