nsivabalan commented on PR #6815: URL: https://github.com/apache/hudi/pull/6815#issuecomment-1260479656
hey Alexey. I am not sure if we can completely remove the reuse flag. for eg, even within the lifespan of a commit, when the writeClient started, the tableMetadata is instantiated ... and then index lookup, partitioner and then write to actual write (by executors). in preCommit, we do conflict resolution. So, even if we have not refreshed the hoodie timeline so far(implicitly file readers from metadata table ), we need to refresh it here to get the latest data. Vinoth was involved while designing the reuse flag. CC @prasannarajaperumal @vinothchandar -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
