boneanxs commented on PR #9875: URL: https://github.com/apache/hudi/pull/9875#issuecomment-1770132874
Agree with @wecharyu that this pr should not use extra driver memory than before, we don't need to revert it. In this method, obtaining fileStatus only happens in executor side, and executors will return partition paths to driver, which is exactly like before. @xuzifu666 Appreciate it if you could provide more details to help us track it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
