geserdugarov commented on PR #12796: URL: https://github.com/apache/hudi/pull/12796#issuecomment-2655439736
> Thank you for this optimization. Given that @danny0405 and @cshuo have proposed RFC-88, let's include this optimization as a subtask within the RFC. Please, check this comment under RFC-88, where I've tried to described why RFC-88 and RFC-84 are different tasks: https://github.com/apache/hudi/pull/12795#issuecomment-2655363635 We shouldn't add any abstraction for optimized serde until we get writers. Otherwise, we wouldn't reach significant performance increase. RFC-88 is focused on processing records in writers. This RFC-84 is focused on passing data from source to writers as fast as possible. And, I suppose, @cshuo , author of RFC-88, thinks the same: https://github.com/apache/hudi/pull/12795#issuecomment-2641752043. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
