boneanxs edited a comment on issue #5107: URL: https://github.com/apache/hudi/issues/5107#issuecomment-1077280474
Yes, I also notice `AvroSerializer` is a very time consuming method(clustering's poor performance also because of this, it needs to serialize to avro twice), I'm afraid it is not easy to optimize this in hudi side. Maybe one solution is hudi fully support using Dataset not RDD, which can avoid using avroSerializer to parse data. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
