ConeyLiu opened a new pull request #25470: [SPARK-28751][Core] Imporve java serializer deserialization performance URL: https://github.com/apache/spark/pull/25470 ### What changes were proposed in this pull request? Improve the performance of java serializer deserialization by caching the resolved class. Java serializer is used in many places: closure, RPC and others. This change could improve the performance of deserialization 1.3X ~ 1.5X. Especially for java primitive instances. And also, add new UT tests and benchmarks case. ### Why are the changes needed? This change could improve the performance of deserialization 1.3X ~ 1.5X. Especially for java primitive instances. ### Does this PR introduce any user-facing change? Add new config to enable disable this feature, default is true. This shouldn't influence the existed code. ### How was this patch tested? New UT tests.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
