[ https://issues.apache.org/jira/browse/SPARK-28751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Xianyang Liu updated SPARK-28751: --------------------------------- Description: Improve the performance of java serializer deserialization by caching the resolved class. Java serializer is used in many places: closure, RPC and others. This change could improve the performance of deserialization 1.3X ~ 1.5X. Especially for java primitive instances. And also, add new UT tests and benchmarks case. was: ### What changes were proposed in this pull request? Improve the performance of java serializer deserialization by caching the resolved class. Java serializer is used in many places: closure, RPC and others. This change could improve the performance of deserialization 1.3X ~ 1.5X. Especially for java primitive instances. And also, add new UT tests and benchmarks case. ### Why are the changes needed? This change could improve the performance of deserialization 1.3X ~ 1.5X. Especially for java primitive instances. ### Does this PR introduce any user-facing change? Add new config to enable disable this feature, default is true. This shouldn't influence the existed code. ### How was this patch tested? New UT tests. > Imporve java serializer deserialization performance > --------------------------------------------------- > > Key: SPARK-28751 > URL: https://issues.apache.org/jira/browse/SPARK-28751 > Project: Spark > Issue Type: Improvement > Components: Spark Core > Affects Versions: 2.4.3 > Reporter: Xianyang Liu > Priority: Major > > Improve the performance of java serializer deserialization by caching the > resolved class. Java serializer is used in many places: closure, RPC and > others. This change could improve the performance of deserialization 1.3X ~ > 1.5X. Especially for java primitive instances. > And also, add new UT tests and benchmarks case. -- This message was sent by Atlassian JIRA (v7.6.14#76016) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org