dbtsai commented on issue #26085: [SPARK-29434][Core] Improve the MapStatuses Serialization Performance URL: https://github.com/apache/spark/pull/26085#issuecomment-545168597 Agree, this PR already speeds up the serialization a bit, and unblocks our use-case. I was initially thinking to add another configuration, but also feel we have too many tuning parameters in Spark now. Let's see what other people think, and if they need to make it faster, we can consider the option to make it configurable. Thanks.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
