zhouyejoe opened a new pull request, #40749: URL: https://github.com/apache/spark/pull/40749
### What changes were proposed in this pull request? For push based shuffle metrics, when writting out the event to log file, the field name is ["Push Based Shuffle"](https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/util/JsonProtocol.scala#L548). But when parsing it out in SHS, the expected field name is ["Shuffle Push Read Metrics"](https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/util/JsonProtocol.scala#L1264). This mismatch makes all the push shuffle metrics 0 from SHS rest calls. ### Why are the changes needed? Without this change, all the push shuffle metrics will not be rendered correctly through SHS rest calls. ### Does this PR introduce _any_ user-facing change? No ### How was this patch tested? Launched Spark-shell application in Yarn client mode in our cluster, get the log file to local, and started a local Spark History Server to parse the log file. The metrics are shown correctly after this patch. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
