Spenserrrr opened a new pull request, #59019: URL: https://github.com/apache/spark/pull/59019
### What changes were proposed in this pull request? Add a bounded, length-prefixed JSON frame for named Python worker metrics when the JVM advertises protocol v1. Keep the existing four-value timing frame for older peers and preserve the binary spill trailer. ### Why are the changes needed? The positional timing frame cannot carry additional worker metrics without another fixed-format protocol change. Named entries with units let the worker add measurements while each JVM consumer validates the values it uses. ### Does this PR introduce _any_ user-facing change? No. The existing SQL timing metrics keep their current values and names. ### How was this patch tested? Focused Python worker-metrics, Scala decoder, and SQL UDF tests passed, including live RDD and Arrow worker paths. ### Was this patch authored or co-authored using generative AI tooling? Generated-by: OpenAI Codex (GPT-6) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
