Spenserrrr opened a new pull request, #59025: URL: https://github.com/apache/spark/pull/59025
### What changes were proposed in this pull request? Use the later of the current task start and Python worker boot timestamps as the initialization accounting boundary. Add regression coverage for an idle reused worker's boot, initialization, and total SQL metrics. ### Why are the changes needed? A reused worker records its boot timestamp before waiting for the next task, so its idle time can be included in initialization even though total worker time starts with the current task. ### Does this PR introduce _any_ user-facing change? Yes. Python worker timing metrics exclude pre-task idle time for reused workers, while fresh-worker calculations remain unchanged. ### How was this patch tested? `PythonUDFSuite` passed all 17 tests, and the new regression test fails with the old calculation when initialization exceeds total worker time; Scalastyle and the pre-push Python checks also passed. ### Was this patch authored or co-authored using generative AI tooling? Generated-by: OpenAI Codex (GPT-6) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
