pengbo opened a new pull request #24460: [SPARK-27565][SQL][Web UI]: Show job info of WholeStageCodegen node on SparkSQL UI page URL: https://github.com/apache/spark/pull/24460 ## What changes were proposed in this pull request? Currently it's really hard to link SQL plan to Spark jobs on SparkSQL UI page. When one job failed, which `PhysicalPlan` nodes are involved are difficult to be located. This PR is to show the job info of `WholeStageCodegen` node on SparkSQL UI page to make life easier. Each `WholeStageCodegen` node has a task metric `PIPELINE_DURATION_METRIC` which records the total duration time shown in the top right. The idea is to put the job info into its metric value during metric aggregation.  ## How was this patch tested? Existing tests & new test has been added
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
