GitHub user smurakozi opened a pull request:
https://github.com/apache/spark/pull/20251
[Spark-23051][core] Fix for broken job description in Spark UI
## What changes were proposed in this pull request?
In 2.2, Spark UI displayed the stage description if the job description was
not set. This functionality was broken, the GUI has shown no description in
this case. In addition, the code uses jobName and
jobDescription instead of stageName and stageDescription when
JobTableRowData is created.
In this PR the logic producing values for the job rows was modified to find
the latest stage attempt for the job and use that as a fallback if job
description was missing.
StageName and stageDescription are also set using values from stage and
jobName/description is used only as a fallback.
## How was this patch tested?
Manual testing of the UI, using the code in the bug report.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/smurakozi/spark SPARK-23051
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/20251.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #20251
----
commit 0412c4b959b42cb0b41c669593e689430da59ec2
Author: Sandor Murakozi <smurakozi@...>
Date: 2018-01-12T15:10:24Z
Fix for SPARK-23051
commit 937e0fd579a7f133f860eb6f572f50ad7d7fdf89
Author: Sandor Murakozi <smurakozi@...>
Date: 2018-01-12T15:25:44Z
fixed logic determining jobDescription
commit df41000d99eef3b609ece4b072c5aee0650c21f1
Author: Sandor Murakozi <smurakozi@...>
Date: 2018-01-12T15:51:06Z
Formatted code
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
