ABHISHEK KUMAR GUPTA created SPARK-25698:
--------------------------------------------
Summary: spark live UI shows wrong completed Job Message
Key: SPARK-25698
URL: https://issues.apache.org/jira/browse/SPARK-25698
Project: Spark
Issue Type: Bug
Components: Web UI
Affects Versions: 2.3.2
Reporter: ABHISHEK KUMAR GUPTA
1. spark.ui.retainedJobs = 100000 in Spark-default conf of JDBC and Job History
2. Restart Job History and JDBC Server
3. Run beeline jobs
4. Open Live UI from Yarn Resource page and click on RUNNING application link
5. Click on the Application Master of JDBC running application ID
6. Message display as Completed Jobs ( XXX, Showing YYY )
*Note*
Here XXX is always less than YYY( sometime difference is of 2 Jobs or sometime
5 Jobs )
Also Number of completed jobs are less than the configured value of
spark.ui.retainedJobs
7. Now open the Job History UI Page
8. Click on the application ID from Incomplete Application and Launch Jobs
Page, Value of the completed Jobs shows Completed Jobs( XXX)
Issue is to handle why in Live UI and Job History UI, the Message of
completed Job is different for running application.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
