Jinhua Fu created SPARK-20591:
---------------------------------
Summary: Succeeded tasks num not equal in job page and job detail
page on spark web ui when speculative task(s) exist
Key: SPARK-20591
URL: https://issues.apache.org/jira/browse/SPARK-20591
Project: Spark
Issue Type: Improvement
Components: Web UI
Affects Versions: 2.0.2
Reporter: Jinhua Fu
when spark.speculation is enabled,and there are some speculative tasks, then we
can see succeeded tasks num include speculative tasks on the job page, which
however not being included on the job detail page(job stages page).
When I consider some tasks may run a little slow by the job page's succeeded
tasks more than total tasks,which make me want to known which tasks and why,I
have to check every stage to find the speculative tasks which is beacause
speculative tasks not being included in the stage succeeded task num.
Can it be improved?
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
