[
https://issues.apache.org/jira/browse/SPARK-20591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16002686#comment-16002686
]
Apache Spark commented on SPARK-20591:
--------------------------------------
User 'fjh100456' has created a pull request for this issue:
https://github.com/apache/spark/pull/17923
> Succeeded tasks num not equal in job page and job detail page on spark web ui
> when speculative task(s) exist
> ------------------------------------------------------------------------------------------------------------
>
> Key: SPARK-20591
> URL: https://issues.apache.org/jira/browse/SPARK-20591
> Project: Spark
> Issue Type: Bug
> Components: Web UI
> Affects Versions: 2.0.2
> Reporter: Jinhua Fu
> Priority: Minor
> Attachments: job detail page(stages).png, job page.png
>
>
> when spark.speculation is enabled,and there are some speculative tasks, then
> we can see succeeded tasks num include speculative tasks on the job page,
> which however not being included on the job detail page(job stages page).
> When I consider some tasks may run a little slow by the job page's succeeded
> tasks more than total tasks,which make me want to known which tasks and why,I
> have to check every stage to find the speculative tasks which is beacause
> speculative tasks not being included in the stage succeeded task num.
> Can it be improved?
> update two screenshots, succeeded task num is 557 on job page,but 550(by sum)
> on job detail page(stages),the extra 7 tasks are speculative tasks.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
