[
https://issues.apache.org/jira/browse/SPARK-4836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-4836:
----------------------------------
Labels: bulk-closed pull-request-available (was: bulk-closed)
> Web UI should display separate information for all stage attempts
> -----------------------------------------------------------------
>
> Key: SPARK-4836
> URL: https://issues.apache.org/jira/browse/SPARK-4836
> Project: Spark
> Issue Type: Bug
> Components: Web UI
> Affects Versions: 1.1.1, 1.2.0
> Reporter: Josh Rosen
> Priority: Major
> Labels: bulk-closed, pull-request-available
>
> I've run into some cases where the web UI job page will say that a job took
> 12 minutes but the sum of that job's stage times is something like 10
> seconds. In this case, it turns out that my job ran a stage to completion
> (which took, say, 5 minutes) then lost some partitions of that stage and had
> to run a new stage attempt to recompute one or two tasks from that stage. As
> a result, the latest attempt for that stage reports only one or two tasks.
> In the web UI, it seems that we only show the latest stage attempt, not all
> attempts, which can lead to confusing / misleading displays for jobs with
> failed / partially-recomputed stages.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
