[ https://issues.apache.org/jira/browse/SPARK-2501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14062950#comment-14062950 ]
Patrick Wendell commented on SPARK-2501: ---------------------------------------- Our handling of stage re-submissions is broken in the UI. For instance, I looked in the JobProgressListener and we index many things on StageId that might better be indexed on StageId, AttemptId. Also, we should probably give the AttemptId when start a task so that we understand which stage attempt to associated it with. I also don't understand exactly what happens when a stage gets re-attempted, do we send a "stage completed" event? It might be good to fix the way we deal with stage re-submissions to make this work better overall. > Handle stage re-submissions properly in the UI > ---------------------------------------------- > > Key: SPARK-2501 > URL: https://issues.apache.org/jira/browse/SPARK-2501 > Project: Spark > Issue Type: Bug > Components: Web UI > Reporter: Patrick Wendell > Assignee: Masayoshi TSUZUKI > Priority: Critical > -- This message was sent by Atlassian JIRA (v6.2#6252)