GitHub user KaiXinXiaoLei opened a pull request:
https://github.com/apache/spark/pull/12059
[SPARK-14265] Get attempId of stage and transfer it to web
## What changes were proposed in this pull request?
if a stage is failed and attempt to start again, DAG visualization does not
render correctly for this stage. Because in spark-dag-viz.js, the link of stage
is ("#stage-" + stageId + "-" + attemptId), and the value of attemptId is 0 .
So I think the attemptId of stage sholike this: stageopening spark web, the
attemptId of stage should be transfer to web, and make the link of ("#stage-"
+ stageId + "-" + attemptId) is correct.
## How was this patch tested?
Please test as fellow. Run spark app, and kill executor to make stage
reSubmitted. Then check DAG visualization in web.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/KaiXinXiaoLei/spark changeType
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/12059.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #12059
----
commit 1a541960452bbdf9da58d31e65e91d1a2cc58d66
Author: KaiXinXiaoLei <huleil...@huawei.com>
Date: 2016-03-30T08:19:18Z
change attemptID
commit 2e975b64913c6572585339d2c780bcfb8a010c5a
Author: KaiXinXiaoLei <huleil...@huawei.com>
Date: 2016-03-30T08:20:27Z
get attempID
commit 6faf63dead512a08ba6529c9db4ce2ae351a3e82
Author: KaiXinXiaoLei <huleil...@huawei.com>
Date: 2016-03-30T08:22:47Z
add onStageSubmitted event
commit 71bebd693db9874a941bbb7b8f0fa528ddfd506b
Author: KaiXinXiaoLei <huleil...@huawei.com>
Date: 2016-03-30T08:24:11Z
get attempID
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
