GitHub user KaiXinXiaoLei opened a pull request:
https://github.com/apache/spark/pull/12059
[SPARK-14265] Get attempId of stage and transfer it to web
## What changes were proposed in this pull request?
if a stage is failed and attempt to start again, DAG visualization does not
render correctly for this stage. Because in spark-dag-viz.js, the link of stage
is ("#stage-" + stageId + "-" + attemptId), and the value of attemptId is 0 .
So I think the attemptId of stage sholike this: stageopening spark web, the
attemptId of stage should be transfer to web, and make the link of ("#stage-"
+ stageId + "-" + attemptId) is correct.
## How was this patch tested?
Please test as fellow. Run spark app, and kill executor to make stage
reSubmitted. Then check DAG visualization in web.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/KaiXinXiaoLei/spark changeType
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/12059.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #12059
----
commit 1a541960452bbdf9da58d31e65e91d1a2cc58d66
Author: KaiXinXiaoLei <[email protected]>
Date: 2016-03-30T08:19:18Z
change attemptID
commit 2e975b64913c6572585339d2c780bcfb8a010c5a
Author: KaiXinXiaoLei <[email protected]>
Date: 2016-03-30T08:20:27Z
get attempID
commit 6faf63dead512a08ba6529c9db4ce2ae351a3e82
Author: KaiXinXiaoLei <[email protected]>
Date: 2016-03-30T08:22:47Z
add onStageSubmitted event
commit 71bebd693db9874a941bbb7b8f0fa528ddfd506b
Author: KaiXinXiaoLei <[email protected]>
Date: 2016-03-30T08:24:11Z
get attempID
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
