sarutak commented on a change in pull request #28061: [SPARK-31270][CORE]
Expose executor metrics in task detail table in StageLevel
URL: https://github.com/apache/spark/pull/28061#discussion_r405311697
##########
File path: core/src/main/resources/org/apache/spark/ui/static/stagepage.js
##########
@@ -572,7 +600,7 @@ $(document).ready(function () {
var row1 = createRowMetadataForColumn(
columnKey, taskMetricsResponse[columnKey],
4);
var row2 = createRowMetadataForColumn(
- "shuffleWriteTime",
taskMetricsResponse[columnKey], 21);
+ "shuffleWriteTime",
taskMetricsResponse[columnKey], 23);
Review comment:
@AngersZhuuuu I found following issues.
1. When a job performs shuffle, StagePage for shuffle write stage has a
problem.
Even if you visit StagePage where the corresponding stage performs shuffle
write and check `Shuffle Write Time`,
the metrics is not shown.
<img width="1426" alt="スクリーンショット 2020-04-08 16 14 30"
src="https://user-images.githubusercontent.com/4736016/78756030-136a5a80-79b5-11ea-90f3-917e31839588.png";>
2. Web UI will be hung-up
When you visit a StagePage where the corresponding stage performs shuffle
read and reload, UI will be hung-up.
<img width="1438" alt="hungup"
src="https://user-images.githubusercontent.com/4736016/78756200-5f1d0400-79b5-11ea-967a-6992fd4b5a4f.png";>
Those issues are caused because column indices are not changed properly.
To avoid such issues, please keep it simple. I believe column indices need
not to be changed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
![https://user-images.githubusercontent.com/4736016/78756030-136a5a80-79b5-11ea-90f3-917e31839588.png"](https://user-images.githubusercontent.com/4736016/78756030-136a5a80-79b5-11ea-90f3-917e31839588.png"){kind=link}
![https://user-images.githubusercontent.com/4736016/78756200-5f1d0400-79b5-11ea-967a-6992fd4b5a4f.png"](https://user-images.githubusercontent.com/4736016/78756200-5f1d0400-79b5-11ea-967a-6992fd4b5a4f.png"){kind=link}