This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch branch-3.0
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-3.0 by this push:
new 5a7395d [SPARK-31073][DOC][FOLLOWUP] Add description for Shuffle
Write Time metric in StagePage to web-ui.md
5a7395d is described below
commit 5a7395d296b57c8e06bbf100b4ebdaa1100c3a91
Author: Kousuke Saruta <[email protected]>
AuthorDate: Wed Apr 1 12:03:41 2020 -0700
[SPARK-31073][DOC][FOLLOWUP] Add description for Shuffle Write Time metric
in StagePage to web-ui.md
### What changes were proposed in this pull request?
This PR adds description for `Shuffle Write Time` to `web-ui.md`.
### Why are the changes needed?
#27837 added `Shuffle Write Time` metric to task metrics summary but it's
not documented yet.
### Does this PR introduce any user-facing change?
Yes.
We can see the description for `Shuffle Write Time` in the new
`web-ui.html`.
<img width="956" alt="shuffle-write-time-description"
src="https://user-images.githubusercontent.com/4736016/78175342-a9722280-7495-11ea-9cc6-62c6f3619aa3.png";>
### How was this patch tested?
Built docs by `SKIP_API=1 jekyll build` in `doc` directory and then
confirmed `web-ui.html`.
Closes #28093 from sarutak/SPARK-31073-doc.
Authored-by: Kousuke Saruta <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
(cherry picked from commit b9b1b549af4dd57767fc0c23f5fe7695ca9fa9d5)
Signed-off-by: Dongjoon Hyun <[email protected]>
---
docs/web-ui.md | 1 +
1 file changed, 1 insertion(+)
diff --git a/docs/web-ui.md b/docs/web-ui.md
index e28a689..c53af80 100644
--- a/docs/web-ui.md
+++ b/docs/web-ui.md
@@ -143,6 +143,7 @@ Summary metrics for all task are represented in a table and
in a timeline.
* **Shuffle Read Size / Records**. Total shuffle bytes read, includes both
data read locally and data read from remote executors.
* **Shuffle Read Blocked Time** is the time that tasks spent blocked waiting
for shuffle data to be read from remote machines.
* **Shuffle Remote Reads** is the total shuffle bytes read from remote
executors.
+* **Shuffle Write Time** is the time that tasks spent writing shuffle data.
* **Shuffle spill (memory)** is the size of the deserialized form of the
shuffled data in memory.
* **Shuffle spill (disk)** is the size of the serialized form of the data on
disk.
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
![https://user-images.githubusercontent.com/4736016/78175342-a9722280-7495-11ea-9cc6-62c6f3619aa3.png"](https://user-images.githubusercontent.com/4736016/78175342-a9722280-7495-11ea-9cc6-62c6f3619aa3.png"){kind=link}