mridulm commented on code in PR #39725:
URL: https://github.com/apache/spark/pull/39725#discussion_r1088326936
##########
docs/monitoring.md:
##########
@@ -1433,8 +1433,9 @@ Note: applies to the shuffle service
- deferredBlocks - the number of the current deferred block parts buffered in
memory
- deferredBlockBytes - the size of the current deferred block parts buffered
in memory
- staleBlockPushes - the number of stale shuffle block push requests
-- ignoredBlockBytes - the size of the pushed block data that are ignored after
the shuffle
- file is finalized or when a request is for a duplicate block
+- ignoredBlockBytes - the size of the pushed block data that are ignored. The
pushed block data are
+ considered as ignored for these cases: 1. received after the shuffle file is
finalized; 2. when a
+ request is for a duplicate block; 3. the part that ESS failed to write.
Review Comment:
```suggestion
- ignoredBlockBytes - size of the pushed block data that was transferred to
ESS, but ignored.
The pushed block data are considered as ignored when: 1. it was received
after the shuffle
was finalized; 2. when a push request is for a duplicate block; 3. ESS was
unable to write the block.
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
