Github user viirya commented on a diff in the pull request:
https://github.com/apache/spark/pull/22754#discussion_r227315262
--- Diff:
core/src/main/java/org/apache/spark/util/collection/unsafe/sort/UnsafeSorterSpillWriter.java
---
@@ -62,6 +62,8 @@ public UnsafeSorterSpillWriter(
int fileBufferSize,
ShuffleWriteMetrics writeMetrics,
int numRecordsToWrite) throws IOException {
+ // Space used by prefix + len + recordLength is more than 4 + 8 bytes
+ assert (diskWriteBufferSize > 12);
--- End diff --
If just for explaining it, maybe you can put a comment on
`diskWriteBufferSize` is defined, instead of an `assert`.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
