Github user 10110346 commented on a diff in the pull request:
https://github.com/apache/spark/pull/22754#discussion_r227191411
--- Diff:
core/src/main/java/org/apache/spark/util/collection/unsafe/sort/UnsafeSorterSpillWriter.java
---
@@ -62,6 +62,8 @@ public UnsafeSorterSpillWriter(
int fileBufferSize,
ShuffleWriteMetrics writeMetrics,
int numRecordsToWrite) throws IOException {
+ // Space used by prefix + len + recordLength is more than 4 + 8 bytes
+ assert (diskWriteBufferSize > 12);
--- End diff --
I am not sure tooï¼ but I see many places(`BitSetMethods.java,
HeapMemoryAllocator.java, LongArray.java`) that use it like this.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
