Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/21527#discussion_r196804445
--- Diff:
core/src/test/scala/org/apache/spark/scheduler/MapStatusSuite.scala ---
@@ -188,4 +188,37 @@ class MapStatusSuite extends SparkFunSuite {
assert(count === 3000)
}
}
+
+ test("YSPARK-500 MapStatus has 2000 hardcoded") {
--- End diff --
rename to "HighlyCompressedMapStatus has configurable threshold"
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
