Github user yucai commented on a diff in the pull request:
https://github.com/apache/spark/pull/19788#discussion_r169843676
--- Diff: core/src/main/scala/org/apache/spark/MapOutputTracker.scala ---
@@ -280,6 +281,16 @@ private[spark] abstract class MapOutputTracker(conf:
SparkConf) extends Logging
}
}
+ protected def supportsContinuousBlockBulkFetch: Boolean = {
+ // continuousBlockBulkFetch only happens in SparkSQL, it uses
UnsafeRowSerializer,
+ // which supports relocation of serialized objects, so we only
consider compression
+ val adaptiveEnabled: Boolean =
conf.getBoolean("spark.sql.adaptive.enabled", false)
--- End diff --
Got it, adaptiveEnabled will be removed as your suggestion.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
