Just wondering if there is a good reason to keep around the pre-tungsten on-heap memory mode for Spark 3, and make spark.memory.offHeap.enabled always true? It would simplify the code somewhat, but I don't feel I'm so aware of the tradeoffs.
I know we didn't deprecate it, but it's been off by default for a long time. It could be deprecated, too. Same question for spark.memory.useLegacyMode and all its various associated settings? Seems like these should go away at some point, and Spark 3 is a good point. Same issue about deprecation though. --------------------------------------------------------------------- To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
