Solved: Call spark-submit with --driver-memory 512m --driver-java-options "-Dspark.memory.useLegacyMode=true -Dspark.shuffle.memoryFraction=0.2 -Dspark.storage.memoryFraction=0.6 -Dspark.storage.unrollFraction=0.2"
Thanks to: https://issues.apache.org/jira/browse/SPARK-14367 -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Using-spark-memory-useLegacyMode-true-does-not-yield-expected-behavior-tp26631p26750.html Sent from the Apache Spark User List mailing list archive at Nabble.com. --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
