Hi Cheez, You can set the parameter spark.shuffle.manager when you submit the Spark job.
--conf spark.shuffle.manager=hash Thank you, Ranjana On Thu, Aug 13, 2015 at 2:26 AM, cheez <[email protected]> wrote: > I understand that the current master branch of Spark uses Sort based > shuffle. > Is there a way to change that to Hash based shuffle, just for experimental > purposes by modifying the source code ? > > > > -- > View this message in context: > http://apache-spark-developers-list.1001551.n3.nabble.com/Switch-from-Sort-based-to-Hash-based-shuffle-tp13661.html > Sent from the Apache Spark Developers List mailing list archive at > Nabble.com. > > --------------------------------------------------------------------- > To unsubscribe, e-mail: [email protected] > For additional commands, e-mail: [email protected] > >
