Hi, I'm new to spark. And wanted to understand more on how shuffle works in spark
In Hadoop map reduce, while performing a reduce operation, the intermediate data from map gets written to disk. How does the same happen in Spark ? Does spark write the intermediate data to disk ? Thanks in advance. Regards, SB
