> We're moving from Spark 0.7.x to Spark 0.8 (or master actually, to get > the latest shuffle improvement)
FWIW I went back from Spark master to Spark 0.8 and am seeing the same behavior: OOMEs because of ~14,000 DiskBlockObjectWriters with 300k of memory each. So, it is not a change from the recent shuffle patch. - Stephen
