Seeing issues with sort-based shuffle (OOM errors and memory leak): https://issues.apache.org/jira/browse/SPARK-4515.
Good performance gains for TeraSort as compared to hash (as expected). Thanks, Nishkam On Thu, Nov 20, 2014 at 11:20 AM, Matei Zaharia <[email protected]> wrote: > You can still send patches for docs until the release goes out -- please > do if you see stuff. > > Matei > > > On Nov 20, 2014, at 6:39 AM, Madhu <[email protected]> wrote: > > > > Thanks Patrick. > > > > I've been testing some 1.2 features, looks good so far. > > I have some example code that I think will be helpful for certain > MR-style > > use cases (secondary sort). > > Can I still add that to the 1.2 documentation, or is that frozen at this > > point? > > > > > > > > ----- > > -- > > Madhu > > https://www.linkedin.com/in/msiddalingaiah > > -- > > View this message in context: > http://apache-spark-developers-list.1001551.n3.nabble.com/ANNOUNCE-Spark-1-2-0-Release-Preview-Posted-tp9400p9449.html > > Sent from the Apache Spark Developers List mailing list archive at > Nabble.com. > > > > --------------------------------------------------------------------- > > To unsubscribe, e-mail: [email protected] > > For additional commands, e-mail: [email protected] > > > > > --------------------------------------------------------------------- > To unsubscribe, e-mail: [email protected] > For additional commands, e-mail: [email protected] > >
