Hi Justin, The Dataset API proposal is available here: https://issues.apache.org/jira/browse/SPARK-9999.
-Sandy On Tue, Nov 3, 2015 at 1:41 PM, Justin Uang <justin.u...@gmail.com> wrote: > Hi, > > I was looking through some of the PRs slated for 1.6.0 and I noted > something called a Dataset, which looks like a new concept based off of the > scaladoc for the class. Can anyone point me to some references/design_docs > regarding the choice to introduce the new concept? I presume it is probably > something to do with performance optimizations? > > Thanks! > > Justin >