Michael: Nice blog. Very informative. bq. In many cases, the current implementation of the Dataset API does not yet leverage the additional information it has and can be slower than RDDs.
Are the characteristics of cases above known so that users can decide which API to use ? For custom encoders, I did a quick search but didn't find the JIRA number. Can you share the JIRA number ? Thanks On Mon, Jan 4, 2016 at 12:06 PM, Michael Armbrust <[email protected]> wrote: > I also wrote about it here: > https://databricks.com/blog/2016/01/04/introducing-spark-datasets.html > > And put together a bunch of examples here: > https://docs.cloud.databricks.com/docs/spark/1.6/index.html > > On Mon, Jan 4, 2016 at 12:02 PM, Annabel Melongo < > [email protected]> wrote: > >> [1] http://spark.apache.org/releases/spark-release-1-6-0.html >> [2] http://spark.apache.org/downloads.html >> >> >> >> On Monday, January 4, 2016 2:59 PM, "[email protected]" < >> [email protected]> wrote: >> >> >> Where can I read more about the dataset api on a user layer? I am failing >> to get an API doc or understand when to use DataFrame or DataSet, >> advantages, etc. >> >> Thanks, >> Saif >> >> -----Original Message----- >> From: Jean-Baptiste Onofré [mailto:[email protected]] >> Sent: Monday, January 04, 2016 2:01 PM >> To: [email protected] >> Subject: Re: Is Spark 1.6 released? >> >> It's now OK: Michael published and announced the release. >> >> Sorry for the delay. >> >> Regards >> JB >> >> On 01/04/2016 10:06 AM, Jung wrote: >> > Hi >> > There were Spark 1.6 jars in maven central and github. >> > I found it 5 days ago. But it doesn't appear on Spark website now. >> > May I regard Spark 1.6 zip file in github as a stable release? >> > >> > Thanks >> > Jung >> > >> >> -- >> Jean-Baptiste Onofré >> [email protected] >> http://blog.nanthrax.net >> Talend - http://www.talend.com >> >> --------------------------------------------------------------------- >> To unsubscribe, e-mail: [email protected] For additional >> commands, e-mail: [email protected] >> >> >> >> --------------------------------------------------------------------- >> To unsubscribe, e-mail: [email protected] >> For additional commands, e-mail: [email protected] >> >> >> >> >
