Re: Dataset encoders for further types?

2016-12-17 Thread Michal Šenkýř
I actually already made a pull request adding support for arbitrary sequence types. https://github.com/apache/spark/pull/16240 There is still a little problem of Seq.toDS not working for those types (couldn't get implicits with multiple type parameters to resolve correctly) but createDataset

Re: Dataset encoders for further types?

2016-12-16 Thread Jakub Dubovsky
I will give that a try. Thanks! On Fri, Dec 16, 2016 at 12:45 AM, Michael Armbrust wrote: > I would have sworn there was a ticket, but I can't find it. So here you > go: https://issues.apache.org/jira/browse/SPARK-18891 > > A work around until that is fixed would be for

Re: Dataset encoders for further types?

2016-12-15 Thread Michael Armbrust
I would have sworn there was a ticket, but I can't find it. So here you go: https://issues.apache.org/jira/browse/SPARK-18891 A work around until that is fixed would be for you to manually specify the kryo encoder

Dataset encoders for further types?

2016-12-15 Thread Jakub Dubovsky
Hey, I want to ask whether there is any roadmap/plan for adding Encoders for further types in next releases of Spark. Here is a list of currently supported types. We would like to use Datasets with our internally defined