Re: ability to provide custom serializers

2016-12-05 Thread Michael Armbrust
Lets start with a new ticket, link them and we can merge if the solution ends up working out for both cases. On Sun, Dec 4, 2016 at 5:39 PM, Erik LaBianca wrote: > Thanks Michael! > > On Dec 2, 2016, at 7:29 PM, Michael Armbrust > wrote: > > I would love to see something like this. The closest

Re: ability to provide custom serializers

2016-12-04 Thread Erik LaBianca
Thanks Michael! > On Dec 2, 2016, at 7:29 PM, Michael Armbrust wrote: > > I would love to see something like this. The closest related ticket is > probably https://issues.apache.org/jira/browse/SPARK-7768 > (though maybe there are > enough p

Re: ability to provide custom serializers

2016-12-02 Thread Michael Armbrust
I would love to see something like this. The closest related ticket is probably https://issues.apache.org/jira/browse/SPARK-7768 (though maybe there are enough people using UDTs in their current form that we should just make a new ticket) A few thoughts: - even if you can do implicit search, we

ability to provide custom serializers

2016-12-02 Thread Erik LaBianca
Hi All, Apologies in advance for any confusing terminology, I’m still pretty new to Spark. I’ve got a bunch of Scala case class “domain objects” from an existing application. Many of them contain simple, but unsupported-by-spark types in them, such as case class Foo(timestamp: java.time.Instan