Re: Catalyst - ObjectType for Encoders

Sounds good to me, I'll keep that in mind and pay attention to updates. Shall I make a pull request from my fork, or would someone else prefer to change those function signatures themselves? Thanks, Alek On Fri, Sep 30, 2016 at 2:25 PM Michael Armbrust wrote: > I'd be

Re: Catalyst - ObjectType for Encoders

I'd be okay removing that modifier, with one caveat. The code in org.apache.spark.sql.catalyst.* is purposefully excluded from published documentation and does not have the same compatibility guarantees as the rest of the Spark's Public APIs. We leave most of it not "private" so that advanced

Catalyst - ObjectType for Encoders

Hi there, Currently Catalyst supports encoding custom classes represented as Java Beans (among others). This Java Bean implementation depends internally on Catalyst’s ObjectType extension of DataType. Currently, this class is private to the sql package [1], which is sensible, as it is only