Re: Schema - DataTypes.NullType

Thanks Nicholas. It makes sense. Now that I have a hint, I can play with it too! jg > On Feb 11, 2018, at 19:15, Nicholas Hakobian > wrote: > > I spent a few minutes poking around in the source code and found this: > > The data type representing None, used

Re: Schema - DataTypes.NullType

I spent a few minutes poking around in the source code and found this: The data type representing None, used for the types that cannot be inferred. https://github.com/apache/spark/blob/branch-2.1/python/pyspark/sql/types.py#L107-L113 Playing around a bit, this is the only use case that I could

Re: Schema - DataTypes.NullType

What is the purpose of DataTypes.NullType, specially as you are building a schema? Have anyone used it or seen it as spart of a schema auto-generation? (If I keep asking long enough, I may get an answer, no? :) ) > On Feb 4, 2018, at 13:15, Jean Georges Perrin wrote: > > Any

Re: Schema - DataTypes.NullType

Any taker on this one? ;) > On Jan 29, 2018, at 16:05, Jean Georges Perrin wrote: > > Hi Sparkians, > > Can someone tell me what is the purpose of DataTypes.NullType, specially as > you are building a schema? > > Thanks > > jg >

Schema - DataTypes.NullType

Hi Sparkians, Can someone tell me what is the purpose of DataTypes.NullType, specially as you are building a schema? Thanks jg - To unsubscribe e-mail: user-unsubscr...@spark.apache.org

Schema - DataTypes.NullType

Hi Sparkians, Can someone tell me what is the purpose of DataTypes.NullType, specially as you are building a schema? Thanks jg - To unsubscribe e-mail: user-unsubscr...@spark.apache.org