Thanks Nicholas. It makes sense. Now that I have a hint, I can play with it too!
jg
> On Feb 11, 2018, at 19:15, Nicholas Hakobian
> wrote:
>
> I spent a few minutes poking around in the source code and found this:
>
> The data type representing None, used for the types that cannot be inferre
I spent a few minutes poking around in the source code and found this:
The data type representing None, used for the types that cannot be inferred.
https://github.com/apache/spark/blob/branch-2.1/python/pyspark/sql/types.py#L107-L113
Playing around a bit, this is the only use case that I could i
What is the purpose of DataTypes.NullType, specially as you are building a
schema? Have anyone used it or seen it as spart of a schema auto-generation?
(If I keep asking long enough, I may get an answer, no? :) )
> On Feb 4, 2018, at 13:15, Jean Georges Perrin wrote:
>
> Any taker on this on
Any taker on this one? ;)
> On Jan 29, 2018, at 16:05, Jean Georges Perrin wrote:
>
> Hi Sparkians,
>
> Can someone tell me what is the purpose of DataTypes.NullType, specially as
> you are building a schema?
>
> Thanks
>
> jg
> ---
Hi Sparkians,
Can someone tell me what is the purpose of DataTypes.NullType, specially as you
are building a schema?
Thanks
jg
-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org
Hi Sparkians,
Can someone tell me what is the purpose of DataTypes.NullType, specially as you
are building a schema?
Thanks
jg
-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org