Re: Using an Option[some primitive type] in Spark Dataset API

2016-04-06 Thread Michael Armbrust
> We only define implicits for a subset of the types we support in > SQLImplicits > . > We should probably consider adding Option[T] for common T as the internal > infrastructure

Fwd: Using an Option[some primitive type] in Spark Dataset API

2016-04-06 Thread Razvan Panda
Copy paste from SO question: http://stackoverflow.com/q/36449368/750216 "Is it possible to use Option[_] member in a case class used with Dataset API? eg. Option[Int] I tried to find an example but could not find any yet. This can probably be done with with a custom encoder (mapping?) but I