Re: Question about Expression Encoders

works perfectly! Thanks Herman. Am Di., 25. Aug. 2020 um 12:03 Uhr schrieb Herman van Hovell < her...@databricks.com>: > Hi Robert, > > Your Spark 3.0 code is missing the encoder that converts the Row to an > InternalRow. Your Spark 3.0 code should look like this: > > def rowToCaseClass[C <:

Re: Question about Expression Encoders

Hi everyone Thanks Takeshi. I run into the same issue as Mark for my row to case class converter: def rowToCaseClass[C <: Product : TypeTag](r: Row)(implicit encs: (ExpressionEncoder[Row], ExpressionEncoder[C])): C = { val ir = encs._1.toRow(r) encs._2.fromRow(ir) } So in Spark3.0 I would

Re: Question about Expression Encoders

Hi, Have you tried it like this? -- { r: InternalRow => enc1.fromRow(r) } ===> { r: InternalRow => val fromRow = enc1.createDeserializer() fromRow(r) } https://github.com/apache/spark/commit/e7fef70fbbea08a38316abdaa9445123bb8c39e2 Bests, Takeshi On Thu, Aug 20, 2020 at 1:52 PM Mark

Question about Expression Encoders

Dear Spark Developers, In our teams Spark Library we utilize ExpressionEncoders to help us automatically generate spark SQL types from scala case classes. https://github.com/Azure/mmlspark/blob/master/src/main/scala/com/microsoft/ml/spark/core/schema/SparkBindings.scala