Github user lindblombr commented on a diff in the pull request:
https://github.com/apache/spark/pull/21847#discussion_r205505006
--- Diff:
external/avro/src/main/scala/org/apache/spark/sql/avro/AvroSerializer.scala ---
@@ -41,7 +42,7 @@ class AvroSerializer(rootCatalystType: DataType,
rootAvroType: Schema, nullable:
}
private val converter: Any => Any = {
- val actualAvroType = resolveNullableType(rootAvroType, nullable)
+ val actualAvroType = resolveNullableType(rootAvroType,
rootCatalystType, nullable)
--- End diff --
Yes. I need the original `rootCatalystType` so I can determine how those
types map back to the specified schema. Simply having `nullable` as context is
not sufficient :(
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
