Github user gengliangwang commented on the issue:
https://github.com/apache/spark/pull/21847
Since the data type in Spark is certain, why do we need to support output
Avro schema like `["int", "long", "null"]`?
Can we just forbid such usage by having a rule for the schema: If the Avro
type is Union, it has at most two types and one of it is Null type.
Otherwise things can be complicated.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]