Jake Dalli created SPARK-35957:
----------------------------------
Summary: Cannot convert Avro schema to catalyst type because
schema at path is not compatible
Key: SPARK-35957
URL: https://issues.apache.org/jira/browse/SPARK-35957
Project: Spark
Issue Type: Bug
Components: Spark Core, SQL
Affects Versions: 3.0.0
Reporter: Jake Dalli
* The Apache Avro specification has a *null* primitive type.
* Using org.apache.spark:spark-avro_2.12:3.0.3 on Spark 3.0.0 with Scala 2.12
* I try to load an avro schema with the a field defined as follows:
*
```
{
"name": "messageKey",
"type": "null"
},
```
* I get the following error:
```
ERROR Client: Application diagnostics message: User class threw exception:
org.apache.spark.sql.avro.IncompatibleSchemaException: Unsupported type NULL
```
This issue is experienced when using Apache Hudi 0.7.0.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
