Sebastian Bernauer created HUDI-1694:
----------------------------------------
Summary: Preparation for Avro update
Key: HUDI-1694
URL: https://issues.apache.org/jira/browse/HUDI-1694
Project: Apache Hudi
Issue Type: Task
Components: Code Cleanup
Reporter: Sebastian Bernauer
We need to upgrade to at least Avro 1.9.x in production so i tried upgrading
the avro version in the pom.xml of Hudi. Doing so i noticed some problems:
Upgrade to Avro 1.9.2:
* Renamed method defaultValue to defaultVal
* Moved NullNode.getInstance() to JsonProperties.NULL_VALUE
* Avro complains about invalid schemas/default values in
hudi-common/src/main/avro/
* The shaded guava libs from Avro have been removed
Upgrade to Avro 1.10.1:
* Some more stuff (Not handled in this PR)
Spark 3.2.0 (we currently use 3.1.1) will contain Avro 1.10.1
(https://issues.apache.org/jira/browse/SPARK-27733).
Ín order to reduce the effort switching to a newer Avro version in the future
i provided a patch that fixes the above mentioned issues.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
