Shawn Chang created HUDI-7951:
---------------------------------
Summary: Classes using avro causing conflict in hudi-aws-bundle
Key: HUDI-7951
URL: https://issues.apache.org/jira/browse/HUDI-7951
Project: Apache Hudi
Issue Type: Bug
Reporter: Shawn Chang
Hudi 0.15 added some Hudi classes with avro usages (ParquetTableSchemaResolver
in this case), also had hudi-aws-bundle depend on hudi-hadoop-common.
hudi-aws-bundle won't relocate avro classes to be compatible with hudi-spark.
The issue would happen when using hudi-flink-bundle with hudi-aws-bundle.
hudi-flink-bundle has relocated avro classes and would cause class conflict:
{code:java}
java.lang.NoSuchMethodError: 'org.apache.parquet.schema.MessageType
org.apache.hudi.common.table.ParquetTableSchemaResolver.convertAvroSchemaToParquet(org.apache.hudi.org.apache.avro.Schema,
org.apache.hadoop.conf.Configuration)'
{code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
