Wechar created HUDI-6219:
----------------------------
Summary: Ensure consistency between Spark catalog schema and Hudi
schema
Key: HUDI-6219
URL: https://issues.apache.org/jira/browse/HUDI-6219
Project: Apache Hudi
Issue Type: Bug
Reporter: Wechar
[HUDI-4149|https://github.com/apache/hudi/pull/5672] fix the drop table error
if table directory moved, but it will make the Spark catalog table schema not
consistent with Hudi schema if some column types are not Avro data types.
*Root cause:*
Hudi schema is Avro types, but Spark catalog table schema is not. There are two
steps to record schema when create a hudi table:
Step1: record the Avro compatible schema to .hoodie/hoodie.properties,
Step2: record table in Spark catalog
The Step2 will use HoodieCatalog.tableSchema, which is table.schema now and
cause this issue.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
