[
https://issues.apache.org/jira/browse/HUDI-7902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ethan Guo updated HUDI-7902:
----------------------------
Description: As of today, writing a partitioned table with
CustomKeyGenerator requires write config of the partition field types (they are
not stored as a table property). CustomKeyGenerator requires partition keys to
be in the format of {{field:type}} (e.g. {{column1:SIMPLE}} ). However, only
the field names are stored in {{hoodie.properties}} file. We need to store the
field types too so that without the write config, the writer configure the
correct partition field name and type in Spark datasource and SQL DML writes.
> Add a new table property to store partition field types for custom key
> generator
> --------------------------------------------------------------------------------
>
> Key: HUDI-7902
> URL: https://issues.apache.org/jira/browse/HUDI-7902
> Project: Apache Hudi
> Issue Type: Improvement
> Reporter: Ethan Guo
> Assignee: Ethan Guo
> Priority: Major
> Fix For: 1.0.0
>
>
> As of today, writing a partitioned table with CustomKeyGenerator requires
> write config of the partition field types (they are not stored as a table
> property). CustomKeyGenerator requires partition keys to be in the format of
> {{field:type}} (e.g. {{column1:SIMPLE}} ). However, only the field names are
> stored in {{hoodie.properties}} file. We need to store the field types too
> so that without the write config, the writer configure the correct partition
> field name and type in Spark datasource and SQL DML writes.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
