[
https://issues.apache.org/jira/browse/HUDI-8220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Danny Chen updated HUDI-8220:
-----------------------------
Fix Version/s: 1.1.0
(was: 1.0.0)
> CustomKeyGenerator can not be created with flink
> ------------------------------------------------
>
> Key: HUDI-8220
> URL: https://issues.apache.org/jira/browse/HUDI-8220
> Project: Apache Hudi
> Issue Type: Bug
> Reporter: Lokesh Jain
> Assignee: Danny Chen
> Priority: Blocker
> Fix For: 1.1.0
>
>
> If we create a table in flink with custom key generator it fails with error
> message.
> {code:java}
> [ERROR] Could not execute SQL statement. Reason:
> org.apache.hudi.exception.HoodieValidationException: Field ts:timestamp does
> not exist{code}
> {code:java}
> CREATE TABLE hudi_table(
> ts BIGINT,
> uuid VARCHAR(40) PRIMARY KEY NOT ENFORCED,
> rider VARCHAR(20),
> driver VARCHAR(20),
> fare DOUBLE,
> city VARCHAR(20)
> )
> WITH (
> 'connector' = 'hudi',
> 'path' = 'file:///tmp/hudi_table',
> 'table.type' = 'MERGE_ON_READ',
> 'hoodie.keygen.timebased.timestamp.type' = 'SCALAR',
> 'hoodie.keygen.timebased.output.dateformat' = 'yyyy/MM/dd',
> 'hoodie.keygen.timebased.timestamp.scalar.time.unit' = 'seconds',
> 'hoodie.datasource.write.keygenerator.class' =
> 'org.apache.hudi.keygen.CustomAvroKeyGenerator',
> 'hoodie.datasource.write.partitionpath.field' = 'ts:timestamp'
> ); {code}
> We need to support using custom keygen with flink engine.
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
