[
https://issues.apache.org/jira/browse/HUDI-1812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HUDI-1812:
---------------------------------
Labels: pull-request-available (was: )
> Add explicit index state TTL option for Flink writer
> ----------------------------------------------------
>
> Key: HUDI-1812
> URL: https://issues.apache.org/jira/browse/HUDI-1812
> Project: Apache Hudi
> Issue Type: Improvement
> Components: Flink Integration
> Reporter: Danny Chen
> Assignee: 谢波
> Priority: Major
> Labels: pull-request-available
> Fix For: 0.9.0
>
>
> Add option:
> {code:java}
> public static final ConfigOption<Long> INDEX_STATE_TTL = ConfigOptions
> .key("index.state.ttl")
> .longType()
> .defaultValue(24 * 60 * 60 * 1000L)
> .withDescription("index state ttl in milliseconds. default is 1 day.");
> {code}
> If the state expires but there are still updates for old records, the records
> would be recognized as INSERT instead of UPDATE thus some data duplication.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)