Danny Chen created HUDI-1812:
--------------------------------
Summary: Add explicit index state TTL option for Flink writer
Key: HUDI-1812
URL: https://issues.apache.org/jira/browse/HUDI-1812
Project: Apache Hudi
Issue Type: Improvement
Components: Flink Integration
Reporter: Danny Chen
Fix For: 0.9.0
Add option:
{code:java}
public static final ConfigOption<Double> INDEX_STATE_TTL = ConfigOptions
.key("index.state.ttl")
.doubleType()
.defaultValue(1.5D)// default 1.5 days
.withDescription("Index state TTL in DAYs, default 1.5 days");
{code}
If the state expires but there are still updates for old records, the records
would be recognized as INSERT instead of UPDATE thus some data duplication.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
