sivabalan narayanan created HUDI-2535:
-----------------------------------------
Summary: Late arriving records and global index with partition
path update set to true
Key: HUDI-2535
URL: https://issues.apache.org/jira/browse/HUDI-2535
Project: Apache Hudi
Issue Type: Improvement
Components: Writer Core
Reporter: sivabalan narayanan
incase of a global index, we have a config to update partition path. if this is
set to true, if there is an incoming record to a newer partition compared to
whats in storage, older record will be deleted and new incoming record will be
routed to new partition.
But it could run into issues if new incoming is a late arriving record.
Expected behavior is, old record is retained and new one is discarded it it has
lower preCombine value. But in this case, we may not honor that.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
