GitHub user nsivabalan edited a comment on the discussion: Use config `hoodie.index.scope=global|partition` to avoid having variants of the same index type
yes. existing tables has to work w/o needing any additional writer config overrides from user. If not, it may wipe out the data or result in data consistency issues. Vinoth: for record index, we managed to retain the same type for `hoodie.index.type` which is `RECORD_INDEX`. Based on the write configs set (`hoodie.metadata.record.index.enable` or `hoodie.metadata.partitioned.record.index.enable`) the indexing will figure out whether its global RLI or partitioned RLI. but from user standpoint, they need to set `hoodie.index.type` to `RECORD_INDEX` if they prefer to use record index from MDT. And we can have only one of global rli or partitioned RLI for a given data table enabled on write. GitHub link: https://github.com/apache/hudi/discussions/13864#discussioncomment-14408693 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
