sivabalan narayanan created HUDI-9721:
-----------------------------------------
Summary: Add RLI index layout to Index definition
Key: HUDI-9721
URL: https://issues.apache.org/jira/browse/HUDI-9721
Project: Apache Hudi
Issue Type: Improvement
Components: reader-core, writer-core
Reporter: sivabalan narayanan
As of now, its not easy to deduce global RLI vs partitioned RLI just by looking
at storage. i.e. nowwhere in metadata table properties or metadata table
partition layout or data table properties, we will be able to figure out
whether the record index in MDT is meant for global RLI or partitioned RLI.
We can get the information by parsing the file groups in RLI partition, but we
would want to detect it for queries.
So, lets add a indexing layout strategy to index definition for RLI partition.
Using this, a query should be able to figure out wether a given RLI is global
or partitioned RLI. Lets add this index definition when we bootstrap the new
RLI partition in MDT.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
