vinishjail97 opened a new pull request, #933: URL: https://github.com/apache/incubator-xtable/pull/933
Related to #887. ## What is the purpose of the pull request Propose index support in Apache XTable, using Hudi's metadata table initially to build record-level and secondary indexes for Iceberg, Delta Lake, Paimon and Parquet. A Spark DataFrame lookup API lets query engines locate candidate rows for joins and merges. The RFC leaves expression and vector indexes for subsequent work. When a published Iceberg specification includes index definitions, XTable can support conversion between compatible Hudi and Iceberg indexes. ## Brief change log - Add RFC-4 with index maintenance and query lookup diagrams. - Define physical row identifiers, lookup results, snapshot consistency and fallback behavior. - Describe execution providers, configuration, public dependencies, adoption and the implementation test plan. ## Verify this pull request Documentation only; this PR adds no implementation code. - Parsed all three Mermaid diagrams successfully. - Checked that all ten footnote references are cited and defined. - Passed `git diff --cached --check`. - Passed `mvn -N -o apache-rat:check -B` with Java 11. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
