vinishjail97 commented on issue #887: URL: https://github.com/apache/incubator-xtable/issues/887#issuecomment-5591584711
Progress on the record index and secondary index slice for tables synced to Hudi: - apache/hudi#19869: Hudi record index and secondary index for parquet files registered from other formats (external files). Rows without a record key are keyed by `<file path relative to the table>_<row position>`, and replace commits from external writers update both indexes. Proposed for Hudi 1.2.1. - #835: Hudi table version 9 for the Hudi target, which the secondary index requires. - #935: builds both indexes from the Hudi target (`xtable.hudi.target.secondary.index.column`, Java or Spark engine) and adds `HudiBackedIcebergSecondaryIndex`, which resolves values of an Iceberg column to file, row position and partition. Draft, stacked on #835, until #19869 is in a Hudi release. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
