amogh-jahagirdar opened a new pull request, #13555: URL: https://github.com/apache/iceberg/pull/13555
Depends on https://github.com/apache/iceberg/pull/13310 This change ensures that row lineage information is preserved on compaction by adding a new analyzer rule which manipulates the DSV2 relation based on the presence of rewrite task IDs. Note: This approach does mean that spark extensions must be enabled in order to run the action on V3 tables to preserve lineage. I'm looking at alternative approaches, but fundamentally anything which requires a rewriting of plans will require extension rules, thereby necessitating extensions... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
