pvary commented on PR #14797: URL: https://github.com/apache/iceberg/pull/14797#issuecomment-4679331514
The Flink sink is technically functional, but working with tables that contain many equality delete files (for reads and compaction) is challenging and often prohibitively slow and expensive. There is ongoing work to eliminate the need for equality deletes by moving Flink to a model that relies solely on delete vectors. If this effort is successful, we plan to revisit the role of equality deletes and may consider removing them from the Iceberg specification altogether. Given this direction, I would recommend avoiding the introduction of new use cases that depend on equality deletes. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
