rainerschamm commented on PR #14797: URL: https://github.com/apache/iceberg/pull/14797#issuecomment-4679149016
> As per my recent investigations, not even Flink supports equality deletes on Iceberg delta writes, as performance-wise it would be subpar. > The Flink Sink supports upsert mode perfectly: https://github.com/apache/iceberg/blob/main/flink/v1.20/flink/src/main/java/org/apache/iceberg/flink/sink/BaseDeltaTaskWriter.java Also, we have been running a manually patched iceberg connect sink with good performance (by extending the same class: org.apache.iceberg.io.BaseTaskWriter in the core iceberg library). I can not understand how one team in the Iceberg community accepts that "org.apache.iceberg.io.BaseTaskWriter" is behaving well and another team does not. Regards Rainer -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
