Hello, we are currently evaluating using Paimon as our primary format for landing data via Flink, but we still want to maintain compatibility with Delta Lake, as we use Delta Sharing <https://github.com/delta-io/delta-sharing> features extensively.
Right now, it seems that there are three options to achieve that: - Enable the Paimon -> Iceberg <https://paimon.apache.org/docs/master/iceberg/overview/> Integration, and then use XTable <https://xtable.apache.org/> to convert Iceberg metadata to Delta Lake metadata. - Implement a Paimon Source for XTable <https://xtable.apache.org/> and use it to convert Delta Lake metadata directly from Paimon metadata (read-optimize only). - Implement a Commit Callback in Paimon that writes the Delta Lake metadata directly, similar to what was done on the Iceberg integration <https://paimon.apache.org/docs/master/iceberg/overview/>. We are playing with the first option right now, but we would like to avoid that going forward because the Iceberg conversion is unnecessary for us. So the question is, would the Paimon community accept contributions to enable Delta Lake compatibility, just like Iceberg's, or would the community prefer to rely on XTable for such cross-table format conversions? Keen to hear your thoughts! Thanks Mike Dias
