openinx commented on issue #2558: URL: https://github.com/apache/iceberg/issues/2558#issuecomment-845616568
> but I couldn't figure out why it was removed, or to find what is the solution. Because the `CatalogDescriptorValidator` is a public API which was marked as `Internal`, the `Internal` API don't guarantee the compatibility when upgrading from flink 1.12 to flink1.13, so in theory we apache iceberg shouldn't use any of the `Internal` public API from apache flink unless we have to ( actually we've already followed the rule but still have few depended classes). > I would have to understand what was the functionality, or reason, why it was used Flink's catalog. Firstly, we apache iceberg need a catalog to manage the iceberg tables, and the catalog also provide the global table lock so that we could implement the iceberg optimistic lock (guarantee the ACID semantic). Second, it's good to integrate the iceberg catalog implementation to flink catalog interface because all flink sql are built on top of flink catalogs/tables, then we could just use the flink catalog sql to manage the iceberg catalogs and create iceberg tables under flink managed catalog. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
