gh-yzou commented on code in PR #1857: URL: https://github.com/apache/polaris/pull/1857#discussion_r2145613566
########## site/content/in-dev/unreleased/polaris-spark-client.md: ########## @@ -128,3 +128,21 @@ The Polaris Spark client has the following functionality limitations: 3) Rename a Delta table is not supported. 4) ALTER TABLE ... SET LOCATION is not supported for DELTA table. 5) For other non-Iceberg tables like csv, it is not supported. + +## Iceberg Spark Client compatibility with Polaris Spark Client +The Polaris Spark client today is not designed to be used with Iceberg Spark client together. In other words, Review Comment: For 1, for example, when we create the catalog, the catalog is created as using ``` catalog = ctor.newInstance(); ``` And the ctor is decided by the String in the configuration. For this kind of use case, those class will be missing during package if we just pack the dependent classes.I believe it is the same for auth manager class. ``` How de we consider this issue wrt to the upcoming 1.0 Polaris release? Changing this after the 1.0 release will be impossible, I guess. ``` That should be possible, every project should be allowed to introduce behavior change with established process, for example, iceberg can move on to v2, v3 specs, which is dramatic change for users. Especially the whole generic table project is marked as beta for now, and the spark client is mainly introduced for generic table usage. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@polaris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
