iting0321 commented on code in PR #3723:
URL: https://github.com/apache/polaris/pull/3723#discussion_r2795168195
##########
site/content/in-dev/unreleased/polaris-spark-client.md:
##########
@@ -123,12 +123,30 @@ build a Spark client jar locally from source. Please
check out the Polaris repo
The following describes the current limitations of the Polaris Spark client:
### General Limitations
-1. The Polaris Spark client only supports Iceberg and Delta tables. It does
not support other table formats like CSV, JSON, etc.
+1. The Polaris Spark client supports Iceberg, Delta, Hudi, and Paimon tables.
Other table formats like CSV, JSON, etc. are not supported for table operations
through Spark.
2. Generic tables (non-Iceberg tables) APIs do not currently support
credential vending.
### Delta Table Limitations
1. Create table as select (CTAS) is not supported for Delta tables. As a
result, the `saveAsTable` method of `Dataframe`
is also not supported, since it relies on the CTAS support.
2. Create a Delta table without explicit location is not supported.
3. Rename a Delta table is not supported.
-4. ALTER TABLE ... SET LOCATION is not supported for DELTA table.
\ No newline at end of file
+4. ALTER TABLE ... SET LOCATION is not supported for DELTA table.
+
+### Paimon Table Limitations
+1. Paimon support requires the Paimon Spark connector to be included in the
classpath. For example:
Review Comment:
Yes, Paimon has the exact same limitation as Delta and Hudi regarding
`spark_catalog`.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
