LuciferYang opened a new issue, #13018: URL: https://github.com/apache/gravitino/issues/13018
### What would you like to be improved? The Spark connector supports Spark 3.5 and 4.0 after #12414, so users on Spark 4.1 have no build to use. Spark 4.1 is also the newest line the connector can support today: Iceberg 1.11.0, the version already pinned for the connector, publishes `iceberg-spark-runtime-4.1_2.13` and nothing for 4.2. ### How should we improve? Add a `spark-connector/v4.1` module alongside `v3.5` and `v4.0`, publishing `gravitino-spark-4.1_2.13` and `gravitino-spark-connector-runtime-4.1_2.13`, and run the shared integration suite against it in CI. The module is not a pure copy of the 4.0 one. `ParserInterface` gained a defaulted `parsePlanWithParameters` that `SparkSession.sql` routes through, `ProcedureCatalog.listProcedures` became abstract, and the constructors of Spark's `JDBCTable` and Iceberg's `SparkTable` both changed. Paimon stays unavailable on 4.1, since no released Paimon version publishes `paimon-spark-4.1`. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
