FANNG1 opened a new pull request, #11070:
URL: https://github.com/apache/gravitino/pull/11070

   ### What changes were proposed in this pull request?
   
   This PR moves Lance storage configuration into Gravitino-managed catalog 
properties and teaches Lance REST to use those catalog defaults when serving 
Spark clients. It removes the need to pass spark.sql.catalog.lance.storage.* in 
the demo path, while keeping table-level lance.storage.* overrides supported.
   
   ### Why are the changes needed?
   
   Spark currently has to repeat MinIO/S3 settings that are already known to 
Gravitino, which makes Lance integration verbose and error-prone. This change 
keeps Gravitino as the source of truth for Lance storage configuration and 
simplifies Spark usage for Gravitino-managed Lance catalogs.
   
   Fix: #11063
   
   ### Does this PR introduce _any_ user-facing change?
   
   Yes.
   
   - lance.storage.* is now supported as a catalog-level property family for 
generic lakehouse catalogs.
   - Lance REST responses now resolve storage options from catalog defaults 
when table-level values are absent.
   - The Spark demo no longer requires explicit Lance storage conf entries.
   - Table-level lance.storage.* remains supported as an override.
   
   ### How was this patch tested?
   
   - ./gradlew :lance:lance-common:test --tests 
org.apache.gravitino.lance.common.utils.TestLancePropertiesUtils -PskipITs 
-PskipDockerTests=true
   - ./gradlew :catalogs:catalog-lakehouse-generic:test --tests 
org.apache.gravitino.catalog.lakehouse.generic.TestPropertiesMetadata -PskipITs 
-PskipDockerTests=true
   - ./gradlew :lance:lance-rest-server:compileTestJava -PskipITs 
-PskipDockerTests=true


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to