diqiu50 opened a new pull request, #11186:
URL: https://github.com/apache/gravitino/pull/11186

   ### What changes were proposed in this pull request?
   
   - Add `GravitinoGlueCatalog` (and Spark 3.3/3.4/3.5 subclasses) as the Spark 
V2 catalog implementation backed by the Gravitino Glue catalog
   - Add `GluePropertiesConverter` to map catalog/table properties between 
Gravitino and Spark
   - Add `SparkAwsGlueCatalogIT33/34/35` integration tests covering Hive-format 
tables, Iceberg tables, partitioning, CTAS, and ALTER TABLE against a real AWS 
Glue endpoint
   
   ### Why are the changes needed?
   
   AWS Glue Data Catalog is the default metadata store for Amazon EMR, Athena, 
and Lake Formation. Without this, Spark users cannot use Gravitino as a unified 
metadata layer for Glue-managed tables.
   
   Fix: #11185
   
   ### Does this PR introduce _any_ user-facing change?
   
   Yes. Users can now configure Gravitino as the Spark catalog 
(`spark.sql.catalog.<name>=org.apache.gravitino.spark.connector.glue.GravitinoGlueCatalogSpark3X`)
 to access AWS Glue tables through Spark.
   
   ### How was this patch tested?
   
   Integration tests `SparkAwsGlueCatalogIT33/34/35` run against a real AWS 
Glue endpoint (skipped by default, enabled by `AWS_ACCESS_KEY_ID` env var). All 
33 active tests pass for Spark 3.3, 3.4, and 3.5.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to