This is an automated email from the ASF dual-hosted git repository.
diqiu50 pushed a change to branch trino-irc-1.3
in repository https://gitbox.apache.org/repos/asf/gravitino.git
from 236a644d95 fix(trino): log catalog registration failures
new b3eef41fea improvement(spark-connector): Route lakehouse-iceberg
catalogs through the Iceberg REST server
new e554a3398d improvement(spark-connector): Reuse OAuth for routed
Iceberg REST catalogs
new 0667d3e02e Merge branch 'spark-irc-1.3' into trino-irc-1.3
The 3 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
docs/spark-connector/spark-catalog-iceberg.md | 40 ++++
docs/spark-connector/spark-connector.md | 2 +
.../spark/connector/GravitinoSparkConfig.java | 14 ++
.../connector/catalog/GravitinoCatalogManager.java | 45 +++-
.../connector/iceberg/GravitinoIcebergCatalog.java | 75 ++++++-
.../iceberg/IcebergPropertiesConstants.java | 17 ++
.../iceberg/IcebergPropertiesConverter.java | 176 +++++++++++++++
.../connector/iceberg/IcebergRestOAuthConfig.java | 89 ++++++++
.../connector/plugin/GravitinoDriverPlugin.java | 1 +
.../connector/glue/TestGravitinoGlueCatalog.java | 2 +-
.../iceberg/TestIcebergPropertiesConverter.java | 136 ++++++++++++
.../iceberg/TestIcebergRestOAuthConfig.java | 123 +++++++++++
.../connector/integration/test/SparkEnvIT.java | 59 +++--
.../iceberg/SparkIcebergCatalogRestRoutingIT.java | 76 +++++++
...ava => SparkIcebergCatalogRestRoutingIT33.java} | 4 +-
...ava => SparkIcebergCatalogRestRoutingIT34.java} | 2 +-
spark-connector/v3.5/spark/build.gradle.kts | 2 +
.../SparkIcebergCatalogRestRoutingIT35.java} | 2 +-
...kIcebergCatalogRestS3CredentialVendingIT35.java | 240 +++++++++++++++++++++
19 files changed, 1075 insertions(+), 30 deletions(-)
create mode 100644
spark-connector/spark-common/src/main/java/org/apache/gravitino/spark/connector/iceberg/IcebergRestOAuthConfig.java
create mode 100644
spark-connector/spark-common/src/test/java/org/apache/gravitino/spark/connector/iceberg/TestIcebergRestOAuthConfig.java
create mode 100644
spark-connector/spark-common/src/test/java/org/apache/gravitino/spark/connector/integration/test/iceberg/SparkIcebergCatalogRestRoutingIT.java
copy
spark-connector/v3.3/spark/src/test/java/org/apache/gravitino/spark/connector/integration/test/iceberg/{SparkIcebergCatalogRestBackendIT33.java
=> SparkIcebergCatalogRestRoutingIT33.java} (94%)
copy
spark-connector/v3.4/spark/src/test/java/org/apache/gravitino/spark/connector/integration/test/iceberg/{SparkIcebergCatalogRestBackendIT34.java
=> SparkIcebergCatalogRestRoutingIT34.java} (91%)
copy
spark-connector/{v3.4/spark/src/test/java/org/apache/gravitino/spark/connector/integration/test/iceberg/SparkIcebergCatalogRestBackendIT34.java
=>
v3.5/spark/src/test/java/org/apache/gravitino/spark/connector/integration/test/iceberg/SparkIcebergCatalogRestRoutingIT35.java}
(91%)
create mode 100644
spark-connector/v3.5/spark/src/test/java/org/apache/gravitino/spark/connector/integration/test/iceberg/SparkIcebergCatalogRestS3CredentialVendingIT35.java
