This is an automated email from the ASF dual-hosted git repository. vinishjail97 pushed a commit to branch 944-bundle-iceberg-aws in repository https://gitbox.apache.org/repos/asf/incubator-xtable.git
commit 951c05e26f3f76fa40c42225698e2aaf6037ba9a Author: Vinish Reddy <[email protected]> AuthorDate: Tue Oct 6 19:16:27 2026 -0700 Address review feedback --- README.md | 2 +- xtable-utilities/pom.xml | 5 +++-- 2 files changed, 4 insertions(+), 3 deletions(-) diff --git a/README.md b/README.md index 2247156e..79bbcc2c 100644 --- a/README.md +++ b/README.md @@ -116,13 +116,13 @@ catalogOptions: # all other options are passed through in a map key1: value1 key2: value2 ``` -The bundled jar includes Iceberg's `org.apache.iceberg.aws.glue.GlueCatalog` and `org.apache.iceberg.aws.s3.S3FileIO`. Other catalog implementations must be added to the classpath, which means running with `java -cp xtable-utilities_2.12-0.5.0-SNAPSHOT-bundled.jar:my-catalog.jar org.apache.xtable.utilities.RunSync ...` instead of `java -jar`. 5. Run with `java -jar xtable-utilities/target/xtable-utilities_2.12-0.5.0-SNAPSHOT-bundled.jar --datasetConfig my_config.yaml [--hadoopConfig hdfs-site.xml] [--convertersConfig converters.yaml] [--icebergCatalogConfig catalog.yaml]` The bundled jar includes hadoop dependencies for AWS, Azure, and GCP. Sample hadoop configurations for configuring the converters can be found in the [xtable-hadoop-defaults.xml](https://github.com/apache/incubator-xtable/blob/main/xtable-utilities/src/main/resources/xtable-hadoop-defaults.xml) file. The custom hadoop configurations can be passed in with the `--hadoopConfig [custom-hadoop-config-file]` option. The config in custom hadoop config file will override the default hadoop configurations. For an example of a custom hadoop config file, see [hadoop.xml](https://xtable.apache.org/docs/fabric#step-2-translate-source-table-to-delta-lake-format-using-apache-xtable-incubating). +The bundled jar includes Iceberg's `org.apache.iceberg.aws.glue.GlueCatalog` and `org.apache.iceberg.aws.s3.S3FileIO`. Other catalog implementations must be added to the classpath, which means running with `java -cp xtable-utilities_2.12-0.5.0-SNAPSHOT-bundled.jar:my-catalog.jar org.apache.xtable.utilities.RunSync ...` instead of `java -jar`. # Running using docker diff --git a/xtable-utilities/pom.xml b/xtable-utilities/pom.xml index aea9e3da..a0146519 100644 --- a/xtable-utilities/pom.xml +++ b/xtable-utilities/pom.xml @@ -200,8 +200,9 @@ <groupId>org.apache.iceberg</groupId> <artifactId>iceberg-parquet</artifactId> </dependency> - <!-- GlueCatalog and S3FileIO for icebergCatalogConfig. The AWS SDK clients it needs are - already bundled below. --> + <!-- GlueCatalog and S3FileIO for icebergCatalogConfig. The s3 and sts SDK clients are + declared below; glue arrives transitively from xtable-aws, so its shade include goes + stale if xtable-aws ever drops it. --> <dependency> <groupId>org.apache.iceberg</groupId> <artifactId>iceberg-aws</artifactId>
