bryanck opened a new pull request, #8231: URL: https://github.com/apache/iceberg/pull/8231
This PR packages the Iceberg GCP library in a similar way to the Iceberg AWS library. The `icberg-gcp` project is packaged with the Spark runtime without the GCP dependencies, similar to how `iceberg-aws` is included without the AWS dependencies. This has a negligible impact on the Spark runtime size. In the `iceberg-gcp` project, the GCP dependencies are changed to compile-only. This mirrors how the AWS dependencies are declared in `iceberg-aws`. While this could impact those using `iceberg-gcp` today, the thought is that there may not be many heavy users of it, as there was a critical bug in the GCP reader that was only recently fixed and is not in a release yet (https://github.com/apache/iceberg/pull/8071). Current users would need to add the GCP dependencies to their build. Finally, a new `iceberg-gcp-runtime` project is added that packages the necessary GCP libraries and shades any packages that might conflict with Spark. This allows users to simply include two dependencies when using Spark with Iceberg on GCP, `iceberg-spark-runtime` and `iceberg-gcp-runtime`. (AWS users similarly can specify the AWS bundle, but Google doesn't provide something similar.) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
