ahmedabu98 commented on PR #31726:
URL: https://github.com/apache/beam/pull/31726#issuecomment-2211957514
Thanks for taking a look @kennknowles. I see what you mean about including
dependencies only if they're mandatory. These dependency changes aren't
necessary for this PR so I reverted them so we can get this in.
I wonder if we can improve IcebergIO's dependency story in a future PR
though. Currently a user writing to a GCS Iceberg table has to include these
dependencies:
```
runtimeOnly "org.yaml:snakeyaml:2.0"
runtimeOnly "com.google.cloud.bigdataoss:gcsio:2.2.16"
runtimeOnly "com.google.cloud.bigdataoss:gcs-connector:hadoop2-2.2.16"
runtimeOnly "org.apache.hadoop:hadoop-client:2.10.2"
```
Maybe we can provide an uber jar just for these dependencies (e.g.
`beam-sdks-java-io-iceberg-gcs-deps`) so users can simply include it along with
the core `beam-sdks-java-io-iceberg` jar. We may similarly need other jars for
different catalogs we want to support. Let me know if there's a more Java-esque
way of doing this.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
