FANNG1 commented on PR #6168: URL: https://github.com/apache/gravitino/pull/6168#issuecomment-2579594369
`iceberg-gcp-bundle` use new google packages while `gravitino-gcp-bundle` use old google packages, there are some compatibility problems when writing Iceberg data to GCS. There may be two alternatives to resovle the problem: 1. Relocate Google packages in Gravitino GCP bundles jar, by using https://github.com/apache/gravitino/pull/5448. The potential problem is we should relocate `com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystem` too. 2. Use Gravitino GCP jar without hadoop for Iceberg REST server. because Hadoop related package is not needed here. I prefer option2 for more cleaner. and propose this PR , @jerryshao @yuqi1129 PTAL. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
