danhuawang commented on issue #9297: URL: https://github.com/apache/gravitino/issues/9297#issuecomment-3595429486
> > > after [#9147 (comment)](https://github.com/apache/gravitino/pull/9147#event-21264142063) is merged, Iceberg gcp bundle is no longer used, could you test with the latest Gravitino GCP Iceberg bundle jar? > > > > > > I retry based on the latest main branch including [#9147](https://github.com/apache/gravitino/pull/9147) and only use the jar from gravitino, the `NoSuchMethodError` error still exist. > > ``` > > curl http://127.0.0.1:8090/api/version > > {"code":0,"version":{"version":"1.1.0-SNAPSHOT","compileDate":"01/12/2025 12:09:36","gitCommit":"cba6505a4da228612a1a1e4b8b90224f3b88830c"}} > > ``` > > > > > > > > > > > > > > > > > > > > > > > > ``` > > wangdanhua@wangdanhuadeMBP package % ls -al iceberg-rest-server/libs | grep gcp > > -rw-r--r--@ 1 wangdanhua staff 27221 Dec 1 13:55 gravitino-gcp-1.1.0-SNAPSHOT.jar > > -rw-r--r--@ 1 wangdanhua staff 15232 Dec 1 13:58 gravitino-gcp-bundle-1.1.0-SNAPSHOT-empty.jar > > -rw-r--r--@ 1 wangdanhua staff 61313449 Dec 1 13:58 gravitino-gcp-bundle-1.1.0-SNAPSHOT.jar > > -rw-r--r--@ 1 wangdanhua staff 14590 Dec 1 13:58 gravitino-iceberg-gcp-bundle-1.1.0-SNAPSHOT-empty.jar > > -rw-r--r--@ 1 wangdanhua staff 65863478 Dec 1 13:58 gravitino-iceberg-gcp-bundle-1.1.0-SNAPSHOT.jar > > -rw-r--r--@ 1 wangdanhua staff 43333 Dec 1 13:55 iceberg-gcp-1.10.0.jar > > ``` > > gravitino-gcp-bundle is not needed After I removed the gravitino-gcp-bundle, encounter 401. ``` 2025-12-01 16:38:19.412 INFO [iceberg-rest-41] [org.apache.gravitino.iceberg.service.rest.IcebergTableOperations.createTable(IcebergTableOperations.java:160)] - Create Iceberg table, catalog: iceberg_gcp, namespace: dml, create table request: CreateTableRequest{name=test, location=null, properties={owner=anonymous}, schema=table { 0: id: optional long (unique id) }, partitionSpec=org.apache.iceberg.UnboundPartitionSpec@3e0c0fbd, writeOrder=null, stageCreate=false}, accessDelegation: vended-credentials, isCredentialVending: true 2025-12-01 16:38:19.421 INFO [iceberg-rest-41] [org.apache.iceberg.BaseMetastoreCatalog$BaseMetastoreCatalogTableBuilder.tableDefaultProperties(BaseMetastoreCatalog.java:269)] - Table properties set at catalog level through catalog properties: {} 2025-12-01 16:38:19.423 INFO [iceberg-rest-41] [org.apache.iceberg.BaseMetastoreCatalog$BaseMetastoreCatalogTableBuilder.tableOverrideProperties(BaseMetastoreCatalog.java:283)] - Table properties enforced at catalog level through catalog properties: {} 2025-12-01 16:38:20.857 WARN [iceberg-rest-41] [org.apache.gravitino.iceberg.service.IcebergExceptionMapper.toRESTResponse(IcebergExceptionMapper.java:84)] - Iceberg REST server unexpected exception: com.google.cloud.storage.StorageException: 401 Unauthorized POST https://storage.googleapis.com/upload/storage/v1/b/strato-iceberg/o?name=test1/dml/test/metadata/00000-03a62453-9567-42b8-8838-e8e75bd86966.metadata.json&uploadType=resumable at com.google.cloud.storage.StorageException.translate(StorageException.java:230) ~[gravitino-iceberg-gcp-bundle-1.1.0-SNAPSHOT.jar:?] at com.google.cloud.storage.spi.v1.HttpStorageRpc.translate(HttpStorageRpc.java:360) ~[gravitino-iceberg-gcp-bundle-1.1.0-SNAPSHOT.jar:?] at com.google.cloud.storage.spi.v1.HttpStorageRpc.open(HttpStorageRpc.java:1161) ~[gravitino-iceberg-gcp-bundle-1.1.0-SNAPSHOT.jar:?] at com.google.cloud.storage.ResumableMedia.lambda$startUploadForBlobInfo$0(ResumableMedia.java:38) ~[gravitino-iceberg-gcp-bundle-1.1.0-SNAPSHOT.jar:?] at com.google.cloud.storage.Retrying$DefaultRetrier.run(Retrying.java:165) ~[gravitino-iceberg-gcp-bundle-1.1.0-SNAPSHOT.jar:?] at com.google.cloud.storage.Retrying$HttpRetrier.run(Retrying.java:206) ~[gravitino-iceberg-gcp-bundle-1.1.0-SNAPSHOT.jar:?] at com.google.cloud.storage.Retrying$RetrierWithAlgImpl.run(Retrying.java:137) ~[gravitino-iceberg-gcp-bundle-1.1.0-SNAPSHOT.jar:?] at com.google.cloud.storage.ResumableMedia.lambda$startUploadForBlobInfo$1(ResumableMedia.java:34) ~[gravitino-iceberg-gcp-bundle-1.1.0-SNAPSHOT.jar:?] at com.google.cloud.storage.StorageImpl.writer(StorageImpl.java:736) ~[gravitino-iceberg-gcp-bundle-1.1.0-SNAPSHOT.jar:?] at com.google.cloud.storage.StorageImpl.writer(StorageImpl.java:100) ~[gravitino-iceberg-gcp-bundle-1.1.0-SNAPSHOT.jar:?] at org.apache.iceberg.gcp.gcs.GCSOutputStream.openStream(GCSOutputStream.java:114) ~[iceberg-gcp-1.10.0.jar:?] at org.apache.iceberg.gcp.gcs.GCSOutputStream.<init>(GCSOutputStream.java:74) ~[iceberg-gcp-1.10.0.jar:?] at org.apache.iceberg.gcp.gcs.GCSOutputFile.createOrOverwrite(GCSOutputFile.java:63) ~[iceberg-gcp-1.10.0.jar:?] at org.apache.iceberg.TableMetadataParser.internalWrite(TableMetadataParser.java:129) ~[iceberg-core-1.10.0.jar:?] at org.apache.iceberg.TableMetadataParser.overwrite(TableMetadataParser.java:119) ~[iceberg-core-1.10.0.jar:?] at org.apache.iceberg.BaseMetastoreTableOperations.writeNewMetadata(BaseMetastoreTableOperations.java:161) ~[iceberg-core-1.10.0.jar:?] at org.apache.iceberg.BaseMetastoreTableOperations.writeNewMetadataIfRequired(BaseMetastoreTableOperations.java:151) ~[iceberg-core-1.10.0.jar:?] ``` I check the privieges by `gsutil` as following, it seams the service account file has the write privilege. ``` wangdanhua@wangdanhuadeMBP bin % ./gcloud auth activate-service-account --key-file=/Users/wangdanhua/Downloads/tonal-land-XXXXXXXX.json Activated service account credentials for: [[email protected]] wangdanhua@wangdanhuadeMBP bin % ./gsutil ls gs://strato-iceberg gs://strato-iceberg/dir1/ gs://strato-iceberg/lmh/ gs://strato-iceberg/test/ gs://strato-iceberg/test1/ gs://strato-iceberg/test_gvfs_catalog1055/ gs://strato-iceberg/test_gvfs_catalog2853/ gs://strato-iceberg/test_gvfs_catalog3230/ gs://strato-iceberg/test_gvfs_catalog3488/ gs://strato-iceberg/test_gvfs_catalog3530/ gs://strato-iceberg/test_gvfs_catalog4469/ gs://strato-iceberg/test_gvfs_catalog4565/ gs://strato-iceberg/test_gvfs_catalog5350/ gs://strato-iceberg/test_gvfs_catalog5354/ gs://strato-iceberg/test_gvfs_catalog5686/ gs://strato-iceberg/test_gvfs_catalog6119/ gs://strato-iceberg/test_gvfs_catalog7027/ gs://strato-iceberg/test_gvfs_catalog7241/ gs://strato-iceberg/test_gvfs_catalog7264/ gs://strato-iceberg/test_gvfs_catalog7273/ gs://strato-iceberg/test_gvfs_catalog7455/ gs://strato-iceberg/test_gvfs_catalog7458/ gs://strato-iceberg/test_gvfs_catalog7531/ gs://strato-iceberg/test_gvfs_catalog766/ gs://strato-iceberg/test_gvfs_catalog8461/ gs://strato-iceberg/test_gvfs_catalog8478/ gs://strato-iceberg/test_gvfs_catalog8575/ gs://strato-iceberg/test_gvfs_catalog8696/ gs://strato-iceberg/test_gvfs_catalog9792/ wangdanhua@wangdanhuadeMBP bin % ./gsutil ls gs://strato-iceberg/test1 gs://strato-iceberg/test1/ wangdanhua@wangdanhuadeMBP bin % echo "test" | ./gsutil cp - gs://strato-iceberg/test-permission.txt Copying from <STDIN>... / [1 files][ 0.0 B/ 0.0 B] Operation completed over 1 objects. wangdanhua@wangdanhuadeMBP bin % echo "test metadata" | ./gsutil cp - gs://strato-iceberg/test1/dml/test/metadata/test.txt Copying from <STDIN>... / [1 files][ 0.0 B/ 0.0 B] Operation completed over 1 objects. ``` Any other recommedation? @FANNG1 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
