danhuawang opened a new issue, #10985: URL: https://github.com/apache/gravitino/issues/10985
### Version main branch ### Describe what's wrong Trino create table with partitioning or sorted_by for remote IRC failed. After switch to local IRC, create these 2 kinds table successfully ``` wangdanhua@wangdanhuadeMBP env1-cross-metalake % trino --server http://34.138.225.171:8080 --debug trino> CREATE TABLE remote_irc.gt_db2.lineitem1( -> orderkey bigint, -> partkey bigint, -> suppkey bigint, -> linenumber integer, -> quantity decimal(12, 2), -> extendedprice decimal(12, 2), -> discount decimal(12, 2), -> tax decimal(12, 2), -> returnflag varchar, -> linestatus varchar, -> shipdate date, -> commitdate date, -> receiptdate date, -> shipinstruct varchar, -> shipmode varchar, -> comment varchar -> ) -> WITH ( -> partitioning = ARRAY['year(commitdate)'], -> sorted_by = ARRAY['partkey', 'extendedprice desc'] -> ); Query 20260507_080831_00006_pr4uh failed: Failed to commit the transaction during create table: Server error: BadRequestException: Malformed request: Cannot find source column for partition field: 1000: commitdate_year: year(12) io.trino.spi.TrinoException: Failed to commit the transaction during create table: Server error: BadRequestException: Malformed request: Cannot find source column for partition field: 1000: commitdate_year: year(12) at io.trino.plugin.iceberg.IcebergMetadata.commitTransaction(IcebergMetadata.java:2211) at io.trino.plugin.iceberg.IcebergMetadata.commitUpdateAndTransaction(IcebergMetadata.java:2192) at io.trino.plugin.iceberg.IcebergMetadata.finishCreateTable(IcebergMetadata.java:1499) at io.trino.plugin.iceberg.IcebergMetadata.createTable(IcebergMetadata.java:1357) at io.trino.plugin.base.classloader.ClassLoaderSafeConnectorMetadata.createTable(ClassLoaderSafeConnectorMetadata.java:478) at io.trino.tracing.TracingConnectorMetadata.createTable(TracingConnectorMetadata.java:398) at io.trino.metadata.MetadataManager.createTable(MetadataManager.java:905) at io.trino.tracing.TracingMetadata.createTable(TracingMetadata.java:448) at io.trino.execution.CreateTableTask.internalExecute(CreateTableTask.java:307) at io.trino.execution.CreateTableTask.execute(CreateTableTask.java:129) at io.trino.execution.CreateTableTask.execute(CreateTableTask.java:95) at io.trino.execution.DataDefinitionExecution.start(DataDefinitionExecution.java:153) at io.trino.execution.QueryManager.createQuery(QueryManager.java:317) at io.trino.dispatcher.LocalDispatchQuery.startExecution(LocalDispatchQuery.java:151) at io.trino.dispatcher.LocalDispatchQuery.lambda$waitForMinimumWorkers$1(LocalDispatchQuery.java:135) at io.airlift.concurrent.MoreFutures.lambda$addSuccessCallback$0(MoreFutures.java:570) at io.airlift.concurrent.MoreFutures$3.onSuccess(MoreFutures.java:545) at com.google.common.util.concurrent.Futures$CallbackListener.run(Futures.java:1132) at io.trino.$gen.Trino_480____20260507_075841_2.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1090) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:614) at java.base/java.lang.Thread.run(Thread.java:1474) Caused by: org.apache.iceberg.exceptions.ServiceFailureException: Server error: BadRequestException: Malformed request: Cannot find source column for partition field: 1000: commitdate_year: year(12) at org.apache.iceberg.rest.ErrorHandlers$DefaultErrorHandler.accept(ErrorHandlers.java:243) at org.apache.iceberg.rest.ErrorHandlers$TableErrorHandler.accept(ErrorHandlers.java:124) at org.apache.iceberg.rest.ErrorHandlers$TableErrorHandler.accept(ErrorHandlers.java:108) at org.apache.iceberg.rest.HTTPClient.throwFailure(HTTPClient.java:240) at org.apache.iceberg.rest.HTTPClient.execute(HTTPClient.java:336) at org.apache.iceberg.rest.HTTPClient.execute(HTTPClient.java:297) at org.apache.iceberg.rest.BaseHTTPClient.post(BaseHTTPClient.java:100) at org.apache.iceberg.rest.RESTClient.post(RESTClient.java:126) at org.apache.iceberg.rest.RESTTableOperations.commit(RESTTableOperations.java:159) at org.apache.iceberg.BaseTransaction.commitCreateTransaction(BaseTransaction.java:281) at org.apache.iceberg.BaseTransaction.commitTransaction(BaseTransaction.java:260) at io.trino.plugin.iceberg.IcebergMetadata.commitTransaction(IcebergMetadata.java:2208) ... 21 more ``` ``` trino> CREATE TABLE remote_irc.gt_db2.lineitem1( -> orderkey bigint, -> partkey bigint, -> suppkey bigint, -> linenumber integer, -> quantity decimal(12, 2), -> extendedprice decimal(12, 2), -> discount decimal(12, 2), -> tax decimal(12, 2), -> returnflag varchar, -> linestatus varchar, -> shipdate date, -> commitdate date, -> receiptdate date, -> shipinstruct varchar, -> shipmode varchar, -> comment varchar -> ) -> WITH ( -> sorted_by = ARRAY['partkey', 'extendedprice desc'] -> ); Query 20260507_081004_00007_pr4uh failed: Failed to commit the transaction during create table: Server error: BadRequestException: Malformed request: Cannot find source column for sort field: identity(2) ASC NULLS FIRST io.trino.spi.TrinoException: Failed to commit the transaction during create table: Server error: BadRequestException: Malformed request: Cannot find source column for sort field: identity(2) ASC NULLS FIRST at io.trino.plugin.iceberg.IcebergMetadata.commitTransaction(IcebergMetadata.java:2211) at io.trino.plugin.iceberg.IcebergMetadata.commitUpdateAndTransaction(IcebergMetadata.java:2192) at io.trino.plugin.iceberg.IcebergMetadata.finishCreateTable(IcebergMetadata.java:1499) at io.trino.plugin.iceberg.IcebergMetadata.createTable(IcebergMetadata.java:1357) at io.trino.plugin.base.classloader.ClassLoaderSafeConnectorMetadata.createTable(ClassLoaderSafeConnectorMetadata.java:478) at io.trino.tracing.TracingConnectorMetadata.createTable(TracingConnectorMetadata.java:398) at io.trino.metadata.MetadataManager.createTable(MetadataManager.java:905) at io.trino.tracing.TracingMetadata.createTable(TracingMetadata.java:448) at io.trino.execution.CreateTableTask.internalExecute(CreateTableTask.java:307) at io.trino.execution.CreateTableTask.execute(CreateTableTask.java:129) at io.trino.execution.CreateTableTask.execute(CreateTableTask.java:95) at io.trino.execution.DataDefinitionExecution.start(DataDefinitionExecution.java:153) at io.trino.execution.QueryManager.createQuery(QueryManager.java:317) at io.trino.dispatcher.LocalDispatchQuery.startExecution(LocalDispatchQuery.java:151) at io.trino.dispatcher.LocalDispatchQuery.lambda$waitForMinimumWorkers$1(LocalDispatchQuery.java:135) at io.airlift.concurrent.MoreFutures.lambda$addSuccessCallback$0(MoreFutures.java:570) at io.airlift.concurrent.MoreFutures$3.onSuccess(MoreFutures.java:545) at com.google.common.util.concurrent.Futures$CallbackListener.run(Futures.java:1132) at io.trino.$gen.Trino_480____20260507_075841_2.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1090) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:614) at java.base/java.lang.Thread.run(Thread.java:1474) Caused by: org.apache.iceberg.exceptions.ServiceFailureException: Server error: BadRequestException: Malformed request: Cannot find source column for sort field: identity(2) ASC NULLS FIRST at org.apache.iceberg.rest.ErrorHandlers$DefaultErrorHandler.accept(ErrorHandlers.java:243) at org.apache.iceberg.rest.ErrorHandlers$TableErrorHandler.accept(ErrorHandlers.java:124) at org.apache.iceberg.rest.ErrorHandlers$TableErrorHandler.accept(ErrorHandlers.java:108) at org.apache.iceberg.rest.HTTPClient.throwFailure(HTTPClient.java:240) at org.apache.iceberg.rest.HTTPClient.execute(HTTPClient.java:336) at org.apache.iceberg.rest.HTTPClient.execute(HTTPClient.java:297) at org.apache.iceberg.rest.BaseHTTPClient.post(BaseHTTPClient.java:100) at org.apache.iceberg.rest.RESTClient.post(RESTClient.java:126) at org.apache.iceberg.rest.RESTTableOperations.commit(RESTTableOperations.java:159) at org.apache.iceberg.BaseTransaction.commitCreateTransaction(BaseTransaction.java:281) at org.apache.iceberg.BaseTransaction.commitTransaction(BaseTransaction.java:260) at io.trino.plugin.iceberg.IcebergMetadata.commitTransaction(IcebergMetadata.java:2208) ... 21 more trino> ``` ### Error message and/or stacktrace ``` 2026-05-07 08:05:20.534 INFO [iceberg-rest-36] [org.apache.gravitino.iceberg.service.rest.IcebergTableOperations.createTable(IcebergTableOperations.java:169)] - Create Iceberg table, catalog: catalog_1, namespace: test_db, create table request: CreateTableRequest{name=feature_table_t2, location=null, properties={}, schema=table { }, partitionSpec=null, writeOrder=null, stageCreate=true}, accessDelegation: vended-credentials, isCredentialVending: true 2026-05-07 08:05:20.535 INFO [iceberg-rest-36] [org.apache.iceberg.BaseMetastoreCatalog$BaseMetastoreCatalogTableBuilder.tableDefaultProperties(BaseMetastoreCatalog.java:269)] - Table properties set at catalog level through catalog properties: {} 2026-05-07 08:05:20.536 INFO [iceberg-rest-36] [org.apache.iceberg.BaseMetastoreCatalog$BaseMetastoreCatalogTableBuilder.tableOverrideProperties(BaseMetastoreCatalog.java:283)] - Table properties enforced at catalog level through catalog properties: {} 2026-05-07 08:05:20.575 INFO [iceberg-rest-36] [org.apache.gravitino.iceberg.service.CatalogWrapperForREST.injectCredentialConfig(CatalogWrapperForREST.java:312)] - Generate credential: s3-token for Iceberg table: test_db.feature_table_t2 2026-05-07 08:05:20.585 INFO [iceberg-rest-43] [org.casbin.jcasbin.util.Util.logEnforce(Util.java:115)] - Request: [839279769178943184, METALAKE, 1365525684669152879, USE_CATALOG] ---> true 2026-05-07 08:05:20.585 INFO [iceberg-rest-43] [org.casbin.jcasbin.util.Util.logEnforce(Util.java:117)] - Hit Policy: [2891671032967709200, METALAKE, 1365525684669152879, USE_CATALOG, allow] 2026-05-07 08:05:20.586 INFO [iceberg-rest-43] [org.casbin.jcasbin.util.Util.logEnforce(Util.java:115)] - Request: [839279769178943184, METALAKE, 1365525684669152879, USE_CATALOG] ---> false 2026-05-07 08:05:20.586 INFO [iceberg-rest-43] [org.casbin.jcasbin.util.Util.logEnforce(Util.java:117)] - Hit Policy: [] 2026-05-07 08:05:20.586 INFO [iceberg-rest-43] [org.casbin.jcasbin.util.Util.logEnforce(Util.java:115)] - Request: [839279769178943184, CATALOG, 1836798795800232444, USE_CATALOG] ---> false 2026-05-07 08:05:20.586 INFO [iceberg-rest-43] [org.casbin.jcasbin.util.Util.logEnforce(Util.java:117)] - Hit Policy: [] 2026-05-07 08:05:20.586 INFO [iceberg-rest-43] [org.apache.gravitino.iceberg.service.rest.IcebergTableOperations.updateTable(IcebergTableOperations.java:214)] - Update Iceberg table, catalog: catalog_1, namespace: test_db, table: feature_table_t2, updateTableRequest: {"requirements":[{"type":"assert-create"}],"updates":[{"action":"assign-uuid","uuid":"b952dc5e-512a-4cbd-97c6-f66217d93752"},{"action":"upgrade-format-version","format-version":2},{"action":"add-schema","schema":{"type":"struct","schema-id":0,"fields":[]},"last-column-id":0},{"action":"set-current-schema","schema-id":-1},{"action":"add-spec","spec":{"spec-id":0,"fields":[]}},{"action":"set-default-spec","spec-id":-1},{"action":"add-sort-order","sort-order":{"order-id":0,"fields":[]}},{"action":"set-default-sort-order","sort-order-id":-1},{"action":"set-location","location":"s3://irc-e2e-env1-metalake-b-warehouse/env1/metalake_b/catalog_1/test_db/feature_table_t2"},{"action":"set-properties","updates":{"owner":"service -account-postman-client","created-at":"2026-05-07T08:05:20.535748965Z","write.parquet.compression-codec":"zstd"}},{"action":"assign-uuid","uuid":"46b7cb57-7add-4026-877e-48738aeb6ceb"},{"action":"add-schema","schema":{"type":"struct","schema-id":0,"fields":[{"id":1,"name":"id","required":false,"type":"long"},{"id":2,"name":"data","required":false,"type":"string"},{"id":3,"name":"category","required":false,"type":"string"},{"id":4,"name":"ts","required":false,"type":"timestamptz"}]},"last-column-id":4},{"action":"add-spec","spec":{"spec-id":0,"fields":[{"name":"category","transform":"identity","source-id":3,"field-id":1000}]}},{"action":"add-sort-order","sort-order":{"order-id":0,"fields":[]}},{"action":"set-location","location":"s3://irc-e2e-env1-metalake-b-warehouse/env1/metalake_b/catalog_1/test_db/feature_table_t2-67585ebe282d45958f373f1ece27afdd"},{"action":"set-properties","updates":{"owner":"service-account-postman-client","created-at":"2026-05-07T08:05:20.071139917Z","write.f ormat.default":"PARQUET","write.parquet.compression-codec":""}},{"action":"remove-properties","removals":["write.parquet.compression-codec"]},{"action":"add-snapshot","snapshot":{"sequence-number":1,"snapshot-id":3109127741924565809,"timestamp-ms":1778141120418,"summary":{"operation":"append","trino_query_id":"20260507_080519_00005_pr4uh","trino_user":"wangdanhua","changed-partition-count":"0","total-records":"0","total-files-size":"0","total-data-files":"0","total-delete-files":"0","total-position-deletes":"0","total-equality-deletes":"0","engine-version":"480","engine-name":"trino","iceberg-version":"Apache Iceberg 1.10.1 (commit ccb8bc435062171e64bc8b7e5f56e6aed9c5b934)"},"manifest-list":"s3://irc-e2e-env1-metalake-b-warehouse/env1/metalake_b/catalog_1/test_db/feature_table_t2-67585ebe282d45958f373f1ece27afdd/metadata/snap-3109127741924565809-1-2194ec88-0454-4b75-8f13-96b9c4a88bc3.avro","schema-id":0}},{"action":"set-snapshot-ref","ref-name":"main","snapshot-id":31091277419245658 09,"type":"branch"}]} 2026-05-07 08:05:20.587 INFO [iceberg-rest-43] [org.apache.iceberg.BaseMetastoreCatalog$BaseMetastoreCatalogTableBuilder.tableDefaultProperties(BaseMetastoreCatalog.java:269)] - Table properties set at catalog level through catalog properties: {} 2026-05-07 08:05:20.587 INFO [iceberg-rest-43] [org.apache.iceberg.BaseMetastoreCatalog$BaseMetastoreCatalogTableBuilder.tableOverrideProperties(BaseMetastoreCatalog.java:283)] - Table properties enforced at catalog level through catalog properties: {} 2026-05-07 08:05:20.589 INFO [iceberg-rest-43] [org.apache.gravitino.iceberg.service.IcebergExceptionMapper.toRESTResponse(IcebergExceptionMapper.java:136)] - Iceberg REST server error maybe caused by user request, response http status: 400, exception: class org.apache.iceberg.exceptions.ValidationException, exception message: Cannot find source column for partition field: 1000: category: identity(3) ``` ``` 2026-05-07 08:08:32.992 INFO [iceberg-rest-36] [org.apache.gravitino.iceberg.service.rest.IcebergTableOperations.loadTable(IcebergTableOperations.java:301)] - Load Iceberg table, catalog: catalog_1, namespace: gt_db2, table: lineitem1, access delegation: vended-credentials, credential vending: true 2026-05-07 08:08:32.994 INFO [iceberg-rest-36] [org.apache.gravitino.iceberg.service.IcebergExceptionMapper.toRESTResponse(IcebergExceptionMapper.java:136)] - Iceberg REST server error maybe caused by user request, response http status: 404, exception: class org.apache.iceberg.exceptions.NoSuchTableException, exception message: Table does not exist: gt_db2.lineitem1 2026-05-07 08:08:33.044 INFO [iceberg-rest-41] [org.casbin.jcasbin.util.Util.logEnforce(Util.java:115)] - Request: [839279769178943184, METALAKE, 1365525684669152879, USE_CATALOG] ---> true 2026-05-07 08:08:33.045 INFO [iceberg-rest-41] [org.casbin.jcasbin.util.Util.logEnforce(Util.java:117)] - Hit Policy: [2891671032967709200, METALAKE, 1365525684669152879, USE_CATALOG, allow] 2026-05-07 08:08:33.045 INFO [iceberg-rest-41] [org.casbin.jcasbin.util.Util.logEnforce(Util.java:115)] - Request: [839279769178943184, METALAKE, 1365525684669152879, USE_CATALOG] ---> false 2026-05-07 08:08:33.045 INFO [iceberg-rest-41] [org.casbin.jcasbin.util.Util.logEnforce(Util.java:117)] - Hit Policy: [] 2026-05-07 08:08:33.045 INFO [iceberg-rest-41] [org.casbin.jcasbin.util.Util.logEnforce(Util.java:115)] - Request: [839279769178943184, CATALOG, 1836798795800232444, USE_CATALOG] ---> false 2026-05-07 08:08:33.045 INFO [iceberg-rest-41] [org.casbin.jcasbin.util.Util.logEnforce(Util.java:117)] - Hit Policy: [] 2026-05-07 08:08:33.045 INFO [iceberg-rest-41] [org.apache.gravitino.iceberg.service.rest.IcebergNamespaceOperations.namespaceExists(IcebergNamespaceOperations.java:174)] - Check Iceberg namespace exists, catalog: catalog_1, namespace: gt_db2 2026-05-07 08:08:33.072 INFO [iceberg-rest-42] [org.casbin.jcasbin.util.Util.logEnforce(Util.java:115)] - Request: [839279769178943184, METALAKE, 1365525684669152879, USE_CATALOG] ---> true 2026-05-07 08:08:33.072 INFO [iceberg-rest-42] [org.casbin.jcasbin.util.Util.logEnforce(Util.java:117)] - Hit Policy: [2891671032967709200, METALAKE, 1365525684669152879, USE_CATALOG, allow] 2026-05-07 08:08:33.072 INFO [iceberg-rest-42] [org.casbin.jcasbin.util.Util.logEnforce(Util.java:115)] - Request: [839279769178943184, METALAKE, 1365525684669152879, USE_CATALOG] ---> false 2026-05-07 08:08:33.072 INFO [iceberg-rest-42] [org.casbin.jcasbin.util.Util.logEnforce(Util.java:117)] - Hit Policy: [] 2026-05-07 08:08:33.072 INFO [iceberg-rest-42] [org.casbin.jcasbin.util.Util.logEnforce(Util.java:115)] - Request: [839279769178943184, CATALOG, 1836798795800232444, USE_CATALOG] ---> false 2026-05-07 08:08:33.072 INFO [iceberg-rest-42] [org.casbin.jcasbin.util.Util.logEnforce(Util.java:117)] - Hit Policy: [] 2026-05-07 08:08:33.072 INFO [iceberg-rest-42] [org.apache.gravitino.iceberg.service.rest.IcebergNamespaceOperations.loadNamespace(IcebergNamespaceOperations.java:143)] - Load Iceberg namespace, catalog: catalog_1, namespace: gt_db2 2026-05-07 08:08:33.125 INFO [iceberg-rest-38] [org.casbin.jcasbin.util.Util.logEnforce(Util.java:115)] - Request: [839279769178943184, METALAKE, 1365525684669152879, USE_CATALOG] ---> true 2026-05-07 08:08:33.125 INFO [iceberg-rest-38] [org.casbin.jcasbin.util.Util.logEnforce(Util.java:117)] - Hit Policy: [2891671032967709200, METALAKE, 1365525684669152879, USE_CATALOG, allow] 2026-05-07 08:08:33.126 INFO [iceberg-rest-38] [org.casbin.jcasbin.util.Util.logEnforce(Util.java:115)] - Request: [839279769178943184, METALAKE, 1365525684669152879, USE_CATALOG] ---> false 2026-05-07 08:08:33.126 INFO [iceberg-rest-38] [org.casbin.jcasbin.util.Util.logEnforce(Util.java:117)] - Hit Policy: [] 2026-05-07 08:08:33.126 INFO [iceberg-rest-38] [org.casbin.jcasbin.util.Util.logEnforce(Util.java:115)] - Request: [839279769178943184, CATALOG, 1836798795800232444, USE_CATALOG] ---> false 2026-05-07 08:08:33.126 INFO [iceberg-rest-38] [org.casbin.jcasbin.util.Util.logEnforce(Util.java:117)] - Hit Policy: [] 2026-05-07 08:08:33.126 INFO [iceberg-rest-38] [org.apache.gravitino.iceberg.service.rest.IcebergTableOperations.tableExists(IcebergTableOperations.java:366)] - Check Iceberg table exists, catalog: catalog_1, namespace: gt_db2, table: lineitem1 2026-05-07 08:08:33.145 INFO [iceberg-rest-43] [org.casbin.jcasbin.util.Util.logEnforce(Util.java:115)] - Request: [839279769178943184, METALAKE, 1365525684669152879, USE_CATALOG] ---> true 2026-05-07 08:08:33.145 INFO [iceberg-rest-43] [org.casbin.jcasbin.util.Util.logEnforce(Util.java:117)] - Hit Policy: [2891671032967709200, METALAKE, 1365525684669152879, USE_CATALOG, allow] 2026-05-07 08:08:33.146 INFO [iceberg-rest-43] [org.casbin.jcasbin.util.Util.logEnforce(Util.java:115)] - Request: [839279769178943184, METALAKE, 1365525684669152879, USE_CATALOG] ---> false 2026-05-07 08:08:33.146 INFO [iceberg-rest-43] [org.casbin.jcasbin.util.Util.logEnforce(Util.java:117)] - Hit Policy: [] 2026-05-07 08:08:33.146 INFO [iceberg-rest-43] [org.casbin.jcasbin.util.Util.logEnforce(Util.java:115)] - Request: [839279769178943184, CATALOG, 1836798795800232444, USE_CATALOG] ---> false 2026-05-07 08:08:33.146 INFO [iceberg-rest-43] [org.casbin.jcasbin.util.Util.logEnforce(Util.java:117)] - Hit Policy: [] 2026-05-07 08:08:33.146 INFO [iceberg-rest-43] [org.apache.gravitino.iceberg.service.rest.IcebergTableOperations.createTable(IcebergTableOperations.java:169)] - Create Iceberg table, catalog: catalog_1, namespace: gt_db2, create table request: CreateTableRequest{name=lineitem1, location=s3://irc-e2e-env1-metalake-b-warehouse/env1/metalake_b/catalog_1/gt_db2/lineitem1-e94030d54a184b628e15efd15a5ecf30, properties={owner=service-account-postman-client, write.format.default=PARQUET, write.parquet.compression-codec=, format-version=2, created-at=2026-05-07T08:08:33.129079690Z}, schema=table { 1: orderkey: optional long 2: partkey: optional long 3: suppkey: optional long 4: linenumber: optional int 5: quantity: optional decimal(12, 2) 6: extendedprice: optional decimal(12, 2) 7: discount: optional decimal(12, 2) 8: tax: optional decimal(12, 2) 9: returnflag: optional string 10: linestatus: optional string 11: shipdate: optional date 12: commitdate: optional date 13: receiptdate: optional date 14: shipinstruct: optional string 15: shipmode: optional string 16: comment: optional string }, partitionSpec=org.apache.iceberg.UnboundPartitionSpec@688820d2, writeOrder=org.apache.iceberg.UnboundSortOrder@5e4ef7b8, stageCreate=true}, accessDelegation: vended-credentials, isCredentialVending: true 2026-05-07 08:08:33.286 INFO [iceberg-rest-43] [org.apache.gravitino.iceberg.service.CatalogWrapperForREST.injectCredentialConfig(CatalogWrapperForREST.java:312)] - Generate credential: s3-token for Iceberg table: gt_db2.lineitem1 2026-05-07 08:08:33.587 INFO [iceberg-rest-40] [org.casbin.jcasbin.util.Util.logEnforce(Util.java:115)] - Request: [839279769178943184, METALAKE, 1365525684669152879, USE_CATALOG] ---> true 2026-05-07 08:08:33.587 INFO [iceberg-rest-40] [org.casbin.jcasbin.util.Util.logEnforce(Util.java:117)] - Hit Policy: [2891671032967709200, METALAKE, 1365525684669152879, USE_CATALOG, allow] 2026-05-07 08:08:33.587 INFO [iceberg-rest-40] [org.casbin.jcasbin.util.Util.logEnforce(Util.java:115)] - Request: [839279769178943184, METALAKE, 1365525684669152879, USE_CATALOG] ---> false 2026-05-07 08:08:33.587 INFO [iceberg-rest-40] [org.casbin.jcasbin.util.Util.logEnforce(Util.java:117)] - Hit Policy: [] 2026-05-07 08:08:33.587 INFO [iceberg-rest-40] [org.casbin.jcasbin.util.Util.logEnforce(Util.java:115)] - Request: [839279769178943184, CATALOG, 1836798795800232444, USE_CATALOG] ---> false 2026-05-07 08:08:33.587 INFO [iceberg-rest-40] [org.casbin.jcasbin.util.Util.logEnforce(Util.java:117)] - Hit Policy: [] 2026-05-07 08:08:33.587 INFO [iceberg-rest-40] [org.apache.gravitino.iceberg.service.rest.IcebergViewOperations.viewExists(IcebergViewOperations.java:293)] - Check Iceberg view exists, catalog: catalog_1, namespace: gt_db2, view: lineitem1 2026-05-07 08:08:33.595 INFO [iceberg-rest-39] [org.casbin.jcasbin.util.Util.logEnforce(Util.java:115)] - Request: [839279769178943184, METALAKE, 1365525684669152879, USE_CATALOG] ---> true 2026-05-07 08:08:33.595 INFO [iceberg-rest-39] [org.casbin.jcasbin.util.Util.logEnforce(Util.java:117)] - Hit Policy: [2891671032967709200, METALAKE, 1365525684669152879, USE_CATALOG, allow] 2026-05-07 08:08:33.595 INFO [iceberg-rest-39] [org.casbin.jcasbin.util.Util.logEnforce(Util.java:115)] - Request: [839279769178943184, METALAKE, 1365525684669152879, USE_CATALOG] ---> false 2026-05-07 08:08:33.595 INFO [iceberg-rest-39] [org.casbin.jcasbin.util.Util.logEnforce(Util.java:117)] - Hit Policy: [] 2026-05-07 08:08:33.595 INFO [iceberg-rest-39] [org.casbin.jcasbin.util.Util.logEnforce(Util.java:115)] - Request: [839279769178943184, CATALOG, 1836798795800232444, USE_CATALOG] ---> false 2026-05-07 08:08:33.595 INFO [iceberg-rest-39] [org.casbin.jcasbin.util.Util.logEnforce(Util.java:117)] - Hit Policy: [] 2026-05-07 08:08:33.595 INFO [iceberg-rest-39] [org.apache.gravitino.iceberg.service.rest.IcebergTableOperations.loadTable(IcebergTableOperations.java:301)] - Load Iceberg table, catalog: catalog_1, namespace: gt_db2, table: lineitem1, access delegation: vended-credentials, credential vending: true 2026-05-07 08:08:33.597 INFO [iceberg-rest-39] [org.apache.gravitino.iceberg.service.IcebergExceptionMapper.toRESTResponse(IcebergExceptionMapper.java:136)] - Iceberg REST server error maybe caused by user request, response http status: 404, exception: class org.apache.iceberg.exceptions.NoSuchTableException, exception message: Table does not exist: gt_db2.lineitem1 2026-05-07 08:08:33.605 INFO [iceberg-rest-36] [org.casbin.jcasbin.util.Util.logEnforce(Util.java:115)] - Request: [839279769178943184, METALAKE, 1365525684669152879, USE_CATALOG] ---> true 2026-05-07 08:08:33.605 INFO [iceberg-rest-36] [org.casbin.jcasbin.util.Util.logEnforce(Util.java:117)] - Hit Policy: [2891671032967709200, METALAKE, 1365525684669152879, USE_CATALOG, allow] 2026-05-07 08:08:33.605 INFO [iceberg-rest-36] [org.casbin.jcasbin.util.Util.logEnforce(Util.java:115)] - Request: [839279769178943184, METALAKE, 1365525684669152879, USE_CATALOG] ---> false 2026-05-07 08:08:33.605 INFO [iceberg-rest-36] [org.casbin.jcasbin.util.Util.logEnforce(Util.java:117)] - Hit Policy: [] 2026-05-07 08:08:33.605 INFO [iceberg-rest-36] [org.casbin.jcasbin.util.Util.logEnforce(Util.java:115)] - Request: [839279769178943184, CATALOG, 1836798795800232444, USE_CATALOG] ---> false 2026-05-07 08:08:33.606 INFO [iceberg-rest-36] [org.casbin.jcasbin.util.Util.logEnforce(Util.java:117)] - Hit Policy: [] 2026-05-07 08:08:33.606 INFO [iceberg-rest-36] [org.apache.gravitino.iceberg.service.rest.IcebergTableOperations.createTable(IcebergTableOperations.java:169)] - Create Iceberg table, catalog: catalog_1, namespace: gt_db2, create table request: CreateTableRequest{name=lineitem1, location=null, properties={}, schema=table { }, partitionSpec=null, writeOrder=null, stageCreate=true}, accessDelegation: vended-credentials, isCredentialVending: true 2026-05-07 08:08:33.607 INFO [iceberg-rest-36] [org.apache.iceberg.BaseMetastoreCatalog$BaseMetastoreCatalogTableBuilder.tableDefaultProperties(BaseMetastoreCatalog.java:269)] - Table properties set at catalog level through catalog properties: {} 2026-05-07 08:08:33.607 INFO [iceberg-rest-36] [org.apache.iceberg.BaseMetastoreCatalog$BaseMetastoreCatalogTableBuilder.tableOverrideProperties(BaseMetastoreCatalog.java:283)] - Table properties enforced at catalog level through catalog properties: {} 2026-05-07 08:08:33.650 INFO [iceberg-rest-36] [org.apache.gravitino.iceberg.service.CatalogWrapperForREST.injectCredentialConfig(CatalogWrapperForREST.java:312)] - Generate credential: s3-token for Iceberg table: gt_db2.lineitem1 2026-05-07 08:08:33.661 INFO [iceberg-rest-41] [org.casbin.jcasbin.util.Util.logEnforce(Util.java:115)] - Request: [839279769178943184, METALAKE, 1365525684669152879, USE_CATALOG] ---> true 2026-05-07 08:08:33.661 INFO [iceberg-rest-41] [org.casbin.jcasbin.util.Util.logEnforce(Util.java:117)] - Hit Policy: [2891671032967709200, METALAKE, 1365525684669152879, USE_CATALOG, allow] 2026-05-07 08:08:33.661 INFO [iceberg-rest-41] [org.casbin.jcasbin.util.Util.logEnforce(Util.java:115)] - Request: [839279769178943184, METALAKE, 1365525684669152879, USE_CATALOG] ---> false 2026-05-07 08:08:33.661 INFO [iceberg-rest-41] [org.casbin.jcasbin.util.Util.logEnforce(Util.java:117)] - Hit Policy: [] 2026-05-07 08:08:33.661 INFO [iceberg-rest-41] [org.casbin.jcasbin.util.Util.logEnforce(Util.java:115)] - Request: [839279769178943184, CATALOG, 1836798795800232444, USE_CATALOG] ---> false 2026-05-07 08:08:33.661 INFO [iceberg-rest-41] [org.casbin.jcasbin.util.Util.logEnforce(Util.java:117)] - Hit Policy: [] 2026-05-07 08:08:33.662 INFO [iceberg-rest-41] [org.apache.gravitino.iceberg.service.rest.IcebergTableOperations.updateTable(IcebergTableOperations.java:214)] - Update Iceberg table, catalog: catalog_1, namespace: gt_db2, table: lineitem1, updateTableRequest: {"requirements":[{"type":"assert-create"}],"updates":[{"action":"assign-uuid","uuid":"2c7d5afa-2e1a-4ca9-b76a-a2aa675d5253"},{"action":"upgrade-format-version","format-version":2},{"action":"add-schema","schema":{"type":"struct","schema-id":0,"fields":[]},"last-column-id":0},{"action":"set-current-schema","schema-id":-1},{"action":"add-spec","spec":{"spec-id":0,"fields":[]}},{"action":"set-default-spec","spec-id":-1},{"action":"add-sort-order","sort-order":{"order-id":0,"fields":[]}},{"action":"set-default-sort-order","sort-order-id":-1},{"action":"set-location","location":"s3://irc-e2e-env1-metalake-b-warehouse/env1/metalake_b/catalog_1/gt_db2/lineitem1"},{"action":"set-properties","updates":{"owner":"service-account-postman -client","created-at":"2026-05-07T08:08:33.607163022Z","write.parquet.compression-codec":"zstd"}},{"action":"assign-uuid","uuid":"7c5d5731-a933-4f4e-a053-dae0e349364d"},{"action":"add-schema","schema":{"type":"struct","schema-id":0,"fields":[{"id":1,"name":"orderkey","required":false,"type":"long"},{"id":2,"name":"partkey","required":false,"type":"long"},{"id":3,"name":"suppkey","required":false,"type":"long"},{"id":4,"name":"linenumber","required":false,"type":"int"},{"id":5,"name":"quantity","required":false,"type":"decimal(12, 2)"},{"id":6,"name":"extendedprice","required":false,"type":"decimal(12, 2)"},{"id":7,"name":"discount","required":false,"type":"decimal(12, 2)"},{"id":8,"name":"tax","required":false,"type":"decimal(12, 2)"},{"id":9,"name":"returnflag","required":false,"type":"string"},{"id":10,"name":"linestatus","required":false,"type":"string"},{"id":11,"name":"shipdate","required":false,"type":"date"},{"id":12,"name":"commitdate","required":false,"type":"date"},{"id":1 3,"name":"receiptdate","required":false,"type":"date"},{"id":14,"name":"shipinstruct","required":false,"type":"string"},{"id":15,"name":"shipmode","required":false,"type":"string"},{"id":16,"name":"comment","required":false,"type":"string"}]},"last-column-id":16},{"action":"add-spec","spec":{"spec-id":0,"fields":[{"name":"commitdate_year","transform":"year","source-id":12,"field-id":1000}]}},{"action":"add-sort-order","sort-order":{"order-id":1,"fields":[{"transform":"identity","source-id":2,"direction":"asc","null-order":"nulls-first"},{"transform":"identity","source-id":6,"direction":"desc","null-order":"nulls-last"}]}},{"action":"set-default-sort-order","sort-order-id":-1},{"action":"set-location","location":"s3://irc-e2e-env1-metalake-b-warehouse/env1/metalake_b/catalog_1/gt_db2/lineitem1-e94030d54a184b628e15efd15a5ecf30"},{"action":"set-properties","updates":{"owner":"service-account-postman-client","created-at":"2026-05-07T08:08:33.129079690Z","write.format.default":"PARQUET", "write.parquet.compression-codec":""}},{"action":"remove-properties","removals":["write.parquet.compression-codec"]},{"action":"add-snapshot","snapshot":{"sequence-number":1,"snapshot-id":3795127771704359233,"timestamp-ms":1778141313565,"summary":{"operation":"append","trino_query_id":"20260507_080831_00006_pr4uh","trino_user":"wangdanhua","changed-partition-count":"0","total-records":"0","total-files-size":"0","total-data-files":"0","total-delete-files":"0","total-position-deletes":"0","total-equality-deletes":"0","engine-version":"480","engine-name":"trino","iceberg-version":"Apache Iceberg 1.10.1 (commit ccb8bc435062171e64bc8b7e5f56e6aed9c5b934)"},"manifest-list":"s3://irc-e2e-env1-metalake-b-warehouse/env1/metalake_b/catalog_1/gt_db2/lineitem1-e94030d54a184b628e15efd15a5ecf30/metadata/snap-3795127771704359233-1-72a9a429-19d3-40ba-8c5d-951838a6cc84.avro","schema-id":0}},{"action":"set-snapshot-ref","ref-name":"main","snapshot-id":3795127771704359233,"type":"branch"}]} 2026-05-07 08:08:33.663 INFO [iceberg-rest-41] [org.apache.iceberg.BaseMetastoreCatalog$BaseMetastoreCatalogTableBuilder.tableDefaultProperties(BaseMetastoreCatalog.java:269)] - Table properties set at catalog level through catalog properties: {} 2026-05-07 08:08:33.663 INFO [iceberg-rest-41] [org.apache.iceberg.BaseMetastoreCatalog$BaseMetastoreCatalogTableBuilder.tableOverrideProperties(BaseMetastoreCatalog.java:283)] - Table properties enforced at catalog level through catalog properties: {} 2026-05-07 08:08:33.705 INFO [iceberg-rest-41] [org.apache.gravitino.iceberg.service.IcebergExceptionMapper.toRESTResponse(IcebergExceptionMapper.java:136)] - Iceberg REST server error maybe caused by user request, response http status: 400, exception: class org.apache.iceberg.exceptions.ValidationException, exception message: Cannot find source column for partition field: 1000: commitdate_year: year(12) ``` ### How to reproduce trino 480 , connect remote IRC catalog ``` CREATE TABLE remote_irc.gt_db2.lineitem1( orderkey bigint, partkey bigint, suppkey bigint, linenumber integer, quantity decimal(12, 2), extendedprice decimal(12, 2), discount decimal(12, 2), tax decimal(12, 2), returnflag varchar, linestatus varchar, shipdate date, commitdate date, receiptdate date, shipinstruct varchar, shipmode varchar, comment varchar ) WITH ( partitioning = ARRAY['year(commitdate)'], sorted_by = ARRAY['partkey', 'extendedprice desc'] ); CREATE TABLE remote_irc.gt_db2.lineitem1( orderkey bigint, partkey bigint, suppkey bigint, linenumber integer, quantity decimal(12, 2), extendedprice decimal(12, 2), discount decimal(12, 2), tax decimal(12, 2), returnflag varchar, linestatus varchar, shipdate date, commitdate date, receiptdate date, shipinstruct varchar, shipmode varchar, comment varchar ) WITH ( sorted_by = ARRAY['partkey', 'extendedprice desc'] ); ``` ### Additional context _No response_ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
