diqiu50 opened a new pull request, #14588: URL: https://github.com/apache/gravitino/pull/14588
### What changes were proposed in this pull request? Trino connector: - Compare Trino catalog names without quotes and case when registering and dropping catalogs. - Leave out columns whose type Trino cannot represent, and name types in SQL terms in errors. - Convert partitioning and sort order of Iceberg tables in a Glue catalog the Iceberg way. - Accept `timestamp(6)` for Iceberg tables; keep `timestamp(3)` for Hive-format tables and name the format in the error. - Use the catalog's `default-table-format` when a statement sets no `type`, and do not ask the lakehouse connector for the layout of a CTAS table. - Derive `format` and `type` of Hive-format tables from their storage classes. - Document that Trino logs the AWS access key ID of static credentials, and how to avoid it. Spark connector: - Use the Iceberg type mapping for Iceberg tables in a Glue catalog on create, load and alter. This PR is based on #14565 and includes its commits. ### Why are the changes needed? Glue catalog tables could not be queried or created through Trino in common cases, and Spark wrote Iceberg timestamps with the wrong type. Fixes #14587 ### Does this PR introduce _any_ user-facing change? Yes. - In Trino, columns of types Trino cannot represent are hidden instead of failing the whole table; this applies to all catalogs. - In Trino, `SHOW CREATE TABLE` of Glue Hive-format tables shows `type` and `format`; transform sort terms of Iceberg tables are not shown. - In Spark, a `timestamp` column of a new Iceberg table in a Glue catalog is an Iceberg `timestamptz`, and `timestamp_ntz` is supported. ### How was this patch tested? - Added unit tests in the Trino connector; all Trino versions passed (469-472, 473-477, 478-479, 480, 481, 482-483). - Added unit tests in the Spark connector; `spark-3.5` passed (249) and `spark-4.0` compiles. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
