diqiu50 opened a new pull request, #14874: URL: https://github.com/apache/gravitino/pull/14874
### What changes were proposed in this pull request? - Remove the catalog-wide NOT NULL capability restriction, and refuse NOT NULL only on Hive-format tables (create, add column and update column nullability). Iceberg tables keep nullability in Iceberg metadata; Iceberg itself refuses changing an optional column to required. - Check `char` and `varchar` lengths against the Hive limits when converting types for Hive-format tables, including nested types. - Update the Glue catalog docs. ### Why are the changes needed? NOT NULL is refused on Iceberg tables although Iceberg supports it, and Hive-format tables accept `char`/`varchar` lengths that Hive-based readers cannot parse. Fix: #14873 ### Does this PR introduce _any_ user-facing change? Yes. - Iceberg tables in a Glue catalog can be created with NOT NULL columns. Changing a column to NOT NULL is refused by Iceberg as an incompatible change instead of by the catalog capability. - Creating or altering a Hive-format table with an out-of-range `char`/`varchar` length now fails. ### How was this patch tested? - Added unit tests in `TestGlueTypeConverter`, `TestGlueCatalogTableOperations`, `TestGlueIcebergTableHelper` and `TestGlueCatalogCapability`. - Added `testIcebergColumnNullability` and `testHiveColumnConstraints` to `AwsGlueCatalogIT`, and ran `AwsGlueCatalogIT` against AWS Glue and `MotoGlueCatalogIT`. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
