jsingh-yelp opened a new pull request, #8223: URL: https://github.com/apache/paimon/pull/8223
### Purpose This PR truncates column comments written by IcebergHiveMetadataCommitter to 255 characters before syncing them to Hive/Glue metadata. Errortrace: ``` 'table.storageDescriptor.columns.29.member.comment' failed to satisfy constraint: Member must have length less than or equal to 255 (Service: AWSGlue; Status Code: 400; Error Code: ValidationException; Request ID: f75bb3cb-36e2-4979-b38a-c4bec5aeb930; Proxy: null)) ``` AWS Glue rejects FieldSchema.comment values longer than 255 characters, which can cause Paimon commits to fail when Iceberg Hive metadata sync is enabled and an upstream schema field description is too long. The committer now preserves short/null comments unchanged and truncates longer comments with a ... marker while staying within the Glue limit. ### Tests - Added unit tests and tested the change manually as well. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
