jackye1995 commented on issue #3547: URL: https://github.com/apache/iceberg/issues/3547#issuecomment-1004292001
> then Spark should support it +1 It's definitely achieveable in CREATE TABLE DDL, but I don't think using TBLPROPERTIES is a good idea. The table version upgrade makes sense to use a special property because we want all users in all engines to easily upgrade their tables to a newer version, and table properties is the best way as it exists in all versions of the CREATE TABLE DDL. For sort order, different engines have different ways to define that. For example, in Hive DDL, there is a clause `CLUSTERED BY (col_name, col_name, ...) [SORTED BY (col_name [ASC|DESC], ...)] INTO num_buckets BUCKETS` , so if we really want to define sort order in create table, we should implement clauses like this on the engine side. (I am not saying to use the Hive DDL syntax in Spark, we should propose a syntax that could fully support Iceberg sort order features when we do it) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
