openinx commented on a change in pull request #2064:
URL: https://github.com/apache/iceberg/pull/2064#discussion_r562325243
##########
File path: core/src/main/java/org/apache/iceberg/TableProperties.java
##########
@@ -138,6 +138,9 @@ private TableProperties() {
public static final String ENGINE_HIVE_ENABLED = "engine.hive.enabled";
public static final boolean ENGINE_HIVE_ENABLED_DEFAULT = false;
+ public static final String WRITE_SHUFFLE_BY_PARTITION =
"write.shuffle-by.partition";
Review comment:
> Eventually, we want to get to where the table metadata has a sketch of
the data distribution so you can use that to get ranges for a global ordering.
I was also thinking about how to partition the (-oo, +oo) into several even
key ranges ( partition key ranges or sort key ranges) for flink. Seems this
idea is similar to the @stevenzwu 's `list-of-values column stats` from
https://github.com/apache/iceberg/pull/2064#discussion_r559264472 . Yes, that
helps a lot if we have such fine-grained column range stats.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
