aokolnychyi commented on a change in pull request #3461:
URL: https://github.com/apache/iceberg/pull/3461#discussion_r742259595
##########
File path:
spark/v3.2/spark/src/main/java/org/apache/iceberg/spark/source/SparkWriteBuilder.java
##########
@@ -64,13 +75,18 @@
this.writeInfo = info;
this.dsSchema = info.schema();
this.overwriteMode = writeConf.overwriteMode();
+ this.rewrittenFileSetId = writeConf.rewrittenFileSetId();
this.handleTimestampWithoutZone = writeConf.handleTimestampWithoutZone();
+ this.requestDistributionAndOrdering = allIdentityTransforms(table.spec());
Review comment:
I'll add a check if extensions are enabled later. The plan is to have a
rule that would build Iceberg writes and translate all connector transforms to
Iceberg transforms. That can only be done if Iceberg extensions are enabled. If
not, we can only request a distribution and ordering if we have identity
transforms.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]