sqd commented on code in PR #16065:
URL: https://github.com/apache/iceberg/pull/16065#discussion_r3221103964
##########
docs/docs/flink-writes.md:
##########
@@ -550,6 +550,8 @@ The Dynamic Iceberg Flink Sink is configured using the
Builder pattern. Here are
| `setAll(Map<String, String> properties)` | Set multiple
properties at once
|
| `tableCreator(TableCreator creator)` | When DynamicIcebergSink creates new
Iceberg tables, allows overriding how tables are created - setting custom table
properties and location based on the table name. |
| `dropUnusedColumns(boolean enabled)` | When enabled, drops
all columns from the current table schema which are not contained in the input
schema (see the caveats above on dropping columns). |
+| `shuffeSinkSlotSharingGroup(SlotSharingGroup ssg)` | Set the [slot sharing
group](https://nightlies.apache.org/flink/flink-docs-stable/docs/deployment/finegrained_resource/)
for the shuffle sink. |
+| `generatorSlotSharingGroup(SlotSharingGroup ssg)` | Set the [slot sharing
group](https://nightlies.apache.org/flink/flink-docs-stable/docs/deployment/finegrained_resource/)
for the generator (and forward sink chained to it). |
Review Comment:
I think it's probably going to be too messy, because we'll have to make a
config translation layer to set cpu/heap/off heap/managed, and even external
resource if we want to support everything Flink offers.
https://nightlies.apache.org/flink/flink-docs-stable/docs/deployment/finegrained_resource/#:~:text=you%20can%20set%20the%20following%20resource%20components%20for%20the%20slot%20sharing%20group
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
