caseylucas commented on issue #2208: URL: https://github.com/apache/iceberg/issues/2208#issuecomment-775490924
@stevenzwu Thanks for the advice. We're now looking at using the approach (as you mentioned) of doing the demux before the sink. Based on my understanding, we may need to implement our own sink similar to the existing IcebergTableSink but instead of knowing the table name at construction time, we'll lazily determine the table. We'll use the KeyBy transformation in flink so that we end up with one sink per key (which corresponds to an iceberg table in our case.) ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
