pvary commented on PR #15433: URL: https://github.com/apache/iceberg/pull/15433#issuecomment-3990471727
@mxm, @sqd: I think we have a misunderstanding here. In the `DynamicSink` currently the `mode` is set per record, while the pipeline is created when the sink is created. If we create the sink in a way that the operators are chained, then we can't depend on the mode set by the record themselves for routing. Is there a way to have duplicated instances of writers (some chained, some are not chained) and route things out of the chained versions based on the mode? Sideoutput seems like a possibility, but maybe complicating the things so much is an overkill. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
