pvary commented on PR #15433: URL: https://github.com/apache/iceberg/pull/15433#issuecomment-3957669212
@sqd Could you share a bit more about your use case? Ignoring `DistributionMode` and chaining directly to writers feels quite risky to me, even if the performance gains are tempting. This approach might work if your input records are already correctly distributed. But any mistake there will lead to small files or skewed writes—fast for the writers, but potentially very costly for the readers. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
