Reo-LEI commented on issue #2918: URL: https://github.com/apache/iceberg/issues/2918#issuecomment-907656213
> It doesn't make sense to have a different job parallelism (y) than CDC source parallelism (x). and then have the FlinkSink to do some magic to override the parallelism of an upstream operator that it doesn't own. But CDC source parallelism (x) and job parallelism(y) are out of iceberg and define by user. Dose iceberg should restrict CDC source parallelism must equal to job parallelism? In other hand, if x != y and we don't override the parallelism of the FlinkSink upstream operator, Is there another way to resolve the disorder problem? > I am wondering if we should add a new equalityKeysHash to the DistributionMode. I think we need to discuss the relation between equailty keys and partition keys first. https://github.com/apache/iceberg/pull/2898#discussion_r697882281 @stevenzwu -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
