fhueske commented on issue #6003: [FLINK-9289][Dataset] Parallelism of generated operators should have max parallelism of input URL: https://github.com/apache/flink/pull/6003#issuecomment-411464535 Hi @xccui, in principle uniform handling of operators is a very good idea! However, union is a special operator, because there is no Union runtime operator. An operator that consumes from Union will simply multiplex all unioned inputs. Hence, the parallelism of the (non-existing) union is the parallelism of its successor. Since there is already quite a bit of custom code for union operators, I'm a bit afraid that your fix might cause problems in some corner cases. Another benefit of my approach is that the key extractors can be chained to the previous operators. This is not the case if the extractor is applied on the unioned result. Best, Fabian
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
