[ https://issues.apache.org/jira/browse/BEAM-7049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941410#comment-16941410 ]
sridhar Reddy commented on BEAM-7049: ------------------------------------- [~amaliujia] I just want to make sure that we are on the same page as far as the next steps are concerned. At this point, I am waiting for your instructions on how to proceed further: How to split UNION ALL and UNION and what aspects of SQL Optimizer should be I looking at. Please take your time to update the Jira. I just want to make sure we are not waiting for each other. > Merge multiple input to one BeamUnionRel > ---------------------------------------- > > Key: BEAM-7049 > URL: https://issues.apache.org/jira/browse/BEAM-7049 > Project: Beam > Issue Type: Improvement > Components: dsl-sql > Reporter: Rui Wang > Assignee: sridhar Reddy > Priority: Major > Time Spent: 1h > Remaining Estimate: 0h > > BeamUnionRel assumes inputs are two and rejects more. So `a UNION b UNION c` > will have to be created as UNION(a, UNION(b, c)) and have two shuffles. If > BeamUnionRel can handle multiple shuffles, we will have only one shuffle -- This message was sent by Atlassian Jira (v8.3.4#803005)