GitHub user HanumathRao opened a pull request:
DRILL-6115: SingleMergeExchange is not scaling up when many minor fraâ¦
â¦gments are allocated for a query.
Currently a singlemerge exchange is merging all the fragment streams on
foreman. This can cause cpu bottleneck and also huge memory consumption at the
This PR contains changes to introduce a new Multiplex Operator called
OrderedMuxExchange which merges the minor fragment streams pertaining to one
drillbit and send as one output stream to the foreman.
The existing multiplex mechanism is used to introduce these operators.
Please review this PR.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/HanumathRao/drill DRILL-6115
Alternatively you can review and apply these changes as the patch at:
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1110
Author: hmaduri <hmaduri@...>
DRILL-6115: SingleMergeExchange is not scaling up when many minor fragments
are allocated for a query.