GitHub user HanumathRao opened a pull request:
https://github.com/apache/drill/pull/1110
DRILL-6115: SingleMergeExchange is not scaling up when many minor fraâ¦
â¦gments are allocated for a query.
Currently a singlemerge exchange is merging all the fragment streams on
foreman. This can cause cpu bottleneck and also huge memory consumption at the
foreman.
This PR contains changes to introduce a new Multiplex Operator called
OrderedMuxExchange which merges the minor fragment streams pertaining to one
drillbit and send as one output stream to the foreman.
The existing multiplex mechanism is used to introduce these operators.
Please review this PR.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/HanumathRao/drill DRILL-6115
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/drill/pull/1110.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1110
----
commit 43a71277aeec9bb377181728b2ce563437d7e46d
Author: hmaduri <hmaduri@...>
Date: 2018-01-22T00:42:28Z
DRILL-6115: SingleMergeExchange is not scaling up when many minor fragments
are allocated for a query.
----
---
