[
https://issues.apache.org/jira/browse/DRILL-6537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16529173#comment-16529173
]
ASF GitHub Bot commented on DRILL-6537:
---------------------------------------
ppadma opened a new pull request #1342: DRILL-6537:Limit the batch size for
buffering operators based on how …
URL: https://github.com/apache/drill/pull/1342
…much memory they get
@Ben-Zvi please review.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
> Limit the batch size for buffering operators based on how much memory they get
> ------------------------------------------------------------------------------
>
> Key: DRILL-6537
> URL: https://issues.apache.org/jira/browse/DRILL-6537
> Project: Apache Drill
> Issue Type: Bug
> Components: Execution - Relational Operators
> Affects Versions: 1.13.0
> Reporter: Padma Penumarthy
> Assignee: Padma Penumarthy
> Priority: Major
> Labels: ready-to-commit
> Fix For: 1.14.0
>
>
> we are using 16MB for output batch size for all operators by default.
> however, for buffering operators, depending upon how much memory they get
> allocated, it is possible that 16MB might be too much to use for output batch
> size, causing them to spill sometimes.
> Have output batch size to be minimum of 16 MB or 20% of the allocated memory.
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
