[
https://issues.apache.org/jira/browse/DRILL-6537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Boaz Ben-Zvi updated DRILL-6537:
--------------------------------
Labels: ready-to-commit (was: )
> Limit the batch size for buffering operators based on how much memory they get
> ------------------------------------------------------------------------------
>
> Key: DRILL-6537
> URL: https://issues.apache.org/jira/browse/DRILL-6537
> Project: Apache Drill
> Issue Type: Bug
> Components: Execution - Relational Operators
> Affects Versions: 1.13.0
> Reporter: Padma Penumarthy
> Assignee: Padma Penumarthy
> Priority: Major
> Labels: ready-to-commit
> Fix For: 1.14.0
>
>
> we are using 16MB for output batch size for all operators by default.
> however, for buffering operators, depending upon how much memory they get
> allocated, it is possible that 16MB might be too much to use for output batch
> size, causing them to spill sometimes.
> Have output batch size to be minimum of 16 MB or 20% of the allocated memory.
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
