[ https://issues.apache.org/jira/browse/DRILL-6180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16380682#comment-16380682 ]
ASF GitHub Bot commented on DRILL-6180: --------------------------------------- Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/1129#discussion_r171315310 --- Diff: exec/java-exec/src/main/resources/drill-module.conf --- @@ -421,7 +416,7 @@ drill.exec.options: { drill.exec.storage.implicit.fqn.column.label: "fqn", drill.exec.storage.implicit.suffix.column.label: "suffix", drill.exec.testing.controls: "{}", - drill.exec.memory.operator.output_batch_size : 33554432, # 32 MB + drill.exec.memory.operator.output_batch_size : 16777216, # 16 MB --- End diff -- Thanks for making this adjustment. > Use System Option "output_batch_size" for External Sort > ------------------------------------------------------- > > Key: DRILL-6180 > URL: https://issues.apache.org/jira/browse/DRILL-6180 > Project: Apache Drill > Issue Type: Improvement > Components: Execution - Flow > Affects Versions: 1.12.0 > Reporter: Padma Penumarthy > Assignee: Padma Penumarthy > Priority: Critical > Fix For: 1.13.0 > > > External Sort has boot time configuration for output batch size > "drill.exec.sort.external.spill.merge_batch_size" which is defaulted to 16M. > To make batch sizing configuration uniform across all operators, change this > to use new system option that is added > "drill.exec.memory.operator.output_batch_size". This option has default value > of 32M. > So, what are the implications if default is changed to 32M for external sort ? > Instead, should we change the output batch size default to 16M for all > operators ? > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)