Padma Penumarthy created DRILL-6123:
---------------------------------------

             Summary: Limit batch size for Merge Join based on memory
                 Key: DRILL-6123
                 URL: https://issues.apache.org/jira/browse/DRILL-6123
             Project: Apache Drill
          Issue Type: Improvement
          Components: Execution - Flow
    Affects Versions: 1.12.0
            Reporter: Padma Penumarthy
            Assignee: Padma Penumarthy
             Fix For: 1.13.0


Merge join limits output batch size to 32K rows irrespective of row size. This 
can create very large or very small batches (in terms of memory), depending 
upon average row width. Change this to figure out output row count based on 
memory specified with the new outputBatchSize option and average row width of 
incoming left and right batches. Output row count will be minimum of 1 and max 
of 64k. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to