salim achouche created DRILL-6147:

             Summary: Limit batch size for Flat Parquet Reader
                 Key: DRILL-6147
             Project: Apache Drill
          Issue Type: Improvement
          Components: Storage - Parquet
            Reporter: salim achouche
            Assignee: salim achouche
             Fix For: 1.13.0

The Parquet reader currently uses a hard-coded batch size limit (32k rows) when 
creating scan batches; there is no parameter nor any logic for controlling the 
amount of memory used. This enhancement will allow Drill to take an extra input 
parameter to control direct memory usage.

This message was sent by Atlassian JIRA

Reply via email to