sachouche opened a new pull request #1544: DRILL-6853: Make the complex parquet reader batch max row size config… URL: https://github.com/apache/drill/pull/1544 …urable - Currently the Parquet Complex Reader hard codes the batch number of rows to 4,000 rows - This create a memory pressure when rows are large (e.g., few hundred KBs and even MBs) - This PR is to let users manually configure this setting: "store.parquet.complex.batch.num_records" - This configuration could be set through configuration or at session level @kkhatua, @ilooner could you guys please review this PR? Thanks!
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
