[
https://issues.apache.org/jira/browse/DRILL-5797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225786#comment-16225786
]
ASF GitHub Bot commented on DRILL-5797:
---------------------------------------
Github user paul-rogers commented on the issue:
https://github.com/apache/drill/pull/976
@dprofeta, tried to commit this PR, but ran into multiple functional test
failures:
```
Execution Failures:
/root/drillAutomation/mapr/framework/resources/Functional/complex/parquet/complex12.q
/root/drillAutomation/mapr/framework/resources/Functional/complex/parquet/complex8.q
/root/drillAutomation/mapr/framework/resources/Functional/complex/parquet/complex56.q
/root/drillAutomation/mapr/framework/resources/Functional/complex/parquet/complex274.q
/root/drillAutomation/mapr/framework/resources/Functional/complex/parquet/complex7.q
/root/drillAutomation/mapr/framework/resources/Functional/complex/parquet/complex57.q
/root/drillAutomation/mapr/framework/resources/Functional/complex/parquet/complex102.q
/root/drillAutomation/mapr/framework/resources/Functional/complex/parquet/complex5.q
/root/drillAutomation/mapr/framework/resources/Functional/complex/parquet/complex10.q
/root/drillAutomation/mapr/framework/resources/Functional/complex/parquet/complex9.q
/root/drillAutomation/mapr/framework/resources/Functional/complex/parquet/complex203.q
/root/drillAutomation/mapr/framework/resources/Functional/complex/parquet/complex101.q
/root/drillAutomation/mapr/framework/resources/Functional/complex/parquet/complex275.q
/root/drillAutomation/mapr/framework/resources/Functional/complex/parquet/complex6.q
/root/drillAutomation/mapr/framework/resources/Functional/complex/parquet/complex205.q
/root/drillAutomation/mapr/framework/resources/Functional/complex/parquet/complex11.q
/root/drillAutomation/mapr/framework/resources/Functional/complex/parquet/complex58.q
/root/drillAutomation/mapr/framework/resources/Functional/complex/parquet/complex153.q
/root/drillAutomation/mapr/framework/resources/Functional/complex/parquet/complex202.q
/root/drillAutomation/mapr/framework/resources/Functional/complex/parquet/complex151.q
```
The common failure stack trace seems to be:
```
org.apache.drill.exec.store.parquet.columnreaders.ParquetRecordReader.handleException():272
org.apache.drill.exec.store.parquet.columnreaders.ParquetRecordReader.setup():256
org.apache.drill.exec.physical.impl.ScanBatch.getNextReaderIfHas():241
org.apache.drill.exec.physical.impl.ScanBatch.next():167
...
```
> Use more often the new parquet reader
> -------------------------------------
>
> Key: DRILL-5797
> URL: https://issues.apache.org/jira/browse/DRILL-5797
> Project: Apache Drill
> Issue Type: Improvement
> Components: Storage - Parquet
> Reporter: Damien Profeta
> Assignee: Damien Profeta
> Fix For: 1.12.0
>
>
> The choice of using the regular parquet reader of the optimized one is based
> of what type of columns is in the file. But the columns that are read by the
> query doesn't matter. We can increase a little bit the cases where the
> optimized reader is used by checking is the projected column are simple or
> not.
> This is an optimization waiting for the fast parquet reader to handle complex
> structure.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
