Hello. I am currently using version 1.18.0 of apache drill, but the following error occurred in a parquet file with a complex structure, so I would like to inquire about the cause and solution.
The error is as follows. apache drill> select * from dfs.`/user/hadoop/test_parquet/dd=01/part-00019-e172793d-32da-4d92-89df-c5fc94f12445-c000.gz.parquet` limit 10;; Error: SYSTEM ERROR: NullPointerException Please, refer to logs for more information. [Error Id: cc06f973-c0dc-4863-9a9d-6f9d3e86c4bb on miapachehadoopdata03:31010] (org.apache.drill.exec.work.foreman.ForemanException) Unexpected exception during fragment initialization: Error while applying rule DrillScanRule, args [rel#5954:EnumerableTa bleScan.ENUMERABLE.ANY([]).[](table=[dfs, /user/hadoop/test_parquet/dd=01/part-00019-e172793d-32da-4d92-89df-c5fc94f12445-c000.gz.parquet])] org.apache.drill.exec.work.foreman.Foreman.run():301 java.util.concurrent.ThreadPoolExecutor.runWorker():1149 java.util.concurrent.ThreadPoolExecutor$Worker.run():624 java.lang.Thread.run():748 Caused By (java.lang.RuntimeException) Error while applying rule DrillScanRule, args [rel#5954:EnumerableTableScan.ENUMERABLE.ANY([]).[](table=[dfs, /user/hadoop/test_parquet/ dd=01/part-00019-e172793d-32da-4d92-89df-c5fc94f12445-c000.gz.parquet])] org.apache.calcite.plan.volcano.VolcanoRuleCall.onMatch():235 org.apache.calcite.plan.volcano.VolcanoPlanner.findBestExp():633 org.apache.calcite.tools.Programs$RuleSetProgram.run():327 org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.transform():405 org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.transform():351 org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.convertToRawDrel():245 org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.convertToDrel():308 org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.getPlan():173 org.apache.drill.exec.planner.sql.DrillSqlWorker.getQueryPlan():283 org.apache.drill.exec.planner.sql.DrillSqlWorker.getPhysicalPlan():163 org.apache.drill.exec.planner.sql.DrillSqlWorker.convertPlan():128 org.apache.drill.exec.planner.sql.DrillSqlWorker.getPlan():93 org.apache.drill.exec.work.foreman.Foreman.runSQL():593 org.apache.drill.exec.work.foreman.Foreman.run():274 java.util.concurrent.ThreadPoolExecutor.runWorker():1149 java.util.concurrent.ThreadPoolExecutor$Worker.run():624 java.lang.Thread.run():748 Caused By (java.lang.NullPointerException) null org.apache.drill.exec.store.parquet.ParquetGroupScanStatistics.checkForPartitionColumn():186 org.apache.drill.exec.store.parquet.ParquetGroupScanStatistics.collect():119 org.apache.drill.exec.store.parquet.ParquetGroupScanStatistics.<init>():59 org.apache.drill.exec.store.parquet.BaseParquetMetadataProvider.getParquetGroupScanStatistics():293 org.apache.drill.exec.store.parquet.BaseParquetMetadataProvider.getTableMetadata():249 org.apache.drill.exec.store.parquet.BaseParquetMetadataProvider.initializeMetadata():203 org.apache.drill.exec.store.parquet.BaseParquetMetadataProvider.init():170 org.apache.drill.exec.metastore.store.parquet.ParquetTableMetadataProviderImpl.<init>():95 org.apache.drill.exec.metastore.store.parquet.ParquetTableMetadataProviderImpl.<init>():48 org.apache.drill.exec.metastore.store.parquet.ParquetTableMetadataProviderImpl$Builder.build():415 org.apache.drill.exec.store.parquet.ParquetGroupScan.<init>():150 org.apache.drill.exec.store.parquet.ParquetGroupScan.<init>():120 org.apache.drill.exec.store.parquet.ParquetFormatPlugin.getGroupScan():202 org.apache.drill.exec.store.parquet.ParquetFormatPlugin.getGroupScan():79 org.apache.drill.exec.store.dfs.FileSystemPlugin.getPhysicalScan():226 org.apache.drill.exec.store.dfs.FileSystemPlugin.getPhysicalScan():209 org.apache.drill.exec.planner.logical.DrillTable.getGroupScan():119 org.apache.drill.exec.planner.common.DrillScanRelBase.<init>():51 org.apache.drill.exec.planner.logical.DrillScanRel.<init>():76 org.apache.drill.exec.planner.logical.DrillScanRel.<init>():65 org.apache.drill.exec.planner.logical.DrillScanRel.<init>():58 org.apache.drill.exec.planner.logical.DrillScanRule.onMatch():38 org.apache.calcite.plan.volcano.VolcanoRuleCall.onMatch():208 org.apache.calcite.plan.volcano.VolcanoPlanner.findBestExp():633 org.apache.calcite.tools.Programs$RuleSetProgram.run():327 org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.transform():405 org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.transform():351 org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.convertToRawDrel():245 org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.convertToDrel():308 org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.getPlan():173 org.apache.drill.exec.planner.sql.DrillSqlWorker.getQueryPlan():283 org.apache.drill.exec.planner.sql.DrillSqlWorker.getPhysicalPlan():163 org.apache.drill.exec.planner.sql.DrillSqlWorker.convertPlan():128 org.apache.drill.exec.planner.sql.DrillSqlWorker.getPlan():93 org.apache.drill.exec.work.foreman.Foreman.runSQL():593 org.apache.drill.exec.work.foreman.Foreman.run():274 java.util.concurrent.ThreadPoolExecutor.runWorker():1149 java.util.concurrent.ThreadPoolExecutor$Worker.run():624 java.lang.Thread.run():748 (state=,code=0) The performance and convenience of the apache drill are so great that I want to use it, but I have a problem, so please contact us. Have a nice day.
