[
https://issues.apache.org/jira/browse/DRILL-7067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16809611#comment-16809611
]
benj edited comment on DRILL-7067 at 4/4/19 8:32 AM:
-----------------------------------------------------
Could you check the mode and the type of the fields of your differents tables ?
Because as related in DRILL-7104, when drill build large parquet files (with
more than one fragment), the mode (NULLABLE vs REQUIRED) and the type can
unfortunately change and next, requests can failed bacause of different mode in
tables requested.
was (Author: benj641):
Could you check the mode (modeof(`field`)) of the fields of your differents
tables ?
Because as related in DRILL-7104, when drill build large parquet files (with
more than one fragment), the mode (NULLABLE vs REQUIRED) can unfortunately
change and next, requests can failed bacause of different mode in tables
requested.
> Querying parquet file with null value field error
> -------------------------------------------------
>
> Key: DRILL-7067
> URL: https://issues.apache.org/jira/browse/DRILL-7067
> Project: Apache Drill
> Issue Type: Bug
> Components: Storage - Parquet
> Affects Versions: 1.15.0
> Environment: Ubuntu 18.04.1 LTS
> Apache Drill 1.15.0
> Reporter: Jardhel Cachola
> Priority: Blocker
> Fix For: Future
>
>
> When we try to join two parquet tables and one of them has null values on any
> field, the query doesn't run. It fails showing the following error:
> Error: SYSTEM ERROR: IllegalStateException: Failure while reading vector.
> Expected vector class of org.apache.drill.exec.vector.NullableIntVector but
> was holding vector class
> org.apache.drill.exec.vector.NullableVarDecimalVector, field= [`id_hubbles`
> (VARDECIMAL(38, 4):OPTIONAL), children=([`$bits$` (UINT1:REQUIRED)],
> [`id_hubbles` (VARDECIMAL(38, 4):OPTIONAL), children=([`$offsets$`
> (UINT4:REQUIRED)])])]
> Fragment 2:0
> Please, refer to logs for more information.
> [Error Id: 48f63255-c771-4809-8252-ef7a78fda31b on
> ################|################]
> (java.lang.IllegalStateException) Failure while reading vector. Expected
> vector class of org.apache.drill.exec.vector.NullableIntVector but was
> holding vector class org.apache.drill.exec.vector.NullableVarDecimalVector,
> field= [`id_hubbles` (VARDECIMAL(38, 4):OPTIONAL), children=([`$bits$`
> (UINT1:REQUIRED)], [`id_hubbles` (VARDECIMAL(38, 4):OPTIONAL),
> children=([`$offsets$` (UINT4:REQUIRED)])])]
> org.apache.drill.exec.record.VectorContainer.getValueAccessorById():324
> org.apache.drill.exec.record.RecordBatchLoader.getValueAccessorById():251
>
> org.apache.drill.exec.physical.impl.unorderedreceiver.UnorderedReceiverBatch.getValueAccessorById():142
>
> org.apache.drill.exec.test.generated.PartitionerGen1732$OutgoingRecordBatch.doSetup():114
>
> org.apache.drill.exec.test.generated.PartitionerGen1732$OutgoingRecordBatch.initializeBatch():399
>
> org.apache.drill.exec.test.generated.PartitionerGen1732.flushOutgoingBatches():185
>
> org.apache.drill.exec.physical.impl.partitionsender.PartitionerDecorator$FlushBatchesHandlingClass.execute():285
>
> org.apache.drill.exec.physical.impl.partitionsender.PartitionerDecorator$PartitionerTask.run():340
> java.util.concurrent.ThreadPoolExecutor.runWorker():1149
> java.util.concurrent.ThreadPoolExecutor$Worker.run():624
> java.lang.Thread.run():748 (state=,code=0)
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
