[
https://issues.apache.org/jira/browse/DRILL-7128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Khurram Faraaz reassigned DRILL-7128:
-------------------------------------
Assignee: salim achouche
> IllegalStateException: Read batch count [0] should be greater than zero
> -----------------------------------------------------------------------
>
> Key: DRILL-7128
> URL: https://issues.apache.org/jira/browse/DRILL-7128
> Project: Apache Drill
> Issue Type: Bug
> Components: Storage - Parquet
> Affects Versions: 1.15.0
> Reporter: Khurram Faraaz
> Assignee: salim achouche
> Priority: Major
>
> Source table is a Hive table stored as parquet.
> Issue is seen only when querying datacapturekey column, which is of VARCHAR
> type.
> Hive 2.3
> MapR Drill : 1.15.0.0-mapr
> commit id : 951ef156fb1025677a2ca2dcf84e11002bf4b513
> {noformat}
> 0: jdbc:drill:drillbit=test.a.node1> describe bt_br_cc_invalid_leads ;
> +-------------------------------------+--------------------+--------------+
> | COLUMN_NAME | DATA_TYPE | IS_NULLABLE |
> +-------------------------------------+--------------------+--------------+
> | wrapup | CHARACTER VARYING | YES |
> | datacapturekey | CHARACTER VARYING | YES |
> | leadgendate | CHARACTER VARYING | YES |
> | crla1 | CHARACTER VARYING | YES |
> | crla2 | CHARACTER VARYING | YES |
> | invalid_lead | INTEGER | YES |
> | destination_advertiser_vendor_name | CHARACTER VARYING | YES |
> | source_program_key | CHARACTER VARYING | YES |
> | publisher_publisher | CHARACTER VARYING | YES |
> | areaname | CHARACTER VARYING | YES |
> | data_abertura_ficha | CHARACTER VARYING | YES |
> +-------------------------------------+--------------------+--------------+
> 11 rows selected (1.85 seconds)
> 0: jdbc:drill:drillbit=test.a.node1>
> // from the view definition, note that column datacapturekey is of type
> VARVCHAR with precision 2000
> {
> "name" : "bt_br_cc_invalid_leads",
> "sql" : "SELECT CAST(`wrapup` AS VARCHAR(2000)) AS `wrapup`,
> CAST(`datacapturekey` AS VARCHAR(2000)) AS `datacapturekey`,
> CAST(`leadgendate` AS VARCHAR(2000)) AS `leadgendate`, CAST(`crla1` AS
> VARCHAR(2000)) AS `crla1`, CAST(`crla2` AS VARCHAR(2000)) AS `crla2`,
> CAST(`invalid_lead` AS INTEGER) AS `invalid_lead`,
> CAST(`destination_advertiser_vendor_name` AS VARCHAR(2000)) AS
> `destination_advertiser_vendor_name`, CAST(`source_program_key` AS
> VARCHAR(2000)) AS `source_program_key`, CAST(`publisher_publisher` AS
> VARCHAR(2000)) AS `publisher_publisher`, CAST(`areaname` AS VARCHAR(2000)) AS
> `areaname`, CAST(`data_abertura_ficha` AS VARCHAR(2000)) AS
> `data_abertura_ficha`\nFROM
> `dfs`.`root`.`/user/bigtable/logs/hive/warehouse/bt_br_cc_invalid_leads`",
> "fields" : [ {
> "name" : "wrapup",
> "type" : "VARCHAR",
> "precision" : 2000,
> "isNullable" : true
> }, {
> "name" : "datacapturekey",
> "type" : "VARCHAR",
> "precision" : 2000,
> "isNullable" : true
> ...
> ...
> // total number of rows in bt_br_cc_invalid_leads
> 0: jdbc:drill:drillbit=test.a.node1> select count(*) from
> bt_br_cc_invalid_leads ;
> +---------+
> | EXPR$0 |
> +---------+
> | 20599 |
> +---------+
> 1 row selected (0.173 seconds)
> {noformat}
> Stack trace from drillbit.log
> {noformat}
> 2019-03-18 12:19:01,610 [237010da-6eda-a913-0424-32f63fbe01be:foreman] INFO
> o.a.drill.exec.work.foreman.Foreman - Query text for query with id
> 237010da-6eda-a913-0424-32f63fbe01be issued by bigtable: SELECT
> `bt_br_cc_invalid_leads`.`datacapturekey` AS `datacapturekey`
> FROM `dfs.drill_views`.`bt_br_cc_invalid_leads` `bt_br_cc_invalid_leads`
> GROUP BY `bt_br_cc_invalid_leads`.`datacapturekey`
> 2019-03-18 12:19:02,495 [237010da-6eda-a913-0424-32f63fbe01be:frag:0:0] INFO
> o.a.d.e.w.fragment.FragmentExecutor -
> 237010da-6eda-a913-0424-32f63fbe01be:0:0: State change requested
> AWAITING_ALLOCATION --> RUNNING
> 2019-03-18 12:19:02,495 [237010da-6eda-a913-0424-32f63fbe01be:frag:0:0] INFO
> o.a.d.e.w.f.FragmentStatusReporter -
> 237010da-6eda-a913-0424-32f63fbe01be:0:0: State to report: RUNNING
> 2019-03-18 12:19:02,502 [237010da-6eda-a913-0424-32f63fbe01be:frag:0:0] INFO
> o.a.d.exec.physical.impl.ScanBatch - User Error Occurred: Error in parquet
> record reader.
> Message:
> Hadoop path:
> /user/bigtable/logs/hive/warehouse/bt_br_cc_invalid_leads/000008_0
> Total records read: 0
> Row group index: 0
> Records in row group: 1551
> Parquet Metadata: ParquetMetaData{FileMetaData{schema: message hive_schema {
> optional binary wrapup (UTF8);
> optional binary datacapturekey (UTF8);
> optional binary leadgendate (UTF8);
> optional binary crla1 (UTF8);
> optional binary crla2 (UTF8);
> optional binary invalid_lead (UTF8);
> optional binary destination_advertiser_vendor_name (UTF8);
> optional binary source_program_key (UTF8);
> optional binary publisher_publisher (UTF8);
> optional binary areaname (UTF8);
> optional binary data_abertura_ficha (UTF8);
> }
> , metadata: {}}, blocks: [BlockMetaData\{1551, 139906
> [ColumnMetaData{UNCOMPRESSED [wrapup] optional binary wrapup (UTF8)
> [PLAIN_DICTIONARY, RLE, BIT_PACKED], 4}, ColumnMetaData\{UNCOMPRESSED
> [datacapturekey] optional binary datacapturekey (UTF8) [RLE, PLAIN,
> BIT_PACKED], 656}, ColumnMetaData\{UNCOMPRESSED [leadgendate] optional binary
> leadgendate (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 23978},
> ColumnMetaData\{UNCOMPRESSED [crla1] optional binary crla1 (UTF8) [RLE,
> PLAIN, BIT_PACKED], 26448}, ColumnMetaData\{UNCOMPRESSED [crla2] optional
> binary crla2 (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 62196},
> ColumnMetaData\{UNCOMPRESSED [invalid_lead] optional binary invalid_lead
> (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 92509},
> ColumnMetaData\{UNCOMPRESSED [destination_advertiser_vendor_name] optional
> binary destination_advertiser_vendor_name (UTF8) [PLAIN_DICTIONARY, RLE,
> BIT_PACKED], 92565}, ColumnMetaData\{UNCOMPRESSED [source_program_key]
> optional binary source_program_key (UTF8) [PLAIN_DICTIONARY, RLE,
> BIT_PACKED], 93571}, ColumnMetaData\{UNCOMPRESSED [publisher_publisher]
> optional binary publisher_publisher (UTF8) [PLAIN_DICTIONARY, RLE,
> BIT_PACKED], 94587}, ColumnMetaData\{UNCOMPRESSED [areaname] optional binary
> areaname (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 96042},
> ColumnMetaData\{UNCOMPRESSED [data_abertura_ficha] optional binary
> data_abertura_ficha (UTF8) [RLE, PLAIN, BIT_PACKED], 104162}]}]} (Error in
> parquet record reader.
> Message:
> Hadoop path:
> /user/bigtable/logs/hive/warehouse/bt_br_cc_invalid_leads/000008_0
> Total records read: 0
> Row group index: 0
> Records in row group: 1551
> Parquet Metadata: ParquetMetaData{FileMetaData{schema: message hive_schema {
> optional binary wrapup (UTF8);
> optional binary datacapturekey (UTF8);
> optional binary leadgendate (UTF8);
> optional binary crla1 (UTF8);
> optional binary crla2 (UTF8);
> optional binary invalid_lead (UTF8);
> optional binary destination_advertiser_vendor_name (UTF8);
> optional binary source_program_key (UTF8);
> optional binary publisher_publisher (UTF8);
> optional binary areaname (UTF8);
> optional binary data_abertura_ficha (UTF8);
> }
> , metadata: {}}, blocks: [BlockMetaData\{1551, 139906
> [ColumnMetaData{UNCOMPRESSED [wrapup] optional binary wrapup (UTF8)
> [PLAIN_DICTIONARY, RLE, BIT_PACKED], 4}, ColumnMetaData\{UNCOMPRESSED
> [datacapturekey] optional binary datacapturekey (UTF8) [RLE, PLAIN,
> BIT_PACKED], 656}, ColumnMetaData\{UNCOMPRESSED [leadgendate] optional binary
> leadgendate (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 23978},
> ColumnMetaData\{UNCOMPRESSED [crla1] optional binary crla1 (UTF8) [RLE,
> PLAIN, BIT_PACKED], 26448}, ColumnMetaData\{UNCOMPRESSED [crla2] optional
> binary crla2 (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 62196},
> ColumnMetaData\{UNCOMPRESSED [invalid_lead] optional binary invalid_lead
> (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 92509},
> ColumnMetaData\{UNCOMPRESSED [destination_advertiser_vendor_name] optional
> binary destination_advertiser_vendor_name (UTF8) [PLAIN_DICTIONARY, RLE,
> BIT_PACKED], 92565}, ColumnMetaData\{UNCOMPRESSED [source_program_key]
> optional binary source_program_key (UTF8) [PLAIN_DICTIONARY, RLE,
> BIT_PACKED], 93571}, ColumnMetaData\{UNCOMPRESSED [publisher_publisher]
> optional binary publisher_publisher (UTF8) [PLAIN_DICTIONARY, RLE,
> BIT_PACKED], 94587}, ColumnMetaData\{UNCOMPRESSED [areaname] optional binary
> areaname (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 96042},
> ColumnMetaData\{UNCOMPRESSED [data_abertura_ficha] optional binary
> data_abertura_ficha (UTF8) [RLE, PLAIN, BIT_PACKED], 104162}]}]})
> org.apache.drill.common.exceptions.UserException: INTERNAL_ERROR ERROR: Error
> in parquet record reader.
> Message:
> Hadoop path:
> /user/bigtable/logs/hive/warehouse/bt_br_cc_invalid_leads/000008_0
> Total records read: 0
> Row group index: 0
> Records in row group: 1551
> Parquet Metadata: ParquetMetaData{FileMetaData{schema: message hive_schema {
> optional binary wrapup (UTF8);
> optional binary datacapturekey (UTF8);
> optional binary leadgendate (UTF8);
> optional binary crla1 (UTF8);
> optional binary crla2 (UTF8);
> optional binary invalid_lead (UTF8);
> optional binary destination_advertiser_vendor_name (UTF8);
> optional binary source_program_key (UTF8);
> optional binary publisher_publisher (UTF8);
> optional binary areaname (UTF8);
> optional binary data_abertura_ficha (UTF8);
> }
> , metadata: {}}, blocks: [BlockMetaData\{1551, 139906
> [ColumnMetaData{UNCOMPRESSED [wrapup] optional binary wrapup (UTF8)
> [PLAIN_DICTIONARY, RLE, BIT_PACKED], 4}, ColumnMetaData\{UNCOMPRESSED
> [datacapturekey] optional binary datacapturekey (UTF8) [RLE, PLAIN,
> BIT_PACKED], 656}, ColumnMetaData\{UNCOMPRESSED [leadgendate] optional binary
> leadgendate (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 23978},
> ColumnMetaData\{UNCOMPRESSED [crla1] optional binary crla1 (UTF8) [RLE,
> PLAIN, BIT_PACKED], 26448}, ColumnMetaData\{UNCOMPRESSED [crla2] optional
> binary crla2 (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 62196},
> ColumnMetaData\{UNCOMPRESSED [invalid_lead] optional binary invalid_lead
> (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 92509},
> ColumnMetaData\{UNCOMPRESSED [destination_advertiser_vendor_name] optional
> binary destination_advertiser_vendor_name (UTF8) [PLAIN_DICTIONARY, RLE,
> BIT_PACKED], 92565}, ColumnMetaData\{UNCOMPRESSED [source_program_key]
> optional binary source_program_key (UTF8) [PLAIN_DICTIONARY, RLE,
> BIT_PACKED], 93571}, ColumnMetaData\{UNCOMPRESSED [publisher_publisher]
> optional binary publisher_publisher (UTF8) [PLAIN_DICTIONARY, RLE,
> BIT_PACKED], 94587}, ColumnMetaData\{UNCOMPRESSED [areaname] optional binary
> areaname (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 96042},
> ColumnMetaData\{UNCOMPRESSED [data_abertura_ficha] optional binary
> data_abertura_ficha (UTF8) [RLE, PLAIN, BIT_PACKED], 104162}]}]}
> Please, refer to logs for more information.
> [Error Id: f951a96c-623e-4423-b4f9-806a29b398dd ]
> at
> org.apache.drill.common.exceptions.UserException$Builder.build(UserException.java:633)
> ~[drill-common-1.15.0.0-mapr.jar:1.15.0.0-mapr]
> at org.apache.drill.exec.physical.impl.ScanBatch.next(ScanBatch.java:293)
> [drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
> at
> org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:126)
> [drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
> at
> org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:116)
> [drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
> at
> org.apache.drill.exec.record.AbstractUnaryRecordBatch.innerNext(AbstractUnaryRecordBatch.java:63)
> [drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
> at
> org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext(ProjectRecordBatch.java:143)
> [drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
> at
> org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:186)
> [drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
> at
> org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:126)
> [drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
> at
> org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:116)
> [drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
> at
> org.apache.drill.exec.physical.impl.aggregate.HashAggBatch.buildSchema(HashAggBatch.java:226)
> [drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
> at
> org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:161)
> [drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
> at
> org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:126)
> [drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
> at
> org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:116)
> [drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
> at
> org.apache.drill.exec.record.AbstractUnaryRecordBatch.innerNext(AbstractUnaryRecordBatch.java:63)
> [drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
> at
> org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext(ProjectRecordBatch.java:143)
> [drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
> at
> org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:186)
> [drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
> at
> org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:104)
> [drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
> at
> org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext(ScreenCreator.java:83)
> [drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
> at
> org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:94)
> [drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
> at
> org.apache.drill.exec.work.fragment.FragmentExecutor$1.run(FragmentExecutor.java:297)
> [drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
> at
> org.apache.drill.exec.work.fragment.FragmentExecutor$1.run(FragmentExecutor.java:284)
> [drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
> at java.security.AccessController.doPrivileged(Native Method) [na:1.8.0_152]
> at javax.security.auth.Subject.doAs(Subject.java:422) [na:1.8.0_152]
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1669)
> [hadoop-common-2.7.0-mapr-1808.jar:na]
> at
> org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:284)
> [drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
> at
> org.apache.drill.common.SelfCleaningRunnable.run(SelfCleaningRunnable.java:38)
> [drill-common-1.15.0.0-mapr.jar:1.15.0.0-mapr]
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> [na:1.8.0_152]
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> [na:1.8.0_152]
> at java.lang.Thread.run(Thread.java:748) [na:1.8.0_152]
> Caused by: org.apache.drill.common.exceptions.DrillRuntimeException: Error in
> parquet record reader.
> Message:
> Hadoop path:
> /user/bigtable/logs/hive/warehouse/bt_br_cc_invalid_leads/000008_0
> Total records read: 0
> Row group index: 0
> Records in row group: 1551
> Parquet Metadata: ParquetMetaData{FileMetaData{schema: message hive_schema {
> optional binary wrapup (UTF8);
> optional binary datacapturekey (UTF8);
> optional binary leadgendate (UTF8);
> optional binary crla1 (UTF8);
> optional binary crla2 (UTF8);
> optional binary invalid_lead (UTF8);
> optional binary destination_advertiser_vendor_name (UTF8);
> optional binary source_program_key (UTF8);
> optional binary publisher_publisher (UTF8);
> optional binary areaname (UTF8);
> optional binary data_abertura_ficha (UTF8);
> }
> , metadata: {}}, blocks: [BlockMetaData\{1551, 139906
> [ColumnMetaData{UNCOMPRESSED [wrapup] optional binary wrapup (UTF8)
> [PLAIN_DICTIONARY, RLE, BIT_PACKED], 4}, ColumnMetaData\{UNCOMPRESSED
> [datacapturekey] optional binary datacapturekey (UTF8) [RLE, PLAIN,
> BIT_PACKED], 656}, ColumnMetaData\{UNCOMPRESSED [leadgendate] optional binary
> leadgendate (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 23978},
> ColumnMetaData\{UNCOMPRESSED [crla1] optional binary crla1 (UTF8) [RLE,
> PLAIN, BIT_PACKED], 26448}, ColumnMetaData\{UNCOMPRESSED [crla2] optional
> binary crla2 (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 62196},
> ColumnMetaData\{UNCOMPRESSED [invalid_lead] optional binary invalid_lead
> (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 92509},
> ColumnMetaData\{UNCOMPRESSED [destination_advertiser_vendor_name] optional
> binary destination_advertiser_vendor_name (UTF8) [PLAIN_DICTIONARY, RLE,
> BIT_PACKED], 92565}, ColumnMetaData\{UNCOMPRESSED [source_program_key]
> optional binary source_program_key (UTF8) [PLAIN_DICTIONARY, RLE,
> BIT_PACKED], 93571}, ColumnMetaData\{UNCOMPRESSED [publisher_publisher]
> optional binary publisher_publisher (UTF8) [PLAIN_DICTIONARY, RLE,
> BIT_PACKED], 94587}, ColumnMetaData\{UNCOMPRESSED [areaname] optional binary
> areaname (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 96042},
> ColumnMetaData\{UNCOMPRESSED [data_abertura_ficha] optional binary
> data_abertura_ficha (UTF8) [RLE, PLAIN, BIT_PACKED], 104162}]}]}
> at
> org.apache.drill.exec.store.parquet.columnreaders.ParquetRecordReader.handleException(ParquetRecordReader.java:271)
> ~[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
> at
> org.apache.drill.exec.store.parquet.columnreaders.ParquetRecordReader.next(ParquetRecordReader.java:290)
> ~[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
> at
> org.apache.drill.exec.physical.impl.ScanBatch.internalNext(ScanBatch.java:223)
> [drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
> at org.apache.drill.exec.physical.impl.ScanBatch.next(ScanBatch.java:271)
> [drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
> ... 27 common frames omitted
> Caused by: java.lang.IllegalStateException: Read batch count [0] should be
> greater than zero
> at
> org.apache.drill.shaded.guava.com.google.common.base.Preconditions.checkState(Preconditions.java:509)
> ~[drill-shaded-guava-23.0.jar:23.0]
> at
> org.apache.drill.exec.store.parquet.columnreaders.VarLenNullableFixedEntryReader.getEntry(VarLenNullableFixedEntryReader.java:49)
> ~[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
> at
> org.apache.drill.exec.store.parquet.columnreaders.VarLenBulkPageReader.getFixedEntry(VarLenBulkPageReader.java:167)
> ~[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
> at
> org.apache.drill.exec.store.parquet.columnreaders.VarLenBulkPageReader.getEntry(VarLenBulkPageReader.java:132)
> ~[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
> at
> org.apache.drill.exec.store.parquet.columnreaders.VarLenColumnBulkInput.next(VarLenColumnBulkInput.java:154)
> ~[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
> at
> org.apache.drill.exec.store.parquet.columnreaders.VarLenColumnBulkInput.next(VarLenColumnBulkInput.java:38)
> ~[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
> at
> org.apache.drill.exec.vector.VarCharVector$Mutator.setSafe(VarCharVector.java:624)
> ~[vector-1.15.0.0-mapr.jar:1.15.0.0-mapr]
> at
> org.apache.drill.exec.vector.NullableVarCharVector$Mutator.setSafe(NullableVarCharVector.java:716)
> ~[vector-1.15.0.0-mapr.jar:1.15.0.0-mapr]
> at
> org.apache.drill.exec.store.parquet.columnreaders.VarLengthColumnReaders$NullableVarCharColumn.setSafe(VarLengthColumnReaders.java:215)
> ~[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
> at
> org.apache.drill.exec.store.parquet.columnreaders.VarLengthValuesColumn.readRecordsInBulk(VarLengthValuesColumn.java:98)
> ~[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
> at
> org.apache.drill.exec.store.parquet.columnreaders.VarLenBinaryReader.readRecordsInBulk(VarLenBinaryReader.java:114)
> ~[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
> at
> org.apache.drill.exec.store.parquet.columnreaders.VarLenBinaryReader.readFields(VarLenBinaryReader.java:92)
> ~[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
> at
> org.apache.drill.exec.store.parquet.columnreaders.BatchReader$VariableWidthReader.readRecords(BatchReader.java:156)
> ~[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
> at
> org.apache.drill.exec.store.parquet.columnreaders.BatchReader.readBatch(BatchReader.java:43)
> ~[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
> at
> org.apache.drill.exec.store.parquet.columnreaders.ParquetRecordReader.next(ParquetRecordReader.java:288)
> ~[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
> ... 29 common frames omitted
> 2019-03-18 12:19:02,502 [237010da-6eda-a913-0424-32f63fbe01be:frag:0:0] INFO
> o.a.d.e.w.fragment.FragmentExecutor -
> 237010da-6eda-a913-0424-32f63fbe01be:0:0: State change requested RUNNING -->
> FAILED
> 2019-03-18 12:19:02,502 [237010da-6eda-a913-0424-32f63fbe01be:frag:0:0] ERROR
> o.a.d.e.physical.impl.BaseRootExec - Batch dump started: dumping last 2
> failed batches
> 2019-03-18 12:19:02,503 [237010da-6eda-a913-0424-32f63fbe01be:frag:0:0] ERROR
> o.a.d.e.p.i.p.ProjectRecordBatch - ProjectRecordBatch[projector=null,
> hasRemainder=false, remainderIndex=0, recordCount=0,
> container=org.apache.drill.exec.record.VectorContainer@79a74963[recordCount =
> 0, schemaChanged = true, schema = null, wrappers = [], ...]]
> 2019-03-18 12:19:02,503 [237010da-6eda-a913-0424-32f63fbe01be:frag:0:0] ERROR
> o.a.d.exec.physical.impl.ScanBatch -
> ScanBatch[container=org.apache.drill.exec.record.VectorContainer@321387c5[recordCount
> = 0, schemaChanged = true, schema = null, wrappers =
> [org.apache.drill.exec.vector.NullableVarCharVector@25c92bff[field =
> [`datacapturekey` (VARCHAR:OPTIONAL)], ...]], ...],
> currentReader=ParquetRecordReader[File=/user/bigtable/logs/hive/warehouse/bt_br_cc_invalid_leads/000008_0,
> Row group index=0, Records in row group=1551, Total records read=0,
> MetadataParquetMetaData{FileMetaData{schema: message hive_schema {
> optional binary wrapup (UTF8);
> optional binary datacapturekey (UTF8);
> optional binary leadgendate (UTF8);
> optional binary crla1 (UTF8);
> optional binary crla2 (UTF8);
> optional binary invalid_lead (UTF8);
> optional binary destination_advertiser_vendor_name (UTF8);
> optional binary source_program_key (UTF8);
> optional binary publisher_publisher (UTF8);
> optional binary areaname (UTF8);
> optional binary data_abertura_ficha (UTF8);
> }
> , metadata: {}}, blocks: [BlockMetaData\{1551, 139906
> [ColumnMetaData{UNCOMPRESSED [wrapup] optional binary wrapup (UTF8)
> [PLAIN_DICTIONARY, RLE, BIT_PACKED], 4}, ColumnMetaData\{UNCOMPRESSED
> [datacapturekey] optional binary datacapturekey (UTF8) [RLE, PLAIN,
> BIT_PACKED], 656}, ColumnMetaData\{UNCOMPRESSED [leadgendate] optional binary
> leadgendate (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 23978},
> ColumnMetaData\{UNCOMPRESSED [crla1] optional binary crla1 (UTF8) [RLE,
> PLAIN, BIT_PACKED], 26448}, ColumnMetaData\{UNCOMPRESSED [crla2] optional
> binary crla2 (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 62196},
> ColumnMetaData\{UNCOMPRESSED [invalid_lead] optional binary invalid_lead
> (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 92509},
> ColumnMetaData\{UNCOMPRESSED [destination_advertiser_vendor_name] optional
> binary destination_advertiser_vendor_name (UTF8) [PLAIN_DICTIONARY, RLE,
> BIT_PACKED], 92565}, ColumnMetaData\{UNCOMPRESSED [source_program_key]
> optional binary source_program_key (UTF8) [PLAIN_DICTIONARY, RLE,
> BIT_PACKED], 93571}, ColumnMetaData\{UNCOMPRESSED [publisher_publisher]
> optional binary publisher_publisher (UTF8) [PLAIN_DICTIONARY, RLE,
> BIT_PACKED], 94587}, ColumnMetaData\{UNCOMPRESSED [areaname] optional binary
> areaname (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 96042},
> ColumnMetaData\{UNCOMPRESSED [data_abertura_ficha] optional binary
> data_abertura_ficha (UTF8) [RLE, PLAIN, BIT_PACKED], 104162}]}]}],
> schema=null]
> 2019-03-18 12:19:02,503 [237010da-6eda-a913-0424-32f63fbe01be:frag:0:0] ERROR
> o.a.d.e.physical.impl.BaseRootExec - Batch dump completed.
> 2019-03-18 12:19:02,504 [237010da-6eda-a913-0424-32f63fbe01be:frag:0:0] INFO
> o.a.d.e.w.fragment.FragmentExecutor -
> 237010da-6eda-a913-0424-32f63fbe01be:0:0: State change requested FAILED -->
> FINISHED
> 2019-03-18 12:19:02,508 [237010da-6eda-a913-0424-32f63fbe01be:frag:0:0] WARN
> o.a.d.exec.rpc.control.WorkEventBus - Fragment
> 237010da-6eda-a913-0424-32f63fbe01be:0:0 manager is not found in the work bus.
> 2019-03-18 12:19:02,520 [237010da-6eda-a913-0424-32f63fbe01be:frag:0:0] WARN
> o.a.d.e.w.f.QueryStateProcessor - Dropping request to move to COMPLETED state
> as query is already at FAILED state (which is terminal).
> [test@test1917 logs]$
> {noformat}
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
