Khurram Faraaz created DRILL-7128:
-------------------------------------
Summary: IllegalStateException: Read batch count [0] should be
greater than zero
Key: DRILL-7128
URL: https://issues.apache.org/jira/browse/DRILL-7128
Project: Apache Drill
Issue Type: Bug
Components: Storage - Parquet
Affects Versions: 1.15.0
Reporter: Khurram Faraaz
Source table is a Hive table stored as parquet.
Issue is seen only when querying datacapturekey column, which is of VARCHAR
type.
Hive 2.3
MapR Drill : 1.15.0.0-mapr
commit id : 951ef156fb1025677a2ca2dcf84e11002bf4b513
{noformat}
0: jdbc:drill:drillbit=test.a.node1> describe bt_br_cc_invalid_leads ;
+-------------------------------------+--------------------+--------------+
| COLUMN_NAME | DATA_TYPE | IS_NULLABLE |
+-------------------------------------+--------------------+--------------+
| wrapup | CHARACTER VARYING | YES |
| datacapturekey | CHARACTER VARYING | YES |
| leadgendate | CHARACTER VARYING | YES |
| crla1 | CHARACTER VARYING | YES |
| crla2 | CHARACTER VARYING | YES |
| invalid_lead | INTEGER | YES |
| destination_advertiser_vendor_name | CHARACTER VARYING | YES |
| source_program_key | CHARACTER VARYING | YES |
| publisher_publisher | CHARACTER VARYING | YES |
| areaname | CHARACTER VARYING | YES |
| data_abertura_ficha | CHARACTER VARYING | YES |
+-------------------------------------+--------------------+--------------+
11 rows selected (1.85 seconds)
0: jdbc:drill:drillbit=test.a.node1>
// from the view definition, note that column datacapturekey is of type
VARVCHAR with precision 2000
{
"name" : "bt_br_cc_invalid_leads",
"sql" : "SELECT CAST(`wrapup` AS VARCHAR(2000)) AS `wrapup`,
CAST(`datacapturekey` AS VARCHAR(2000)) AS `datacapturekey`, CAST(`leadgendate`
AS VARCHAR(2000)) AS `leadgendate`, CAST(`crla1` AS VARCHAR(2000)) AS `crla1`,
CAST(`crla2` AS VARCHAR(2000)) AS `crla2`, CAST(`invalid_lead` AS INTEGER) AS
`invalid_lead`, CAST(`destination_advertiser_vendor_name` AS VARCHAR(2000)) AS
`destination_advertiser_vendor_name`, CAST(`source_program_key` AS
VARCHAR(2000)) AS `source_program_key`, CAST(`publisher_publisher` AS
VARCHAR(2000)) AS `publisher_publisher`, CAST(`areaname` AS VARCHAR(2000)) AS
`areaname`, CAST(`data_abertura_ficha` AS VARCHAR(2000)) AS
`data_abertura_ficha`\nFROM
`dfs`.`root`.`/user/bigtable/logs/hive/warehouse/bt_br_cc_invalid_leads`",
"fields" : [ {
"name" : "wrapup",
"type" : "VARCHAR",
"precision" : 2000,
"isNullable" : true
}, {
"name" : "datacapturekey",
"type" : "VARCHAR",
"precision" : 2000,
"isNullable" : true
...
...
// total number of rows in bt_br_cc_invalid_leads
0: jdbc:drill:drillbit=test.a.node1> select count(*) from
bt_br_cc_invalid_leads ;
+---------+
| EXPR$0 |
+---------+
| 20599 |
+---------+
1 row selected (0.173 seconds)
{noformat}
Stack trace from drillbit.log
{noformat}
2019-03-18 12:19:01,610 [237010da-6eda-a913-0424-32f63fbe01be:foreman] INFO
o.a.drill.exec.work.foreman.Foreman - Query text for query with id
237010da-6eda-a913-0424-32f63fbe01be issued by bigtable: SELECT
`bt_br_cc_invalid_leads`.`datacapturekey` AS `datacapturekey`
FROM `dfs.drill_views`.`bt_br_cc_invalid_leads` `bt_br_cc_invalid_leads`
GROUP BY `bt_br_cc_invalid_leads`.`datacapturekey`
2019-03-18 12:19:02,495 [237010da-6eda-a913-0424-32f63fbe01be:frag:0:0] INFO
o.a.d.e.w.fragment.FragmentExecutor - 237010da-6eda-a913-0424-32f63fbe01be:0:0:
State change requested AWAITING_ALLOCATION --> RUNNING
2019-03-18 12:19:02,495 [237010da-6eda-a913-0424-32f63fbe01be:frag:0:0] INFO
o.a.d.e.w.f.FragmentStatusReporter - 237010da-6eda-a913-0424-32f63fbe01be:0:0:
State to report: RUNNING
2019-03-18 12:19:02,502 [237010da-6eda-a913-0424-32f63fbe01be:frag:0:0] INFO
o.a.d.exec.physical.impl.ScanBatch - User Error Occurred: Error in parquet
record reader.
Message:
Hadoop path: /user/bigtable/logs/hive/warehouse/bt_br_cc_invalid_leads/000008_0
Total records read: 0
Row group index: 0
Records in row group: 1551
Parquet Metadata: ParquetMetaData{FileMetaData{schema: message hive_schema {
optional binary wrapup (UTF8);
optional binary datacapturekey (UTF8);
optional binary leadgendate (UTF8);
optional binary crla1 (UTF8);
optional binary crla2 (UTF8);
optional binary invalid_lead (UTF8);
optional binary destination_advertiser_vendor_name (UTF8);
optional binary source_program_key (UTF8);
optional binary publisher_publisher (UTF8);
optional binary areaname (UTF8);
optional binary data_abertura_ficha (UTF8);
}
, metadata: {}}, blocks: [BlockMetaData\{1551, 139906
[ColumnMetaData{UNCOMPRESSED [wrapup] optional binary wrapup (UTF8)
[PLAIN_DICTIONARY, RLE, BIT_PACKED], 4}, ColumnMetaData\{UNCOMPRESSED
[datacapturekey] optional binary datacapturekey (UTF8) [RLE, PLAIN,
BIT_PACKED], 656}, ColumnMetaData\{UNCOMPRESSED [leadgendate] optional binary
leadgendate (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 23978},
ColumnMetaData\{UNCOMPRESSED [crla1] optional binary crla1 (UTF8) [RLE, PLAIN,
BIT_PACKED], 26448}, ColumnMetaData\{UNCOMPRESSED [crla2] optional binary crla2
(UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 62196},
ColumnMetaData\{UNCOMPRESSED [invalid_lead] optional binary invalid_lead (UTF8)
[PLAIN_DICTIONARY, RLE, BIT_PACKED], 92509}, ColumnMetaData\{UNCOMPRESSED
[destination_advertiser_vendor_name] optional binary
destination_advertiser_vendor_name (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED],
92565}, ColumnMetaData\{UNCOMPRESSED [source_program_key] optional binary
source_program_key (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 93571},
ColumnMetaData\{UNCOMPRESSED [publisher_publisher] optional binary
publisher_publisher (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 94587},
ColumnMetaData\{UNCOMPRESSED [areaname] optional binary areaname (UTF8)
[PLAIN_DICTIONARY, RLE, BIT_PACKED], 96042}, ColumnMetaData\{UNCOMPRESSED
[data_abertura_ficha] optional binary data_abertura_ficha (UTF8) [RLE, PLAIN,
BIT_PACKED], 104162}]}]} (Error in parquet record reader.
Message:
Hadoop path: /user/bigtable/logs/hive/warehouse/bt_br_cc_invalid_leads/000008_0
Total records read: 0
Row group index: 0
Records in row group: 1551
Parquet Metadata: ParquetMetaData{FileMetaData{schema: message hive_schema {
optional binary wrapup (UTF8);
optional binary datacapturekey (UTF8);
optional binary leadgendate (UTF8);
optional binary crla1 (UTF8);
optional binary crla2 (UTF8);
optional binary invalid_lead (UTF8);
optional binary destination_advertiser_vendor_name (UTF8);
optional binary source_program_key (UTF8);
optional binary publisher_publisher (UTF8);
optional binary areaname (UTF8);
optional binary data_abertura_ficha (UTF8);
}
, metadata: {}}, blocks: [BlockMetaData\{1551, 139906
[ColumnMetaData{UNCOMPRESSED [wrapup] optional binary wrapup (UTF8)
[PLAIN_DICTIONARY, RLE, BIT_PACKED], 4}, ColumnMetaData\{UNCOMPRESSED
[datacapturekey] optional binary datacapturekey (UTF8) [RLE, PLAIN,
BIT_PACKED], 656}, ColumnMetaData\{UNCOMPRESSED [leadgendate] optional binary
leadgendate (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 23978},
ColumnMetaData\{UNCOMPRESSED [crla1] optional binary crla1 (UTF8) [RLE, PLAIN,
BIT_PACKED], 26448}, ColumnMetaData\{UNCOMPRESSED [crla2] optional binary crla2
(UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 62196},
ColumnMetaData\{UNCOMPRESSED [invalid_lead] optional binary invalid_lead (UTF8)
[PLAIN_DICTIONARY, RLE, BIT_PACKED], 92509}, ColumnMetaData\{UNCOMPRESSED
[destination_advertiser_vendor_name] optional binary
destination_advertiser_vendor_name (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED],
92565}, ColumnMetaData\{UNCOMPRESSED [source_program_key] optional binary
source_program_key (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 93571},
ColumnMetaData\{UNCOMPRESSED [publisher_publisher] optional binary
publisher_publisher (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 94587},
ColumnMetaData\{UNCOMPRESSED [areaname] optional binary areaname (UTF8)
[PLAIN_DICTIONARY, RLE, BIT_PACKED], 96042}, ColumnMetaData\{UNCOMPRESSED
[data_abertura_ficha] optional binary data_abertura_ficha (UTF8) [RLE, PLAIN,
BIT_PACKED], 104162}]}]})
org.apache.drill.common.exceptions.UserException: INTERNAL_ERROR ERROR: Error
in parquet record reader.
Message:
Hadoop path: /user/bigtable/logs/hive/warehouse/bt_br_cc_invalid_leads/000008_0
Total records read: 0
Row group index: 0
Records in row group: 1551
Parquet Metadata: ParquetMetaData{FileMetaData{schema: message hive_schema {
optional binary wrapup (UTF8);
optional binary datacapturekey (UTF8);
optional binary leadgendate (UTF8);
optional binary crla1 (UTF8);
optional binary crla2 (UTF8);
optional binary invalid_lead (UTF8);
optional binary destination_advertiser_vendor_name (UTF8);
optional binary source_program_key (UTF8);
optional binary publisher_publisher (UTF8);
optional binary areaname (UTF8);
optional binary data_abertura_ficha (UTF8);
}
, metadata: {}}, blocks: [BlockMetaData\{1551, 139906
[ColumnMetaData{UNCOMPRESSED [wrapup] optional binary wrapup (UTF8)
[PLAIN_DICTIONARY, RLE, BIT_PACKED], 4}, ColumnMetaData\{UNCOMPRESSED
[datacapturekey] optional binary datacapturekey (UTF8) [RLE, PLAIN,
BIT_PACKED], 656}, ColumnMetaData\{UNCOMPRESSED [leadgendate] optional binary
leadgendate (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 23978},
ColumnMetaData\{UNCOMPRESSED [crla1] optional binary crla1 (UTF8) [RLE, PLAIN,
BIT_PACKED], 26448}, ColumnMetaData\{UNCOMPRESSED [crla2] optional binary crla2
(UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 62196},
ColumnMetaData\{UNCOMPRESSED [invalid_lead] optional binary invalid_lead (UTF8)
[PLAIN_DICTIONARY, RLE, BIT_PACKED], 92509}, ColumnMetaData\{UNCOMPRESSED
[destination_advertiser_vendor_name] optional binary
destination_advertiser_vendor_name (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED],
92565}, ColumnMetaData\{UNCOMPRESSED [source_program_key] optional binary
source_program_key (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 93571},
ColumnMetaData\{UNCOMPRESSED [publisher_publisher] optional binary
publisher_publisher (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 94587},
ColumnMetaData\{UNCOMPRESSED [areaname] optional binary areaname (UTF8)
[PLAIN_DICTIONARY, RLE, BIT_PACKED], 96042}, ColumnMetaData\{UNCOMPRESSED
[data_abertura_ficha] optional binary data_abertura_ficha (UTF8) [RLE, PLAIN,
BIT_PACKED], 104162}]}]}
Please, refer to logs for more information.
[Error Id: f951a96c-623e-4423-b4f9-806a29b398dd ]
at
org.apache.drill.common.exceptions.UserException$Builder.build(UserException.java:633)
~[drill-common-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at org.apache.drill.exec.physical.impl.ScanBatch.next(ScanBatch.java:293)
[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at
org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:126)
[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at
org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:116)
[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at
org.apache.drill.exec.record.AbstractUnaryRecordBatch.innerNext(AbstractUnaryRecordBatch.java:63)
[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at
org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext(ProjectRecordBatch.java:143)
[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at
org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:186)
[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at
org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:126)
[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at
org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:116)
[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at
org.apache.drill.exec.physical.impl.aggregate.HashAggBatch.buildSchema(HashAggBatch.java:226)
[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at
org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:161)
[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at
org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:126)
[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at
org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:116)
[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at
org.apache.drill.exec.record.AbstractUnaryRecordBatch.innerNext(AbstractUnaryRecordBatch.java:63)
[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at
org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext(ProjectRecordBatch.java:143)
[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at
org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:186)
[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at
org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:104)
[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at
org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext(ScreenCreator.java:83)
[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:94)
[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at
org.apache.drill.exec.work.fragment.FragmentExecutor$1.run(FragmentExecutor.java:297)
[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at
org.apache.drill.exec.work.fragment.FragmentExecutor$1.run(FragmentExecutor.java:284)
[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at java.security.AccessController.doPrivileged(Native Method) [na:1.8.0_152]
at javax.security.auth.Subject.doAs(Subject.java:422) [na:1.8.0_152]
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1669)
[hadoop-common-2.7.0-mapr-1808.jar:na]
at
org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:284)
[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at
org.apache.drill.common.SelfCleaningRunnable.run(SelfCleaningRunnable.java:38)
[drill-common-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[na:1.8.0_152]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[na:1.8.0_152]
at java.lang.Thread.run(Thread.java:748) [na:1.8.0_152]
Caused by: org.apache.drill.common.exceptions.DrillRuntimeException: Error in
parquet record reader.
Message:
Hadoop path: /user/bigtable/logs/hive/warehouse/bt_br_cc_invalid_leads/000008_0
Total records read: 0
Row group index: 0
Records in row group: 1551
Parquet Metadata: ParquetMetaData{FileMetaData{schema: message hive_schema {
optional binary wrapup (UTF8);
optional binary datacapturekey (UTF8);
optional binary leadgendate (UTF8);
optional binary crla1 (UTF8);
optional binary crla2 (UTF8);
optional binary invalid_lead (UTF8);
optional binary destination_advertiser_vendor_name (UTF8);
optional binary source_program_key (UTF8);
optional binary publisher_publisher (UTF8);
optional binary areaname (UTF8);
optional binary data_abertura_ficha (UTF8);
}
, metadata: {}}, blocks: [BlockMetaData\{1551, 139906
[ColumnMetaData{UNCOMPRESSED [wrapup] optional binary wrapup (UTF8)
[PLAIN_DICTIONARY, RLE, BIT_PACKED], 4}, ColumnMetaData\{UNCOMPRESSED
[datacapturekey] optional binary datacapturekey (UTF8) [RLE, PLAIN,
BIT_PACKED], 656}, ColumnMetaData\{UNCOMPRESSED [leadgendate] optional binary
leadgendate (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 23978},
ColumnMetaData\{UNCOMPRESSED [crla1] optional binary crla1 (UTF8) [RLE, PLAIN,
BIT_PACKED], 26448}, ColumnMetaData\{UNCOMPRESSED [crla2] optional binary crla2
(UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 62196},
ColumnMetaData\{UNCOMPRESSED [invalid_lead] optional binary invalid_lead (UTF8)
[PLAIN_DICTIONARY, RLE, BIT_PACKED], 92509}, ColumnMetaData\{UNCOMPRESSED
[destination_advertiser_vendor_name] optional binary
destination_advertiser_vendor_name (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED],
92565}, ColumnMetaData\{UNCOMPRESSED [source_program_key] optional binary
source_program_key (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 93571},
ColumnMetaData\{UNCOMPRESSED [publisher_publisher] optional binary
publisher_publisher (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 94587},
ColumnMetaData\{UNCOMPRESSED [areaname] optional binary areaname (UTF8)
[PLAIN_DICTIONARY, RLE, BIT_PACKED], 96042}, ColumnMetaData\{UNCOMPRESSED
[data_abertura_ficha] optional binary data_abertura_ficha (UTF8) [RLE, PLAIN,
BIT_PACKED], 104162}]}]}
at
org.apache.drill.exec.store.parquet.columnreaders.ParquetRecordReader.handleException(ParquetRecordReader.java:271)
~[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at
org.apache.drill.exec.store.parquet.columnreaders.ParquetRecordReader.next(ParquetRecordReader.java:290)
~[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at
org.apache.drill.exec.physical.impl.ScanBatch.internalNext(ScanBatch.java:223)
[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at org.apache.drill.exec.physical.impl.ScanBatch.next(ScanBatch.java:271)
[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
... 27 common frames omitted
Caused by: java.lang.IllegalStateException: Read batch count [0] should be
greater than zero
at
org.apache.drill.shaded.guava.com.google.common.base.Preconditions.checkState(Preconditions.java:509)
~[drill-shaded-guava-23.0.jar:23.0]
at
org.apache.drill.exec.store.parquet.columnreaders.VarLenNullableFixedEntryReader.getEntry(VarLenNullableFixedEntryReader.java:49)
~[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at
org.apache.drill.exec.store.parquet.columnreaders.VarLenBulkPageReader.getFixedEntry(VarLenBulkPageReader.java:167)
~[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at
org.apache.drill.exec.store.parquet.columnreaders.VarLenBulkPageReader.getEntry(VarLenBulkPageReader.java:132)
~[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at
org.apache.drill.exec.store.parquet.columnreaders.VarLenColumnBulkInput.next(VarLenColumnBulkInput.java:154)
~[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at
org.apache.drill.exec.store.parquet.columnreaders.VarLenColumnBulkInput.next(VarLenColumnBulkInput.java:38)
~[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at
org.apache.drill.exec.vector.VarCharVector$Mutator.setSafe(VarCharVector.java:624)
~[vector-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at
org.apache.drill.exec.vector.NullableVarCharVector$Mutator.setSafe(NullableVarCharVector.java:716)
~[vector-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at
org.apache.drill.exec.store.parquet.columnreaders.VarLengthColumnReaders$NullableVarCharColumn.setSafe(VarLengthColumnReaders.java:215)
~[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at
org.apache.drill.exec.store.parquet.columnreaders.VarLengthValuesColumn.readRecordsInBulk(VarLengthValuesColumn.java:98)
~[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at
org.apache.drill.exec.store.parquet.columnreaders.VarLenBinaryReader.readRecordsInBulk(VarLenBinaryReader.java:114)
~[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at
org.apache.drill.exec.store.parquet.columnreaders.VarLenBinaryReader.readFields(VarLenBinaryReader.java:92)
~[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at
org.apache.drill.exec.store.parquet.columnreaders.BatchReader$VariableWidthReader.readRecords(BatchReader.java:156)
~[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at
org.apache.drill.exec.store.parquet.columnreaders.BatchReader.readBatch(BatchReader.java:43)
~[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at
org.apache.drill.exec.store.parquet.columnreaders.ParquetRecordReader.next(ParquetRecordReader.java:288)
~[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
... 29 common frames omitted
2019-03-18 12:19:02,502 [237010da-6eda-a913-0424-32f63fbe01be:frag:0:0] INFO
o.a.d.e.w.fragment.FragmentExecutor - 237010da-6eda-a913-0424-32f63fbe01be:0:0:
State change requested RUNNING --> FAILED
2019-03-18 12:19:02,502 [237010da-6eda-a913-0424-32f63fbe01be:frag:0:0] ERROR
o.a.d.e.physical.impl.BaseRootExec - Batch dump started: dumping last 2 failed
batches
2019-03-18 12:19:02,503 [237010da-6eda-a913-0424-32f63fbe01be:frag:0:0] ERROR
o.a.d.e.p.i.p.ProjectRecordBatch - ProjectRecordBatch[projector=null,
hasRemainder=false, remainderIndex=0, recordCount=0,
container=org.apache.drill.exec.record.VectorContainer@79a74963[recordCount =
0, schemaChanged = true, schema = null, wrappers = [], ...]]
2019-03-18 12:19:02,503 [237010da-6eda-a913-0424-32f63fbe01be:frag:0:0] ERROR
o.a.d.exec.physical.impl.ScanBatch -
ScanBatch[container=org.apache.drill.exec.record.VectorContainer@321387c5[recordCount
= 0, schemaChanged = true, schema = null, wrappers =
[org.apache.drill.exec.vector.NullableVarCharVector@25c92bff[field =
[`datacapturekey` (VARCHAR:OPTIONAL)], ...]], ...],
currentReader=ParquetRecordReader[File=/user/bigtable/logs/hive/warehouse/bt_br_cc_invalid_leads/000008_0,
Row group index=0, Records in row group=1551, Total records read=0,
MetadataParquetMetaData{FileMetaData{schema: message hive_schema {
optional binary wrapup (UTF8);
optional binary datacapturekey (UTF8);
optional binary leadgendate (UTF8);
optional binary crla1 (UTF8);
optional binary crla2 (UTF8);
optional binary invalid_lead (UTF8);
optional binary destination_advertiser_vendor_name (UTF8);
optional binary source_program_key (UTF8);
optional binary publisher_publisher (UTF8);
optional binary areaname (UTF8);
optional binary data_abertura_ficha (UTF8);
}
, metadata: {}}, blocks: [BlockMetaData\{1551, 139906
[ColumnMetaData{UNCOMPRESSED [wrapup] optional binary wrapup (UTF8)
[PLAIN_DICTIONARY, RLE, BIT_PACKED], 4}, ColumnMetaData\{UNCOMPRESSED
[datacapturekey] optional binary datacapturekey (UTF8) [RLE, PLAIN,
BIT_PACKED], 656}, ColumnMetaData\{UNCOMPRESSED [leadgendate] optional binary
leadgendate (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 23978},
ColumnMetaData\{UNCOMPRESSED [crla1] optional binary crla1 (UTF8) [RLE, PLAIN,
BIT_PACKED], 26448}, ColumnMetaData\{UNCOMPRESSED [crla2] optional binary crla2
(UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 62196},
ColumnMetaData\{UNCOMPRESSED [invalid_lead] optional binary invalid_lead (UTF8)
[PLAIN_DICTIONARY, RLE, BIT_PACKED], 92509}, ColumnMetaData\{UNCOMPRESSED
[destination_advertiser_vendor_name] optional binary
destination_advertiser_vendor_name (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED],
92565}, ColumnMetaData\{UNCOMPRESSED [source_program_key] optional binary
source_program_key (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 93571},
ColumnMetaData\{UNCOMPRESSED [publisher_publisher] optional binary
publisher_publisher (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 94587},
ColumnMetaData\{UNCOMPRESSED [areaname] optional binary areaname (UTF8)
[PLAIN_DICTIONARY, RLE, BIT_PACKED], 96042}, ColumnMetaData\{UNCOMPRESSED
[data_abertura_ficha] optional binary data_abertura_ficha (UTF8) [RLE, PLAIN,
BIT_PACKED], 104162}]}]}], schema=null]
2019-03-18 12:19:02,503 [237010da-6eda-a913-0424-32f63fbe01be:frag:0:0] ERROR
o.a.d.e.physical.impl.BaseRootExec - Batch dump completed.
2019-03-18 12:19:02,504 [237010da-6eda-a913-0424-32f63fbe01be:frag:0:0] INFO
o.a.d.e.w.fragment.FragmentExecutor - 237010da-6eda-a913-0424-32f63fbe01be:0:0:
State change requested FAILED --> FINISHED
2019-03-18 12:19:02,508 [237010da-6eda-a913-0424-32f63fbe01be:frag:0:0] WARN
o.a.d.exec.rpc.control.WorkEventBus - Fragment
237010da-6eda-a913-0424-32f63fbe01be:0:0 manager is not found in the work bus.
2019-03-18 12:19:02,520 [237010da-6eda-a913-0424-32f63fbe01be:frag:0:0] WARN
o.a.d.e.w.f.QueryStateProcessor - Dropping request to move to COMPLETED state
as query is already at FAILED state (which is terminal).
[test@test1917 logs]$
{noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
