[
https://issues.apache.org/jira/browse/DRILL-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15060473#comment-15060473
]
Dechang Gu commented on DRILL-4205:
-----------------------------------
Error: SYSTEM ERROR: IndexOutOfBoundsException: srcIndex: 1048587
Fragment 0:0
[Error Id: ad8d2bc0-259f-483c-9024-93865963541e on ucs-node4.perf.lab:31010]
(org.apache.drill.common.exceptions.DrillRuntimeException) Error in parquet
record reader.
Message:
Hadoop path: /tpcdsPigParq/SF100/store_sales/part-m-00073.parquet
Total records read: 135280
Mock records read: 0
Records to read: 1424
Row group index: 0
Records in row group: 3775712
Parquet Metadata: ParquetMetaData{FileMetaData{schema: message pig_schema {
optional int64 ss_sold_date_sk;
optional int64 ss_sold_time_sk;
optional int64 ss_item_sk;
optional int64 ss_customer_sk;
optional int64 ss_cdemo_sk;
optional int64 ss_hdemo_sk;
optional int64 ss_addr_sk;
optional int64 ss_store_sk;
optional int64 ss_promo_sk;
optional int64 ss_ticket_number;
optional int64 ss_quantity;
optional double ss_wholesale_cost;
optional double ss_list_price;
optional double ss_sales_price;
optional double ss_ext_discount_amt;
optional double ss_ext_sales_price;
optional double ss_ext_wholesale_cost;
optional double ss_ext_list_price;
optional double ss_ext_tax;
optional double ss_coupon_amt;
optional double ss_net_paid;
optional double ss_net_paid_inc_tax;
optional double ss_net_profit;
}
, metadata: {pig.schema=ss_sold_date_sk: long,ss_sold_time_sk: long,ss_item_sk:
long,ss_customer_sk: long,ss_cdemo_sk: long,ss_hdemo_sk: long,ss_addr_sk:
long,ss_store_sk: long,ss_promo_sk: long,ss_ticket_number: long,ss_quantity:
long,ss_wholesale_cost: double,ss_list_price: double,ss_sales_price:
double,ss_ext_discount_amt: double,ss_ext_sales_price:
double,ss_ext_wholesale_cost: double,ss_ext_list_price: double,ss_ext_tax:
double,ss_coupon_amt: double,ss_net_paid: double,ss_net_paid_inc_tax:
double,ss_net_profit: double}}, blocks: [BlockMetaData{3775712, 0
[ColumnMetaData{UNCOMPRESSED [ss_sold_date_sk] INT64 [], 4},
ColumnMetaData{UNCOMPRESSED [ss_sold_time_sk] INT64 [], 29267389},
ColumnMetaData{UNCOMPRESSED [ss_item_sk] INT64 [], 58537018},
ColumnMetaData{UNCOMPRESSED [ss_customer_sk] INT64 [], 88743669},
ColumnMetaData{UNCOMPRESSED [ss_cdemo_sk] INT64 [], 118014602},
ColumnMetaData{UNCOMPRESSED [ss_hdemo_sk] INT64 [], 147285963},
ColumnMetaData{UNCOMPRESSED [ss_addr_sk] INT64 [], 176556258},
ColumnMetaData{UNCOMPRESSED [ss_store_sk] INT64 [], 205824976},
ColumnMetaData{UNCOMPRESSED [ss_promo_sk] INT64 [], 235094014},
ColumnMetaData{UNCOMPRESSED [ss_ticket_number] INT64 [], 264361193},
ColumnMetaData{UNCOMPRESSED [ss_quantity] INT64 [], 294567844},
ColumnMetaData{UNCOMPRESSED [ss_wholesale_cost] DOUBLE [], 323835708},
ColumnMetaData{UNCOMPRESSED [ss_list_price] DOUBLE [], 353102398},
ColumnMetaData{UNCOMPRESSED [ss_sales_price] DOUBLE [], 382371438},
ColumnMetaData{UNCOMPRESSED [ss_ext_discount_amt] DOUBLE [], 411640889},
ColumnMetaData{UNCOMPRESSED [ss_ext_sales_price] DOUBLE [], 440911353},
ColumnMetaData{UNCOMPRESSED [ss_ext_wholesale_cost] DOUBLE [], 470180589},
ColumnMetaData{UNCOMPRESSED [ss_ext_list_price] DOUBLE [], 499448181},
ColumnMetaData{UNCOMPRESSED [ss_ext_tax] DOUBLE [], 528714378},
ColumnMetaData{UNCOMPRESSED [ss_coupon_amt] DOUBLE [], 557982761},
ColumnMetaData{UNCOMPRESSED [ss_net_paid] DOUBLE [], 587253225},
ColumnMetaData{UNCOMPRESSED [ss_net_paid_inc_tax] DOUBLE [], 616521701},
ColumnMetaData{UNCOMPRESSED [ss_net_profit] DOUBLE [], 645790652}]}]}
org.apache.drill.exec.store.parquet.columnreaders.ParquetRecordReader.handleAndRaise():345
org.apache.drill.exec.store.parquet.columnreaders.ParquetRecordReader.next():447
org.apache.drill.exec.physical.impl.ScanBatch.next():191
org.apache.drill.exec.record.AbstractRecordBatch.next():119
org.apache.drill.exec.record.AbstractRecordBatch.next():109
org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext():51
org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext():132
org.apache.drill.exec.record.AbstractRecordBatch.next():162
org.apache.drill.exec.physical.impl.BaseRootExec.next():104
org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext():81
org.apache.drill.exec.physical.impl.BaseRootExec.next():94
org.apache.drill.exec.work.fragment.FragmentExecutor$1.run():256
org.apache.drill.exec.work.fragment.FragmentExecutor$1.run():250
java.security.AccessController.doPrivileged():-2
javax.security.auth.Subject.doAs():415
org.apache.hadoop.security.UserGroupInformation.doAs():1595
org.apache.drill.exec.work.fragment.FragmentExecutor.run():250
org.apache.drill.common.SelfCleaningRunnable.run():38
java.util.concurrent.ThreadPoolExecutor.runWorker():1145
java.util.concurrent.ThreadPoolExecutor$Worker.run():615
java.lang.Thread.run():745
Caused By (java.lang.IndexOutOfBoundsException) srcIndex: 1048587
io.netty.buffer.PooledUnsafeDirectByteBuf.setBytes():255
io.netty.buffer.WrappedByteBuf.setBytes():378
io.netty.buffer.UnsafeDirectLittleEndian.setBytes():26
io.netty.buffer.DrillBuf.setBytes():685
io.netty.buffer.AbstractByteBuf.writeBytes():850
org.apache.drill.exec.store.parquet.columnreaders.NullableFixedByteAlignedReaders$NullableFixedByteAlignedReader.readField():68
org.apache.drill.exec.store.parquet.columnreaders.NullableColumnReader.processPages():152
org.apache.drill.exec.store.parquet.columnreaders.ParquetRecordReader.readAllFixedFields():386
org.apache.drill.exec.store.parquet.columnreaders.ParquetRecordReader.next():429
org.apache.drill.exec.physical.impl.ScanBatch.next():191
org.apache.drill.exec.record.AbstractRecordBatch.next():119
org.apache.drill.exec.record.AbstractRecordBatch.next():109
org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext():51
org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext():132
org.apache.drill.exec.record.AbstractRecordBatch.next():162
org.apache.drill.exec.physical.impl.BaseRootExec.next():104
org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext():81
org.apache.drill.exec.physical.impl.BaseRootExec.next():94
org.apache.drill.exec.work.fragment.FragmentExecutor$1.run():256
org.apache.drill.exec.work.fragment.FragmentExecutor$1.run():250
java.security.AccessController.doPrivileged():-2
javax.security.auth.Subject.doAs():415
org.apache.hadoop.security.UserGroupInformation.doAs():1595
org.apache.drill.exec.work.fragment.FragmentExecutor.run():250
org.apache.drill.common.SelfCleaningRunnable.run():38
java.util.concurrent.ThreadPoolExecutor.runWorker():1145
java.util.concurrent.ThreadPoolExecutor$Worker.run():615
java.lang.Thread.run():745 (state=,code=0)
> Simple query hit IndexOutOfBoundException
> ------------------------------------------
>
> Key: DRILL-4205
> URL: https://issues.apache.org/jira/browse/DRILL-4205
> Project: Apache Drill
> Issue Type: Bug
> Components: Functions - Drill
> Affects Versions: 1.4.0
> Reporter: Dechang Gu
> Assignee: Parth Chandra
>
> The following query failed due to IOB:
> 0: jdbc:drill:schema=wf_pigprq100> select * from
> `store_sales/part-m-00073.parquet`;
> Error: SYSTEM ERROR: IndexOutOfBoundsException: srcIndex: 1048587
> Fragment 0:0
> [Error Id: ad8d2bc0-259f-483c-9024-93865963541e on ucs-node4.perf.lab:31010]
> (org.apache.drill.common.exceptions.DrillRuntimeException) Error in parquet
> record reader.
> Message:
> Hadoop path: /tpcdsPigParq/SF100/store_sales/part-m-00073.parquet
> Total records read: 135280
> Mock records read: 0
> Records to read: 1424
> Row group index: 0
> Records in row group: 3775712
> Parquet Metadata: ParquetMetaData{FileMetaData{schema: message pig_schema {
> optional int64 ss_sold_date_sk;
> optional int64 ss_sold_time_sk;
> optional int64 ss_item_sk;
> optional int64 ss_customer_sk;
> optional int64 ss_cdemo_sk;
> optional int64 ss_hdemo_sk;
> optional int64 ss_addr_sk;
> optional int64 ss_store_sk;
> optional int64 ss_promo_sk;
> optional int64 ss_ticket_number;
> optional int64 ss_quantity;
> optional double ss_wholesale_cost;
> optional double ss_list_price;
> optional double ss_sales_price;
> optional double ss_ext_discount_amt;
> optional double ss_ext_sales_price;
> optional double ss_ext_wholesale_cost;
> optional double ss_ext_list_price;
> optional double ss_ext_tax;
> optional double ss_coupon_amt;
> optional double ss_net_paid;
> optional double ss_net_paid_inc_tax;
> optional double ss_net_profit;
> }
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
