[
https://issues.apache.org/jira/browse/DRILL-1304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14099375#comment-14099375
]
Jason Altekruse commented on DRILL-1304:
----------------------------------------
I have a patch that includes a fix for this issue and DRILL-1307. I am avoiding
posting the patch for review until the DirectMemory based reading is merged
into master. This has been rebased repeatedly on top of some changes to the old
byte array based version of the reader, and it would be simpler to make the new
changes on top of it.
> Failure in parquet reader when projecting selected columns from Lineitem table
> ------------------------------------------------------------------------------
>
> Key: DRILL-1304
> URL: https://issues.apache.org/jira/browse/DRILL-1304
> Project: Apache Drill
> Issue Type: Bug
> Components: Storage - Parquet
> Affects Versions: 0.4.0
> Reporter: Aman Sinha
> Assignee: Jason Altekruse
> Priority: Critical
> Fix For: 0.5.0
>
>
> See query and stack trace below.
> Make sure you are using TPCH SF1 (or higher) scale factor.
> 0: jdbc:drill:zk=local> select l.l_partkey from lineitem l order by
> l.l_partkey limit 1;
> Query failed: Failure while running fragment. minWritableBytes: -487112
> (expected: >= 0) [eb48980b-5966-4aef-95f0-c990649e4e9c]
> Error: exception while executing query: Failure while trying to get next
> result batch. (state=,code=0)
> java.lang.IllegalArgumentException: minWritableBytes: -487112 (expected: >= 0)
>
> io.netty.buffer.AbstractByteBuf.ensureWritable(AbstractByteBuf.java:233)
> ~[netty-buffer-4.0.20.Final.jar:4.0.20.Final]
> io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:818)
> ~[netty-buffer-4.0.20.Final.jar:4.0.20.Final]
> io.netty.buffer.WrappedByteBuf.writeBytes(WrappedByteBuf.java:624)
> ~[netty-buffer-4.0.20.Final.jar:4.0.20.Final]
>
> io.netty.buffer.AccountingByteBuf.writeBytes(AccountingByteBuf.java:671)
> ~[drill-java-exec-0.5.0-incubating-SNAPSHOT-rebuffed.jar:4.0.20.Final]
>
> org.apache.drill.exec.store.parquet.columnreaders.FixedByteAlignedReader.writeData(FixedByteAlignedReader.java:63)
>
> ~[drill-java-exec-0.5.0-incubating-SNAPSHOT-rebuffed.jar:0.5.0-incubating-SNAPSHOT]
>
> org.apache.drill.exec.store.parquet.columnreaders.FixedByteAlignedReader.readField(FixedByteAlignedReader.java:59)
>
> ~[drill-java-exec-0.5.0-incubating-SNAPSHOT-rebuffed.jar:0.5.0-incubating-SNAPSHOT]
>
> org.apache.drill.exec.store.parquet.columnreaders.ColumnReader.readValues(ColumnReader.java:116)
>
> ~[drill-java-exec-0.5.0-incubating-SNAPSHOT-rebuffed.jar:0.5.0-incubating-SNAPSHOT]
>
> org.apache.drill.exec.store.parquet.columnreaders.ColumnReader.processPageData(ColumnReader.java:163)
>
> ~[drill-java-exec-0.5.0-incubating-SNAPSHOT-rebuffed.jar:0.5.0-incubating-SNAPSHOT]
>
> org.apache.drill.exec.store.parquet.columnreaders.ColumnReader.determineSize(ColumnReader.java:142)
>
> ~[drill-java-exec-0.5.0-incubating-SNAPSHOT-rebuffed.jar:0.5.0-incubating-SNAPSHOT]
>
> org.apache.drill.exec.store.parquet.columnreaders.ColumnReader.processPages(ColumnReader.java:104)
>
> ~[drill-java-exec-0.5.0-incubating-SNAPSHOT-rebuffed.jar:0.5.0-incubating-SNAPSHOT]
>
> org.apache.drill.exec.store.parquet.columnreaders.ParquetRecordReader.readAllFixedFields(ParquetRecordReader.java:302)
>
> ~[drill-java-exec-0.5.0-incubating-SNAPSHOT-rebuffed.jar:0.5.0-incubating-SNAPSHOT]
>
> org.apache.drill.exec.store.parquet.columnreaders.ParquetRecordReader.next(ParquetRecordReader.java:337)
>
> ~[drill-java-exec-0.5.0-incubating-SNAPSHOT-rebuffed.jar:0.5.0-incubating-SNAPSHOT]
>
> org.apache.drill.exec.physical.impl.ScanBatch.next(ScanBatch.java:148)
> ~[drill-java-exec-0.5.0-incubating-SNAPSHOT-rebuffed.jar:0.5.0-incubating-SNAPSHOT]
>
> org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:59)
> ~[drill-java-exec-0.5.0-incubating-SNAPSHOT-rebuffed.jar:0.5.0-incubating-SNAPSHOT]
>
> org.apache.drill.exec.physical.impl.partitionsender.PartitionSenderRootExec.innerNext(PartitionSenderRootExec.java:122)
>
> ~[drill-java-exec-0.5.0-incubating-SNAPSHOT-rebuffed.jar:0.5.0-incubating-SNAPSHOT]
>
> org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:49)
> ~[drill-java-exec-0.5.0-incubating-SNAPSHOT-rebuffed.jar:0.5.0-incubating-SNAPSHOT]
>
> org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:105)
>
> ~[drill-java-exec-0.5.0-incubating-SNAPSHOT-rebuffed.jar:0.5.0-incubating-SNAPSHOT]
--
This message was sent by Atlassian JIRA
(v6.2#6252)
