[
https://issues.apache.org/jira/browse/DRILL-5569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102331#comment-16102331
]
Kunal Khatua commented on DRILL-5569:
-------------------------------------
[~khfaraaz] can you verify whether this issue is resolved?
A PR (https://github.com/apache/drill/pull/862) for DRILL-5420 might have
addressed this.
> NullPointerException in Async Parquet reader
> --------------------------------------------
>
> Key: DRILL-5569
> URL: https://issues.apache.org/jira/browse/DRILL-5569
> Project: Apache Drill
> Issue Type: Bug
> Components: Storage - Parquet
> Affects Versions: 1.11.0
> Reporter: Khurram Faraaz
>
> The below Exception was seen when TPC-DS Query 4 was executed against Drill
> 1.11.0
> Drill 1.11.0 git commit ID: d11aba2
> [root@centos-01 mapr]# cat MapRBuildVersion
> 5.2.1.42646.GA
> Stack trace from drillbit.log
> {noformat}
> 2017-06-06 07:46:43,160 [Drillbit-ShutdownHook#0] WARN
> o.apache.drill.exec.work.WorkManager - Closing WorkManager but there are 80
> running fragments.
> 2017-06-06 07:46:43,207 [Drillbit-ShutdownHook#0] INFO
> o.a.drill.exec.compile.CodeCompiler - Stats: code gen count: 959, cache miss
> count: 12, hit rate: 99%
> 2017-06-06 07:46:43,504 [scan-3] ERROR
> o.a.d.e.u.f.BufferedDirectBufInputStream - Error reading from stream
> 1_1_0.parquet. Error was : Error reading out of an FSDataInputStream using
> the Hadoop 2 ByteBuffer based read method.
> 2017-06-06 07:46:43,510 [scan-8] ERROR
> o.a.d.e.u.f.BufferedDirectBufInputStream - Error reading from stream
> 1_1_0.parquet. Error was : Error reading out of an FSDataInputStream using
> the Hadoop 2 ByteBuffer based read method.
> 2017-06-06 07:46:43,514 [scan-8] INFO o.a.d.e.s.p.c.AsyncPageReader - User
> Error Occurred: Exception occurred while reading from disk.
> (java.io.IOException: Error reading out of an FSDataInputStream using the
> Hadoop 2 ByteBuffer based read method.)
> org.apache.drill.common.exceptions.UserException: DATA_READ ERROR: Exception
> occurred while reading from disk.
> File: /drill/testdata/tpcds_sf1/parquet/store_sales/1_1_0.parquet
> Column: ss_ext_list_price
> Row Group Start: 75660513
> [Error Id: 3a758095-fcc4-4364-a50b-33a027c1beb6 ]
> at
> org.apache.drill.common.exceptions.UserException$Builder.build(UserException.java:544)
> ~[drill-common-1.11.0-SNAPSHOT.jar:1.11.0-SNAPSHOT]
> at
> org.apache.drill.exec.store.parquet.columnreaders.AsyncPageReader.handleAndThrowException(AsyncPageReader.java:199)
> [drill-java-exec-1.11.0-SNAPSHOT.jar:1.11.0-SNAPSHOT]
> at
> org.apache.drill.exec.store.parquet.columnreaders.AsyncPageReader.access$600(AsyncPageReader.java:81)
> [drill-java-exec-1.11.0-SNAPSHOT.jar:1.11.0-SNAPSHOT]
> at
> org.apache.drill.exec.store.parquet.columnreaders.AsyncPageReader$AsyncPageReaderTask.call(AsyncPageReader.java:483)
> [drill-java-exec-1.11.0-SNAPSHOT.jar:1.11.0-SNAPSHOT]
> at
> org.apache.drill.exec.store.parquet.columnreaders.AsyncPageReader$AsyncPageReaderTask.call(AsyncPageReader.java:392)
> [drill-java-exec-1.11.0-SNAPSHOT.jar:1.11.0-SNAPSHOT]
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> [na:1.8.0_65]
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> [na:1.8.0_65]
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> [na:1.8.0_65]
> at java.lang.Thread.run(Thread.java:745) [na:1.8.0_65]
> Caused by: java.io.IOException: java.io.IOException: Error reading out of an
> FSDataInputStream using the Hadoop 2 ByteBuffer based read method.
> at
> org.apache.drill.exec.util.filereader.BufferedDirectBufInputStream.getNextBlock(BufferedDirectBufInputStream.java:185)
> ~[drill-java-exec-1.11.0-SNAPSHOT.jar:1.11.0-SNAPSHOT]
> at
> org.apache.drill.exec.util.filereader.BufferedDirectBufInputStream.readInternal(BufferedDirectBufInputStream.java:212)
> ~[drill-java-exec-1.11.0-SNAPSHOT.jar:1.11.0-SNAPSHOT]
> at
> org.apache.drill.exec.util.filereader.BufferedDirectBufInputStream.read(BufferedDirectBufInputStream.java:277)
> ~[drill-java-exec-1.11.0-SNAPSHOT.jar:1.11.0-SNAPSHOT]
> at
> org.apache.drill.exec.util.filereader.DirectBufInputStream.getNext(DirectBufInputStream.java:111)
> ~[drill-java-exec-1.11.0-SNAPSHOT.jar:1.11.0-SNAPSHOT]
> at
> org.apache.drill.exec.store.parquet.columnreaders.AsyncPageReader$AsyncPageReaderTask.call(AsyncPageReader.java:437)
> [drill-java-exec-1.11.0-SNAPSHOT.jar:1.11.0-SNAPSHOT]
> ... 5 common frames omitted
> Caused by: java.io.IOException: Error reading out of an FSDataInputStream
> using the Hadoop 2 ByteBuffer based read method.
> at
> org.apache.parquet.hadoop.util.CompatibilityUtil.getBuf(CompatibilityUtil.java:99)
> ~[parquet-hadoop-1.8.1-drill-r0.jar:1.8.1-drill-r0]
> at
> org.apache.drill.exec.util.filereader.BufferedDirectBufInputStream.getNextBlock(BufferedDirectBufInputStream.java:182)
> ~[drill-java-exec-1.11.0-SNAPSHOT.jar:1.11.0-SNAPSHOT]
> ... 9 common frames omitted
> Caused by: java.lang.NullPointerException: null
> at
> com.mapr.fs.MapRFsInStream.readIntoDirectByteBuffer(MapRFsInStream.java:219)
> ~[maprfs-5.2.1-mapr.jar:5.2.1-mapr]
> at com.mapr.fs.MapRFsInStream.read(MapRFsInStream.java:333)
> ~[maprfs-5.2.1-mapr.jar:5.2.1-mapr]
> at
> org.apache.hadoop.fs.FSDataInputStream.read(FSDataInputStream.java:156)
> ~[hadoop-common-2.7.0-mapr-1607.jar:na]
> at sun.reflect.GeneratedMethodAccessor44.invoke(Unknown Source)
> ~[na:na]
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> ~[na:1.8.0_65]
> at java.lang.reflect.Method.invoke(Method.java:497) ~[na:1.8.0_65]
> at
> org.apache.parquet.hadoop.util.CompatibilityUtil.getBuf(CompatibilityUtil.java:83)
> ~[parquet-hadoop-1.8.1-drill-r0.jar:1.8.1-drill-r0]
> ... 10 common frames omitted
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
