[
https://issues.apache.org/jira/browse/ARROW-9036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gaurangi Saxena closed ARROW-9036.
----------------------------------
Resolution: Fixed
Issue was with ArrowBinaryIterator. We were closing the channel and then
referencing it again.
> [Java] Null pointer exception when caching data frames
> ------------------------------------------------------
>
> Key: ARROW-9036
> URL: https://issues.apache.org/jira/browse/ARROW-9036
> Project: Apache Arrow
> Issue Type: Bug
> Components: Java
> Affects Versions: 0.16.0
> Reporter: Gaurangi Saxena
> Priority: Major
>
> I get a NPE when I try to cache a DataFrame in spark with Arrow as read
> format.
>
> Stack Trace -
> java.lang.NullPointerExceptionjava.lang.NullPointerException at
> org.apache.arrow.vector.ipc.ReadChannel.readFully(ReadChannel.java:61) at
> org.apache.arrow.vector.ipc.message.MessageSerializer.readMessage(MessageSerializer.java:649)
> at
> org.apache.arrow.vector.ipc.message.MessageChannelReader.readNext(MessageChannelReader.java:58)
> at
> org.apache.arrow.vector.ipc.ArrowStreamReader.loadNextBatch(ArrowStreamReader.java:106)
> at
> com.google.cloud.spark.bigquery.ArrowReaderIterator.hasNext(ArrowBinaryIterator.java:107)
> at
> com.google.cloud.spark.bigquery.ArrowBinaryIterator.hasNext(ArrowBinaryIterator.java:63)
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
