[
https://issues.apache.org/jira/browse/TEZ-1050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13982733#comment-13982733
]
Cheolsoo Park commented on TEZ-1050:
------------------------------------
Sorry for the late reply.
I believe [~daijy] is looking into this. I don't know whether the fix should be
go into Pig or Tez. I'll let Daniel chime in.
> EOFException is thrown by ShuffledUnorderedKVReader
> ---------------------------------------------------
>
> Key: TEZ-1050
> URL: https://issues.apache.org/jira/browse/TEZ-1050
> Project: Apache Tez
> Issue Type: Bug
> Affects Versions: 0.4.0
> Reporter: Cheolsoo Park
>
> Not sure whether this is expected or not, but I am seeing an EOFException
> while doing ShuffledUnorderedKVReader.next() in Pig. See
> [here|https://github.com/apache/pig/blob/tez/src/org/apache/pig/backend/hadoop/executionengine/tez/POValueInputTez.java#L100]
> for the source code.
> {code}
> : Caused by: java.io.EOFException: Completed reading 31
> : at
> org.apache.tez.runtime.library.common.sort.impl.IFile$Reader.positionToNextRecord(IFile.java:480)
> : at
> org.apache.tez.runtime.library.common.shuffle.impl.InMemoryReader.readRawKey(InMemoryReader.java:94)
> : at
> org.apache.tez.runtime.library.common.sort.impl.IFile$Reader.nextRawKey(IFile.java:510)
>
> : at
> org.apache.tez.runtime.library.common.readers.ShuffledUnorderedKVReader.readNextFromCurrentReader(ShuffledUnorderedKVReader.java:147)
> : at
> org.apache.tez.runtime.library.common.readers.ShuffledUnorderedKVReader.next(ShuffledUnorderedKVReader.java:108)
> : at
> org.apache.pig.backend.hadoop.executionengine.tez.POValueInputTez.getNextTuple(POValueInputTez.java:100)
> : ... 12 more
> {code}
> Shouldn't next() return false when it's EOF instead of throwing a runtime
> exception? Is this exception supposed to be handled on Pig side?
> This makes a Pig e2e test (CastScalar_11) fail.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
