Jascha Swisher created SPARK-4222:
-------------------------------------
Summary: FixedLengthBinaryRecordReader should readFully
Key: SPARK-4222
URL: https://issues.apache.org/jira/browse/SPARK-4222
Project: Spark
Issue Type: Bug
Reporter: Jascha Swisher
Priority: Minor
The new FixedLengthBinaryRecordReader currently uses a read() call to read from
the FSDataInputStream, without checking the number of bytes actually returned.
The currentPosition variable is updated assuming that the full number of
requested bytes are returned, which could lead to data corruption or other
problems if fewer bytes come back than requested.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
