Jascha Swisher created SPARK-4222: ------------------------------------- Summary: FixedLengthBinaryRecordReader should readFully Key: SPARK-4222 URL: https://issues.apache.org/jira/browse/SPARK-4222 Project: Spark Issue Type: Bug Reporter: Jascha Swisher Priority: Minor
The new FixedLengthBinaryRecordReader currently uses a read() call to read from the FSDataInputStream, without checking the number of bytes actually returned. The currentPosition variable is updated assuming that the full number of requested bytes are returned, which could lead to data corruption or other problems if fewer bytes come back than requested. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org