Raghu Angadi created BEAM-5412:
----------------------------------
Summary: TFRecordIO fails with records larger than 8K
Key: BEAM-5412
URL: https://issues.apache.org/jira/browse/BEAM-5412
Project: Beam
Issue Type: Bug
Components: io-java-text
Affects Versions: 2.4.0
Reporter: Raghu Angadi
Assignee: Eugene Kirpichov
This was reported on
[Stackoverflow|https://stackoverflow.com/questions/52284639/beam-java-sdk-with-tfrecord-and-compression-gzip].
TFRecordIO reader assumes a single call to {{channel.read()}} returns as much
as can fit in the input buffer. {{read()}} can return fewer bytes than
requested. Assert failure :
https://github.com/apache/beam/blob/release-2.4.0/sdks/java/core/src/main/java/org/apache/beam/sdk/io/TFRecordIO.java#L642
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
