Ismaël Mejía created AVRO-4330:
----------------------------------
Summary: [python] Bound bytes/string allocation on non-seekable
streams
Key: AVRO-4330
URL: https://issues.apache.org/jira/browse/AVRO-4330
Project: Apache Avro
Issue Type: Sub-task
Components: python
Reporter: Ismaël Mejía
Assignee: Ismaël Mejía
Python SDK implementation of AVRO-4303.
When the number of bytes remaining is unknown (a non-seekable stream), read a
bytes/string value into a buffer that grows in bounded chunks rather than
issuing a single reader.read(n) that allocates n bytes up front, so a truncated
or hostile stream fails with a bounded InvalidAvroBinaryEncoding. The existing
single-read fast path is kept when the remaining byte count is known.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)