Jorge Leitão created ARROW-15074:
------------------------------------
Summary: [C++] Support multiple frames in LZ4?
Key: ARROW-15074
URL: https://issues.apache.org/jira/browse/ARROW-15074
Project: Apache Arrow
Issue Type: Improvement
Reporter: Jorge Leitão
Attachments: b.arrow
When reading an arrow file with buffers LZ4-compressed with multiple frames, we
get
{code:java}
OSError: Lz4 compressed input contains more than one frame
{code}
Attached is an example of such a file, which can be opened with
{code:java}
import pyarrow.ipc
with pa.ipc.open_file("b.arrow") as reader:
print(reader.get_batch(0))
{code}
that fails with the error above.
The LZ4 frame supports multiple frames and we do not refer that only one frame
should be on a buffer as part of the spec.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)