[
https://issues.apache.org/jira/browse/ARROW-15074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17458525#comment-17458525
]
Jorge Leitão commented on ARROW-15074:
--------------------------------------
I do find a bit odd to restrict which LZ4 we support, but writing "LZ4 MUST be
written in a single frame" in the spec is another option, yes.
> [C++] Support multiple frames in LZ4?
> -------------------------------------
>
> Key: ARROW-15074
> URL: https://issues.apache.org/jira/browse/ARROW-15074
> Project: Apache Arrow
> Issue Type: Improvement
> Components: C++
> Reporter: Jorge Leitão
> Priority: Major
> Attachments: b.arrow
>
>
> When reading an arrow file with buffers LZ4-compressed with multiple frames,
> we get
> {code:java}
> OSError: Lz4 compressed input contains more than one frame
> {code}
> Attached is an example of such a file, which can be opened with
> {code:java}
> import pyarrow.ipc
> with pa.ipc.open_file("b.arrow") as reader:
> print(reader.get_batch(0))
> {code}
> that fails with the error above.
> The LZ4 frame supports multiple frames and we do not refer that only one
> frame should be on a buffer as part of the spec.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
