nevi-me commented on pull request #9137:
URL: https://github.com/apache/arrow/pull/9137#issuecomment-756815481
For anyone who understands how LZ4 works, I need some help.
I'm able to read LZ4 compressed data written in Python from Rust, but I get
an error when trying to read a file written by the Rust writer from `pyarrow`.
The error that I'm getting is:
```
OSError: Lz4 compressed input contains more than one frame
```
To reproduce the error, please:
1. Run the `arrow` unit tests, so that a compressed file is created.
2. Run the below to read the file in `pyarrow`
```python
import pyarrow as pa
file =
pa.ipc.open_file("$ARROW_ROOT/rust/arrow/target/debug/testdata/primitive_lz4.arrow_file")
batches = file.read_all()
```
Thanks
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
