Smotrov opened a new issue, #10435:
URL: https://github.com/apache/datafusion/issues/10435
### Describe the bug
When reading a partition of big NDJSON files compressed with ZSTD there is
an error appears.
`Error: Custom { kind: Other, error:
External(ArrowError(ExternalError(IoError(Custom { kind: Other, error: "Unknown
frame descriptor" })), None)) }`
Meanwhile all files could be easily decompressed with ZSTD terminal utility.
### To Reproduce
Try to access big ZSTD files.
### Expected behavior
Would be good if it could read it.
### Additional context
Files are located on AWS S3
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
