leekeiabstraction commented on issue #109: URL: https://github.com/apache/fluss-rust/issues/109#issuecomment-3681507076
On Java side, we use lower level arrow classes e.g. [`VectorUnloader`](https://github.com/apache/fluss/blob/main/fluss-common/src/main/java/org/apache/fluss/row/arrow/ArrowWriter.java#L252-L253) instead of using ArrowStreamWriter. This was documented in https://github.com/apache/fluss/issues/187 > Currently, Fluss still need to support Java8, and that's why Fluss sticks on arrow-15.0 (the latest is v18.0). Arrow 15.0 Java client already introduced the CompressionCodec interfaces for ArrowStreamWriter, but doesn't natively support LZ4 and ZSTD compressions (implemented in later versions). But it should work if we learn the implementation by extending our own CompressionCodec.Factory: https://github.com/apache/arrow-java/commits/main/compression/src/main/java/org/apache/arrow/compression -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
