Re: [I] Support LZO Compression Codec in Parquet Files (NYI: "The codec type LZO is not supported yet") [arrow-rs]

2025-01-13 Thread via GitHub


kosiew commented on issue #6970:
URL: https://github.com/apache/arrow-rs/issues/6970#issuecomment-2588820203

   > LZ4 had largely replaced LZO, its compression is slightly worse but it is 
much faster to read, and much more widely adopted.
   
   Closing.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [I] Support LZO Compression Codec in Parquet Files (NYI: "The codec type LZO is not supported yet") [arrow-rs]

2025-01-13 Thread via GitHub


kosiew closed issue #6970: Support LZO Compression Codec in Parquet Files (NYI: 
"The codec type LZO is not supported yet")
URL: https://github.com/apache/arrow-rs/issues/6970


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [I] Support LZO Compression Codec in Parquet Files (NYI: "The codec type LZO is not supported yet") [arrow-rs]

2025-01-13 Thread via GitHub


tustvold commented on issue #6970:
URL: https://github.com/apache/arrow-rs/issues/6970#issuecomment-2586884593

   I suspect the way to support this would be to find some way to allow people 
to plugin in their own codecs, that way they can depend on whatever LZO 
implementation they choose. I don't think there are any with a sufficiently 
mature maintenance that would allow us to take a dependency on them


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [I] Support LZO Compression Codec in Parquet Files (NYI: "The codec type LZO is not supported yet") [arrow-rs]

2025-01-13 Thread via GitHub


kosiew commented on issue #6970:
URL: https://github.com/apache/arrow-rs/issues/6970#issuecomment-2586756153

   @tustvold , thanks for looking.
   I found https://github.com/arma-tools/lzokay-native-rs, but I don't know how 
suitable it is for this issue.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [I] Support LZO Compression Codec in Parquet Files (NYI: "The codec type LZO is not supported yet") [arrow-rs]

2025-01-13 Thread via GitHub


tustvold commented on issue #6970:
URL: https://github.com/apache/arrow-rs/issues/6970#issuecomment-2586516263

   I had a brief look and couldn't find a Rust crate providing this compression 
algorithm...


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org