PortellJ opened a new issue, #3067:
URL: https://github.com/apache/parquet-java/issues/3067

   ### Describe the enhancement requested
   
   FAPEC is a high-performance data compression algorithm with many options, 
based on efficient entropy coding and including several pre-processing 
algorithms for time series, images, text, floats, etc.
   It's already available for some formats like HDF5 and FITS. We're now 
investigating the possibility to include FAPEC as a new codec option for 
Parquet, which (we think) should provide better compression ratios (than the 
currently available codecs) mainly for integers and floats/doubles. We're now 
working on a proof-of-concept to evaluate how much would it actually improve.
   If the outcome reveals a "significant enough" improvement, will it be 
possible to include this new option?
   Note that FAPEC is a commercial product, so a valid license would be needed 
to generate Parquet files with this, and the compression library would have to 
be used in binary form for the adequate platform. (reading Parquet files 
compressed with FAPEC would always be free). Perhaps this would be a blocking 
issue...?
   
   ### Component(s)
   
   _No response_


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to