HuangZhenQiu opened a new pull request, #19917:
URL: https://github.com/apache/hudi/pull/19917

   ### Describe the issue this Pull Request addresses
   
   Support snappy hudi compressor for better compression efficiency for HFiles
   
   ### Summary and Changelog
   
   1. Add HoodieAirliftCompressor for generic functions needed for future 
compressor algorithm integration
   2.  Add HoodieAirliftSnappyCompressor and plugin into HoodieCompressorFactory
   3. Add unit tests for new classes and changes and compatibility test cases.
   
   ### Impact
   
   none
   
   ### Risk Level
   Low:  the native Hudi reader needs no native lib (pure-Java airlift), but 
the HBase reader path does. A table written with SNAPPY reads fine via Hudi's 
native reader everywhere, yet can fail on engines still routing through HBase 
HFile readers without libhadoop+snappy. GZIP has no such asymmetry since it is 
JDK-native. 
   
   ### Documentation Update
   
   none
   
   ### Contributor's checklist
   
   - [ ] Read through [contributor's 
guide](https://hudi.apache.org/contribute/how-to-contribute)
   - [ ] Enough context is provided in the sections above
   - [ ] Adequate tests were added if applicable
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to