apurtell commented on pull request #3244: URL: https://github.com/apache/hbase/pull/3244#issuecomment-840250363
I took another bite at the @bharathv suggestion to use a streams API instead of driving Deflater and Inflater at the low level. A really excellent additional benefit, if this can be made to work, is we can switch to the Hadoop compression library, which would allow the user to choose among any of our supported algorithms in `Compression` to pick their desired point along the speed versus space continuum. (_The Hadoop compression library kind-of sort-of exports a Deflater/Inflater inspired low level API but it has runtime limitations in this mode requiring native support, which we lack in dev environments and for unit tests. If we use the Hadoop compression library's streaming API, there is no issue._) I have a change that passes unit tests but is pending a full integration test as well as microbenchmarking. Hopefully I will have all of that done some time tomorrow. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
