Thanks Chuanyin. This PR looks cool. Allowing customized codec is a good option. Comparing with the existing built-in Snappy codec in CarbonData, I think QATCodec with better performance and better compression ratio is also a good candidate for built-in support. Any thoughts?
Thanks Ferdinand Xu -----Original Message----- From: xuchuanyin [mailto:[email protected]] Sent: Friday, October 12, 2018 11:07 AM To: [email protected] Subject: Re: Proposal to integrate QATCodec into Carbondata emm, if it only needs to extend another compressor for software implementation, I think it will be quite easy to integrate. Actually a PR has already been raised weeks ago to support customize compressor in carbondata, you can refer to this link: https://github.com/apache/carbondata/pull/2715. You can refer to the `CustomizeCompressor` in `TestLoadDataWithCompression.scala` for more information. -- Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
