Re: Proposal to integrate QATCodec into Carbondata

2018-11-05 Thread brijoobopanna
Thanks por proposing this QATCodec If any performance benchmarks are already available wrt Snappy or ZSTD -- Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/

RE: Proposal to integrate QATCodec into Carbondata

2018-11-01 Thread Xu, Cheng A
Li [mailto:jacky.li...@qq.com] Sent: Thursday, November 1, 2018 8:13 PM To: dev@carbondata.apache.org Subject: Re: Proposal to integrate QATCodec into Carbondata Hi, Good to know about QATCodec. I have a quick question. Is the QATCodec an independent compression/decompression library

Re: Proposal to integrate QATCodec into Carbondata

2018-11-01 Thread Jacky Li
Hi, Good to know about QATCodec. I have a quick question. Is the QATCodec an independent compression/decompression library or it depends on any hardware to achieve the performance improvement you have mentioned? Is there any link for QATCodec project or source code? Regards, Jacky > 在

RE: Proposal to integrate QATCodec into Carbondata

2018-11-01 Thread Xu, Cheng A
Thanks Raghu. Will prepare for the pull request. Thanks Ferdinand Xu -Original Message- From: Raghunandan S [mailto:carbondatacontributi...@gmail.com] Sent: Thursday, November 1, 2018 7:09 PM To: dev@carbondata.apache.org Subject: Re: Proposal to integrate QATCodec into Carbondata +1

Re: Proposal to integrate QATCodec into Carbondata

2018-11-01 Thread Raghunandan S
tober 12, 2018 11:07 AM > To: dev@carbondata.apache.org > Subject: Re: Proposal to integrate QATCodec into Carbondata > > emm, if it only needs to extend another compressor for software > implementation, I think it will be quite easy to integrate. > > Actually a PR has already b

RE: Proposal to integrate QATCodec into Carbondata

2018-10-12 Thread Xu, Cheng A
Xu -Original Message- From: xuchuanyin [mailto:xuchuan...@hust.edu.cn] Sent: Friday, October 12, 2018 11:07 AM To: dev@carbondata.apache.org Subject: Re: Proposal to integrate QATCodec into Carbondata emm, if it only needs to extend another compressor for software implementation, I think

Re: Proposal to integrate QATCodec into Carbondata

2018-10-11 Thread xuchuanyin
emm, if it only needs to extend another compressor for software implementation, I think it will be quite easy to integrate. Actually a PR has already been raised weeks ago to support customize compressor in carbondata, you can refer to this link: https://github.com/apache/carbondata/pull/2715.

Recall: Proposal to integrate QATCodec into Carbondata

2018-10-11 Thread Xu, Cheng A
Xu, Cheng A would like to recall the message, "Proposal to integrate QATCodec into Carbondata".

Proposal to integrate QATCodec into Carbondata

2018-10-11 Thread Xu, Cheng A
Hi all I want to make a proposal to support QATCodec [1] into CarbonData. QAT Codec project provides compression and decompression library for Apache Hadoop/Spark to make use of the Intel(r) QuickAssist Technology (Abbrev. QAT) [2] for compression/decompression. This project has been open

Proposal to integrate QATCodec into Carbondata

2018-10-11 Thread Xu, Cheng A
Hi all I want to make a proposal to support QATCodec [1] into CarbonData. QAT Codec project provides compression and decompression library for Apache Hadoop/Spark to make use of the Intel(r) QuickAssist Technology (Abbrev. QAT) [2] for compression/decompression. This project has been open