RE: CASSANDRA-19268: Improve Cassandra compression performance using hardware accelerators

2024-01-25 Thread Kokoori, Shylaja
we have a mix of machines where some support Intel's IAA and some don't? 3. Does QPL have checksumming built in? thanks, Dinesh [1] https://github.com/intel/qpl-java [2] https://www.apache.org/legal/resolved.html#category-a On Mon, Jan 22, 2024 at 6:37 PM Kokoori, Shylaja mailto:shylaja.koko

RE: CASSANDRA-19268: Improve Cassandra compression performance using hardware accelerators

2024-01-22 Thread Kokoori, Shylaja
Dinesh & Abe, Thank you very much for your feedback. The algorithm used by this HW compressor is compatible with Deflate but there is a constraint of 4K window size. Therefore the concern is that existing data may not decompress correctly as is. That is why we chose the path of adding a new

CASSANDRA-19268: Improve Cassandra compression performance using hardware accelerators

2024-01-19 Thread Kokoori, Shylaja
Hi, Latest processors have integrated hardware accelerators which can speed up operations like compress/decompress, crypto and analytics. Here are some links to details 1) https://cdrdv2.intel.com/v1/dl/getContent/721858 2)

RE: Resurrection of CASSANDRA-9633 - SSTable encryption

2021-11-19 Thread Kokoori, Shylaja
c < > stefan.mikloso...@instaclustr.com> wrote: > >> On Fri, 19 Nov 2021 at 02:51, Joseph Lynch wrote: >> > >> > On Thu, Nov 18, 2021 at 7:23 PM Kokoori, Shylaja < >> shylaja.koko...@intel.com> >> > wrote: >> > >> > > To

RE: Resurrection of CASSANDRA-9633 - SSTable encryption

2021-11-18 Thread Kokoori, Shylaja
To address Joey's concern, the OpenJDK JVM and its derivatives optimize Java crypto based on the underlying HW capabilities. For example, if the underlying HW supports AES-NI, JVM intrinsics will use those for crypto operations. Likewise, the new vector AES available on the latest Intel

RE: [DISCUSSION] Next release roadmap

2021-04-14 Thread Kokoori, Shylaja
Thanks Stefan for bringing up the JIRA https://issues.apache.org/jira/browse/CASSANDRA-9633 - Add ability to encrypt sstables I have been working on it and would appreciate some feedback. I would also like to add to the list this one https://issues.apache.org/jira/browse/CASSANDRA-14466 -

RE: [DISCUSSION] Next release roadmap

2021-04-14 Thread Kokoori, Shylaja
RE: Pluggability improvements, this is a great idea. This will be good for persistent memory support https://issues.apache.org/jira/browse/CASSANDRA-13981 - Enable Cassandra for Persistent Memory, can be easily refactored to be a pluggable memtable. > On Apr 8, 2021, at 8:22 AM, Benjamin