[
https://issues.apache.org/jira/browse/CASSANDRA-3997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13222039#comment-13222039
]
Vijay edited comment on CASSANDRA-3997 at 3/4/12 10:30 PM:
-----------------------------------------------------------
Attached is the test classes used for the test.
Results on CentOS:
{noformat}
[vijay_tcasstest@vijay_tcass-i-a91ee8cd ~]$
/etc/alternatives/jre_1.7.0/bin/java -Djava.library.path=/usr/local/lib/ -cp
jna.jar:/apps/nfcassandra_server/lib/*:. com.sun.jna.MallocAllocator 50000
2000000
total used free shared buffers cached
Mem: 71688220 26049380 45638840 0 169116 996172
-/+ buffers/cache: 24884092 46804128
Swap: 0 0 0
**** Starting Test! ****
Total bytes read: 101422934016
Time taken: 25407
total used free shared buffers cached
Mem: 71688220 31981924 39706296 0 169116 996312
-/+ buffers/cache: 30816496 40871724
Swap: 0 0 0
**** ending Test!****
[vijay_tcasstest@vijay_tcass-i-a91ee8cd ~]$ export
LD_LIBRARY_PATH=/usr/local/lib/
[vijay_tcasstest@vijay_tcass-i-a91ee8cd ~]$
/etc/alternatives/jre_1.7.0/bin/java -Djava.library.path=/usr/local/lib/ -cp
jna.jar:/apps/nfcassandra_server/lib/*:. com.sun.jna.TCMallocAllocator 50000
2000000
total used free shared buffers cached
Mem: 71688220 26054620 45633600 0 169128 996228
-/+ buffers/cache: 24889264 46798956
Swap: 0 0 0
**** Starting Test! ****
Total bytes read: 101304894464
Time taken: 46387
total used free shared buffers cached
Mem: 71688220 28535136 43153084 0 169128 996436
-/+ buffers/cache: 27369572 44318648
Swap: 0 0 0
**** ending Test!****
[vijay_tcasstest@vijay_tcass-i-a91ee8cd ~]$ export
LD_LIBRARY_PATH=~/jemalloc-2.2.5/lib/
[vijay_tcasstest@vijay_tcass-i-a91ee8cd ~]$
/etc/alternatives/jre_1.7.0/bin/java -Djava.library.path=~/jemalloc-2.2.5/lib/
-cp jna.jar:/apps/nfcassandra_server/lib/*:. com.sun.jna.JEMallocAllocator
50000 2000000
total used free shared buffers cached
Mem: 71688220 26060604 45627616 0 169128 996300
-/+ buffers/cache: 24895176 46793044
Swap: 0 0 0
**** Starting Test! ****
Total bytes read: 101321734144
Time taken: 29937
total used free shared buffers cached
Mem: 71688220 28472436 43215784 0 169128 996440
-/+ buffers/cache: 27306868 44381352
Swap: 0 0 0
**** ending Test!****
[vijay_tcasstest@vijay_tcass-i-a91ee8cd ~]$
{noformat}
The test shows around 4 GB savings. The test was on 101321734144 bytes (101 GB
each). The test use CLHM to hold on to the objects and release them when the
capacity is reached (5K)
was (Author: [email protected]):
Attached is the test classes used for the test.
Results on CentOS:
{noformat}
[vijay_tcasstest@vijay_tcass-i-a91ee8cd ~]$
/etc/alternatives/jre_1.7.0/bin/java -Djava.library.path=/usr/local/lib/ -cp
jna.jar:/apps/nfcassandra_server/lib/*:. com.sun.jna.MallocAllocator 50000
2000000
total used free shared buffers cached
Mem: 71688220 26049380 45638840 0 169116 996172
-/+ buffers/cache: 24884092 46804128
Swap: 0 0 0
**** Starting Test! ****
Total bytes read: 101422934016
Time taken: 25407
total used free shared buffers cached
Mem: 71688220 31981924 39706296 0 169116 996312
-/+ buffers/cache: 30816496 40871724
Swap: 0 0 0
**** ending Test!****
[vijay_tcasstest@vijay_tcass-i-a91ee8cd ~]$ export
LD_LIBRARY_PATH=/usr/local/lib/
[vijay_tcasstest@vijay_tcass-i-a91ee8cd ~]$
/etc/alternatives/jre_1.7.0/bin/java -Djava.library.path=/usr/local/lib/ -cp
jna.jar:/apps/nfcassandra_server/lib/*:. com.sun.jna.TCMallocAllocator 50000
2000000
total used free shared buffers cached
Mem: 71688220 26054620 45633600 0 169128 996228
-/+ buffers/cache: 24889264 46798956
Swap: 0 0 0
**** Starting Test! ****
Total bytes read: 101304894464
Time taken: 46387
total used free shared buffers cached
Mem: 71688220 28535136 43153084 0 169128 996436
-/+ buffers/cache: 27369572 44318648
Swap: 0 0 0
**** ending Test!****
[vijay_tcasstest@vijay_tcass-i-a91ee8cd ~]$ export
LD_LIBRARY_PATH=~/jemalloc-2.2.5/lib/
[vijay_tcasstest@vijay_tcass-i-a91ee8cd ~]$
/etc/alternatives/jre_1.7.0/bin/java -Djava.library.path=~/jemalloc-2.2.5/lib/
-cp jna.jar:/apps/nfcassandra_server/lib/*:. com.sun.jna.JEMallocAllocator
50000 2000000
total used free shared buffers cached
Mem: 71688220 26060604 45627616 0 169128 996300
-/+ buffers/cache: 24895176 46793044
Swap: 0 0 0
**** Starting Test! ****
Total bytes read: 101321734144
Time taken: 29937
total used free shared buffers cached
Mem: 71688220 28472436 43215784 0 169128 996440
-/+ buffers/cache: 27306868 44381352
Swap: 0 0 0
**** ending Test!****
[vijay_tcasstest@vijay_tcass-i-a91ee8cd ~]$
{noformat}
> Make SerializingCache Memory Pluggable
> --------------------------------------
>
> Key: CASSANDRA-3997
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3997
> Project: Cassandra
> Issue Type: Improvement
> Components: Core
> Affects Versions: 1.2
> Reporter: Vijay
> Priority: Minor
> Labels: cache
> Fix For: 1.2
>
> Attachments: jna.zip
>
>
> Serializing cache uses native malloc and free by making FM pluggable, users
> will have a choice of gcc malloc, TCMalloc or JEMalloc as needed.
> Initial tests shows less fragmentation in JEMalloc but the only issue with it
> is that (both TCMalloc and JEMalloc) are kind of single threaded (at-least
> they crash in my test otherwise).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
