Hello All,
I'm having some trouble with the memory allocation of my glusterfsd processes.
The server keeps running out of memory, no matter how much I add (it's a vm)
and I just don't understand how gluster allocates memory to its processes.
The situation is as follows: rhel 6.4, 16 GB ram, gluster 3.4.2-1
I have one big lun of 20 TB that contains all my bricks. I started with 4 GB
memory, but saw it was getting full, so I stepped it up to 8GB and later 16.
The weird thing is VMware claims only 50% of the memory is actively used so I
guess this is all due to caching?
I tried the flushcaches thing, but I don't see to free up much.
If I check my memory consumption I see this:
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
26800 root 20 0 2593m 1.9g 1088 S 17.3 12.5 5261:43 glusterfsd
26914 root 20 0 2541m 1.9g 1072 S 15.9 12.2 1081:04 glusterfsd
33299 root 20 0 2938m 1.9g 1056 S 15.9 12.1 1787:40 glusterfsd
26872 root 20 0 2093m 1.3g 1080 S 15.6 8.6 3391:02 glusterfsd
26995 root 20 0 1828m 1.3g 1072 S 8.0 8.1 782:29.85 glusterfsd
26934 root 20 0 1891m 1.0g 376 S 0.0 6.6 795:44.19 glusterfsd
37651 root 20 0 1309m 1.0g 332 S 0.0 6.6 0:03.52 glusterfs
27015 root 20 0 1374m 780m 388 S 0.0 4.9 580:29.19 glusterfsd
29712 root 20 0 989m 504m 1076 S 20.2 3.2 227:47.87 glusterfsd
8635 root 20 0 2415m 186m 392 S 0.0 1.2 594:02.47 glusterfsd
31859 root 20 0 643m 174m 392 S 0.0 1.1 99:06.60 glusterfsd
27308 root 20 0 440m 169m 1296 S 10.0 1.1 646:30.02 glusterfs
27458 root 20 0 415m 149m 1280 S 12.3 0.9 781:36.04 glusterfs
27358 root 20 0 420m 143m 1272 S 10.3 0.9 553:04.97 glusterfs
7453 root 20 0 609m 133m 872 S 0.0 0.8 27:49.83 glusterfsd
27508 root 20 0 410m 117m 1272 S 9.6 0.7 560:42.51 glusterfs
8608 root 20 0 2418m 111m 372 S 0.0 0.7 785:53.31 glusterfsd
27408 root 20 0 373m 96m 1272 S 9.6 0.6 431:32.28 glusterfs
27558 root 20 0 368m 87m 344 S 0.0 0.6 318:37.92 glusterfs
40715 root 20 0 203m 86m 1036 S 0.3 0.5 3:41.78 puppetd
30940 root 20 0 674m 78m 960 S 0.0 0.5 40:18.17 glusterfsd
19363 root 20 0 1437m 74m 728 S 0.0 0.5 60:12.02 glusterfsd
8773 root 20 0 685m 71m 956 S 0.0 0.4 19:40.05 glusterfsd
789 root 20 0 625m 67m 900 S 0.0 0.4 22:45.64 glusterfsd
1599 root 20 0 1291m 41m 956 S 0.0 0.3 13:03.23 glusterfsd
27808 root 20 0 482m 36m 344 S 0.0 0.2 42:40.67 glusterfs
47625 root 20 0 677m 31m 900 S 0.0 0.2 4:09.29 glusterfsd
30539 root 20 0 1381m 27m 852 S 0.0 0.2 20:31.90 glusterfsd
Etc...
Right now I'm at:
total used free shared buffers cached
Mem: 16326684 16176692 149992 0 14284 59520
-/+ buffers/cache: 16102888 223796
Swap: 4194296 4194252 44
... the lack of free swap worries me a lot
Is it normal for some volumes to consume that much memory? How does gluster
decide how much memory it should allocate? It there any way to influence this?
>From time to time bricks switch themselves offline. Is this due to the lack of
>free memory?
Any help to shed some light on this situation would be most welcome as I have
no idea where to start.....
_______________________________________________
Gluster-users mailing list
[email protected]
http://supercolony.gluster.org/mailman/listinfo/gluster-users
