13.09.2012 15:18, Vladislav Bogdanov wrote: ...
> and now it runs on my testing cluster. > > Ipc-related memory problems seem to be completely fixed now, processes > own memory (RES-SHR in terms of htop) does not grow any longer (after 40 > minutes). Although I see that both RES and SHR counters sometimes > increase synchronously. lrmd does not grow at all. Will look again after > few hours. So, lrmd is ok. I see only 4kb growth in RES-SHR on one node (current DC). Other instances are of the constant size for almost a day. I see RES-SHR growth in pacemakerd (>100kb per day). So I expect some leakage here. Should I run it under valgrind? And I see that both RES and SHR synchronously grow in crmd (600-700kb per day on member nodes, 6Mb on DC), while RES-SHR is reduced by 24kb on DC. And I see cib growth in both RES and SHR in range 12-340 kb, and 4kb growth in RES-SHR on nodes except DC. I can't say for sure what causes growth of shared pages. May be it is /dev/shm. Lot of files are there. I'll look if it grows. # ls -l /dev/shm total 75492 -rw------- 1 hacluster root 24 Sep 13 10:49 qb-attrd-control-1732-1734-6 -rw------- 1 root root 1048576 Sep 13 10:49 qb-cfg-event-1634-1727-29-data -rw------- 1 root root 8248 Sep 13 10:49 qb-cfg-event-1634-1727-29-header -rw------- 1 hacluster root 1048576 Sep 13 10:49 qb-cfg-event-1634-1734-37-data -rw------- 1 hacluster root 8248 Sep 13 10:49 qb-cfg-event-1634-1734-37-header -rw------- 1 hacluster root 1048576 Sep 13 10:49 qb-cfg-event-1634-1734-38-data -rw------- 1 hacluster root 8248 Sep 13 10:49 qb-cfg-event-1634-1734-38-header -rw------- 1 hacluster root 1048576 Sep 13 10:49 qb-cfg-event-1634-1734-39-data -rw------- 1 hacluster root 8248 Sep 13 10:49 qb-cfg-event-1634-1734-39-header -rw------- 1 root root 1048576 Sep 13 10:50 qb-cfg-event-1634-2440-36-data -rw------- 1 root root 8248 Sep 13 10:50 qb-cfg-event-1634-2440-36-header -rw------- 1 root root 1048576 Sep 13 10:49 qb-cfg-request-1634-1727-29-data -rw------- 1 root root 8252 Sep 13 10:49 qb-cfg-request-1634-1727-29-header -rw------- 1 hacluster root 1048576 Sep 13 10:49 qb-cfg-request-1634-1734-37-data -rw------- 1 hacluster root 8252 Sep 13 10:49 qb-cfg-request-1634-1734-37-header -rw------- 1 hacluster root 1048576 Sep 13 10:49 qb-cfg-request-1634-1734-38-data -rw------- 1 hacluster root 8252 Sep 13 10:49 qb-cfg-request-1634-1734-38-header -rw------- 1 hacluster root 1048576 Sep 13 10:49 qb-cfg-request-1634-1734-39-data -rw------- 1 hacluster root 8252 Sep 13 10:49 qb-cfg-request-1634-1734-39-header -rw------- 1 root root 1048576 Sep 13 10:50 qb-cfg-request-1634-2440-36-data -rw------- 1 root root 8252 Sep 13 10:50 qb-cfg-request-1634-2440-36-header -rw------- 1 root root 1048576 Sep 13 10:49 qb-cfg-response-1634-1727-29-data -rw------- 1 root root 8248 Sep 13 10:49 qb-cfg-response-1634-1727-29-header -rw------- 1 hacluster root 1048576 Sep 13 10:49 qb-cfg-response-1634-1734-37-data -rw------- 1 hacluster root 8248 Sep 13 10:49 qb-cfg-response-1634-1734-37-header -rw------- 1 hacluster root 1048576 Sep 13 10:49 qb-cfg-response-1634-1734-38-data -rw------- 1 hacluster root 8248 Sep 13 10:49 qb-cfg-response-1634-1734-38-header -rw------- 1 hacluster root 1048576 Sep 13 10:49 qb-cfg-response-1634-1734-39-data -rw------- 1 hacluster root 8248 Sep 13 10:49 qb-cfg-response-1634-1734-39-header -rw------- 1 root root 1048576 Sep 13 10:50 qb-cfg-response-1634-2440-36-data -rw------- 1 root root 8248 Sep 13 10:50 qb-cfg-response-1634-2440-36-header -rw------- 1 hacluster root 24 Sep 13 10:49 qb-cib_rw-control-1729-1730-10 -rw------- 1 hacluster root 24 Sep 13 10:49 qb-cib_rw-control-1729-1732-12 -rw------- 1 hacluster root 524288 Sep 13 11:11 qb-cib_shm-event-1729-1734-8-data -rw------- 1 hacluster root 8248 Sep 13 10:49 qb-cib_shm-event-1729-1734-8-header -rw------- 1 hacluster root 524288 Sep 13 21:55 qb-cib_shm-request-1729-1734-8-data -rw------- 1 hacluster root 8252 Sep 13 10:49 qb-cib_shm-request-1729-1734-8-header -rw------- 1 hacluster root 524288 Sep 13 10:49 qb-cib_shm-response-1729-1734-8-data -rw------- 1 hacluster root 8248 Sep 13 10:49 qb-cib_shm-response-1729-1734-8-header -rw------- 1 root root 8388608 Sep 14 06:34 qb-corosync-blackbox-data -rw------- 1 root root 8248 Sep 13 10:49 qb-corosync-blackbox-header -rw------- 1 root root 1048576 Sep 13 10:49 qb-cpg-event-1634-1727-30-data -rw------- 1 root root 8248 Sep 13 10:49 qb-cpg-event-1634-1727-30-header -rw------- 1 hacluster root 1048576 Sep 13 11:11 qb-cpg-event-1634-1729-33-data -rw------- 1 hacluster root 8248 Sep 13 10:49 qb-cpg-event-1634-1729-33-header -rw------- 1 root root 1048576 Sep 13 10:49 qb-cpg-event-1634-1730-32-data -rw------- 1 root root 8248 Sep 13 10:49 qb-cpg-event-1634-1730-32-header -rw------- 1 hacluster root 1048576 Sep 13 10:49 qb-cpg-event-1634-1732-31-data -rw------- 1 hacluster root 8248 Sep 13 10:49 qb-cpg-event-1634-1732-31-header -rw------- 1 hacluster root 1048576 Sep 13 11:35 qb-cpg-event-1634-1734-34-data -rw------- 1 hacluster root 8248 Sep 13 10:49 qb-cpg-event-1634-1734-34-header -rw------- 1 root root 1048576 Sep 13 10:50 qb-cpg-event-1634-2440-41-data -rw------- 1 root root 8248 Sep 13 10:50 qb-cpg-event-1634-2440-41-header -rw------- 1 root root 1048576 Sep 13 10:50 qb-cpg-event-1634-2440-44-data -rw------- 1 root root 8248 Sep 13 10:50 qb-cpg-event-1634-2440-44-header -rw------- 1 root root 1048576 Sep 13 10:50 qb-cpg-event-1634-3140-42-data -rw------- 1 root root 8248 Sep 13 10:50 qb-cpg-event-1634-3140-42-header -rw------- 1 root root 1048576 Sep 13 10:49 qb-cpg-request-1634-1727-30-data -rw------- 1 root root 8252 Sep 13 10:49 qb-cpg-request-1634-1727-30-header -rw------- 1 hacluster root 1048576 Sep 13 17:58 qb-cpg-request-1634-1729-33-data -rw------- 1 hacluster root 8252 Sep 13 10:49 qb-cpg-request-1634-1729-33-header -rw------- 1 root root 1048576 Sep 13 11:35 qb-cpg-request-1634-1730-32-data -rw------- 1 root root 8252 Sep 13 10:49 qb-cpg-request-1634-1730-32-header -rw------- 1 hacluster root 1048576 Sep 13 17:58 qb-cpg-request-1634-1732-31-data -rw------- 1 hacluster root 8252 Sep 13 10:49 qb-cpg-request-1634-1732-31-header -rw------- 1 hacluster root 1048576 Sep 13 17:58 qb-cpg-request-1634-1734-34-data -rw------- 1 hacluster root 8252 Sep 13 10:49 qb-cpg-request-1634-1734-34-header -rw------- 1 root root 1048576 Sep 13 11:35 qb-cpg-request-1634-2440-41-data -rw------- 1 root root 8252 Sep 13 10:50 qb-cpg-request-1634-2440-41-header -rw------- 1 root root 1048576 Sep 13 10:50 qb-cpg-request-1634-2440-44-data -rw------- 1 root root 8252 Sep 13 10:50 qb-cpg-request-1634-2440-44-header -rw------- 1 root root 1048576 Sep 13 10:50 qb-cpg-request-1634-3140-42-data -rw------- 1 root root 8252 Sep 13 10:50 qb-cpg-request-1634-3140-42-header -rw------- 1 root root 1048576 Sep 13 10:49 qb-cpg-response-1634-1727-30-data -rw------- 1 root root 8248 Sep 13 10:49 qb-cpg-response-1634-1727-30-header -rw------- 1 hacluster root 1048576 Sep 13 10:49 qb-cpg-response-1634-1729-33-data -rw------- 1 hacluster root 8248 Sep 13 10:49 qb-cpg-response-1634-1729-33-header -rw------- 1 root root 1048576 Sep 13 10:49 qb-cpg-response-1634-1730-32-data -rw------- 1 root root 8248 Sep 13 10:49 qb-cpg-response-1634-1730-32-header -rw------- 1 hacluster root 1048576 Sep 13 10:49 qb-cpg-response-1634-1732-31-data -rw------- 1 hacluster root 8248 Sep 13 10:49 qb-cpg-response-1634-1732-31-header -rw------- 1 hacluster root 1048576 Sep 13 10:49 qb-cpg-response-1634-1734-34-data -rw------- 1 hacluster root 8248 Sep 13 10:49 qb-cpg-response-1634-1734-34-header -rw------- 1 root root 1048576 Sep 13 10:50 qb-cpg-response-1634-2440-41-data -rw------- 1 root root 8248 Sep 13 10:50 qb-cpg-response-1634-2440-41-header -rw------- 1 root root 1048576 Sep 13 10:50 qb-cpg-response-1634-2440-44-data -rw------- 1 root root 8248 Sep 13 10:50 qb-cpg-response-1634-2440-44-header -rw------- 1 root root 1048576 Sep 13 10:50 qb-cpg-response-1634-3140-42-data -rw------- 1 root root 8248 Sep 13 10:50 qb-cpg-response-1634-3140-42-header -rw------- 1 hacluster root 20480 Sep 13 10:49 qb-lrmd-event-1731-1734-5-data -rw------- 1 hacluster root 8248 Sep 13 10:49 qb-lrmd-event-1731-1734-5-header -rw------- 1 hacluster root 20480 Sep 13 10:50 qb-lrmd-request-1731-1734-5-data -rw------- 1 hacluster root 8252 Sep 13 10:49 qb-lrmd-request-1731-1734-5-header -rw------- 1 hacluster root 20480 Sep 13 10:49 qb-lrmd-response-1731-1734-5-data -rw------- 1 hacluster root 8248 Sep 13 10:49 qb-lrmd-response-1731-1734-5-header -rw------- 1 hacluster root 5242880 Sep 13 11:29 qb-pengine-event-1733-1734-4-data -rw------- 1 hacluster root 8248 Sep 13 11:29 qb-pengine-event-1733-1734-4-header -rw------- 1 hacluster root 5242880 Sep 13 23:50 qb-pengine-request-1733-1734-4-data -rw------- 1 hacluster root 8252 Sep 13 11:29 qb-pengine-request-1733-1734-4-header -rw------- 1 hacluster root 5242880 Sep 13 11:29 qb-pengine-response-1733-1734-4-data -rw------- 1 hacluster root 8248 Sep 13 11:29 qb-pengine-response-1733-1734-4-header -rw------- 1 hacluster root 1048576 Sep 13 10:49 qb-quorum-event-1634-1734-35-data -rw------- 1 hacluster root 8248 Sep 13 10:49 qb-quorum-event-1634-1734-35-header -rw------- 1 root root 1048576 Sep 13 10:50 qb-quorum-event-1634-2440-40-data -rw------- 1 root root 8248 Sep 13 10:50 qb-quorum-event-1634-2440-40-header -rw------- 1 root root 1048576 Sep 13 10:50 qb-quorum-event-1634-3140-43-data -rw------- 1 root root 8248 Sep 13 10:50 qb-quorum-event-1634-3140-43-header -rw------- 1 hacluster root 1048576 Sep 13 10:49 qb-quorum-request-1634-1734-35-data -rw------- 1 hacluster root 8252 Sep 13 10:49 qb-quorum-request-1634-1734-35-header -rw------- 1 root root 1048576 Sep 13 10:50 qb-quorum-request-1634-2440-40-data -rw------- 1 root root 8252 Sep 13 10:50 qb-quorum-request-1634-2440-40-header -rw------- 1 root root 1048576 Sep 13 10:50 qb-quorum-request-1634-3140-43-data -rw------- 1 root root 8252 Sep 13 10:50 qb-quorum-request-1634-3140-43-header -rw------- 1 hacluster root 1048576 Sep 13 10:49 qb-quorum-response-1634-1734-35-data -rw------- 1 hacluster root 8248 Sep 13 10:49 qb-quorum-response-1634-1734-35-header -rw------- 1 root root 1048576 Sep 13 10:50 qb-quorum-response-1634-2440-40-data -rw------- 1 root root 8248 Sep 13 10:50 qb-quorum-response-1634-2440-40-header -rw------- 1 root root 1048576 Sep 13 10:50 qb-quorum-response-1634-3140-43-data -rw------- 1 root root 8248 Sep 13 10:50 qb-quorum-response-1634-3140-43-header -rw------- 1 root root 24 Sep 13 10:50 qb-stonith-ng-control-1730-1731-11 -rw------- 1 hacluster root 24 Sep 13 10:49 qb-stonith-ng-control-1730-1734-8 Vladislav _______________________________________________ Pacemaker mailing list: Pacemaker@oss.clusterlabs.org http://oss.clusterlabs.org/mailman/listinfo/pacemaker Project Home: http://www.clusterlabs.org Getting started: http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf Bugs: http://bugs.clusterlabs.org
