[Devel] Re: Fwd: Re: lxc-performance?
Le 08/10/2010 18:41, Serge E. Hallyn a écrit :
Quoting MALATTAR (mouhannad.alat...@univ-fcomte.fr):
Message original
Sujet: Re: lxc-performance
Date : Thu, 07 Oct 2010 16:56:05 +0200
De : MALATTARmouhannad.alat...@univ-fcomte.fr
Pour : MALATTARmouhannad.alat...@univ-fcomte.fr
Le 07/10/2010 16:43, MALATTAR a écrit :
06.10.2010 23:41, MALATTAR ?:
/ the container dora1, where i launch an instance of my IDS, does not take
// more than 70 MB as memory even though the memory limit for it is much
// bigger than this value,
/
How do you measure memory usage?
by using the command:
lxc-cgroup -n dora1 memory.usage_in_bytes
What's in memory.max_usage_in_bytes of
the container's cgroup?
executing the next command lxc-cgroup -n dora1 memory.max_usage_in_bytes
gave me 70193152 bytes
Interesting - that's not the value you set in your intro email.
???
What does /var/lib/lxc/dora1/config have?
lxc.utsname = dora1
lxc.tty = 4
lxc.network.type = veth
lxc.network.flags = up
lxc.network.link = br-node1
lxc.network.name = eth0
lxc.network.mtu = 1500
lxc.network.ipv4 = 10.0.0.1/24
lxc.network.hwaddr = 12:DA:00:4B:54:45
lxc.rootfs = /lxc/rootfs.fedora
lxc.mount = /lxc/fstab.fedora
lxc.cgroup.devices.deny = a
# /dev/null and zero
lxc.cgroup.devices.allow = c 1:3 rwm
lxc.cgroup.devices.allow = c 1:5 rwm
# consoles
lxc.cgroup.devices.allow = c 5:1 rwm
lxc.cgroup.devices.allow = c 5:0 rwm
lxc.cgroup.devices.allow = c 4:0 rwm
lxc.cgroup.devices.allow = c 4:1 rwm
# /dev/{,u}random
lxc.cgroup.devices.allow = c 1:9 rwm
lxc.cgroup.devices.allow = c 1:8 rwm
# /dev/pts/* - pts namespaces are coming soon
lxc.cgroup.devices.allow = c 136:* rwm
lxc.cgroup.devices.allow = c 5:2 rwm
# rtc
lxc.cgroup.devices.allow = c 254:0 rwm
lxc.cgroup.memory.limit_in_bytes = 1524435456
lxc.pts=1
--
Mouhannad AlATTAR
Doctorant à L’UFR Sciences,Techniques et Gestion de l’Industrie
Pôle multimedia de Franche Comté - numerica
1, cours Leprince-Ringuet
25201 Montbéliard
Fixe bureau : 03 81 99 47 87
Portable : 06 16 71 05 10
___
Containers mailing list
contain...@lists.linux-foundation.org
https://lists.linux-foundation.org/mailman/listinfo/containers
___
Devel mailing list
Devel@openvz.org
https://openvz.org/mailman/listinfo/devel
[Devel] Re: Fwd: Re: lxc-performance?
Le 12/10/2010 07:05, KAMEZAWA Hiroyuki a écrit : On Fri, 08 Oct 2010 10:09:51 +0200 MALATTARmouhannad.alat...@univ-fcomte.fr wrote: Le 07/10/2010 16:43, MALATTAR a écrit : 06.10.2010 23:41, MALATTAR ?: / the container dora1, where i launch an instance of my IDS, does not take // more than 70 MB as memory even though the memory limit for it is much // bigger than this value, / How do you measure memory usage? by using the command: lxc-cgroup -n dora1 memory.usage_in_bytes What's in memory.max_usage_in_bytes of the container's cgroup? executing the next command lxc-cgroup -n dora1 memory.max_usage_in_bytes gave me 70193152 bytes Hmm. what latencytop shows ? You can see this kind of output. == CauseMaximum Percentage Writing a page to disk551.6 msec 36.8 % Fork() system call273.7 msec 1.1 % Page fault253.9 msec 29.5 % Writing buffer to disk (synchronous) 225.9 msec 2.9 % Creating block layer request 202.7 msec 17.1 % Walking directory tree161.5 msec 1.4 % [congestion_wait] 97.6 msec 4.4 % Executing a program97.1 msec 0.3 % synchronous write 73.9 msec 0.1 % == IMHO, if memory limit is the problem, Page Fault tend to be big. Thanks, -Kame executing latencytop during the execution of my program gave me: Cause Maximum Percentage fsync() on a file (type 'F' for details) 45.1 msec 2.2 % Waiting for event (poll) 5.0 msec 47.9 % Userspace lock contention5.0 msec 43.1 % Waiting for event (select) 4.8 msec 5.7 % Throttling GPU while waiting for commands 3.4 msec 0.4 % [i915_do_wait_request] 3.3 msec 0.5 % Waiting for data on unix socket 0.3 msec 0.1 % Waiting for TTY data 0.2 msec 0.1 % Process mysqld (291) Total: 2.3 msec Waiting for data on unix socket 0.3 msec100.0 % It seems that there is no problem... also memtest command was able to allocate up to 1024MB but it takes a long time for one loop only ... So, i think the problem is in my program not in the container, is not it? a+ -- Mouhannad AlATTAR Doctorant à L’UFR Sciences,Techniques et Gestion de l’Industrie Pôle multimedia de Franche Comté - numerica 1, cours Leprince-Ringuet 25201 Montbéliard Fixe bureau : 03 81 99 47 87 Portable : 06 16 71 05 10 ___ Containers mailing list contain...@lists.linux-foundation.org https://lists.linux-foundation.org/mailman/listinfo/containers ___ Devel mailing list Devel@openvz.org https://openvz.org/mailman/listinfo/devel
[Devel] Re: Fwd: Re: lxc-performance?
14.10.2010 21:41, MALATTAR пишет: also memtest command was able to allocate up to 1024MB but it takes a long time for one loop only ... OK, the problem is not with LXC memory limits therefore. So, i think the problem is in my program not in the container, is not it? It could be your program or too low rlimits. What 'ulimit -a' says? Note that rlimits are per-process, so you should investigate their values from inside your program's operating environment. ___ Containers mailing list contain...@lists.linux-foundation.org https://lists.linux-foundation.org/mailman/listinfo/containers ___ Devel mailing list Devel@openvz.org https://openvz.org/mailman/listinfo/devel
[Devel] Re: Fwd: Re: lxc-performance?
On Thu, Oct 14, 2010 at 7:11 PM, MALATTAR mouhannad.alat...@univ-fcomte.fr wrote: Le 12/10/2010 07:05, KAMEZAWA Hiroyuki a écrit : On Fri, 08 Oct 2010 10:09:51 +0200 MALATTARmouhannad.alat...@univ-fcomte.fr wrote: Le 07/10/2010 16:43, MALATTAR a écrit : 06.10.2010 23:41, MALATTAR ?: / the container dora1, where i launch an instance of my IDS, does not take // more than 70 MB as memory even though the memory limit for it is much // bigger than this value, / How do you measure memory usage? by using the command: lxc-cgroup -n dora1 memory.usage_in_bytes What's in memory.max_usage_in_bytes of the container's cgroup? executing the next command lxc-cgroup -n dora1 memory.max_usage_in_bytes gave me 70193152 bytes Hmm. what latencytop shows ? You can see this kind of output. == Cause Maximum Percentage Writing a page to disk 551.6 msec 36.8 % Fork() system call 273.7 msec 1.1 % Page fault 253.9 msec 29.5 % Writing buffer to disk (synchronous) 225.9 msec 2.9 % Creating block layer request 202.7 msec 17.1 % Walking directory tree 161.5 msec 1.4 % [congestion_wait] 97.6 msec 4.4 % Executing a program 97.1 msec 0.3 % synchronous write 73.9 msec 0.1 % == IMHO, if memory limit is the problem, Page Fault tend to be big. Thanks, -Kame executing latencytop during the execution of my program gave me: Cause Maximum Percentage fsync() on a file (type 'F' for details) 45.1 msec 2.2 % Waiting for event (poll) 5.0 msec 47.9 % Userspace lock contention 5.0 msec 43.1 % Waiting for event (select) 4.8 msec 5.7 % Throttling GPU while waiting for commands 3.4 msec 0.4 % [i915_do_wait_request] 3.3 msec 0.5 % Waiting for data on unix socket 0.3 msec 0.1 % Waiting for TTY data 0.2 msec 0.1 % Process mysqld (291) Total: 2.3 msec Waiting for data on unix socket 0.3 msec 100.0 % It seems that there is no problem... also memtest command was able to allocate up to 1024MB but it takes a long time for one loop only ... So, i think the problem is in my program not in the container, is not it? Could you please dump your cgroup filesystem? What is memory.limit_in_bytes, memory.stat? fysnc() can clearly hold up things across the filesystem with ext3 and other FS. The source does sound like mysql database for the frequent fsync's - is that correct? What does the iotop output look like? Balbir ___ Containers mailing list contain...@lists.linux-foundation.org https://lists.linux-foundation.org/mailman/listinfo/containers ___ Devel mailing list Devel@openvz.org https://openvz.org/mailman/listinfo/devel
[Devel] Re: Fwd: Re: lxc-performance?
Quoting MALATTAR (mouhannad.alat...@univ-fcomte.fr): Message original Sujet:Re: lxc-performance Date :Thu, 07 Oct 2010 16:56:05 +0200 De : MALATTAR mouhannad.alat...@univ-fcomte.fr Pour :MALATTAR mouhannad.alat...@univ-fcomte.fr Le 07/10/2010 16:43, MALATTAR a écrit : 06.10.2010 23:41, MALATTAR ?: / the container dora1, where i launch an instance of my IDS, does not take // more than 70 MB as memory even though the memory limit for it is much // bigger than this value, / How do you measure memory usage? by using the command: lxc-cgroup -n dora1 memory.usage_in_bytes What's in memory.max_usage_in_bytes of the container's cgroup? executing the next command lxc-cgroup -n dora1 memory.max_usage_in_bytes gave me 70193152 bytes Ah, linux/Documentation/cgroups/memory.txt explains that max_usage_in_bytes reports the maximum memory usage recorded, not the limit. Look at lxc-cgroup -n dora1 memory.max_usage_in_bytes -serge ___ Containers mailing list contain...@lists.linux-foundation.org https://lists.linux-foundation.org/mailman/listinfo/containers ___ Devel mailing list Devel@openvz.org https://openvz.org/mailman/listinfo/devel
[Devel] Re: Fwd: Re: lxc-performance?
On Fri, 08 Oct 2010 10:09:51 +0200 MALATTAR mouhannad.alat...@univ-fcomte.fr wrote: Le 07/10/2010 16:43, MALATTAR a écrit : 06.10.2010 23:41, MALATTAR ?: / the container dora1, where i launch an instance of my IDS, does not take // more than 70 MB as memory even though the memory limit for it is much // bigger than this value, / How do you measure memory usage? by using the command: lxc-cgroup -n dora1 memory.usage_in_bytes What's in memory.max_usage_in_bytes of the container's cgroup? executing the next command lxc-cgroup -n dora1 memory.max_usage_in_bytes gave me 70193152 bytes Hmm. what latencytop shows ? You can see this kind of output. == CauseMaximum Percentage Writing a page to disk551.6 msec 36.8 % Fork() system call273.7 msec 1.1 % Page fault253.9 msec 29.5 % Writing buffer to disk (synchronous) 225.9 msec 2.9 % Creating block layer request 202.7 msec 17.1 % Walking directory tree161.5 msec 1.4 % [congestion_wait] 97.6 msec 4.4 % Executing a program97.1 msec 0.3 % synchronous write 73.9 msec 0.1 % == IMHO, if memory limit is the problem, Page Fault tend to be big. Thanks, -Kame ___ Containers mailing list contain...@lists.linux-foundation.org https://lists.linux-foundation.org/mailman/listinfo/containers ___ Devel mailing list Devel@openvz.org https://openvz.org/mailman/listinfo/devel
[Devel] Re: Fwd: Re: lxc-performance?
Quoting MALATTAR (mouhannad.alat...@univ-fcomte.fr): Message original Sujet:Re: lxc-performance Date :Thu, 07 Oct 2010 16:56:05 +0200 De : MALATTAR mouhannad.alat...@univ-fcomte.fr Pour :MALATTAR mouhannad.alat...@univ-fcomte.fr Le 07/10/2010 16:43, MALATTAR a écrit : 06.10.2010 23:41, MALATTAR ?: / the container dora1, where i launch an instance of my IDS, does not take // more than 70 MB as memory even though the memory limit for it is much // bigger than this value, / How do you measure memory usage? by using the command: lxc-cgroup -n dora1 memory.usage_in_bytes What's in memory.max_usage_in_bytes of the container's cgroup? executing the next command lxc-cgroup -n dora1 memory.max_usage_in_bytes gave me 70193152 bytes Interesting - that's not the value you set in your intro email. What does /var/lib/lxc/dora1/config have? ___ Containers mailing list contain...@lists.linux-foundation.org https://lists.linux-foundation.org/mailman/listinfo/containers ___ Devel mailing list Devel@openvz.org https://openvz.org/mailman/listinfo/devel
