Re: [hwloc-devel] Cgroup resource limits

2012-11-05 Thread Christopher Samuel
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 03/11/12 09:05, Ralph Castain wrote: > System resource managers don't usually provide this capability, so we > will do it at the ORTE level. Interestingly one of the Torque developers posted this overnight:

Re: [hwloc-devel] Cgroup resource limits

2012-11-05 Thread Christopher Samuel
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 06/11/12 13:01, Ralph Castain wrote: > Depends on the use-case. If you are going to direct-launch the > processes (e.g., using srun), then you are correct. Yup. > However, that isn't the case in other scenarios. For example, if > you get an

Re: [hwloc-devel] Cgroup resource limits

2012-11-05 Thread Christopher Samuel
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 06/11/12 01:43, Ralph Castain wrote: > On Nov 4, 2012, at 7:28 PM, Christopher Samuel > wrote: > >> I would argue that the resource managers *should* be doing it > > No argument from me - I would love for them to provide

Re: [hwloc-devel] Cgroup resource limits

2012-11-05 Thread Ralph Castain
On Nov 4, 2012, at 7:28 PM, Christopher Samuel wrote: > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA1 > > On 03/11/12 09:05, Ralph Castain wrote: > >> System resource managers don't usually provide this capability, so >> we will do it at the ORTE level. > > I would

Re: [hwloc-devel] Cgroup resource limits

2012-11-04 Thread Christopher Samuel
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 03/11/12 09:05, Ralph Castain wrote: > System resource managers don't usually provide this capability, so > we will do it at the ORTE level. I would argue that the resource managers *should* be doing it - however, I will also argue that the

Re: [hwloc-devel] Cgroup resource limits

2012-11-02 Thread Ralph Castain
Hi Brice I think Linux cgroups makes the most sense in terms of a mechanism for doing this. We don't already do it, but it is something our customers want to see in the platform - so we have to provide it. The basic use-case is for an application to specify a max memory requirement, thus

Re: [hwloc-devel] Cgroup resource limits

2012-11-02 Thread Rayson Ho
Ralph, We added cgroups integration support into Grid Engine a few months ago, and we ended up implementing routines that write values to "memory.memsw.limit_in_bytes", "memory.limit_in_bytes", "memory.soft_limit_in_bytes", etc... We just simply write the values out to the cgroups files.

Re: [hwloc-devel] Cgroup resource limits

2012-11-02 Thread Brice Goglin
Hello Ralph, I am not very familiar with these features. What system mechanism do you currently use for this? Linux cgroups? Any concrete example of what you would like to do? Brice Le 02/11/2012 22:12, Ralph Castain a écrit : > Hi folks > > We (Greenplum) have a need to support resource

[hwloc-devel] Cgroup resource limits

2012-11-02 Thread Ralph Castain
Hi folks We (Greenplum) have a need to support resource limits (e.g., memory and cpu usage) on processes running under Open MPI's RTE. OMPI uses hwloc for processor and memory affinity, so this seems a likely place to add the required support. Jeff tells me that it doesn't yet exist in hwloc -