Hi Satoshi, I am not aware of any possibility to map the current statistics in /proc to UIDs. But I might be wrong. We had a script like this a while ago which did not kill the I/O intensive processes but told us the PIDs.
What we did is collecting for ~30 seconds the number of I/O operations per node via /proc on all nodes. Then we attached an strace process to each process on nodes with heavy I/O load. This strace intercepted only the I/O calls and wrote one log file per process. If this strace is running for the same amount of time for each process on a host, you just need to sort the log files for size. Regards, Michael Am Donnerstag, den 10.02.2011, 21:16 -0600 schrieb Satoshi Isono: > Dear members, > > I am looking into the way which can detect userid or jobid on the Lustre > client. Assumed the following condition; > > 1) Any users run any jobs through scheduler like PBS Pro, LSF or SGE. > 2) A users processes occupy Lustre I/O. > 3) Some Lustre servers (MDS?/OSS?) can detect high I/O stress on each server. > 4) But Lustre server cannot make the mapping between jobid/userid and Lustre > I/O processes having heavy stress, because there aren't userid on Lustre > servers. > 5) I expect that Lustre can monitor and can make the mapping. > 6) If possible for (5), we can make a script which launches scheduler > command like as qdel. > 7) Heavy users job will be killed by job scheduler. > > I want (5) for Lustre capability, but I guess current Lustre 1.8 cannot > perform (5). On the other hand, in order to map Lustre process to > userid/jobid, are there any ways using like rpctrace or nid stats? Can you > please your advice or comments? > > Regards, > Satoshi Isono > _______________________________________________ > Lustre-discuss mailing list > [email protected] > http://lists.lustre.org/mailman/listinfo/lustre-discuss > -- Michael Kluge, M.Sc. Technische Universität Dresden Center for Information Services and High Performance Computing (ZIH) D-01062 Dresden Germany Contact: Willersbau, Room A 208 Phone: (+49) 351 463-34217 Fax: (+49) 351 463-37773 e-mail: [email protected] WWW: http://www.tu-dresden.de/zih
smime.p7s
Description: S/MIME cryptographic signature
_______________________________________________ Lustre-discuss mailing list [email protected] http://lists.lustre.org/mailman/listinfo/lustre-discuss
