Hi,

Yes, this is somewhat expected behavior. More client memory can help this as it allows for more local caching.
-cf

-----Original message-----
From: Christian Becker <[email protected]>
To: "[email protected]" <[email protected]>
Sent: Fri, May 4, 2012 22:34:26 MDT
Subject: [Lustre-discuss] Frequent system calls cause high load on meta data server

Dear colleagues,

one of our users calls within his R application an external program via the system function very often (/home is a lustre file system):


 for (i=0;i<10000;i++)
 {
   system("/home/user/bin/program arg0 arg1 ....");
 }

The runtime for the external program is only a few seconds. With hundred of these jobs running, the load on the meta data server goes up to 25 (2way quad core with lustre 1.8.3).


Is such a behavior known, if yes, how can I avoid it?


best regards,
Christian


_______________________________________________
Lustre-discuss mailing list
[email protected]
http://lists.lustre.org/mailman/listinfo/lustre-discuss

_______________________________________________
Lustre-discuss mailing list
[email protected]
http://lists.lustre.org/mailman/listinfo/lustre-discuss

Reply via email to