Re: [Jfs-discussion] performance probs - 2.4.28, jsf117, raid5
On Mon, 6 Dec 2004 17:37:30 -0500, Sonny Rao wrote: Right, so there's really only one thing i can think of and it's not much of a solution. You can change the memory split so that you can use all 2gb for kernel memory. I know there are some patches floating around to convert the 1GB to a 2GB split, or you can use one of the so-called 4GB/4GB kernels which keeps the kernel in a totally different address space. This is separate to the option for high-mem support in the kernel? OK, I've just found the posting from Ingo Molnar. It's really only a solution if all of the inodes in your working set fit into 2GB, otherwise you're just delaying the inevitable. Ultimately, this is what 64bit machines (with a lot of ram) are good for :-) Yeah ... thanks again. I've managed to tweak our setup, which has helped - but the problem is that kswapd when under heavy load manages to bring the machine to a halt as other processes appear to be spinning. I'm now contemplating offloading a lot of this IO to another box - fortunately 32bit boxes are cheap to come by these days. /Per Jessen, Zurich -- regards, Per Jessen, Zurich http://www.spamchek.com - let your spam stop here! ___ Jfs-discussion mailing list [EMAIL PROTECTED] http://www-124.ibm.com/developerworks/oss/mailman/listinfo/jfs-discussion
Re: [Jfs-discussion] performance probs - 2.4.28, jsf117, raid5
On Sun, Dec 05, 2004 at 08:41:35PM +0100, Per Jessen wrote: On Sun, 05 Dec 2004 18:40:58 +0100, Per Jessen wrote: I do a find in a directory that contains 5-600,000 files - which just about makes the box grind to a halt. The machine is not heavily loaded as such, but does write 2 new files/sec to the same filesystem. Or tries to. I need to add - at the same time kswapd is very, very busy, despite only about 1Gb of the 2Gb main core being used/active. /Per Yes, this is a consequence of the way memory is partitioned on IA32 machines (which I'm assuming you're using). If you look at the amount of memory being used by the kernel slab cache, I'd bet it's using much of that 1GB for kernel data structures (inodes, dentrys, etc) and whenever the kernel needs to allocate some more memory it has to evict some of those structures which is a very expensive process. Look at /proc/slabinfo and add up the total number of slabs. Sonny ___ Jfs-discussion mailing list [EMAIL PROTECTED] http://www-124.ibm.com/developerworks/oss/mailman/listinfo/jfs-discussion
Re: [Jfs-discussion] performance probs - 2.4.28, jsf117, raid5
On Sun, 05 Dec 2004 18:40:58 +0100, Per Jessen wrote: I do a find in a directory that contains 5-600,000 files - which just about makes the box grind to a halt. The machine is not heavily loaded as such, but does write 2 new files/sec to the same filesystem. Or tries to. I need to add - at the same time kswapd is very, very busy, despite only about 1Gb of the 2Gb main core being used/active. /Per -- regards, Per Jessen, Zurich http://www.spamchek.com - let your spam stop here! ___ Jfs-discussion mailing list [EMAIL PROTECTED] http://www-124.ibm.com/developerworks/oss/mailman/listinfo/jfs-discussion
