Re: [zfs-discuss] Some performance questions with ZFS/NFS/DNLC at snv_48

2006-11-15 Thread Sanjeev Bagewadi
Tomas, Apologies for delayed response... Tomas Ögren wrote: Interesting ! So, it is not the ARC which is consuming too much memory It is some other piece (not sure if it belongs to ZFS) which is causing the crunch... Or the other possibility is that ARC ate up too much and caused a

Re: [zfs-discuss] Some performance questions with ZFS/NFS/DNLC at snv_48

2006-11-14 Thread Tomas Ögren
On 13 November, 2006 - Eric Kustarz sent me these 2,4K bytes: Tomas Ögren wrote: On 13 November, 2006 - Sanjeev Bagewadi sent me these 7,1K bytes: Regarding the huge number of reads, I am sure you have already tried disabling the VDEV prefetch. If not, it is worth a try. That was part of

Re: [zfs-discuss] Some performance questions with ZFS/NFS/DNLC at snv_48

2006-11-13 Thread Tomas Ögren
On 13 November, 2006 - Sanjeev Bagewadi sent me these 7,1K bytes: Tomas, comments inline... arc::print struct arc { anon = ARC_anon mru = ARC_mru mru_ghost = ARC_mru_ghost mfu = ARC_mfu mfu_ghost = ARC_mfu_ghost size = 0x6f7a400 p =

Re: [zfs-discuss] Some performance questions with ZFS/NFS/DNLC at snv_48

2006-11-13 Thread Roch - PAE
Tomas Ögren writes: On 13 November, 2006 - Sanjeev Bagewadi sent me these 7,1K bytes: Tomas, comments inline... arc::print struct arc { anon = ARC_anon mru = ARC_mru mru_ghost = ARC_mru_ghost mfu = ARC_mfu

Re: [zfs-discuss] Some performance questions with ZFS/NFS/DNLC at snv_48

2006-11-13 Thread Eric Kustarz
Tomas Ögren wrote: On 13 November, 2006 - Sanjeev Bagewadi sent me these 7,1K bytes: Tomas, comments inline... arc::print struct arc { anon = ARC_anon mru = ARC_mru mru_ghost = ARC_mru_ghost mfu = ARC_mfu mfu_ghost = ARC_mfu_ghost size = 0x6f7a400 p = 0x5d9bd5a

Re: [zfs-discuss] Some performance questions with ZFS/NFS/DNLC at snv_48

2006-11-12 Thread Sanjeev Bagewadi
Tomas, comments inline... Tomas Ögren wrote: On 10 November, 2006 - Sanjeev Bagewadi sent me these 3,5K bytes: 1. DNLC-through-ZFS doesn't seem to listen to ncsize. The filesystem currently has ~550k inodes and large portions of it is frequently looked over with rsync (over nfs). mdb

Re: [zfs-discuss] Some performance questions with ZFS/NFS/DNLC at snv_48

2006-11-10 Thread Sanjeev Bagewadi
Comments in line... Neil Perrin wrote: 1. DNLC-through-ZFS doesn't seem to listen to ncsize. The filesystem currently has ~550k inodes and large portions of it is frequently looked over with rsync (over nfs). mdb said ncsize was about 68k and vmstat -s said we had a hitrate of ~30%, so I

Re: [zfs-discuss] Some performance questions with ZFS/NFS/DNLC at snv_48

2006-11-10 Thread Tomas Ögren
On 10 November, 2006 - Sanjeev Bagewadi sent me these 3,5K bytes: Comments in line... Neil Perrin wrote: 1. DNLC-through-ZFS doesn't seem to listen to ncsize. The filesystem currently has ~550k inodes and large portions of it is frequently looked over with rsync (over nfs). mdb said

[zfs-discuss] Some performance questions with ZFS/NFS/DNLC at snv_48

2006-11-09 Thread Tomas Ögren
Hello. We're currently using a Sun Blade1000 (2x750MHz, 1G ram, 2x160MB/s mpt scsi buses, skge GigE network) as a NFS backend with ZFS for distribution of free software like Debian (cdimage.debian.org, ftp.se.debian.org) and have run into some performance issues. We are running SX snv_48 and

Re: [zfs-discuss] Some performance questions with ZFS/NFS/DNLC at snv_48

2006-11-09 Thread Neil Perrin
Tomas Ögren wrote On 11/09/06 09:59,: 1. DNLC-through-ZFS doesn't seem to listen to ncsize. The filesystem currently has ~550k inodes and large portions of it is frequently looked over with rsync (over nfs). mdb said ncsize was about 68k and vmstat -s said we had a hitrate of ~30%, so I set

Re: [zfs-discuss] Some performance questions with ZFS/NFS/DNLC at snv_48

2006-11-09 Thread eric kustarz
Neil Perrin wrote: Tomas Ögren wrote On 11/09/06 09:59,: 1. DNLC-through-ZFS doesn't seem to listen to ncsize. The filesystem currently has ~550k inodes and large portions of it is frequently looked over with rsync (over nfs). mdb said ncsize was about 68k and vmstat -s said we had a

Re: [zfs-discuss] Some performance questions with ZFS/NFS/DNLC at snv_48

2006-11-09 Thread Tomas Ögren
On 09 November, 2006 - Neil Perrin sent me these 1,6K bytes: Tomas Ögren wrote On 11/09/06 09:59,: 1. DNLC-through-ZFS doesn't seem to listen to ncsize. The filesystem currently has ~550k inodes and large portions of it is frequently looked over with rsync (over nfs). mdb said ncsize

Re: [zfs-discuss] Some performance questions with ZFS/NFS/DNLC at snv_48

2006-11-09 Thread Brian Wong
eric kustarz wrote: If the ARC detects low memory (via arc_reclaim_needed()), then we call arc_kmem_reap_now() and subsequently dnlc_reduce_cache() - which reduces the # of dnlc entries by 3% (ARC_REDUCE_DNLC_PERCENT). So yeah, dnlc_nentries would be really interesting to see (especially

Re: [zfs-discuss] Some performance questions with ZFS/NFS/DNLC at snv_48

2006-11-09 Thread Tomas Ögren
On 09 November, 2006 - Tomas Ögren sent me these 4,4K bytes: On 09 November, 2006 - Neil Perrin sent me these 1,6K bytes: nfs does have a maximum nmber of rnodes which is calculated from the memory available. It doesn't look like nrnode_max can be overridden. rnode seems to take 472

Re: [zfs-discuss] Some performance questions with ZFS/NFS/DNLC at snv_48

2006-11-09 Thread eric kustarz
Brian Wong wrote: eric kustarz wrote: If the ARC detects low memory (via arc_reclaim_needed()), then we call arc_kmem_reap_now() and subsequently dnlc_reduce_cache() - which reduces the # of dnlc entries by 3% (ARC_REDUCE_DNLC_PERCENT). So yeah, dnlc_nentries would be really interesting

Re[2]: [zfs-discuss] Some performance questions with ZFS/NFS/DNLC at snv_48

2006-11-09 Thread Robert Milkowski
Hello Tomas, Thursday, November 9, 2006, 9:47:17 PM, you wrote: TÖ On 09 November, 2006 - Neil Perrin sent me these 1,6K bytes: TÖ Current memory usage (for some values of usage ;): TÖ # echo ::memstat|mdb -k TÖ Page SummaryPagesMB %Tot TÖ

Re: [zfs-discuss] Some performance questions with ZFS/NFS/DNLC at snv_48

2006-11-09 Thread Neil Perrin
Tomas Ögren wrote On 11/09/06 13:47,: On 09 November, 2006 - Neil Perrin sent me these 1,6K bytes: Tomas Ögren wrote On 11/09/06 09:59,: 1. DNLC-through-ZFS doesn't seem to listen to ncsize. The filesystem currently has ~550k inodes and large portions of it is frequently looked