Robert wrote: > Before jumping to any conclusions - first try to > eliminate nfs and do readdirs locally - I guess that would be quite fast. > Then check on a client (dtrace) the time distribution of nfs requests > and sends us results.
We used this test program that is doing readdirs and can be run with one argument: name of directory to dig into - like in this example : [b]rdir /mnt[/b] The program can be downloaded here: http://tinyurl.com/ywcyyp/rdir.c (source code) http://tinyurl.com/ywcyyp/rdir (executable for sparc) http://tinyurl.com/ywcyyp/rdir.x86 (executable for x86) Results: 1.local ZFS - we have 160 zfs'es under /tank1 : /tank1/1.../tank1/160 that were created during the SFS benchmark run # ptime /var/tmp/rdir /tank1 real [b]1:37.824[/b] user 1.637 sys 38.498 again: real 1:27.001 user 1.595 sys 32.146 To avoid an influence of local runs on the NFS runs: # zfs unmount -a # zfs mount -a # zfs share -a (160 shares) 2. NFS ssh to NFS client, create 160 dirs under /mnt, mount /tank1/i to /mnt/i (i=1...160) from the NFS server > ptime /var/tmp/rdir /mnt real [b]1:48.983[/b] user 1.096 sys 17.265 again: real [b]3:51.001[/b] user 1.657 sys 27.468 There is definitely a problem - 2nd NFS run is more than 2 times longer! What is the reason ? This message posted from opensolaris.org
