Richard, I disconnected all but one path and disabled mpxio via stmsboot -d and my read performance doubled. I saw about 100MBps average from the pool. BTW, single harddrive performance (single disk in a pool) is about 140MBps. What do you think? Thank you again for your help!
--- On Thu, 7/29/10, Richard Elling <rich...@nexenta.com> wrote: From: Richard Elling <rich...@nexenta.com> Subject: Re: [zfs-discuss] ZFS read performance terrible To: "Carol" <holaaqu...@yahoo.com> Cc: "zfs-discuss@opensolaris.org" <zfs-discuss@opensolaris.org> Date: Thursday, July 29, 2010, 2:03 PM On Jul 29, 2010, at 9:57 AM, Carol wrote: > Yes I noticed that thread a while back and have been doing a great deal of > testing with various scsi_vhci options. > I am disappointed that the thread hasn't moved further since I also suspect > that it is related to mpt-sas or multipath or expander related. The thread is in the ZFS forum, but the problem is not a ZFS problem. > I was able to get aggregate writes up to 500MB out to the disks but reads > have not improved beyond an aggregate average of about 50-70MBps for the pool. I find "zpool iostat" to be only marginally useful. You need to look at the output of "iostat -zxCn" which will show the latency of the I/Os. Check to see if the latency (asvc_t) is similar to the previous thread. > I did not look much at read speeds during alot of my previous testing because > I thought write speeds were my issue... And I've since realized that my > userland write speed problem from zpool <-> zpool was actually read limited. Writes are cached in RAM, so looking at iostat or zpool iostat doesn't offer the observation point you'd expect. > Since then I've tried mirrors, stripes, raidz, checked my drive caches, > tested recordsizes, volblocksizes, clustersizes, combinations therein, tried > vol-backed luns, file-backed luns, wcd=false - etc. > > Reads from disk are slow no matter what. Of course - once the arc cache is > populated, the userland experience is blazing - because the disks are not > being read. Yep, classic case of slow disk I/O. > Seeing write speeds so much faster that read strikes me as quite strange from > a hardware perspective, though, since writes also invoke a read operation - > do they not? In many cases, writes do not invoke a read. -- richard
_______________________________________________ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss