Re: [cifs-discuss] Poor performance
Hi, I found the source of my problems, which were all networking problems. I'm now reading that same directory which has 110,000 files, with an average size of 500K at 20Mbytes/sec. Sorry for panicking John -- This message posted from opensolaris.org ___ cifs-discuss mailing list cifs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/cifs-discuss
Re: [cifs-discuss] Poor performance
Hi Daniel, Is that 500Mb/sec with CIFS, copying a directory structure with lots of small files? I can also get 500Mb/sec just doing a local block read. My problem is that CIFS is very slow, and it seems to get worse as there are more people using the system. We only have about 50 possible users anyway. This morning before anyone was using the system I got 6 Mbytes/sec. - Still not brilliant, as I was probably the only CIFS user. During the day, it's gets down to 2Mbytes/sec Running snoop while I'm reading via CIFS, shows a lot of NBT and SMB traffic going back and forth between client and server, but not much in the way of file transfer. Anyone any clues? John -Original Message- From: Liebster, Daniel [mailto:liebs...@cshl.edu] Sent: 08 June 2010 18:48 To: Ryan John; cifs-discuss@opensolaris.org Subject: Re: [cifs-discuss] Poor performance This doesn't sound like you are maxing out the server. We've gotten 500 MB/s on an x4500. On 6/8/10 12:36 PM, "John Ryan" wrote: > I forgot to mention the build. > I'm running 2 almost identical servers. > One at snv_133 and the other at snv_134 > > John > > Ryan John wrote: >> >> Hi, >> >> I¹m getting poor read performance on some of my shares using CIFS, and >> I can¹t see what¹s going wrong. >> >> Read speed is around 10Mbits per second. >> >> My network is all gigabit and even 10Gbit to the storage servers. The >> hardware is an x4540 configured with RAIDz2 and ZIL on a pair of SSDs >> >> >> Regards >> >> John Ryan >> >> >> >> ___ >> cifs-discuss mailing list >> cifs-discuss@opensolaris.org >> http://mail.opensolaris.org/mailman/listinfo/cifs-discuss >> > > ___ > cifs-discuss mailing list > cifs-discuss@opensolaris.org > http://mail.opensolaris.org/mailman/listinfo/cifs-discuss ___ cifs-discuss mailing list cifs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/cifs-discuss
Re: [cifs-discuss] Poor performance
This doesn't sound like you are maxing out the server. We've gotten 500 MB/s on an x4500. On 6/8/10 12:36 PM, "John Ryan" wrote: > I forgot to mention the build. > I'm running 2 almost identical servers. > One at snv_133 and the other at snv_134 > > John > > Ryan John wrote: >> >> Hi, >> >> I¹m getting poor read performance on some of my shares using CIFS, and >> I can¹t see what¹s going wrong. >> >> Read speed is around 10Mbits per second. >> >> My network is all gigabit and even 10Gbit to the storage servers. The >> hardware is an x4540 configured with RAIDz2 and ZIL on a pair of SSDs >> >> >> Regards >> >> John Ryan >> >> >> >> ___ >> cifs-discuss mailing list >> cifs-discuss@opensolaris.org >> http://mail.opensolaris.org/mailman/listinfo/cifs-discuss >> > > ___ > cifs-discuss mailing list > cifs-discuss@opensolaris.org > http://mail.opensolaris.org/mailman/listinfo/cifs-discuss ___ cifs-discuss mailing list cifs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/cifs-discuss
Re: [cifs-discuss] Poor performance
I forgot to mention the build. I'm running 2 almost identical servers. One at snv_133 and the other at snv_134 John Ryan John wrote: Hi, I’m getting poor read performance on some of my shares using CIFS, and I can’t see what’s going wrong. Read speed is around 10Mbits per second. My network is all gigabit and even 10Gbit to the storage servers. The hardware is an x4540 configured with RAIDz2 and ZIL on a pair of SSDs Regards John Ryan ___ cifs-discuss mailing list cifs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/cifs-discuss ___ cifs-discuss mailing list cifs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/cifs-discuss
Re: [cifs-discuss] Poor performance
With CIFS reading only, iostat looks like: # zpool iostat dataPool 1 200 capacity operationsbandwidth poolalloc free read write read write -- - - - - - - dataPool18.3T 21.7T577 59 35.1M 1.36M dataPool18.3T 21.7T 38 0 3.38M 0 dataPool18.3T 21.7T 22 0 2.37M 0 dataPool18.3T 21.7T 33 0 3.25M 0 dataPool18.3T 21.7T 54 0 5.56M 0 ^C Regards John From: cifs-discuss-boun...@opensolaris.org [mailto:cifs-discuss-boun...@opensolaris.org] On Behalf Of Ryan John Sent: 08 June 2010 17:24 To: cifs-discuss@opensolaris.org Subject: [cifs-discuss] Poor performance Hi, I'm getting poor read performance on some of my shares using CIFS, and I can't see what's going wrong. Read speed is around 10Mbits per second. My network is all gigabit and even 10Gbit to the storage servers. The hardware is an x4540 configured with RAIDz2 and ZIL on a pair of SSDs NFS to the same shares performs about twice the speed. I did a zpool iostat while both the nfs and CIFS read are happening. # zpool iostat dataPool 1 200 capacity operationsbandwidth poolalloc free read write read write -- - - - - - - dataPool18.3T 21.7T578 59 35.2M 1.37M dataPool18.3T 21.7T 46 0 4.99M 0 dataPool18.3T 21.7T231 0 26.1M 0 dataPool18.3T 21.7T280 0 31.7M 0 dataPool18.3T 21.7T352 0 40.6M 0 dataPool18.3T 21.7T348 0 41.1M 0 dataPool18.3T 21.7T371 0 45.3M 0 dataPool18.3T 21.7T475 0 57.6M 0 dataPool18.3T 21.7T409 0 49.7M 0 dataPool18.3T 21.7T483 0 58.8M 0 dataPool18.3T 21.7T188 0 15.4M 0 dataPool18.3T 21.7T143 1.49K 13.4M 5.68M Do you think my machine is at the limit of it's performance? Regards John Ryan ___ cifs-discuss mailing list cifs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/cifs-discuss