>Ok... so we've rebuilt the pool as 14 pairs of mirrors, each pair having one 
>disk in each of the two JBODs.  >Now we're getting about 500-1000 IOPS 
>(according to zpool iostat) and 20-30MB/sec in random read on a big >database. 
> Does that sounds right?>Seems right, as Erik said. Btw, do you use SSDs for 
>L2ARC/SLOG here? If not, that might help quite a bit.
 
I have 8x 100GB SLC SDDs (the Samsung ones that Dell sells) for the L2ARC and 
2x 4GB DDRDrive X1s in mirror for the SLOG.  The server also has 128GB of RAM, 
I can see 100GB+ are used for the ARC.  I'll also double the RAM to 256GB and 
add 4 more SSDs (total 1.2TB) for the L2ARC once I'm ready to go to production. 
 I will eventually connect total of 75 SATA drives and 84 SAS 15K drives to it, 
I just want to make sure that I get the most of what I have.  When I run a 
dozen large SQL queries at once (they can take >10 mins) I consistently get 
300-1000 IOPs and 10-30MB/sec from the pool (according to zpool iostat).
What I don't understand is why, when I run a single query I get <100 IOPS and 
<3MB/sec.  The setup can obviously do better, so where is the bottleneck?  I 
don't see any CPU core on any side being maxed out so it can't be it...
The database is MySQL, it runs on a Linux box that connects to the Nexenta 
server through 10GbE using iSCSI.
You're very helpful btw, thanks a lot!Ian                                       
  
_______________________________________________
zfs-discuss mailing list
zfs-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/zfs-discuss

Reply via email to