I've been doing some benchmarking with bonnie++ on the following system.
The following zpools tanks CRASH (*) the system when bonnie++ is run:
1. 2 (stripe) x 3 disk raidz - zpool create -f tank raidz c0t1d0
c0t2d0 c0t3d0 raidz c1t1d0 c1t2d0 c1t3d0
2. 6 disk raidz - zpool create -f tank raidz c0t1d0 c0t2d0 c0t3d0
c1t1d0 c1t2d0 c1t3d0
3. 7 disk raidz - zpool create -f tank raidz c0t1d0 c0t2d0 c0t3d0
c0t4d0 c1t1d0 c1t2d0 c1t3d0
4. 8 disk raidz - zpool create -f tank raidz c0t1d0 c0t2d0 c0t3d0
c0t4d0 c1t1d0 c1t2d0 c1t3d0 c1t4d0
5. 10 disk raid2z
6. 2 (stripe) x 5 disk raidz - zpool create tank raidz c0t1d0 c0t2d0
c0t3d0 c1t1d0 c1t2d0 raidz c0t4d0 c0t5d0 c1t3d0 c1t4d0 c1t5d0
7. 7 disk raidz2 - zpool create tank raidz2 c0t1d0 c0t2d0 c0t3d0
c0t4d0 c1t1d0 c1t2d0 c1t3d0
The following work fine:
1. One disk
2. two disk stripe - zpool create tank c0t1d0 c1t1d0
3. six disk stripe - zpool create tank c0t1d0 c0t2d0 c0t3d0 c1t1d0
c1t2d0 c1t3d0
4. three (stripe) x two disk mirror - zpool create tank mirror c0t1d0
c0t2d0 mirror c0t3d0 c1t1d0 mirror c1t2d0 c1t3d0
5. five (stripe) x two disk mirror - zpool create tank mirror c0t1d0
c0t2d0 mirror c0t3d0 c1t1d0 mirror c1t2d0 c1t3d0 mirror c0t4d0 c1t4d0 mirror
c0t5d0 c1t5d0
6. 5 disk raidz- zpool create -f tank raidz c0t1d0 c0t2d0 c0t3d0
c1t1d0 c1t2d0
7. 6 disk raidz2 - zpool create tank raidz2 c0t1d0 c0t2d0 c0t3d0
c1t1d0 c1t2d0 c1t3d0
(*) When I say crash I mean. With NexentaCore with b69 the system rebooted
and the root zpool was corrupted. With SX:DE b77 the system locked up and
refused to respond to the console - power needed to be cycled to get the
system back. Also with b77 I noticed that during the system lock/crash the
disk lights would be hard on, not flashing. And it seems on the lights on
the first controller. The crash always occurs on the "seq output rewrite"
test.
-bash-3.2# ~nic/bonnie++-1.03a/bonnie++ -u nic
Using uid:101, gid:10.
Writing with putc()...done
Writing intelligently...done
Rewriting...CRASH.
-bash-3.2# uname -a
SunOS sstore 5.11 snv_77 i86pc i386 i86pc
I'm using the following SATA disks with two supermicro SATA2 marvell88sx1
controllers:
AVAILABLE DISK SELECTIONS:
0. c0t0d0 <DEFAULT cyl 30387 alt 2 hd 255 sec 63>
/[EMAIL PROTECTED],0/pci8086,[EMAIL PROTECTED]/pci8086,[EMAIL
PROTECTED]/pci8086,[EMAIL PROTECTED]/pci8086,
[EMAIL PROTECTED]/pci11ab,[EMAIL PROTECTED]/[EMAIL PROTECTED],0
1. c0t1d0 <ATA-ST3500630NS-G-465.76GB>
/[EMAIL PROTECTED],0/pci8086,[EMAIL PROTECTED]/pci8086,[EMAIL
PROTECTED]/pci8086,[EMAIL PROTECTED]/pci8086,
[EMAIL PROTECTED]/pci11ab,[EMAIL PROTECTED]/[EMAIL PROTECTED],0
2. c0t2d0 <ATA-ST3500630NS-G-465.76GB>
/[EMAIL PROTECTED],0/pci8086,[EMAIL PROTECTED]/pci8086,[EMAIL
PROTECTED]/pci8086,[EMAIL PROTECTED]/pci8086,
[EMAIL PROTECTED]/pci11ab,[EMAIL PROTECTED]/[EMAIL PROTECTED],0
3. c0t3d0 <ATA-ST3500630NS-G-465.76GB>
/[EMAIL PROTECTED],0/pci8086,[EMAIL PROTECTED]/pci8086,[EMAIL
PROTECTED]/pci8086,[EMAIL PROTECTED]/pci8086,
[EMAIL PROTECTED]/pci11ab,[EMAIL PROTECTED]/[EMAIL PROTECTED],0
4. c0t4d0 <ATA-ST3500630NS-G-465.76GB>
/[EMAIL PROTECTED],0/pci8086,[EMAIL PROTECTED]/pci8086,[EMAIL
PROTECTED]/pci8086,[EMAIL PROTECTED]/pci8086,
[EMAIL PROTECTED]/pci11ab,[EMAIL PROTECTED]/[EMAIL PROTECTED],0
5. c0t5d0 <ATA-ST3500630NS-G-465.76GB>
/[EMAIL PROTECTED],0/pci8086,[EMAIL PROTECTED]/pci8086,[EMAIL
PROTECTED]/pci8086,[EMAIL PROTECTED]/pci8086,
[EMAIL PROTECTED]/pci11ab,[EMAIL PROTECTED]/[EMAIL PROTECTED],0
6. c1t0d0 <DEFAULT cyl 30398 alt 2 hd 255 sec 63>
/[EMAIL PROTECTED],0/pci8086,[EMAIL PROTECTED]/pci8086,[EMAIL
PROTECTED],3/pci11ab,[EMAIL PROTECTED]/[EMAIL PROTECTED],0
7. c1t1d0 <ATA-ST3500630NS-G-465.76GB>
/[EMAIL PROTECTED],0/pci8086,[EMAIL PROTECTED]/pci8086,[EMAIL
PROTECTED],3/pci11ab,[EMAIL PROTECTED]/[EMAIL PROTECTED],0
8. c1t2d0 <ATA-ST3500630NS-G-465.76GB>
/[EMAIL PROTECTED],0/pci8086,[EMAIL PROTECTED]/pci8086,[EMAIL
PROTECTED],3/pci11ab,[EMAIL PROTECTED]/[EMAIL PROTECTED],0
9. c1t3d0 <ATA-ST3500630NS-G-465.76GB>
/[EMAIL PROTECTED],0/pci8086,[EMAIL PROTECTED]/pci8086,[EMAIL
PROTECTED],3/pci11ab,[EMAIL PROTECTED]/[EMAIL PROTECTED],0
10. c1t4d0 <ATA-ST3500630NS-G-465.76GB>
/[EMAIL PROTECTED],0/pci8086,[EMAIL PROTECTED]/pci8086,[EMAIL
PROTECTED],3/pci11ab,[EMAIL PROTECTED]/[EMAIL PROTECTED],0
11. c1t5d0 <ATA-ST3500630NS-G-465.76GB>
/[EMAIL PROTECTED],0/pci8086,[EMAIL PROTECTED]/pci8086,[EMAIL
PROTECTED],3/pci11ab,[EMAIL PROTECTED]/[EMAIL PROTECTED],0
Nov 22 15:53:46 sstore sata: [ID 349649 kern.info] Supported queue
depth 32
Nov 22 15:53:46 sstore sata: [ID 349649 kern.info] capacity = 976773168
sectors
Nov 22 15:53:46 sstore scsi: [ID 193665 kern.info] sd6 at marvell88sx1:
target 2 lun 0
Nov 22 15:53:46 sstore genunix: [ID 936769 kern.info] sd6 is
/[EMAIL PROTECTED],0/pci8086,[EMAIL PROTECTED]/pci8086,[EMAIL
PROTECTED],3/pci11ab,[EMAIL PROTECTED]/[EMAIL PROTECTED],0
Nov 22 15:53:46 sstore genunix: [ID 408114 kern.info] /[EMAIL
PROTECTED],0/pci8086,
[EMAIL PROTECTED]/pci8086,[EMAIL PROTECTED],3/pci11ab,[EMAIL PROTECTED]/[EMAIL
PROTECTED],0 (sd6) online
Nov 22 15:53:46 sstore sata: [ID 663010 kern.info] /[EMAIL
PROTECTED],0/pci8086,[EMAIL PROTECTED]
/pci8086,[EMAIL PROTECTED],3/pci11ab,[EMAIL PROTECTED] :
Nov 22 15:53:46 sstore sata: [ID 761595 kern.info] SATA disk device at
port 3
Nov 22 15:53:46 sstore sata: [ID 846691 kern.info] model ST3500630NS
Nov 22 15:53:46 sstore sata: [ID 693010 kern.info] firmware 3.AEG
Nov 22 15:53:46 sstore sata: [ID 163988 kern.info] serial
number 5QG0ZVVS
Nov 22 15:53:46 sstore sata: [ID 594940 kern.info] supported features:
Nov 22 15:53:46 sstore sata: [ID 981177 kern.info] 48-bit LBA, DMA,
Native Command Queueing, SMART, SMART self-test
Nov 22 15:53:46 sstore sata: [ID 643337 kern.info] SATA Gen2 signaling
speed (3.0Gbps)
Nov 22 15:53:46 sstore sata: [ID 349649 kern.info] Supported queue
depth 32
Nov 22 15:53:46 sstore sata: [ID 349649 kern.info] capacity = 976773168
sectors
-bash-3.2# /usr/sbin/prtdiag
System Configuration: Supermicro X7DB8
BIOS Configuration: Phoenix Technologies LTD 6.00 01/26/2007
BMC Configuration: IPMI 2.0 (KCS: Keyboard Controller Style)
==== Processor Sockets ====================================
Version Location Tag
-------------------------------- --------------------------
Intel(R) Xeon(R) CPU 5 LGA771/CPU1
Intel(R) Xeon(R) LGA771/CPU2
==== Memory Device Sockets ================================
Type Status Set Device Locator Bank Locator
------- ------ --- ------------------- --------------------
DDR2 in use 1 DIMM x 4 Bank1
DDR2 in use 1 DIMM x 4 Bank2
DDR2 in use 1 DIMM x 4 Bank3
DDR2 in use 1 DIMM x 4 Bank4
==== On-Board Devices =====================================
==== Upgradeable Slots ====================================
ID Status Type Description
--- --------- ---------------- ----------------------------
1 in use PCI-X PCIX#1-100MHz
2 available PCI-X PCIX#2-133MHz
3 in use PCI-X PCIX#3-133MHz
4 available other PCIE#4-x4
5 in use other PCIE#5-x8
6 available other PCIE#6-x8
_______________________________________________
storage-discuss mailing list
[email protected]
http://mail.opensolaris.org/mailman/listinfo/storage-discuss
