Hi, I've got an snv_99 host where the rpool mirror keeps showing checksum errors. I've replaced both drives and it still occurs. It seems to be triggered by sustained I/O on the pool, such as doing a zfs send or reading/writing large amounts of data.
The motherboard is a Tyan S2882 (Thunder K8S Pro), and the rpool disks (2 80GB WD Caviars) are connected to the onboard SiI 3114 SATA ports. The bulk of the system's storage is on 6 1.5TB SATA drives connected to an add-in Supermicro 8-port card, and I have never seen errors on that pool. This leads me to believe it is not a RAM issue (the RAM is also new, from a recent upgrade). Has anyone seen corruption caused by the SiI 3114 controller? The one thing I have yet to try is swapping the SATA cables, but this is a production server, so my maintenance windows are limited. Below is a scanpci output. Any advice would be appreciated. Thanks, Eric # /usr/X11R6/bin/scanpci -v pci bus 0x0000 cardnum 0x06 function 0x00: vendor 0x1022 device 0x7460 Advanced Micro Devices [AMD] AMD-8111 PCI STATUS 0x0230 COMMAND 0x0007 CLASS 0x06 0x04 0x00 REVISION 0x07 HEADER 0x01 LATENCY 0x40 PRIBUS 0x00 SECBUS 0x03 SUBBUS 0x03 SECLT 0x40 SECSTATUS 0x2200 IOBASE 0xa000 IOLIM 0xbfff NOPREFETCH_MEMBASE 0xfc900000 MEMLIM 0xfeafffff PREFETCH_MEMBASE 0xfff00000 MEMLIM 0x000fffff NO_FAST_B2B NO_SEC_BUS_RST NO_M_ABRT VGA_EN NO_ISA_EN SERR_EN NO_PERR_EN pci bus 0x0000 cardnum 0x07 function 0x00: vendor 0x1022 device 0x7468 Advanced Micro Devices [AMD] AMD-8111 LPC STATUS 0x0220 COMMAND 0x000f CLASS 0x06 0x01 0x00 REVISION 0x05 BIST 0x00 HEADER 0x80 LATENCY 0x00 CACHE 0x00 BYTE_0 0x00 BYTE_1 0x30 BYTE_2 0x07 BYTE_3 0x80 pci bus 0x0000 cardnum 0x07 function 0x01: vendor 0x1022 device 0x7469 Advanced Micro Devices [AMD] AMD-8111 IDE STATUS 0x0200 COMMAND 0x0005 CLASS 0x01 0x01 0x8a REVISION 0x03 BIST 0x00 HEADER 0x00 LATENCY 0x20 CACHE 0x00 BASE4 0x0000ffa1 addr 0x0000ffa0 I/O MAX_LAT 0x00 MIN_GNT 0x00 INT_PIN 0x00 INT_LINE 0xff BYTE_0 0x03 BYTE_1 0x50 BYTE_2 0x00 BYTE_3 0x00 pci bus 0x0000 cardnum 0x07 function 0x02: vendor 0x1022 device 0x746a Advanced Micro Devices [AMD] AMD-8111 SMBus 2.0 STATUS 0x0200 COMMAND 0x0001 CLASS 0x0c 0x05 0x00 REVISION 0x02 BIST 0x00 HEADER 0x00 LATENCY 0x40 CACHE 0x00 BASE0 0x0000cc01 addr 0x0000cc00 I/O MAX_LAT 0x00 MIN_GNT 0x00 INT_PIN 0x04 INT_LINE 0x0a BYTE_0 0x02 BYTE_1 0x00 BYTE_2 0x05 BYTE_3 0x0c pci bus 0x0000 cardnum 0x07 function 0x03: vendor 0x1022 device 0x746b Advanced Micro Devices [AMD] AMD-8111 ACPI STATUS 0x0280 COMMAND 0x0000 CLASS 0x06 0x80 0x00 REVISION 0x05 BIST 0x00 HEADER 0x00 LATENCY 0x40 CACHE 0x00 BYTE_0 0x00 BYTE_1 0xb1 BYTE_2 0x09 BYTE_3 0x04 pci bus 0x0000 cardnum 0x0a function 0x00: vendor 0x1022 device 0x7450 Advanced Micro Devices [AMD] AMD-8131 PCI-X Bridge STATUS 0x0230 COMMAND 0x0007 CLASS 0x06 0x04 0x00 REVISION 0x12 HEADER 0x81 LATENCY 0x40 PRIBUS 0x00 SECBUS 0x02 SUBBUS 0x02 SECLT 0x40 SECSTATUS 0x2220 IOBASE 0x00009000 IOLIM 0x00001fff NOPREFETCH_MEMBASE 0xfc800000 MEMLIM 0xfc8fffff PREFETCH_MEMBASE 0x00000000ff500000 MEMLIM 0x00000000ff5fffff NO_FAST_B2B NO_SEC_BUS_RST NO_M_ABRT NO_VGA_EN ISA_EN NO_SERR_EN PERR_EN pci bus 0x0000 cardnum 0x0a function 0x01: vendor 0x1022 device 0x7451 Advanced Micro Devices [AMD] AMD-8131 PCI-X IOAPIC CardVendor 0x1022 card 0x36c0 (Advanced Micro Devices [AMD], Card unknown) STATUS 0x0200 COMMAND 0x0006 CLASS 0x08 0x00 0x10 REVISION 0x01 BIST 0x00 HEADER 0x00 LATENCY 0x00 CACHE 0x00 BASE0 0x00000000febff004 addr 0x00000000febff000 MEM 64BIT pci bus 0x0000 cardnum 0x0b function 0x00: vendor 0x1022 device 0x7450 Advanced Micro Devices [AMD] AMD-8131 PCI-X Bridge STATUS 0x0230 COMMAND 0x0007 CLASS 0x06 0x04 0x00 REVISION 0x12 HEADER 0x81 LATENCY 0x40 PRIBUS 0x00 SECBUS 0x01 SUBBUS 0x01 SECLT 0x40 SECSTATUS 0x2220 IOBASE 0x00009000 IOLIM 0x00009fff NOPREFETCH_MEMBASE 0xfb600000 MEMLIM 0xfc7fffff PREFETCH_MEMBASE 0x00000000ff400000 MEMLIM 0x00000000ff4fffff NO_FAST_B2B NO_SEC_BUS_RST NO_M_ABRT NO_VGA_EN ISA_EN NO_SERR_EN PERR_EN pci bus 0x0000 cardnum 0x0b function 0x01: vendor 0x1022 device 0x7451 Advanced Micro Devices [AMD] AMD-8131 PCI-X IOAPIC CardVendor 0x1022 card 0x36c0 (Advanced Micro Devices [AMD], Card unknown) STATUS 0x0200 COMMAND 0x0006 CLASS 0x08 0x00 0x10 REVISION 0x01 BIST 0x00 HEADER 0x00 LATENCY 0x00 CACHE 0x00 BASE0 0x00000000febfe004 addr 0x00000000febfe000 MEM 64BIT pci bus 0x0000 cardnum 0x18 function 0x00: vendor 0x1022 device 0x1100 Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] HyperTransport Technology Configuration STATUS 0x0010 COMMAND 0x0000 CLASS 0x06 0x00 0x00 REVISION 0x00 BIST 0x00 HEADER 0x80 LATENCY 0x00 CACHE 0x00 BYTE_0 0x01 BYTE_1 0x01 BYTE_2 0x05 BYTE_3 0x00 pci bus 0x0000 cardnum 0x18 function 0x01: vendor 0x1022 device 0x1101 Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] Address Map STATUS 0x0000 COMMAND 0x0000 CLASS 0x06 0x00 0x00 REVISION 0x00 BIST 0x00 HEADER 0x80 LATENCY 0x00 CACHE 0x00 BYTE_0 0x03 BYTE_1 0x00 BYTE_2 0x00 BYTE_3 0x00 pci bus 0x0000 cardnum 0x18 function 0x02: vendor 0x1022 device 0x1102 Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] DRAM Controller STATUS 0x0000 COMMAND 0x0000 CLASS 0x06 0x00 0x00 REVISION 0x00 BIST 0x00 HEADER 0x80 LATENCY 0x00 CACHE 0x00 BYTE_0 0x01 BYTE_1 0x00 BYTE_2 0x00 BYTE_3 0x00 pci bus 0x0000 cardnum 0x18 function 0x03: vendor 0x1022 device 0x1103 Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] Miscellaneous Control STATUS 0x0000 COMMAND 0x0000 CLASS 0x06 0x00 0x00 REVISION 0x00 BIST 0x00 HEADER 0x80 LATENCY 0x00 CACHE 0x00 BYTE_0 0xff BYTE_1 0x1b BYTE_2 0x00 BYTE_3 0x00 pci bus 0x0000 cardnum 0x19 function 0x00: vendor 0x1022 device 0x1100 Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] HyperTransport Technology Configuration STATUS 0x0010 COMMAND 0x0000 CLASS 0x06 0x00 0x00 REVISION 0x00 BIST 0x00 HEADER 0x80 LATENCY 0x00 CACHE 0x00 BYTE_0 0x04 BYTE_1 0x04 BYTE_2 0x01 BYTE_3 0x00 pci bus 0x0000 cardnum 0x19 function 0x01: vendor 0x1022 device 0x1101 Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] Address Map STATUS 0x0000 COMMAND 0x0000 CLASS 0x06 0x00 0x00 REVISION 0x00 BIST 0x00 HEADER 0x80 LATENCY 0x00 CACHE 0x00 BYTE_0 0x03 BYTE_1 0x00 BYTE_2 0x00 BYTE_3 0x00 pci bus 0x0000 cardnum 0x19 function 0x02: vendor 0x1022 device 0x1102 Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] DRAM Controller STATUS 0x0000 COMMAND 0x0000 CLASS 0x06 0x00 0x00 REVISION 0x00 BIST 0x00 HEADER 0x80 LATENCY 0x00 CACHE 0x00 pci bus 0x0000 cardnum 0x19 function 0x03: vendor 0x1022 device 0x1103 Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] Miscellaneous Control STATUS 0x0000 COMMAND 0x0000 CLASS 0x06 0x00 0x00 REVISION 0x00 BIST 0x00 HEADER 0x80 LATENCY 0x00 CACHE 0x00 BYTE_0 0xff BYTE_1 0x1b BYTE_2 0x00 BYTE_3 0x00 pci bus 0x0001 cardnum 0x01 function 0x00: vendor 0x11ab device 0x6081 Marvell Technology Group Ltd. MV88SX6081 8-port SATA II PCI-X Controller CardVendor 0x11ab card 0x11ab (Marvell Technology Group Ltd., Card unknown) STATUS 0x02b0 COMMAND 0x0007 CLASS 0x01 0x00 0x00 REVISION 0x09 BIST 0x00 HEADER 0x00 LATENCY 0x40 CACHE 0x10 BASE0 0x00000000fc700004 addr 0x00000000fc700000 MEM 64BIT BASE2 0x00009801 addr 0x00009800 I/O MAX_LAT 0x00 MIN_GNT 0x00 INT_PIN 0x01 INT_LINE 0x09 BYTE_0 0x01 BYTE_1 0x50 BYTE_2 0x02 BYTE_3 0x00 pci bus 0x0002 cardnum 0x09 function 0x00: vendor 0x14e4 device 0x1648 Broadcom Corporation NetXtreme BCM5704 Gigabit Ethernet CardVendor 0x14e4 card 0x1644 (Broadcom Corporation, Card unknown) STATUS 0x02b0 COMMAND 0x0006 CLASS 0x02 0x00 0x00 REVISION 0x03 BIST 0x00 HEADER 0x80 LATENCY 0x40 CACHE 0x10 BASE0 0x00000000fc8c0004 addr 0x00000000fc8c0000 MEM 64BIT BASE2 0x00000000fc8b0004 addr 0x00000000fc8b0000 MEM 64BIT BASEROM 0xfc8a0000 addr 0xfc8a0000 not-decode-enabled MAX_LAT 0x00 MIN_GNT 0x40 INT_PIN 0x01 INT_LINE 0x05 BYTE_0 0x07 BYTE_1 0x48 BYTE_2 0x00 BYTE_3 0x00 pci bus 0x0002 cardnum 0x09 function 0x01: vendor 0x14e4 device 0x1648 Broadcom Corporation NetXtreme BCM5704 Gigabit Ethernet CardVendor 0x14e4 card 0x1644 (Broadcom Corporation, Card unknown) STATUS 0x02b0 COMMAND 0x0006 CLASS 0x02 0x00 0x00 REVISION 0x03 BIST 0x00 HEADER 0x80 LATENCY 0x40 CACHE 0x10 BASE0 0x00000000fc8f0004 addr 0x00000000fc8f0000 MEM 64BIT BASE2 0x00000000fc8e0004 addr 0x00000000fc8e0000 MEM 64BIT BASEROM 0xfc8d0000 addr 0xfc8d0000 not-decode-enabled MAX_LAT 0x00 MIN_GNT 0x40 INT_PIN 0x02 INT_LINE 0x09 BYTE_0 0x07 BYTE_1 0x48 BYTE_2 0x00 BYTE_3 0x00 pci bus 0x0003 cardnum 0x00 function 0x00: vendor 0x1022 device 0x7464 Advanced Micro Devices [AMD] AMD-8111 USB STATUS 0x0280 COMMAND 0x0007 CLASS 0x0c 0x03 0x10 REVISION 0x0b BIST 0x00 HEADER 0x80 LATENCY 0x40 CACHE 0x00 BASE0 0xfeafc000 addr 0xfeafc000 MEM MAX_LAT 0x50 MIN_GNT 0x00 INT_PIN 0x04 INT_LINE 0x0a pci bus 0x0003 cardnum 0x00 function 0x01: vendor 0x1022 device 0x7464 Advanced Micro Devices [AMD] AMD-8111 USB STATUS 0x0280 COMMAND 0x0007 CLASS 0x0c 0x03 0x10 REVISION 0x0b BIST 0x00 HEADER 0x00 LATENCY 0x40 CACHE 0x00 BASE0 0xfeafd000 addr 0xfeafd000 MEM MAX_LAT 0x50 MIN_GNT 0x00 INT_PIN 0x04 INT_LINE 0x0a pci bus 0x0003 cardnum 0x05 function 0x00: vendor 0x1095 device 0x3114 Silicon Image, Inc. SiI 3114 [SATALink/SATARaid] Serial ATA Controller STATUS 0x02b0 COMMAND 0x0007 CLASS 0x01 0x80 0x00 REVISION 0x02 BIST 0x00 HEADER 0x00 LATENCY 0x40 CACHE 0x10 BASE0 0x0000bc01 addr 0x0000bc00 I/O BASE1 0x0000b401 addr 0x0000b400 I/O BASE2 0x0000b001 addr 0x0000b000 I/O BASE3 0x0000ac01 addr 0x0000ac00 I/O BASE4 0x0000a801 addr 0x0000a800 I/O BASE5 0xfeafec00 addr 0xfeafec00 MEM BASEROM 0xfea00000 addr 0xfea00000 not-decode-enabled MAX_LAT 0x00 MIN_GNT 0x00 INT_PIN 0x01 INT_LINE 0x0a BYTE_0 0x02 BYTE_1 0x00 BYTE_2 0x00 BYTE_3 0x00 pci bus 0x0003 cardnum 0x06 function 0x00: vendor 0x1002 device 0x4752 ATI Technologies Inc Rage XL CardVendor 0x1002 card 0x8008 STATUS 0x0290 COMMAND 0x0087 CLASS 0x03 0x00 0x00 REVISION 0x27 BIST 0x00 HEADER 0x00 LATENCY 0x40 CACHE 0x10 APBASE 0xfd000000 addr 0xfd000000 BLOCKIO 0x0000b801 addr 0x0000b800 REGBASE 0xfeaff000 addr 0xfeaff000 BASEROM 0xfeac0000 addr 0xfeac0000 not-decode-enabled MAX_LAT 0x00 MIN_GNT 0x08 INT_PIN 0x01 INT_LINE 0x0b SPARSEIO 0x2ec Block IO enabled Disable 0x46E8 pci bus 0x0003 cardnum 0x08 function 0x00: vendor 0x8086 device 0x1229 Intel Corporation 82557/8/9/0/1 Ethernet Pro 100 CardVendor 0x8086 card 0x1040 (Intel Corporation EtherExpress PRO/100 S Server Adapter) STATUS 0x0290 COMMAND 0x0017 CLASS 0x02 0x00 0x00 REVISION 0x10 BIST 0x00 HEADER 0x00 LATENCY 0x40 CACHE 0x10 BASE0 0xfeafb000 addr 0xfeafb000 MEM BASE1 0x0000a401 addr 0x0000a400 I/O BASE2 0xfeaa0000 addr 0xfeaa0000 MEM MAX_LAT 0x38 MIN_GNT 0x08 INT_PIN 0x01 INT_LINE 0x0b _______________________________________________ storage-discuss mailing list [email protected] http://mail.opensolaris.org/mailman/listinfo/storage-discuss
