Nigel, Thanks for the response! Basically my last method of testing was to sftp a few 50-100MB files to /tank over a couple of minutes and force a scrub after. The very first time this happened, I was using it as a NAS device dumping data to it for over a week. I went to a customer's site to show him how cool zfs was and upon running zpool status, I saw the data corruption status and telling me to restore from a backup. Running zpool status without a scrub shows no errors.
I tried mirrored devices, no raid whatsoever and raidz, all with the same results. All the motherboards I've been using only have PCI since I was hoping I could create a low cost solution as a POC. I'll test changing the transfer mode a bit later. Other people have had better luck, what other debugging can be done? I'm willing to even let someone have remote access to the box if they want. Nigel Smith wrote: > Ok, this is a strange problem! > You seem to have tried & eliminated all the possible issues > that the community has suggested! > > I was hoping you would see some errors logged in > '/var/adm/messages' that would give a clue. > > Your original 'zpool status' said 140 errors. > Over what time period are these occurring? > I'm wondering if the errors are occurring at a > constant steady rate or if there are bursts of error? > Maybe you could monitor zpool status while generating > activity with "dd" or similar. > You could use "zpool iostat <interval>" to monitor > bandwidth and see if it is reasonably steady or erratic. > > >From your "prtconf -D" we see the 3114 card is using > the "ata" driver, as expected. > I believe the driver can talk to the disk drive > in either PIO or DMA mode, so you could try > changing that in the "ata.conf" file. See here for details: > http://docs.sun.com/app/docs/doc/819-2254/ata-7d?a=view > > I've just had a quick look at the source code for > the ata driver, and there does seem to be specific support > for the Silicon Image chips in the drivers: > http://src.opensolaris.org/source/xref/onnv/onnv-gate/usr/src/uts/intel/io/dktp/controller/ata/sil3xxx.c > and > http://src.opensolaris.org/source/xref/onnv/onnv-gate/usr/src/uts/intel/io/dktp/controller/ata/sil3xxx.h > The file "sil3xxx.h" does mention: > "Errata Sil-AN-0109-B2 (Sil3114 Rev 0.3) > To prevent erroneous ERR set for queued DMA transfers > greater then 8k, FIS reception for FIS0cfg needs to be set > to Accept FIS without Interlock" > ..which I read as meaning there have being some 'issues' > with this chip. And it sounds similar to the issue mention on > the link that Tomasz supplied: > http://home-tj.org/wiki/index.php/Sil_m15w > > If you decide to try a different SATA controller card, possible options are: > > 1. The si3124 driver, which supports SiI-3132 (PCI-E) > and SiI-3124 (PCI-X) devices. > > 2. The AHCI driver, which supports the Intel ICH6 and latter devices, often > found on motherboard. > > 4. The NV_SATA driver which supports Nvidia ck804/mcp55 devices. > > Regards > Nigel Smith > > > This message posted from opensolaris.org > _______________________________________________ > zfs-discuss mailing list > zfs-discuss@opensolaris.org > http://mail.opensolaris.org/mailman/listinfo/zfs-discuss > _______________________________________________ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
