Mark, Shutdown happens cleanly. My pciconf.log is attached. sysctl.conf is empty. Kernel is uncustomized amd64:
FreeBSD herschel.biodesign.asu.edu 9.1-RC3 FreeBSD 9.1-RC3 #0 r242324: Tue Oct 30 00:58:57 UTC 2012 [email protected]:/usr/obj/usr/src/sys/GENERIC amd64 loader.conf: zfs_load="YES" geom_eli_load="YES" ahci_load="YES" vfs.root.mountfrom="zfs:zroot" debug.acpi.max_tasks="128" #vboxdrv_load="YES" kern.maxfiles="65536" kldstat: Id Refs Address Size Name 1 46 0xffffffff80200000 1323388 kernel 2 1 0xffffffff81524000 2084d8 zfs.ko 3 2 0xffffffff8172d000 5c58 opensolaris.ko 4 1 0xffffffff81733000 1f988 geom_eli.ko 5 2 0xffffffff81753000 2b470 crypto.ko 6 2 0xffffffff8177f000 dde0 zlib.ko 7 1 0xffffffff81812000 15c2 fdescfs.ko 8 1 0xffffffff81814000 3dfc linprocfs.ko 9 2 0xffffffff81818000 1f3dc linux.ko 10 1 0xffffffff81838000 a0e linsysfs.ko 11 2 0xffffffff81839000 29f1 vboxnetflt.ko 12 2 0xffffffff8183c000 2c018 vboxdrv.ko 13 2 0xffffffff81869000 87b2 netgraph.ko 14 1 0xffffffff81872000 1579 ng_ether.ko 15 1 0xffffffff81874000 3f8a vboxnetadp.ko 16 1 0xffffffff81878000 ce8a ipfw.ko 17 1 0xffffffff81885000 21d green_saver.ko ZFS Properties: NAME PROPERTY VALUE SOURCE storage mountpoint legacy local storage atime off local storage/home mountpoint /home local storage/jails mountpoint /jails local storage/storage mountpoint /storage local zroot mountpoint legacy local zroot checksum fletcher4 local storage/home xattr off temporary storage/jails xattr off temporary storage/storage xattr off temporary storage/storage/tt xattr off temporary zroot xattr off temporary ZFS Status: pool: storage state: ONLINE scan: scrub repaired 0 in 9h21m with 0 errors on Sat Nov 17 12:23:44 2012 config: NAME STATE READ WRITE CKSUM storage ONLINE 0 0 0 raidz2-0 ONLINE 0 0 0 da0 ONLINE 0 0 0 da1 ONLINE 0 0 0 da2 ONLINE 0 0 0 da3 ONLINE 0 0 0 da4 ONLINE 0 0 0 da5 ONLINE 0 0 0 da6 ONLINE 0 0 0 da7 ONLINE 0 0 0 cache da8 ONLINE 0 0 0 errors: No known data errors pool: zroot state: ONLINE scan: scrub repaired 0 in 0h14m with 0 errors on Sat Nov 17 03:16:09 2012 config: NAME STATE READ WRITE CKSUM zroot ONLINE 0 0 0 mirror-0 ONLINE 0 0 0 da11p2 ONLINE 0 0 0 da10p2 ONLINE 0 0 0 errors: No known data errors On Mon, Nov 26, 2012 at 9:09 PM, Mark Saad <[email protected]> wrote: > > > > On Nov 26, 2012, at 4:01 PM, "Reed A. Cartwright" <[email protected]> wrote: > >> I'm new to this list... >> >> I'm running a bioinformatics server using 9.1-RC3 (64 cores, 512GB >> ram). I have a ZFS raid-z2 array attached to an LSI controller with a >> SSD cache drive. > > Can you tell us more about this server . Can you post the output of pciconf > -lv , > What do you have in loader.conf and sysctl.conf ? Do you se a custom kernel > build; What are the changes you made to that config ? >> >> Since upgrading to 9.1-RC2/3 (for AVX support), I have been >> experiencing hard drive lockups with the message "write failed" >> printed to the console. After this reading from the hard drives no >> longer work, but the machine is not locked up. If the appropriate >> files are in the cache, I can log in and execute programs. I know the >> LSI driver has been updated in 9.1 and I have updated my cards' bios >> to match. It doesn't seem to make a difference. >> >> Once I was able to run top, and saw that many processes were stuck in >> the 'tx->tx' state. > > What does your zfs config look like can you post the output if zpool status ? > What zfz options have you set on pool and filesystens ? > > Lastly In a shutdown -h now , does the system properly shutdown ,does it > crash and dump core ? >> >> So far, no corruption appears to have occurred in the drives. >> >> I'm about to downgrade to 9.0, but I wanted to know if anyone has any >> idea what the issue is. >> >> -- >> Reed A. Cartwright, PhD >> Assistant Professor of Genomics, Evolution, and Bioinformatics >> School of Life Sciences >> Center for Evolutionary Medicine and Informatics >> The Biodesign Institute >> Arizona State University >> _______________________________________________ >> [email protected] mailing list >> http://lists.freebsd.org/mailman/listinfo/freebsd-stable >> To unsubscribe, send any mail to "[email protected]" > > --- > Mark saad | [email protected] > > _______________________________________________ > [email protected] mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "[email protected]" -- Reed A. Cartwright, PhD Assistant Professor of Genomics, Evolution, and Bioinformatics School of Life Sciences Center for Evolutionary Medicine and Informatics The Biodesign Institute Arizona State University
pciconf.log
Description: Binary data
_______________________________________________ [email protected] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "[email protected]"
