zpool can't bring online disk2
Hello! all, I hope someone can help me out with this. Recently disk2 when bad, I have used Zpool offline tank hast/disk2 To bring the disk offline. Then I replaced it. And use the command Zpool online tank hast/disk2 But the disk show REMOVE. [root@san1 /usr/home/jose]# zpool status -v pool: tank state: DEGRADED status: One or more devices has been removed by the administrator. Sufficient replicas exist for the pool to continue functioning in a degraded state. action: Online the device using 'zpool online' or replace the device with 'zpool replace'. scan: resilvered 2.49M in 0h2m with 0 errors on Sat Sep 22 01:03:13 2012 config: NAME STATE READ WRITE CKSUM tank DEGRADED 0 0 0 raidz1-0DEGRADED 0 0 0 hast/disk1ONLINE 0 0 0 11919832608590631234 REMOVED 0 0 0 was /dev/hast/disk2 hast/disk3ONLINE 0 0 0 hast/disk4ONLINE 0 0 0 hast/disk5ONLINE 0 0 0 hast/disk6ONLINE 0 0 0 hast/disk7ONLINE 0 0 0 hast/disk8ONLINE 0 0 0 hast/disk9ONLINE 0 0 0 hast/disk10 ONLINE 0 0 0 [root@san1 /usr/home/jose]# zpool online tank hast/disk2 warning: device 'hast/disk2' onlined, but remains in faulted state use 'zpool replace' to replace devices that are no longer present [root@san1 /usr/home/jose]# I can't bring it back online. Can you guys help me out what to do. This is a production server and I can't afford to bring the server down. I have already swap 3 disks and I got the same result. Thank you guys in advance. --jose ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: zpool can't bring online disk2
On Sun, Sep 23, 2012 at 11:23 AM, Jose A. Lombera j...@lajni.com wrote: Hello! all, I hope someone can help me out with this. Recently disk2 when bad, I have used Zpool offline tank hast/disk2 To bring the disk offline. Then I replaced it. And use the command Zpool online tank hast/disk2 But the disk show REMOVE. [root@san1 /usr/home/jose]# zpool status -v pool: tank state: DEGRADED status: One or more devices has been removed by the administrator. Sufficient replicas exist for the pool to continue functioning in a degraded state. action: Online the device using 'zpool online' or replace the device with 'zpool replace'. scan: resilvered 2.49M in 0h2m with 0 errors on Sat Sep 22 01:03:13 2012 config: NAME STATE READ WRITE CKSUM tank DEGRADED 0 0 0 raidz1-0DEGRADED 0 0 0 hast/disk1ONLINE 0 0 0 11919832608590631234 REMOVED 0 0 0 was /dev/hast/disk2 hast/disk3ONLINE 0 0 0 hast/disk4ONLINE 0 0 0 hast/disk5ONLINE 0 0 0 hast/disk6ONLINE 0 0 0 hast/disk7ONLINE 0 0 0 hast/disk8ONLINE 0 0 0 hast/disk9ONLINE 0 0 0 hast/disk10 ONLINE 0 0 0 [root@san1 /usr/home/jose]# zpool online tank hast/disk2 warning: device 'hast/disk2' onlined, but remains in faulted state use 'zpool replace' to replace devices that are no longer present [root@san1 /usr/home/jose]# I can't bring it back online. Can you guys help me out what to do. This is a production server and I can't afford to bring the server down. I have already swap 3 disks and I got the same result. Thank you guys in advance. You forgot to call zpool replace as the last step in the process of replacing your faulted disk: http://docs.oracle.com/cd/E19253-01/819-5461/gbcet/index.html . Cheers, -Garrett ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
ZFS TRIM support committed to HEAD.
FYI, I just committed TRIM support to ZFS, especially useful for SSD-only pools. This is something I implemented long time ago, but was now motivated to get back to it and commit it finally by some great fixes and improvements from the zfsonlinux project (made by Etienne Dechamps). Note that this functionality is turned off by default for now. To turn it on you need to add vfs.zfs.trim_disable=0 to /boot/loader.conf. You can see some statistics under kstat.zfs.misc.zio_trim sysctl. Big thanks to multiplay.co.uk for sponsoring this work! BTW. If you find this useful, so tell me about it during EuroBSDcon 2012 in a month that will be held this year in Warsaw, Poland: http://eurobsdcon.org :) On Sun, Sep 23, 2012 at 07:40:58PM +, Pawel Jakub Dawidek wrote: Author: pjd Date: Sun Sep 23 19:40:58 2012 New Revision: 240868 URL: http://svn.freebsd.org/changeset/base/240868 Log: Add TRIM support. The code builds a map of regions that were freed. On every write the code consults the map and eventually removes ranges that were freed before, but are now overwritten. Freed blocks are not TRIMed immediately. There is a tunable that defines how many txg we should wait with TRIMming freed blocks (64 by default). There is a low priority thread that TRIMs ranges when the time comes. During TRIM we keep in-flight ranges on a list to detect colliding writes - we have to delay writes that collide with in-flight TRIMs in case something will be reordered and write will reached the disk before the TRIM. We don't have to do the same for in-flight writes, as colliding writes just remove ranges to TRIM. Sponsored by: multiplay.co.uk This work includes some important fixes and some improvements obtained from the zfsonlinux project, including TRIMming entire vdevs on pool create/add/attach and on pool import for spare and cache vdevs. Obtained from: zfsonlinux Submitted by: Etienne Dechamps etienne.decha...@ovh.net -- Pawel Jakub Dawidek http://www.wheelsystems.com FreeBSD committer http://www.FreeBSD.org Am I Evil? Yes, I Am! http://tupytaj.pl pgpuE8lmhRoHn.pgp Description: PGP signature
RE: zpool can't bring online disk2
Yanegomi, I tried that, as you can see below, freebsd doesn’t have cfgadm Utility to un configure the device, according to, http://docs.oracle.com/cd/E19253-01/819-5461/gbcet/index.html, I looked to ports but there is no utility like that. Pardon me, my knowledge is little. Can you please type the command I will need, or if I need cfgadm do I have to look for that and install it in my freebsd box? Thanks. [root@san1 /usr/home/jose]# zpool offline tank hast/disk2 [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# zpool status -x pool: tank state: DEGRADED status: One or more devices has been taken offline by the administrator. Sufficient replicas exist for the pool to continue functioning in a degraded state. action: Online the device using 'zpool online' or replace the device with 'zpool replace'. scan: scrub repaired 0 in 12h4m with 0 errors on Sun Sep 23 19:14:19 2012 config: NAME STATE READ WRITE CKSUM tank DEGRADED 0 0 0 raidz1-0DEGRADED 0 0 0 hast/disk1ONLINE 0 0 0 11919832608590631234 OFFLINE 0 0 0 was /dev/hast/disk2 hast/disk3ONLINE 0 0 0 hast/disk4ONLINE 0 0 0 hast/disk5ONLINE 0 0 0 hast/disk6ONLINE 0 0 0 hast/disk7ONLINE 0 0 0 hast/disk8ONLINE 0 0 0 hast/disk9ONLINE 0 0 0 hast/disk10 ONLINE 0 0 0 errors: No known data errors [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# zpool replace tank hast/disk2 cannot open 'hast/disk2': no such GEOM provider must be a full path or shorthand device name [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# cfgadm bash: cfgadm: command not found [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# zpool offline tank hast/disk2 [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# zpool status -x pool: tank state: DEGRADED status: One or more devices has been taken offline by the administrator. Sufficient replicas exist for the pool to continue functioning in a degraded state. action: Online the device using 'zpool online' or replace the device with 'zpool replace'. scan: scrub repaired 0 in 12h4m with 0 errors on Sun Sep 23 19:14:19 2012 config: NAME STATE READ WRITE CKSUM tank DEGRADED 0 0 0 raidz1-0DEGRADED 0 0 0 hast/disk1ONLINE 0 0 0 11919832608590631234 OFFLINE 0 0 0 was /dev/hast/disk2 hast/disk3ONLINE 0 0 0 hast/disk4ONLINE 0 0 0 hast/disk5ONLINE 0 0 0 hast/disk6ONLINE 0 0 0 hast/disk7ONLINE 0 0 0 hast/disk8ONLINE 0 0 0 hast/disk9ONLINE 0 0 0 hast/disk10 ONLINE 0 0 0 errors: No known data errors [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# zpool online tank hast/disk2 warning: device 'hast/disk2' onlined, but remains in faulted state use 'zpool replace' to replace devices that are no longer present [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# zpool replace tank hast/disk2 cannot open 'hast/disk2': no such GEOM provider must be a full path or shorthand device name [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# From: Garrett Cooper yaneg...@gmail.com Date: September 23, 2012 12:25:52 PM PDT To: Jose A. Lombera j...@lajni.com Cc: freebsd-current@freebsd.org Subject:
Re: ZFS TRIM support committed to HEAD.
Hi, On 23 Sep 2012, at 20:53, Pawel Jakub Dawidek wrote: FYI, I just committed TRIM support to ZFS, especially useful for SSD-only pools. [etc] Is any of this applicable to -STABLE or 8.x? -- Bob Bishop r...@gid.co.uk ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
RE: zpool can't bring online disk2
Yanegomi, I tried that, as you can see below, freebsd doesn’t have cfgadm Utility to un configure the device, according to, http://docs.oracle.com/cd/E19253-01/819-5461/gbcet/index.html, I looked to ports but there is no utility like that. Pardon me, my knowledge is little. Can you please type the command I will need, or if I need cfgadm do I have to look for that and install it in my freebsd box? Thanks. [root@san1 /usr/home/jose]# zpool offline tank hast/disk2 [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# zpool status -x pool: tank state: DEGRADED status: One or more devices has been taken offline by the administrator. Sufficient replicas exist for the pool to continue functioning in a degraded state. action: Online the device using 'zpool online' or replace the device with 'zpool replace'. scan: scrub repaired 0 in 12h4m with 0 errors on Sun Sep 23 19:14:19 2012 config: NAME STATE READ WRITE CKSUM tank DEGRADED 0 0 0 raidz1-0DEGRADED 0 0 0 hast/disk1ONLINE 0 0 0 11919832608590631234 OFFLINE 0 0 0 was /dev/hast/disk2 hast/disk3ONLINE 0 0 0 hast/disk4ONLINE 0 0 0 hast/disk5ONLINE 0 0 0 hast/disk6ONLINE 0 0 0 hast/disk7ONLINE 0 0 0 hast/disk8ONLINE 0 0 0 hast/disk9ONLINE 0 0 0 hast/disk10 ONLINE 0 0 0 errors: No known data errors [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# zpool replace tank hast/disk2 cannot open 'hast/disk2': no such GEOM provider must be a full path or shorthand device name [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# cfgadm bash: cfgadm: command not found [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# zpool offline tank hast/disk2 [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# zpool status -x pool: tank state: DEGRADED status: One or more devices has been taken offline by the administrator. Sufficient replicas exist for the pool to continue functioning in a degraded state. action: Online the device using 'zpool online' or replace the device with 'zpool replace'. scan: scrub repaired 0 in 12h4m with 0 errors on Sun Sep 23 19:14:19 2012 config: NAME STATE READ WRITE CKSUM tank DEGRADED 0 0 0 raidz1-0DEGRADED 0 0 0 hast/disk1ONLINE 0 0 0 11919832608590631234 OFFLINE 0 0 0 was /dev/hast/disk2 hast/disk3ONLINE 0 0 0 hast/disk4ONLINE 0 0 0 hast/disk5ONLINE 0 0 0 hast/disk6ONLINE 0 0 0 hast/disk7ONLINE 0 0 0 hast/disk8ONLINE 0 0 0 hast/disk9ONLINE 0 0 0 hast/disk10 ONLINE 0 0 0 errors: No known data errors [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# zpool online tank hast/disk2 warning: device 'hast/disk2' onlined, but remains in faulted state use 'zpool replace' to replace devices that are no longer present [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# zpool replace tank hast/disk2 cannot open 'hast/disk2': no such GEOM provider must be a full path or shorthand device name [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# From: Garrett Cooper yaneg...@gmail.com Date: September 23, 2012 12:25:52 PM PDT To: Jose A. Lombera j...@lajni.com Cc: freebsd-current@freebsd.org Subject: Re:
Re: zpool can't bring online disk2
On Sun, Sep 23, 2012 at 1:42 PM, Jose A. Lombera j...@lajni.com wrote: I tried that, as you can see below, freebsd doesn’t have cfgadm Utility to un configure the device, according to, http://docs.oracle.com/cd/E19253-01/819-5461/gbcet/index.html, I looked to ports but there is no utility like that. Pardon me, my knowledge is little. Can you please type the command I will need, or if I need cfgadm do I have to look for that and install it in my freebsd box? The docs were written for Solaris, so I definitely don't expect them to work verbatim on FreeBSD. The process is: zpool offline pool old-drive/partition zpool online pool new-drive/partition zpool replace pool old-drive/partition new-drive/partition The missing command was also noted in the first email you sent out. Thanks, -Garrett ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: ZFS TRIM support committed to HEAD.
On Sun, Sep 23, 2012 at 10:24:53PM +0100, Bob Bishop wrote: Hi, On 23 Sep 2012, at 20:53, Pawel Jakub Dawidek wrote: FYI, I just committed TRIM support to ZFS, especially useful for SSD-only pools. [etc] Is any of this applicable to -STABLE or 8.x? I have a patch against stable/8, but not stable/9: http://people.freebsd.org/~pjd/patches/zfstrim8.patch -- Pawel Jakub Dawidek http://www.wheelsystems.com FreeBSD committer http://www.FreeBSD.org Am I Evil? Yes, I Am! http://tupytaj.pl pgpO35odYgQfi.pgp Description: PGP signature
Re: ZFS TRIM support committed to HEAD.
On Mon, Sep 24, 2012 at 1:25 AM, Pawel Jakub Dawidek p...@freebsd.org wrote: On Sun, Sep 23, 2012 at 10:24:53PM +0100, Bob Bishop wrote: Hi, On 23 Sep 2012, at 20:53, Pawel Jakub Dawidek wrote: FYI, I just committed TRIM support to ZFS, especially useful for SSD-only pools. [etc] Is any of this applicable to -STABLE or 8.x? I have a patch against stable/8, but not stable/9: http://people.freebsd.org/~pjd/patches/zfstrim8.patch -- Pawel Jakub Dawidek http://www.wheelsystems.com FreeBSD committer http://www.FreeBSD.org Am I Evil? Yes, I Am! http://tupytaj.pl This sounds great. I guess we will have to wait for MFC, probably after 9.1-RELEASE, right? -- George Kontostanos --- http://www.aisecure.net ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: ZFS TRIM support committed to HEAD.
Hi Pawel, On Sun, Sep 23, 2012 at 09:53:58PM +0200, Pawel Jakub Dawidek wrote: FYI, I just committed TRIM support to ZFS, especially useful for SSD-only pools. This is something I implemented long time ago, but was now motivated to get back to it and commit it finally by some great fixes and improvements from the zfsonlinux project (made by Etienne Dechamps). Great! Thanks for this. Any chance you can document the following sysctls? root@kaos:/root # sysctl -d kstat.zfs.misc.zio_trim kstat.zfs.misc.zio_trim: kstat.zfs.misc.zio_trim.zio_trim_bytes: kstat.zfs.misc.zio_trim.zio_trim_success: kstat.zfs.misc.zio_trim.zio_trim_unsupported: kstat.zfs.misc.zio_trim.zio_trim_failed: Glen pgpfdHRXEsG3t.pgp Description: PGP signature
Re: ZFS TRIM support committed to HEAD.
Is this making it TRIM aware globally -- even on your cache and log devices? ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
RE: zpool can't bring online disk2
Since it's a HAST device, you have to initialise the disk via hastctl. Once that is done, the /dev/hast/disk2 GEOM device node will be created. Then you can 'zpool replace' it. One step at a time. :) And you've skipped a few. 1. 'zpool offline' the defective disk 2. Physically remove the defective disk 3. Physically insert the new disk 4. Initialise it as a HAST resource via 'hastctl' 5. 'zpool replace' it using the /dev/hast node 6. Wait for the pool (and HAST) to resilver it 7. Carry on as per normal On Sep 23, 2012 2:28 PM, compufutura -the computer of the future j...@compufutura.com wrote: Yanegomi, I tried that, as you can see below, freebsd doesn’t have cfgadm Utility to un configure the device, according to, http://docs.oracle.com/cd/E19253-01/819-5461/gbcet/index.html, I looked to ports but there is no utility like that. Pardon me, my knowledge is little. Can you please type the command I will need, or if I need cfgadm do I have to look for that and install it in my freebsd box? Thanks. [root@san1 /usr/home/jose]# zpool offline tank hast/disk2 [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# zpool status -x pool: tank state: DEGRADED status: One or more devices has been taken offline by the administrator. Sufficient replicas exist for the pool to continue functioning in a degraded state. action: Online the device using 'zpool online' or replace the device with 'zpool replace'. scan: scrub repaired 0 in 12h4m with 0 errors on Sun Sep 23 19:14:19 2012 config: NAME STATE READ WRITE CKSUM tank DEGRADED 0 0 0 raidz1-0DEGRADED 0 0 0 hast/disk1ONLINE 0 0 0 11919832608590631234 OFFLINE 0 0 0 was /dev/hast/disk2 hast/disk3ONLINE 0 0 0 hast/disk4ONLINE 0 0 0 hast/disk5ONLINE 0 0 0 hast/disk6ONLINE 0 0 0 hast/disk7ONLINE 0 0 0 hast/disk8ONLINE 0 0 0 hast/disk9ONLINE 0 0 0 hast/disk10 ONLINE 0 0 0 errors: No known data errors [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# zpool replace tank hast/disk2 cannot open 'hast/disk2': no such GEOM provider must be a full path or shorthand device name [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# cfgadm bash: cfgadm: command not found [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# zpool offline tank hast/disk2 [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# zpool status -x pool: tank state: DEGRADED status: One or more devices has been taken offline by the administrator. Sufficient replicas exist for the pool to continue functioning in a degraded state. action: Online the device using 'zpool online' or replace the device with 'zpool replace'. scan: scrub repaired 0 in 12h4m with 0 errors on Sun Sep 23 19:14:19 2012 config: NAME STATE READ WRITE CKSUM tank DEGRADED 0 0 0 raidz1-0DEGRADED 0 0 0 hast/disk1ONLINE 0 0 0 11919832608590631234 OFFLINE 0 0 0 was /dev/hast/disk2 hast/disk3ONLINE 0 0 0 hast/disk4ONLINE 0 0 0 hast/disk5ONLINE 0 0 0 hast/disk6ONLINE 0 0 0 hast/disk7ONLINE 0 0 0 hast/disk8ONLINE 0 0 0 hast/disk9ONLINE 0 0 0 hast/disk10 ONLINE 0 0 0 errors: No known data errors
Re: Call for bge(4) testers
On Fri, Sep 21, 2012 at 08:34:29PM +0900, Wanpeng Qian wrote: On Thu, Sep 20, 2012 at 06:56:09AM +0900, Wanpeng Qian wrote: Hi, On Mon, Sep 17, 2012 at 09:37:21PM +0900, Wanpeng Qian wrote: Hi, here is the dmesg output. bge0: HP NC107i PCIe Gigabit Server Adapter, ASIC rev. 0x5784100 mem 0xfe9f-0xfe9f irq 18 at device 0.0 on pci4 bge0: CHIP ID 0x05784100; ASIC REV 0x5784; CHIP REV 0x57841; PCI-E miibus0: MII bus on bge0 brgphy0: BCM5784 10/100/1000baseT PHY PHY 1 on miibus0 brgphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto, auto-flow It seems your controller is BCM5784 A1. The latest WIP have one change that may affect its DMA behavior. So it would be good to know how the WIP version works on your box. I update my system to 9-STABLE and using your WIP files. after I reboot the whole system. I cannot find bge anymore. here is the pciconf -lv output. none1@pci0:4:0:0: class=0x02 card=0x705d103c chip=0x165b14e4 rev=0x10 hdr=0x00 vendor = 'Broadcom Corporation' device = 'NetXtreme BCM5723 Gigabit Ethernet PCIe' class = network subclass = ethernet Hmm, the WIP version didn't remove the chip id so bge(4) may have failed to attach. Could you check any message printed by bge(4) in dmesg output? There is neither message related to bge in the dmesg output. nor ifconfig -a output. anything else I can try ? Does stock bge(4) in latest stable/9 recognize your controller? If the answer is yes, would you post full verbose boot message? ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
RE: zpool can't bring online disk2
Freddie, Thanks for your great help, now makes so much sense. I still have a small problem, and I'm not sure if it is because hastd is running. I can't initialize (hastctl create disk2) disk2 This is what I did. 1.. zpool offline tank /dev/dsk/hast/disk2 2. zpool status -x [root@san /usr/home/jose]# zpool status -x pool: tank state: DEGRADED status: One or more devices has been taken offline by the administrator. Sufficient replicas exist for the pool to continue functioning in a degraded state. action: Online the device using 'zpool online' or replace the device with 'zpool replace'. scan: scrub repaired 0 in 12h4m with 0 errors on Sun Sep 23 19:14:19 2012 config: NAME STATE READ WRITE CKSUM tank DEGRADED 0 0 0 raidz1-0DEGRADED 0 0 0 hast/disk1ONLINE 0 0 0 11919832608590631234 OFFLINE 0 0 0 was /dev/dsk/hast/disk2 hast/disk3ONLINE 0 0 0 hast/disk4ONLINE 0 0 0 hast/disk5ONLINE 0 0 0 hast/disk6ONLINE 0 0 0 hast/disk7ONLINE 0 0 0 hast/disk8ONLINE 0 0 0 hast/disk9ONLINE 0 0 0 hast/disk10 ONLINE 0 0 0 errors: No known data errors 3. removed disk / insert a new one. 4. initialize Hastctl role init disk2 [root@san /usr/home/jose]# hastctl status disk2 disk2: role: init provname: disk2 localpath: /dev/mfid2 extentsize: 0 (0B) keepdirty: 0 remoteaddr: san1 replication: fullsync dirty: 0 (0B) statistics: reads: 0 writes: 0 deletes: 0 flushes: 0 activemap updates: 0 [root@san /usr/home/jose]# [root@san /usr/home/jose]# [root@san /usr/home/jose]# hastctl create disk2 [ERROR] [disk2] Unable to write metadata: Input/output error. I don't want to stop hastd since it will shut down the connection to my san. Do you have any suggestion? Thanks --jose -Original Message- From: owner-freebsd-curr...@freebsd.org [mailto:owner-freebsd-curr...@freebsd.org] On Behalf Of Freddie Cash Sent: Sunday, September 23, 2012 6:30 PM To: compufutura -the computer of the future Cc: yaneg...@gmail.com; freebsd-current@freebsd.org Subject: RE: zpool can't bring online disk2 Since it's a HAST device, you have to initialise the disk via hastctl. Once that is done, the /dev/hast/disk2 GEOM device node will be created. Then you can 'zpool replace' it. One step at a time. :) And you've skipped a few. 1. 'zpool offline' the defective disk 2. Physically remove the defective disk 3. Physically insert the new disk 4. Initialise it as a HAST resource via 'hastctl' 5. 'zpool replace' it using the /dev/hast node 6. Wait for the pool (and HAST) to resilver it 7. Carry on as per normal On Sep 23, 2012 2:28 PM, compufutura -the computer of the future mailto:j...@compufutura.com j...@compufutura.com wrote: Yanegomi, I tried that, as you can see below, freebsd doesn’t have cfgadm Utility to un configure the device, according to, http://docs.oracle.com/cd/E19253-01/819-5461/gbcet/index.html http://docs.oracle.com/cd/E19253-01/819-5461/gbcet/index.html, I looked to ports but there is no utility like that. Pardon me, my knowledge is little. Can you please type the command I will need, or if I need cfgadm do I have to look for that and install it in my freebsd box? Thanks. [root@san1 /usr/home/jose]# zpool offline tank hast/disk2 [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# zpool status -x pool: tank state: DEGRADED status: One or more devices has been taken offline by the administrator. Sufficient replicas exist for the pool to continue functioning in a degraded state. action: Online the device using 'zpool online' or replace the device with 'zpool replace'. scan: scrub repaired 0 in 12h4m with 0 errors on Sun Sep 23 19:14:19 2012 config: NAME STATE READ WRITE CKSUM tank DEGRADED 0 0 0 raidz1-0DEGRADED 0 0 0 hast/disk1ONLINE 0 0 0 11919832608590631234 OFFLINE 0 0 0 was /dev/hast/disk2 hast/disk3ONLINE 0 0 0 hast/disk4ONLINE 0 0 0 hast/disk5ONLINE
Re: ZFS TRIM support committed to HEAD.
2012/9/24 Pawel Jakub Dawidek p...@freebsd.org FYI, I just committed TRIM support to ZFS, especially useful for SSD-only pools. This is something I implemented long time ago, but was now motivated to get back to it and commit it finally by some great fixes and improvements from the zfsonlinux project (made by Etienne Dechamps). Thank you so much to bring it up to us. -- Marcelo Araujo ara...@freebsd.org ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
RE: zpool can't bring online disk2
Sorry, can't help beyond that. I haven't played with HAST since it first hit the tree (back in 7-stable?). On Sep 23, 2012 8:10 PM, Jose A. Lombera j...@lajni.com wrote: Freddie, ** ** Thanks for your great help, now makes so much sense. I still have a small problem, and I'm not sure if it is because hastd is running. I can't initialize (hastctl create disk2) disk2 ** ** This is what I did. ** ** 1.. zpool offline tank /dev/dsk/hast/disk2 2. zpool status -x [root@san /usr/home/jose]# zpool status -x pool: tank state: DEGRADED status: One or more devices has been taken offline by the administrator.** ** Sufficient replicas exist for the pool to continue functioning in a degraded state. action: Online the device using 'zpool online' or replace the device with* *** 'zpool replace'. scan: scrub repaired 0 in 12h4m with 0 errors on Sun Sep 23 19:14:19 2012* *** config: ** ** NAME STATE READ WRITE CKSUM tank DEGRADED 0 0 0 raidz1-0DEGRADED 0 0 0 hast/disk1ONLINE 0 0 0 11919832608590631234 OFFLINE 0 0 0 was /dev/dsk/hast/disk2 hast/disk3ONLINE 0 0 0 hast/disk4ONLINE 0 0 0 hast/disk5ONLINE 0 0 0 hast/disk6ONLINE 0 0 0 hast/disk7ONLINE 0 0 0 hast/disk8ONLINE 0 0 0 hast/disk9ONLINE 0 0 0 hast/disk10 ONLINE 0 0 0 ** ** errors: No known data errors ** ** 3. removed disk / insert a new one. 4. initialize Hastctl role init disk2 [root@san /usr/home/jose]# hastctl status disk2 disk2: role: init provname: disk2 localpath: /dev/mfid2 extentsize: 0 (0B) keepdirty: 0 remoteaddr: san1 replication: fullsync dirty: 0 (0B) statistics: reads: 0 writes: 0 deletes: 0 flushes: 0 activemap updates: 0 [root@san /usr/home/jose]# [root@san /usr/home/jose]# [root@san /usr/home/jose]# hastctl create disk2 [ERROR] [disk2] Unable to write metadata: Input/output error. ** ** ** ** ** ** I don't want to stop hastd since it will shut down the connection to my san. ** ** Do you have any suggestion? ** ** Thanks ** ** ** ** --jose ** ** ** ** -Original Message- From: owner-freebsd-curr...@freebsd.org [mailto: owner-freebsd-curr...@freebsd.org] On Behalf Of Freddie Cash Sent: Sunday, September 23, 2012 6:30 PM To: compufutura -the computer of the future Cc: yaneg...@gmail.com; freebsd-current@freebsd.org Subject: RE: zpool can't bring online disk2 ** ** Since it's a HAST device, you have to initialise the disk via hastctl. Once that is done, the /dev/hast/disk2 GEOM device node will be created.** ** ** ** Then you can 'zpool replace' it. ** ** One step at a time. :) And you've skipped a few. ** ** 1. 'zpool offline' the defective disk 2. Physically remove the defective disk 3. Physically insert the new disk 4. Initialise it as a HAST resource via 'hastctl' 5. 'zpool replace' it using the /dev/hast node 6. Wait for the pool (and HAST) to resilver it 7. Carry on as per normal On Sep 23, 2012 2:28 PM, compufutura -the computer of the future j...@compufutura.com wrote:** ** ** ** Yanegomi, ** ** ** ** ** ** I tried that, as you can see below, freebsd doesn’t have cfgadm ** ** Utility to un configure the device, according to, http://docs.oracle.com/cd/E19253-01/819-5461/gbcet/index.html, I looked to ports but there is no utility like that. ** ** ** ** ** ** Pardon me, my knowledge is little. ** ** ** ** ** ** Can you please type the command I will need, or if I need cfgadm do I ** ** have to look for that and install it in my freebsd box? ** ** ** ** ** ** Thanks. ** ** ** ** ** ** ** ** ** ** [root@san1 /usr/home/jose]# zpool offline tank hast/disk2 ** ** [root@san1 /usr/home/jose]# ** ** [root@san1 /usr/home/jose]# ** ** [root@san1 /usr/home/jose]# zpool status -x ** ** pool: tank ** ** state: DEGRADED ** ** status: One or more devices has been taken offline by the administrator. ** ** Sufficient replicas exist for the pool to continue functioning * *** in a ** ** degraded
RE: zpool can't bring online disk2 ----I screwed up
Please, some one help me….!!! I screw up big time. I was doing the Hastctl create disk2 But since I got some input out errors I decided to stop /etc/rc.d/hastd stop But since couldn’t stop disk1 and 9 I killed it. Restarted both servers. And now only /dev/hast shows nothing. And the pool is lost. I was able to create disk2. I have restarted both server but the pool is not coming up. Any suggestions, please help I know that the info is there since I only did “hastctl create disk2” I haven’t done it for the other disks. From: Jose A. Lombera [mailto:j...@lajni.com] Sent: Sunday, September 23, 2012 8:10 PM To: 'Freddie Cash' Cc: freebsd-current@freebsd.org Subject: RE: zpool can't bring online disk2 Freddie, Thanks for your great help, now makes so much sense. I still have a small problem, and I'm not sure if it is because hastd is running. I can't initialize (hastctl create disk2) disk2 This is what I did. 1.. zpool offline tank /dev/dsk/hast/disk2 2. zpool status -x [root@san /usr/home/jose]# zpool status -x pool: tank state: DEGRADED status: One or more devices has been taken offline by the administrator. Sufficient replicas exist for the pool to continue functioning in a degraded state. action: Online the device using 'zpool online' or replace the device with 'zpool replace'. scan: scrub repaired 0 in 12h4m with 0 errors on Sun Sep 23 19:14:19 2012 config: NAME STATE READ WRITE CKSUM tank DEGRADED 0 0 0 raidz1-0DEGRADED 0 0 0 hast/disk1ONLINE 0 0 0 11919832608590631234 OFFLINE 0 0 0 was /dev/dsk/hast/disk2 hast/disk3ONLINE 0 0 0 hast/disk4ONLINE 0 0 0 hast/disk5ONLINE 0 0 0 hast/disk6ONLINE 0 0 0 hast/disk7ONLINE 0 0 0 hast/disk8ONLINE 0 0 0 hast/disk9ONLINE 0 0 0 hast/disk10 ONLINE 0 0 0 errors: No known data errors 3. removed disk / insert a new one. 4. initialize Hastctl role init disk2 [root@san /usr/home/jose]# hastctl status disk2 disk2: role: init provname: disk2 localpath: /dev/mfid2 extentsize: 0 (0B) keepdirty: 0 remoteaddr: san1 replication: fullsync dirty: 0 (0B) statistics: reads: 0 writes: 0 deletes: 0 flushes: 0 activemap updates: 0 [root@san /usr/home/jose]# [root@san /usr/home/jose]# [root@san /usr/home/jose]# hastctl create disk2 [ERROR] [disk2] Unable to write metadata: Input/output error. I don't want to stop hastd since it will shut down the connection to my san. Do you have any suggestion? Thanks --jose -Original Message- From: owner-freebsd-curr...@freebsd.org [mailto:owner-freebsd-curr...@freebsd.org] On Behalf Of Freddie Cash Sent: Sunday, September 23, 2012 6:30 PM To: compufutura -the computer of the future Cc: yaneg...@gmail.com; freebsd-current@freebsd.org Subject: RE: zpool can't bring online disk2 Since it's a HAST device, you have to initialise the disk via hastctl. Once that is done, the /dev/hast/disk2 GEOM device node will be created. Then you can 'zpool replace' it. One step at a time. :) And you've skipped a few. 1. 'zpool offline' the defective disk 2. Physically remove the defective disk 3. Physically insert the new disk 4. Initialise it as a HAST resource via 'hastctl' 5. 'zpool replace' it using the /dev/hast node 6. Wait for the pool (and HAST) to resilver it 7. Carry on as per normal On Sep 23, 2012 2:28 PM, compufutura -the computer of the future mailto:j...@compufutura.com j...@compufutura.com wrote: Yanegomi, I tried that, as you can see below, freebsd doesn’t have cfgadm Utility to un configure the device, according to, http://docs.oracle.com/cd/E19253-01/819-5461/gbcet/index.html http://docs.oracle.com/cd/E19253-01/819-5461/gbcet/index.html, I looked to ports but there is no utility like that. Pardon me, my knowledge is little. Can you please type the command I will need, or if I need cfgadm do I have to look for that and install it in my freebsd box? Thanks. [root@san1 /usr/home/jose]# zpool offline tank hast/disk2 [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# [root@san1 /usr/home/jose]# zpool status -x pool: tank state: DEGRADED status: One or more devices has been taken offline by the administrator. Sufficient replicas exist for the pool to continue functioning in a
RE: zpool can't bring online disk2 ----I screwed up
Everytime I run this for any of the disk 3,4,5,6,7,8,9,10 Disk 1,2 shows in the /dev/hast [root@san2 /usr/home/jose]# hastctl role primary disk3 [root@san2 /usr/home/jose]# I got this in the logs. Sep 23 21:58:13 san2 hastd[2793]: [disk3] (primary) Provider /dev/mfid3 is not part of resource disk3. Please help. Thanks. From: Jose A. Lombera [mailto:j...@lajni.com] Sent: Sunday, September 23, 2012 9:46 PM To: 'Freddie Cash' Cc: freebsd-current@freebsd.org Subject: RE: zpool can't bring online disk2 I screwed up Please, some one help me….!!! I screw up big time. I was doing the Hastctl create disk2 But since I got some input out errors I decided to stop /etc/rc.d/hastd stop But since couldn’t stop disk1 and 9 I killed it. Restarted both servers. And now only /dev/hast shows nothing. And the pool is lost. I was able to create disk2. I have restarted both server but the pool is not coming up. Any suggestions, please help I know that the info is there since I only did “hastctl create disk2” I haven’t done it for the other disks. From: Jose A. Lombera [mailto:j...@lajni.com] Sent: Sunday, September 23, 2012 8:10 PM To: 'Freddie Cash' Cc: freebsd-current@freebsd.org Subject: RE: zpool can't bring online disk2 Freddie, Thanks for your great help, now makes so much sense. I still have a small problem, and I'm not sure if it is because hastd is running. I can't initialize (hastctl create disk2) disk2 This is what I did. 1.. zpool offline tank /dev/dsk/hast/disk2 2. zpool status -x [root@san /usr/home/jose]# zpool status -x pool: tank state: DEGRADED status: One or more devices has been taken offline by the administrator. Sufficient replicas exist for the pool to continue functioning in a degraded state. action: Online the device using 'zpool online' or replace the device with 'zpool replace'. scan: scrub repaired 0 in 12h4m with 0 errors on Sun Sep 23 19:14:19 2012 config: NAME STATE READ WRITE CKSUM tank DEGRADED 0 0 0 raidz1-0DEGRADED 0 0 0 hast/disk1ONLINE 0 0 0 11919832608590631234 OFFLINE 0 0 0 was /dev/dsk/hast/disk2 hast/disk3ONLINE 0 0 0 hast/disk4ONLINE 0 0 0 hast/disk5ONLINE 0 0 0 hast/disk6ONLINE 0 0 0 hast/disk7ONLINE 0 0 0 hast/disk8ONLINE 0 0 0 hast/disk9ONLINE 0 0 0 hast/disk10 ONLINE 0 0 0 errors: No known data errors 3. removed disk / insert a new one. 4. initialize Hastctl role init disk2 [root@san /usr/home/jose]# hastctl status disk2 disk2: role: init provname: disk2 localpath: /dev/mfid2 extentsize: 0 (0B) keepdirty: 0 remoteaddr: san1 replication: fullsync dirty: 0 (0B) statistics: reads: 0 writes: 0 deletes: 0 flushes: 0 activemap updates: 0 [root@san /usr/home/jose]# [root@san /usr/home/jose]# [root@san /usr/home/jose]# hastctl create disk2 [ERROR] [disk2] Unable to write metadata: Input/output error. I don't want to stop hastd since it will shut down the connection to my san. Do you have any suggestion? Thanks --jose -Original Message- From: owner-freebsd-curr...@freebsd.org [mailto:owner-freebsd-curr...@freebsd.org] On Behalf Of Freddie Cash Sent: Sunday, September 23, 2012 6:30 PM To: compufutura -the computer of the future Cc: yaneg...@gmail.com; freebsd-current@freebsd.org Subject: RE: zpool can't bring online disk2 Since it's a HAST device, you have to initialise the disk via hastctl. Once that is done, the /dev/hast/disk2 GEOM device node will be created. Then you can 'zpool replace' it. One step at a time. :) And you've skipped a few. 1. 'zpool offline' the defective disk 2. Physically remove the defective disk 3. Physically insert the new disk 4. Initialise it as a HAST resource via 'hastctl' 5. 'zpool replace' it using the /dev/hast node 6. Wait for the pool (and HAST) to resilver it 7. Carry on as per normal On Sep 23, 2012 2:28 PM, compufutura -the computer of the future mailto:j...@compufutura.com j...@compufutura.com wrote: Yanegomi, I tried that, as you can see below, freebsd doesn’t have cfgadm Utility to un configure the device, according to, http://docs.oracle.com/cd/E19253-01/819-5461/gbcet/index.html http://docs.oracle.com/cd/E19253-01/819-5461/gbcet/index.html, I looked to ports but there is no utility like that. Pardon me, my knowledge is
RE: zpool can't bring online disk2 ----I screwed up
This is the error I got when I run the failover script. Sep 24 06:43:39 san1 hastd[3404]: [disk3] (primary) Provider /dev/mfid3 is not part of resource disk3. Sep 24 06:43:39 san1 hastd[3343]: [disk3] (primary) Worker process exited ungracefully (pid=3404, exitcode=66). Sep 24 06:43:39 san1 hastd[3413]: [disk6] (primary) Provider /dev/mfid6 is not part of resource disk6. Sep 24 06:43:39 san1 hastd[3343]: [disk6] (primary) Worker process exited ungracefully (pid=3413, exitcode=66). Sep 24 06:43:39 san1 hastd[3425]: [disk10] (primary) Unable to open /dev/mfid10: No such file or directory. Sep 24 06:43:39 san1 hastd[3407]: [disk4] (primary) Provider /dev/mfid4 is not part of resource disk4. Sep 24 06:43:39 san1 hastd[3343]: [disk10] (primary) Worker process exited ungracefully (pid=3425, exitcode=66). Sep 24 06:43:39 san1 hastd[3410]: [disk5] (primary) Provider /dev/mfid5 is not part of resource disk5. Sep 24 06:43:39 san1 hastd[3343]: [disk4] (primary) Worker process exited ungracefully (pid=3407, exitcode=66). Sep 24 06:43:39 san1 hastd[3416]: [disk7] (primary) Provider /dev/mfid7 is not part of resource disk7. Sep 24 06:43:39 san1 hastd[3422]: [disk9] (primary) Provider /dev/mfid9 is not part of resource disk9. Sep 24 06:43:39 san1 hastd[3419]: [disk8] (primary) Provider /dev/mfid8 is not part of resource disk8. Sep 24 06:43:39 san1 hastd[3343]: [disk5] (primary) Worker process exited ungracefully (pid=3410, exitcode=66). Sep 24 06:43:40 san1 hastd[3343]: [disk9] (primary) Worker process exited ungracefully (pid=3422, exitcode=66). Sep 24 06:43:40 san1 hastd[3343]: [disk8] (primary) Worker process exited ungracefully (pid=3419, exitcode=66). Sep 24 06:43:40 san1 hastd[3343]: [disk7] (primary) Worker process exited ungracefully (pid=3416, exitcode=66). Sep 24 06:43:40 san1 hastd[3351]: [disk2] (primary) Resource unique ID mismatch (primary=2635341666474957411, secondary=5944493181984227803). Sep 24 06:43:45 san1 hastd[3348]: [disk1] (primary) Split-brain condition! Sep 24 06:43:50 san1 hastd[3351]: [disk2] (primary) Resource unique ID mismatch (primary=2635341666474957411, secondary=5944493181984227803). Sep 24 06:43:55 san1 hastd[3348]: [disk1] (primary) Split-brain condition! Sep 24 06:44:00 san1 hastd[3351]: [disk2] (primary) Resource unique ID mismatch (primary=2635341666474957411, secondary=5944493181984227803). Sep 24 06:44:05 san1 hastd[3348]: [disk1] (primary) Split-brain condition! Sep 24 06:44:10 san1 hastd[3351]: [disk2] (primary) Resource unique ID mismatch (primary=2635341666474957411, secondary=5944493181984227803) Is there any patch I need to run to fix this issue? From: Jose A. Lombera [mailto:j...@lajni.com] Sent: Sunday, September 23, 2012 10:00 PM To: freebsd-current@freebsd.org Cc: freebsd-current@freebsd.org Subject: RE: zpool can't bring online disk2 I screwed up Everytime I run this for any of the disk 3,4,5,6,7,8,9,10 Disk 1,2 shows in the /dev/hast [root@san2 /usr/home/jose]# hastctl role primary disk3 [root@san2 /usr/home/jose]# I got this in the logs. Sep 23 21:58:13 san2 hastd[2793]: [disk3] (primary) Provider /dev/mfid3 is not part of resource disk3. Please help. Thanks. From: Jose A. Lombera [mailto:j...@lajni.com] Sent: Sunday, September 23, 2012 9:46 PM To: 'Freddie Cash' Cc: freebsd-current@freebsd.org Subject: RE: zpool can't bring online disk2 I screwed up Please, some one help me….!!! I screw up big time. I was doing the Hastctl create disk2 But since I got some input out errors I decided to stop /etc/rc.d/hastd stop But since couldn’t stop disk1 and 9 I killed it. Restarted both servers. And now only /dev/hast shows nothing. And the pool is lost. I was able to create disk2. I have restarted both server but the pool is not coming up. Any suggestions, please help I know that the info is there since I only did “hastctl create disk2” I haven’t done it for the other disks. From: Jose A. Lombera [mailto:j...@lajni.com] Sent: Sunday, September 23, 2012 8:10 PM To: 'Freddie Cash' Cc: freebsd-current@freebsd.org Subject: RE: zpool can't bring online disk2 Freddie, Thanks for your great help, now makes so much sense. I still have a small problem, and I'm not sure if it is because hastd is running. I can't initialize (hastctl create disk2) disk2 This is what I did. 1.. zpool offline tank /dev/dsk/hast/disk2 2. zpool status -x [root@san /usr/home/jose]# zpool status -x pool: tank state: DEGRADED status: One or more devices has been taken offline by the administrator. Sufficient replicas exist for the pool to continue functioning in a degraded state. action: Online the device using 'zpool online' or replace the device with 'zpool replace'. scan: scrub repaired 0 in 12h4m with 0 errors on Sun Sep 23 19:14:19 2012 config: NAME