Rainer Orth <[EMAIL PROTECTED]> writes:

> Yesterday evening, I tried Live Upgrade on a Sun Fire V60x running SX:CE 90
> to SX:CE 93 with ZFS root (mirrored root pool called root).  The LU itself
> ran without problems, but before rebooting the machine, I wanted to add
> some space to the root pool that had previously been in use for an UFS BE.
> 
> Both disks (c0t0d0 and c0t1d0) were partitioned as follows:
> 
> Part      Tag    Flag     Cylinders         Size            Blocks
>   0       root    wm       1 - 18810       25.91GB    (18810/0/0) 54342090
>   1 unassigned    wm   18811 - 24618        8.00GB    (5808/0/0)  16779312
>   2     backup    wm       0 - 24618       33.91GB    (24619/0/0) 71124291
>   3 unassigned    wu       0                0         (0/0/0)            0
>   4 unassigned    wu       0                0         (0/0/0)            0
>   5 unassigned    wu       0                0         (0/0/0)            0
>   6 unassigned    wu       0                0         (0/0/0)            0
>   7 unassigned    wu       0                0         (0/0/0)            0
>   8       boot    wu       0 -     0        1.41MB    (1/0/0)         2889
>   9 unassigned    wu       0                0         (0/0/0)            0
> 
> Slice 0 is used by the root pool, slice 1 was used by the UFS BE.  To
> achieve this, I ludeleted the now unused UFS BE and used 
> 
> # NOINUSE_CHECK=1 format
> 
> to extend slice 0 by the size of slice 1, deleting the latter afterwards.
> I'm pretty sure that I've done this successfully before, even on a live
> system, but this time something went wrong: I remember an FMA message about
> one side of the root pool mirror being broken (something about an
> inconsistent label, unfortunately I didn't write down the exact message).
> Nonetheless, I rebooted the machine after luactivate sol_nv_93 (the new ZFS
> BE), but the machine didn't come up:
> 
> SunOS Release 5.11 Version snv_93 32-bit
> Copyright 1983-2008 Sun Microsystems, Inc.  All rights reserved.
> Use is subject to license terms.
> NOTICE:
> spa_import_rootpool: error 22
> 
> 
> panic[cpu0]/thread=fec1cfe0: cannot mount root path /[EMAIL 
> PROTECTED],0/pci8086,[EMAIL PROTECTED]/pci8086,[EMAIL 
> PROTECTED]/pci8086,[EMAIL PROTECTED],1/[EMAIL PROTECTED],0:a /[EMAIL 
> PROTECTED],0/pci8086,[EMAIL PROTECTED]/pci8086,[EMAIL 
> PROTECTED]/pci8086,[EMAIL PROTECTED],1/[EMAIL PROTECTED],0:a
> 
> fec351ac genunix:rootconf+10b (c0f040, 1, fec1c750)
> fec351d0 genunix:vfs_mountroot+54 (fe800010, fec30fd8,)
> fec351e4 genunix:main+b4 ()
> 
> panic: entering debugger (no dump device, continue to reboot)
> skipping system dump - no dump device configured
> rebooting...
> 
> I've managed a failsafe boot (from the same pool), and zpool import reveals
> 
>   pool: root
>     id: 14475053522795106129
>  state: UNAVAIL
> status: The pool was last accessed by another system.
> action: The pool cannot be imported due to damaged devices or data.
>    see: http://www.sun.com/msg/ZFS-8000-EY
> config:
> 
>         root          UNAVAIL  insufficient replicas
>           mirror      UNAVAIL  corrupted data
>             c0t1d0s0  ONLINE
>             c0t0d0s0  ONLINE
> 
> Even restoring slice 1 on both disks to its old size and shrinking slice 0
> accordingly doesn't help.  I'm sure I've done this correctly since I could
> boot from the old sol_nv_b90_ufs BE, which was still on c0t0d0s1.
> 
> I didn't have much success to find out what's going on here: I tried to
> remove either of the disks in case both sides of the mirror are
> inconsistent, but to no avail.  I didn't have much luck with zdb either.
> Here's the output of zdb -l /dev/rdsk/c0t0d0s0 and /dev/rdsk/c0t1d0s0:
> 
> c0t0d0s0:
> 
> --------------------------------------------
> LABEL 0
> --------------------------------------------
>     version=10
>     name='root'
>     state=0
>     txg=14643945
>     pool_guid=14475053522795106129
>     hostid=336880771
>     hostname='erebus'
>     top_guid=17627503873514720747
>     guid=6121143629633742955
>     vdev_tree
>         type='mirror'
>         id=0
>         guid=17627503873514720747
>         whole_disk=0
>         metaslab_array=13
>         metaslab_shift=28
>         ashift=9
>         asize=36409180160
>         is_log=0
>         children[0]
>                 type='disk'
>                 id=0
>                 guid=1526746004928780410
>                 path='/dev/dsk/c0t1d0s0'
>                 devid='id1,[EMAIL PROTECTED]/a'
>                 phys_path='/[EMAIL PROTECTED],0/pci8086,[EMAIL 
> PROTECTED]/pci8086,[EMAIL PROTECTED]/pci8086,[EMAIL PROTECTED],1/[EMAIL 
> PROTECTED],0:a'
>                 whole_disk=0
>                 DTL=160
>         children[1]
>                 type='disk'
>                 id=1
>                 guid=6121143629633742955
>                 path='/dev/dsk/c0t0d0s0'
>                 devid='id1,[EMAIL PROTECTED]/a'
>                 phys_path='/[EMAIL PROTECTED],0/pci8086,[EMAIL 
> PROTECTED]/pci8086,[EMAIL PROTECTED]/pci8086,[EMAIL PROTECTED],1/[EMAIL 
> PROTECTED],0:a'
>                 whole_disk=0
>                 DTL=272
> --------------------------------------------
> LABEL 1
> --------------------------------------------
>     version=10
>     name='root'
>     state=0
>     txg=14643945
>     pool_guid=14475053522795106129
>     hostid=336880771
>     hostname='erebus'
>     top_guid=17627503873514720747
>     guid=6121143629633742955
>     vdev_tree
>         type='mirror'
>         id=0
>         guid=17627503873514720747
>         whole_disk=0
>         metaslab_array=13
>         metaslab_shift=28
>         ashift=9
>         asize=36409180160
>         is_log=0
>         children[0]
>                 type='disk'
>                 id=0
>                 guid=1526746004928780410
>                 path='/dev/dsk/c0t1d0s0'
>                 devid='id1,[EMAIL PROTECTED]/a'
>                 phys_path='/[EMAIL PROTECTED],0/pci8086,[EMAIL 
> PROTECTED]/pci8086,[EMAIL PROTECTED]/pci8086,[EMAIL PROTECTED],1/[EMAIL 
> PROTECTED],0:a'
>                 whole_disk=0
>                 DTL=160
>         children[1]
>                 type='disk'
>                 id=1
>                 guid=6121143629633742955
>                 path='/dev/dsk/c0t0d0s0'
>                 devid='id1,[EMAIL PROTECTED]/a'
>                 phys_path='/[EMAIL PROTECTED],0/pci8086,[EMAIL 
> PROTECTED]/pci8086,[EMAIL PROTECTED]/pci8086,[EMAIL PROTECTED],1/[EMAIL 
> PROTECTED],0:a'
>                 whole_disk=0
>                 DTL=272
> --------------------------------------------
> LABEL 2
> --------------------------------------------
>     version=10
>     name='root'
>     state=0
>     txg=14549625
>     pool_guid=14475053522795106129
>     hostid=336880771
>     hostname=''
>     top_guid=17627503873514720747
>     guid=6121143629633742955
>     vdev_tree
>         type='mirror'
>         id=0
>         guid=17627503873514720747
>         whole_disk=0
>         metaslab_array=13
>         metaslab_shift=28
>         ashift=9
>         asize=27818196992
>         is_log=0
>         children[0]
>                 type='disk'
>                 id=0
>                 guid=1526746004928780410
>                 path='/dev/dsk/c0t1d0s0'
>                 devid='id1,[EMAIL PROTECTED]/a'
>                 phys_path='/[EMAIL PROTECTED],0/pci8086,[EMAIL 
> PROTECTED]/pci8086,[EMAIL PROTECTED]/pci8086,[EMAIL PROTECTED],1/[EMAIL 
> PROTECTED],0:a'
>                 whole_disk=0
>                 DTL=160
>         children[1]
>                 type='disk'
>                 id=1
>                 guid=6121143629633742955
>                 path='/dev/dsk/c0t0d0s0'
>                 devid='id1,[EMAIL PROTECTED]/a'
>                 phys_path='/[EMAIL PROTECTED],0/pci8086,[EMAIL 
> PROTECTED]/pci8086,[EMAIL PROTECTED]/pci8086,[EMAIL PROTECTED],1/[EMAIL 
> PROTECTED],0:a'
>                 whole_disk=0
>                 DTL=272
> --------------------------------------------
> LABEL 3
> --------------------------------------------
>     version=10
>     name='root'
>     state=0
>     txg=14549625
>     pool_guid=14475053522795106129
>     hostid=336880771
>     hostname=''
>     top_guid=17627503873514720747
>     guid=6121143629633742955
>     vdev_tree
>         type='mirror'
>         id=0
>         guid=17627503873514720747
>         whole_disk=0
>         metaslab_array=13
>         metaslab_shift=28
>         ashift=9
>         asize=27818196992
>         is_log=0
>         children[0]
>                 type='disk'
>                 id=0
>                 guid=1526746004928780410
>                 path='/dev/dsk/c0t1d0s0'
>                 devid='id1,[EMAIL PROTECTED]/a'
>                 phys_path='/[EMAIL PROTECTED],0/pci8086,[EMAIL 
> PROTECTED]/pci8086,[EMAIL PROTECTED]/pci8086,[EMAIL PROTECTED],1/[EMAIL 
> PROTECTED],0:a'
>                 whole_disk=0
>                 DTL=160
>         children[1]
>                 type='disk'
>                 id=1
>                 guid=6121143629633742955
>                 path='/dev/dsk/c0t0d0s0'
>                 devid='id1,[EMAIL PROTECTED]/a'
>                 phys_path='/[EMAIL PROTECTED],0/pci8086,[EMAIL 
> PROTECTED]/pci8086,[EMAIL PROTECTED]/pci8086,[EMAIL PROTECTED],1/[EMAIL 
> PROTECTED],0:a'
>                 whole_disk=0
>                 DTL=272
> 
> c0t1d0s0:
> 
> --------------------------------------------
> LABEL 0
> --------------------------------------------
>     version=10
>     name='root'
>     state=0
>     txg=14643905
>     pool_guid=14475053522795106129
>     hostid=336880771
>     hostname='erebus'
>     top_guid=17627503873514720747
>     guid=1526746004928780410
>     vdev_tree
>         type='mirror'
>         id=0
>         guid=17627503873514720747
>         whole_disk=0
>         metaslab_array=13
>         metaslab_shift=28
>         ashift=9
>         asize=36409180160
>         is_log=0
>         children[0]
>                 type='disk'
>                 id=0
>                 guid=1526746004928780410
>                 path='/dev/dsk/c0t1d0s0'
>                 devid='id1,[EMAIL PROTECTED]/a'
>                 phys_path='/[EMAIL PROTECTED],0/pci8086,[EMAIL 
> PROTECTED]/pci8086,[EMAIL PROTECTED]/pci8086,[EMAIL PROTECTED],1/[EMAIL 
> PROTECTED],0:a'
>                 whole_disk=0
>                 DTL=160
>         children[1]
>                 type='disk'
>                 id=1
>                 guid=6121143629633742955
>                 path='/dev/dsk/c0t0d0s0'
>                 devid='id1,[EMAIL PROTECTED]/a'
>                 phys_path='/[EMAIL PROTECTED],0/pci8086,[EMAIL 
> PROTECTED]/pci8086,[EMAIL PROTECTED]/pci8086,[EMAIL PROTECTED],1/[EMAIL 
> PROTECTED],0:a'
>                 whole_disk=0
>                 DTL=272
> --------------------------------------------
> LABEL 1
> --------------------------------------------
>     version=10
>     name='root'
>     state=0
>     txg=14643905
>     pool_guid=14475053522795106129
>     hostid=336880771
>     hostname='erebus'
>     top_guid=17627503873514720747
>     guid=1526746004928780410
>     vdev_tree
>         type='mirror'
>         id=0
>         guid=17627503873514720747
>         whole_disk=0
>         metaslab_array=13
>         metaslab_shift=28
>         ashift=9
>         asize=36409180160
>         is_log=0
>         children[0]
>                 type='disk'
>                 id=0
>                 guid=1526746004928780410
>                 path='/dev/dsk/c0t1d0s0'
>                 devid='id1,[EMAIL PROTECTED]/a'
>                 phys_path='/[EMAIL PROTECTED],0/pci8086,[EMAIL 
> PROTECTED]/pci8086,[EMAIL PROTECTED]/pci8086,[EMAIL PROTECTED],1/[EMAIL 
> PROTECTED],0:a'
>                 whole_disk=0
>                 DTL=160
>         children[1]
>                 type='disk'
>                 id=1
>                 guid=6121143629633742955
>                 path='/dev/dsk/c0t0d0s0'
>                 devid='id1,[EMAIL PROTECTED]/a'
>                 phys_path='/[EMAIL PROTECTED],0/pci8086,[EMAIL 
> PROTECTED]/pci8086,[EMAIL PROTECTED]/pci8086,[EMAIL PROTECTED],1/[EMAIL 
> PROTECTED],0:a'
>                 whole_disk=0
>                 DTL=272
> --------------------------------------------
> LABEL 2
> --------------------------------------------
>     version=10
>     name='root'
>     state=0
>     txg=14643900
>     pool_guid=14475053522795106129
>     hostid=336880771
>     hostname='erebus'
>     top_guid=17627503873514720747
>     guid=1526746004928780410
>     vdev_tree
>         type='mirror'
>         id=0
>         guid=17627503873514720747
>         whole_disk=0
>         metaslab_array=13
>         metaslab_shift=28
>         ashift=9
>         asize=27818196992
>         is_log=0
>         children[0]
>                 type='disk'
>                 id=0
>                 guid=1526746004928780410
>                 path='/dev/dsk/c0t1d0s0'
>                 devid='id1,[EMAIL PROTECTED]/a'
>                 phys_path='/[EMAIL PROTECTED],0/pci8086,[EMAIL 
> PROTECTED]/pci8086,[EMAIL PROTECTED]/pci8086,[EMAIL PROTECTED],1/[EMAIL 
> PROTECTED],0:a'
>                 whole_disk=0
>                 DTL=160
>         children[1]
>                 type='disk'
>                 id=1
>                 guid=6121143629633742955
>                 path='/dev/dsk/c0t0d0s0'
>                 devid='id1,[EMAIL PROTECTED]/a'
>                 phys_path='/[EMAIL PROTECTED],0/pci8086,[EMAIL 
> PROTECTED]/pci8086,[EMAIL PROTECTED]/pci8086,[EMAIL PROTECTED],1/[EMAIL 
> PROTECTED],0:a'
>                 whole_disk=0
>                 DTL=272
> --------------------------------------------
> LABEL 3
> --------------------------------------------
>     version=10
>     name='root'
>     state=0
>     txg=14643900
>     pool_guid=14475053522795106129
>     hostid=336880771
>     hostname='erebus'
>     top_guid=17627503873514720747
>     guid=1526746004928780410
>     vdev_tree
>         type='mirror'
>         id=0
>         guid=17627503873514720747
>         whole_disk=0
>         metaslab_array=13
>         metaslab_shift=28
>         ashift=9
>         asize=27818196992
>         is_log=0
>         children[0]
>                 type='disk'
>                 id=0
>                 guid=1526746004928780410
>                 path='/dev/dsk/c0t1d0s0'
>                 devid='id1,[EMAIL PROTECTED]/a'
>                 phys_path='/[EMAIL PROTECTED],0/pci8086,[EMAIL 
> PROTECTED]/pci8086,[EMAIL PROTECTED]/pci8086,[EMAIL PROTECTED],1/[EMAIL 
> PROTECTED],0:a'
>                 whole_disk=0
>                 DTL=160
>         children[1]
>                 type='disk'
>                 id=1
>                 guid=6121143629633742955
>                 path='/dev/dsk/c0t0d0s0'
>                 devid='id1,[EMAIL PROTECTED]/a'
>                 phys_path='/[EMAIL PROTECTED],0/pci8086,[EMAIL 
> PROTECTED]/pci8086,[EMAIL PROTECTED]/pci8086,[EMAIL PROTECTED],1/[EMAIL 
> PROTECTED],0:a'
>                 whole_disk=0
>                 DTL=272
> 
> A diff between both files shows:
> 
> --- c0t0d0s0.zdb-l    Fri Jul 11 17:50:07 2008
> +++ c0t1d0s0.zdb-l    Fri Jul 11 17:50:08 2008
> @@ -4,12 +4,12 @@
>      version=10
>      name='root'
>      state=0
> -    txg=14643945
> +    txg=14643905
>      pool_guid=14475053522795106129
>      hostid=336880771
>      hostname='erebus'
>      top_guid=17627503873514720747
> -    guid=6121143629633742955
> +    guid=1526746004928780410
>      vdev_tree
>          type='mirror'
>          id=0
> @@ -44,12 +44,12 @@
>      version=10
>      name='root'
>      state=0
> -    txg=14643945
> +    txg=14643905
>      pool_guid=14475053522795106129
>      hostid=336880771
>      hostname='erebus'
>      top_guid=17627503873514720747
> -    guid=6121143629633742955
> +    guid=1526746004928780410
>      vdev_tree
>          type='mirror'
>          id=0
> @@ -84,12 +84,12 @@
>      version=10
>      name='root'
>      state=0
> -    txg=14549625
> +    txg=14643900
>      pool_guid=14475053522795106129
>      hostid=336880771
> -    hostname=''
> +    hostname='erebus'
>      top_guid=17627503873514720747
> -    guid=6121143629633742955
> +    guid=1526746004928780410
>      vdev_tree
>          type='mirror'
>          id=0
> @@ -124,12 +124,12 @@
>      version=10
>      name='root'
>      state=0
> -    txg=14549625
> +    txg=14643900
>      pool_guid=14475053522795106129
>      hostid=336880771
> -    hostname=''
> +    hostname='erebus'
>      top_guid=17627503873514720747
> -    guid=6121143629633742955
> +    guid=1526746004928780410
>      vdev_tree
>          type='mirror'
>          id=0
> 
> Other invocations of zdb didn't have much success, unfortunately:
> 
> # zdb -u -e root
> zdb: More than one matching pool - specify guid/devid/device path.
> # zdb -u -e /dev/rdsk/c0t0d0s0
> zdb: can't open /dev/rdsk/c0t0d0s0: No such file or directory
> # zdb -u -e 14475053522795106129
> zdb: can't open 14475053522795106129: Invalid argument
> 
> I have no idea why device path or guid (from zpool import) don't work
> here. 
> 
> Is there any chance to recover the pool contents (which of course contains
> other data besides the O/S installation), or a least to understand why this
> resize exercise went terribly wrong here?

Unfortunately, I've received no comment whatsoever on this issue.  I don't
think growing slices underlying a mirrored root pool should so badly
corrupt the pool.

I may file a CR if this thread gives no result.

        Rainer

-- 
-----------------------------------------------------------------------------
Rainer Orth, Faculty of Technology, Bielefeld University
_______________________________________________
zfs-discuss mailing list
zfs-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/zfs-discuss

Reply via email to