Rainer Orth <ro at techfak.uni-bielefeld.de> writes:
> Yesterday evening, I tried Live Upgrade on a Sun Fire V60x running SX:CE 90
> to SX:CE 93 with ZFS root (mirrored root pool called root). The LU itself
> ran without problems, but before rebooting the machine, I wanted to add
> some space to the root pool that had previously been in use for an UFS BE.
>
> Both disks (c0t0d0 and c0t1d0) were partitioned as follows:
>
> Part Tag Flag Cylinders Size Blocks
> 0 root wm 1 - 18810 25.91GB (18810/0/0) 54342090
> 1 unassigned wm 18811 - 24618 8.00GB (5808/0/0) 16779312
> 2 backup wm 0 - 24618 33.91GB (24619/0/0) 71124291
> 3 unassigned wu 0 0 (0/0/0) 0
> 4 unassigned wu 0 0 (0/0/0) 0
> 5 unassigned wu 0 0 (0/0/0) 0
> 6 unassigned wu 0 0 (0/0/0) 0
> 7 unassigned wu 0 0 (0/0/0) 0
> 8 boot wu 0 - 0 1.41MB (1/0/0) 2889
> 9 unassigned wu 0 0 (0/0/0) 0
>
> Slice 0 is used by the root pool, slice 1 was used by the UFS BE. To
> achieve this, I ludeleted the now unused UFS BE and used
>
> # NOINUSE_CHECK=1 format
>
> to extend slice 0 by the size of slice 1, deleting the latter afterwards.
> I''m pretty sure that I''ve done this successfully before,
even on a live
> system, but this time something went wrong: I remember an FMA message about
> one side of the root pool mirror being broken (something about an
> inconsistent label, unfortunately I didn''t write down the exact
message).
> Nonetheless, I rebooted the machine after luactivate sol_nv_93 (the new ZFS
> BE), but the machine didn''t come up:
>
> SunOS Release 5.11 Version snv_93 32-bit
> Copyright 1983-2008 Sun Microsystems, Inc. All rights reserved.
> Use is subject to license terms.
> NOTICE:
> spa_import_rootpool: error 22
>
>
> panic[cpu0]/thread=fec1cfe0: cannot mount root path /pci at
0,0/pci8086,2545 at 3/pci8086,1460 at 1d/pci8086,341a at 7,1/sd at 1,0:a /pci at
0,0/pci8086,2545 at 3/pci8086,1460 at 1d/pci8086,341a at 7,1/sd at 0,0:a
>
> fec351ac genunix:rootconf+10b (c0f040, 1, fec1c750)
> fec351d0 genunix:vfs_mountroot+54 (fe800010, fec30fd8,)
> fec351e4 genunix:main+b4 ()
>
> panic: entering debugger (no dump device, continue to reboot)
> skipping system dump - no dump device configured
> rebooting...
>
> I''ve managed a failsafe boot (from the same pool), and zpool
import reveals
>
> pool: root
> id: 14475053522795106129
> state: UNAVAIL
> status: The pool was last accessed by another system.
> action: The pool cannot be imported due to damaged devices or data.
> see: http://www.sun.com/msg/ZFS-8000-EY
> config:
>
> root UNAVAIL insufficient replicas
> mirror UNAVAIL corrupted data
> c0t1d0s0 ONLINE
> c0t0d0s0 ONLINE
>
> Even restoring slice 1 on both disks to its old size and shrinking slice 0
> accordingly doesn''t help. I''m sure I''ve done
this correctly since I could
> boot from the old sol_nv_b90_ufs BE, which was still on c0t0d0s1.
>
> I didn''t have much success to find out what''s going on
here: I tried to
> remove either of the disks in case both sides of the mirror are
> inconsistent, but to no avail. I didn''t have much luck with zdb
either.
> Here''s the output of zdb -l /dev/rdsk/c0t0d0s0 and
/dev/rdsk/c0t1d0s0:
>
> c0t0d0s0:
>
> --------------------------------------------
> LABEL 0
> --------------------------------------------
> version=10
> name=''root''
> state=0
> txg=14643945
> pool_guid=14475053522795106129
> hostid=336880771
> hostname=''erebus''
> top_guid=17627503873514720747
> guid=6121143629633742955
> vdev_tree
> type=''mirror''
> id=0
> guid=17627503873514720747
> whole_disk=0
> metaslab_array=13
> metaslab_shift=28
> ashift=9
> asize=36409180160
> is_log=0
> children[0]
> type=''disk''
> id=0
> guid=1526746004928780410
> path=''/dev/dsk/c0t1d0s0''
> devid=''id1,sd at
SSEAGATE_ST336607LSUN36G_3JA2CBTL000074039RPW/a''
> phys_path=''/pci at 0,0/pci8086,2545 at
3/pci8086,1460 at 1d/pci8086,341a at 7,1/sd at 1,0:a''
> whole_disk=0
> DTL=160
> children[1]
> type=''disk''
> id=1
> guid=6121143629633742955
> path=''/dev/dsk/c0t0d0s0''
> devid=''id1,sd at
SSEAGATE_ST336607LSUN36G_3JAA6QTV000074478N8M/a''
> phys_path=''/pci at 0,0/pci8086,2545 at
3/pci8086,1460 at 1d/pci8086,341a at 7,1/sd at 0,0:a''
> whole_disk=0
> DTL=272
> --------------------------------------------
> LABEL 1
> --------------------------------------------
> version=10
> name=''root''
> state=0
> txg=14643945
> pool_guid=14475053522795106129
> hostid=336880771
> hostname=''erebus''
> top_guid=17627503873514720747
> guid=6121143629633742955
> vdev_tree
> type=''mirror''
> id=0
> guid=17627503873514720747
> whole_disk=0
> metaslab_array=13
> metaslab_shift=28
> ashift=9
> asize=36409180160
> is_log=0
> children[0]
> type=''disk''
> id=0
> guid=1526746004928780410
> path=''/dev/dsk/c0t1d0s0''
> devid=''id1,sd at
SSEAGATE_ST336607LSUN36G_3JA2CBTL000074039RPW/a''
> phys_path=''/pci at 0,0/pci8086,2545 at
3/pci8086,1460 at 1d/pci8086,341a at 7,1/sd at 1,0:a''
> whole_disk=0
> DTL=160
> children[1]
> type=''disk''
> id=1
> guid=6121143629633742955
> path=''/dev/dsk/c0t0d0s0''
> devid=''id1,sd at
SSEAGATE_ST336607LSUN36G_3JAA6QTV000074478N8M/a''
> phys_path=''/pci at 0,0/pci8086,2545 at
3/pci8086,1460 at 1d/pci8086,341a at 7,1/sd at 0,0:a''
> whole_disk=0
> DTL=272
> --------------------------------------------
> LABEL 2
> --------------------------------------------
> version=10
> name=''root''
> state=0
> txg=14549625
> pool_guid=14475053522795106129
> hostid=336880771
> hostname=''''
> top_guid=17627503873514720747
> guid=6121143629633742955
> vdev_tree
> type=''mirror''
> id=0
> guid=17627503873514720747
> whole_disk=0
> metaslab_array=13
> metaslab_shift=28
> ashift=9
> asize=27818196992
> is_log=0
> children[0]
> type=''disk''
> id=0
> guid=1526746004928780410
> path=''/dev/dsk/c0t1d0s0''
> devid=''id1,sd at
SSEAGATE_ST336607LSUN36G_3JA2CBTL000074039RPW/a''
> phys_path=''/pci at 0,0/pci8086,2545 at
3/pci8086,1460 at 1d/pci8086,341a at 7,1/sd at 1,0:a''
> whole_disk=0
> DTL=160
> children[1]
> type=''disk''
> id=1
> guid=6121143629633742955
> path=''/dev/dsk/c0t0d0s0''
> devid=''id1,sd at
SSEAGATE_ST336607LSUN36G_3JAA6QTV000074478N8M/a''
> phys_path=''/pci at 0,0/pci8086,2545 at
3/pci8086,1460 at 1d/pci8086,341a at 7,1/sd at 0,0:a''
> whole_disk=0
> DTL=272
> --------------------------------------------
> LABEL 3
> --------------------------------------------
> version=10
> name=''root''
> state=0
> txg=14549625
> pool_guid=14475053522795106129
> hostid=336880771
> hostname=''''
> top_guid=17627503873514720747
> guid=6121143629633742955
> vdev_tree
> type=''mirror''
> id=0
> guid=17627503873514720747
> whole_disk=0
> metaslab_array=13
> metaslab_shift=28
> ashift=9
> asize=27818196992
> is_log=0
> children[0]
> type=''disk''
> id=0
> guid=1526746004928780410
> path=''/dev/dsk/c0t1d0s0''
> devid=''id1,sd at
SSEAGATE_ST336607LSUN36G_3JA2CBTL000074039RPW/a''
> phys_path=''/pci at 0,0/pci8086,2545 at
3/pci8086,1460 at 1d/pci8086,341a at 7,1/sd at 1,0:a''
> whole_disk=0
> DTL=160
> children[1]
> type=''disk''
> id=1
> guid=6121143629633742955
> path=''/dev/dsk/c0t0d0s0''
> devid=''id1,sd at
SSEAGATE_ST336607LSUN36G_3JAA6QTV000074478N8M/a''
> phys_path=''/pci at 0,0/pci8086,2545 at
3/pci8086,1460 at 1d/pci8086,341a at 7,1/sd at 0,0:a''
> whole_disk=0
> DTL=272
>
> c0t1d0s0:
>
> --------------------------------------------
> LABEL 0
> --------------------------------------------
> version=10
> name=''root''
> state=0
> txg=14643905
> pool_guid=14475053522795106129
> hostid=336880771
> hostname=''erebus''
> top_guid=17627503873514720747
> guid=1526746004928780410
> vdev_tree
> type=''mirror''
> id=0
> guid=17627503873514720747
> whole_disk=0
> metaslab_array=13
> metaslab_shift=28
> ashift=9
> asize=36409180160
> is_log=0
> children[0]
> type=''disk''
> id=0
> guid=1526746004928780410
> path=''/dev/dsk/c0t1d0s0''
> devid=''id1,sd at
SSEAGATE_ST336607LSUN36G_3JA2CBTL000074039RPW/a''
> phys_path=''/pci at 0,0/pci8086,2545 at
3/pci8086,1460 at 1d/pci8086,341a at 7,1/sd at 1,0:a''
> whole_disk=0
> DTL=160
> children[1]
> type=''disk''
> id=1
> guid=6121143629633742955
> path=''/dev/dsk/c0t0d0s0''
> devid=''id1,sd at
SSEAGATE_ST336607LSUN36G_3JAA6QTV000074478N8M/a''
> phys_path=''/pci at 0,0/pci8086,2545 at
3/pci8086,1460 at 1d/pci8086,341a at 7,1/sd at 0,0:a''
> whole_disk=0
> DTL=272
> --------------------------------------------
> LABEL 1
> --------------------------------------------
> version=10
> name=''root''
> state=0
> txg=14643905
> pool_guid=14475053522795106129
> hostid=336880771
> hostname=''erebus''
> top_guid=17627503873514720747
> guid=1526746004928780410
> vdev_tree
> type=''mirror''
> id=0
> guid=17627503873514720747
> whole_disk=0
> metaslab_array=13
> metaslab_shift=28
> ashift=9
> asize=36409180160
> is_log=0
> children[0]
> type=''disk''
> id=0
> guid=1526746004928780410
> path=''/dev/dsk/c0t1d0s0''
> devid=''id1,sd at
SSEAGATE_ST336607LSUN36G_3JA2CBTL000074039RPW/a''
> phys_path=''/pci at 0,0/pci8086,2545 at
3/pci8086,1460 at 1d/pci8086,341a at 7,1/sd at 1,0:a''
> whole_disk=0
> DTL=160
> children[1]
> type=''disk''
> id=1
> guid=6121143629633742955
> path=''/dev/dsk/c0t0d0s0''
> devid=''id1,sd at
SSEAGATE_ST336607LSUN36G_3JAA6QTV000074478N8M/a''
> phys_path=''/pci at 0,0/pci8086,2545 at
3/pci8086,1460 at 1d/pci8086,341a at 7,1/sd at 0,0:a''
> whole_disk=0
> DTL=272
> --------------------------------------------
> LABEL 2
> --------------------------------------------
> version=10
> name=''root''
> state=0
> txg=14643900
> pool_guid=14475053522795106129
> hostid=336880771
> hostname=''erebus''
> top_guid=17627503873514720747
> guid=1526746004928780410
> vdev_tree
> type=''mirror''
> id=0
> guid=17627503873514720747
> whole_disk=0
> metaslab_array=13
> metaslab_shift=28
> ashift=9
> asize=27818196992
> is_log=0
> children[0]
> type=''disk''
> id=0
> guid=1526746004928780410
> path=''/dev/dsk/c0t1d0s0''
> devid=''id1,sd at
SSEAGATE_ST336607LSUN36G_3JA2CBTL000074039RPW/a''
> phys_path=''/pci at 0,0/pci8086,2545 at
3/pci8086,1460 at 1d/pci8086,341a at 7,1/sd at 1,0:a''
> whole_disk=0
> DTL=160
> children[1]
> type=''disk''
> id=1
> guid=6121143629633742955
> path=''/dev/dsk/c0t0d0s0''
> devid=''id1,sd at
SSEAGATE_ST336607LSUN36G_3JAA6QTV000074478N8M/a''
> phys_path=''/pci at 0,0/pci8086,2545 at
3/pci8086,1460 at 1d/pci8086,341a at 7,1/sd at 0,0:a''
> whole_disk=0
> DTL=272
> --------------------------------------------
> LABEL 3
> --------------------------------------------
> version=10
> name=''root''
> state=0
> txg=14643900
> pool_guid=14475053522795106129
> hostid=336880771
> hostname=''erebus''
> top_guid=17627503873514720747
> guid=1526746004928780410
> vdev_tree
> type=''mirror''
> id=0
> guid=17627503873514720747
> whole_disk=0
> metaslab_array=13
> metaslab_shift=28
> ashift=9
> asize=27818196992
> is_log=0
> children[0]
> type=''disk''
> id=0
> guid=1526746004928780410
> path=''/dev/dsk/c0t1d0s0''
> devid=''id1,sd at
SSEAGATE_ST336607LSUN36G_3JA2CBTL000074039RPW/a''
> phys_path=''/pci at 0,0/pci8086,2545 at
3/pci8086,1460 at 1d/pci8086,341a at 7,1/sd at 1,0:a''
> whole_disk=0
> DTL=160
> children[1]
> type=''disk''
> id=1
> guid=6121143629633742955
> path=''/dev/dsk/c0t0d0s0''
> devid=''id1,sd at
SSEAGATE_ST336607LSUN36G_3JAA6QTV000074478N8M/a''
> phys_path=''/pci at 0,0/pci8086,2545 at
3/pci8086,1460 at 1d/pci8086,341a at 7,1/sd at 0,0:a''
> whole_disk=0
> DTL=272
>
> A diff between both files shows:
>
> --- c0t0d0s0.zdb-l Fri Jul 11 17:50:07 2008
> +++ c0t1d0s0.zdb-l Fri Jul 11 17:50:08 2008
> @@ -4,12 +4,12 @@
> version=10
> name=''root''
> state=0
> - txg=14643945
> + txg=14643905
> pool_guid=14475053522795106129
> hostid=336880771
> hostname=''erebus''
> top_guid=17627503873514720747
> - guid=6121143629633742955
> + guid=1526746004928780410
> vdev_tree
> type=''mirror''
> id=0
> @@ -44,12 +44,12 @@
> version=10
> name=''root''
> state=0
> - txg=14643945
> + txg=14643905
> pool_guid=14475053522795106129
> hostid=336880771
> hostname=''erebus''
> top_guid=17627503873514720747
> - guid=6121143629633742955
> + guid=1526746004928780410
> vdev_tree
> type=''mirror''
> id=0
> @@ -84,12 +84,12 @@
> version=10
> name=''root''
> state=0
> - txg=14549625
> + txg=14643900
> pool_guid=14475053522795106129
> hostid=336880771
> - hostname=''''
> + hostname=''erebus''
> top_guid=17627503873514720747
> - guid=6121143629633742955
> + guid=1526746004928780410
> vdev_tree
> type=''mirror''
> id=0
> @@ -124,12 +124,12 @@
> version=10
> name=''root''
> state=0
> - txg=14549625
> + txg=14643900
> pool_guid=14475053522795106129
> hostid=336880771
> - hostname=''''
> + hostname=''erebus''
> top_guid=17627503873514720747
> - guid=6121143629633742955
> + guid=1526746004928780410
> vdev_tree
> type=''mirror''
> id=0
>
> Other invocations of zdb didn''t have much success, unfortunately:
>
> # zdb -u -e root
> zdb: More than one matching pool - specify guid/devid/device path.
> # zdb -u -e /dev/rdsk/c0t0d0s0
> zdb: can''t open /dev/rdsk/c0t0d0s0: No such file or directory
> # zdb -u -e 14475053522795106129
> zdb: can''t open 14475053522795106129: Invalid argument
>
> I have no idea why device path or guid (from zpool import) don''t
work
> here.
>
> Is there any chance to recover the pool contents (which of course contains
> other data besides the O/S installation), or a least to understand why this
> resize exercise went terribly wrong here?
Unfortunately, I''ve received no comment whatsoever on this issue. I
don''t
think growing slices underlying a mirrored root pool should so badly
corrupt the pool.
I may file a CR if this thread gives no result.
Rainer
--
-----------------------------------------------------------------------------
Rainer Orth, Faculty of Technology, Bielefeld University