Here is what I have configured:
T2000 with OBP 4.28.6 2008/05/23 12:07 with 2 - 72 GB disks as the root
disks
OpenSolaris Nevada Build 91
Solaris Express Community Edition snv_91 SPARC
Copyright 2008 Sun Microsystems, Inc. All Rights Reserved.
Use is subject to license terms.
Assembled 03 June 2008
Installed from DVD as ZFS boot filesystems
1 SAN disk attached from IBM SVC using DS8300 storage.
2 - 1 port Qlogic cards attached to McData 6064 Directors
Here''s my questions:
1. After the install I created a zfs mirror of the root disk c0t0d0 to c0t1d0,
format shows the mirrored disk with sectors instead of cylinders, is this normal
or correct? Is there a way to reverse this back to cylinders if it is not?
Same goes for the external disk pool using SAN disk from the IBM SVC.
2. After enabled MPxIO (stmsboot -e), the 2 root disks now have MPxIO labels,
is this a bug with ZFS boot using MPxIO? I have MPxIO running on Solaris 10
release 4 with none of this behavior (I have 2 T2000''s, 1 with SVM root
disks and other with Veritas Encapsulated root disks, all external or non root
filesystems are managed by Veritas volume management, not ZFS).
From format:
0. c4t5000C5000AF82EDBd0 <SEAGATE-ST973402SSUN72G-0603-68.37GB>
/scsi_vhci/disk at g5000c5000af82edb
1. c4t5000C5000AF834ABd0 <SUN72G cyl 14087 alt 2 hd 24 sec 424>
/scsi_vhci/disk at g5000c5000af834ab
2. c4t60050768019081653000000000000617d0 <IBM-2145-0000-36.00GB>
/scsi_vhci/ssd at g60050768019081653000000000000617
root[:/root]# stmsboot -L
non-STMS device name STMS device name
------------------------------------------------------------------
/dev/rdsk/c0t0d0 /dev/rdsk/c4t5000C5000AF834ABd0
/dev/rdsk/c0t1d0 /dev/rdsk/c4t5000C5000AF82EDBd0
3. Any good references for using ZFS with MPxIO?
Thanks in advance,
Adrian
This message posted from opensolaris.org
Adrian Danielson wrote:> 1. After the install I created a zfs mirror of the root disk c0t0d0 to c0t1d0, format shows the mirrored disk with sectors instead of cylinders, is this normal or correct? Is there a way to reverse this back to cylinders if it is not? Same goes for the external disk pool using SAN disk from the IBM SVC.Format show sectors when the disk has an EFI label, and cylinders when the disk has a Sun label. ZFS always uses EFI labels, so you''re seeing the right thing. You can change the label (blowing away the disk contents of course) using format -e. The label menu changes with the -e flag to let you choose the kind of label. Cheers, Chris
On Wed, Jul 9, 2008 at 6:27 PM, Adrian Danielson <adrian_danielson at csgsystems.com> wrote:> Here is what I have configured: > > T2000 with OBP 4.28.6 2008/05/23 12:07 with 2 - 72 GB disks as the root disks > OpenSolaris Nevada Build 91...> 2. After enabled MPxIO (stmsboot -e), the 2 root disks now have MPxIO labels, is this a bug with ZFS boot using MPxIO? I have MPxIO running on Solaris 10 release 4 with none of this behavior (I have 2 T2000''s, 1 with SVM root disks and other with Veritas Encapsulated root disks, all external or non root filesystems are managed by Veritas volume management, not ZFS).Nothing to do with ZFS. Current versions of the mpt driver, used in a lot of current Sun systems for the internal drive and for external SAS connectivity, support mpxio as well. (Solaris 10 update 4 doesn''t have it - it came soon after in a patch.) You can restrict stmsboot to only enable mpxio on the mpt or fibre interfaces using ''stmsboot -D mpt'' or ''stmsboot -D fp''. -- -Peter Tribble http://www.petertribble.co.uk/ - http://ptribble.blogspot.com/
Adrian Danielson wrote:> Here is what I have configured: > > T2000 with OBP 4.28.6 2008/05/23 12:07 with 2 - 72 GB disks as the root disks > OpenSolaris Nevada Build 91 > Solaris Express Community Edition snv_91 SPARC > Copyright 2008 Sun Microsystems, Inc. All Rights Reserved. > Use is subject to license terms. > Assembled 03 June 2008 > > Installed from DVD as ZFS boot filesystems > 1 SAN disk attached from IBM SVC using DS8300 storage. > 2 - 1 port Qlogic cards attached to McData 6064 Directors > > > Here''s my questions: > > 1. After the install I created a zfs mirror of the root disk c0t0d0 to c0t1d0, format shows the mirrored disk with sectors instead of cylinders, is this normal or correct? Is there a way to reverse this back to cylinders if it is not? Same goes for the external disk pool using SAN disk from the IBM SVC. >Please verify that you following the procedures for mirroring ZFS boot disks in the ZFS Adminstration Guide http://www.opensolaris.org/os/community/zfs/docs/zfsadmin.pdf As always, I also suggest testing prior to production roll-out. -- richard
Cindy.Swearingen at Sun.COM
2008-Jul-09 21:17 UTC
[zfs-discuss] Using zfs boot with MPxIO on T2000
ZFS uses EFI when a storage pool is created with whole disks. ZFS uses the old-style VTOC label when a storage pool is created with slices. To be able to boot from a ZFS root pool, the storage pool must be created with slices. This is a new requirement in ZFS land, and is described in the doc pointer Richard provided previously: http://www.opensolaris.org/os/community/zfs/docs/zfsadmin.pdf Cindy Chris Ridd wrote:> Adrian Danielson wrote: > >>1. After the install I created a zfs mirror of the root disk c0t0d0 to c0t1d0, format shows the mirrored disk with sectors instead of cylinders, is this normal or correct? Is there a way to reverse this back to cylinders if it is not? Same goes for the external disk pool using SAN disk from the IBM SVC. > > > Format show sectors when the disk has an EFI label, and cylinders when > the disk has a Sun label. ZFS always uses EFI labels, so you''re seeing > the right thing. > > You can change the label (blowing away the disk contents of course) > using format -e. The label menu changes with the -e flag to let you > choose the kind of label. > > Cheers, > > Chris > _______________________________________________ > zfs-discuss mailing list > zfs-discuss at opensolaris.org > http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Peter Tribble wrote:> On Wed, Jul 9, 2008 at 6:27 PM, Adrian Danielson > <adrian_danielson at csgsystems.com> wrote: >> Here is what I have configured: >> >> T2000 with OBP 4.28.6 2008/05/23 12:07 with 2 - 72 GB disks as the root disks >> OpenSolaris Nevada Build 91 > ... >> 2. After enabled MPxIO (stmsboot -e), the 2 root disks now have MPxIO labels, is this a bug with ZFS boot using MPxIO? I have MPxIO running on Solaris 10 release 4 with none of this behavior (I have 2 T2000''s, 1 with SVM root disks and other with Veritas Encapsulated root disks, all external or non root filesystems are managed by Veritas volume management, not ZFS). > > Nothing to do with ZFS. Current versions of the mpt driver, used in a > lot of current Sun > systems for the internal drive and for external SAS connectivity, > support mpxio as well. > (Solaris 10 update 4 doesn''t have it - it came soon after in a patch.) > > You can restrict stmsboot to only enable mpxio on the mpt or fibre > interfaces using > ''stmsboot -D mpt'' or ''stmsboot -D fp''.Hi Adrian, as Peter mentions, this isn''t a bug, it''s a feature ;) Actually, it''s the feature that I delivered into Solaris 10 last year with the 125081-10/125082-10 patches. James C. McPherson -- Senior Kernel Software Engineer, Solaris Sun Microsystems http://blogs.sun.com/jmcp http://www.jmcp.homeunix.com/blog
Thanks everyone for your replies, I have a better understanding of how to test out ZFS with MPxIO. Best Regards, Adrian This message posted from opensolaris.org
http://www.opensolaris.org/os/community/zfs/docs/zfsadmin.pdf Another question: When trying to mirror the 2nd root disk, I get the following error: root[tst01:/root]# zpool attach rpool c0t0d0s0 c0t1d0s0 cannot attach c0t1d0s0 to c0t0d0s0: device is too small Since c0t1d0s0 has been reduced by 1 cylinder it''s too small, is there a way to reduce the existing rpool so it will fit? I did not see in the zfsadmin.pdf guide if there was a way to do this or a work around. If I use the "-f" it will work but create an EFI labeled disk as I understand does not boot using ZFS. I must be overlooking a step. Thanks again, Adrian This message posted from opensolaris.org
Adrian Danielson wrote:> http://www.opensolaris.org/os/community/zfs/docs/zfsadmin.pdf > > Another question: > > When trying to mirror the 2nd root disk, I get the following error: > > root[tst01:/root]# zpool attach rpool c0t0d0s0 c0t1d0s0 cannot attach > c0t1d0s0 to c0t0d0s0: device is too small > > Since c0t1d0s0 has been reduced by 1 cylinder it''s too small, is there a > way to reduce the existing rpool so it will fit? I did not see in the > zfsadmin.pdf guide if there was a way to do this or a work around. If I > use the "-f" it will work but create an EFI labeled disk as I understand > does not boot using ZFS. I must be overlooking a step.Sorry, you''re out of luck - at least for the moment. Can you create the rpool to be smaller? James C. McPherson -- Senior Kernel Software Engineer, Solaris Sun Microsystems http://blogs.sun.com/jmcp http://www.jmcp.homeunix.com/blog