Hi, are there any issue in ZFS boot using a pool with devices in a Storage Area Network (SAN)? I''m interested in both the SPARC and x86 platforms. Rgrds, Danilo.
Hello Danilo,
Thursday, October 2, 2008, 10:01:05 AM, you wrote:
DP> Hi,
DP> are there any issue in ZFS boot using a pool with devices in a Storage
DP> Area Network (SAN)?
DP> I''m interested in both the SPARC and x86 platforms.
As long as your system (OBP or BIOS) is able to boot from these disks
it should be fine.
--
Best regards,
Robert mailto:milek at task.gda.pl
http://milek.blogspot.com
Hi, Milek!
I try to get Sun-Fire-280R to boot zfs-rpool, where 1 of 2 slices is in SAN.
here is a small listing of properties:
{0} ok show-devs
........
/pci at 8,600000/SUNW,qlc at 4
/pci at 8,600000/SUNW,qlc at 4/fp at 0,0
/pci at 8,600000/SUNW,qlc at 4/fp at 0,0/disk
/pci at 8,700000/QLGC,qla at 3
/pci at 8,700000/QLGC,qla at 1
/pci at 8,700000/scsi at 6,1
/pci at 8,700000/scsi at 6
..........
{0} ok show-disks
a) /ramdisk-root
b) /pci at 8,600000/SUNW,qlc at 4/fp at 0,0/disk
c) /pci at 8,700000/QLGC,qla at 3/sd
d) /pci at 8,700000/QLGC,qla at 1/sd
e) /pci at 8,700000/scsi at 6,1/disk
f) /pci at 8,700000/scsi at 6/disk
q) NO SELECTION
{0} ok printenv boot-device
boot-device = /pci at 8,700000/QLGC,qla at 3/fp at 0,0/ssd at
w2101001b3233b1b0,0:a /pci at 8,600000/SUNW,qlc at 4/fp at 0,0/disk at
w2100000c504f98ac,0:a disk net
{0} ok boot /pci at 8,700000/QLGC,qla at 3/fp at 0,0/ssd at
w2101001b3233b1b0,0:a
Resetting ...
Sun Fire 280R (2 X UltraSPARC-III+) , No Keyboard
Copyright 1998-2002 Sun Microsystems, Inc. All rights reserved.
OpenBoot 4.5, 3072 MB memory installed, Serial #54825423.
Ethernet address 0:3:ba:44:91:cf, Host ID: 834491cf.
Rebooting with command: boot /pci at 8,700000/QLGC,qla at 3/fp at 0,0/ssd at
w2101001b3233b1b0,0:a
Boot device: /pci at 8,700000/QLGC,qla at 3/fp at 0,0/ssd at
w2101001b3233b1b0,0:a File and args:
Evaluating: boot /pci at 8,700000/QLGC,qla at 3/fp at 0,0/ssd at
w2101001b3233b1b0,0:a
Can''t locate boot device
BUT!!!:
{0} ok " /pci at 8,700000/QLGC,qla at 3" select-dev
QLA2340 2.10 11/15/06
Firmware version 3.03.21
{0} ok show-children
********************** Fabric Attached Devices **********************
Adapter portId - 51d00
Device PortId 16300 DeviceId 0 Port WWN 2101001b322f3de7
Lun 0 DISK FALCON IPSTOR DISK v1.0
Device PortId 16400 DeviceId 1 Port WWN 2101001b3233b1b0
Lun 0 DISK FALCON IPSTOR DISK v1.0
{0} ok boot /pci at 8,700000/QLGC,qla at 3/sd at w2101001b322f3de7,0:a
Boot device: /pci at 8,700000/QLGC,qla at 3/sd at w2101001b322f3de7,0:a File
and args:
Fast Data Access MMU Miss
^^^^^^^^^^^^^^^^ i can not get any information about this trouble. Do you have
any idea?
WBW, Stanislav
--
This message posted from opensolaris.org
Doug Baker - Sun UK - Support Engineer
2008-Dec-16 14:28 UTC
[zfs-discuss] ZFS Boot on SAN
Stanislav Filippov wrote:> Hi, Milek! > I try to get Sun-Fire-280R to boot zfs-rpool, where 1 of 2 slices is in SAN. > > here is a small listing of properties: > > {0} ok show-devs > ........ > /pci at 8,600000/SUNW,qlc at 4 > /pci at 8,600000/SUNW,qlc at 4/fp at 0,0 > /pci at 8,600000/SUNW,qlc at 4/fp at 0,0/disk > /pci at 8,700000/QLGC,qla at 3 > /pci at 8,700000/QLGC,qla at 1 > /pci at 8,700000/scsi at 6,1 > /pci at 8,700000/scsi at 6 > .......... > > {0} ok show-disks > a) /ramdisk-root > b) /pci at 8,600000/SUNW,qlc at 4/fp at 0,0/disk > c) /pci at 8,700000/QLGC,qla at 3/sd > d) /pci at 8,700000/QLGC,qla at 1/sd > e) /pci at 8,700000/scsi at 6,1/disk > f) /pci at 8,700000/scsi at 6/disk > q) NO SELECTION > > {0} ok printenv boot-device > boot-device = /pci at 8,700000/QLGC,qla at 3/fp at 0,0/ssd at w2101001b3233b1b0,0:a /pci at 8,600000/SUNW,qlc at 4/fp at 0,0/disk at w2100000c504f98ac,0:a disk net > > {0} ok boot /pci at 8,700000/QLGC,qla at 3/fp at 0,0/ssd at w2101001b3233b1b0,0:a > Resetting ... > > Sun Fire 280R (2 X UltraSPARC-III+) , No Keyboard > Copyright 1998-2002 Sun Microsystems, Inc. All rights reserved. > OpenBoot 4.5, 3072 MB memory installed, Serial #54825423. > Ethernet address 0:3:ba:44:91:cf, Host ID: 834491cf. > > > > Rebooting with command: boot /pci at 8,700000/QLGC,qla at 3/fp at 0,0/ssd at w2101001b3233b1b0,0:a > Boot device: /pci at 8,700000/QLGC,qla at 3/fp at 0,0/ssd at w2101001b3233b1b0,0:a File and args: > Evaluating: boot /pci at 8,700000/QLGC,qla at 3/fp at 0,0/ssd at w2101001b3233b1b0,0:a > > Can''t locate boot device > > BUT!!!: > > {0} ok " /pci at 8,700000/QLGC,qla at 3" select-dev > QLA2340 2.10 11/15/06 > Firmware version 3.03.21 > > {0} ok show-children > ********************** Fabric Attached Devices ********************** > Adapter portId - 51d00 > Device PortId 16300 DeviceId 0 Port WWN 2101001b322f3de7 > Lun 0 DISK FALCON IPSTOR DISK v1.0 > > Device PortId 16400 DeviceId 1 Port WWN 2101001b3233b1b0 > Lun 0 DISK FALCON IPSTOR DISK v1.0 > > {0} ok boot /pci at 8,700000/QLGC,qla at 3/sd at w2101001b322f3de7,0:a > Boot device: /pci at 8,700000/QLGC,qla at 3/sd at w2101001b322f3de7,0:a File and args: > Fast Data Access MMU Miss > ^^^^^^^^^^^^^^^^ i can not get any information about this trouble. Do you have any idea? > WBW, StanislavThe OBP installed on this system is ancient and could be the cause of the problems you are seeing. Patch 118323-01 has the latest OBP for the 280R. Does the system boot ok if you try from the Internal disk? Regards, Douglas -- Dr Doug Baker Sun Microsystems Systems Support Engineer. UK Mission Critical Solution Centre. Tel : 0870 600 3222
I''d start by upgrading the fcode on the QLogic adapter as well as upgrading the obp on the server. http://filedownloads.qlogic.com/Files/TempDownlods/20340/qla23xxFcode2.12.tar.Z I''d also double check your LUN security on the storage array. Seems to me you might not have it configured properly, although if you managed to get Solaris installed on it already from this systems, that''s probably a moot point. --Tim -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20081216/ea97602b/attachment.html>
I''d first resolve the OBP and HBA fcode issues, then I''d verify that you are starting from a cold-reset system. "Fast Data Access MMU Miss" is a notorious problem on SF280R and is very often associated with attempting to reboot after a warm cycle of the system. We instituted a cold cycle of the platform years ago at every change to alleviate the problem, which seems more prevalent on very early issue mboards/CPU combos (we have a significant number of first release systems still doing sterling service!). HTH Craig On 16 Dec 2008, at 15:28, Tim wrote:> I''d start by upgrading the fcode on the QLogic adapter as well as > upgrading the obp on the server. > http://filedownloads.qlogic.com/Files/TempDownlods/20340/qla23xxFcode2.12.tar.Z > > I''d also double check your LUN security on the storage array. Seems > to me you might not have it configured properly, although if you > managed to get Solaris installed on it already from this systems, > that''s probably a moot point. > > --Tim > > > _______________________________________________ > zfs-discuss mailing list > zfs-discuss at opensolaris.org > http://mail.opensolaris.org/mailman/listinfo/zfs-discuss-- Craig Craig Morgan t: +44 (0)791 338 3190 f: +44 (0)870 705 1726 e: craig.morgan at sun.com ~ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ NOTICE: This email message is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message. ~ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Hi, All!
I''ve installed patch 118-323-01. Now i have OBP 4.16.4. After them
i''ve powered off and plugged off power supplies of server completly.
Is it cold reset?
{0} ok ok boot /pci at 8,700000/QLGC,qla at 3/sd at w2101001b322f3de7,0:a
Boot device: /pci at 8,700000/QLGC,qla at 3/sd at w2101001b322f3de7,0:a File
and args:
-
ERROR: /pci at 8,700000/QLGC,qla at 3: Last Trap: Fast Data Access MMU Miss
:(((((
{0} ok probe-scsi-all
/pci at 8,600000/SUNW,qlc at 4
LiD HA LUN --- Port WWN --- ----- Disk description -----
0 0 0 500000e0108766c1 FUJITSU MAP3735F SUN72G 1201
1 1 0 500000e010877a11 FUJITSU MAP3735F SUN72G 1201
/pci at 8,700000/QLGC,qla at 3
********************** Fabric Attached Devices **********************
Adapter portId - 51d00
Device PortId 16300 DeviceId 0 Port WWN 2101001b322f3de7
Lun 0 DISK FALCON IPSTOR DISK v1.0
Device PortId 16400 DeviceId 2 Port WWN 2101001b3233b1b0
Lun 0 DISK FALCON IPSTOR DISK v1.0
/pci at 8,700000/QLGC,qla at 1
********************** Fabric Attached Devices **********************
Adapter portId - 51d00
Device PortId 13300 DeviceId 0 Port WWN 2100001b320f3de7
Lun 0 DISK FALCON IPSTOR DISK v1.0
Device PortId 14300 DeviceId 1 Port WWN 2100001b3213b1b0
Lun 0 DISK FALCON IPSTOR DISK v1.0
/pci at 8,700000/scsi at 6,1
/pci at 8,700000/scsi at 6
Target 6
Unit 0 Removable Read Only device TOSHIBA DVD-ROM SD-M17111005
{0} ok
The boot from internal fc-hdd does work correct.
{0} ok boot /pci at 8,600000/SUNW,qlc at 4/fp at 0,0/disk at 0,0
Boot device: /pci at 8,600000/SUNW,qlc at 4/fp at 0,0/disk at 0,0 File and
args:
SunOS Release 5.10 Version Generic_137137-09 64-bit
Copyright 1983-2008 Sun Microsystems, Inc. All rights reserved.
Use is subject to license terms.
Hostname: andrew
Loading smf(5) service descriptions: 1/1
Reading ZFS config: done.
Mounting ZFS filesystems: (5/5)
andrew console login:
WBW, Stanislav
--
This message posted from opensolaris.org
Stanislav Filippov wrote:> {0} ok boot /pci at 8,700000/QLGC,qla at 3/sd at w2101001b322f3de7,0:a > Boot device: /pci at 8,700000/QLGC,qla at 3/sd at w2101001b322f3de7,0:a File and args: > Fast Data Access MMU Miss > ^^^^^^^^^^^^^^^^ i can not get any information about this trouble. Do you have any idea? > WBW, Stanislav >This error can occur if your bootblock is incorrect. Unfortunately, there isn''t an easy way to check to see if the bootblock is correct, but you can overwrite it with installboot. -- richard
Hi, All!
I''ve tried to install bootblock with installboot such as with DD too...
# zpool status
pool: rpool
state: ONLINE
scrub: none requested
config:
NAME STATE READ WRITE CKSUM
rpool ONLINE 0 0 0
mirror ONLINE 0 0 0
c2t2101001B3233B1B0d0s0 ONLINE 0 0 0
c3t0d0s0 ONLINE 0 0 0
errors: No known data errors
# installboot -F zfs /usr/platform/SUNW,Sun-Fire-280R/lib/fs/zfs/bootblk
/dev/rdsk/c2t2101001B3233B1B0d0s0
# dd if=/usr/platform/SUNW,Sun-Fire-280R/lib/fs/zfs/bootblk
of=/dev/rdsk/c2t2101001B3233B1B0d0s0 bs=1b iseek=15 oseek=1024 count=16
conv=sync
16+0 records in
16+0 records out
The result is the same. :((((
WBW, Stanislav
--
This message posted from opensolaris.org