Hello,
I have a Nevada 89 installation as Dom0 (With Crossbow BFU''d).
I''ve installed a Nevada 89 Domu on a ZFS volume that has shareiscsi
flag "ON". I am able to clearly use the DomU on the system where I
have installed it.
However, when I try to boot the Domu from a remote machine (iSCSI disk) I get
errors or crashes as follows. Could somebody kindly help me resolve this issue ?
Thanks,
Sumedha
Case 1:
Config File :
name = "iscsidomu"
memory = "1024"
bootloader = "/usr/lib/xen/bin/pygrub"
disk = [
''phy:/dev/rdsk/c4t010000144F585BE300002A00484DBAAEd0s2,0,w'' ]
vif = [ '''' ]
on_shutdown = ''destroy''
on_reboot = ''destroy''
on_crash = ''destroy''
Result:
Error: Boot loader didn''t return any data!
Case 2:
Here I copied the kernel and the ram disk from the domu
name = "iscsidomu"
memory = "1024"
disk = [
''phy:/dev/rdsk/c4t010000144F585BE300002A00484DBAAEd0s2,0,w'' ]
kernel = "/root/OSFILES/unix"
extra = "/platform/i86xpv/kernel/unix -kd -B
zfs-bootfs=tank/containerfs/fs1"
ramdisk = "/root/OSFILES/boot_archive"
vif = [ '''' ]
on_shutdown = ''destroy''
on_reboot = ''destroy''
on_crash = ''destroy''
Result :
[root@slipstream]# xm create -c domu.conf
Using config file "./domu.conf".
[root@slipstream]# Error: Device 0 (vbd) could not be connected. Backend device
not found.
Dom0 crashes with the following panic :
panic[cpu2]/thread=ffffff000edb7c80: mutex_enter: bad mutex, lp=ffffff02d4601130
owner=ffffff000f11bc80 thread=ffffff000edb7c80
ffffff000edb7690 unix:mutex_panic+73 ()
ffffff000edb7700 unix:mutex_vector_enter+452 ()
ffffff000edb77b0 xnb:xnb_to_peer+3a ()
ffffff000edb7880 xnb:xnb_copy_to_peer+5d1 ()
ffffff000edb78b0 xnbo:xnbo_from_mac+1c ()
ffffff000edb7930 mac:mac_do_rx+b9 ()
ffffff000edb7960 mac:mac_rx+1b ()
ffffff000edb79b0 vnic:vnic_rx+59 ()
ffffff000edb7a60 vnic:vnic_promisc_rx+12e ()
ffffff000edb7ac0 vnic:vnic_classifier_rx+43 ()
ffffff000edb7b40 mac:mac_do_rx+b9 ()
ffffff000edb7b70 mac:mac_rx+1b ()
ffffff000edb7bc0 e1000g:e1000g_intr+102 ()
ffffff000edb7c20 unix:av_dispatch_autovect+78 ()
ffffff000edb7c60 unix:dispatch_hardint+33 ()
ffffff000ed819d0 unix:switch_sp_and_call+13 ()
ffffff000ed81a20 unix:do_interrupt+9b ()
ffffff000ed81ad0 unix:xen_callback_handler+370 ()
ffffff000ed81ae0 unix:xen_callback+cd ()
ffffff000ed81be0 unix:HYPERVISOR_sched_op+29 ()
ffffff000ed81bf0 unix:HYPERVISOR_block+11 ()
ffffff000ed81c00 unix:mach_cpu_idle+12 ()
ffffff000ed81c40 unix:cpu_idle+e1 ()
ffffff000ed81c60 unix:idle+10e ()
ffffff000ed81c70 unix:thread_start+8 ()
syncing file systems... 8 2 done
dumping to /dev/dsk/c0t0d0s1, offset 108593152, content: kernel
After rebooting, I collected the logs as below :
1. /var/log/xen/xend.log
[2008-06-10 13:39:02 333] DEBUG (XendDomainInfo:84)
XendDomainInfo.create([''vm'', [''name'',
''iscsidomu''], [''memory'',
''1024''], [''on_reboot'',
''destroy''], [''on_crash'',
''destroy''], [''vcpus'', 1],
[''on_xend_start'', ''ignore''],
[''on_xend_stop'',
''shutdown''], [''image'',
[''linux'', [''kernel'',
''/root/OSFILES/unix''], [''ramdisk'',
''/root/OSFILES/boot_archive''], [''args'',
''/platform/i86xpv/kernel/unix -kd -B
zfs-bootfs=tank/containerfs/fs1'']]], [''device'',
[''vbd'', [''uname'', ''phy:/dev/rds
k/c4t010000144F585BE300002A00484DBAAEd0s2''], [''dev'',
''0''], [''mode'', ''w'']]],
[''device'', [''vif'']]])
[2008-06-10 13:39:02 333] DEBUG (XendDomainInfo:1552)
XendDomainInfo.constructDomain
[2008-06-10 13:39:02 333] DEBUG (balloon:116) Balloon: 131072 KiB free; need
2048; done.
[2008-06-10 13:39:02 333] DEBUG (XendDomain:435) Adding Domain: 5
[2008-06-10 13:39:02 333] DEBUG (XendDomainInfo:1612) XendDomainInfo.initDomain:
5 256
[2008-06-10 13:39:02 333] DEBUG (XendDomainInfo:1646)
_initDomain:shadow_memory=0x0, memory_static_max=0x40000000,
memory_static_min=0x0.
[2008-06-10 13:39:02 333] DEBUG (balloon:122) Balloon: 131064 KiB free; 0 to
scrub; need 1048576; retries: 20.
[2008-06-10 13:39:02 333] DEBUG (balloon:137) Balloon: setting dom0 target to
6918 MiB.
[2008-06-10 13:39:02 333] DEBUG (XendDomainInfo:689) Setting memory target of
domain Domain-0 (0) to 6918 MiB.
[2008-06-10 13:39:02 333] DEBUG (balloon:122) Balloon: 249848 KiB free; 0 to
scrub; need 1048576; retries: 20.
[2008-06-10 13:39:02 333] DEBUG (balloon:137) Balloon: setting dom0 target to
6910 MiB.
[2008-06-10 13:39:02 333] DEBUG (XendDomainInfo:689) Setting memory target of
domain Domain-0 (0) to 6910 MiB.
[2008-06-10 13:39:02 333] DEBUG (balloon:122) Balloon: 471032 KiB free; 0 to
scrub; need 1048576; retries: 20.
[2008-06-10 13:39:02 333] DEBUG (balloon:137) Balloon: setting dom0 target to
6912 MiB.
[2008-06-10 13:39:02 333] DEBUG (XendDomainInfo:689) Setting memory target of
domain Domain-0 (0) to 6912 MiB.
[2008-06-10 13:39:03 333] DEBUG (balloon:122) Balloon: 780280 KiB free; 0 to
scrub; need 1048576; retries: 20.
[2008-06-10 13:39:03 333] DEBUG (balloon:116) Balloon: 1055588 KiB free; need
1048576; done.
[2008-06-10 13:39:03 333] INFO (image:128) buildDomain os=linux dom=5 vcpus=1
[2008-06-10 13:39:03 333] DEBUG (image:203) domid = 5
[2008-06-10 13:39:03 333] DEBUG (image:204) memsize = 1024
[2008-06-10 13:39:03 333] DEBUG (image:205) image = /root/OSFILES/unix
[2008-06-10 13:39:03 333] DEBUG (image:206) store_evtchn = 1
[2008-06-10 13:39:03 333] DEBUG (image:207) console_evtchn = 2
[2008-06-10 13:39:03 333] DEBUG (image:208) cmdline =
/platform/i86xpv/kernel/unix -kd -B zfs-bootfs=tank/containerfs/fs1
[2008-06-10 13:39:03 333] DEBUG (image:209) ramdisk =
/root/OSFILES/boot_archive
[2008-06-10 13:39:03 333] DEBUG (image:210) vcpus = 1
[2008-06-10 13:39:03 333] DEBUG (image:211) features [2008-06-10 13:39:04
333] INFO (XendDomainInfo:1454) createDevice: vbd : {''uuid'':
''b75caa76-9274-4e2b-1154-2d1ab83d4c34'',
''bootable'': 1, ''driver'':
''paravirtualised'', ''dev'':
''0'', ''uname'':
''phy:/dev/rdsk/c4t010000144F585BE300002A00484DBA
AEd0s2'', ''mode'': ''w''}
[2008-06-10 13:39:04 333] DEBUG (DevController:118) DevController: writing
{''virtual-device'': ''0'',
''device-type'': ''disk'',
''protocol'': ''x86_32-abi'',
''backend-id'': ''0'',
''state'': ''1'', ''backend'':
''/local/domain/0/backend/vbd/5/0''} to /loca
l/domain/5/device/vbd/0.
[2008-06-10 13:39:04 333] DEBUG (DevController:120) DevController: writing
{''domain'': ''iscsidomu'',
''frontend'': ''/local/domain/5/device/vbd/0'',
''uuid'':
''b75caa76-9274-4e2b-1154-2d1ab83d4c34'',
''dev'': ''0'', ''state'':
''1'', ''params'': ''/dev/rd
sk/c4t010000144F585BE300002A00484DBAAEd0s2'', ''mode'':
''w'', ''online'': ''1'',
''frontend-id'': ''5'',
''type'': ''phy''} to
/local/domain/0/backend/vbd/5/0.
[2008-06-10 13:39:04 333] INFO (XendDomainInfo:1454) createDevice: vif :
{''mac'': ''00:16:3e:07:93:3a'',
''uuid'':
''01e04040-30a0-c256-3993-581094124a27''}
[2008-06-10 13:39:04 333] DEBUG (DevController:118) DevController: writing
{''mac'': ''00:16:3e:07:93:3a'',
''handle'': ''0'', ''protocol'':
''x86_32-abi'', ''backend-id'':
''0'', ''state'': ''1'',
''backend'':
''/local/domain/0/backend/vif/5/0''} to /local/d
omain/5/device/vif/0.
[2008-06-10 13:39:04 333] DEBUG (DevController:120) DevController: writing
{''domain'': ''iscsidomu'',
''frontend'': ''/local/domain/5/device/vif/0'',
''uuid'':
''01e04040-30a0-c256-3993-581094124a27'',
''script'': ''/usr/lib/xen/scripts/vif-vnic'',
''
mac'': ''00:16:3e:07:93:3a'',
''frontend-id'': ''5'',
''state'': ''1'', ''online'':
''1'', ''handle'': ''0''} to
/local/domain/0/backend/vif/5/0.
[2008-06-10 13:39:04 333] DEBUG (XendDomainInfo:2125) Storing VM details:
{''on_xend_stop'': ''shutdown'',
''shadow_memory'': ''0'',
''uuid'':
''07a4a19a-16cb-b441-1568-b4a91235cad3'',
''on_reboot'': ''destroy'',
''start_time'': ''1213130344.46'',
''on_pow
eroff'': ''destroy'', ''on_xend_start'':
''ignore'', ''on_crash'':
''destroy'', ''xend/restart_count'':
''0'', ''vcpus'': ''1'',
''vcpu_avail'': ''1'',
''image'': "(linux (kernel /root/OSFILES/unix) (ramdisk
/root/OSFILES/boot_archive) (args ''/platform/i86xpv/
kernel/unix -kd -B zfs-bootfs=tank/containerfs/fs1'') (notes (VIRT_BASE
1073741824) (PADDR_OFFSET 1073741824) (GUEST_OS Solaris) (LOADER generic)
(PAE_MODE ''yes,bimodal'') (XEN_VERSION xen-3.0)))",
''name'': ''iscsidomu''}
[2008-06-10 13:39:04 333] DEBUG (XendDomainInfo:937) Storing domain details:
{''console/ring-ref'': ''1943939'',
''image/pae-mode'': ''yes,bimodal'',
''console/port'': ''2'',
''name'': ''iscsidomu'',
''console/limit'': ''1048576'',
''image/paddr-offset'': ''
1073741824'', ''image/virt-base'':
''1073741824'', ''image/guest-os'':
''Solaris'', ''vm'':
''/vm/07a4a19a-16cb-b441-1568-b4a91235cad3'',
''domid'': ''5'',
''store/port'': ''1'',
''image/xen-version'': ''xen-3.0'',
''memory/target'': ''1048576'',
''store/ring-ref'':
''1943946'', ''image/loader'':
''generic'', ''cpu/0/availability'':
''online''}
[2008-06-10 13:39:04 333] DEBUG (DevController:118) DevController: writing
{''protocol'': ''x86_32-abi'',
''state'': ''1'',
''backend-id'': ''0'',
''backend'':
''/local/domain/0/backend/console/5/0''} to
/local/domain/5/device/console/0.
[2008-06-10 13:39:04 333] DEBUG (DevController:120) DevController: writing
{''domain'': ''iscsidomu'',
''frontend'':
''/local/domain/5/device/console/0'', ''uuid'':
''753d6b38-7629-e887-c3c5-fdaed0f5b37a'',
''frontend-id'': ''5'',
''state'': ''1'', ''locat
ion'': ''2'', ''online'':
''1'', ''protocol'': ''vt100''}
to /local/domain/0/backend/console/5/0.
[2008-06-10 13:39:04 333] DEBUG (XendDomainInfo:1021)
XendDomainInfo.handleShutdownWatch
[2008-06-10 13:39:04 333] DEBUG (DevController:151) Waiting for devices vif.
[2008-06-10 13:39:04 333] DEBUG (DevController:156) Waiting for 0.
[2008-06-10 13:39:04 333] DEBUG (DevController:590) hotplugStatusCallback
/local/domain/0/backend/vif/5/0/hotplug-status.
[2008-06-10 13:39:05 333] DEBUG (DevController:590) hotplugStatusCallback
/local/domain/0/backend/vif/5/0/hotplug-status.
[2008-06-10 13:39:05 333] DEBUG (DevController:604) hotplugStatusCallback 1.
[2008-06-10 13:39:05 333] DEBUG (DevController:151) Waiting for devices usb.
[2008-06-10 13:39:05 333] DEBUG (DevController:151) Waiting for devices vbd.
[2008-06-10 13:39:05 333] DEBUG (DevController:156) Waiting for 0.
[2008-06-10 13:39:05 333] DEBUG (DevController:590) hotplugStatusCallback
/local/domain/0/backend/vbd/5/0/hotplug-status.
[2008-06-10 13:39:05 333] DEBUG (DevController:604) hotplugStatusCallback 2.
[2008-06-10 13:39:05 333] DEBUG (XendDomainInfo:1811) XendDomainInfo.destroy:
domid=5
[2008-06-10 13:39:05 333] DEBUG (XendDomainInfo:1830)
XendDomainInfo.destroyDomain(5)
[2008-06-10 13:39:06 333] DEBUG (XendDomainInfo:1476) Removing vif/0
[2008-06-10 13:39:06 333] DEBUG (XendDomainInfo:594)
XendDomainInfo.destroyDevice: deviceClass = vif, device = vif/0
[2008-06-10 13:39:06 333] DEBUG (XendDomainInfo:1476) Removing vbd/0
[2008-06-10 13:39:06 333] DEBUG (XendDomainInfo:594)
XendDomainInfo.destroyDevice: deviceClass = vbd, device = vbd/0
[2008-06-10 13:39:06 333] DEBUG (XendDomainInfo:1476) Removing console/0
[2008-06-10 13:39:06 333] DEBUG (XendDomainInfo:594)
XendDomainInfo.destroyDevice: deviceClass = console, device = console/0
What could be the problem ?
Thanks,
Sumedha
This message posted from opensolaris.org
Just to make it clearer, When Dom0 is on the local machine, with and without Crossbow BFU''d, DomU boots and works fine. However, the problem is only when the ZFS volume is used as a DomU remotely using iSCSI. The remote machine has a Nevada 89, without anything else BFU''d. The DomU is also a fresh installation of Nevada 89. Thanks, Sumedha This message posted from opensolaris.org
Seems like your iSCSI disk cannot be opened correctly... Did you see any error from /var/log/xen/xpvd-event.log? Max Sumedha Swamy wrote:> Hello, > I have a Nevada 89 installation as Dom0 (With Crossbow BFU''d). I''ve installed a Nevada 89 Domu on a ZFS volume that has shareiscsi flag "ON". I am able to clearly use the DomU on the system where I have installed it. > > However, when I try to boot the Domu from a remote machine (iSCSI disk) I get errors or crashes as follows. Could somebody kindly help me resolve this issue ? > Thanks, > Sumedha > > Case 1: > Config File : > name = "iscsidomu" > memory = "1024" > bootloader = "/usr/lib/xen/bin/pygrub" > disk = [ ''phy:/dev/rdsk/c4t010000144F585BE300002A00484DBAAEd0s2,0,w'' ] > vif = [ '''' ] > on_shutdown = ''destroy'' > on_reboot = ''destroy'' > on_crash = ''destroy'' > > Result: > Error: Boot loader didn''t return any data! > > > Case 2: > Here I copied the kernel and the ram disk from the domu > > name = "iscsidomu" > memory = "1024" > disk = [ ''phy:/dev/rdsk/c4t010000144F585BE300002A00484DBAAEd0s2,0,w'' ] > kernel = "/root/OSFILES/unix" > extra = "/platform/i86xpv/kernel/unix -kd -B zfs-bootfs=tank/containerfs/fs1" > ramdisk = "/root/OSFILES/boot_archive" > vif = [ '''' ] > on_shutdown = ''destroy'' > on_reboot = ''destroy'' > on_crash = ''destroy'' > > Result : > [root@slipstream]# xm create -c domu.conf > Using config file "./domu.conf". > [root@slipstream]# Error: Device 0 (vbd) could not be connected. Backend device not found. > > Dom0 crashes with the following panic : > > panic[cpu2]/thread=ffffff000edb7c80: mutex_enter: bad mutex, lp=ffffff02d4601130 owner=ffffff000f11bc80 thread=ffffff000edb7c80 > > ffffff000edb7690 unix:mutex_panic+73 () > ffffff000edb7700 unix:mutex_vector_enter+452 () > ffffff000edb77b0 xnb:xnb_to_peer+3a () > ffffff000edb7880 xnb:xnb_copy_to_peer+5d1 () > ffffff000edb78b0 xnbo:xnbo_from_mac+1c () > ffffff000edb7930 mac:mac_do_rx+b9 () > ffffff000edb7960 mac:mac_rx+1b () > ffffff000edb79b0 vnic:vnic_rx+59 () > ffffff000edb7a60 vnic:vnic_promisc_rx+12e () > ffffff000edb7ac0 vnic:vnic_classifier_rx+43 () > ffffff000edb7b40 mac:mac_do_rx+b9 () > ffffff000edb7b70 mac:mac_rx+1b () > ffffff000edb7bc0 e1000g:e1000g_intr+102 () > ffffff000edb7c20 unix:av_dispatch_autovect+78 () > ffffff000edb7c60 unix:dispatch_hardint+33 () > ffffff000ed819d0 unix:switch_sp_and_call+13 () > ffffff000ed81a20 unix:do_interrupt+9b () > ffffff000ed81ad0 unix:xen_callback_handler+370 () > ffffff000ed81ae0 unix:xen_callback+cd () > ffffff000ed81be0 unix:HYPERVISOR_sched_op+29 () > ffffff000ed81bf0 unix:HYPERVISOR_block+11 () > ffffff000ed81c00 unix:mach_cpu_idle+12 () > ffffff000ed81c40 unix:cpu_idle+e1 () > ffffff000ed81c60 unix:idle+10e () > ffffff000ed81c70 unix:thread_start+8 () > > syncing file systems... 8 2 done > dumping to /dev/dsk/c0t0d0s1, offset 108593152, content: kernel > > > After rebooting, I collected the logs as below : > 1. /var/log/xen/xend.log > > [2008-06-10 13:39:02 333] DEBUG (XendDomainInfo:84) XendDomainInfo.create([''vm'', [''name'', ''iscsidomu''], [''memory'', ''1024''], [''on_reboot'', ''destroy''], [''on_crash'', ''destroy''], [''vcpus'', 1], [''on_xend_start'', ''ignore''], [''on_xend_stop'', > ''shutdown''], [''image'', [''linux'', [''kernel'', ''/root/OSFILES/unix''], [''ramdisk'', ''/root/OSFILES/boot_archive''], [''args'', ''/platform/i86xpv/kernel/unix -kd -B zfs-bootfs=tank/containerfs/fs1'']]], [''device'', [''vbd'', [''uname'', ''phy:/dev/rds > k/c4t010000144F585BE300002A00484DBAAEd0s2''], [''dev'', ''0''], [''mode'', ''w'']]], [''device'', [''vif'']]]) > [2008-06-10 13:39:02 333] DEBUG (XendDomainInfo:1552) XendDomainInfo.constructDomain > [2008-06-10 13:39:02 333] DEBUG (balloon:116) Balloon: 131072 KiB free; need 2048; done. > [2008-06-10 13:39:02 333] DEBUG (XendDomain:435) Adding Domain: 5 > [2008-06-10 13:39:02 333] DEBUG (XendDomainInfo:1612) XendDomainInfo.initDomain: 5 256 > [2008-06-10 13:39:02 333] DEBUG (XendDomainInfo:1646) _initDomain:shadow_memory=0x0, memory_static_max=0x40000000, memory_static_min=0x0. > [2008-06-10 13:39:02 333] DEBUG (balloon:122) Balloon: 131064 KiB free; 0 to scrub; need 1048576; retries: 20. > [2008-06-10 13:39:02 333] DEBUG (balloon:137) Balloon: setting dom0 target to 6918 MiB. > [2008-06-10 13:39:02 333] DEBUG (XendDomainInfo:689) Setting memory target of domain Domain-0 (0) to 6918 MiB. > [2008-06-10 13:39:02 333] DEBUG (balloon:122) Balloon: 249848 KiB free; 0 to scrub; need 1048576; retries: 20. > [2008-06-10 13:39:02 333] DEBUG (balloon:137) Balloon: setting dom0 target to 6910 MiB. > [2008-06-10 13:39:02 333] DEBUG (XendDomainInfo:689) Setting memory target of domain Domain-0 (0) to 6910 MiB. > [2008-06-10 13:39:02 333] DEBUG (balloon:122) Balloon: 471032 KiB free; 0 to scrub; need 1048576; retries: 20. > [2008-06-10 13:39:02 333] DEBUG (balloon:137) Balloon: setting dom0 target to 6912 MiB. > [2008-06-10 13:39:02 333] DEBUG (XendDomainInfo:689) Setting memory target of domain Domain-0 (0) to 6912 MiB. > [2008-06-10 13:39:03 333] DEBUG (balloon:122) Balloon: 780280 KiB free; 0 to scrub; need 1048576; retries: 20. > [2008-06-10 13:39:03 333] DEBUG (balloon:116) Balloon: 1055588 KiB free; need 1048576; done. > [2008-06-10 13:39:03 333] INFO (image:128) buildDomain os=linux dom=5 vcpus=1 > [2008-06-10 13:39:03 333] DEBUG (image:203) domid = 5 > [2008-06-10 13:39:03 333] DEBUG (image:204) memsize = 1024 > [2008-06-10 13:39:03 333] DEBUG (image:205) image = /root/OSFILES/unix > [2008-06-10 13:39:03 333] DEBUG (image:206) store_evtchn = 1 > [2008-06-10 13:39:03 333] DEBUG (image:207) console_evtchn = 2 > [2008-06-10 13:39:03 333] DEBUG (image:208) cmdline = /platform/i86xpv/kernel/unix -kd -B zfs-bootfs=tank/containerfs/fs1 > [2008-06-10 13:39:03 333] DEBUG (image:209) ramdisk = /root/OSFILES/boot_archive > [2008-06-10 13:39:03 333] DEBUG (image:210) vcpus = 1 > [2008-06-10 13:39:03 333] DEBUG (image:211) features > [2008-06-10 13:39:04 333] INFO (XendDomainInfo:1454) createDevice: vbd : {''uuid'': ''b75caa76-9274-4e2b-1154-2d1ab83d4c34'', ''bootable'': 1, ''driver'': ''paravirtualised'', ''dev'': ''0'', ''uname'': ''phy:/dev/rdsk/c4t010000144F585BE300002A00484DBA > AEd0s2'', ''mode'': ''w''} > [2008-06-10 13:39:04 333] DEBUG (DevController:118) DevController: writing {''virtual-device'': ''0'', ''device-type'': ''disk'', ''protocol'': ''x86_32-abi'', ''backend-id'': ''0'', ''state'': ''1'', ''backend'': ''/local/domain/0/backend/vbd/5/0''} to /loca > l/domain/5/device/vbd/0. > [2008-06-10 13:39:04 333] DEBUG (DevController:120) DevController: writing {''domain'': ''iscsidomu'', ''frontend'': ''/local/domain/5/device/vbd/0'', ''uuid'': ''b75caa76-9274-4e2b-1154-2d1ab83d4c34'', ''dev'': ''0'', ''state'': ''1'', ''params'': ''/dev/rd > sk/c4t010000144F585BE300002A00484DBAAEd0s2'', ''mode'': ''w'', ''online'': ''1'', ''frontend-id'': ''5'', ''type'': ''phy''} to /local/domain/0/backend/vbd/5/0. > [2008-06-10 13:39:04 333] INFO (XendDomainInfo:1454) createDevice: vif : {''mac'': ''00:16:3e:07:93:3a'', ''uuid'': ''01e04040-30a0-c256-3993-581094124a27''} > [2008-06-10 13:39:04 333] DEBUG (DevController:118) DevController: writing {''mac'': ''00:16:3e:07:93:3a'', ''handle'': ''0'', ''protocol'': ''x86_32-abi'', ''backend-id'': ''0'', ''state'': ''1'', ''backend'': ''/local/domain/0/backend/vif/5/0''} to /local/d > omain/5/device/vif/0. > [2008-06-10 13:39:04 333] DEBUG (DevController:120) DevController: writing {''domain'': ''iscsidomu'', ''frontend'': ''/local/domain/5/device/vif/0'', ''uuid'': ''01e04040-30a0-c256-3993-581094124a27'', ''script'': ''/usr/lib/xen/scripts/vif-vnic'', '' > mac'': ''00:16:3e:07:93:3a'', ''frontend-id'': ''5'', ''state'': ''1'', ''online'': ''1'', ''handle'': ''0''} to /local/domain/0/backend/vif/5/0. > [2008-06-10 13:39:04 333] DEBUG (XendDomainInfo:2125) Storing VM details: {''on_xend_stop'': ''shutdown'', ''shadow_memory'': ''0'', ''uuid'': ''07a4a19a-16cb-b441-1568-b4a91235cad3'', ''on_reboot'': ''destroy'', ''start_time'': ''1213130344.46'', ''on_pow > eroff'': ''destroy'', ''on_xend_start'': ''ignore'', ''on_crash'': ''destroy'', ''xend/restart_count'': ''0'', ''vcpus'': ''1'', ''vcpu_avail'': ''1'', ''image'': "(linux (kernel /root/OSFILES/unix) (ramdisk /root/OSFILES/boot_archive) (args ''/platform/i86xpv/ > kernel/unix -kd -B zfs-bootfs=tank/containerfs/fs1'') (notes (VIRT_BASE 1073741824) (PADDR_OFFSET 1073741824) (GUEST_OS Solaris) (LOADER generic) (PAE_MODE ''yes,bimodal'') (XEN_VERSION xen-3.0)))", ''name'': ''iscsidomu''} > [2008-06-10 13:39:04 333] DEBUG (XendDomainInfo:937) Storing domain details: {''console/ring-ref'': ''1943939'', ''image/pae-mode'': ''yes,bimodal'', ''console/port'': ''2'', ''name'': ''iscsidomu'', ''console/limit'': ''1048576'', ''image/paddr-offset'': '' > 1073741824'', ''image/virt-base'': ''1073741824'', ''image/guest-os'': ''Solaris'', ''vm'': ''/vm/07a4a19a-16cb-b441-1568-b4a91235cad3'', ''domid'': ''5'', ''store/port'': ''1'', ''image/xen-version'': ''xen-3.0'', ''memory/target'': ''1048576'', ''store/ring-ref'': > ''1943946'', ''image/loader'': ''generic'', ''cpu/0/availability'': ''online''} > [2008-06-10 13:39:04 333] DEBUG (DevController:118) DevController: writing {''protocol'': ''x86_32-abi'', ''state'': ''1'', ''backend-id'': ''0'', ''backend'': ''/local/domain/0/backend/console/5/0''} to /local/domain/5/device/console/0. > [2008-06-10 13:39:04 333] DEBUG (DevController:120) DevController: writing {''domain'': ''iscsidomu'', ''frontend'': ''/local/domain/5/device/console/0'', ''uuid'': ''753d6b38-7629-e887-c3c5-fdaed0f5b37a'', ''frontend-id'': ''5'', ''state'': ''1'', ''locat > ion'': ''2'', ''online'': ''1'', ''protocol'': ''vt100''} to /local/domain/0/backend/console/5/0. > [2008-06-10 13:39:04 333] DEBUG (XendDomainInfo:1021) XendDomainInfo.handleShutdownWatch > [2008-06-10 13:39:04 333] DEBUG (DevController:151) Waiting for devices vif. > [2008-06-10 13:39:04 333] DEBUG (DevController:156) Waiting for 0. > [2008-06-10 13:39:04 333] DEBUG (DevController:590) hotplugStatusCallback /local/domain/0/backend/vif/5/0/hotplug-status. > [2008-06-10 13:39:05 333] DEBUG (DevController:590) hotplugStatusCallback /local/domain/0/backend/vif/5/0/hotplug-status. > [2008-06-10 13:39:05 333] DEBUG (DevController:604) hotplugStatusCallback 1. > [2008-06-10 13:39:05 333] DEBUG (DevController:151) Waiting for devices usb. > [2008-06-10 13:39:05 333] DEBUG (DevController:151) Waiting for devices vbd. > [2008-06-10 13:39:05 333] DEBUG (DevController:156) Waiting for 0. > [2008-06-10 13:39:05 333] DEBUG (DevController:590) hotplugStatusCallback /local/domain/0/backend/vbd/5/0/hotplug-status. > [2008-06-10 13:39:05 333] DEBUG (DevController:604) hotplugStatusCallback 2. > [2008-06-10 13:39:05 333] DEBUG (XendDomainInfo:1811) XendDomainInfo.destroy: domid=5 > [2008-06-10 13:39:05 333] DEBUG (XendDomainInfo:1830) XendDomainInfo.destroyDomain(5) > [2008-06-10 13:39:06 333] DEBUG (XendDomainInfo:1476) Removing vif/0 > [2008-06-10 13:39:06 333] DEBUG (XendDomainInfo:594) XendDomainInfo.destroyDevice: deviceClass = vif, device = vif/0 > [2008-06-10 13:39:06 333] DEBUG (XendDomainInfo:1476) Removing vbd/0 > [2008-06-10 13:39:06 333] DEBUG (XendDomainInfo:594) XendDomainInfo.destroyDevice: deviceClass = vbd, device = vbd/0 > [2008-06-10 13:39:06 333] DEBUG (XendDomainInfo:1476) Removing console/0 > [2008-06-10 13:39:06 333] DEBUG (XendDomainInfo:594) XendDomainInfo.destroyDevice: deviceClass = console, device = console/0 > > > What could be the problem ? > > Thanks, > Sumedha > > > This message posted from opensolaris.org > _______________________________________________ > xen-discuss mailing list > xen-discuss@opensolaris.org >
> However, when I try to boot the Domu from a remote > machine (iSCSI disk) I get errors or crashes as > follows. Could somebody kindly help me resolve this > issue ?> Case 1: > Config File : > name = "iscsidomu" > memory = "1024" > bootloader = "/usr/lib/xen/bin/pygrub" > disk = [ > ''phy:/dev/rdsk/c4t010000144F585BE300002A00484DBAAEd0s2,0,w'' ] > vif = [ '''' ] > on_shutdown = ''destroy'' > on_reboot = ''destroy'' > on_crash = ''destroy'' > > Result: > Error: Boot loader didn''t return any data!Does it work when you use the block device instead of the character device in that disk / phy: device line? /usr/lib/xen/scripts/vbd-event checks for a block device for type phy: backends, and disonnects otherwise: case "${action}" in add) type=`xenstore-read ${path}/type` file=`xenstore-read ${path}/params` if [ "${type}" = "file" ]; then if [ ! -f "${file}" ]; then disconnect fi elif [ "${type}" = "phy" ]; then if [ ! -b "${file}" ]; then <<<<<<<<<<<<<<<<<<< disconnect fi else disconnect fi This message posted from opensolaris.org
Hello,
I used a block device as suggested, and there is some progress. The kernel
starts up and immediately panics with the following message :
Using config file "./domu.conf".
Started domain iscsidomu
v3.1.4-xvm chgset ''Mon Apr 28 23:11:15 2008
-0700 15872:0f22805887a1''
SunOS Release 5.11 Version snv_89 32-bit
Copyright 1983-2008 Sun Microsystems, Inc. All rights reserved.
Use is subject to license terms.
WARNING: /xpvd/xdf@0 (xdf0):
Corrupt label - bad geometry
Label says 41913585 blocks; Drive says 41881455 blocks
WARNING: /xpvd/xdf@0 (xdf0):
Corrupt label - bad geometry
Label says 41913585 blocks; Drive says 41881455 blocks
NOTICE: mount: not a UFS magic number (0x0)
panic[cpu0]/thread=f50299a0: cannot mount root path /xpvd/xdf@0:a
f5053b6c genunix:rootconf+10b (0, 1, f5029110, 0, )
f5053b90 genunix:vfs_mountroot+54 (f4c00010, f504f9b8,)
f5053ba0 genunix:main+b4 ()
skipping system dump - no dump device configured
rebooting...
Just to reiterate, the destination iSCSI target has a ZFS file system.
Here is a structure of the FIle system on dom0 :
[root@dom0]$ zfs list
NAME USED AVAIL REFER MOUNTPOINT
tank 20.0G 114G 19K /tank
tank/containerfs 20.0G 114G 20K /tank/containerfs
tank/containerfs/fs1 20G 128G 5.61G -
"tank/containerfs/fs1 " is where nevada 89 is installed using
virt-install.
The configuration file where this panic happens is :
name = "iscsidomu"
memory = "1024"
disk = [
''phy:/devices/scsi_vhci/disk@g010000144f585be300002a00484dbaae:c,0,w''
]
kernel = "/root/OSFILES/unix"
extra = "/platform/i86xpv/kernel/unix"
ramdisk = "/root/OSFILES/boot_archive"
vif = [ '''' ]
on_shutdown = ''destroy''
on_reboot = ''destroy''
on_crash = ''destroy''
Next, I tried setting zfs-bootfs parameter. The configuration file looks as
follows :
name = "iscsidomu"
memory = "1024"
disk = [
''phy:/devices/scsi_vhci/disk@g010000144f585be300002a00484dbaae:c,0,w''
]
kernel = "/root/OSFILES/unix"
extra = "/platform/i86xpv/kernel/unix -B
zfs-bootfs=tank/containerfs/fs1"
ramdisk = "/root/OSFILES/boot_archive"
vif = [ '''' ]
on_shutdown = ''destroy''
on_reboot = ''destroy''
on_crash = ''destroy''
However, in this case too, I get a kernel panic with dom0 rebooting. The dump is
as follows :
Using config file "./domu.conf".
Started domain iscsidomu
v3.1.4-xvm chgset ''Mon Apr 28 23:11:15 2008
-0700 15872:0f22805887a1''
SunOS Release 5.11 Version snv_89 32-bit
Copyright 1983-2008 Sun Microsystems, Inc. All rights reserved.
Use is subject to license terms.
WARNING: /xpvd/xdf@0 (xdf0):
Corrupt label - bad geometry
Label says 41913585 blocks; Drive says 41881455 blocks
NOTICE:
***************************************************
* This device is not bootable! *
* It is either offlined or detached or faulted. *
* Please try to boot from a different device. *
***************************************************
NOTICE:
spa_import_rootpool: error 22
panic[cpu0]/thread=f50299a0: cannot mount root path /xpvd/xdf@0:a
f5053b6c genunix:rootconf+10b (0, 1, f5029110, 0, )
f5053b90 genunix:vfs_mountroot+54 (f4c00010, f504f9b8,)
f5053ba0 genunix:main+b4 ()
skipping system dump - no dump device configured
rebooting...
What could be going wrong here ?
Thanks,
Sumedha
This message posted from opensolaris.org
> Case 2: > Here I copied the kernel and the ram disk from the domu > > name = "iscsidomu" > memory = "1024" > disk = [ ''phy:/dev/rdsk/c4t010000144F585BE300002A00484DBAAEd0s2,0,w'' ] > kernel = "/root/OSFILES/unix" > extra = "/platform/i86xpv/kernel/unix -kd -B zfs-bootfs=tank/containerfs/fs1"Hmm, I''m not sure if you can use a full zfs name for the zfs-bootfs property. I think the kernel needs something like "tank/1234", where 1234 is the ID for a zfs filesystem. zdb tank/containerfs/fs1 should list that ID. GRUB does this translation when it expands the $ZFS-BOOTFS token. This message posted from opensolaris.org