Bruce Edge
2009-Oct-21 19:04 UTC
[Xen-devel] HVM NFS boot problem with 2.6.31 dom0 and xen 3.5
Goal: NFS boot HVM image Result: The domU hangs immediately after the PXE TFTP transfer of menu.lst Are there any HOWTOs on NFS with HVM? All the ones I have found are for PV VMs. I also tried the 2.6.31.1 pv-ops kernel with the same results. I can boot non NFS images of the same target with no problem. Are there any grub tricks I need to know? I suspect the problem is in my domU config file (below). Has anyone managed to get an HVM NFS boot working? If so, please, can I have the details of the configuration? I know have the tftp server and dhcp setup right as I can boot non-xen images fine. Here''s the console output: #> xm create -c /import/bedge/static-nfs.cfg Using config file "/import/bedge/static-nfs.cfg". Started domain dpm (id=20) Probing pci nic... [PXE]Hunting for pixies...found !PXE at 0009ce60...ok configfile: (nd)/import/tonic/pxe/kaan-14-dpm/menu.lst bootp called in PXE TFTP mode dhcp called in PXE TFTP mode ...then nothing. I know the grub menu.lst was transferred because the tftp server logs: Oct 20 12:13:31 tonic in.tftpd[20901]: RRQ from 135.149.76.94 filename /import/tonic/pxe/lib/pxegrub Oct 20 12:13:31 tonic in.tftpd[20902]: RRQ from 135.149.76.94 filename import/tonic/pxe/kaan-14-dpm/menu.lst Oct 20 12:13:32 tonic in.tftpd[20903]: RRQ from 135.149.76.94 filename import/tonic/pxe/kaan-14-dpm/menu.lst This is the config: #bootloader = ''/usr/bin/pygrub'' kernel = ''/usr/lib64/xen/boot/hvmloader'' builder=''hvm'' memory = 4096 memory_dynamic_max = 2048 name = "dpm" hap=0 vcpus=1 #vif = [ ''type=ioemu, bridge=xenbr0, mac=00:16:3e:00:14:01'' ] #vif = [ ''type=ioemu, bridge=eth0, mac=00:16:3e:00:14:01'' ] vif = [ ''type=ioemu, mac=00:16:3e:00:14:01'' ] disk = [ ''phy:system/dpm_root_0,xvda:sda1,w'', ''phy:system/dpm_swap,xvdb:sda2,w'' ] boot="n" device_model = ''/usr/lib64/xen/bin/qemu-dm'' #pci = [''17:00.0'', ''17:00.1''] vnc=0 vncunused=1 nographic=0 apic=1 acpi=1 vnclisten="0.0.0.0" vncpasswd='''' stdvga=0 serial=''pty'' usbdevice=''tablet'' on_poweroff = ''destroy'' on_reboot = ''restart'' on_crash = ''restart'' Here''s the Xen console output: (XEN) HVM20: HVM Loader (XEN) HVM20: Detected Xen v3.5-unstable (XEN) HVM20: CPU speed is 1000 MHz (XEN) irq.c:243: Dom20 PCI link 0 changed 0 -> 5 (XEN) HVM20: PCI-ISA link 0 routed to IRQ5 (XEN) irq.c:243: Dom20 PCI link 1 changed 0 -> 10 (XEN) HVM20: PCI-ISA link 1 routed to IRQ10 (XEN) irq.c:243: Dom20 PCI link 2 changed 0 -> 11 (XEN) HVM20: PCI-ISA link 2 routed to IRQ11 (XEN) irq.c:243: Dom20 PCI link 3 changed 0 -> 5 (XEN) HVM20: PCI-ISA link 3 routed to IRQ5 (XEN) HVM20: pci dev 01:2 INTD->IRQ5 (XEN) HVM20: pci dev 01:3 INTA->IRQ10 (XEN) HVM20: pci dev 03:0 INTA->IRQ5 (XEN) HVM20: pci dev 04:0 INTA->IRQ5 (XEN) HVM20: pci dev 02:0 bar 10 size 02000000: f0000008 (XEN) HVM20: pci dev 03:0 bar 14 size 01000000: f2000008 (XEN) HVM20: pci dev 02:0 bar 14 size 00001000: f3000000 (XEN) HVM20: pci dev 03:0 bar 10 size 00000100: 0000c001 (XEN) HVM20: pci dev 04:0 bar 10 size 00000100: 0000c101 (XEN) HVM20: pci dev 04:0 bar 14 size 00000100: f3001000 (XEN) HVM20: pci dev 01:2 bar 20 size 00000020: 0000c201 (XEN) HVM20: pci dev 01:1 bar 20 size 00000010: 0000c221 (XEN) HVM20: Multiprocessor initialisation: (XEN) HVM20: - CPU0 ... 40-bit phys ... fixed MTRRs ... var MTRRs [2/8] ... done. (XEN) HVM20: Testing HVM environment: (XEN) HVM20: - REP INSB across page boundaries ... passed (XEN) HVM20: - GS base MSRs and SWAPGS ... passed (XEN) HVM20: Passed 2 of 2 tests (XEN) HVM20: Writing SMBIOS tables ... (XEN) HVM20: Loading ROMBIOS ... (XEN) HVM20: 9788 bytes of ROMBIOS high-memory extensions: (XEN) HVM20: Relocating to 0xfc000000-0xfc00263c ... done (XEN) HVM20: Creating MP tables ... (XEN) HVM20: Loading Cirrus VGABIOS ... (XEN) HVM20: Loading PCI Option ROM ... (XEN) HVM20: - Manufacturer: http://etherboot.org (XEN) HVM20: - Product name: gPXE (XEN) HVM20: Loading ACPI ... (XEN) HVM20: - Lo data: 000ea020-000ea04f (XEN) HVM20: - Hi data: fc002800-fc011dcf (XEN) HVM20: vm86 TSS at fc012000 (XEN) HVM20: BIOS map: (XEN) HVM20: c0000-c8fff: VGA BIOS (XEN) HVM20: c9000-d57ff: Etherboot ROM (XEN) HVM20: eb000-eb14e: SMBIOS tables (XEN) HVM20: f0000-fffff: Main BIOS (XEN) HVM20: Invoking ROMBIOS ... (XEN) HVM20: $Revision: 1.221 $ $Date: 2008/12/07 17:32:29 $ (XEN) stdvga.c:147:d20 entering stdvga and caching modes (XEN) HVM20: VGABios $Id: vgabios.c,v 1.67 2008/01/27 09:44:12 vruppert Exp $ (XEN) HVM20: Bochs BIOS - build: 06/23/99 (XEN) HVM20: $Revision: 1.221 $ $Date: 2008/12/07 17:32:29 $ (XEN) HVM20: Options: apmbios pcibios eltorito PMM (XEN) HVM20: (XEN) HVM20: ata0-0: PCHS=16383/16/63 translation=lba LCHS=1024/255/63 (XEN) HVM20: ata0 master: QEMU HARDDISK ATA-7 Hard-Disk (8192 MBytes) (XEN) HVM20: ata0-1: PCHS=4161/16/63 translation=lba LCHS=520/128/63 (XEN) HVM20: ata0 slave: QEMU HARDDISK ATA-7 Hard-Disk (2048 MBytes) (XEN) HVM20: (XEN) HVM20: (XEN) HVM20: (XEN) HVM20: Press F12 for boot menu. (XEN) HVM20: (XEN) HVM20: Booting from Network... (XEN) HVM20: Booting from c900:0281 (XEN) HVM20: int13_harddisk: function 41, unmapped device for ELDL=82 (XEN) HVM20: int13_harddisk: function 08, unmapped device for ELDL=82 (XEN) HVM20: *** int 15h function AX=00c0, BX=0000 not yet supported! ...and here''s the xen logs: ==> xend.log <=[2009-10-20 12:13:24 11382] DEBUG (XendDomainInfo:99) XendDomainInfo.create([''vm'', [''name'', ''dpm''], [''memory'', 4096], [''on_poweroff'', ''destroy''], [''on_reboot'', ''restart''], [''on_crash'', ''restart''], [''vcpus'', 1], [''on_xend_start'', ''ignore''], [''on_xend_stop'', ''ignore''], [''image'', [''hvm'', [''kernel'', ''/usr/lib64/xen/boot/hvmloader''], [''videoram'', 4], [''device_model'', ''/usr/lib64/xen/bin/qemu-dm''], [''pae'', 1], [''vcpus'', 1], [''boot'', ''n''], [''fda'', ''''], [''fdb'', ''''], [''timer_mode'', 1], [''localtime'', 0], [''serial'', ''pty''], [''stdvga'', 0], [''isa'', 0], [''nographic'', 0], [''soundhw'', ''''], [''vnc'', 0], [''vncunused'', 1], [''vnclisten'', ''0.0.0.0''], [''xauthority'', ''/root/.Xauthority''], [''rtc_timeoffset'', 0], [''monitor'', 0], [''acpi'', 1], [''apic'', 1], [''usb'', 0], [''usbdevice'', ''tablet''], [''keymap'', ''''], [''pci'', []], [''hpet'', 0], [''guest_os_type'', ''default''], [''hap'', 0], [''cpuid'', []], [''cpuid_check'', []], [''viridian'', 0], [''pci_msitranslate'', 1], [''vpt_align'', 1], [''pci_power_mgmt'', 0], [''xen_platform_pci'', 1], [''vncpasswd'', ''XXXXXXXX''], [''tsc_native'', 0]]], [''s3_integrity'', 1], [''device'', [''vbd'', [''uname'', ''phy:system/dpm_root_0''], [''dev'', ''xvda:sda1''], [''mode'', ''w'']]], [''device'', [''vbd'', [''uname'', ''phy:system/dpm_swap''], [''dev'', ''xvdb:sda2''], [''mode'', ''w'']]], [''device'', [''vif'', [''mac'', ''00:16:3e:00:14:01''], [''type'', ''ioemu'']]]]) [2009-10-20 12:13:24 11382] DEBUG (XendDomainInfo:2389) XendDomainInfo.constructDomain [2009-10-20 12:13:24 11382] DEBUG (balloon:181) Balloon: 4250864 KiB free; need 4096; done. [2009-10-20 12:13:24 11382] DEBUG (XendDomain:464) Adding Domain: 20 [2009-10-20 12:13:24 11382] DEBUG (XendDomainInfo:2634) XendDomainInfo.initDomain: 20 256 [2009-10-20 12:13:24 11382] DEBUG (image:847) args: boot, val: n [2009-10-20 12:13:24 11382] DEBUG (image:847) args: fda, val: None [2009-10-20 12:13:24 11382] DEBUG (image:847) args: fdb, val: None [2009-10-20 12:13:24 11382] DEBUG (image:847) args: soundhw, val: None [2009-10-20 12:13:24 11382] DEBUG (image:847) args: localtime, val: 0 [2009-10-20 12:13:24 11382] DEBUG (image:847) args: serial, val: [''pty''] [2009-10-20 12:13:24 11382] DEBUG (image:847) args: std-vga, val: 0 [2009-10-20 12:13:24 11382] DEBUG (image:847) args: isa, val: 0 [2009-10-20 12:13:24 11382] DEBUG (image:847) args: acpi, val: 1 [2009-10-20 12:13:24 11382] DEBUG (image:847) args: usb, val: 0 [2009-10-20 12:13:24 11382] DEBUG (image:847) args: usbdevice, val: tablet [2009-10-20 12:13:24 11382] DEBUG (image:847) args: gfx_passthru, val: None [2009-10-20 12:13:24 11382] INFO (image:783) Need to create platform device.[domid:20] [2009-10-20 12:13:24 11382] DEBUG (XendDomainInfo:2661) _initDomain:shadow_memory=0x0, memory_static_max=0x100000000, memory_static_min=0x0. [2009-10-20 12:13:24 11382] DEBUG (balloon:181) Balloon: 4249412 KiB free; need 4248576; done. [2009-10-20 12:13:24 11382] INFO (image:181) buildDomain os=hvm dom=20 vcpus=1 [2009-10-20 12:13:24 11382] DEBUG (image:900) domid = 20 [2009-10-20 12:13:24 11382] DEBUG (image:901) image /usr/lib64/xen/boot/hvmloader [2009-10-20 12:13:24 11382] DEBUG (image:902) store_evtchn = 2 [2009-10-20 12:13:24 11382] DEBUG (image:903) memsize = 4096 [2009-10-20 12:13:24 11382] DEBUG (image:904) target = 4096 [2009-10-20 12:13:24 11382] DEBUG (image:905) vcpus = 1 [2009-10-20 12:13:24 11382] DEBUG (image:906) acpi = 1 [2009-10-20 12:13:24 11382] DEBUG (image:907) apic = 1 [2009-10-20 12:13:25 11382] INFO (XendDomainInfo:2253) createDevice: vbd : {''uuid'': ''92d71e42-49d2-f977-5fbe-2a5d73b7d169'', ''bootable'': 1, ''driver'': ''paravirtualised'', ''dev'': ''xvda:sda1'', ''uname'': ''phy:system/dpm_root_0'', ''mode'': ''w''} [2009-10-20 12:13:25 11382] DEBUG (DevController:95) DevController: writing {''backend-id'': ''0'', ''virtual-device'': ''51712'', ''device-type'': ''sda1'', ''state'': ''1'', ''backend'': ''/local/domain/0/backend/vbd/20/51712''} to /local/domain/20/device/vbd/51712. [2009-10-20 12:13:25 11382] DEBUG (DevController:97) DevController: writing {''domain'': ''dpm'', ''frontend'': ''/local/domain/20/device/vbd/51712'', ''uuid'': ''92d71e42-49d2-f977-5fbe-2a5d73b7d169'', ''bootable'': ''1'', ''dev'': ''xvda'', ''state'': ''1'', ''params'': ''system/dpm_root_0'', ''mode'': ''w'', ''online'': ''1'', ''frontend-id'': ''20'', ''type'': ''phy''} to /local/domain/0/backend/vbd/20/51712. [2009-10-20 12:13:25 11382] INFO (XendDomainInfo:2253) createDevice: vbd : {''uuid'': ''eddb896f-8ca7-ce22-4cff-a97895fc95ba'', ''bootable'': 0, ''driver'': ''paravirtualised'', ''dev'': ''xvdb:sda2'', ''uname'': ''phy:system/dpm_swap'', ''mode'': ''w''} [2009-10-20 12:13:25 11382] DEBUG (DevController:95) DevController: writing {''backend-id'': ''0'', ''virtual-device'': ''51728'', ''device-type'': ''sda2'', ''state'': ''1'', ''backend'': ''/local/domain/0/backend/vbd/20/51728''} to /local/domain/20/device/vbd/51728. [2009-10-20 12:13:25 11382] DEBUG (DevController:97) DevController: writing {''domain'': ''dpm'', ''frontend'': ''/local/domain/20/device/vbd/51728'', ''uuid'': ''eddb896f-8ca7-ce22-4cff-a97895fc95ba'', ''bootable'': ''0'', ''dev'': ''xvdb'', ''state'': ''1'', ''params'': ''system/dpm_swap'', ''mode'': ''w'', ''online'': ''1'', ''frontend-id'': ''20'', ''type'': ''phy''} to /local/domain/0/backend/vbd/20/51728. [2009-10-20 12:13:25 11382] INFO (XendDomainInfo:2253) createDevice: vif : {''mac'': ''00:16:3e:00:14:01'', ''type'': ''ioemu'', ''uuid'': ''fc2d0127-1e56-ff53-0918-aee9358e5ca5''} [2009-10-20 12:13:25 11382] DEBUG (DevController:95) DevController: writing {''state'': ''1'', ''backend-id'': ''0'', ''backend'': ''/local/domain/0/backend/vif/20/0''} to /local/domain/20/device/vif/0. [2009-10-20 12:13:25 11382] DEBUG (DevController:97) DevController: writing {''domain'': ''dpm'', ''frontend'': ''/local/domain/20/device/vif/0'', ''uuid'': ''fc2d0127-1e56-ff53-0918-aee9358e5ca5'', ''script'': ''/etc/xen/scripts/vif-bridge'', ''mac'': ''00:16:3e:00:14:01'', ''frontend-id'': ''20'', ''state'': ''1'', ''online'': ''1'', ''handle'': ''0'', ''type'': ''ioemu''} to /local/domain/0/backend/vif/20/0. [2009-10-20 12:13:25 11382] INFO (image:410) spawning device models: /usr/lib64/xen/bin/qemu-dm [''/usr/lib64/xen/bin/qemu-dm'', ''-d'', ''20'', ''-domain-name'', ''dpm'', ''-videoram'', ''4'', ''-nographic'', ''-vcpus'', ''1'', ''-boot'', ''n'', ''-serial'', ''pty'', ''-acpi'', ''-usbdevice'', ''tablet'', ''-net'', ''nic,vlan=1,macaddr=00:16:3e:00:14:01,model=rtl8139'', ''-net'', ''tap,vlan=1,ifname=tap20.0,bridge=xenbr0'', ''-M'', ''xenfv''] [2009-10-20 12:13:25 11382] INFO (image:459) device model pid: 14877 [2009-10-20 12:13:25 11382] INFO (image:561) waiting for sentinel_fifo [2009-10-20 12:13:25 11382] DEBUG (XendDomainInfo:3205) Storing VM details: {''on_xend_stop'': ''ignore'', ''shadow_memory'': ''33'', ''uuid'': ''ef62ef66-caca-6fdc-166d-ce3e08d231b9'', ''on_reboot'': ''restart'', ''start_time'': ''1256066005.3'', ''on_poweroff'': ''destroy'', ''bootloader_args'': '''', ''on_xend_start'': ''ignore'', ''on_crash'': ''restart'', ''xend/restart_count'': ''0'', ''vcpus'': ''1'', ''vcpu_avail'': ''1'', ''bootloader'': '''', ''image'': ''(hvm (kernel ) (superpages 0) (videoram 4) (hpet 0) (stdvga 0) (vnclisten 0.0.0.0) (loader /usr/lib64/xen/boot/hvmloader) (monitor 0) (rtc_timeoffset 0) (pci ()) (hap 0) (localtime 0) (timer_mode 1) (pci_msitranslate 1) (apic 1) (usbdevice tablet) (vpt_align 1) (serial pty) (vncunused 1) (boot n) (xen_platform_pci 1) (pae 1) (viridian 0) (acpi 1) (vnc 0) (nographic 0) (tsc_native 0) (usb 0) (guest_os_type default) (device_model /usr/lib64/xen/bin/qemu-dm) (pci_power_mgmt 0) (xauthority /root/.Xauthority) (isa 0) (notes (SUSPEND_CANCEL 1)))'', ''name'': ''dpm''} [2009-10-20 12:13:25 11382] DEBUG (XendDomainInfo:1693) Storing domain details: {''console/port'': ''3'', ''name'': ''dpm'', ''console/limit'': ''1048576'', ''store/port'': ''2'', ''vm'': ''/vm/ef62ef66-caca-6fdc-166d-ce3e08d231b9'', ''domid'': ''20'', ''image/suspend-cancel'': ''1'', ''cpu/0/availability'': ''online'', ''memory/target'': ''4194304'', ''control/platform-feature-multiprocessor-suspend'': ''1'', ''store/ring-ref'': ''1044476'', ''console/type'': ''ioemu''} [2009-10-20 12:13:25 11382] DEBUG (DevController:95) DevController: writing {''state'': ''1'', ''backend-id'': ''0'', ''backend'': ''/local/domain/0/backend/console/20/0''} to /local/domain/20/device/console/0. [2009-10-20 12:13:25 11382] DEBUG (DevController:97) DevController: writing {''domain'': ''dpm'', ''frontend'': ''/local/domain/20/device/console/0'', ''uuid'': ''18e9fb5c-7c8d-5682-c15b-929914f1a1b9'', ''frontend-id'': ''20'', ''state'': ''1'', ''location'': ''3'', ''online'': ''1'', ''protocol'': ''vt100''} to /local/domain/0/backend/console/20/0. [2009-10-20 12:13:25 11382] DEBUG (XendDomainInfo:1780) XendDomainInfo.handleShutdownWatch [2009-10-20 12:13:25 11382] DEBUG (DevController:139) Waiting for devices tap2. [2009-10-20 12:13:25 11382] DEBUG (DevController:139) Waiting for devices vif. [2009-10-20 12:13:25 11382] DEBUG (DevController:144) Waiting for 0. [2009-10-20 12:13:25 11382] DEBUG (DevController:628) hotplugStatusCallback /local/domain/0/backend/vif/20/0/hotplug-status. [2009-10-20 12:13:25 11382] DEBUG (DevController:642) hotplugStatusCallback 1. [2009-10-20 12:13:25 11382] DEBUG (DevController:139) Waiting for devices vkbd. [2009-10-20 12:13:25 11382] DEBUG (DevController:139) Waiting for devices ioports. [2009-10-20 12:13:25 11382] DEBUG (DevController:139) Waiting for devices tap. [2009-10-20 12:13:25 11382] DEBUG (DevController:139) Waiting for devices vif2. [2009-10-20 12:13:25 11382] DEBUG (DevController:139) Waiting for devices console. [2009-10-20 12:13:26 11382] DEBUG (DevController:144) Waiting for 0. [2009-10-20 12:13:26 11382] DEBUG (DevController:139) Waiting for devices vscsi. [2009-10-20 12:13:26 11382] DEBUG (DevController:139) Waiting for devices vbd. [2009-10-20 12:13:26 11382] DEBUG (DevController:144) Waiting for 51712. [2009-10-20 12:13:26 11382] DEBUG (DevController:628) hotplugStatusCallback /local/domain/0/backend/vbd/20/51712/hotplug-status. ==> xen-hotplug.log <=Nothing to flush. ==> ../kern.log <=Oct 20 12:13:25 kaan-14 kernel: [358675.614339] device tap20.0 entered promiscuous mode Oct 20 12:13:25 kaan-14 kernel: [358675.614360] eth0: port 2(tap20.0) entering forwarding state Oct 20 12:13:25 kaan-14 kernel: [358675.695537] device vif20.0 entered promiscuous mode Oct 20 12:13:25 kaan-14 kernel: [358675.720156] eth0: port 3(vif20.0) entering forwarding state Oct 20 12:13:25 kaan-14 kernel: [358675.778216] physdev match: using --physdev-out in the OUTPUT, FORWARD and POSTROUTING chains for non-bridged traffic is not supported anymore. Oct 20 12:13:25 kaan-14 kernel: [358675.943472] (cdrom_add_media_watch() file=drivers/xen/blkback/cdrom.c, line=108) nodename:backend/vbd/20/51728 Oct 20 12:13:25 kaan-14 kernel: [358675.943476] (cdrom_is_type() file=drivers/xen/blkback/cdrom.c, line=95) type:0 ==> xend.log <=[2009-10-20 12:13:26 11382] DEBUG (DevController:628) hotplugStatusCallback /local/domain/0/backend/vbd/20/51712/hotplug-status. [2009-10-20 12:13:26 11382] DEBUG (DevController:642) hotplugStatusCallback 1. [2009-10-20 12:13:26 11382] DEBUG (DevController:144) Waiting for 51728. [2009-10-20 12:13:26 11382] DEBUG (DevController:628) hotplugStatusCallback /local/domain/0/backend/vbd/20/51728/hotplug-status. [2009-10-20 12:13:26 11382] DEBUG (DevController:642) hotplugStatusCallback 1. [2009-10-20 12:13:26 11382] DEBUG (DevController:139) Waiting for devices irq. [2009-10-20 12:13:26 11382] DEBUG (DevController:139) Waiting for devices vfb. [2009-10-20 12:13:26 11382] DEBUG (DevController:139) Waiting for devices pci. [2009-10-20 12:13:26 11382] DEBUG (DevController:139) Waiting for devices vtpm. [2009-10-20 12:13:26 11382] INFO (XendDomain:1206) Domain dpm (20) unpaused. ==> ../kern.log <=Oct 20 12:13:26 kaan-14 kernel: [358676.959824] (cdrom_add_media_watch() file=drivers/xen/blkback/cdrom.c, line=108) nodename:backend/vbd/20/51712 Oct 20 12:13:26 kaan-14 kernel: [358676.959829] (cdrom_is_type() file=drivers/xen/blkback/cdrom.c, line=95) type:0 Oct 20 12:13:35 kaan-14 kernel: [358685.462114] tap20.0: no IPv6 routers present Oct 20 12:13:36 kaan-14 kernel: [358686.431951] vif20.0: no IPv6 routers present Thanks in advance -Bruce _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel