Jeremy Fitzhardinge
2010-May-13 00:13 UTC
[Xen-devel] problem starting hvm domain with stubdoms with "xl create"
xl create is failing with a timeout waiting on the device model. I''m pretty sure its because its looking at the wrong domid for the device model (the main domain''s, not the stubdom; I added to the log message to print which domain it''s waiting on), but I haven''t tracked down a specific fix yet. J sh-4.0# xl create -d /etc/xen/win7-ctxs Parsing config file /etc/xen/win7-ctxs *** domain_create_info *** hvm: 1 hap: 0 oos: 1 ssidref: 0 name: win7-ctxs uuid: 412b35f0-6a0c-4f26-8595-c79a5940b4a1 cpupool: Pool-0 (0) xsdata: (null) platformdata: (null) *** domain_build_info *** timer_mode: -1 hpet: 1 vpt_align: -1 max_vcpus: 2 tsc_mode: 0 max_memkb: 1048576 target_memkb: 1048576 kernel: /usr/lib/xen/boot/hvmloader hvm: 1 video_memkb: 8192 shadow_memkb: 1280 pae: 1 apic: 1 acpi: 1 nx: 1 viridian: 1 *** disks_info: 0 *** backend_domid 0 domid 0 physpath /dev/vg_lilith-raid/xen-win7-ctxs phystype 4 virtpath hda unpluggable 1 readwrite 1 is_cdrom 0 *** disks_info: 1 *** backend_domid 0 domid 0 physpath /home/jeremy/commercial/ms/SW_DVD5_SA_Win_Ent_7_32BIT_English_Full_MLF_X15-70745.iso phystype 5 virtpath hdc unpluggable 1 readwrite 0 is_cdrom 1 *** vifs_info: 0 *** backend_domid 0 domid 0 devid 0 mtu 1492 model e1000 mac 00:16:3e:23:f8:c2 *** device_model_info *** domid: 0 dom_name: win7-ctxs device_model: stubdom-dm videoram: 8 stdvga: 0 vnc: 1 vnclisten: 0.0.0.0 vncdisplay: 0 vncunused: 1 keymap: (null) sdl: 0 opengl: 0 nographic: 0 serial: pty boot: cda usb: 0 usbdevice: tablet apic: 1 VIRTUAL MEMORY ARRANGEMENT: Loader: 0000000000100000->0000000000171404 TOTAL: 0000000000000000->000000003f800000 ENTRY ADDRESS: 0000000000100000 PHYSICAL MEMORY ALLOCATION: 4KB PAGES: 0x0000000000000200 2MB PAGES: 0x00000000000001fb 1GB PAGES: 0x0000000000000000 [0] libxl_device.c:460:libxl_wait_for_device_model: Device Model for 14 not ready (want "running") xl: fatal error: xl_cmdimpl.c:1040, rc=-1: libxl_confirm_device_model_startup(&ctx, dm_starting) sh-4.0# xl list Name ID Mem VCPUs State Time(s) Dom0 0 2217 4 r-- 2092.6 win7-ctxs 14 1019 1 -p- 0.0 win7-ctxs-dm 15 32 1 --- 0.0 sh-4.0# xenstore-read /local/domain/0/device-model/14/state xenstore-read: couldn''t read path /local/domain/0/device-model/14/state sh-4.0# xenstore-read /local/domain/0/device-model/15/state running _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Jeremy Fitzhardinge
2010-May-13 00:44 UTC
Re: [Xen-devel] problem starting hvm domain with stubdoms with "xl create"
On 05/12/2010 05:13 PM, Jeremy Fitzhardinge wrote:> xl create is failing with a timeout waiting on the device model. I''m > pretty sure its because its looking at the wrong domid for the device > model (the main domain''s, not the stubdom; I added to the log message to > print which domain it''s waiting on), but I haven''t tracked down a > specific fix yet. >I tried brute-forcing it by making libxl_wait_for_device_model() try to find the stubdomid for the given domid and use that if present. That appeared to work in that it avoided this particular problem, but xl immediately decided the domain had rebooted and sat in a loop repeatedly constructing and rebooting the domain until I forcably killed it. I also tried making libxl_create_stubdom() set (*starting_r)->domid domid; (rather than info->domid), which had the same effect. So at this point I''m not sure what''s going on. J sh-4.0# tail -50 xl-win7-ctxs.log 2MB PAGES: 0x00000000000001fb 1GB PAGES: 0x0000000000000000 Waiting for domain win7-ctxs (domid 90) to die [pid 20701] Domain 90 is dead Domain 90 needs to be clean: destroying the domain [0] libxl.c:684:libxl_destroy_device_model: Device model is a stubdom, domid=91 [3] libxl.c:694:libxl_destroy_device_model: Device Model signaled Done. Rebooting now VIRTUAL MEMORY ARRANGEMENT: Loader: 0000000000100000->0000000000171404 TOTAL: 0000000000000000->000000003f800000 ENTRY ADDRESS: 0000000000100000 PHYSICAL MEMORY ALLOCATION: 4KB PAGES: 0x0000000000000200 2MB PAGES: 0x00000000000001fb 1GB PAGES: 0x0000000000000000 Waiting for domain win7-ctxs (domid 92) to die [pid 20701] Domain 92 is dead Domain 92 needs to be clean: destroying the domain [0] libxl.c:684:libxl_destroy_device_model: Device model is a stubdom, domid=93 [3] libxl.c:694:libxl_destroy_device_model: Device Model signaled Done. Rebooting now VIRTUAL MEMORY ARRANGEMENT: Loader: 0000000000100000->0000000000171404 TOTAL: 0000000000000000->000000003f800000 ENTRY ADDRESS: 0000000000100000 PHYSICAL MEMORY ALLOCATION: 4KB PAGES: 0x0000000000000200 2MB PAGES: 0x00000000000001fb 1GB PAGES: 0x0000000000000000 Waiting for domain win7-ctxs (domid 94) to die [pid 20701] Domain 94 is dead Domain 94 needs to be clean: destroying the domain [0] libxl.c:684:libxl_destroy_device_model: Device model is a stubdom, domid=95 [3] libxl.c:694:libxl_destroy_device_model: Device Model signaled Done. Rebooting now VIRTUAL MEMORY ARRANGEMENT: Loader: 0000000000100000->0000000000171404 TOTAL: 0000000000000000->000000003f800000 ENTRY ADDRESS: 0000000000100000 PHYSICAL MEMORY ALLOCATION: 4KB PAGES: 0x0000000000000200 2MB PAGES: 0x00000000000001fb 1GB PAGES: 0x0000000000000000 Waiting for domain win7-ctxs (domid 96) to die [pid 20701] Domain 96 is dead Domain 96 does not need to be clean, exiting now sh-4.0# tail -60 xl-win7-ctxs.log [0] libxl.c:684:libxl_destroy_device_model: Device model is a stubdom, domid=89 [3] libxl.c:694:libxl_destroy_device_model: Device Model signaled Done. Rebooting now VIRTUAL MEMORY ARRANGEMENT: Loader: 0000000000100000->0000000000171404 TOTAL: 0000000000000000->000000003f800000 ENTRY ADDRESS: 0000000000100000 PHYSICAL MEMORY ALLOCATION: 4KB PAGES: 0x0000000000000200 2MB PAGES: 0x00000000000001fb 1GB PAGES: 0x0000000000000000 Waiting for domain win7-ctxs (domid 90) to die [pid 20701] Domain 90 is dead Domain 90 needs to be clean: destroying the domain [0] libxl.c:684:libxl_destroy_device_model: Device model is a stubdom, domid=91 [3] libxl.c:694:libxl_destroy_device_model: Device Model signaled Done. Rebooting now VIRTUAL MEMORY ARRANGEMENT: Loader: 0000000000100000->0000000000171404 TOTAL: 0000000000000000->000000003f800000 ENTRY ADDRESS: 0000000000100000 PHYSICAL MEMORY ALLOCATION: 4KB PAGES: 0x0000000000000200 2MB PAGES: 0x00000000000001fb 1GB PAGES: 0x0000000000000000 Waiting for domain win7-ctxs (domid 92) to die [pid 20701] Domain 92 is dead Domain 92 needs to be clean: destroying the domain [0] libxl.c:684:libxl_destroy_device_model: Device model is a stubdom, domid=93 [3] libxl.c:694:libxl_destroy_device_model: Device Model signaled Done. Rebooting now VIRTUAL MEMORY ARRANGEMENT: Loader: 0000000000100000->0000000000171404 TOTAL: 0000000000000000->000000003f800000 ENTRY ADDRESS: 0000000000100000 PHYSICAL MEMORY ALLOCATION: 4KB PAGES: 0x0000000000000200 2MB PAGES: 0x00000000000001fb 1GB PAGES: 0x0000000000000000 Waiting for domain win7-ctxs (domid 94) to die [pid 20701] Domain 94 is dead Domain 94 needs to be clean: destroying the domain [0] libxl.c:684:libxl_destroy_device_model: Device model is a stubdom, domid=95 [3] libxl.c:694:libxl_destroy_device_model: Device Model signaled Done. Rebooting now VIRTUAL MEMORY ARRANGEMENT: Loader: 0000000000100000->0000000000171404 TOTAL: 0000000000000000->000000003f800000 ENTRY ADDRESS: 0000000000100000 PHYSICAL MEMORY ALLOCATION: 4KB PAGES: 0x0000000000000200 2MB PAGES: 0x00000000000001fb 1GB PAGES: 0x0000000000000000 Waiting for domain win7-ctxs (domid 96) to die [pid 20701] Domain 96 is dead Domain 96 does not need to be clean, exiting now> J > > sh-4.0# xl create -d /etc/xen/win7-ctxs > Parsing config file /etc/xen/win7-ctxs > *** domain_create_info *** > hvm: 1 > hap: 0 > oos: 1 > ssidref: 0 > name: win7-ctxs > uuid: 412b35f0-6a0c-4f26-8595-c79a5940b4a1 > cpupool: Pool-0 (0) > xsdata: (null) > platformdata: (null) > > > > *** domain_build_info *** > timer_mode: -1 > hpet: 1 > vpt_align: -1 > max_vcpus: 2 > tsc_mode: 0 > max_memkb: 1048576 > target_memkb: 1048576 > kernel: /usr/lib/xen/boot/hvmloader > hvm: 1 > video_memkb: 8192 > shadow_memkb: 1280 > pae: 1 > apic: 1 > acpi: 1 > nx: 1 > viridian: 1 > > > > *** disks_info: 0 *** > backend_domid 0 > domid 0 > physpath /dev/vg_lilith-raid/xen-win7-ctxs > phystype 4 > virtpath hda > unpluggable 1 > readwrite 1 > is_cdrom 0 > > > > *** disks_info: 1 *** > backend_domid 0 > domid 0 > physpath /home/jeremy/commercial/ms/SW_DVD5_SA_Win_Ent_7_32BIT_English_Full_MLF_X15-70745.iso > phystype 5 > virtpath hdc > unpluggable 1 > readwrite 0 > is_cdrom 1 > > > > *** vifs_info: 0 *** > backend_domid 0 > domid 0 > devid 0 > mtu 1492 > model e1000 > mac 00:16:3e:23:f8:c2 > > > > *** device_model_info *** > domid: 0 > dom_name: win7-ctxs > device_model: stubdom-dm > videoram: 8 > stdvga: 0 > vnc: 1 > vnclisten: 0.0.0.0 > vncdisplay: 0 > vncunused: 1 > keymap: (null) > sdl: 0 > opengl: 0 > nographic: 0 > serial: pty > boot: cda > usb: 0 > usbdevice: tablet > apic: 1 > VIRTUAL MEMORY ARRANGEMENT: > Loader: 0000000000100000->0000000000171404 > TOTAL: 0000000000000000->000000003f800000 > ENTRY ADDRESS: 0000000000100000 > PHYSICAL MEMORY ALLOCATION: > 4KB PAGES: 0x0000000000000200 > 2MB PAGES: 0x00000000000001fb > 1GB PAGES: 0x0000000000000000 > [0] libxl_device.c:460:libxl_wait_for_device_model: Device Model for 14 not ready (want "running") > xl: fatal error: xl_cmdimpl.c:1040, rc=-1: libxl_confirm_device_model_startup(&ctx, dm_starting) > > sh-4.0# xl list > Name ID Mem VCPUs State Time(s) > Dom0 0 2217 4 r-- 2092.6 > win7-ctxs 14 1019 1 -p- 0.0 > win7-ctxs-dm 15 32 1 --- 0.0 > > sh-4.0# xenstore-read /local/domain/0/device-model/14/state > xenstore-read: couldn''t read path /local/domain/0/device-model/14/state > sh-4.0# xenstore-read /local/domain/0/device-model/15/state > running > > > > _______________________________________________ > Xen-devel mailing list > Xen-devel@lists.xensource.com > http://lists.xensource.com/xen-devel > >_______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel