Chuck Zmudzinski
2021-Oct-27 17:23 UTC
[Pkg-xen-devel] Bug#988333: xen/4.14.3-1: VGA Intel IGD Passthrough to Debian Xen HVM DomUs not working: xl -vvv create log
On 10/26/2021 10:06 AM, Chuck Zmudzinski wrote:> On 10/25/2021 4:45 PM, Chuck Zmudzinski wrote: >> On 10/23/2021 11:11 AM, Hans van Kranenburg wrote: >>> Hi! >>> >>>> On 5/10/2021 1:33 PM, Chuck Zmudzinski wrote: >>>>> [...] with buster and bullseye running as the Dom0, I can only get >>>>> the VGA/Passthrough feature to work with Windows Xen HVMs. I would >>>>> expect both Windows and Linux HVMs to work comparably well. >>> >>> A possible time-saver that I can recommend is to send a post to the >>> upstream xen-users list [0] about this already. Like "Hi all, I'm >>> starting a HVM Linux domU with Linux 5.10.70 on a Xen 4.14.3 system >>> with >>> also 5.10.70 dom0 kernel, with this and this domU config file. It fails >>> to start, this is the xl -vvv create output, and this error (the irq >>> stuff) appears in the dom0 kernel log.". Try to keep it simple and not >>> too long initially, without the surrounding stories, to increase chance >>> of it being fully read. >> >> I can do this soon - I have some more interesting tests to share >> here and with the Xen developers upstream. > > I will need to think a little about how to present this bug to > the Xen upstream developers in a short and simple enough way > for them to be likely to read it initially. For now, I will report here > some results from the journal log entries of both Bullseye dom0 > and Bullseye domU for two different configurations. These logs > are not generated with the -vvv option, but they do provide > quite a bit of interesting information and are already > somewhat overwhelming, even without the -vvv option. So > I will hold off for now before making the logs even more verbose > with -vvv.Now I add output of xl create with -vvv option: chuckz at debian:~$ sudo xl -vvv create bullseye-hvm.cfg Parsing config from bullseye-hvm.cfg libxl: debug: libxl_create.c:2017:do_domain_create: ao 0x55c97f27e180: create: how=(nil) callback=(nil) poller=0x55c97f27e220 libxl: detail: libxl_create.c:622:libxl__domain_make: passthrough: sync_pt libxl: debug: libxl_device.c:379:libxl__device_disk_set_backend: Disk vdev=xvda spec.backend=unknown libxl: debug: libxl_device.c:413:libxl__device_disk_set_backend: Disk vdev=xvda, using backend phy libxl: debug: libxl_device.c:379:libxl__device_disk_set_backend: Disk vdev=xvdb spec.backend=unknown libxl: debug: libxl_device.c:413:libxl__device_disk_set_backend: Disk vdev=xvdb, using backend phy libxl: debug: libxl_create.c:1279:initiate_domain_create: Domain 2:running bootloader libxl: debug: libxl_bootloader.c:328:libxl__bootloader_run: Domain 2:not a PV/PVH domain, skipping bootloader libxl: debug: libxl_event.c:864:libxl__ev_xswatch_deregister: watch w=0x55c97f284148: deregister unregistered libxl: detail: libxl_x86.c:338:hvm_set_viridian_features: base group enabled libxl: detail: libxl_x86.c:338:hvm_set_viridian_features: freq group enabled libxl: detail: libxl_x86.c:338:hvm_set_viridian_features: time_ref_count group enabled libxl: detail: libxl_x86.c:338:hvm_set_viridian_features: apic_assist group enabled libxl: detail: libxl_x86.c:338:hvm_set_viridian_features: crash_ctl group enabled domainbuilder: detail: xc_dom_allocate: cmdline="", features="" domainbuilder: detail: xc_dom_kernel_file: filename="/usr/lib/xen-4.14/boot/hvmloader" domainbuilder: detail: xc_dom_malloc_filemap??? : 329 kB libxl: debug: libxl_dom.c:829:libxl__load_hvm_firmware_module: Loading BIOS: /usr/share/seabios/bios-256k.bin domainbuilder: detail: xc_dom_boot_xen_init: ver 4.14, caps xen-3.0-x86_64 hvm-3.0-x86_32 hvm-3.0-x86_32p hvm-3.0-x86_64 domainbuilder: detail: xc_dom_parse_image: called domainbuilder: detail: xc_dom_find_loader: trying multiboot-binary loader ... domainbuilder: detail: loader probe failed domainbuilder: detail: xc_dom_find_loader: trying HVM-generic loader ... domainbuilder: detail: loader probe OK xc: detail: ELF: phdr: paddr=0x100000 memsz=0x5bfc4 xc: detail: ELF: memory: 0x100000 -> 0x15bfc4 domainbuilder: detail: xc_dom_mem_init: mem 3072 MB, pages 0xc0000 pages, 4k each domainbuilder: detail: xc_dom_mem_init: 0xc0000 pages domainbuilder: detail: xc_dom_boot_mem_init: called domainbuilder: detail: range: start=0x0 end=0xc0000000 xc: detail: PHYSICAL MEMORY ALLOCATION: xc: detail:?? 4KB PAGES: 0x0000000000000200 xc: detail:?? 2MB PAGES: 0x00000000000001ff xc: detail:?? 1GB PAGES: 0x0000000000000002 domainbuilder: detail: xc_dom_build_image: called domainbuilder: detail: xc_dom_pfn_to_ptr_retcount: domU mapping: pfn 0x100+0x5c at 0x7f20de301000 domainbuilder: detail: xc_dom_alloc_segment:?? kernel?????? : 0x100000 -> 0x15c000? (pfn 0x100 + 0x5c pages) xc: detail: ELF: phdr 0 at 0x7f20de2a5000 -> 0x7f20de2f7420 domainbuilder: detail: xc_dom_pfn_to_ptr_retcount: domU mapping: pfn 0x15c+0x40 at 0x7f20de2c1000 domainbuilder: detail: xc_dom_alloc_segment:?? System Firmware module : 0x15c000 -> 0x19c000? (pfn 0x15c + 0x40 pages) domainbuilder: detail: xc_dom_pfn_to_ptr_retcount: domU mapping: pfn 0x19c+0x1 at 0x7f20de7e2000 domainbuilder: detail: xc_dom_alloc_segment:?? HVM start info : 0x19c000 -> 0x19d000? (pfn 0x19c + 0x1 pages) domainbuilder: detail: xc_dom_build_image? : virt_alloc_end : 0x19d000 domainbuilder: detail: xc_dom_build_image? : virt_pgtab_end : 0x0 domainbuilder: detail: xc_dom_boot_image: called domainbuilder: detail: xc_dom_compat_check: supported guest type: xen-3.0-x86_64 domainbuilder: detail: xc_dom_compat_check: supported guest type: hvm-3.0-x86_32 <= matches domainbuilder: detail: xc_dom_compat_check: supported guest type: hvm-3.0-x86_32p domainbuilder: detail: xc_dom_compat_check: supported guest type: hvm-3.0-x86_64 domainbuilder: detail: domain builder memory footprint domainbuilder: detail:??? allocated domainbuilder: detail:?????? malloc???????????? : 6856 bytes domainbuilder: detail:?????? anon mmap????????? : 0 bytes domainbuilder: detail:??? mapped domainbuilder: detail:?????? file mmap????????? : 329 kB domainbuilder: detail:?????? domU mmap????????? : 628 kB domainbuilder: detail: vcpu_hvm: called domainbuilder: detail: xc_dom_set_gnttab_entry: d2 gnt[0] -> d0 0xfefff domainbuilder: detail: xc_dom_set_gnttab_entry: d2 gnt[1] -> d0 0xfeffc domainbuilder: detail: xc_dom_release: called libxl: debug: libxl_device.c:379:libxl__device_disk_set_backend: Disk vdev=xvda spec.backend=phy libxl: debug: libxl_event.c:813:libxl__ev_xswatch_register: watch w=0x55c97f28ed50 wpath=/local/domain/0/backend/vbd/2/51712/state token=3/0: register slotnum=3 libxl: debug: libxl_device.c:379:libxl__device_disk_set_backend: Disk vdev=xvdb spec.backend=phy libxl: debug: libxl_event.c:813:libxl__ev_xswatch_register: watch w=0x55c97f288f70 wpath=/local/domain/0/backend/vbd/2/51728/state token=2/1: register slotnum=2 libxl: debug: libxl_create.c:2055:do_domain_create: ao 0x55c97f27e180: inprogress: poller=0x55c97f27e220, flags=i libxl: debug: libxl_event.c:750:watchfd_callback: watch w=0x55c97f28ed50 wpath=/local/domain/0/backend/vbd/2/51712/state token=3/0: event epath=/local/domain/0/backend/vbd/2/51712/state libxl: debug: libxl_event.c:1052:devstate_callback: backend /local/domain/0/backend/vbd/2/51712/state wanted state 2 ok libxl: debug: libxl_event.c:850:libxl__ev_xswatch_deregister: watch w=0x55c97f28ed50 wpath=/local/domain/0/backend/vbd/2/51712/state token=3/0: deregister slotnum=3 libxl: debug: libxl_device.c:1090:device_backend_callback: Domain 2:calling device_backend_cleanup libxl: debug: libxl_event.c:864:libxl__ev_xswatch_deregister: watch w=0x55c97f28ed50: deregister unregistered libxl: debug: libxl_linux.c:194:libxl__hotplug_disk: Domain 2:Args and environment ready libxl: debug: libxl_device.c:1191:device_hotplug: Domain 2:calling hotplug script: /etc/xen/scripts/block add libxl: debug: libxl_device.c:1192:device_hotplug: Domain 2:extra args: libxl: debug: libxl_device.c:1200:device_hotplug: Domain 2:env: libxl: debug: libxl_device.c:1207:device_hotplug: Domain 2: script: /etc/xen/scripts/block libxl: debug: libxl_device.c:1207:device_hotplug: Domain 2: XENBUS_TYPE: vbd libxl: debug: libxl_device.c:1207:device_hotplug: Domain 2: XENBUS_PATH: backend/vbd/2/51712 libxl: debug: libxl_device.c:1207:device_hotplug: Domain 2: XENBUS_BASE_PATH: backend libxl: debug: libxl_aoutils.c:593:libxl__async_exec_start: forking to execute: /etc/xen/scripts/block add libxl: debug: libxl_event.c:720:watchfd_callback: watch epath=/local/domain/0/backend/vbd/2/51712/state token=3/0: empty slot libxl: debug: libxl_event.c:750:watchfd_callback: watch w=0x55c97f288f70 wpath=/local/domain/0/backend/vbd/2/51728/state token=2/1: event epath=/local/domain/0/backend/vbd/2/51728/state libxl: debug: libxl_event.c:1055:devstate_callback: backend /local/domain/0/backend/vbd/2/51728/state wanted state 2 still waiting state 1 libxl: debug: libxl_event.c:750:watchfd_callback: watch w=0x55c97f288f70 wpath=/local/domain/0/backend/vbd/2/51728/state token=2/1: event epath=/local/domain/0/backend/vbd/2/51728/state libxl: debug: libxl_event.c:1052:devstate_callback: backend /local/domain/0/backend/vbd/2/51728/state wanted state 2 ok libxl: debug: libxl_event.c:850:libxl__ev_xswatch_deregister: watch w=0x55c97f288f70 wpath=/local/domain/0/backend/vbd/2/51728/state token=2/1: deregister slotnum=2 libxl: debug: libxl_device.c:1090:device_backend_callback: Domain 2:calling device_backend_cleanup libxl: debug: libxl_event.c:864:libxl__ev_xswatch_deregister: watch w=0x55c97f288f70: deregister unregistered libxl: debug: libxl_linux.c:194:libxl__hotplug_disk: Domain 2:Args and environment ready libxl: debug: libxl_device.c:1191:device_hotplug: Domain 2:calling hotplug script: /etc/xen/scripts/block add libxl: debug: libxl_device.c:1192:device_hotplug: Domain 2:extra args: libxl: debug: libxl_device.c:1200:device_hotplug: Domain 2:env: libxl: debug: libxl_device.c:1207:device_hotplug: Domain 2: script: /etc/xen/scripts/block libxl: debug: libxl_device.c:1207:device_hotplug: Domain 2: XENBUS_TYPE: vbd libxl: debug: libxl_device.c:1207:device_hotplug: Domain 2: XENBUS_PATH: backend/vbd/2/51728 libxl: debug: libxl_device.c:1207:device_hotplug: Domain 2: XENBUS_BASE_PATH: backend libxl: debug: libxl_aoutils.c:593:libxl__async_exec_start: forking to execute: /etc/xen/scripts/block add libxl: debug: libxl_event.c:864:libxl__ev_xswatch_deregister: watch w=0x55c97f28ee50: deregister unregistered libxl: debug: libxl_linux.c:211:libxl__get_hotplug_script_info: Domain 2:num_exec 1, not running hotplug scripts libxl: debug: libxl_device.c:1176:device_hotplug: Domain 2:No hotplug script to execute libxl: debug: libxl_event.c:864:libxl__ev_xswatch_deregister: watch w=0x55c97f28ee50: deregister unregistered libxl: debug: libxl_event.c:864:libxl__ev_xswatch_deregister: watch w=0x55c97f289070: deregister unregistered libxl: debug: libxl_linux.c:211:libxl__get_hotplug_script_info: Domain 2:num_exec 1, not running hotplug scripts libxl: debug: libxl_device.c:1176:device_hotplug: Domain 2:No hotplug script to execute libxl: debug: libxl_event.c:864:libxl__ev_xswatch_deregister: watch w=0x55c97f289070: deregister unregistered libxl: debug: libxl_dm.c:177:libxl__domain_get_device_model_uid: Domain 2:dm_restrict disabled, starting QEMU as root libxl: debug: libxl_disk.c:1115:libxl__device_disk_find_local_path: Directly accessing local RAW disk /dev/systems/linux libxl: debug: libxl_disk.c:1115:libxl__device_disk_find_local_path: Directly accessing local RAW disk /dev/data/linuxdata libxl: debug: libxl_dm.c:2946:libxl__spawn_local_dm: Domain 2:Spawning device-model /usr/bin/qemu-system-i386 with arguments: libxl: debug: libxl_dm.c:2948:libxl__spawn_local_dm: Domain 2: /usr/bin/qemu-system-i386 libxl: debug: libxl_dm.c:2948:libxl__spawn_local_dm: Domain 2: -xen-domid libxl: debug: libxl_dm.c:2948:libxl__spawn_local_dm: Domain 2:? 2 libxl: debug: libxl_dm.c:2948:libxl__spawn_local_dm: Domain 2: -no-shutdown libxl: debug: libxl_dm.c:2948:libxl__spawn_local_dm: Domain 2: -chardev libxl: debug: libxl_dm.c:2948:libxl__spawn_local_dm: Domain 2: socket,id=libxl-cmd,path=/var/run/xen/qmp-libxl-2,server,nowait libxl: debug: libxl_dm.c:2948:libxl__spawn_local_dm: Domain 2:? -mon libxl: debug: libxl_dm.c:2948:libxl__spawn_local_dm: Domain 2: chardev=libxl-cmd,mode=control libxl: debug: libxl_dm.c:2948:libxl__spawn_local_dm: Domain 2: -chardev libxl: debug: libxl_dm.c:2948:libxl__spawn_local_dm: Domain 2: socket,id=libxenstat-cmd,path=/var/run/xen/qmp-libxenstat-2,server,nowait libxl: debug: libxl_dm.c:2948:libxl__spawn_local_dm: Domain 2:? -mon libxl: debug: libxl_dm.c:2948:libxl__spawn_local_dm: Domain 2: chardev=libxenstat-cmd,mode=control libxl: debug: libxl_dm.c:2948:libxl__spawn_local_dm: Domain 2: -nodefaults libxl: debug: libxl_dm.c:2948:libxl__spawn_local_dm: Domain 2: -no-user-config libxl: debug: libxl_dm.c:2948:libxl__spawn_local_dm: Domain 2: -name libxl: debug: libxl_dm.c:2948:libxl__spawn_local_dm: Domain 2: bullseye-hvm libxl: debug: libxl_dm.c:2948:libxl__spawn_local_dm: Domain 2:? -vnc libxl: debug: libxl_dm.c:2948:libxl__spawn_local_dm: Domain 2:? none libxl: debug: libxl_dm.c:2948:libxl__spawn_local_dm: Domain 2: -display libxl: debug: libxl_dm.c:2948:libxl__spawn_local_dm: Domain 2:? none libxl: debug: libxl_dm.c:2948:libxl__spawn_local_dm: Domain 2: -serial libxl: debug: libxl_dm.c:2948:libxl__spawn_local_dm: Domain 2:? pty libxl: debug: libxl_dm.c:2948:libxl__spawn_local_dm: Domain 2: -boot libxl: debug: libxl_dm.c:2948:libxl__spawn_local_dm: Domain 2: order=c libxl: debug: libxl_dm.c:2948:libxl__spawn_local_dm: Domain 2:? -smp libxl: debug: libxl_dm.c:2948:libxl__spawn_local_dm: Domain 2: 4,maxcpus=4 libxl: debug: libxl_dm.c:2948:libxl__spawn_local_dm: Domain 2: -device libxl: debug: libxl_dm.c:2948:libxl__spawn_local_dm: Domain 2: e1000,id=nic0,netdev=net0,mac=xx:xx:xx:xx:xx:xx libxl: debug: libxl_dm.c:2948:libxl__spawn_local_dm: Domain 2: -netdev libxl: debug: libxl_dm.c:2948:libxl__spawn_local_dm: Domain 2: type=tap,id=net0,ifname=vif2.0-emu,script=no,downscript=no libxl: debug: libxl_dm.c:2948:libxl__spawn_local_dm: Domain 2: -machine libxl: debug: libxl_dm.c:2948:libxl__spawn_local_dm: Domain 2: xenfv,igd-passthru=on libxl: debug: libxl_dm.c:2948:libxl__spawn_local_dm: Domain 2:? -m libxl: debug: libxl_dm.c:2948:libxl__spawn_local_dm: Domain 2:? 3072 libxl: debug: libxl_dm.c:2948:libxl__spawn_local_dm: Domain 2: -drive libxl: debug: libxl_dm.c:2948:libxl__spawn_local_dm: Domain 2: file=/dev/systems/linux,if=ide,index=0,media=disk,format=raw,cache=writeback libxl: debug: libxl_dm.c:2948:libxl__spawn_local_dm: Domain 2: -drive libxl: debug: libxl_dm.c:2948:libxl__spawn_local_dm: Domain 2: file=/dev/data/linuxdata,if=ide,index=1,media=disk,format=raw,cache=writeback libxl: debug: libxl_dm.c:2950:libxl__spawn_local_dm: Domain 2:Spawning device-model /usr/bin/qemu-system-i386 with additional environment: libxl: debug: libxl_dm.c:2952:libxl__spawn_local_dm: Domain 2: XEN_QEMU_CONSOLE_LIMIT=1048576 libxl: debug: libxl_event.c:813:libxl__ev_xswatch_register: watch w=0x55c97f284440 wpath=/local/domain/0/device-model/2/state token=2/2: register slotnum=2 libxl: debug: libxl_event.c:750:watchfd_callback: watch w=0x55c97f284440 wpath=/local/domain/0/device-model/2/state token=2/2: event epath=/local/domain/0/device-model/2/state libxl: debug: libxl_exec.c:407:spawn_watch_event: domain 2 device model: spawn watch p=(null) libxl: debug: libxl_event.c:750:watchfd_callback: watch w=0x55c97f284440 wpath=/local/domain/0/device-model/2/state token=2/2: event epath=/local/domain/0/device-model/2/state libxl: debug: libxl_exec.c:407:spawn_watch_event: domain 2 device model: spawn watch p=running libxl: debug: libxl_event.c:850:libxl__ev_xswatch_deregister: watch w=0x55c97f284440 wpath=/local/domain/0/device-model/2/state token=2/2: deregister slotnum=2 libxl: debug: libxl_exec.c:127:libxl_report_child_exitstatus: domain 2 device model (dying as expected) [2843] died due to fatal signal Killed libxl: debug: libxl_event.c:864:libxl__ev_xswatch_deregister: watch w=0x55c97f284440: deregister unregistered libxl: debug: libxl_qmp.c:1883:libxl__ev_qmp_send: Domain 2: ev 0x55c97f284458, cmd 'query-chardev' libxl: debug: libxl_qmp.c:1323:qmp_ev_lock_aquired: Domain 2:Connecting to /var/run/xen/qmp-libxl-2 libxl: debug: libxl_qmp.c:1698:qmp_ev_handle_message: Domain 2:QEMU version: 5.2.0 libxl: debug: libxl_qmp.c:1883:libxl__ev_qmp_send: Domain 2: ev 0x55c97f284458, cmd 'query-vnc' libxl: debug: libxl_qmp.c:1919:libxl__ev_qmp_dispose: Domain 2: ev 0x55c97f284458 libxl: debug: libxl_event.c:813:libxl__ev_xswatch_register: watch w=0x55c97f290b80 wpath=/local/domain/0/backend/vif/2/0/state token=2/3: register slotnum=2 libxl: debug: libxl_event.c:750:watchfd_callback: watch w=0x55c97f290b80 wpath=/local/domain/0/backend/vif/2/0/state token=2/3: event epath=/local/domain/0/backend/vif/2/0/state libxl: debug: libxl_event.c:1055:devstate_callback: backend /local/domain/0/backend/vif/2/0/state wanted state 2 still waiting state 1 libxl: debug: libxl_event.c:750:watchfd_callback: watch w=0x55c97f290b80 wpath=/local/domain/0/backend/vif/2/0/state token=2/3: event epath=/local/domain/0/backend/vif/2/0/state libxl: debug: libxl_event.c:1052:devstate_callback: backend /local/domain/0/backend/vif/2/0/state wanted state 2 ok libxl: debug: libxl_event.c:850:libxl__ev_xswatch_deregister: watch w=0x55c97f290b80 wpath=/local/domain/0/backend/vif/2/0/state token=2/3: deregister slotnum=2 libxl: debug: libxl_device.c:1090:device_backend_callback: Domain 2:calling device_backend_cleanup libxl: debug: libxl_event.c:864:libxl__ev_xswatch_deregister: watch w=0x55c97f290b80: deregister unregistered libxl: debug: libxl_device.c:1191:device_hotplug: Domain 2:calling hotplug script: /etc/xen/scripts/vif-route.hvm online libxl: debug: libxl_device.c:1192:device_hotplug: Domain 2:extra args: libxl: debug: libxl_device.c:1198:device_hotplug: Domain 2: type_if=vif libxl: debug: libxl_device.c:1200:device_hotplug: Domain 2:env: libxl: debug: libxl_device.c:1207:device_hotplug: Domain 2: script: /etc/xen/scripts/vif-route.hvm libxl: debug: libxl_device.c:1207:device_hotplug: Domain 2: XENBUS_TYPE: vif libxl: debug: libxl_device.c:1207:device_hotplug: Domain 2: XENBUS_PATH: backend/vif/2/0 libxl: debug: libxl_device.c:1207:device_hotplug: Domain 2: XENBUS_BASE_PATH: backend libxl: debug: libxl_device.c:1207:device_hotplug: Domain 2: netdev: eth0 libxl: debug: libxl_device.c:1207:device_hotplug: Domain 2: INTERFACE: vif2.0-emu libxl: debug: libxl_device.c:1207:device_hotplug: Domain 2:???? vif: vif2.0 libxl: debug: libxl_aoutils.c:593:libxl__async_exec_start: forking to execute: /etc/xen/scripts/vif-route.hvm online libxl: debug: libxl_event.c:864:libxl__ev_xswatch_deregister: watch w=0x55c97f290c80: deregister unregistered libxl: debug: libxl_device.c:1191:device_hotplug: Domain 2:calling hotplug script: /etc/xen/scripts/vif-route.hvm add libxl: debug: libxl_device.c:1192:device_hotplug: Domain 2:extra args: libxl: debug: libxl_device.c:1198:device_hotplug: Domain 2: type_if=tap libxl: debug: libxl_device.c:1200:device_hotplug: Domain 2:env: libxl: debug: libxl_device.c:1207:device_hotplug: Domain 2: script: /etc/xen/scripts/vif-route.hvm libxl: debug: libxl_device.c:1207:device_hotplug: Domain 2: XENBUS_TYPE: vif libxl: debug: libxl_device.c:1207:device_hotplug: Domain 2: XENBUS_PATH: backend/vif/2/0 libxl: debug: libxl_device.c:1207:device_hotplug: Domain 2: XENBUS_BASE_PATH: backend libxl: debug: libxl_device.c:1207:device_hotplug: Domain 2: netdev: eth0 libxl: debug: libxl_device.c:1207:device_hotplug: Domain 2: INTERFACE: vif2.0-emu libxl: debug: libxl_device.c:1207:device_hotplug: Domain 2:???? vif: vif2.0 libxl: debug: libxl_aoutils.c:593:libxl__async_exec_start: forking to execute: /etc/xen/scripts/vif-route.hvm add libxl: debug: libxl_event.c:864:libxl__ev_xswatch_deregister: watch w=0x55c97f290c80: deregister unregistered libxl: debug: libxl_linux.c:225:libxl__get_hotplug_script_info: Domain 2:num_exec 2, not running hotplug scripts libxl: debug: libxl_device.c:1176:device_hotplug: Domain 2:No hotplug script to execute libxl: debug: libxl_event.c:864:libxl__ev_xswatch_deregister: watch w=0x55c97f290c80: deregister unregistered libxl: debug: libxl_qmp.c:1883:libxl__ev_qmp_send: Domain 2: ev 0x55c97f293708, cmd 'device_add' libxl: debug: libxl_qmp.c:1323:qmp_ev_lock_aquired: Domain 2:Connecting to /var/run/xen/qmp-libxl-2 libxl: error: libxl_pci.c:1477:libxl__device_pci_reset: The kernel doesn't support reset from sysfs for PCI device 0000:00:14.0 libxl: debug: libxl_qmp.c:1883:libxl__ev_qmp_send: Domain 2: ev 0x55c97f2941b8, cmd 'device_add' libxl: debug: libxl_qmp.c:1883:libxl__ev_qmp_send: Domain 2: ev 0x55c97f294d18, cmd 'device_add' libxl: debug: libxl_qmp.c:1698:qmp_ev_handle_message: Domain 2:QEMU version: 5.2.0 libxl: debug: libxl_qmp.c:1883:libxl__ev_qmp_send: Domain 2: ev 0x55c97f293708, cmd 'query-pci' libxl: debug: libxl_qmp.c:1919:libxl__ev_qmp_dispose: Domain 2: ev 0x55c97f293708 libxl: debug: libxl_qmp.c:1323:qmp_ev_lock_aquired: Domain 2:Connecting to /var/run/xen/qmp-libxl-2 libxl: debug: libxl_qmp.c:1698:qmp_ev_handle_message: Domain 2:QEMU version: 5.2.0 libxl: debug: libxl_qmp.c:1883:libxl__ev_qmp_send: Domain 2: ev 0x55c97f2941b8, cmd 'query-pci' libxl: debug: libxl_qmp.c:1919:libxl__ev_qmp_dispose: Domain 2: ev 0x55c97f2941b8 libxl: debug: libxl_qmp.c:1323:qmp_ev_lock_aquired: Domain 2:Connecting to /var/run/xen/qmp-libxl-2 libxl: debug: libxl_qmp.c:1698:qmp_ev_handle_message: Domain 2:QEMU version: 5.2.0 libxl: debug: libxl_qmp.c:1883:libxl__ev_qmp_send: Domain 2: ev 0x55c97f294d18, cmd 'query-pci' libxl: debug: libxl_qmp.c:1919:libxl__ev_qmp_dispose: Domain 2: ev 0x55c97f294d18 libxl: debug: libxl_pci.c:94:libxl__create_pci_backend: Domain 2:Creating pci backend libxl: debug: libxl_event.c:813:libxl__ev_xswatch_register: watch w=0x55c97f285af8 wpath=/local/domain/2/console/tty token=2/4: register slotnum=2 libxl: debug: libxl_event.c:750:watchfd_callback: watch w=0x55c97f285af8 wpath=/local/domain/2/console/tty token=2/4: event epath=/local/domain/2/console/tty libxl: debug: libxl_event.c:2402:libxl__ao_progress_report: ao 0x55c97f27e180: progress report: ignored libxl: debug: libxl_event.c:850:libxl__ev_xswatch_deregister: watch w=0x55c97f285af8 wpath=/local/domain/2/console/tty token=2/4: deregister slotnum=2 libxl: debug: libxl_event.c:864:libxl__ev_xswatch_deregister: watch w=0x55c97f285af8: deregister unregistered libxl: debug: libxl_event.c:2066:libxl__ao_complete: ao 0x55c97f27e180: complete, rc=0 libxl: debug: libxl_event.c:2035:libxl__ao__destroy: ao 0x55c97f27e180: destroy libxl: debug: libxl_domain.c:703:libxl_domain_unpause: Domain 2:ao 0x55c97f2b0210: create: how=(nil) callback=(nil) poller=0x55c97f27e220 libxl: debug: libxl_qmp.c:1883:libxl__ev_qmp_send: Domain 2: ev 0x55c97f2947c8, cmd 'cont' libxl: debug: libxl_qmp.c:1323:qmp_ev_lock_aquired: Domain 2:Connecting to /var/run/xen/qmp-libxl-2 libxl: debug: libxl_domain.c:711:libxl_domain_unpause: Domain 2:ao 0x55c97f2b0210: inprogress: poller=0x55c97f27e220, flags=i libxl: debug: libxl_qmp.c:1698:qmp_ev_handle_message: Domain 2:QEMU version: 5.2.0 libxl: debug: libxl_qmp.c:1919:libxl__ev_qmp_dispose: Domain 2: ev 0x55c97f2947c8 libxl: debug: libxl_event.c:864:libxl__ev_xswatch_deregister: watch w=0x55c97f294938: deregister unregistered libxl: debug: libxl_event.c:2066:libxl__ao_complete: ao 0x55c97f2b0210: complete, rc=0 libxl: debug: libxl_event.c:2035:libxl__ao__destroy: ao 0x55c97f2b0210: destroy xencall:buffer: debug: total allocations:476 total releases:476 xencall:buffer: debug: current allocations:0 maximum allocations:3 xencall:buffer: debug: cache current size:3 xencall:buffer: debug: cache hits:455 misses:3 toobig:18 xencall:buffer: debug: total allocations:0 total releases:0 xencall:buffer: debug: current allocations:0 maximum allocations:0 xencall:buffer: debug: cache current size:0 xencall:buffer: debug: cache hits:0 misses:0 toobig:0 Regards, Chuck