feral
2012-Nov-09 04:02 UTC
PCI/VGA passthrough on >Xen-4.2 - (XEN) AMD-Vi: IO_PAGE_FAULT:
Upgraded from Xen-4.1 to 4.2/4.3/4.3-unstable. Tested against all three. VGA passthrough previously working with 4.1 is no longer working with >4.2. Setup - Working: Mint13, kernel-3.2.0-32, Xen-4.1 (from Ubuntu-Precise repos), libvirt-bin, xend Asus Radeon HD 7870 DirectCU. Works perfect. Benches on par with bare metal. Setup - Broken: Mint13, kernel-3.2.0-32, Xen-4.2,Xen-4.3,Xen-4.3-unstable (from GIT), xl toolstack. Asus Radeon HD 7870 DirectCU. Some times the guest boots correctly but display is never enabled. Sometimes BSOD, doesn''t seem to be any rhyme or reason? No errors in logs. Found the following in ''xl dmesg'': (XEN) AMD-Vi: IO_PAGE_FAULT: domain = 2, device id = 0x600, fault address 0x1ac800000, flags = 0 Full ''xl dmesg'' output: __ __ _ _ _____ _ _ _ \ \/ /___ _ __ | || | |___ / _ _ _ __ ___| |_ __ _| |__ | | ___ \ // _ \ ''_ \ | || |_ |_ \ __| | | | ''_ \/ __| __/ _` | ''_ \| |/ _ \ / \ __/ | | | |__ _| ___) |__| |_| | | | \__ \ || (_| | |_) | | __/ /_/\_\___|_| |_| |_|(_)____/ \__,_|_| |_|___/\__\__,_|_.__/|_|\___| (XEN) Xen version 4.3-unstable (root@) (gcc (Ubuntu/Linaro 4.6.3-1ubuntu5) 4.6.3) Wed Nov 7 21:13:35 PST 2012 (XEN) Latest ChangeSet: unavailable (XEN) Bootloader: GRUB 1.99-21ubuntu3.4 (XEN) Command line: xen-pciback=passthrough xen-pciback.hide=(06:00.0)(06.00.1) (XEN) Video information: (XEN) VGA is text mode 80x25, font 8x16 (XEN) VBE/DDC methods: V2; EDID transfer time: 1 seconds (XEN) Disc information: (XEN) Found 6 MBR signatures (XEN) Found 6 EDD information structures (XEN) Xen-e820 RAM map: (XEN) 0000000000000000 - 000000000009e800 (usable) (XEN) 000000000009e800 - 00000000000a0000 (reserved) (XEN) 00000000000e0000 - 0000000000100000 (reserved) (XEN) 0000000000100000 - 00000000bab4f000 (usable) (XEN) 00000000bab4f000 - 00000000baf83000 (reserved) (XEN) 00000000baf83000 - 00000000baf93000 (ACPI data) (XEN) 00000000baf93000 - 00000000bbcfa000 (ACPI NVS) (XEN) 00000000bbcfa000 - 00000000bca4f000 (reserved) (XEN) 00000000bca4f000 - 00000000bca50000 (usable) (XEN) 00000000bca50000 - 00000000bcc56000 (ACPI NVS) (XEN) 00000000bcc56000 - 00000000bd083000 (usable) (XEN) 00000000bd083000 - 00000000bd7f4000 (reserved) (XEN) 00000000bd7f4000 - 00000000bd800000 (usable) (XEN) 00000000f8000000 - 00000000fc000000 (reserved) (XEN) 00000000fec00000 - 00000000fec01000 (reserved) (XEN) 00000000fec10000 - 00000000fec11000 (reserved) (XEN) 00000000fec20000 - 00000000fec21000 (reserved) (XEN) 00000000fed00000 - 00000000fed01000 (reserved) (XEN) 00000000fed61000 - 00000000fed71000 (reserved) (XEN) 00000000fed80000 - 00000000fed90000 (reserved) (XEN) 00000000fef00000 - 0000000100000000 (reserved) (XEN) 0000000100001000 - 000000043f000000 (usable) (XEN) ACPI: RSDP 000F0490, 0024 (r2 ALASKA) (XEN) ACPI: XSDT BAF89070, 005C (r1 ALASKA A M I 1072009 AMI 10013) (XEN) ACPI: FACP BAF90BF8, 010C (r5 ALASKA A M I 1072009 AMI 10013) (XEN) ACPI Warning (tbfadt-0232): FADT (revision 5) is longer than ACPI 2.0 version, truncating length 0x10C to 0xF4 [20070126] (XEN) ACPI Warning (tbfadt-0444): Optional field "Pm2ControlBlock" has zero address or length: 0000000000000000/1 [20070126] (XEN) ACPI: DSDT BAF89168, 7A8A (r2 ALASKA A M I 0 INTL 20051117) (XEN) ACPI: FACS BBCF4F80, 0040 (XEN) ACPI: APIC BAF90D08, 009E (r3 ALASKA A M I 1072009 AMI 10013) (XEN) ACPI: FPDT BAF90DA8, 0044 (r1 ALASKA A M I 1072009 AMI 10013) (XEN) ACPI: MCFG BAF90DF0, 003C (r1 ALASKA A M I 1072009 MSFT 10013) (XEN) ACPI: HPET BAF90E30, 0038 (r1 ALASKA A M I 1072009 AMI 5) (XEN) ACPI: SSDT BAF90FC0, 1714 (r1 AMD POWERNOW 1 AMD 1) (XEN) ACPI: IVRS BAF90EC0, 0100 (r1 AMD RD890S 202031 AMD 0) (XEN) System RAM: 16287MB (16678040kB) (XEN) No NUMA configuration found (XEN) Faking a node at 0000000000000000-000000043f000000 (XEN) Domain heap initialised (XEN) DMI 2.7 present. (XEN) Using APIC driver default (XEN) ACPI: PM-Timer IO Port: 0x808 (XEN) ACPI: ACPI SLEEP INFO: pm1x_cnt[804,0], pm1x_evt[800,0] (XEN) ACPI: 32/64X FACS address mismatch in FADT - bbcf4f80/0000000000000000, using 32 (XEN) ACPI: wakeup_vec[bbcf4f8c], vec_size[20] (XEN) ACPI: Local APIC address 0xfee00000 (XEN) ACPI: LAPIC (acpi_id[0x01] lapic_id[0x10] enabled) (XEN) Processor #16 5:1 APIC version 16 (XEN) ACPI: LAPIC (acpi_id[0x02] lapic_id[0x11] enabled) (XEN) Processor #17 5:1 APIC version 16 (XEN) ACPI: LAPIC (acpi_id[0x03] lapic_id[0x12] enabled) (XEN) Processor #18 5:1 APIC version 16 (XEN) ACPI: LAPIC (acpi_id[0x04] lapic_id[0x13] enabled) (XEN) Processor #19 5:1 APIC version 16 (XEN) ACPI: LAPIC (acpi_id[0x05] lapic_id[0x14] enabled) (XEN) Processor #20 5:1 APIC version 16 (XEN) ACPI: LAPIC (acpi_id[0x06] lapic_id[0x15] enabled) (XEN) Processor #21 5:1 APIC version 16 (XEN) ACPI: LAPIC (acpi_id[0x07] lapic_id[0x16] enabled) (XEN) Processor #22 5:1 APIC version 16 (XEN) ACPI: LAPIC (acpi_id[0x08] lapic_id[0x17] enabled) (XEN) Processor #23 5:1 APIC version 16 (XEN) ACPI: LAPIC_NMI (acpi_id[0xff] high edge lint[0x1]) (XEN) ACPI: IOAPIC (id[0x09] address[0xfec00000] gsi_base[0]) (XEN) IOAPIC[0]: apic_id 9, version 33, address 0xfec00000, GSI 0-23 (XEN) ACPI: IOAPIC (id[0x0a] address[0xfec20000] gsi_base[24]) (XEN) IOAPIC[1]: apic_id 10, version 33, address 0xfec20000, GSI 24-55 (XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) (XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 low level) (XEN) ACPI: IRQ0 used by override. (XEN) ACPI: IRQ2 used by override. (XEN) ACPI: IRQ9 used by override. (XEN) Enabling APIC mode: Flat. Using 2 I/O APICs (XEN) ACPI: HPET id: 0x43538210 base: 0xfed00000 (XEN) Table is not found! (XEN) Using ACPI (MADT) for SMP configuration information (XEN) SMP: Allowing 8 CPUs (0 hotplug CPUs) (XEN) IRQ limits: 56 GSI, 1496 MSI/MSI-X (XEN) Using scheduler: SMP Credit Scheduler (credit) (XEN) Detected 3913.302 MHz processor. (XEN) Initing memory sharing. (XEN) xstate_init: using cntxt_size: 0x3c0 and states: 0x4000000000000007 (XEN) AMD Fam15h machine check reporting enabled (XEN) PCI: MCFG configuration 0: base e0000000 segment 0000 buses 00 - ff (XEN) PCI: Not using MCFG for segment 0000 bus 00-ff (XEN) AMD-Vi: IOMMU 0 Enabled. (XEN) AMD-Vi: Enabling global vector map (XEN) I/O virtualisation enabled (XEN) - Dom0 mode: Relaxed (XEN) ENABLING IO-APIC IRQs (XEN) -> Using new ACK method (XEN) ..TIMER: vector=0xF0 apic1=0 pin1=2 apic2=-1 pin2=-1 (XEN) Platform timer is 14.318MHz HPET (XEN) Allocated console ring of 64 KiB. (XEN) HVM: ASIDs enabled. (XEN) SVM: Supported advanced features: (XEN) - Nested Page Tables (NPT) (XEN) - Last Branch Record (LBR) Virtualisation (XEN) - Next-RIP Saved on #VMEXIT (XEN) - VMCB Clean Bits (XEN) - DecodeAssists (XEN) - Pause-Intercept Filter (XEN) - TSC Rate MSR (XEN) HVM: SVM enabled (XEN) HVM: Hardware Assisted Paging (HAP) detected (XEN) HVM: HAP page sizes: 4kB, 2MB, 1GB (XEN) microcode: collect_cpu_info: patch_id=0x6000629 (XEN) microcode: collect_cpu_info: patch_id=0x6000629 (XEN) microcode: collect_cpu_info: patch_id=0x6000629 (XEN) microcode: collect_cpu_info: patch_id=0x6000629 (XEN) microcode: collect_cpu_info: patch_id=0x6000629 (XEN) microcode: collect_cpu_info: patch_id=0x6000629 (XEN) microcode: collect_cpu_info: patch_id=0x6000629 (XEN) Brought up 8 CPUs (XEN) ACPI sleep modes: S3 (XEN) MCA: Use hw thresholding to adjust polling frequency (XEN) mcheck_poll: Machine check polling timer started. (XEN) mtrr: your CPUs had inconsistent fixed MTRR settings (XEN) mtrr: probably your BIOS does not setup all CPUs. (XEN) mtrr: corrected configuration. (XEN) *** LOADING DOMAIN 0 *** (XEN) elf_parse_binary: phdr: paddr=0x1000000 memsz=0xad4000 (XEN) elf_parse_binary: phdr: paddr=0x1c00000 memsz=0xe50e0 (XEN) elf_parse_binary: phdr: paddr=0x1ce6000 memsz=0x144c0 (XEN) elf_parse_binary: phdr: paddr=0x1cfb000 memsz=0x365000 (XEN) elf_parse_binary: memory: 0x1000000 -> 0x2060000 (XEN) elf_xen_parse_note: GUEST_OS = "linux" (XEN) elf_xen_parse_note: GUEST_VERSION = "2.6" (XEN) elf_xen_parse_note: XEN_VERSION = "xen-3.0" (XEN) elf_xen_parse_note: VIRT_BASE = 0xffffffff80000000 (XEN) elf_xen_parse_note: ENTRY = 0xffffffff81cfb200 (XEN) elf_xen_parse_note: HYPERCALL_PAGE = 0xffffffff81001000 (XEN) elf_xen_parse_note: FEATURES "!writable_page_tables|pae_pgdir_above_4gb" (XEN) elf_xen_parse_note: PAE_MODE = "yes" (XEN) elf_xen_parse_note: LOADER = "generic" (XEN) elf_xen_parse_note: unknown xen elf note (0xd) (XEN) elf_xen_parse_note: SUSPEND_CANCEL = 0x1 (XEN) elf_xen_parse_note: HV_START_LOW = 0xffff800000000000 (XEN) elf_xen_parse_note: PADDR_OFFSET = 0x0 (XEN) elf_xen_addr_calc_check: addresses: (XEN) virt_base = 0xffffffff80000000 (XEN) elf_paddr_offset = 0x0 (XEN) virt_offset = 0xffffffff80000000 (XEN) virt_kstart = 0xffffffff81000000 (XEN) virt_kend = 0xffffffff82060000 (XEN) virt_entry = 0xffffffff81cfb200 (XEN) p2m_base = 0xffffffffffffffff (XEN) Xen kernel: 64-bit, lsb, compat32 (XEN) Dom0 kernel: 64-bit, PAE, lsb, paddr 0x1000000 -> 0x2060000 (XEN) PHYSICAL MEMORY ARRANGEMENT: (XEN) Dom0 alloc.: 0000000420000000->0000000428000000 (4038356 pages to be allocated) (XEN) Init. ramdisk: 000000043c7e4000->000000043efff600 (XEN) VIRTUAL MEMORY ARRANGEMENT: (XEN) Loaded kernel: ffffffff81000000->ffffffff82060000 (XEN) Init. ramdisk: ffffffff82060000->ffffffff8487b600 (XEN) Phys-Mach map: ffffffff8487c000->ffffffff8679f780 (XEN) Start info: ffffffff867a0000->ffffffff867a04b4 (XEN) Page tables: ffffffff867a1000->ffffffff867da000 (XEN) Boot stack: ffffffff867da000->ffffffff867db000 (XEN) TOTAL: ffffffff80000000->ffffffff86c00000 (XEN) ENTRY ADDRESS: ffffffff81cfb200 (XEN) Dom0 has maximum 8 VCPUs (XEN) elf_load_binary: phdr 0 at 0xffffffff81000000 -> 0xffffffff81ad4000 (XEN) elf_load_binary: phdr 1 at 0xffffffff81c00000 -> 0xffffffff81ce50e0 (XEN) elf_load_binary: phdr 2 at 0xffffffff81ce6000 -> 0xffffffff81cfa4c0 (XEN) elf_load_binary: phdr 3 at 0xffffffff81cfb000 -> 0xffffffff81dd4000 (XEN) Scrubbing Free RAM: .done. (XEN) Initial low memory virq threshold set at 0x4000 pages. (XEN) Std. Loglevel: All (XEN) Guest Loglevel: All (XEN) Xen is relinquishing VGA console. (XEN) *** Serial input -> DOM0 (type ''CTRL-a'' three times to switch input to Xen) (XEN) Freed 244kB init memory. (XEN) traps.c:2486:d0 Domain attempted WRMSR 00000000c0010201 from 0x0000000000000000 to 0x000000000000abcd. (XEN) PCI add device 0000:00:00.0 (XEN) PCI add device 0000:00:00.2 (XEN) PCI add device 0000:00:02.0 (XEN) PCI add device 0000:00:04.0 (XEN) PCI add device 0000:00:05.0 (XEN) PCI add device 0000:00:09.0 (XEN) PCI add device 0000:00:0a.0 (XEN) PCI add device 0000:00:0b.0 (XEN) PCI add device 0000:00:0d.0 (XEN) PCI add device 0000:00:11.0 (XEN) PCI add device 0000:00:12.0 (XEN) PCI add device 0000:00:12.2 (XEN) PCI add device 0000:00:13.0 (XEN) PCI add device 0000:00:13.2 (XEN) PCI add device 0000:00:14.0 (XEN) PCI add device 0000:00:14.2 (XEN) PCI add device 0000:00:14.3 (XEN) PCI add device 0000:00:14.4 (XEN) PCI add device 0000:00:14.5 (XEN) PCI add device 0000:00:15.0 (XEN) PCI add device 0000:00:15.1 (XEN) PCI add device 0000:00:15.2 (XEN) PCI add device 0000:00:15.3 (XEN) PCI add device 0000:00:16.0 (XEN) PCI add device 0000:00:16.2 (XEN) PCI add device 0000:00:18.0 (XEN) PCI add device 0000:00:18.1 (XEN) PCI add device 0000:00:18.2 (XEN) PCI add device 0000:00:18.3 (XEN) PCI add device 0000:00:18.4 (XEN) PCI add device 0000:00:18.5 (XEN) PCI add device 0000:01:00.0 (XEN) PCI add device 0000:01:00.1 (XEN) PCI add device 0000:02:00.0 (XEN) PCI add device 0000:03:00.0 (XEN) PCI add device 0000:04:00.0 (XEN) PCI add device 0000:06:00.0 (XEN) PCI add device 0000:06:00.1 (XEN) PCI add device 0000:0a:00.0 (XEN) PCI add device 0000:0b:00.0 (XEN) PCI add device 0000:0c:00.0 (XEN) memory.c:131:d0 Could not allocate order=18 extent: id=1 memflags=0 (0 of 1) (XEN) memory.c:131:d0 Could not allocate order=9 extent: id=1 memflags=0 (3 of 4) (XEN) memory.c:131:d0 Could not allocate order=9 extent: id=1 memflags=0 (1 of 4) (XEN) memory.c:131:d0 Could not allocate order=9 extent: id=1 memflags=0 (0 of 4) (XEN) memory.c:131:d0 Could not allocate order=9 extent: id=1 memflags=0 (0 of 4) (XEN) memory.c:131:d0 Could not allocate order=9 extent: id=1 memflags=0 (0 of 4) (XEN) memory.c:131:d0 Could not allocate order=9 extent: id=1 memflags=0 (0 of 4) (XEN) memory.c:131:d0 Could not allocate order=9 extent: id=1 memflags=0 (0 of 4) (XEN) memory.c:131:d0 Could not allocate order=9 extent: id=1 memflags=0 (0 of 4) (XEN) memory.c:131:d0 Could not allocate order=9 extent: id=1 memflags=0 (0 of 4) (XEN) memory.c:131:d0 Could not allocate order=9 extent: id=1 memflags=0 (0 of 4) (XEN) memory.c:131:d0 Could not allocate order=9 extent: id=1 memflags=0 (0 of 4) (XEN) memory.c:131:d0 Could not allocate order=0 extent: id=1 memflags=0 (582 of 2048) (XEN) memory.c:131:d0 Could not allocate order=18 extent: id=2 memflags=0 (0 of 1) (XEN) HVM2: HVM Loader (XEN) HVM2: Detected Xen v4.3-unstable (XEN) HVM2: Xenbus rings @0xfeffc000, event channel 8 (XEN) HVM2: System requested ROMBIOS (XEN) HVM2: CPU speed is 3913 MHz (XEN) irq.c:270: Dom2 PCI link 0 changed 0 -> 5 (XEN) HVM2: PCI-ISA link 0 routed to IRQ5 (XEN) irq.c:270: Dom2 PCI link 1 changed 0 -> 10 (XEN) HVM2: PCI-ISA link 1 routed to IRQ10 (XEN) irq.c:270: Dom2 PCI link 2 changed 0 -> 11 (XEN) HVM2: PCI-ISA link 2 routed to IRQ11 (XEN) irq.c:270: Dom2 PCI link 3 changed 0 -> 5 (XEN) HVM2: PCI-ISA link 3 routed to IRQ5 (XEN) HVM2: pci dev 01:3 INTA->IRQ10 (XEN) HVM2: pci dev 03:0 INTA->IRQ5 (XEN) HVM2: pci dev 04:0 INTA->IRQ5 (XEN) HVM2: pci dev 05:0 INTA->IRQ10 (XEN) HVM2: pci dev 06:0 INTB->IRQ5 (XEN) HVM2: pci dev 05:0 bar 10 size lx: 10000000 (XEN) memory_map:add: dom2 gfn=e0000 mfn=c0000 nr=10000 (XEN) HVM2: pci dev 02:0 bar 10 size lx: 02000000 (XEN) HVM2: pci dev 03:0 bar 14 size lx: 01000000 (XEN) memory_map:add: dom2 gfn=f3000 mfn=fe300 nr=40 (XEN) HVM2: pci dev 05:0 bar 18 size lx: 00040000 (XEN) HVM2: pci dev 05:0 bar 30 size lx: 00020000 (XEN) HVM2: pci dev 06:0 bar 10 size lx: 00004000 (XEN) memory_map:add: dom2 gfn=f3060 mfn=fe360 nr=4 (XEN) HVM2: pci dev 02:0 bar 14 size lx: 00001000 (XEN) HVM2: pci dev 03:0 bar 10 size lx: 00000100 (XEN) HVM2: pci dev 04:0 bar 10 size lx: 00000100 (XEN) HVM2: pci dev 04:0 bar 14 size lx: 00000100 (XEN) HVM2: pci dev 05:0 bar 20 size lx: 00000100 (XEN) ioport_map:add: dom2 gport=c200 mport=b000 nr=100 (XEN) HVM2: pci dev 01:1 bar 20 size lx: 00000010 (XEN) HVM2: Multiprocessor initialisation: (XEN) HVM2: - CPU0 ... 48-bit phys ... fixed MTRRs ... var MTRRs [3/8] ... done. (XEN) HVM2: - CPU1 ... 48-bit phys ... fixed MTRRs ... var MTRRs [3/8] ... done. (XEN) HVM2: - CPU2 ... 48-bit phys ... fixed MTRRs ... var MTRRs [3/8] ... done. (XEN) HVM2: - CPU3 ... 48-bit phys ... fixed MTRRs ... var MTRRs [3/8] ... done. (XEN) HVM2: - CPU4 ... 48-bit phys ... fixed MTRRs ... var MTRRs [3/8] ... done. (XEN) HVM2: - CPU5 ... 48-bit phys ... fixed MTRRs ... var MTRRs [3/8] ... done. (XEN) HVM2: Testing HVM environment: (XEN) HVM2: - REP INSB across page boundaries ... passed (XEN) HVM2: - GS base MSRs and SWAPGS ... passed (XEN) HVM2: Passed 2 of 2 tests (XEN) HVM2: Writing SMBIOS tables ... (XEN) HVM2: Loading ROMBIOS ... (XEN) HVM2: 12636 bytes of ROMBIOS high-memory extensions: (XEN) HVM2: Relocating to 0xfc001000-0xfc00415c ... done (XEN) HVM2: Creating MP tables ... (XEN) HVM2: Loading Cirrus VGABIOS ... (XEN) HVM2: Loading PCI Option ROM ... (XEN) HVM2: - Manufacturer: http://ipxe.org (XEN) HVM2: - Product name: iPXE (XEN) HVM2: Option ROMs: (XEN) HVM2: c0000-c8fff: VGA BIOS (XEN) HVM2: c9000-d8fff: Etherboot ROM (XEN) HVM2: Loading ACPI ... (XEN) HVM2: vm86 TSS at fc010280 (XEN) HVM2: BIOS map: (XEN) HVM2: f0000-fffff: Main BIOS (XEN) HVM2: E820 table: (XEN) HVM2: [00]: 00000000:00000000 - 00000000:0009e000: RAM (XEN) HVM2: [01]: 00000000:0009e000 - 00000000:000a0000: RESERVED (XEN) HVM2: HOLE: 00000000:000a0000 - 00000000:000e0000 (XEN) HVM2: [02]: 00000000:000e0000 - 00000000:00100000: RESERVED (XEN) HVM2: [03]: 00000000:00100000 - 00000000:e0000000: RAM (XEN) HVM2: HOLE: 00000000:e0000000 - 00000000:fc000000 (XEN) HVM2: [04]: 00000000:fc000000 - 00000001:00000000: RESERVED (XEN) HVM2: [05]: 00000001:00000000 - 00000002:19800000: RAM (XEN) HVM2: Invoking ROMBIOS ... (XEN) HVM2: $Revision: 1.221 $ $Date: 2008/12/07 17:32:29 $ (XEN) stdvga.c:147:d2 entering stdvga and caching modes (XEN) HVM2: VGABios $Id: vgabios.c,v 1.67 2008/01/27 09:44:12 vruppert Exp $ (XEN) HVM2: Bochs BIOS - build: 06/23/99 (XEN) HVM2: $Revision: 1.221 $ $Date: 2008/12/07 17:32:29 $ (XEN) HVM2: Options: apmbios pcibios eltorito PMM (XEN) HVM2: (XEN) HVM2: ata0-0: PCHS=16383/16/63 translation=lba LCHS=1024/255/63 (XEN) HVM2: ata0 master: QEMU HARDDISK ATA-7 Hard-Disk ( 115 GBytes) (XEN) HVM2: IDE time out (XEN) HVM2: (XEN) HVM2: (XEN) HVM2: (XEN) HVM2: Press F12 for boot menu. (XEN) HVM2: (XEN) HVM2: Booting from Hard Disk... (XEN) HVM2: Booting from 0000:7c00 (XEN) stdvga.c:151:d2 leaving stdvga (XEN) irq.c:270: Dom2 PCI link 0 changed 5 -> 0 (XEN) irq.c:270: Dom2 PCI link 1 changed 10 -> 0 (XEN) irq.c:270: Dom2 PCI link 2 changed 11 -> 0 (XEN) irq.c:270: Dom2 PCI link 3 changed 5 -> 0 (XEN) memory_map:remove: dom2 gfn=e0000 mfn=c0000 nr=10000 (XEN) memory_map:remove: dom2 gfn=f3000 mfn=fe300 nr=40 (XEN) ioport_map:remove: dom2 gport=c200 mport=b000 nr=100 (XEN) memory_map:add: dom2 gfn=e0000 mfn=c0000 nr=10000 (XEN) memory_map:add: dom2 gfn=f3000 mfn=fe300 nr=40 (XEN) ioport_map:add: dom2 gport=c200 mport=b000 nr=100 (XEN) memory_map:remove: dom2 gfn=f3060 mfn=fe360 nr=4 (XEN) memory_map:add: dom2 gfn=f3060 mfn=fe360 nr=4 (XEN) grant_table.c:1266:d2 Expanding dom (2) grant table from (4) to (32) frames. (XEN) irq.c:375: Dom2 callback via changed to GSI 28 (XEN) memory_map:remove: dom2 gfn=e0000 mfn=c0000 nr=10000 (XEN) memory_map:remove: dom2 gfn=f3000 mfn=fe300 nr=40 (XEN) ioport_map:remove: dom2 gport=c200 mport=b000 nr=100 (XEN) memory_map:add: dom2 gfn=e0000 mfn=c0000 nr=10000 (XEN) memory_map:add: dom2 gfn=f3000 mfn=fe300 nr=40 (XEN) ioport_map:add: dom2 gport=c200 mport=b000 nr=100 (XEN) memory_map:remove: dom2 gfn=f3060 mfn=fe360 nr=4 (XEN) memory_map:add: dom2 gfn=f3060 mfn=fe360 nr=4 (XEN) AMD-Vi: IO_PAGE_FAULT: domain = 2, device id = 0x600, fault address 0x1ac800000, flags = 0 I''ve noticed this has already flown around the mailing list but I''ve only recently subscribed and haven''t seen a reply on previous posts about this issue. I apologise if I''m posting this erroneously. -- _____ Fact: 1. Ninjas are mammals. 2. Ninjas fight ALL the time. 3. The purpose of the ninja is to flip out and kill people. _______________________________________________ Xen-devel mailing list Xen-devel@lists.xen.org http://lists.xen.org/xen-devel
Hans Mueller
2012-Nov-09 16:25 UTC
Re: PCI/VGA passthrough on >Xen-4.2 - (XEN) AMD-Vi: IO_PAGE_FAULT:
On Thursday, 8. November 2012 20:02:51 feral wrote:> Upgraded from Xen-4.1 to 4.2/4.3/4.3-unstable. Tested against all three. > > VGA passthrough previously working with 4.1 is no longer working with >4.2. > > Setup - Working: > Mint13, kernel-3.2.0-32, Xen-4.1 (from Ubuntu-Precise repos), libvirt-bin, > xend > Asus Radeon HD 7870 DirectCU. > Works perfect. Benches on par with bare metal. > > Setup - Broken: > Mint13, kernel-3.2.0-32, Xen-4.2,Xen-4.3,Xen-4.3-unstable (from GIT), xl > toolstack. > Asus Radeon HD 7870 DirectCU. > Some times the guest boots correctly but display is never enabled. > Sometimes BSOD, doesn''t seem to be any rhyme or reason? > > No errors in logs. Found the following in ''xl dmesg'': > (XEN) AMD-Vi: IO_PAGE_FAULT: domain = 2, device id = 0x600, fault address > 0x1ac800000, flags = 0I had a similar problem since hg revision 25818:50adc933faaf which changes the qemu tag. It looks like the qemu commit 3e66da7266c84638c0e22a09c9d2b07529802576 (qemu-xen-trad: fix msi_translate with PV event delivery) causes this behavior. I solved the problem for me by using ''pci_msitranslate=0'' in the domU config. In addition I had to reboot (perhaps poweroff?) the dom0 once the IO_PAGE_FAULT occured. Regards Hans
Ian Campbell
2012-Nov-09 16:33 UTC
Re: PCI/VGA passthrough on >Xen-4.2 - (XEN) AMD-Vi: IO_PAGE_FAULT:
On Fri, 2012-11-09 at 16:25 +0000, Hans Mueller wrote:> On Thursday, 8. November 2012 20:02:51 feral wrote: > > Upgraded from Xen-4.1 to 4.2/4.3/4.3-unstable. Tested against all three. > > > > VGA passthrough previously working with 4.1 is no longer working with >4.2. > > > > Setup - Working: > > Mint13, kernel-3.2.0-32, Xen-4.1 (from Ubuntu-Precise repos), libvirt-bin, > > xend > > Asus Radeon HD 7870 DirectCU. > > Works perfect. Benches on par with bare metal. > > > > Setup - Broken: > > Mint13, kernel-3.2.0-32, Xen-4.2,Xen-4.3,Xen-4.3-unstable (from GIT), xl > > toolstack. > > Asus Radeon HD 7870 DirectCU. > > Some times the guest boots correctly but display is never enabled. > > Sometimes BSOD, doesn''t seem to be any rhyme or reason? > > > > No errors in logs. Found the following in ''xl dmesg'': > > (XEN) AMD-Vi: IO_PAGE_FAULT: domain = 2, device id = 0x600, fault address > > 0x1ac800000, flags = 0 > > I had a similar problem since hg revision 25818:50adc933faaf which changes the > qemu tag. > It looks like the qemu commit > 3e66da7266c84638c0e22a09c9d2b07529802576 > (qemu-xen-trad: fix msi_translate with PV event delivery) > causes this behavior. > > I solved the problem for me by using ''pci_msitranslate=0'' in the domU config.I don''t follow this stuff closely but I could have sworn we had disabled msitranslate by default. In any case I don''t think that changeset was intended to cause anything like this -- Stefano?> In addition I had to reboot (perhaps poweroff?) the dom0 once the IO_PAGE_FAULT > occured. > > Regards > Hans > > > _______________________________________________ > Xen-devel mailing list > Xen-devel@lists.xen.org > http://lists.xen.org/xen-devel
Hans Mueller
2012-Nov-09 17:03 UTC
Re: PCI/VGA passthrough on >Xen-4.2 - (XEN) AMD-Vi: IO_PAGE_FAULT:
On Friday, 9. November 2012 16:33:47 Ian Campbell wrote:> On Fri, 2012-11-09 at 16:25 +0000, Hans Mueller wrote: > > On Thursday, 8. November 2012 20:02:51 feral wrote: > > > Upgraded from Xen-4.1 to 4.2/4.3/4.3-unstable. Tested against all > > > three. > > > > > > VGA passthrough previously working with 4.1 is no longer working with > > > >4.2. > > > > > > Setup - Working: > > > Mint13, kernel-3.2.0-32, Xen-4.1 (from Ubuntu-Precise repos), > > > libvirt-bin, > > > xend > > > Asus Radeon HD 7870 DirectCU. > > > Works perfect. Benches on par with bare metal. > > > > > > Setup - Broken: > > > Mint13, kernel-3.2.0-32, Xen-4.2,Xen-4.3,Xen-4.3-unstable (from GIT), xl > > > toolstack. > > > Asus Radeon HD 7870 DirectCU. > > > Some times the guest boots correctly but display is never enabled. > > > > > > Sometimes BSOD, doesn''t seem to be any rhyme or reason? > > > > > > No errors in logs. Found the following in ''xl dmesg'': > > > (XEN) AMD-Vi: IO_PAGE_FAULT: domain = 2, device id = 0x600, fault > > > address > > > 0x1ac800000, flags = 0 > > > > I had a similar problem since hg revision 25818:50adc933faaf which changes > > the qemu tag. > > It looks like the qemu commit > > 3e66da7266c84638c0e22a09c9d2b07529802576 > > (qemu-xen-trad: fix msi_translate with PV event delivery) > > causes this behavior. > > > > I solved the problem for me by using ''pci_msitranslate=0'' in the domU > > config. > > I don''t follow this stuff closely but I could have sworn we had disabled > msitranslate by default.You''re right - you don''t have to explicitly disable msitranslate, you just may not enable it (which was the case in my domU config, not sure why it was enabled nor whether it was really required in the past - I think it was enabled during pci/gpu-passthrough testing and not changed back/disabled once it worked).
Hans Mueller
2012-Nov-09 17:14 UTC
Re: PCI/VGA passthrough on >Xen-4.2 - (XEN) AMD-Vi: IO_PAGE_FAULT:
On Friday, 9. November 2012 16:33:47 Ian Campbell wrote:> On Fri, 2012-11-09 at 16:25 +0000, Hans Mueller wrote: > > On Thursday, 8. November 2012 20:02:51 feral wrote: > > > Upgraded from Xen-4.1 to 4.2/4.3/4.3-unstable. Tested against all > > > three. > > > > > > VGA passthrough previously working with 4.1 is no longer working with > > > >4.2. > > > > > > Setup - Working: > > > Mint13, kernel-3.2.0-32, Xen-4.1 (from Ubuntu-Precise repos), > > > libvirt-bin, > > > xend > > > Asus Radeon HD 7870 DirectCU. > > > Works perfect. Benches on par with bare metal. > > > > > > Setup - Broken: > > > Mint13, kernel-3.2.0-32, Xen-4.2,Xen-4.3,Xen-4.3-unstable (from GIT), xl > > > toolstack. > > > Asus Radeon HD 7870 DirectCU. > > > Some times the guest boots correctly but display is never enabled. > > > > > > Sometimes BSOD, doesn''t seem to be any rhyme or reason? > > > > > > No errors in logs. Found the following in ''xl dmesg'': > > > (XEN) AMD-Vi: IO_PAGE_FAULT: domain = 2, device id = 0x600, fault > > > address > > > 0x1ac800000, flags = 0 > > > > I had a similar problem since hg revision 25818:50adc933faaf which changes > > the qemu tag. > > It looks like the qemu commit > > 3e66da7266c84638c0e22a09c9d2b07529802576 > > (qemu-xen-trad: fix msi_translate with PV event delivery) > > causes this behavior. > > > > I solved the problem for me by using ''pci_msitranslate=0'' in the domU > > config. > I don''t follow this stuff closely but I could have sworn we had disabled > msitranslate by default. > > In any case I don''t think that changeset was intended to cause anything > like this -- Stefano? > > > In addition I had to reboot (perhaps poweroff?) the dom0 once the > > IO_PAGE_FAULT occured.One more info for you - afair i noticed that it was not only the IO_PAGE_FAULT which occured but also the qemu process in dom0 crashed w/o any messages in the logs, perhaps feral can confirm this?
Stefano Stabellini
2012-Nov-13 11:29 UTC
Re: PCI/VGA passthrough on >Xen-4.2 - (XEN) AMD-Vi: IO_PAGE_FAULT:
On Fri, 9 Nov 2012, Ian Campbell wrote:> On Fri, 2012-11-09 at 16:25 +0000, Hans Mueller wrote: > > On Thursday, 8. November 2012 20:02:51 feral wrote: > > > Upgraded from Xen-4.1 to 4.2/4.3/4.3-unstable. Tested against all three. > > > > > > VGA passthrough previously working with 4.1 is no longer working with >4.2. > > > > > > Setup - Working: > > > Mint13, kernel-3.2.0-32, Xen-4.1 (from Ubuntu-Precise repos), libvirt-bin, > > > xend > > > Asus Radeon HD 7870 DirectCU. > > > Works perfect. Benches on par with bare metal. > > > > > > Setup - Broken: > > > Mint13, kernel-3.2.0-32, Xen-4.2,Xen-4.3,Xen-4.3-unstable (from GIT), xl > > > toolstack. > > > Asus Radeon HD 7870 DirectCU. > > > Some times the guest boots correctly but display is never enabled. > > > Sometimes BSOD, doesn''t seem to be any rhyme or reason? > > > > > > No errors in logs. Found the following in ''xl dmesg'': > > > (XEN) AMD-Vi: IO_PAGE_FAULT: domain = 2, device id = 0x600, fault address > > > 0x1ac800000, flags = 0 > > > > I had a similar problem since hg revision 25818:50adc933faaf which changes the > > qemu tag. > > It looks like the qemu commit > > 3e66da7266c84638c0e22a09c9d2b07529802576 > > (qemu-xen-trad: fix msi_translate with PV event delivery) > > causes this behavior. > > > > I solved the problem for me by using ''pci_msitranslate=0'' in the domU config. > > I don''t follow this stuff closely but I could have sworn we had disabled > msitranslate by default. > > In any case I don''t think that changeset was intended to cause anything > like this -- Stefano?No, it wasn''t. Can you please try reverting that specific commit on the qemu tree and let me know if everything works afterwards (git revert 3e66da7266c84638c0e22a09c9d2b07529802576)? Are you testing with a Linux or a Windows guest? In any case, it is always safer to run with msi_translate=0, we have found problems in the past using msi_translate with Nvidia graphic cards.