Tommi Airikka
2016-Jan-08 16:19 UTC
[Pkg-xen-devel] Bug#810379: xen: pci-passthrough generates "xen:events: Failed to obtain physical IRQ" for some devices
Source: xen
Severity: normal
Dear Maintainer,
After an upgrade, my passthroughed NIC stopped working.
I created a new jessie domU and tried to passthrough some PCI devices
and found that both USB3 host controller and tg3 NIC generated these
lines in domU dmesg:
xen:events: Failed to obtain physical IRQ 31
xen:events: Failed to obtain physical IRQ 32
xen:events: Failed to obtain physical IRQ 33
And from the dom0 "xl dmesg":
(XEN) mm.c:812: d13: Forcing read-only access to MFN fbff1
(XEN) mm.c:812: d13: Forcing read-only access to MFN fbff1
(XEN) mm.c:812: d13: Forcing read-only access to MFN fbff1
(XEN) mm.c:812: d0: Forcing read-only access to MFN fbff1
(XEN) mm.c:812: d13: Forcing read-only access to MFN faba0
(XEN) mm.c:812: d0: Forcing read-only access to MFN faba0
I also tried pci-passthrough with another USB host controller (not USB3) and it
did work.
domU "lspci -vn":
00:00.1 0200: 14e4:165f
Subsystem: 103c:2133
Flags: bus master, fast devsel, latency 0, IRQ 30
Memory at fabc0000 (64-bit, prefetchable) [size=64K]
Memory at fabb0000 (64-bit, prefetchable) [size=64K]
Memory at faba0000 (64-bit, prefetchable) [size=64K]
Expansion ROM at <ignored> [disabled]
Capabilities: [48] Power Management version 3
Capabilities: [50] Vital Product Data
Capabilities: [58] MSI: Enable- Count=1/8 Maskable- 64bit+
Capabilities: [a0] MSI-X: Enable+ Count=17 Masked-
Capabilities: [ac] Express Endpoint, MSI 00
Capabilities: [100] Advanced Error Reporting
Capabilities: [13c] Device Serial Number 00-00-34-64-a9-9a-a8-b1
Capabilities: [150] Power Budgeting <?>
Capabilities: [160] Virtual Channel
Kernel driver in use: tg3
00:01.0 0c03: 1912:0014 (rev 03) (prog-if 30 [XHCI])
Subsystem: 103c:1996
Flags: bus master, fast devsel, latency 0, IRQ 29
Memory at fbff0000 (64-bit, non-prefetchable) [size=8K]
Capabilities: [50] Power Management version 3
Capabilities: [70] MSI: Enable- Count=1/8 Maskable- 64bit+
Capabilities: [90] MSI-X: Enable+ Count=8 Masked-
Capabilities: [a0] Express Endpoint, MSI 00
Capabilities: [100] Advanced Error Reporting
Capabilities: [150] Latency Tolerance Reporting
Kernel driver in use: xhci_hcd
domU "cat /proc/interrupts":
CPU0
16: 25114 xen-percpu-virq timer0
17: 0 xen-percpu-ipi resched0
18: 0 xen-percpu-ipi callfunc0
19: 0 xen-percpu-virq debug0
20: 0 xen-percpu-ipi callfuncsingle0
21: 0 xen-percpu-ipi irqwork0
22: 473 xen-dyn-event xenbus
23: 96 xen-dyn-event hvc_console
24: 8811 xen-dyn-event blkif
25: 255 xen-dyn-event blkif
26: 3045 xen-dyn-event eth0-q0-tx
27: 5650 xen-dyn-event eth0-q0-rx
28: 93 xen-dyn-event pcifront
31: 0 xen-pirq-pcifront-msi-x xhci_hcd
32: 0 xen-pirq-pcifront-msi-x xhci_hcd
33: 0 xen-pirq-pcifront-msi-x eth1
NMI: 0 Non-maskable interrupts
LOC: 0 Local timer interrupts
SPU: 0 Spurious interrupts
PMI: 0 Performance monitoring interrupts
IWI: 0 IRQ work interrupts
RTR: 0 APIC ICR read retries
RES: 0 Rescheduling interrupts
CAL: 0 Function call interrupts
TLB: 0 TLB shootdowns
TRM: 0 Thermal event interrupts
THR: 0 Threshold APIC interrupts
MCE: 0 Machine check exceptions
MCP: 0 Machine check polls
HYP: 43966 Hypervisor callback interrupts
ERR: 0
MIS: 0
domU "dmesg":
[ 0.000000] Initializing cgroup subsys cpuset
[ 0.000000] Initializing cgroup subsys cpu
[ 0.000000] Initializing cgroup subsys cpuacct
[ 0.000000] Linux version 3.16.0-4-amd64 (debian-kernel at lists.debian.org)
(gcc version 4.8.4 (Debian 4.8.4-1)
[ 0.000000] Command line: root=/dev/xvda2 ro elevator=noop root=/dev/xvda2 ro
[ 0.000000] ACPI in unprivileged domain disabled
[ 0.000000] 1-1 mapping on 8000->100000
[ 0.000000] Set 1015808 page(s) to 1-1 mapping
[ 0.000000] 1-1 mapping on 100000->8000000
[ 0.000000] e820: BIOS-provided physical RAM map:
[ 0.000000] Xen: [mem 0x0000000000000000-0x000000000009ffff] usable
[ 0.000000] Xen: [mem 0x00000000000a0000-0x00000000000fffff] reserved
[ 0.000000] Xen: [mem 0x0000000000100000-0x0000000007ffffff] usable
[ 0.000000] Xen: [mem 0x0000000008000000-0x00000000f1de3fff] unusable
[ 0.000000] Xen: [mem 0x00000000f1de4000-0x00000000f1dedfff] ACPI data
[ 0.000000] Xen: [mem 0x00000000f1dee000-0x00000000f7ffffff] reserved
[ 0.000000] Xen: [mem 0x00000000fec00000-0x00000000feefffff] reserved
[ 0.000000] Xen: [mem 0x00000000ff800000-0x00000000ffffffff] reserved
[ 0.000000] NX (Execute Disable) protection: active
[ 0.000000] DMI not present or invalid.
[ 0.000000] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved
[ 0.000000] e820: remove [mem 0x000a0000-0x000fffff] usable
[ 0.000000] AGP: No AGP bridge found
[ 0.000000] e820: last_pfn = 0x8000 max_arch_pfn = 0x400000000
[ 0.000000] Base memory trampoline at [ffff88000009a000] 9a000 size 24576
[ 0.000000] init_memory_mapping: [mem 0x00000000-0x000fffff]
[ 0.000000] [mem 0x00000000-0x000fffff] page 4k
[ 0.000000] init_memory_mapping: [mem 0x07e00000-0x07ffffff]
[ 0.000000] [mem 0x07e00000-0x07ffffff] page 4k
[ 0.000000] BRK [0x01b02000, 0x01b02fff] PGTABLE
[ 0.000000] init_memory_mapping: [mem 0x04000000-0x07dfffff]
[ 0.000000] [mem 0x04000000-0x07dfffff] page 4k
[ 0.000000] BRK [0x01b03000, 0x01b03fff] PGTABLE
[ 0.000000] BRK [0x01b04000, 0x01b04fff] PGTABLE
[ 0.000000] BRK [0x01b05000, 0x01b05fff] PGTABLE
[ 0.000000] BRK [0x01b06000, 0x01b06fff] PGTABLE
[ 0.000000] BRK [0x01b07000, 0x01b07fff] PGTABLE
[ 0.000000] init_memory_mapping: [mem 0x00100000-0x03ffffff]
[ 0.000000] [mem 0x00100000-0x03ffffff] page 4k
[ 0.000000] RAMDISK: [mem 0x01f18000-0x049bffff]
[ 0.000000] NUMA turned off
[ 0.000000] Faking a node at [mem 0x0000000000000000-0x0000000007ffffff]
[ 0.000000] Initmem setup node 0 [mem 0x00000000-0x07ffffff]
[ 0.000000] NODE_DATA [mem 0x07fe7000-0x07febfff]
[ 0.000000] Zone ranges:
[ 0.000000] DMA [mem 0x00001000-0x00ffffff]
[ 0.000000] DMA32 [mem 0x01000000-0xffffffff]
[ 0.000000] Normal empty
[ 0.000000] Movable zone start for each node
[ 0.000000] Early memory node ranges
[ 0.000000] node 0: [mem 0x00001000-0x0009ffff]
[ 0.000000] node 0: [mem 0x00100000-0x07ffffff]
[ 0.000000] On node 0 totalpages: 32671
[ 0.000000] DMA zone: 56 pages used for memmap
[ 0.000000] DMA zone: 21 pages reserved
[ 0.000000] DMA zone: 3999 pages, LIFO batch:0
[ 0.000000] DMA32 zone: 392 pages used for memmap
[ 0.000000] DMA32 zone: 28672 pages, LIFO batch:7
[ 0.000000] SFI: Simple Firmware Interface v0.81 http://simplefirmware.org
[ 0.000000] smpboot: Allowing 1 CPUs, 0 hotplug CPUs
[ 0.000000] nr_irqs_gsi: 16
[ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000fffff]
[ 0.000000] e820: [mem 0xf8000000-0xfebfffff] available for PCI devices
[ 0.000000] Booting paravirtualized kernel on Xen
[ 0.000000] Xen version: 4.4.1 (preserve-AD)
[ 0.000000] setup_percpu: NR_CPUS:512 nr_cpumask_bits:512 nr_cpu_ids:1
nr_node_ids:1
[ 0.000000] PERCPU: Embedded 27 pages/cpu @ffff880007c00000 s80896 r8192
d21504 u2097152
[ 0.000000] pcpu-alloc: s80896 r8192 d21504 u2097152 alloc=1*2097152
[ 0.000000] pcpu-alloc: [0] 0
[ 0.000000] Built 1 zonelists in Node order, mobility grouping on. Total
pages: 32202
[ 0.000000] Policy zone: DMA32
[ 0.000000] Kernel command line: root=/dev/xvda2 ro elevator=noop
root=/dev/xvda2 ro
[ 0.000000] PID hash table entries: 512 (order: 0, 4096 bytes)
[ 0.000000] xsave: enabled xstate_bv 0x3, cntxt size 0x240
[ 0.000000] AGP: Checking aperture...
[ 0.000000] AGP: No AGP bridge found
[ 0.000000] Calgary: detecting Calgary via BIOS EBDA area
[ 0.000000] Calgary: Unable to locate Rio Grande table in EBDA - bailing!
[ 0.000000] Memory: 72968K/130684K available (5219K kernel code, 947K rwdata,
1836K rodata, 1204K init, 840K
[ 0.000000] Hierarchical RCU implementation.
[ 0.000000] RCU dyntick-idle grace-period acceleration is enabled.
[ 0.000000] RCU restricting CPUs from NR_CPUS=512 to nr_cpu_ids=1.
[ 0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1
[ 0.000000] NR_IRQS:33024 nr_irqs:256 16
[ 0.000000] xen:events: Using FIFO-based ABI
[ 0.000000] Console: colour dummy device 80x25
[ 0.000000] console [tty0] enabled
[ 0.000000] console [hvc0] enabled
[ 0.000000] Xen: using vcpuop timer interface
[ 0.000000] installing Xen timer for CPU 0
[ 0.000000] tsc: Detected 2294.838 MHz processor
[ 0.004000] Calibrating delay loop (skipped), value calculated using timer
frequency.. 4589.67 BogoMIPS (lpj[ 0.004000] pid_max: default: 32768 minimum:
301
[ 0.004000] Security Framework initialized
[ 0.004000] AppArmor: AppArmor disabled by boot time parameter
[ 0.004000] Yama: disabled by default; enable with sysctl kernel.yama.*
[ 0.004000] Dentry cache hash table entries: 16384 (order: 5, 131072 bytes)
[ 0.004000] Inode-cache hash table entries: 8192 (order: 4, 65536 bytes)
[ 0.004000] Mount-cache hash table entries: 512 (order: 0, 4096 bytes)
[ 0.004000] Mountpoint-cache hash table entries: 512 (order: 0, 4096 bytes)
[ 0.004000] Initializing cgroup subsys memory
[ 0.004000] Initializing cgroup subsys devices
[ 0.004000] Initializing cgroup subsys freezer
[ 0.004000] Initializing cgroup subsys net_cls
[ 0.004000] Initializing cgroup subsys blkio
[ 0.004000] Initializing cgroup subsys perf_event
[ 0.004000] Initializing cgroup subsys net_prio
[ 0.004000] ENERGY_PERF_BIAS: Set to 'normal', was
'performance'
ENERGY_PERF_BIAS: View and update with x86_energy_perf_policy(8)
[ 0.004000] CPU: Physical Processor ID: 0
[ 0.004000] CPU: Processor Core ID: 0
[ 0.004000] Last level iTLB entries: 4KB 512, 2MB 8, 4MB 8
Last level dTLB entries: 4KB 512, 2MB 32, 4MB 32, 1GB 0
tlb_flushall_shift: 2
[ 0.036441] Freeing SMP alternatives memory: 20K (ffffffff81a1b000 -
ffffffff81a20000)
[ 0.040068] ftrace: allocating 21679 entries in 85 pages
[ 0.048193] Performance Events: unsupported p6 CPU model 58 no PMU driver,
software events only.
[ 0.050513] x86: Booted up 1 node, 1 CPUs
[ 0.050738] NMI watchdog: disabled (cpu0): hardware events not enabled
[ 0.050849] devtmpfs: initialized
[ 0.055640] pinctrl core: initialized pinctrl subsystem
[ 0.055761] NET: Registered protocol family 16
[ 0.055786] xen:grant_table: Grant tables using version 1 layout
[ 0.055811] Grant table initialized
[ 0.056754] PCI: setting up Xen PCI frontend stub
[ 0.056764] PCI: pci_cache_line_size set to 64 bytes
[ 0.057845] ACPI: Interpreter disabled.
[ 0.057869] xen:balloon: Initialising balloon driver
[ 0.057891] xen_balloon: Initialising balloon driver
[ 0.057891] vgaarb: loaded
[ 0.057891] PCI: System does not support PCI
[ 0.057891] PCI: System does not support PCI
[ 0.060186] Switched to clocksource xen
[ 0.066155] pnp: PnP ACPI: disabled
[ 0.068881] NET: Registered protocol family 2
[ 0.069126] TCP established hash table entries: 1024 (order: 1, 8192 bytes)
[ 0.069142] TCP bind hash table entries: 1024 (order: 2, 16384 bytes)
[ 0.069150] TCP: Hash tables configured (established 1024 bind 1024)
[ 0.069170] TCP: reno registered
[ 0.069178] UDP hash table entries: 256 (order: 1, 8192 bytes)
[ 0.069188] UDP-Lite hash table entries: 256 (order: 1, 8192 bytes)
[ 0.069240] NET: Registered protocol family 1
[ 0.069260] PCI: CLS 0 bytes, default 64
[ 0.069323] Unpacking initramfs...
[ 0.124178] Freeing initrd memory: 43680K (ffff880001f18000 -
ffff8800049c0000)
[ 0.126623] platform rtc_cmos: registered platform RTC device (no PNP device
found)
[ 0.126711] RAPL PMU detected, hw unit 2^-16 Joules, API unit is 2^-32
Joules, 3 fixed counters 163840 ms ovf
[ 0.126757] microcode: CPU0 sig=0x306a9, pf=0x2, revision=0x19
[ 0.126826] microcode: Microcode Update Driver: v2.00 <tigran at
aivazian.fsnet.co.uk>, Peter Oruba
[ 0.127132] futex hash table entries: 256 (order: 2, 16384 bytes)
[ 0.127170] audit: initializing netlink subsys (disabled)
[ 0.127196] audit: type=2000 audit(1452265722.038:1): initialized
[ 0.128047] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[ 0.128087] zbud: loaded
[ 0.128295] VFS: Disk quotas dquot_6.5.2
[ 0.128314] Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[ 0.128403] msgmni has been set to 227
[ 0.128778] alg: No test for stdrng (krng)
[ 0.128809] Block layer SCSI generic (bsg) driver version 0.4 loaded (major
252)
[ 0.128867] io scheduler noop registered (default)
[ 0.128875] io scheduler deadline registered
[ 0.128912] io scheduler cfq registered
[ 0.128995] pci_hotplug: PCI Hot Plug PCI Core version: 0.5
[ 0.129021] pciehp: PCI Express Hot Plug Controller Driver version: 0.4
[ 0.129062] intel_idle: does not run on family 6 model 58
[ 0.129466] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[ 0.129819] Linux agpgart interface v0.103
[ 0.129918] i8042: PNP: No PS/2 controller found. Probing ports directly.
[ 1.373182] i8042: No controller found
[ 1.373401] mousedev: PS/2 mouse device common for all mice
[ 1.460855] rtc_cmos rtc_cmos: rtc core: registered rtc_cmos as rtc0
[ 1.460918] rtc_cmos: probe of rtc_cmos failed with error -38
[ 1.460953] ledtrig-cpu: registered to indicate activity on CPUs
[ 1.460973] AMD IOMMUv2 driver by Joerg Roedel <joerg.roedel at
amd.com>
[ 1.460977] AMD IOMMUv2 functionality not available on this system
[ 1.461076] TCP: cubic registered
[ 1.461097] NET: Registered protocol family 10
[ 1.461286] mip6: Mobile IPv6
[ 1.461295] NET: Registered protocol family 17
[ 1.461303] mpls_gso: MPLS GSO support
[ 1.461310] mce: Unable to init device /dev/mcelog (rc: -5)
[ 1.461463] registered taskstats version 1
[ 1.461516] xenbus_probe_frontend: Device with no driver: device/vbd/51714
[ 1.461521] xenbus_probe_frontend: Device with no driver: device/vbd/51713
[ 1.461524] xenbus_probe_frontend: Device with no driver: device/vif/0
[ 1.461527] xenbus_probe_frontend: Device with no driver: device/pci/0
[ 1.461569] rtc_hctosys: unable to open rtc device (rtc0)
[ 1.461620] PM: Hibernation image not present or could not be loaded.
[ 1.462130] Freeing unused kernel memory: 1204K (ffffffff818ee000 -
ffffffff81a1b000)
[ 1.462137] Write protecting the kernel read-only data: 8192k
[ 1.464662] Freeing unused kernel memory: 912K (ffff88000151c000 -
ffff880001600000)
[ 1.464765] Freeing unused kernel memory: 212K (ffff8800017cb000 -
ffff880001800000)
[ 1.484305] systemd-udevd[58]: starting version 215
[ 1.484846] random: systemd-udevd urandom read with 4 bits of entropy
available
[ 1.508462] xen_netfront: Initialising Xen virtual ethernet driver
[ 1.565647] blkfront: xvda2: flush diskcache: enabled; persistent grants:
enabled; indirect descriptors: enab
[ 1.568041] blkfront: xvda1: flush diskcache: enabled; persistent grants:
enabled; indirect descriptors: enab
[ 9.699548] EXT4-fs (xvda2): mounted filesystem with ordered data mode. Opts:
(null)
[ 10.030680] random: nonblocking pool is initialized
[ 11.587594] systemd[1]: systemd 215 running in system mode. (+PAM +AUDIT
+SELINUX +IMA +SYSVINIT +LIBCRYPTSET
[ 11.587689] systemd[1]: Detected virtualization 'xen'.
[ 11.587704] systemd[1]: Detected architecture 'x86-64'.
[ 12.754742] systemd[1]: Inserted module 'autofs4'
[ 12.791362] systemd[1]: Set hostname to <bug>.
[ 16.336333] systemd[1]: Cannot add dependency job for unit dbus.socket,
ignoring: Unit dbus.socket failed to
[ 16.336369] systemd[1]: Cannot add dependency job for unit
display-manager.service, ignoring: Unit display-ma
[ 16.336879] systemd[1]: Starting Forward Password Requests to Wall Directory
Watch.
[ 16.337039] systemd[1]: Started Forward Password Requests to Wall Directory
Watch.
[ 16.337067] systemd[1]: Expecting device dev-hvc0.device...
[ 16.337241] systemd[1]: Starting Remote File Systems (Pre).
[ 16.337329] systemd[1]: Reached target Remote File Systems (Pre).
[ 16.337384] systemd[1]: Starting Arbitrary Executable File Formats File
System Automount Point.
[ 16.337608] systemd[1]: Set up automount Arbitrary Executable File Formats
File System Automount Point.
[ 16.337649] systemd[1]: Starting Dispatch Password Requests to Console
Directory Watch.
[ 16.337733] systemd[1]: Started Dispatch Password Requests to Console
Directory Watch.
[ 16.337755] systemd[1]: Starting Paths.
[ 16.337842] systemd[1]: Reached target Paths.
[ 16.337866] systemd[1]: Starting Encrypted Volumes.
[ 16.337947] systemd[1]: Reached target Encrypted Volumes.
[ 16.337970] systemd[1]: Expecting device dev-xvda1.device...
[ 16.338059] systemd[1]: Starting Root Slice.
[ 16.338166] systemd[1]: Created slice Root Slice.
[ 16.338191] systemd[1]: Starting User and Session Slice.
[ 16.338322] systemd[1]: Created slice User and Session Slice.
[ 16.338346] systemd[1]: Starting Delayed Shutdown Socket.
[ 16.338812] systemd[1]: Listening on Delayed Shutdown Socket.
[ 16.338840] systemd[1]: Starting /dev/initctl Compatibility Named Pipe.
[ 16.338979] systemd[1]: Listening on /dev/initctl Compatibility Named Pipe.
[ 16.339002] systemd[1]: Starting Journal Socket (/dev/log).
[ 16.339141] systemd[1]: Listening on Journal Socket (/dev/log).
[ 16.339175] systemd[1]: Starting udev Kernel Socket.
[ 16.339280] systemd[1]: Listening on udev Kernel Socket.
[ 16.339311] systemd[1]: Starting udev Control Socket.
[ 16.339425] systemd[1]: Listening on udev Control Socket.
[ 16.339454] systemd[1]: Starting Journal Socket.
[ 16.339594] systemd[1]: Listening on Journal Socket.
[ 16.339632] systemd[1]: Starting System Slice.
[ 16.339776] systemd[1]: Created slice System Slice.
[ 16.339819] systemd[1]: Starting File System Check on Root Device...
[ 16.341351] systemd[1]: Starting system-getty.slice.
[ 16.341580] systemd[1]: Created slice system-getty.slice.
[ 16.341606] systemd[1]: Starting system-serial\x2dgetty.slice.
[ 16.341751] systemd[1]: Created slice system-serial\x2dgetty.slice.
[ 16.341832] systemd[1]: Starting Increase datagram queue length...
[ 16.343890] systemd[1]: Mounting POSIX Message Queue File System...
[ 16.349573] systemd[1]: Mounting Debug File System...
[ 16.386487] systemd[1]: Started Set Up Additional Binary Formats.
[ 16.386567] systemd[1]: Mounting Huge Pages File System...
[ 16.388234] systemd[1]: Starting Create list of required static device nodes
for the current kernel...
[ 16.420891] systemd[1]: Starting Load Kernel Modules...
[ 16.422455] systemd[1]: Starting udev Coldplug all Devices...
[ 16.423981] systemd[1]: Starting Slices.
[ 16.424152] systemd[1]: Reached target Slices.
[ 16.526927] systemd[1]: Mounted Huge Pages File System.
[ 16.527472] systemd[1]: Mounted POSIX Message Queue File System.
[ 16.528053] systemd[1]: Mounted Debug File System.
[ 16.539437] systemd[1]: Started Increase datagram queue length.
[ 16.539776] systemd[1]: Starting Syslog Socket.
[ 16.539873] systemd[1]: Listening on Syslog Socket.
[ 16.539901] systemd[1]: Starting Sockets.
[ 16.539940] systemd[1]: Reached target Sockets.
[ 16.539963] systemd[1]: Starting Journal Service...
[ 16.541579] systemd[1]: Started Journal Service.
[ 20.334341] systemd-udevd[138]: starting version 215
[ 20.905312] EXT4-fs (xvda2): re-mounted. Opts: errors=remount-ro
[ 21.199307] pcifront pci-0: Installing PCI frontend
[ 21.199334] xen:swiotlb_xen: Warning: only able to allocate 4 MB for software
IO TLB
[ 21.202593] software IO TLB [mem 0x05800000-0x05c00000] (4MB) mapped at
[ffff880005800000-ffff880005bfffff]
[ 21.211902] pcifront pci-0: Creating PCI Frontend Bus 0000:00
[ 21.211974] pcifront pci-0: PCI host bridge to bus 0000:00
[ 21.211982] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]
[ 21.211988] pci_bus 0000:00: root bus resource [mem 0x00000000-0xfffffffff]
[ 21.211994] pci_bus 0000:00: root bus resource [bus 00-ff]
[ 21.214065] pci 0000:00:01.0: [1912:0014] type 00 class 0x0c0330
[ 21.214505] pci 0000:00:01.0: reg 0x10: [mem 0xfbff0000-0xfbff1fff 64bit]
[ 21.218500] alg: No test for crc32 (crc32-pclmul)
[ 21.234075] pci 0000:00:00.1: [14e4:165f] type 00 class 0x020000
[ 21.234630] pci 0000:00:00.1: reg 0x10: [mem 0xfabc0000-0xfabcffff 64bit
pref]
[ 21.234914] pci 0000:00:00.1: reg 0x18: [mem 0xfabb0000-0xfabbffff 64bit
pref]
[ 21.235179] pci 0000:00:00.1: reg 0x20: [mem 0xfaba0000-0xfabaffff 64bit
pref]
[ 21.242805] pcifront pci-0: New device on 0000:00:00.1 found.
[ 21.261341] pcifront pci-0: claiming resource 0000:00:01.0/0
[ 21.261355] pcifront pci-0: claiming resource 0000:00:00.1/0
[ 21.261360] pcifront pci-0: claiming resource 0000:00:00.1/2
[ 21.261365] pcifront pci-0: claiming resource 0000:00:00.1/4
[ 21.261545] pci 0000:00:01.0: Xen PCI mapped GSI18 to IRQ29
[ 21.364943] systemd-journald[124]: Received request to flush runtime journal
from PID 1
[ 21.584884] input: PC Speaker as /devices/platform/pcspkr/input/input0
[ 21.635516] intel_rapl: Found RAPL domain package
[ 21.635530] intel_rapl: Found RAPL domain core
[ 21.936105] pps_core: LinuxPPS API ver. 1 registered
[ 21.936119] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo
Giometti <giometti at linux.it>
[ 21.961610] PTP clock support registered
[ 22.109201] tg3.c:v3.137 (May 11, 2014)
[ 22.109445] tg3 0000:00:00.1: Xen PCI mapped GSI17 to IRQ30
[ 22.131432] tg3 0000:00:00.1 eth1: Tigon3 [partno(N/A) rev 5720000] (PCI
Express) MAC address 34:64:a9:9a:a8:
[ 22.131450] tg3 0000:00:00.1 eth1: attached PHY is 5720C (10/100/1000Base-T
Ethernet) (WireSpeed[1], EEE[1])
[ 22.131459] tg3 0000:00:00.1 eth1: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[1]
TSOcap[1]
[ 22.131466] tg3 0000:00:00.1 eth1: dma_rwctrl[00000001] dma_mask[64-bit]
[ 22.154753] usbcore: registered new interface driver usbfs
[ 22.155023] usbcore: registered new interface driver hub
[ 22.157566] usbcore: registered new device driver usb
[ 22.293477] xen:events: xen_bind_pirq_gsi_to_irq: returning irq 29 for gsi 18
[ 22.293493] xhci_hcd 0000:00:01.0: Xen PCI mapped GSI18 to IRQ29
[ 22.293632] xhci_hcd 0000:00:01.0: xHCI Host Controller
[ 22.293645] xhci_hcd 0000:00:01.0: new USB bus registered, assigned bus
number 1
[ 22.302041] xen:events: Failed to obtain physical IRQ 31
[ 22.302064] xen:events: Failed to obtain physical IRQ 32
[ 22.302159] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
[ 22.302166] usb usb1: New USB device strings: Mfr=3, Product=2,
SerialNumber=1
[ 22.302172] usb usb1: Product: xHCI Host Controller
[ 22.302176] usb usb1: Manufacturer: Linux 3.16.0-4-amd64 xhci_hcd
[ 22.302181] usb usb1: SerialNumber: 0000:00:01.0
[ 22.302529] hub 1-0:1.0: USB hub found
[ 22.302551] hub 1-0:1.0: 2 ports detected
[ 22.302686] xhci_hcd 0000:00:01.0: xHCI Host Controller
[ 22.302696] xhci_hcd 0000:00:01.0: new USB bus registered, assigned bus
number 2
[ 22.302750] usb usb2: We don't know the algorithms for LPM for this host,
disabling LPM.
[ 22.302780] usb usb2: New USB device found, idVendor=1d6b, idProduct=0003
[ 22.302786] usb usb2: New USB device strings: Mfr=3, Product=2,
SerialNumber=1
[ 22.302792] usb usb2: Product: xHCI Host Controller
[ 22.302796] usb usb2: Manufacturer: Linux 3.16.0-4-amd64 xhci_hcd
[ 22.302801] usb usb2: SerialNumber: 0000:00:01.0
[ 22.303057] hub 2-0:1.0: USB hub found
[ 22.303075] hub 2-0:1.0: 2 ports detected
[ 22.808901] Adding 262140k swap on /dev/xvda1. Priority:-1 extents:1
across:262140k SSFS
[ 188.358732] xen:events: Failed to obtain physical IRQ 33
[ 188.487712] IPv6: ADDRCONF(NETDEV_UP): eth1: link is not ready
The last "xen:events: Failed to obtain physical IRQ 33" is from when I
did a "ifconfig eth1 up"
where eth1 is the tg3 NIC.
dom0 "grep -vE '^#|^$' /etc/xen/bug.cfg":
bootloader = '/usr/lib/xen-4.4/bin/pygrub'
vcpus = '1'
memory = '128'
root = '/dev/xvda2 ro'
disk = [
'phy:/dev/vg_xen/bug-disk,xvda2,w',
'phy:/dev/vg_xen/bug-swap,xvda1,w',
]
name = 'bug'
dhcp = 'dhcp'
vif = [ 'mac=00:16:3E:99:92:03,bridge=br_home' ]
pci = [ '03:00.1,permissive=1', '04:00.0,permissive=1' ]
on_poweroff = 'destroy'
on_reboot = 'restart'
on_crash = 'restart'
dom0 "xl pci-list bug":
Vdev Device
00.0 0000:03:00.1
00.0 0000:04:00.0
Br,
Tommi Airikka
-- System Information:
Debian Release: 8.2
APT prefers stable
APT policy: (500, 'stable')
Architecture: amd64 (x86_64)
Kernel: Linux 3.16.0-4-amd64 (SMP w/1 CPU core)
Locale: LANG=C, LC_CTYPE=C (charmap=ANSI_X3.4-1968)
Shell: /bin/sh linked to /bin/dash
Init: systemd (via /run/systemd/system)
Ian Campbell
2016-Jan-20 11:22 UTC
[Pkg-xen-devel] Bug#810379: Bug#810379: xen: pci-passthrough generates "xen:events: Failed to obtain physical IRQ" for some devices
On Fri, 2016-01-08 at 17:19 +0100, Tommi Airikka wrote:> Source: xen > Severity: normal > > Dear Maintainer, > > After an upgrade, my passthroughed NIC stopped working. > I created a new jessie domU and tried to passthrough some PCI devices > and found that both USB3 host controller and tg3 NIC generated these > lines in domU dmesg: > > xen:events: Failed to obtain physical IRQ 31 > xen:events: Failed to obtain physical IRQ 32 > xen:events: Failed to obtain physical IRQ 33Thanks for the report. I think this is as likely to be a dom0/domU kernel (i.e. pciback/front) issue as a hypervisor one, but I'm not sure. Would you mind reporting this to upstream per: http://wiki.xen.org/wiki/Reporting_Bugs_against_Xen please. We could forward it but I expect there will need to be some back and forth with the maintainers so it makes sense for you to speak to them directly. You can CC 810379 at bugs.debian.org to keep this bug in the loop. In addition to the information you provide here I would expect upstream to want to see the dom0 lspci for the devices you are passing through, as well as dom0's /proc/interrupts and probably full "xl dmesg" and dmesg from both dom0 and domU. Thanks, Ian.
Possibly Parallel Threads
- Bug#810379: [BUG] pci-passthrough generates "xen:events: Failed to obtain physical IRQ" for some devices
- Bug#810379: [Xen-devel] [BUG] pci-passthrough generates "xen:events: Failed to obtain physical IRQ" for some devices
- Bug#810379: [Xen-devel] [BUG] pci-passthrough generates "xen:events: Failed to obtain physical IRQ" for some devices
- Problem with GTX 970 under Fedora 21
- 3.12rc1-pre Nouveau? oops