Sander Eikelenboom
2013-Jul-22 20:50 UTC
[xen-unstable] Commit 2ca9fbd739b8a72b16dd790d0fff7b75f5488fb8 AMD IOMMU: allocate IRTE entries instead of using a static mapping, makes dom0 boot process stall several times.
Hi Jan, After commit 2ca9fbd739b8a72b16dd790d0fff7b75f5488fb8 AMD IOMMU: allocate IRTE entries instead of using a static mapping, booting dom0 stalls several times. Sometimes this results in RCU stall warnings from the dom0 kernel, hitting the "any" key, on normal or serial console, makes the boot continue for a while but it stalls several times. (It also stalls on shutdown BTW) I have bisected it to this commit running kernel 3.10.2 and Debian wheezy. xl-dmesg and dmesg from a boot with stall are attached, snippet from dmesg with RCU stall appended below. Note that i do have to run with iommu=''no-amd-iommu-perdev-intremap'' due to the bios bug that probably will never get fixed. When i run without the ''no-amd-iommu-perdev-intremap'' the iommu is disabled and stalls do not occur. -- Sander [ 13.066802] udevd[1548]: starting version 175 [ 13.250159] usb 4-5: New USB device found, idVendor=0a12, idProduct=0001 [ 13.255702] usb 4-5: New USB device strings: Mfr=0, Product=2, SerialNumber=0 [ 13.261247] usb 4-5: Product: EDRClassone [ 13.700775] bio: create slab <bio-2> at 2 [ 14.332086] EXT4-fs (dm-0): mounted filesystem with ordered data mode. Opts: (null) [ 17.210269] udevd[1959]: starting version 175 [ 130.161724] INFO: rcu_preempt detected stalls on CPUs/tasks: [ 130.172305] (detected by 3, t=33837 jiffies, g=107, c=106, q=126) [ 130.180226] INFO: Stall ended before state dump start [ 131.052732] ata1.00: configured for UDMA/133 [ 131.061174] ata1: EH complete [ 132.143528] ata1.00: configured for UDMA/133 [ 132.149962] ata1: EH complete [ 133.214683] EXT4-fs (dm-0): re-mounted. Opts: (null) [ 133.747387] EXT4-fs (dm-0): re-mounted. Opts: barrier=1,errors=remount-ro [ 141.751979] Adding 2097148k swap on /dev/mapper/serveerstertje-swap. Priority:-1 extents:1 across:2097148k [ 154.078205] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: barrier=1,errors=remount-ro [ 308.571758] INFO: rcu_preempt self-detected stall on CPU [ 308.572077] INFO: rcu_preempt self-detected stall on CPU [ 308.572105] 1: (1 ticks this GP) idle=b03/1/0 softirq=2415/2415 last_accelerate: 4e40/0059, nonlazy_posted: 0, .. [ 308.575441] INFO: rcu_preempt self-detected stall on CPU [ 308.575446] [ 308.575451] (t=45593 jiffies g=1527 c=1526 q=67) [ 308.575461] 2: (1 GPs behind) idle=d1b/1/0 softirq=2276/2277 last_accelerate: 4e3e/0059, nonlazy_posted: 0, L. [ 308.575473] sending NMI to all CPUs: [ 308.575477] INFO: rcu_preempt self-detected stall on CPU [ 308.575483] xen: vector 0x2 is not implemented [ 308.575490] (t=45594 jiffies g=1527 c=1526 q=67) [ 308.575494] [ 308.575507] 3: (1 ticks this GP) idle=9fb/1/0 softirq=1945/1945 last_accelerate: 4e3d/005a, nonlazy_posted: 0, .. [ 308.575515] (t=45594 jiffies g=1527 c=1526 q=67) [ 308.672071] 5: (1 ticks this GP) idle=c8b/1/0 softirq=1858/1858 last_accelerate: 0014/0074, nonlazy_posted: 0, L. [ 308.679459] (t=45625 jiffies g=1527 c=1526 q=38) [ 308.795873] r8169 0000:0a:00.0 eth1: link down [ 308.803468] r8169 0000:0a:00.0 eth1: link down [ 310.542284] r8169 0000:0a:00.0 eth1: link up [ 318.576834] Hangcheck: hangcheck value past margin! [ 318.864711] r8169 0000:0b:00.0 eth0: link down [ 318.864739] r8169 0000:0b:00.0 eth0: link down [ 320.568031] r8169 0000:0b:00.0 eth0: link up _______________________________________________ Xen-devel mailing list Xen-devel@lists.xen.org http://lists.xen.org/xen-devel
Jan Beulich
2013-Aug-05 07:48 UTC
Re: [xen-unstable] Commit 2ca9fbd739b8a72b16dd790d0fff7b75f5488fb8 AMD IOMMU: allocate IRTE entries instead of using a static mapping, makes dom0 boot process stall several times.
>>> On 22.07.13 at 22:50, Sander Eikelenboom <linux@eikelenboom.it> wrote: > After commit 2ca9fbd739b8a72b16dd790d0fff7b75f5488fb8 AMD IOMMU: allocate > IRTE entries instead of using a static mapping, booting dom0 stalls several > times. > Sometimes this results in RCU stall warnings from the dom0 kernel, hitting > the "any" key, on normal or serial console, makes the boot continue for a > while but it stalls several times. > (It also stalls on shutdown BTW) > > I have bisected it to this commit running kernel 3.10.2 and Debian wheezy. > > xl-dmesg and dmesg from a boot with stall are attached, snippet from dmesg > with RCU stall appended below. > > Note that i do have to run with iommu=''no-amd-iommu-perdev-intremap'' due to the > bios bug that probably will never get fixed. > When i run without the ''no-amd-iommu-perdev-intremap'' the iommu is disabled and > stalls do not occur.I can only hope that someone with access to a system exposing this problem (you?) can debug it - I certainly have no system where this issue could be seen, and I don''t recall Suravee having noticed anything like this in his testing of those patches. Jan
Suravee Suthikulanit
2013-Aug-06 15:47 UTC
Re: [xen-unstable] Commit 2ca9fbd739b8a72b16dd790d0fff7b75f5488fb8 AMD IOMMU: allocate IRTE entries instead of using a static mapping, makes dom0 boot process stall several times.
On 8/5/2013 2:48 AM, Jan Beulich wrote:>>>> On 22.07.13 at 22:50, Sander Eikelenboom <linux@eikelenboom.it> wrote: >> After commit 2ca9fbd739b8a72b16dd790d0fff7b75f5488fb8 AMD IOMMU: allocate >> IRTE entries instead of using a static mapping, booting dom0 stalls several >> times. >> Sometimes this results in RCU stall warnings from the dom0 kernel, hitting >> the "any" key, on normal or serial console, makes the boot continue for a >> while but it stalls several times. >> (It also stalls on shutdown BTW) >> >> I have bisected it to this commit running kernel 3.10.2 and Debian wheezy. >> >> xl-dmesg and dmesg from a boot with stall are attached, snippet from dmesg >> with RCU stall appended below. >> >> Note that i do have to run with iommu=''no-amd-iommu-perdev-intremap'' due to the >> bios bug that probably will never get fixed. >> When i run without the ''no-amd-iommu-perdev-intremap'' the iommu is disabled and >> stalls do not occur. > I can only hope that someone with access to a system exposing this > problem (you?) can debug it - I certainly have no system where this > issue could be seen, and I don''t recall Suravee having noticed > anything like this in his testing of those patches. > > JanI don''t have the system which has the exact same BIOS IVRS IOAPIC bug as mentioned in the origin xl dmesg output you sent. In your case the special IVHD entry for the first IOAPIC with ID 0x6 is missing from IVRS table. (XEN) AMD-Vi: IVHD Special: 0000:00:14.0 variety 0x2 handle 0 (XEN) AMD-Vi: IVHD Device Entry: type 0x48 id 0 flags 0 (XEN) AMD-Vi: IVHD Special: 0000:00:00.1 variety 0x1 handle 0x7 (XEN) IVHD Error: no information for IO-APIC 0x6 (XEN) vmap(ffff82c000802000:0x4) (XEN) AMD-Vi: IOMMU 0 Enabled. (XEN) AMD-Vi: Using global interrupt remap table is not recommended (see XSA-36)! (XEN) I/O virtualisation enabled Here, I was expecting to see a print out showing (XEN) AMD-Vi: IVHD Special: 0000:00:14.0 variety 0x1 handle 0x6 I could imagine this would cause IOMMU to not correctly setup, and probably should be disabled. Suravee
Sander Eikelenboom
2013-Aug-15 14:43 UTC
Re: [xen-unstable] Commit 2ca9fbd739b8a72b16dd790d0fff7b75f5488fb8 AMD IOMMU: allocate IRTE entries instead of using a static mapping, makes dom0 boot process stall several times.
Tuesday, August 6, 2013, 5:47:04 PM, you wrote:> On 8/5/2013 2:48 AM, Jan Beulich wrote: >>>>> On 22.07.13 at 22:50, Sander Eikelenboom <linux@eikelenboom.it> wrote: >>> After commit 2ca9fbd739b8a72b16dd790d0fff7b75f5488fb8 AMD IOMMU: allocate >>> IRTE entries instead of using a static mapping, booting dom0 stalls several >>> times. >>> Sometimes this results in RCU stall warnings from the dom0 kernel, hitting >>> the "any" key, on normal or serial console, makes the boot continue for a >>> while but it stalls several times. >>> (It also stalls on shutdown BTW) >>> >>> I have bisected it to this commit running kernel 3.10.2 and Debian wheezy. >>> >>> xl-dmesg and dmesg from a boot with stall are attached, snippet from dmesg >>> with RCU stall appended below. >>> >>> Note that i do have to run with iommu=''no-amd-iommu-perdev-intremap'' due to the >>> bios bug that probably will never get fixed. >>> When i run without the ''no-amd-iommu-perdev-intremap'' the iommu is disabled and >>> stalls do not occur. >> I can only hope that someone with access to a system exposing this >> problem (you?) can debug it - I certainly have no system where this >> issue could be seen, and I don''t recall Suravee having noticed >> anything like this in his testing of those patches. >> >> Jan> I don''t have the system which has the exact same BIOS IVRS IOAPIC bug as mentioned > in the origin xl dmesg output you sent. In your case the special IVHD entry for the > first IOAPIC with ID 0x6 is missing from IVRS table.> (XEN) AMD-Vi: IVHD Special: 0000:00:14.0 variety 0x2 handle 0 > (XEN) AMD-Vi: IVHD Device Entry: type 0x48 id 0 flags 0 > (XEN) AMD-Vi: IVHD Special: 0000:00:00.1 variety 0x1 handle 0x7 > (XEN) IVHD Error: no information for IO-APIC 0x6 > (XEN) vmap(ffff82c000802000:0x4) > (XEN) AMD-Vi: IOMMU 0 Enabled. > (XEN) AMD-Vi: Using global interrupt remap table is not recommended (see XSA-36)! > (XEN) I/O virtualisation enabled> Here, I was expecting to see a print out showing> (XEN) AMD-Vi: IVHD Special: 0000:00:14.0 variety 0x1 handle 0x6> I could imagine this would cause IOMMU to not correctly setup, and probably should > be disabled.Well apart from the dom0 boot stalls, everthing is working fine after the system is booted, including the passthrough of 4 pci(e) devices. From closer inspection it seems to be when enabling the sata controller and the NICs during dom0 boot. The question is why it stalls, and why it seems to resume when pressing any key on the console. (so unfortunately trying to use xen debug keys to find out what it''s occupied with doesn''t work in this case) The Bisection pointed to that changeset, which is quite large, i will see if i can get some more info. -- Sander> Suravee
Jan Beulich
2013-Aug-15 15:15 UTC
Re: [xen-unstable] Commit 2ca9fbd739b8a72b16dd790d0fff7b75f5488fb8 AMD IOMMU: allocate IRTE entries instead of using a static mapping, makes dom0 boot process stall several times.
>>> On 15.08.13 at 16:43, Sander Eikelenboom <linux@eikelenboom.it> wrote: > Well apart from the dom0 boot stalls, everthing is working fine after the > system is booted, including the passthrough of 4 pci(e) devices. > From closer inspection it seems to be when enabling the sata controller and > the NICs during dom0 boot. > The question is why it stalls, and why it seems to resume when pressing any > key on the console.Once the system is up, can you check whether a sane amount of interrupts is arriving for SATA controller and NIC? The stalls could certainly be a result of there being interrupts missing the driver expects, potentially causing it to fall back to some polling mode. Jan
Sander Eikelenboom
2013-Aug-15 23:22 UTC
Re: [xen-unstable] Commit 2ca9fbd739b8a72b16dd790d0fff7b75f5488fb8 AMD IOMMU: allocate IRTE entries instead of using a static mapping, makes dom0 boot process stall several times.
Thursday, August 15, 2013, 5:15:43 PM, you wrote:>>>> On 15.08.13 at 16:43, Sander Eikelenboom <linux@eikelenboom.it> wrote: >> Well apart from the dom0 boot stalls, everthing is working fine after the >> system is booted, including the passthrough of 4 pci(e) devices. >> From closer inspection it seems to be when enabling the sata controller and >> the NICs during dom0 boot. >> The question is why it stalls, and why it seems to resume when pressing any >> key on the console.> Once the system is up, can you check whether a sane amount of > interrupts is arriving for SATA controller and NIC? The stalls could > certainly be a result of there being interrupts missing the driver > expects, potentially causing it to fall back to some polling mode.> JanHmm does seem to be a bit more random than i initially thought ... so that all seemed to be a red herring .. Adding Andrew to CC Since i saw a thread about him working on a hpet interrupt issue ... All this below was done running: xen-unstable (git:ab7f9a7) kernel: 3.9.0 (was using 3.11-rc''s before, but downgraded to rule that out) However .. after fixing up my serial console i''m able to use the debug keys on the moment it stalls. Pressing the key makes everything continue again, but nevertheless perhaps: (XEN) [2013-08-15 21:48:55] IOAPIC[1]: Set PCI routing entry (7-27 -> 0x32 -> IRQ 51 Mode:1 Active:1) (XEN) [2013-08-15 21:49:20] *** Serial input -> Xen (type ''CTRL-a'' three times to switch input to DOM0) (XEN) [2013-08-15 21:49:55] ''d'' pressed -> dumping registers (XEN) [2013-08-15 21:49:55] (XEN) [2013-08-15 21:49:55] *** Dumping CPU0 host state: *** (XEN) [2013-08-15 21:49:55] ----[ Xen-4.4-unstable x86_64 debug=y Not tainted ]---- (XEN) [2013-08-15 21:49:55] CPU: 0 (XEN) [2013-08-15 21:49:55] RIP: e008:[<ffff82d0801a1a1c>] hpet_broadcast_exit+0/0x171 (XEN) [2013-08-15 21:49:55] RFLAGS: 0000000000000246 CONTEXT: hypervisor (XEN) [2013-08-15 21:49:55] rax: 0000000000000000 rbx: ffff83055d73be60 rcx: 20c49ba5e353f7cf (XEN) [2013-08-15 21:49:55] rdx: ffff82d080311220 rsi: 000000109ba8c084 rdi: ffff83055d73be88 (XEN) [2013-08-15 21:49:55] rbp: ffff82d0802cfef0 rsp: ffff82d0802cfe88 r8: 0000000ddd0c9d10 (XEN) [2013-08-15 21:49:55] r9: 0000000000000000 r10: 0000000decae8c37 r11: 0000000000000246 (XEN) [2013-08-15 21:49:55] r12: ffff83055d73bed0 r13: 0000000deb20de1e r14: 000000109ba8c084 (XEN) [2013-08-15 21:49:55] r15: ffff82d080311280 cr0: 000000008005003b cr4: 00000000000006f0 (XEN) [2013-08-15 21:49:55] cr3: 000000009fc7b000 cr2: 00000000019ec208 (XEN) [2013-08-15 21:49:55] ds: 0000 es: 0000 fs: 0000 gs: 0000 ss: e010 cs: e008 (XEN) [2013-08-15 21:49:55] Xen stack trace from rsp=ffff82d0802cfe88: (XEN) [2013-08-15 21:49:55] ffff82d0801a3f02 ffff82d080225a00 0000000deb255ece ffff82d0802e8000 (XEN) [2013-08-15 21:49:55] ffff82d0802e8000 ffff82d0802cfee0 0000000000000000 0000000000000000 (XEN) [2013-08-15 21:49:55] 0000015a000002c1 ffff82d0802c8000 ffff82d0802c8000 00000000ffffffff (XEN) [2013-08-15 21:49:55] 0000000000000002 ffff82d0802cff10 ffff82d08015ce92 ffff83009fd13000 (XEN) [2013-08-15 21:49:55] ffff83009ff88000 ffff82d0802cfdd8 0000000000000000 ffff88005fcf3040 (XEN) [2013-08-15 21:49:55] ffffffff81f970c0 ffffffff81edb630 ffffffff81e01e88 ffffffff81e01fd8 (XEN) [2013-08-15 21:49:55] 0000000000000246 0000000000000000 0000000000000000 0000000000000001 (XEN) [2013-08-15 21:49:55] 0000000000000000 ffffffff810013aa ffffffff81e13440 00000000deadbeef (XEN) [2013-08-15 21:49:55] 00000000deadbeef 0000010000000000 ffffffff810013aa 000000000000e033 (XEN) [2013-08-15 21:49:55] 0000000000000246 ffffffff81e01e70 000000000000e02b 0000000000000000 (XEN) [2013-08-15 21:49:55] 0000000000000000 0000000000000000 0000000000000000 0000000000000000 (XEN) [2013-08-15 21:49:55] ffff83009fd13000 0000000000000000 0000000000000000 (XEN) [2013-08-15 21:49:55] Xen call trace: (XEN) [2013-08-15 21:49:55] [<ffff82d0801a1a1c>] hpet_broadcast_exit+0/0x171 (XEN) [2013-08-15 21:49:56] [<ffff82d08015ce92>] idle_loop+0x5b/0x6b (XEN) [2013-08-15 21:49:56] (XEN) [2013-08-15 21:49:56] *** Dumping CPU1 host state: *** (XEN) [2013-08-15 21:49:56] ----[ Xen-4.4-unstable x86_64 debug=y Not tainted ]---- (XEN) [2013-08-15 21:49:56] CPU: 1 (XEN) [2013-08-15 21:49:56] RIP: e008:[<ffff82d0801a1a1c>] hpet_broadcast_exit+0/0x171 (XEN) [2013-08-15 21:49:56] RFLAGS: 0000000000000246 CONTEXT: hypervisor (XEN) [2013-08-15 21:49:56] rax: 0000000000000000 rbx: ffff83055d73a700 rcx: 20c49ba5e353f7cf (XEN) [2013-08-15 21:49:56] rdx: ffff83055d6db020 rsi: 00000010c56cd683 rdi: ffff83055d73a728 (XEN) [2013-08-15 21:49:56] rbp: ffff83055d6d7ef0 rsp: ffff83055d6d7e88 r8: 0000000ddd0c9d10 (XEN) [2013-08-15 21:49:56] r9: 0000000000000000 r10: 00000000deadbeef r11: 0000000000000246 (XEN) [2013-08-15 21:49:56] r12: ffff83055d73a770 r13: 0000000dfda25862 r14: 00000010c56cd683 (XEN) [2013-08-15 21:49:56] r15: ffff83055d6db080 cr0: 000000008005003b cr4: 00000000000006f0 (XEN) [2013-08-15 21:49:56] cr3: 00000005440db000 cr2: ffff8800577e1020 (XEN) [2013-08-15 21:49:56] ds: 002b es: 002b fs: 0000 gs: 0000 ss: e010 cs: e008 (XEN) [2013-08-15 21:49:56] Xen stack trace from rsp=ffff83055d6d7e88: (XEN) [2013-08-15 21:49:56] ffff82d0801a3f02 ffff82d080225a00 0000000e15445354 ffff82d0802e8080 (XEN) [2013-08-15 21:49:56] ffff82d0802e8000 ffff83055d6d0000 0000000000000000 0000000000000000 (XEN) [2013-08-15 21:49:56] 000000cb000172d7 ffff83055d6d0000 ffff83055d6d0000 00000000ffffffff (XEN) [2013-08-15 21:49:56] 0000000000000002 ffff83055d6d7f10 ffff82d08015ce92 ffff83009fafe000 (XEN) [2013-08-15 21:49:56] ffff83009fd17000 ffff83055d6d7dd8 0000000000000000 0000000000000000 (XEN) [2013-08-15 21:49:56] 0000000000000000 ffffffff81edb630 ffff880059bd5f10 ffff880059bd5fd8 (XEN) [2013-08-15 21:49:56] 0000000000000246 0000000000000000 0000000000000000 0000000000000001 (XEN) [2013-08-15 21:49:56] 0000000000000000 ffffffff810013aa ffff880059bd8000 00000000deadbeef (XEN) [2013-08-15 21:49:56] 00000000deadbeef 0000010000000000 ffffffff810013aa 000000000000e033 (XEN) [2013-08-15 21:49:56] 0000000000000246 ffff880059bd5ef8 000000000000e02b 64657a696c616974 (XEN) [2013-08-15 21:49:56] 312020205b0a0d0d 3332373831342e35 6f7465756c42205d 4943482000000001 (XEN) [2013-08-15 21:49:56] ffff83009fafe000 00000034dd3c9e00 7270202935482820 (XEN) [2013-08-15 21:49:56] Xen call trace: (XEN) [2013-08-15 21:49:56] [<ffff82d0801a1a1c>] hpet_broadcast_exit+0/0x171 (XEN) [2013-08-15 21:49:56] [<ffff82d08015ce92>] idle_loop+0x5b/0x6b (XEN) [2013-08-15 21:49:56] (XEN) [2013-08-15 21:49:56] *** Dumping CPU2 host state: *** (XEN) [2013-08-15 21:49:56] ----[ Xen-4.4-unstable x86_64 debug=y Not tainted ]---- (XEN) [2013-08-15 21:49:56] CPU: 2 (XEN) [2013-08-15 21:49:56] RIP: e008:[<ffff82d0801a1a1c>] hpet_broadcast_exit+0/0x171 (XEN) [2013-08-15 21:49:56] RFLAGS: 0000000000000246 CONTEXT: hypervisor (XEN) [2013-08-15 21:49:56] rax: 0000000000000000 rbx: ffff83055d73aba0 rcx: 20c49ba5e353f7cf (XEN) [2013-08-15 21:49:56] rdx: ffff83055d66c020 rsi: 00000010edcb1af0 rdi: ffff83055d73abc8 (XEN) [2013-08-15 21:49:56] rbp: ffff83055d667ef0 rsp: ffff83055d667e88 r8: 0000000ddd0c9d10 (XEN) [2013-08-15 21:49:56] r9: 0000000000000001 r10: 00000000deadbeef r11: 0000000000000246 (XEN) [2013-08-15 21:49:56] r12: ffff83055d73ac10 r13: 0000000dfda4749b r14: 00000010edcb1af0 (XEN) [2013-08-15 21:49:56] r15: ffff83055d66c080 cr0: 000000008005003b cr4: 00000000000006f0 (XEN) [2013-08-15 21:49:56] cr3: 00000005435ac000 cr2: ffffffffff600400 (XEN) [2013-08-15 21:49:56] ds: 002b es: 002b fs: 0000 gs: 0000 ss: e010 cs: e008 (XEN) [2013-08-15 21:49:57] Xen stack trace from rsp=ffff83055d667e88: (XEN) [2013-08-15 21:49:57] ffff82d0801a3f02 aaaaaaaaaaaaaa00 0000000e127c3f26 ffff82d0802e8100 (XEN) [2013-08-15 21:49:57] ffff82d0802e8000 ffff83055d660000 0000000000000000 0000000000000000 (XEN) [2013-08-15 21:49:57] 00000040000000da ffff83055d660000 ffff83055d660000 00000000ffffffff (XEN) [2013-08-15 21:49:57] 0000000000000002 ffff83055d667f10 ffff82d08015ce92 ffff83009fafd000 (XEN) [2013-08-15 21:49:57] ffff83009fd16000 ffff83055d667dd8 0000000000000000 0000000000000000 (XEN) [2013-08-15 21:49:57] 0000000000000000 ffffffff81edb630 ffff880059bd7f10 ffff880059bd7fd8 (XEN) [2013-08-15 21:49:57] 0000000000000246 0000000000000000 0000000000000000 0000000000000001 (XEN) [2013-08-15 21:49:57] 0000000000000000 ffffffff810013aa ffff880059bd9070 00000000deadbeef (XEN) [2013-08-15 21:49:57] 00000000deadbeef 0000010000000000 ffffffff810013aa 000000000000e033 (XEN) [2013-08-15 21:49:57] 0000000000000246 ffff880059bd7ef8 000000000000e02b 0000000000000000 (XEN) [2013-08-15 21:49:57] 0000000000000000 0000000000000000 0000000000000000 0000000000000002 (XEN) [2013-08-15 21:49:57] ffff83009fafd000 00000034dd35ae00 0000000000000000 (XEN) [2013-08-15 21:49:57] Xen call trace: (XEN) [2013-08-15 21:49:57] [<ffff82d0801a1a1c>] hpet_broadcast_exit+0/0x171 (XEN) [2013-08-15 21:49:57] [<ffff82d08015ce92>] idle_loop+0x5b/0x6b (XEN) [2013-08-15 21:49:57] (XEN) [2013-08-15 21:49:57] *** Dumping CPU3 host state: *** (XEN) [2013-08-15 21:49:57] ----[ Xen-4.4-unstable x86_64 debug=y Not tainted ]---- (XEN) [2013-08-15 21:49:57] CPU: 3 (XEN) [2013-08-15 21:49:57] RIP: e008:[<ffff82d0801a1a1c>] hpet_broadcast_exit+0/0x171 (XEN) [2013-08-15 21:49:57] RFLAGS: 0000000000000246 CONTEXT: hypervisor (XEN) [2013-08-15 21:49:57] rax: 0000000000000000 rbx: ffff83055d65a070 rcx: 20c49ba5e353f7cf (XEN) [2013-08-15 21:49:57] rdx: ffff83055d65e020 rsi: 0000001116295d71 rdi: ffff83055d65a098 (XEN) [2013-08-15 21:49:57] rbp: ffff83055d657ef0 rsp: ffff83055d657e88 r8: 0000000ddd0c9d10 (XEN) [2013-08-15 21:49:57] r9: 0000000000000000 r10: 00000000deadbeef r11: 0000000000000246 (XEN) [2013-08-15 21:49:57] r12: ffff83055d65a0e0 r13: 0000000debb31eb2 r14: 0000001116295d71 (XEN) [2013-08-15 21:49:57] r15: ffff83055d65e080 cr0: 000000008005003b cr4: 00000000000006f0 (XEN) [2013-08-15 21:49:57] cr3: 000000054355b000 cr2: ffff880057cb8d88 (XEN) [2013-08-15 21:49:57] ds: 002b es: 002b fs: 0000 gs: 0000 ss: e010 cs: e008 (XEN) [2013-08-15 21:49:57] Xen stack trace from rsp=ffff83055d657e88: (XEN) [2013-08-15 21:49:57] ffff82d0801a3f02 ffff82d080225a00 0000000dec23ae62 ffff82d0802e8180 (XEN) [2013-08-15 21:49:57] ffff82d0802e8000 ffff83055d650000 0000000000000000 0000000000000000 (XEN) [2013-08-15 21:49:57] 0000044400000426 ffff83055d650000 ffff83055d650000 00000000ffffffff (XEN) [2013-08-15 21:49:57] 0000000000000002 ffff83055d657f10 ffff82d08015ce92 ffff83009fafc000 (XEN) [2013-08-15 21:49:57] ffff83009fd15000 ffff83055d657dd8 0000000000000000 0000000000000000 (XEN) [2013-08-15 21:49:57] 0000000000000000 ffffffff81edb630 ffff880059be9f10 ffff880059be9fd8 (XEN) [2013-08-15 21:49:57] 0000000000000246 0000000000000000 0000000000000000 0000000000000001 (XEN) [2013-08-15 21:49:57] 0000000000000000 ffffffff810013aa ffff880059bda0e0 00000000deadbeef (XEN) [2013-08-15 21:49:57] 00000000deadbeef 0000010000000000 ffffffff810013aa 000000000000e033 (XEN) [2013-08-15 21:49:57] 0000000000000246 ffff880059be9ef8 000000000000e02b 0000000000000000 (XEN) [2013-08-15 21:49:57] 0000000000000000 0000000000000000 0000000000000000 0000000000000003 (XEN) [2013-08-15 21:49:57] ffff83009fafc000 00000034dd34ce00 0000000000000000 (XEN) [2013-08-15 21:49:58] Xen call trace: (XEN) [2013-08-15 21:49:58] [<ffff82d0801a1a1c>] hpet_broadcast_exit+0/0x171 (XEN) [2013-08-15 21:49:58] [<ffff82d08015ce92>] idle_loop+0x5b/0x6b (XEN) [2013-08-15 21:49:58] (XEN) [2013-08-15 21:49:58] *** Dumping CPU4 host state: *** (XEN) [2013-08-15 21:49:58] ----[ Xen-4.4-unstable x86_64 debug=y Not tainted ]---- (XEN) [2013-08-15 21:49:58] CPU: 4 (XEN) [2013-08-15 21:49:58] RIP: e008:[<ffff82d0801a1a1c>] hpet_broadcast_exit+0/0x171 (XEN) [2013-08-15 21:49:58] RFLAGS: 0000000000000246 CONTEXT: hypervisor (XEN) [2013-08-15 21:49:58] rax: 0000000000000000 rbx: ffff83055d65a4f0 rcx: 20c49ba5e353f7cf (XEN) [2013-08-15 21:49:58] rdx: ffff83055d64f020 rsi: 000000113e879ffa rdi: ffff83055d65a518 (XEN) [2013-08-15 21:49:58] rbp: ffff83055d647ef0 rsp: ffff83055d647e88 r8: 0000000ddd0c9d10 (XEN) [2013-08-15 21:49:58] r9: 0000000000000000 r10: 00000000deadbeef r11: 0000000000000246 (XEN) [2013-08-15 21:49:58] r12: ffff83055d65a560 r13: 0000000dea7fc5fb r14: 000000113e879ffa (XEN) [2013-08-15 21:49:58] r15: ffff83055d64f080 cr0: 000000008005003b cr4: 00000000000006f0 (XEN) [2013-08-15 21:49:58] cr3: 000000009fc7b000 cr2: 0000000000408a6d (XEN) [2013-08-15 21:49:58] ds: 002b es: 002b fs: 0000 gs: 0000 ss: e010 cs: e008 (XEN) [2013-08-15 21:49:58] Xen stack trace from rsp=ffff83055d647e88: (XEN) [2013-08-15 21:49:58] ffff82d0801a3f02 ffff82d0802e8000 ffff83055d640000 ffffffffffffffff (XEN) [2013-08-15 21:49:58] ffff83055d64f080 ffff83055d647ee0 0000000000000000 0000000000000000 (XEN) [2013-08-15 21:49:58] 000004d10000014b ffff83055d640000 ffff83055d640000 00000000ffffffff (XEN) [2013-08-15 21:49:58] 0000000000000002 ffff83055d647f10 ffff82d08015ce92 ffff83009ff8b000 (XEN) [2013-08-15 21:49:58] ffff83009fd14000 ffff83055d647dd8 0000000000000000 0000000000000000 (XEN) [2013-08-15 21:49:58] 0000000000000000 ffffffff81edb630 ffff880059bebf10 ffff880059bebfd8 (XEN) [2013-08-15 21:49:58] 0000000000000246 0000000000000000 0000000000000000 0000000000000001 (XEN) [2013-08-15 21:49:58] 0000000000000000 ffffffff810013aa ffff880059bdb150 00000000deadbeef (XEN) [2013-08-15 21:49:58] 00000000deadbeef 0000010000000000 ffffffff810013aa 000000000000e033 (XEN) [2013-08-15 21:49:58] 0000000000000246 ffff880059bebef8 000000000000e02b 8010000537152067 (XEN) [2013-08-15 21:49:58] 8010000537151067 8010000537150067 801000053714f067 8010000500000004 (XEN) [2013-08-15 21:49:58] ffff83009ff8b000 00000034dd33de00 801000053714b067 (XEN) [2013-08-15 21:49:58] Xen call trace: (XEN) [2013-08-15 21:49:58] [<ffff82d0801a1a1c>] hpet_broadcast_exit+0/0x171 (XEN) [2013-08-15 21:49:58] [<ffff82d08015ce92>] idle_loop+0x5b/0x6b (XEN) [2013-08-15 21:49:58] (XEN) [2013-08-15 21:49:58] *** Dumping CPU5 host state: *** (XEN) [2013-08-15 21:49:58] ----[ Xen-4.4-unstable x86_64 debug=y Not tainted ]---- (XEN) [2013-08-15 21:49:58] CPU: 5 (XEN) [2013-08-15 21:49:58] RIP: e008:[<ffff82d0801a1a1c>] hpet_broadcast_exit+0/0x171 (XEN) [2013-08-15 21:49:58] RFLAGS: 0000000000000246 CONTEXT: hypervisor (XEN) [2013-08-15 21:49:58] rax: 0000000000000000 rbx: ffff83055d65a990 rcx: 20c49ba5e353f7cf (XEN) [2013-08-15 21:49:58] rdx: ffff83055d649020 rsi: 0000001166e5e459 rdi: ffff83055d65a9b8 (XEN) [2013-08-15 21:49:58] rbp: ffff83055d63fef0 rsp: ffff83055d63fe88 r8: 0000000ddd0c9d10 (XEN) [2013-08-15 21:49:58] r9: 0000000000000001 r10: 00000000deadbeef r11: 0000000000000246 (XEN) [2013-08-15 21:49:58] r12: ffff83055d65aa00 r13: 0000000debb43795 r14: 0000001166e5e459 (XEN) [2013-08-15 21:49:58] r15: ffff83055d649080 cr0: 000000008005003b cr4: 00000000000006f0 (XEN) [2013-08-15 21:49:58] cr3: 00000005446bd000 cr2: ffff8800562483a0 (XEN) [2013-08-15 21:49:59] ds: 002b es: 002b fs: 0000 gs: 0000 ss: e010 cs: e008 (XEN) [2013-08-15 21:49:59] Xen stack trace from rsp=ffff83055d63fe88: (XEN) [2013-08-15 21:49:59] ffff82d0801a3f02 aaaaaaaaaaaaaa00 0000000dfd9754dd ffff82d0802e8280 (XEN) [2013-08-15 21:49:59] ffff82d0802e8000 ffff83055d638000 0000000000000000 0000000000000000 (XEN) [2013-08-15 21:49:59] 000003fd0000041b ffff83055d638000 ffff83055d638000 00000000ffffffff (XEN) [2013-08-15 21:49:59] 0000000000000002 ffff83055d63ff10 ffff82d08015ce92 ffff83009ff8a000 (XEN) [2013-08-15 21:49:59] ffff83009fafb000 ffff83055d63fdd8 0000000000000000 0000000000000000 (XEN) [2013-08-15 21:49:59] 0000000000000000 ffffffff81edb630 ffff880059bedf10 ffff880059bedfd8 (XEN) [2013-08-15 21:49:59] 0000000000000246 0000000000000000 0000000000000000 0000000000000001 (XEN) [2013-08-15 21:49:59] 0000000000000000 ffffffff810013aa ffff880059bdc1c0 00000000deadbeef (XEN) [2013-08-15 21:49:59] 00000000deadbeef 0000010000000000 ffffffff810013aa 000000000000e033 (XEN) [2013-08-15 21:49:59] 0000000000000246 ffff880059bedef8 000000000000e02b 0000000000000000 (XEN) [2013-08-15 21:49:59] 0000000000000000 0000000000000000 0000000000000000 0000000000000005 (XEN) [2013-08-15 21:49:59] ffff83009ff8a000 00000034dd337e00 0000000000000000 (XEN) [2013-08-15 21:49:59] Xen call trace: (XEN) [2013-08-15 21:49:59] [<ffff82d0801a1a1c>] hpet_broadcast_exit+0/0x171 (XEN) [2013-08-15 21:49:59] [<ffff82d08015ce92>] idle_loop+0x5b/0x6b (XEN) [2013-08-15 21:49:59] Another thing is that it stalls just right before the actually reboot ... it prints it will restart, but stalls. This time i could hit the "d" debug key without it actually continuing, after hitting the "c" it continued and actually rebooted: (XEN) [2013-08-15 21:41:55] ''d'' pressed -> dumping registers (XEN) [2013-08-15 21:41:55] (XEN) [2013-08-15 21:41:55] *** Dumping CPU0 host state: *** (XEN) [2013-08-15 21:41:55] ----[ Xen-4.4-unstable x86_64 debug=y Not tainted ]---- (XEN) [2013-08-15 21:41:55] CPU: 0 (XEN) [2013-08-15 21:41:55] RIP: e008:[<ffff82d0801a1a1c>] hpet_broadcast_exit+0/0x171 (XEN) [2013-08-15 21:41:55] RFLAGS: 0000000000000246 CONTEXT: hypervisor (XEN) [2013-08-15 21:41:55] rax: 0000000000000000 rbx: ffff83055d73be60 rcx: 20c49ba5e353f7cf (XEN) [2013-08-15 21:41:55] rdx: ffff82d080311220 rsi: 0000005e99982290 rdi: ffff83055d73be88 (XEN) [2013-08-15 21:41:55] rbp: ffff82d0802cfef0 rsp: ffff82d0802cfe88 r8: 0000005e7a02f104 (XEN) [2013-08-15 21:41:55] r9: 0000000000000001 r10: 0000005eb59dde39 r11: 0000000000000246 (XEN) [2013-08-15 21:41:55] r12: ffff83055d73bed0 r13: 0000005e9743dd3d r14: 0000005e99982290 (XEN) [2013-08-15 21:41:55] r15: ffff82d080311280 cr0: 000000008005003b cr4: 00000000000006f0 (XEN) [2013-08-15 21:41:55] cr3: 0000000545ff5000 cr2: ffff880056bdb120 (XEN) [2013-08-15 21:41:55] ds: 0000 es: 0000 fs: 0000 gs: 0000 ss: e010 cs: e008 (XEN) [2013-08-15 21:41:55] Xen stack trace from rsp=ffff82d0802cfe88: (XEN) [2013-08-15 21:41:55] ffff82d0801a3f02 ffff82d080225a00 ffff82d0802c8000 ffff82d0802e8000 (XEN) [2013-08-15 21:41:55] ffff82d0802e8000 ffff82d0802c8000 0000000000000000 0000000000000000 (XEN) [2013-08-15 21:41:55] 0000037c00003f40 ffff82d0802c8000 ffff82d0802c8000 00000000ffffffff (XEN) [2013-08-15 21:41:55] 0000000000000002 ffff82d0802cff10 ffff82d08015ce92 ffff83009fd13000 (XEN) [2013-08-15 21:41:55] ffff83009ff88000 ffff82d0802cfdd8 0000000000000000 ffff88005fcf3040 (XEN) [2013-08-15 21:41:55] ffffffff81f970c0 ffffffff81edb630 ffffffff81e01e88 ffffffff81e01fd8 (XEN) [2013-08-15 21:41:55] 0000000000000246 0000000000000000 0000000000000000 0000000000000001 (XEN) [2013-08-15 21:41:55] 0000000000000000 ffffffff810013aa ffffffff81e13440 00000000deadbeef (XEN) [2013-08-15 21:41:55] 00000000deadbeef 0000010000000000 ffffffff810013aa 000000000000e033 (XEN) [2013-08-15 21:41:55] 0000000000000246 ffffffff81e01e70 000000000000e02b 0000000000000000 (XEN) [2013-08-15 21:41:55] 0000000000000000 0000000000000000 0000000000000000 0000000000000000 (XEN) [2013-08-15 21:41:55] ffff83009fd13000 0000000000000000 0000000000000000 (XEN) [2013-08-15 21:41:55] Xen call trace: (XEN) [2013-08-15 21:41:55] [<ffff82d0801a1a1c>] hpet_broadcast_exit+0/0x171 (XEN) [2013-08-15 21:41:55] [<ffff82d08015ce92>] idle_loop+0x5b/0x6b (XEN) [2013-08-15 21:41:55] (XEN) [2013-08-15 21:41:56] *** Dumping CPU1 host state: *** (XEN) [2013-08-15 21:41:56] ----[ Xen-4.4-unstable x86_64 debug=y Not tainted ]---- (XEN) [2013-08-15 21:41:56] CPU: 1 (XEN) [2013-08-15 21:41:56] RIP: e008:[<ffff82d0801a1a1c>] hpet_broadcast_exit+0/0x171 (XEN) [2013-08-15 21:41:56] RFLAGS: 0000000000000246 CONTEXT: hypervisor (XEN) [2013-08-15 21:41:56] rax: 0000000000000000 rbx: ffff83055d73a700 rcx: 20c49ba5e353f7cf (XEN) [2013-08-15 21:41:56] rdx: ffff83055d6db020 rsi: 0000005ec35c1c8f rdi: ffff83055d73a728 (XEN) [2013-08-15 21:41:56] rbp: ffff83055d6d7ef0 rsp: ffff83055d6d7e88 r8: 0000005e7a02f104 (XEN) [2013-08-15 21:41:56] r9: 000000000000003b r10: 00000000deadbeef r11: 0000000000000246 (XEN) [2013-08-15 21:41:56] r12: ffff83055d73a770 r13: 0000005ea7f993ab r14: 0000005ec35c1c8f (XEN) [2013-08-15 21:41:56] r15: ffff83055d6db080 cr0: 000000008005003b cr4: 00000000000006f0 (XEN) [2013-08-15 21:41:56] cr3: 000000009fc7b000 cr2: 00007f4b4513fde0 (XEN) [2013-08-15 21:41:56] ds: 002b es: 002b fs: 0000 gs: 0000 ss: e010 cs: e008 (XEN) [2013-08-15 21:41:56] Xen stack trace from rsp=ffff83055d6d7e88: (XEN) [2013-08-15 21:41:56] ffff82d0801a3f02 ffff82d0802e8000 ffff83055d6d0000 ffffffffffffffff (XEN) [2013-08-15 21:41:56] ffff83055d6db080 ffff83055d6d7ee0 0000000000000000 0000000000000000 (XEN) [2013-08-15 21:41:56] 0000136f00016642 ffff83055d6d0000 ffff83055d6d0000 00000000ffffffff (XEN) [2013-08-15 21:41:56] 0000000000000002 ffff83055d6d7f10 ffff82d08015ce92 ffff83009fafe000 (XEN) [2013-08-15 21:41:56] ffff83009fd17000 ffff83055d6d7dd8 0000000000000000 0000000000000000 (XEN) [2013-08-15 21:41:56] 0000000000000000 ffffffff81edb630 ffff880059bd5f10 ffff880059bd5fd8 (XEN) [2013-08-15 21:41:56] 0000000000000246 0000000000000000 0000000000000000 0000000000000001 (XEN) [2013-08-15 21:41:56] 0000000000000000 ffffffff810013aa ffff880059bd8000 00000000deadbeef (XEN) [2013-08-15 21:41:56] 00000000deadbeef 0000010000000000 ffffffff810013aa 000000000000e033 (XEN) [2013-08-15 21:41:56] 0000000000000246 ffff880059bd5ef8 000000000000e02b 64657a696c616974 (XEN) [2013-08-15 21:41:56] 312020205b0a0d0d 3332373831342e35 6f7465756c42205d 4943482000000001 (XEN) [2013-08-15 21:41:56] ffff83009fafe000 00000034dd3c9e00 7270202935482820 (XEN) [2013-08-15 21:41:56] Xen call trace: (XEN) [2013-08-15 21:41:56] [<ffff82d0801a1a1c>] hpet_broadcast_exit+0/0x171 (XEN) [2013-08-15 21:41:56] [<ffff82d08015ce92>] idle_loop+0x5b/0x6b (XEN) [2013-08-15 21:41:56] (XEN) [2013-08-15 21:41:56] *** Dumping CPU2 host state: *** (XEN) [2013-08-15 21:41:56] ----[ Xen-4.4-unstable x86_64 debug=y Not tainted ]---- (XEN) [2013-08-15 21:41:56] CPU: 2 (XEN) [2013-08-15 21:41:56] RIP: e008:[<ffff82d0801a1a1c>] hpet_broadcast_exit+0/0x171 (XEN) [2013-08-15 21:41:56] RFLAGS: 0000000000000246 CONTEXT: hypervisor (XEN) [2013-08-15 21:41:56] rax: 0000000000000000 rbx: ffff83055d73aba0 rcx: 20c49ba5e353f7cf (XEN) [2013-08-15 21:41:56] rdx: ffff83055d66c020 rsi: 0000005eebba4dfe rdi: ffff83055d73abc8 (XEN) [2013-08-15 21:41:56] rbp: ffff83055d667ef0 rsp: ffff83055d667e88 r8: 0000005e7a02f104 (XEN) [2013-08-15 21:41:56] r9: 0000000000000000 r10: 00000000deadbeef r11: 0000000000000246 (XEN) [2013-08-15 21:41:56] r12: ffff83055d73ac10 r13: 0000005e940e326b r14: 0000005eebba4dfe (XEN) [2013-08-15 21:41:56] r15: ffff83055d66c080 cr0: 000000008005003b cr4: 00000000000006f0 (XEN) [2013-08-15 21:41:56] cr3: 0000000544001000 cr2: ffff880056bdb120 (XEN) [2013-08-15 21:41:56] ds: 002b es: 002b fs: 0000 gs: 0000 ss: e010 cs: e008 (XEN) [2013-08-15 21:41:56] Xen stack trace from rsp=ffff83055d667e88: (XEN) [2013-08-15 21:41:56] ffff82d0801a3f02 ffff82d0802e8000 ffff83055d660000 ffffffffffffffff (XEN) [2013-08-15 21:41:57] ffff83055d66c080 ffff83055d667ee0 0000000000000000 0000000000000000 (XEN) [2013-08-15 21:41:57] 000023d600016cb8 ffff83055d660000 ffff83055d660000 00000000ffffffff (XEN) [2013-08-15 21:41:57] 0000000000000002 ffff83055d667f10 ffff82d08015ce92 ffff83009fafd000 (XEN) [2013-08-15 21:41:57] ffff83009fd17000 ffff83055d667dd8 0000000000000000 0000000000000000 (XEN) [2013-08-15 21:41:57] 0000000000000000 ffffffff81edb630 ffff880059bd5f10 ffff880059bd5fd8 (XEN) [2013-08-15 21:41:57] 0000000000000246 0000000000000000 0000000000000000 0000000000000001 (XEN) [2013-08-15 21:41:57] 0000000000000000 ffffffff810013aa ffff880059bd8000 00000000deadbeef (XEN) [2013-08-15 21:41:57] 00000000deadbeef 0000010000000000 ffffffff810013aa 000000000000e033 (XEN) [2013-08-15 21:41:57] 0000000000000246 ffff880059bd5ef8 000000000000e02b 0000000000000000 (XEN) [2013-08-15 21:41:57] 0000000000000000 0000000000000000 0000000000000000 0000000000000002 (XEN) [2013-08-15 21:41:57] ffff83009fafd000 00000034dd35ae00 0000000000000000 (XEN) [2013-08-15 21:41:57] Xen call trace: (XEN) [2013-08-15 21:41:57] [<ffff82d0801a1a1c>] hpet_broadcast_exit+0/0x171 (XEN) [2013-08-15 21:41:57] [<ffff82d08015ce92>] idle_loop+0x5b/0x6b (XEN) [2013-08-15 21:41:57] (XEN) [2013-08-15 21:41:57] *** Dumping CPU3 host state: *** (XEN) [2013-08-15 21:41:57] ----[ Xen-4.4-unstable x86_64 debug=y Not tainted ]---- (XEN) [2013-08-15 21:41:57] CPU: 3 (XEN) [2013-08-15 21:41:57] RIP: e008:[<ffff82d0801a1a1c>] hpet_broadcast_exit+0/0x171 (XEN) [2013-08-15 21:41:57] RFLAGS: 0000000000000246 CONTEXT: hypervisor (XEN) [2013-08-15 21:41:57] rax: 0000000000000000 rbx: ffff83055d65a070 rcx: 20c49ba5e353f7cf (XEN) [2013-08-15 21:41:57] rdx: ffff83055d65e020 rsi: 0000005f14187b50 rdi: ffff83055d65a098 (XEN) [2013-08-15 21:41:57] rbp: ffff83055d657ef0 rsp: ffff83055d657e88 r8: 0000005e7a02f104 (XEN) [2013-08-15 21:41:57] r9: 0000000000000000 r10: 00000000deadbeef r11: 0000000000000246 (XEN) [2013-08-15 21:41:57] r12: ffff83055d65a0e0 r13: 0000005e9658a00b r14: 0000005f14187b50 (XEN) [2013-08-15 21:41:57] r15: ffff83055d65e080 cr0: 000000008005003b cr4: 00000000000006f0 (XEN) [2013-08-15 21:41:57] cr3: 0000000543ad2000 cr2: ffff880057da4788 (XEN) [2013-08-15 21:41:57] ds: 002b es: 002b fs: 0000 gs: 0000 ss: e010 cs: e008 (XEN) [2013-08-15 21:41:57] Xen stack trace from rsp=ffff83055d657e88: (XEN) [2013-08-15 21:41:57] ffff82d0801a3f02 ffff82d0802e8000 ffff83055d650000 ffffffffffffffff (XEN) [2013-08-15 21:41:57] ffff83055d65e080 ffff83055d657ee0 0000000000000000 0000000000000000 (XEN) [2013-08-15 21:41:57] 000002e60000c0d8 ffff83055d650000 ffff83055d650000 00000000ffffffff (XEN) [2013-08-15 21:41:57] 0000000000000002 ffff83055d657f10 ffff82d08015ce92 ffff83009fafc000 (XEN) [2013-08-15 21:41:57] ffff83009fafb000 ffff83055d657dd8 0000000000000000 0000000000000000 (XEN) [2013-08-15 21:41:57] 0000000000000000 ffffffff81edb630 ffff880059bedf10 ffff880059bedfd8 (XEN) [2013-08-15 21:41:57] 0000000000000246 0000000000000000 0000000000000000 0000000000000001 (XEN) [2013-08-15 21:41:57] 0000000000000000 ffffffff810013aa ffff880059bdc1c0 00000000deadbeef (XEN) [2013-08-15 21:41:57] 00000000deadbeef 0000010000000000 ffffffff810013aa 000000000000e033 (XEN) [2013-08-15 21:41:57] 0000000000000246 ffff880059bedef8 000000000000e02b 0000000000000000 (XEN) [2013-08-15 21:41:57] 0000000000000000 0000000000000000 0000000000000000 0000000000000003 (XEN) [2013-08-15 21:41:57] ffff83009fafc000 00000034dd34ce00 0000000000000000 (XEN) [2013-08-15 21:41:57] Xen call trace: (XEN) [2013-08-15 21:41:57] [<ffff82d0801a1a1c>] hpet_broadcast_exit+0/0x171 (XEN) [2013-08-15 21:41:58] [<ffff82d08015ce92>] idle_loop+0x5b/0x6b (XEN) [2013-08-15 21:41:58] (XEN) [2013-08-15 21:41:58] *** Dumping CPU4 host state: *** (XEN) [2013-08-15 21:41:58] ----[ Xen-4.4-unstable x86_64 debug=y Not tainted ]---- (XEN) [2013-08-15 21:41:58] CPU: 4 (XEN) [2013-08-15 21:41:58] RIP: e008:[<ffff82d0801a1a1c>] hpet_broadcast_exit+0/0x171 (XEN) [2013-08-15 21:41:58] RFLAGS: 0000000000000246 CONTEXT: hypervisor (XEN) [2013-08-15 21:41:58] rax: 0000000000000000 rbx: ffff83055d65a4f0 rcx: 20c49ba5e353f7cf (XEN) [2013-08-15 21:41:58] rdx: ffff83055d64f020 rsi: 0000005f3c76af75 rdi: ffff83055d65a518 (XEN) [2013-08-15 21:41:58] rbp: ffff83055d647ef0 rsp: ffff83055d647e88 r8: 0000005e7a02f104 (XEN) [2013-08-15 21:41:58] r9: 0000000000000001 r10: 00000000deadbeef r11: 0000000000000246 (XEN) [2013-08-15 21:41:58] r12: ffff83055d65a560 r13: 0000005f1420fc47 r14: 0000005f3c76af75 (XEN) [2013-08-15 21:41:58] r15: ffff83055d64f080 cr0: 000000008005003b cr4: 00000000000006f0 (XEN) [2013-08-15 21:41:58] cr3: 0000000545bff000 cr2: 00007f6e0ce6ef30 (XEN) [2013-08-15 21:41:58] ds: 002b es: 002b fs: 0000 gs: 0000 ss: e010 cs: e008 (XEN) [2013-08-15 21:41:58] Xen stack trace from rsp=ffff83055d647e88: (XEN) [2013-08-15 21:41:58] ffff82d0801a3f02 ffff82d080225a00 0000005f1cdd66da ffff82d0802e8200 (XEN) [2013-08-15 21:41:58] ffff82d0802e8000 ffff83055d640000 0000000000000000 0000000000000000 (XEN) [2013-08-15 21:41:58] 000001c700010b97 ffff83055d640000 ffff83055d640000 00000000ffffffff (XEN) [2013-08-15 21:41:58] 0000000000000002 ffff83055d647f10 ffff82d08015ce92 ffff83009ff8b000 (XEN) [2013-08-15 21:41:58] ffff83009fd16000 ffff83055d647dd8 0000000000000000 0000000000000000 (XEN) [2013-08-15 21:41:58] 0000000000000000 ffffffff81edb630 ffff880059bd7f10 ffff880059bd7fd8 (XEN) [2013-08-15 21:41:58] 0000000000000246 0000000000000000 0000000000000000 0000000000000001 (XEN) [2013-08-15 21:41:58] 0000000000000000 ffffffff810013aa ffff880059bd9070 00000000deadbeef (XEN) [2013-08-15 21:41:58] 00000000deadbeef 0000010000000000 ffffffff810013aa 000000000000e033 (XEN) [2013-08-15 21:41:58] 0000000000000246 ffff880059bd7ef8 000000000000e02b 8010000537152067 (XEN) [2013-08-15 21:41:58] 8010000537151067 8010000537150067 801000053714f067 8010000500000004 (XEN) [2013-08-15 21:41:58] ffff83009ff8b000 00000034dd33de00 801000053714b067 (XEN) [2013-08-15 21:41:58] Xen call trace: (XEN) [2013-08-15 21:41:58] [<ffff82d0801a1a1c>] hpet_broadcast_exit+0/0x171 (XEN) [2013-08-15 21:41:58] [<ffff82d08015ce92>] idle_loop+0x5b/0x6b (XEN) [2013-08-15 21:41:58] (XEN) [2013-08-15 21:41:58] *** Dumping CPU5 host state: *** (XEN) [2013-08-15 21:41:58] ----[ Xen-4.4-unstable x86_64 debug=y Not tainted ]---- (XEN) [2013-08-15 21:41:58] CPU: 5 (XEN) [2013-08-15 21:41:58] RIP: e008:[<ffff82d0801a1a1c>] hpet_broadcast_exit+0/0x171 (XEN) [2013-08-15 21:41:58] RFLAGS: 0000000000000246 CONTEXT: hypervisor (XEN) [2013-08-15 21:41:58] rax: 0000000000000000 rbx: ffff83055d65a990 rcx: 20c49ba5e353f7cf (XEN) [2013-08-15 21:41:58] rdx: ffff83055d649020 rsi: 0000005f64d4deab rdi: ffff83055d65a9b8 (XEN) [2013-08-15 21:41:58] rbp: ffff83055d63fef0 rsp: ffff83055d63fe88 r8: 0000005e7a02f104 (XEN) [2013-08-15 21:41:58] r9: 0000000000000000 r10: 00000000deadbeef r11: 0000000000000246 (XEN) [2013-08-15 21:41:58] r12: ffff83055d65aa00 r13: 0000005f14413f36 r14: 0000005f64d4deab (XEN) [2013-08-15 21:41:58] r15: ffff83055d649080 cr0: 000000008005003b cr4: 00000000000006f0 (XEN) [2013-08-15 21:41:58] cr3: 0000000543b12000 cr2: ffffffffff600400 (XEN) [2013-08-15 21:41:58] ds: 002b es: 002b fs: 0000 gs: 0000 ss: e010 cs: e008 (XEN) [2013-08-15 21:41:59] Xen stack trace from rsp=ffff83055d63fe88: (XEN) [2013-08-15 21:41:59] ffff82d0801a3f02 aaaaaaaaaaaaaa00 0000005f1a36ceb7 ffff82d0802e8280 (XEN) [2013-08-15 21:41:59] ffff82d0802e8000 ffff83055d638000 0000000000000000 0000000000000000 (XEN) [2013-08-15 21:41:59] 000020cb000ddf9e ffff83055d638000 ffff83055d638000 00000000ffffffff (XEN) [2013-08-15 21:41:59] 0000000000000002 ffff83055d63ff10 ffff82d08015ce92 ffff83009ff8a000 (XEN) [2013-08-15 21:41:59] ffff83009fd15000 ffff83055d63fdd8 0000000000000000 0000000000000000 (XEN) [2013-08-15 21:41:59] 0000000000000000 ffffffff81edb630 ffff880059be9f10 ffff880059be9fd8 (XEN) [2013-08-15 21:41:59] 0000000000000246 0000000000000000 0000000000000000 0000000000000001 (XEN) [2013-08-15 21:41:59] 0000000000000000 ffffffff810013aa ffff880059bda0e0 00000000deadbeef (XEN) [2013-08-15 21:41:59] 00000000deadbeef 0000010000000000 ffffffff810013aa 000000000000e033 (XEN) [2013-08-15 21:41:59] 0000000000000246 ffff880059be9ef8 000000000000e02b 0000000000000000 (XEN) [2013-08-15 21:41:59] 0000000000000000 0000000000000000 0000000000000000 0000000000000005 (XEN) [2013-08-15 21:41:59] ffff83009ff8a000 00000034dd337e00 0000000000000000 (XEN) [2013-08-15 21:41:59] Xen call trace: (XEN) [2013-08-15 21:41:59] [<ffff82d0801a1a1c>] hpet_broadcast_exit+0/0x171 (XEN) [2013-08-15 21:41:59] [<ffff82d08015ce92>] idle_loop+0x5b/0x6b (XEN) [2013-08-15 21:41:59] (XEN) [2013-08-15 21:42:10] ''h'' pressed -> showing installed handlers (XEN) [2013-08-15 21:42:10] key ''%'' (ascii ''25'') => trap to xendbg (XEN) [2013-08-15 21:42:10] key ''*'' (ascii ''2a'') => print all diagnostics (XEN) [2013-08-15 21:42:10] key ''0'' (ascii ''30'') => dump Dom0 registers (XEN) [2013-08-15 21:42:10] key ''A'' (ascii ''41'') => toggle alternative key handling (XEN) [2013-08-15 21:42:10] key ''H'' (ascii ''48'') => dump heap info (XEN) [2013-08-15 21:42:10] key ''I'' (ascii ''49'') => dump HVM irq info (XEN) [2013-08-15 21:42:10] key ''M'' (ascii ''4d'') => dump MSI state (XEN) [2013-08-15 21:42:10] key ''N'' (ascii ''4e'') => trigger an NMI (XEN) [2013-08-15 21:42:10] key ''O'' (ascii ''4f'') => toggle shadow audits (XEN) [2013-08-15 21:42:10] key ''Q'' (ascii ''51'') => dump PCI devices (XEN) [2013-08-15 21:42:10] key ''R'' (ascii ''52'') => reboot machine (XEN) [2013-08-15 21:42:10] key ''S'' (ascii ''53'') => reset shadow pagetables (XEN) [2013-08-15 21:42:10] key ''V'' (ascii ''56'') => dump IOMMU intremap tables (XEN) [2013-08-15 21:42:10] key ''a'' (ascii ''61'') => dump timer queues (XEN) [2013-08-15 21:42:10] key ''c'' (ascii ''63'') => dump ACPI Cx structures (XEN) [2013-08-15 21:42:10] key ''d'' (ascii ''64'') => dump registers (XEN) [2013-08-15 21:42:10] key ''e'' (ascii ''65'') => dump evtchn info (XEN) [2013-08-15 21:42:10] key ''g'' (ascii ''67'') => print grant table usage (XEN) [2013-08-15 21:42:10] key ''h'' (ascii ''68'') => show this message (XEN) [2013-08-15 21:42:10] key ''i'' (ascii ''69'') => dump interrupt bindings (XEN) [2013-08-15 21:42:10] key ''m'' (ascii ''6d'') => memory info (XEN) [2013-08-15 21:42:10] key ''n'' (ascii ''6e'') => NMI statistics (XEN) [2013-08-15 21:42:10] key ''o'' (ascii ''6f'') => dump iommu p2m table (XEN) [2013-08-15 21:42:10] key ''q'' (ascii ''71'') => dump domain (and guest debug) info (XEN) [2013-08-15 21:42:10] key ''r'' (ascii ''72'') => dump run queues (XEN) [2013-08-15 21:42:10] key ''s'' (ascii ''73'') => dump softtsc stats (XEN) [2013-08-15 21:42:10] key ''t'' (ascii ''74'') => display multi-cpu clock info (XEN) [2013-08-15 21:42:10] key ''u'' (ascii ''75'') => dump numa info (XEN) [2013-08-15 21:42:10] key ''v'' (ascii ''76'') => dump AMD-V VMCBs (XEN) [2013-08-15 21:42:10] key ''w'' (ascii ''77'') => synchronously dump console ring buffer (dmesg) (XEN) [2013-08-15 21:42:10] key ''z'' (ascii ''7a'') => print ioapic info (XEN) [2013-08-15 21:47:32] ''d'' pressed -> dumping registers (XEN) [2013-08-15 21:47:32] (XEN) [2013-08-15 21:47:32] *** Dumping CPU0 host state: *** (XEN) [2013-08-15 21:47:32] ----[ Xen-4.4-unstable x86_64 debug=y Not tainted ]---- (XEN) [2013-08-15 21:47:32] CPU: 0 (XEN) [2013-08-15 21:47:32] RIP: e008:[<ffff82d0801a1a1c>] hpet_broadcast_exit+0/0x171 (XEN) [2013-08-15 21:47:32] RFLAGS: 0000000000000246 CONTEXT: hypervisor (XEN) [2013-08-15 21:47:32] rax: 0000000000000000 rbx: ffff83055d73be60 rcx: 20c49ba5e353f7cf (XEN) [2013-08-15 21:47:32] rdx: ffff82d080311220 rsi: 000000ad2d34925e rdi: ffff83055d73be88 (XEN) [2013-08-15 21:47:32] rbp: ffff82d0802cfef0 rsp: ffff82d0802cfe88 r8: 000000a646cd580f (XEN) [2013-08-15 21:47:32] r9: 0000000000000000 r10: 000000aec9d61960 r11: 0000000000000246 (XEN) [2013-08-15 21:47:33] r12: ffff83055d73bed0 r13: 000000a682032ac2 r14: 000000ad2d34925e (XEN) [2013-08-15 21:47:33] r15: ffff82d080311280 cr0: 000000008005003b cr4: 00000000000006f0 (XEN) [2013-08-15 21:47:33] cr3: 000000009fc7b000 cr2: ffff8800580d8b38 (XEN) [2013-08-15 21:47:33] ds: 0000 es: 0000 fs: 0000 gs: 0000 ss: e010 cs: e008 (XEN) [2013-08-15 21:47:33] Xen stack trace from rsp=ffff82d0802cfe88: (XEN) [2013-08-15 21:47:33] ffff82d0801a3f02 aaaaaaaaaaaaaa00 aaaaaaaaaaaaaaaa ffff82d0802e8000 (XEN) [2013-08-15 21:47:33] ffff82d0802e8000 ffff82d0802cfee0 0000000000000000 0000000000000000 (XEN) [2013-08-15 21:47:33] 000004d30000017d ffff82d0802c8000 ffff82d0802c8000 00000000ffffffff (XEN) [2013-08-15 21:47:33] 0000000000000002 ffff82d0802cff10 ffff82d08015ce92 ffff83009fd13000 (XEN) [2013-08-15 21:47:33] ffff83009ff88000 ffff82d0802cfdd8 0000000000000000 ffff88005fcf3040 (XEN) [2013-08-15 21:47:33] ffffffff81f970c0 ffffffff81edb630 ffffffff81e01e88 ffffffff81e01fd8 (XEN) [2013-08-15 21:47:33] 0000000000000246 0000000000000000 0000000000000000 0000000000000001 (XEN) [2013-08-15 21:47:33] 0000000000000000 ffffffff810013aa ffffffff81e13440 00000000deadbeef (XEN) [2013-08-15 21:47:33] 00000000deadbeef 0000010000000000 ffffffff810013aa 000000000000e033 (XEN) [2013-08-15 21:47:33] 0000000000000246 ffffffff81e01e70 000000000000e02b 0000000000000000 (XEN) [2013-08-15 21:47:33] 0000000000000000 0000000000000000 0000000000000000 0000000000000000 (XEN) [2013-08-15 21:47:33] ffff83009fd13000 0000000000000000 0000000000000000 (XEN) [2013-08-15 21:47:33] Xen call trace: (XEN) [2013-08-15 21:47:33] [<ffff82d0801a1a1c>] hpet_broadcast_exit+0/0x171 (XEN) [2013-08-15 21:47:33] [<ffff82d08015ce92>] idle_loop+0x5b/0x6b (XEN) [2013-08-15 21:47:33] (XEN) [2013-08-15 21:47:33] *** Dumping CPU1 host state: *** (XEN) [2013-08-15 21:47:33] ----[ Xen-4.4-unstable x86_64 debug=y Not tainted ]---- (XEN) [2013-08-15 21:47:33] CPU: 1 (XEN) [2013-08-15 21:47:33] RIP: e008:[<ffff82d0801a1a1c>] hpet_broadcast_exit+0/0x171 (XEN) [2013-08-15 21:47:33] RFLAGS: 0000000000000246 CONTEXT: hypervisor (XEN) [2013-08-15 21:47:33] rax: 0000000000000000 rbx: ffff83055d73a700 rcx: 20c49ba5e353f7cf (XEN) [2013-08-15 21:47:33] rdx: ffff83055d6db020 rsi: 000000ad56f89314 rdi: ffff83055d73a728 (XEN) [2013-08-15 21:47:33] rbp: ffff83055d6d7ef0 rsp: ffff83055d6d7e88 r8: 000000a646cd580f (XEN) [2013-08-15 21:47:33] r9: 000000000000003b r10: 00000000deadbeef r11: 0000000000000246 (XEN) [2013-08-15 21:47:33] r12: ffff83055d73a770 r13: 000000a682e14806 r14: 000000ad56f89314 (XEN) [2013-08-15 21:47:33] r15: ffff83055d6db080 cr0: 000000008005003b cr4: 00000000000006f0 (XEN) [2013-08-15 21:47:33] cr3: 000000009fc7b000 cr2: 00007f4b4513fde0 (XEN) [2013-08-15 21:47:33] ds: 002b es: 002b fs: 0000 gs: 0000 ss: e010 cs: e008 (XEN) [2013-08-15 21:47:33] Xen stack trace from rsp=ffff83055d6d7e88: (XEN) [2013-08-15 21:47:33] ffff82d0801a3f02 ffff82d0802e8000 ffff83055d6d0000 ffffffffffffffff (XEN) [2013-08-15 21:47:33] ffff83055d6db080 ffff83055d6d7ee0 0000000000000000 0000000000000000 (XEN) [2013-08-15 21:47:33] 000025cf000043bc ffff83055d6d0000 ffff83055d6d0000 00000000ffffffff (XEN) [2013-08-15 21:47:33] 0000000000000002 ffff83055d6d7f10 ffff82d08015ce92 ffff83009fafe000 (XEN) [2013-08-15 21:47:33] ffff83009fd17000 ffff83055d6d7dd8 0000000000000000 0000000000000000 (XEN) [2013-08-15 21:47:33] 0000000000000000 ffffffff81edb630 ffff880059bd5f10 ffff880059bd5fd8 (XEN) [2013-08-15 21:47:33] 0000000000000246 0000000000000000 0000000000000000 0000000000000001 (XEN) [2013-08-15 21:47:33] 0000000000000000 ffffffff810013aa ffff880059bd8000 00000000deadbeef (XEN) [2013-08-15 21:47:34] 00000000deadbeef 0000010000000000 ffffffff810013aa 000000000000e033 (XEN) [2013-08-15 21:47:34] 0000000000000246 ffff880059bd5ef8 000000000000e02b 64657a696c616974 (XEN) [2013-08-15 21:47:34] 312020205b0a0d0d 3332373831342e35 6f7465756c42205d 4943482000000001 (XEN) [2013-08-15 21:47:34] ffff83009fafe000 00000034dd3c9e00 7270202935482820 (XEN) [2013-08-15 21:47:34] Xen call trace: (XEN) [2013-08-15 21:47:34] [<ffff82d0801a1a1c>] hpet_broadcast_exit+0/0x171 (XEN) [2013-08-15 21:47:34] [<ffff82d08015ce92>] idle_loop+0x5b/0x6b (XEN) [2013-08-15 21:47:34] (XEN) [2013-08-15 21:47:34] *** Dumping CPU2 host state: *** (XEN) [2013-08-15 21:47:34] ----[ Xen-4.4-unstable x86_64 debug=y Not tainted ]---- (XEN) [2013-08-15 21:47:34] CPU: 2 (XEN) [2013-08-15 21:47:34] RIP: e008:[<ffff82d0801a1a1c>] hpet_broadcast_exit+0/0x171 (XEN) [2013-08-15 21:47:34] RFLAGS: 0000000000000246 CONTEXT: hypervisor (XEN) [2013-08-15 21:47:34] rax: 0000000000000000 rbx: ffff83055d73aba0 rcx: 20c49ba5e353f7cf (XEN) [2013-08-15 21:47:34] rdx: ffff83055d66c020 rsi: 000000ad7f56c1b5 rdi: ffff83055d73abc8 (XEN) [2013-08-15 21:47:34] rbp: ffff83055d667ef0 rsp: ffff83055d667e88 r8: 000000a646cd580f (XEN) [2013-08-15 21:47:34] r9: 0000000000000000 r10: 00000000deadbeef r11: 0000000000000246 (XEN) [2013-08-15 21:47:34] r12: ffff83055d73ac10 r13: 000000a681e8f202 r14: 000000ad7f56c1b5 (XEN) [2013-08-15 21:47:34] r15: ffff83055d66c080 cr0: 000000008005003b cr4: 00000000000006f0 (XEN) [2013-08-15 21:47:34] cr3: 000000009fc7b000 cr2: 000000000048c620 (XEN) [2013-08-15 21:47:34] ds: 002b es: 002b fs: 0000 gs: 0000 ss: e010 cs: e008 (XEN) [2013-08-15 21:47:34] Xen stack trace from rsp=ffff83055d667e88: (XEN) [2013-08-15 21:47:34] ffff82d0801a3f02 ffff82d080225a00 000000a682152727 ffff82d0802e8100 (XEN) [2013-08-15 21:47:34] ffff82d0802e8000 ffff83055d667ee0 0000000000000000 0000000000000000 (XEN) [2013-08-15 21:47:34] 00000b860000091b ffff83055d660000 ffff83055d660000 00000000ffffffff (XEN) [2013-08-15 21:47:34] 0000000000000002 ffff83055d667f10 ffff82d08015ce92 ffff83009fafd000 (XEN) [2013-08-15 21:47:34] ffff83009fd14000 ffff83055d667dd8 0000000000000000 0000000000000000 (XEN) [2013-08-15 21:47:34] 0000000000000000 ffffffff81edb630 ffff880059bebf10 ffff880059bebfd8 (XEN) [2013-08-15 21:47:34] 0000000000000246 0000000000000000 0000000000000000 0000000000000001 (XEN) [2013-08-15 21:47:34] 0000000000000000 ffffffff810013aa ffff880059bdb150 00000000deadbeef (XEN) [2013-08-15 21:47:34] 00000000deadbeef 0000010000000000 ffffffff810013aa 000000000000e033 (XEN) [2013-08-15 21:47:34] 0000000000000246 ffff880059bebef8 000000000000e02b 0000000000000000 (XEN) [2013-08-15 21:47:34] 0000000000000000 0000000000000000 0000000000000000 0000000000000002 (XEN) [2013-08-15 21:47:34] ffff83009fafd000 00000034dd35ae00 0000000000000000 (XEN) [2013-08-15 21:47:34] Xen call trace: (XEN) [2013-08-15 21:47:34] [<ffff82d0801a1a1c>] hpet_broadcast_exit+0/0x171 (XEN) [2013-08-15 21:47:34] [<ffff82d08015ce92>] idle_loop+0x5b/0x6b (XEN) [2013-08-15 21:47:34] (XEN) [2013-08-15 21:47:34] *** Dumping CPU3 host state: *** (XEN) [2013-08-15 21:47:34] ----[ Xen-4.4-unstable x86_64 debug=y Not tainted ]---- (XEN) [2013-08-15 21:47:34] CPU: 3 (XEN) [2013-08-15 21:47:34] RIP: e008:[<ffff82d0801a1a1c>] hpet_broadcast_exit+0/0x171 (XEN) [2013-08-15 21:47:34] RFLAGS: 0000000000000246 CONTEXT: hypervisor (XEN) [2013-08-15 21:47:34] rax: 0000000000000000 rbx: ffff83055d65a070 rcx: 20c49ba5e353f7cf (XEN) [2013-08-15 21:47:34] rdx: ffff83055d65e020 rsi: 000000ada7b4f668 rdi: ffff83055d65a098 (XEN) [2013-08-15 21:47:34] rbp: ffff83055d657ef0 rsp: ffff83055d657e88 r8: 000000a646cd580f (XEN) [2013-08-15 21:47:35] r9: 0000000000000000 r10: 00000000deadbeef r11: 0000000000000246 (XEN) [2013-08-15 21:47:35] r12: ffff83055d65a0e0 r13: 000000a6825fe0e5 r14: 000000ada7b4f668 (XEN) [2013-08-15 21:47:35] r15: ffff83055d65e080 cr0: 000000008005003b cr4: 00000000000006f0 (XEN) [2013-08-15 21:47:35] cr3: 0000000542ead000 cr2: 00007f2952bde970 (XEN) [2013-08-15 21:47:35] ds: 002b es: 002b fs: 0000 gs: 0000 ss: e010 cs: e008 (XEN) [2013-08-15 21:47:35] Xen stack trace from rsp=ffff83055d657e88: (XEN) [2013-08-15 21:47:35] ffff82d0801a3f02 aaaaaaaaaaaaaa00 000000a682adda82 ffff82d0802e8180 (XEN) [2013-08-15 21:47:35] ffff82d0802e8000 ffff83055d650000 0000000000000000 0000000000000000 (XEN) [2013-08-15 21:47:35] 0000142b0000171c ffff83055d650000 ffff83055d650000 00000000ffffffff (XEN) [2013-08-15 21:47:35] 0000000000000002 ffff83055d657f10 ffff82d08015ce92 ffff83009fafc000 (XEN) [2013-08-15 21:47:35] ffff83009fd16000 ffff83055d657dd8 0000000000000000 0000000000000000 (XEN) [2013-08-15 21:47:35] 0000000000000000 ffffffff81edb630 ffff880059bd7f10 ffff880059bd7fd8 (XEN) [2013-08-15 21:47:35] 0000000000000246 0000000000000000 0000000000000000 0000000000000001 (XEN) [2013-08-15 21:47:35] 0000000000000000 ffffffff810013aa ffff880059bd9070 00000000deadbeef (XEN) [2013-08-15 21:47:35] 00000000deadbeef 0000010000000000 ffffffff810013aa 000000000000e033 (XEN) [2013-08-15 21:47:35] 0000000000000246 ffff880059bd7ef8 000000000000e02b 0000000000000000 (XEN) [2013-08-15 21:47:35] 0000000000000000 0000000000000000 0000000000000000 0000000000000003 (XEN) [2013-08-15 21:47:35] ffff83009fafc000 00000034dd34ce00 0000000000000000 (XEN) [2013-08-15 21:47:35] Xen call trace: (XEN) [2013-08-15 21:47:35] [<ffff82d0801a1a1c>] hpet_broadcast_exit+0/0x171 (XEN) [2013-08-15 21:47:35] [<ffff82d08015ce92>] idle_loop+0x5b/0x6b (XEN) [2013-08-15 21:47:35] (XEN) [2013-08-15 21:47:35] *** Dumping CPU4 host state: *** (XEN) [2013-08-15 21:47:35] ----[ Xen-4.4-unstable x86_64 debug=y Not tainted ]---- (XEN) [2013-08-15 21:47:35] CPU: 4 (XEN) [2013-08-15 21:47:35] RIP: e008:[<ffff82d0801a1a1c>] hpet_broadcast_exit+0/0x171 (XEN) [2013-08-15 21:47:35] RFLAGS: 0000000000000246 CONTEXT: hypervisor (XEN) [2013-08-15 21:47:35] rax: 0000000000000000 rbx: ffff83055d65a4f0 rcx: 20c49ba5e353f7cf (XEN) [2013-08-15 21:47:35] rdx: ffff83055d64f020 rsi: 000000add0132956 rdi: ffff83055d65a518 (XEN) [2013-08-15 21:47:35] rbp: ffff83055d647ef0 rsp: ffff83055d647e88 r8: 000000a646cd580f (XEN) [2013-08-15 21:47:35] r9: 0000000000000002 r10: 00000000deadbeef r11: 0000000000000246 (XEN) [2013-08-15 21:47:35] r12: ffff83055d65a560 r13: 000000ada7e905e7 r14: 000000add0132956 (XEN) [2013-08-15 21:47:35] r15: ffff83055d64f080 cr0: 000000008005003b cr4: 00000000000006f0 (XEN) [2013-08-15 21:47:35] cr3: 0000000549e0c000 cr2: 00007f2e6ddf9e02 (XEN) [2013-08-15 21:47:35] ds: 002b es: 002b fs: 0000 gs: 0000 ss: e010 cs: e008 (XEN) [2013-08-15 21:47:35] Xen stack trace from rsp=ffff83055d647e88: (XEN) [2013-08-15 21:47:35] ffff82d0801a3f02 ffff82d080225a00 000000ae54f2e7e7 ffff82d0802e8200 (XEN) [2013-08-15 21:47:35] ffff82d0802e8000 ffff83055d640000 0000000000000000 0000000000000000 (XEN) [2013-08-15 21:47:35] 00000e3d00017bde ffff83055d640000 ffff83055d640000 00000000ffffffff (XEN) [2013-08-15 21:47:35] 0000000000000002 ffff83055d647f10 ffff82d08015ce92 ffff83009ff8b000 (XEN) [2013-08-15 21:47:35] ffff83009fafb000 ffff83055d647dd8 0000000000000000 0000000000000000 (XEN) [2013-08-15 21:47:35] 0000000000000000 ffffffff81edb630 ffff880059bedf10 ffff880059bedfd8 (XEN) [2013-08-15 21:47:35] 0000000000000246 0000000000000000 0000000000000000 0000000000000001 (XEN) [2013-08-15 21:47:36] 0000000000000000 ffffffff810013aa ffff880059bdc1c0 00000000deadbeef (XEN) [2013-08-15 21:47:36] 00000000deadbeef 0000010000000000 ffffffff810013aa 000000000000e033 (XEN) [2013-08-15 21:47:36] 0000000000000246 ffff880059bedef8 000000000000e02b 8010000537152067 (XEN) [2013-08-15 21:47:36] 8010000537151067 8010000537150067 801000053714f067 8010000500000004 (XEN) [2013-08-15 21:47:36] ffff83009ff8b000 00000034dd33de00 801000053714b067 (XEN) [2013-08-15 21:47:36] Xen call trace: (XEN) [2013-08-15 21:47:36] [<ffff82d0801a1a1c>] hpet_broadcast_exit+0/0x171 (XEN) [2013-08-15 21:47:36] [<ffff82d08015ce92>] idle_loop+0x5b/0x6b (XEN) [2013-08-15 21:47:36] (XEN) [2013-08-15 21:47:36] *** Dumping CPU5 host state: *** (XEN) [2013-08-15 21:47:36] ----[ Xen-4.4-unstable x86_64 debug=y Not tainted ]---- (XEN) [2013-08-15 21:47:36] CPU: 5 (XEN) [2013-08-15 21:47:36] RIP: e008:[<ffff82d080100223>] __bitmap_empty+0x73/0x83 (XEN) [2013-08-15 21:47:36] RFLAGS: 0000000000000202 CONTEXT: hypervisor (XEN) [2013-08-15 21:47:36] rax: 0000000000000000 rbx: ffff82d0802fbd00 rcx: 0000000000000006 (XEN) [2013-08-15 21:47:36] rdx: 0000000000000000 rsi: 0000000000000006 rdi: ffff82d0802fbd00 (XEN) [2013-08-15 21:47:36] rbp: ffff83055d63fc48 rsp: ffff83055d63fc48 r8: 0000000000000004 (XEN) [2013-08-15 21:47:36] r9: 000000000000003a r10: 0080000000000001 r11: 0000000000000282 (XEN) [2013-08-15 21:47:36] r12: 0000000000000100 r13: 0000000000000000 r14: 7400000000000001 (XEN) [2013-08-15 21:47:36] r15: 7400000000000000 cr0: 000000008005003b cr4: 00000000000006f0 (XEN) [2013-08-15 21:47:36] cr3: 0000000542ead000 cr2: 00000000018a4008 (XEN) [2013-08-15 21:47:36] ds: 0000 es: 0000 fs: 0000 gs: 0000 ss: e010 cs: e008 (XEN) [2013-08-15 21:47:36] Xen stack trace from rsp=ffff83055d63fc48: (XEN) [2013-08-15 21:47:36] ffff83055d63fc78 ffff82d080182e69 ffff83055d63fcb8 0000000000000006 (XEN) [2013-08-15 21:47:36] 1000000000000000 ffff82e00a858340 ffff83055d63fd48 ffff82d080178210 (XEN) [2013-08-15 21:47:36] 0000000000000000 0000000000542ead ffff83055d63fcf8 ffff82d080311634 (XEN) [2013-08-15 21:47:36] ffff83055d63fd38 ffff82d0801764f3 0000000000541d22 ffff83055d638000 (XEN) [2013-08-15 21:47:36] ffff83055d63fd28 ffff82d080311634 0000000000542c1a ffff830000000000 (XEN) [2013-08-15 21:47:36] 0000000000542c1a ffff83055d638000 000000000000003c 0000000000000000 (XEN) [2013-08-15 21:47:36] 0000000000000000 0000000000000000 1000000000000000 0000000000000000 (XEN) [2013-08-15 21:47:36] 0000000000000000 ffff82e00a858340 1000000000000000 0000000000542c1a (XEN) [2013-08-15 21:47:36] ffff83055d63fd58 ffff82d0801792c9 ffff83055d63fd88 ffff82d080179902 (XEN) [2013-08-15 21:47:36] 0000000000000000 0000000000000067 ffff83055d632000 0000000000541d35 (XEN) [2013-08-15 21:47:36] ffff83055d63fdc8 ffff82d08017a669 8010000542c1a067 0000000000000000 (XEN) [2013-08-15 21:47:36] 0000000000541d35 0000000542c1a067 ffff88005f6cb930 0000000000000000 (XEN) [2013-08-15 21:47:36] ffff83055d63fef8 ffff82d08017b341 0000000000000087 000000000055d7f0 (XEN) [2013-08-15 21:47:36] 0000000000000000 ffff83055d632000 8000000500000000 ffff82004005d9b8 (XEN) [2013-08-15 21:47:36] 0000000000000000 0000000000541d35 ffff82004005e000 0000000300007ff0 (XEN) [2013-08-15 21:47:36] 0000000000541d35 ffff83055d632000 ffff83009fd15000 ffff830500000000 (XEN) [2013-08-15 21:47:36] ffff83055d632000 ffff82e00a83a6a0 0000000700000000 ffff83055d638000 (XEN) [2013-08-15 21:47:36] ffff83009fd15000 ffff82004005e060 ffff83055d632000 ffff83055d632000 (XEN) [2013-08-15 21:47:36] ffff83055d638000 0000000700000001 0000000000000000 0000000000000000 (XEN) [2013-08-15 21:47:37] ffff83055d63ff18 000000000055d7f0 0000000541d35060 0000000542c1a067 (XEN) [2013-08-15 21:47:37] Xen call trace: (XEN) [2013-08-15 21:47:37] [<ffff82d080100223>] __bitmap_empty+0x73/0x83 (XEN) [2013-08-15 21:47:37] [<ffff82d080182e69>] flush_area_mask+0x13f/0x15a (XEN) [2013-08-15 21:47:37] [<ffff82d080178210>] __get_page_type+0x2dd/0x134e (XEN) [2013-08-15 21:47:37] [<ffff82d0801792c9>] get_page_type+0xe/0x40 (XEN) [2013-08-15 21:47:37] [<ffff82d080179902>] get_page_and_type_from_pagenr+0x85/0xe3 (XEN) [2013-08-15 21:47:37] [<ffff82d08017a669>] get_page_from_l2e+0xc0/0x239 (XEN) [2013-08-15 21:47:37] [<ffff82d08017b341>] do_mmu_update+0xb5f/0x18eb (XEN) [2013-08-15 21:47:37] [<ffff82d08022b0cb>] syscall_enter+0xeb/0x145 (XEN) [2013-08-15 21:47:37] (XEN) [2013-08-15 21:47:37] *** Dumping CPU5 guest state (d0:v3): *** (XEN) [2013-08-15 21:47:37] ----[ Xen-4.4-unstable x86_64 debug=y Not tainted ]---- (XEN) [2013-08-15 21:47:37] CPU: 5 (XEN) [2013-08-15 21:47:37] RIP: e033:[<ffffffff8100102a>] (XEN) [2013-08-15 21:47:37] RFLAGS: 0000000000000282 EM: 1 CONTEXT: pv guest (XEN) [2013-08-15 21:47:37] rax: 0000000000000001 rbx: 0000000542c1a067 rcx: ffffffff8100102a (XEN) [2013-08-15 21:47:37] rdx: 0000000000000000 rsi: 0000000000000001 rdi: ffff88005f6cb930 (XEN) [2013-08-15 21:47:37] rbp: ffff8800573b1d38 rsp: ffff8800573b1d00 r8: aaaaaaaaaaaaaaaa (XEN) [2013-08-15 21:47:37] r9: 0000000000000000 r10: 0000000000007ff0 r11: 0000000000000282 (XEN) [2013-08-15 21:47:37] cr0: 000000008005003b cr4: 00000000000006f0 (XEN) [2013-08-15 21:47:37] cr3: 0000000542ead000 cr2: 00000000018a4008 (XEN) [2013-08-15 21:47:37] ds: 0000 es: 0000 fs: 0000 gs: 0000 ss: e02b cs: e033 (XEN) [2013-08-15 21:47:37] Guest stack trace from rsp=ffff8800573b1d00: (XEN) [2013-08-15 21:47:37] 0000000000000000 0000000000000002 ffffffff8100490c 0000000542c1a067 (XEN) [2013-08-15 21:47:37] ffff880054c1c060 ffff8800573b02d8 ffff880058b8c380 ffff8800573b1d78 (XEN) [2013-08-15 21:47:37] ffffffff81006d45 0000000541d35060 0000000542c1a067 0000000000000000 (XEN) [2013-08-15 21:47:37] 0000000000055d37 ffff880054c1c060 ffff880058b8c3e8 ffff8800573b1d88 (XEN) [2013-08-15 21:47:37] ffffffff81006dd9 ffff8800573b1dc8 ffffffff8112f302 ffff880054c1c060 (XEN) [2013-08-15 21:47:37] 00000000018a4008 0000000000000000 ffff880056ab85c0 00003ffffffff000 (XEN) [2013-08-15 21:47:37] ffff880058b8c380 ffff8800573b1e28 ffffffff811337ba ffff880054c1c060 (XEN) [2013-08-15 21:47:37] 0000002900000001 ffff880000000060 ffff880000000000 ffff8800573b1e28 (XEN) [2013-08-15 21:47:37] 0000000000000029 0000000000000006 ffff880058b8c380 ffff8800573b1f58 (XEN) [2013-08-15 21:47:37] 00000000018a4008 ffff8800573b1f38 ffffffff8103d81a ffff8800570b7250 (XEN) [2013-08-15 21:47:37] ffff880058b8c380 ffff88005122e2a0 ffff880058b8c420 ffff8800573b1e98 (XEN) [2013-08-15 21:47:37] ffffffff81153fcd ffff8800570b7248 ffff8800570b7250 00000000018a4000 (XEN) [2013-08-15 21:47:37] ffff8800570b7248 00000000018cd000 ffff880058b8c380 ffff8800573b1f28 (XEN) [2013-08-15 21:47:37] ffffffff811386a0 ffff88005122e2a0 00000000018a0200 ffff880058b8c470 (XEN) [2013-08-15 21:47:37] 0000000000000001 ffff8800573b1f08 ffffffff810cbb4f 0000000000000029 (XEN) [2013-08-15 21:47:37] ffff88005122e2a0 ffffffff810c62df 00007f2952eb8e60 ffffffff813e448d (XEN) [2013-08-15 21:47:37] 0000000000000206 0000000000090d50 0000000000000000 00007f2952eb8eb8 (XEN) [2013-08-15 21:47:37] 0000000000000000 00007f2952eb7da0 00000000018cd000 ffff8800573b1f48 (XEN) [2013-08-15 21:47:37] ffffffff8103dba9 00007f2952eb8e60 ffffffff8199a538 00000000018cd000 (XEN) [2013-08-15 21:47:37] 00007f2952eb7da0 0000000000000000 00007f2952eb8eb8 00007f2952eb8e60 (XEN) [2013-08-15 21:47:38] (XEN) [2013-08-15 21:48:08] ''c'' pressed -> printing ACPI Cx structures (XEN) [2013-08-15 21:48:08] ==cpu0=(XEN) [2013-08-15 21:48:08] active state: C0 (XEN) [2013-08-15 21:48:08] max_cstate: C7 (XEN) [2013-08-15 21:48:08] states: (XEN) [2013-08-15 21:48:08] C1: type[C1] latency[000] usage[00072952] method[ HALT] duration[26482032638] (XEN) [2013-08-15 21:48:08] C2: type[C2] latency[075] usage[00041280] method[SYSIO] duration[686558382455] (XEN) [2013-08-15 21:48:08] *C0: usage[00114232] duration[66482497828] (XEN) [2013-08-15 21:48:08] PC2[0] PC3[0] PC6[0] PC7[0] (XEN) [2013-08-15 21:48:08] CC3[0] CC6[0] CC7[0] (XEN) [2013-08-15 21:48:08] ==cpu1=(XEN) [2013-08-15 21:48:08] active state: C2 (XEN) [2013-08-15 21:48:08] max_cstate: C7 (XEN) [2013-08-15 21:48:08] states: (XEN) [2013-08-15 21:48:08] C1: type[C1] latency[000] usage[00008684] method[ HALT] duration[6016679162] (XEN) [2013-08-15 21:48:08] *C2: type[C2] latency[075] usage[00030903] method[SYSIO] duration[746231947244] (XEN) [2013-08-15 21:48:08] C0: usage[00039587] duration[27274360529] (XEN) [2013-08-15 21:48:08] PC2[0] PC3[0] PC6[0] PC7[0] (XEN) [2013-08-15 21:48:08] CC3[0] CC6[0] CC7[0] (XEN) [2013-08-15 21:48:08] ==cpu2=(XEN) [2013-08-15 21:48:08] active state: C2 (XEN) [2013-08-15 21:48:08] max_cstate: C7 (XEN) [2013-08-15 21:48:08] states: (XEN) [2013-08-15 21:48:08] C1: type[C1] latency[000] usage[00011284] method[ HALT] duration[12103336867] (XEN) [2013-08-15 21:48:08] *C2: type[C2] latency[075] usage[00019757] method[SYSIO] duration[737885526835] (XEN) [2013-08-15 21:48:08] C0: usage[00031041] duration[29534208557] (XEN) [2013-08-15 21:48:08] PC2[0] PC3[0] PC6[0] PC7[0] (XEN) [2013-08-15 21:48:08] CC3[0] CC6[0] CC7[0] (XEN) [2013-08-15 21:48:08] ==cpu3=(XEN) [2013-08-15 21:48:08] active state: C2 (XEN) [2013-08-15 21:48:08] max_cstate: C7 (XEN) [2013-08-15 21:48:08] states: (XEN) [2013-08-15 21:48:08] C1: type[C1] latency[000] usage[00011483] method[ HALT] duration[10160098893] (XEN) [2013-08-15 21:48:08] *C2: type[C2] latency[075] usage[00019043] method[SYSIO] duration[739453870027] (XEN) [2013-08-15 21:48:08] C0: usage[00030526] duration[29909188170] (XEN) [2013-08-15 21:48:08] PC2[0] PC3[0] PC6[0] PC7[0] (XEN) [2013-08-15 21:48:08] CC3[0] CC6[0] CC7[0] (XEN) [2013-08-15 21:48:08] ==cpu4=(XEN) [2013-08-15 21:48:08] active state: C0 (XEN) [2013-08-15 21:48:08] max_cstate: C7 (XEN) [2013-08-15 21:48:08] states: (XEN) [2013-08-15 21:48:08] C1: type[C1] latency[000] usage[00011422] method[ HALT] duration[9537900270] (XEN) [2013-08-15 21:48:08] C2: type[C2] latency[075] usage[00018548] method[SYSIO] duration[741329458092] (XEN) [2013-08-15 21:48:08] *C0: usage[00029970] duration[28655883377] (XEN) [2013-08-15 21:48:08] PC2[0] PC3[0] PC6[0] PC7[0] (XEN) [2013-08-15 21:48:08] CC3[0] CC6[0] CC7[0] (XEN) [2013-08-15 21:48:08] ==cpu5=(XEN) [2013-08-15 21:48:08] active state: C2 (XEN) [2013-08-15 21:48:08] max_cstate: C7 (XEN) [2013-08-15 21:48:08] states: (XEN) [2013-08-15 21:48:08] C1: type[C1] latency[000] usage[00011007] method[ HALT] duration[9241868755] (XEN) [2013-08-15 21:48:08] *C2: type[C2] latency[075] usage[00017378] method[SYSIO] duration[740476254894] (XEN) [2013-08-15 21:48:08] C0: usage[00028385] duration[29805191701] (XEN) [2013-08-15 21:48:08] PC2[0] PC3[0] PC6[0] PC7[0] (XEN) [2013-08-15 21:48:08] CC3[0] CC6[0] CC7[0] (XEN) [2013-08-15 21:48:08] Domain 0 shutdown: rebooting machine. Then i thought to be clever and use "clocksource=acpi" (and still had cpuidle and cpufreq=xen in grub ) .. but that only made things worse (probably a non-valid combination of command line options ?) .. it is still reporting to use hpet for broadcast ... (XEN) [2013-08-15 22:15:36] Platform timer is 3.579MHz ACPI PM Timer <SNIP> (XEN) [2013-08-15 22:15:36] HPET: 3 timers (3 will be used for broadcast) <SNIP> (XEN) [2013-08-15 22:19:06] Platform timer appears to have unexpectedly wrapped 10 or more times. (XEN) [2013-08-15 22:16:41] *** Serial input -> Xen (type ''CTRL-a'' three times to switch input to DOM0) (XEN) [2013-08-15 22:16:46] ''d'' pressed -> dumping registers (XEN) [2013-08-15 22:16:46] (XEN) [2013-08-15 22:16:46] *** Dumping CPU0 host state: *** (XEN) [2013-08-15 22:16:46] ----[ Xen-4.4-unstable x86_64 debug=y Not tainted ]---- (XEN) [2013-08-15 22:16:46] CPU: 0 (XEN) [2013-08-15 22:16:46] RIP: e008:[<ffff82d0801a1a1c>] hpet_broadcast_exit+0/0x171 (XEN) [2013-08-15 22:16:46] RFLAGS: 0000000000000246 CONTEXT: hypervisor (XEN) [2013-08-15 22:16:46] rax: 0000000000000000 rbx: ffff83055d73be60 rcx: 20c49ba5e353f7cf (XEN) [2013-08-15 22:16:46] rdx: ffff82d080311220 rsi: 0000001060bc025b rdi: ffff83055d73be88 (XEN) [2013-08-15 22:16:46] rbp: ffff82d0802cfef0 rsp: ffff82d0802cfe88 r8: 0000000f76065470 (XEN) [2013-08-15 22:16:46] r9: ffff82cfffd76000 r10: 0000000fb1a1298a r11: 0000000000000246 (XEN) [2013-08-15 22:16:46] r12: ffff83055d73bed0 r13: 0000000f760691ee r14: 0000001060bc025b (XEN) [2013-08-15 22:16:46] r15: ffff82d080311280 cr0: 000000008005003b cr4: 00000000000006f0 (XEN) [2013-08-15 22:16:46] cr3: 000000009fc7b000 cr2: ffff8800589c52a8 (XEN) [2013-08-15 22:16:46] ds: 0000 es: 0000 fs: 0000 gs: 0000 ss: e010 cs: e008 (XEN) [2013-08-15 22:16:46] Xen stack trace from rsp=ffff82d0802cfe88: (XEN) [2013-08-15 22:16:46] ffff82d0801a3f02 ffff82d0802cfeb0 ffff82d080186d09 ffffffffffffffff (XEN) [2013-08-15 22:16:46] ffff82d0802e8000 ffff82d0802cfee0 0000000000000000 0000000000000000 (XEN) [2013-08-15 22:16:46] 000015210000eb86 ffff82d0802c8000 ffff82d0802c8000 00000000ffffffff (XEN) [2013-08-15 22:16:46] 0000000000000002 ffff82d0802cff10 ffff82d08015ce92 ffff83009fd13000 (XEN) [2013-08-15 22:16:46] ffff83009ff88000 ffff82d0802cfdd8 0000000000000000 ffff88005fcf3040 (XEN) [2013-08-15 22:16:46] ffffffff81f970c0 ffffffff81edb630 ffffffff81e01e88 ffffffff81e01fd8 (XEN) [2013-08-15 22:16:46] 0000000000000246 0000000000000000 0000000000000000 0000000000000001 (XEN) [2013-08-15 22:16:46] 0000000000000000 ffffffff810013aa ffffffff81e13440 00000000deadbeef (XEN) [2013-08-15 22:16:46] 00000000deadbeef 0000010000000000 ffffffff810013aa 000000000000e033 (XEN) [2013-08-15 22:16:46] 0000000000000246 ffffffff81e01e70 000000000000e02b 0000000000000000 (XEN) [2013-08-15 22:16:46] 0000000000000000 0000000000000000 0000000000000000 0000000000000000 (XEN) [2013-08-15 22:16:46] ffff83009fd13000 0000000000000000 0000000000000000 (XEN) [2013-08-15 22:16:46] Xen call trace: (XEN) [2013-08-15 22:16:46] [<ffff82d0801a1a1c>] hpet_broadcast_exit+0/0x171 (XEN) [2013-08-15 22:16:47] [<ffff82d08015ce92>] idle_loop+0x5b/0x6b (XEN) [2013-08-15 22:16:47] (XEN) [2013-08-15 22:16:47] *** Dumping CPU1 host state: *** (XEN) [2013-08-15 22:16:47] ----[ Xen-4.4-unstable x86_64 debug=y Not tainted ]---- (XEN) [2013-08-15 22:16:47] CPU: 1 (XEN) [2013-08-15 22:16:47] RIP: e008:[<ffff82d0801a1a1c>] hpet_broadcast_exit+0/0x171 (XEN) [2013-08-15 22:16:47] RFLAGS: 0000000000000246 CONTEXT: hypervisor (XEN) [2013-08-15 22:16:47] rax: 0000000000000000 rbx: ffff83055d73a6c0 rcx: 20c49ba5e353f7cf (XEN) [2013-08-15 22:16:47] rdx: ffff83055d6db020 rsi: 000000108a8019a8 rdi: ffff83055d73a6e8 (XEN) [2013-08-15 22:16:47] rbp: ffff83055d6d7ef0 rsp: ffff83055d6d7e88 r8: 0000000f76065470 (XEN) [2013-08-15 22:16:47] r9: 0000000000000001 r10: 00000000deadbeef r11: 0000000000000246 (XEN) [2013-08-15 22:16:47] r12: ffff83055d73a730 r13: 0000000f7606908b r14: 000000108a8019a8 (XEN) [2013-08-15 22:16:47] r15: ffff83055d6db080 cr0: 000000008005003b cr4: 00000000000006f0 (XEN) [2013-08-15 22:16:47] cr3: 0000000545e09000 cr2: 00007f0b8c493e02 (XEN) [2013-08-15 22:16:47] ds: 002b es: 002b fs: 0000 gs: 0000 ss: e010 cs: e008 (XEN) [2013-08-15 22:16:47] Xen stack trace from rsp=ffff83055d6d7e88: (XEN) [2013-08-15 22:16:47] ffff82d0801a3f02 ffff83055d6d7eb0 ffff82d080186ba7 ffffffffffffffff (XEN) [2013-08-15 22:16:47] ffff82d0802e8080 ffff83055d6d7ee0 0000000000000000 0000000000000000 (XEN) [2013-08-15 22:16:47] 0000151e00036318 ffff83055d6d0000 ffff83055d6d0000 00000000ffffffff (XEN) [2013-08-15 22:16:47] 0000000000000002 ffff83055d6d7f10 ffff82d08015ce92 ffff83009fafe000 (XEN) [2013-08-15 22:16:47] ffff83009fd17000 ffff83055d6d7dd8 0000000000000000 0000000000000000 (XEN) [2013-08-15 22:16:47] 0000000000000000 ffffffff81edb630 ffff880059bd5f10 ffff880059bd5fd8 (XEN) [2013-08-15 22:16:47] 0000000000000246 0000000000000000 0000000000000000 0000000000000001 (XEN) [2013-08-15 22:16:47] 0000000000000000 ffffffff810013aa ffff880059bd8000 00000000deadbeef (XEN) [2013-08-15 22:16:47] 00000000deadbeef 0000010000000000 ffffffff810013aa 000000000000e033 (XEN) [2013-08-15 22:16:47] 0000000000000246 ffff880059bd5ef8 000000000000e02b 64657a696c616974 (XEN) [2013-08-15 22:16:47] 312020205b0a0d0d 3332373831342e35 6f7465756c42205d 4943482000000001 (XEN) [2013-08-15 22:16:47] ffff83009fafe000 00000034dd3c9e00 7270202935482820 (XEN) [2013-08-15 22:16:47] Xen call trace: (XEN) [2013-08-15 22:16:47] [<ffff82d0801a1a1c>] hpet_broadcast_exit+0/0x171 (XEN) [2013-08-15 22:16:47] [<ffff82d08015ce92>] idle_loop+0x5b/0x6b (XEN) [2013-08-15 22:16:47] (XEN) [2013-08-15 22:16:47] *** Dumping CPU2 host state: *** (XEN) [2013-08-15 22:16:47] ----[ Xen-4.4-unstable x86_64 debug=y Not tainted ]---- (XEN) [2013-08-15 22:16:47] CPU: 2 (XEN) [2013-08-15 22:16:47] RIP: e008:[<ffff82d0801a1a1c>] hpet_broadcast_exit+0/0x171 (XEN) [2013-08-15 22:16:47] RFLAGS: 0000000000000246 CONTEXT: hypervisor (XEN) [2013-08-15 22:16:47] rax: 0000000000000000 rbx: ffff83055d73ab60 rcx: 20c49ba5e353f7cf (XEN) [2013-08-15 22:16:47] rdx: ffff83055d66c020 rsi: 00000010b2de4b5a rdi: ffff83055d73ab88 (XEN) [2013-08-15 22:16:47] rbp: ffff83055d667ef0 rsp: ffff83055d667e88 r8: 0000000f76065470 (XEN) [2013-08-15 22:16:47] r9: 0000000000000002 r10: 00000000deadbeef r11: 0000000000000246 (XEN) [2013-08-15 22:16:47] r12: ffff83055d73abd0 r13: 0000000fb1a27519 r14: 00000010b2de4b5a (XEN) [2013-08-15 22:16:47] r15: ffff83055d66c080 cr0: 000000008005003b cr4: 00000000000006f0 (XEN) [2013-08-15 22:16:47] cr3: 0000000545e09000 cr2: ffff8800570ae048 (XEN) [2013-08-15 22:16:47] ds: 002b es: 002b fs: 0000 gs: 0000 ss: e010 cs: e008 (XEN) [2013-08-15 22:16:48] Xen stack trace from rsp=ffff83055d667e88: (XEN) [2013-08-15 22:16:48] ffff82d0801a3f02 ffff82d0802e8000 ffff83055d660000 ffffffffffffffff (XEN) [2013-08-15 22:16:48] ffff83055d66c080 ffff83055d667ee0 0000000000000000 0000000000000000 (XEN) [2013-08-15 22:16:48] 000014d4000bb2db ffff83055d660000 ffff83055d660000 00000000ffffffff (XEN) [2013-08-15 22:16:48] 0000000000000002 ffff83055d667f10 ffff82d08015ce92 ffff83009fafd000 (XEN) [2013-08-15 22:16:48] ffff83009fd16000 ffff83055d667dd8 0000000000000000 0000000000000000 (XEN) [2013-08-15 22:16:48] 0000000000000000 ffffffff81edb630 ffff880059bd7f10 ffff880059bd7fd8 (XEN) [2013-08-15 22:16:48] 0000000000000246 0000000000000000 0000000000000000 0000000000000001 (XEN) [2013-08-15 22:16:48] 0000000000000000 ffffffff810013aa ffff880059bd9070 00000000deadbeef (XEN) [2013-08-15 22:16:48] 00000000deadbeef 0000010000000000 ffffffff810013aa 000000000000e033 (XEN) [2013-08-15 22:16:48] 0000000000000246 ffff880059bd7ef8 000000000000e02b 0000000000000000 (XEN) [2013-08-15 22:16:48] 0000000000000000 0000000000000000 0000000000000000 0000000000000002 (XEN) [2013-08-15 22:16:48] ffff83009fafd000 00000034dd35ae00 0000000000000000 (XEN) [2013-08-15 22:16:48] Xen call trace: (XEN) [2013-08-15 22:16:48] [<ffff82d0801a1a1c>] hpet_broadcast_exit+0/0x171 (XEN) [2013-08-15 22:16:48] [<ffff82d08015ce92>] idle_loop+0x5b/0x6b (XEN) [2013-08-15 22:16:48] (XEN) [2013-08-15 22:16:48] *** Dumping CPU3 host state: *** (XEN) [2013-08-15 22:16:48] ----[ Xen-4.4-unstable x86_64 debug=y Not tainted ]---- (XEN) [2013-08-15 22:16:48] CPU: 3 (XEN) [2013-08-15 22:16:48] RIP: e008:[<ffff82d0801a38c5>] acpi_idle_do_entry+0x35/0x3a (XEN) [2013-08-15 22:16:48] RFLAGS: 0000000000000246 CONTEXT: hypervisor (XEN) [2013-08-15 22:16:48] rax: 0000000000000003 rbx: ffff83055d658010 rcx: 0000000000000001 (XEN) [2013-08-15 22:16:48] rdx: 0000000000000000 rsi: ffff83055d65ec80 rdi: ffff83055d658060 (XEN) [2013-08-15 22:16:48] rbp: ffff83055d657ef0 rsp: ffff83055d657e88 r8: 0000000f76065470 (XEN) [2013-08-15 22:16:48] r9: ffff83009fd15060 r10: 00000000deadbeef r11: 0000000000000246 (XEN) [2013-08-15 22:16:48] r12: ffff83055d658060 r13: 0000000f76068524 r14: 0000000000000002 (XEN) [2013-08-15 22:16:48] r15: ffff83055d65e080 cr0: 000000008005003b cr4: 00000000000006f0 (XEN) [2013-08-15 22:16:48] cr3: 000000009fc7b000 cr2: 00007ff22a4e2594 (XEN) [2013-08-15 22:16:48] ds: 002b es: 002b fs: 0000 gs: 0000 ss: e010 cs: e008 (XEN) [2013-08-15 22:16:48] Xen stack trace from rsp=ffff83055d657e88: (XEN) [2013-08-15 22:16:48] ffff82d0801a3d21 ffff83055d657eb0 ffff82d080186ba7 ffffffffffffffff (XEN) [2013-08-15 22:16:48] ffff82d0802e8180 ffff83055d657ee0 0000000000000000 0000000000000000 (XEN) [2013-08-15 22:16:48] 0000151c000cf5d3 ffff83055d650000 ffff83055d650000 00000000ffffffff (XEN) [2013-08-15 22:16:48] 0000000000000002 ffff83055d657f10 ffff82d08015ce92 ffff83009fafc000 (XEN) [2013-08-15 22:16:48] ffff83009fd15000 ffff83055d657dd8 0000000000000000 0000000000000000 (XEN) [2013-08-15 22:16:48] 0000000000000000 ffffffff81edb630 ffff880059be9f10 ffff880059be9fd8 (XEN) [2013-08-15 22:16:48] 0000000000000246 0000000000000000 0000000000000000 0000000000000001 (XEN) [2013-08-15 22:16:48] 0000000000000000 ffffffff810013aa ffff880059bda0e0 00000000deadbeef (XEN) [2013-08-15 22:16:48] 00000000deadbeef 0000010000000000 ffffffff810013aa 000000000000e033 (XEN) [2013-08-15 22:16:48] 0000000000000246 ffff880059be9ef8 000000000000e02b 0000000000000000 (XEN) [2013-08-15 22:16:48] 0000000000000000 0000000000000000 0000000000000000 0000000000000003 (XEN) [2013-08-15 22:16:48] ffff83009fafc000 00000034dd34ce00 0000000000000000 (XEN) [2013-08-15 22:16:49] Xen call trace: (XEN) [2013-08-15 22:16:49] [<ffff82d0801a38c5>] acpi_idle_do_entry+0x35/0x3a (XEN) [2013-08-15 22:16:49] [<ffff82d08015ce92>] idle_loop+0x5b/0x6b (XEN) [2013-08-15 22:16:49] (XEN) [2013-08-15 22:16:49] *** Dumping CPU4 guest state (d0:v4): *** (XEN) [2013-08-15 22:16:49] ----[ Xen-4.4-unstable x86_64 debug=y Not tainted ]---- (XEN) [2013-08-15 22:16:49] CPU: 4 (XEN) [2013-08-15 22:16:49] RIP: e033:[<ffffffff810c9b0b>] (XEN) [2013-08-15 22:16:49] RFLAGS: 0000000000000202 EM: 1 CONTEXT: pv guest (XEN) [2013-08-15 22:16:49] rax: ffffffff81997abc rbx: 0000000000000002 rcx: 0000000000000002 (XEN) [2013-08-15 22:16:49] rdx: 0000000000000018 rsi: 0000000000000008 rdi: 0000000000000000 (XEN) [2013-08-15 22:16:49] rbp: ffff88005907dc08 rsp: ffff88005907db28 r8: 0000000000000000 (XEN) [2013-08-15 22:16:49] r9: 0000000000000001 r10: 0000000000000000 r11: 0000000000000019 (XEN) [2013-08-15 22:16:49] r12: 0000000000000019 r13: ffff88005905d230 r14: ffff88005f713398 (XEN) [2013-08-15 22:16:49] r15: ffff88005905d908 cr0: 000000008005003b cr4: 00000000000006f0 (XEN) [2013-08-15 22:16:49] cr3: 0000000549e0c000 cr2: 00007f53afbafaf0 (XEN) [2013-08-15 22:16:49] ds: 0000 es: 0000 fs: 0000 gs: 0000 ss: e02b cs: e033 (XEN) [2013-08-15 22:16:49] Guest stack trace from rsp=ffff88005907db28: (XEN) [2013-08-15 22:16:49] 0000000000000000 ffffffff810b2b33 ffff88005905d900 ffff880000000000 (XEN) [2013-08-15 22:16:49] ffff880000000019 ffff880000000000 0000000200000019 0000000000000002 (XEN) [2013-08-15 22:16:49] ffff88005905d900 ffffffff822efd30 ffff88005905d900 ffffffff822efd30 (XEN) [2013-08-15 22:16:49] 0000000000000000 0000000000000000 ffff88005907dc08 000000000000b120 (XEN) [2013-08-15 22:16:49] 0000000000000000 0000000000000000 ffff88005907dbf8 ffffffff8100499a (XEN) [2013-08-15 22:16:49] ffff88005907dc08 ffff880059050030 ffff88005f713398 ffffffff819900bc (XEN) [2013-08-15 22:16:49] ffff88005f713398 ffff88005905d230 0000000000000000 ffff88005905d230 (XEN) [2013-08-15 22:16:49] ffff88005907dc78 ffffffff810cbd0d 0000000000000000 ffffffff81997abc (XEN) [2013-08-15 22:16:49] ffff880000000000 ffffffff810c837c 0000000000000002 0000000000000000 (XEN) [2013-08-15 22:16:49] ffff880000000000 ffffffff00000000 ffff88005f713380 ffff88005f713380 (XEN) [2013-08-15 22:16:49] 0000000000000004 0000000000000004 ffff88005907dca8 ffffffff81999b6c (XEN) [2013-08-15 22:16:49] ffffffff81997abc ffff88005f713380 ffff880059802550 ffff88005f713380 (XEN) [2013-08-15 22:16:49] ffff88005907ddd8 ffffffff81997abc ffff88005905b150 ffff88005905b150 (XEN) [2013-08-15 22:16:49] ffff88005905d230 ffff88005907dfd8 ffff88005907dfd8 ffff88005907dfd8 (XEN) [2013-08-15 22:16:49] ffff880059bdb150 ffff88005905d230 ffff88005f70e920 ffffffff81e405c0 (XEN) [2013-08-15 22:16:49] ffff88005907dd18 ffff88005905d230 ffffffff810891e9 ffffffff81e35fa0 (XEN) [2013-08-15 22:16:49] 0000000000000004 ffffffff810c88c7 ffff88005907dd58 0000000000000100 (XEN) [2013-08-15 22:16:49] ffff88005907dd68 ffffffff81088a28 ffff88005907dd68 ffffffff810c6301 (XEN) [2013-08-15 22:16:49] ffff88005907dd78 ffff88005905d230 ffffffff81089381 ffffffff81e35fa0 (XEN) [2013-08-15 22:16:49] 0000000000000004 ffff88005905d230 ffff88005907ddb8 ffffffff810c837c (XEN) [2013-08-15 22:16:49] (XEN) [2013-08-15 22:16:49] *** Dumping CPU5 host state: *** (XEN) [2013-08-15 22:16:49] ----[ Xen-4.4-unstable x86_64 debug=y Not tainted ]---- (XEN) [2013-08-15 22:16:49] CPU: 5 (XEN) [2013-08-15 22:16:49] RIP: e008:[<ffff82d0801a1a1c>] hpet_broadcast_exit+0/0x171 (XEN) [2013-08-15 22:16:49] RFLAGS: 0000000000000246 CONTEXT: hypervisor (XEN) [2013-08-15 22:16:50] rax: 0000000000000000 rbx: ffff83055d658950 rcx: 20c49ba5e353f7cf (XEN) [2013-08-15 22:16:50] rdx: ffff83055d649020 rsi: 00000011355ced81 rdi: ffff83055d658978 (XEN) [2013-08-15 22:16:50] rbp: ffff83055d63fef0 rsp: ffff83055d63fe88 r8: 0000000f76065470 (XEN) [2013-08-15 22:16:50] r9: ffff82cfffd76000 r10: 00000000deadbeef r11: 0000000000000246 (XEN) [2013-08-15 22:16:50] r12: ffff83055d6589c0 r13: 0000000f76068d7c r14: 00000011355ced81 (XEN) [2013-08-15 22:16:50] r15: ffff83055d649080 cr0: 000000008005003b cr4: 00000000000006f0 (XEN) [2013-08-15 22:16:50] cr3: 000000009fc7b000 cr2: 0000000000201718 (XEN) [2013-08-15 22:16:50] ds: 002b es: 002b fs: 0000 gs: 0000 ss: e010 cs: e008 (XEN) [2013-08-15 22:16:50] Xen stack trace from rsp=ffff83055d63fe88: (XEN) [2013-08-15 22:16:50] ffff82d0801a3f02 ffff83055d63feb0 ffff82d080186ba7 ffffffffffffffff (XEN) [2013-08-15 22:16:50] ffff82d0802e8280 ffff83055d63fee0 0000000000000000 0000000000000000 (XEN) [2013-08-15 22:16:50] 0000152200104f21 ffff83055d638000 ffff83055d638000 00000000ffffffff (XEN) [2013-08-15 22:16:50] 0000000000000002 ffff83055d63ff10 ffff82d08015ce92 ffff83009ff8a000 (XEN) [2013-08-15 22:16:50] ffff83009fafb000 ffff83055d63fdd8 0000000000000000 0000000000000000 (XEN) [2013-08-15 22:16:50] 0000000000000000 ffffffff81edb630 ffff880059bedf10 ffff880059bedfd8 (XEN) [2013-08-15 22:16:50] 0000000000000246 0000000000000000 0000000000000000 0000000000000001 (XEN) [2013-08-15 22:16:50] 0000000000000000 ffffffff810013aa ffff880059bdc1c0 00000000deadbeef (XEN) [2013-08-15 22:16:50] 00000000deadbeef 0000010000000000 ffffffff810013aa 000000000000e033 (XEN) [2013-08-15 22:16:50] 0000000000000246 ffff880059bedef8 000000000000e02b 0000000000000000 (XEN) [2013-08-15 22:16:50] 0000000000000000 0000000000000000 0000000000000000 0000000000000005 (XEN) [2013-08-15 22:16:50] ffff83009ff8a000 00000034dd337e00 0000000000000000 (XEN) [2013-08-15 22:16:50] Xen call trace: (XEN) [2013-08-15 22:16:50] [<ffff82d0801a1a1c>] hpet_broadcast_exit+0/0x171 (XEN) [2013-08-15 22:16:50] [<ffff82d08015ce92>] idle_loop+0x5b/0x6b (XEN) [2013-08-15 22:16:50] (XEN) [2332-07-30 04:06:58] ''c'' pressed -> printing ACPI Cx structures (XEN) [2332-07-30 04:06:58] ==cpu0=(XEN) [2332-07-30 04:06:58] active state: C0 (XEN) [2332-07-30 04:06:58] max_cstate: C7 (XEN) [2332-07-30 04:06:58] states: (XEN) [2332-07-30 04:06:58] C1: type[C1] latency[000] usage[00002258] method[ HALT] duration[3454028917] (XEN) [2332-07-30 04:06:58] C2: type[C2] latency[075] usage[00000901] method[SYSIO] duration[211234937386] (XEN) [2332-07-30 04:06:58] *C0: usage[00003159] duration[-8381555205551695425] (XEN) [2332-07-30 04:06:58] PC2[0] PC3[0] PC6[0] PC7[0] (XEN) [2332-07-30 04:06:58] CC3[0] CC6[0] CC7[0] (XEN) [2332-07-30 04:06:58] ==cpu1=(XEN) [2332-07-30 04:06:58] active state: C1 (XEN) [2332-07-30 04:06:58] max_cstate: C7 (XEN) [2332-07-30 04:06:58] states: (XEN) [2332-07-30 04:06:58] *C1: type[C1] latency[000] usage[00001031] method[ HALT] duration[2443305639] (XEN) [2332-07-30 04:06:58] C2: type[C2] latency[075] usage[00000551] method[SYSIO] duration[216748985000] (XEN) [2332-07-30 04:06:58] C0: usage[00001582] duration[-8381555210054923001] (XEN) [2332-07-30 04:06:58] PC2[0] PC3[0] PC6[0] PC7[0] (XEN) [2332-07-30 04:06:58] CC3[0] CC6[0] CC7[0] (XEN) [2332-07-30 04:06:58] ==cpu2=(XEN) [2332-07-30 04:06:58] active state: C1 (XEN) [2332-07-30 04:06:58] max_cstate: C7 (XEN) [2332-07-30 04:06:58] states: (XEN) [2332-07-30 04:06:58] *C1: type[C1] latency[000] usage[00001019] method[ HALT] duration[1413510230] (XEN) [2332-07-30 04:06:58] C2: type[C2] latency[075] usage[00000492] method[SYSIO] duration[217869128982] (XEN) [2332-07-30 04:06:58] C0: usage[00001511] duration[-8381555210145167459] (XEN) [2332-07-30 04:06:58] PC2[0] PC3[0] PC6[0] PC7[0] (XEN) [2332-07-30 04:06:58] CC3[0] CC6[0] CC7[0] (XEN) [2332-07-30 04:06:58] ==cpu3=(XEN) [2332-07-30 04:06:58] active state: C1 (XEN) [2332-07-30 04:06:58] max_cstate: C7 (XEN) [2332-07-30 04:06:58] states: (XEN) [2332-07-30 04:06:58] *C1: type[C1] latency[000] usage[00000865] method[ HALT] duration[25623711920] (XEN) [2332-07-30 04:06:58] C2: type[C2] latency[075] usage[00000593] method[SYSIO] duration[194068490138] (XEN) [2332-07-30 04:06:58] C0: usage[00001458] duration[-8381555210554628502] (XEN) [2332-07-30 04:06:58] PC2[0] PC3[0] PC6[0] PC7[0] (XEN) [2332-07-30 04:06:58] CC3[0] CC6[0] CC7[0] (XEN) [2332-07-30 04:06:58] ==cpu4=(XEN) [2332-07-30 04:06:58] active state: C0 (XEN) [2332-07-30 04:06:58] max_cstate: C7 (XEN) [2332-07-30 04:06:58] states: (XEN) [2332-07-30 04:06:58] C1: type[C1] latency[000] usage[00000927] method[ HALT] duration[324870059] (XEN) [2332-07-30 04:06:58] C2: type[C2] latency[075] usage[00000489] method[SYSIO] duration[198425572230] (XEN) [2332-07-30 04:06:58] *C0: usage[00001416] duration[-8381555189612766487] (XEN) [2332-07-30 04:06:58] PC2[0] PC3[0] PC6[0] PC7[0] (XEN) [2332-07-30 04:06:58] CC3[0] CC6[0] CC7[0] (XEN) [2332-07-30 04:06:58] ==cpu5=(XEN) [2332-07-30 04:06:58] active state: C1 (XEN) [2332-07-30 04:06:58] max_cstate: C7 (XEN) [2332-07-30 04:06:58] states: (XEN) [2332-07-30 04:06:58] *C1: type[C1] latency[000] usage[00000750] method[ HALT] duration[2269018488] (XEN) [2332-07-30 04:06:58] C2: type[C2] latency[075] usage[00000376] method[SYSIO] duration[216867927931] (XEN) [2332-07-30 04:06:58] C0: usage[00001126] duration[-8381555209999175764] (XEN) [2332-07-30 04:06:58] PC2[0] PC3[0] PC6[0] PC7[0] (XEN) [2332-07-30 04:06:58] CC3[0] CC6[0] CC7[0] (XEN) [2066-12-22 10:22:57] Assertion ''credits == val'' failed at sched_credit.c:346 (XEN) [2066-12-22 10:22:57] ----[ Xen-4.4-unstable x86_64 debug=y Not tainted ]---- (XEN) [2066-12-22 10:22:57] CPU: 4 (XEN) [2066-12-22 10:22:57] RIP: e008:[<ffff82d080119bcc>] burn_credits+0x77/0xa8 (XEN) [2066-12-22 10:22:57] RFLAGS: 0000000000010206 CONTEXT: hypervisor (XEN) [2066-12-22 10:22:57] rax: 0000000003f6f763 rbx: 0000000000000004 rcx: 0000000000062250 (XEN) [2066-12-22 10:22:57] rdx: 00000f5003f6f763 rsi: 175d780cb73adbba rdi: ffff83054f5f0340 (XEN) [2066-12-22 10:22:57] rbp: ffff83055d647dd8 rsp: ffff83055d647dd8 r8: 175d783d72bbc47e (XEN) [2066-12-22 10:22:57] r9: ffff83009fd14060 r10: 0000000000000000 r11: 0000000000021270 (XEN) [2066-12-22 10:22:57] r12: ffff83055d658270 r13: ffff83055d6ca300 r14: 0000000000000004 (XEN) [2066-12-22 10:22:57] r15: ffff83054f5f0340 cr0: 000000008005003b cr4: 00000000000006f0 (XEN) [2066-12-22 10:22:57] cr3: 0000000549e0c000 cr2: 00007f53afbafaf0 (XEN) [2066-12-22 10:22:57] ds: 0000 es: 0000 fs: 0000 gs: 0000 ss: 0000 cs: e008 (XEN) [2066-12-22 10:22:57] Xen stack trace from rsp=ffff83055d647dd8: (XEN) [2066-12-22 10:22:57] ffff83055d647e48 ffff82d08011b3c9 ffff83055d647e28 ffff82d0802cfe10 (XEN) [2066-12-22 10:22:57] ffff82d080267820 ffff83055d640000 0000000000000000 0000000000000000 (XEN) [2066-12-22 10:22:57] ffff83055d647e48 ffff83055d64f200 ffff82d08011b2d9 0000000000000004 (XEN) [2066-12-22 10:22:57] 175d783d9ca7fc02 0000000000000000 ffff83055d647e78 ffff82d0801299f6 (XEN) [2066-12-22 10:22:57] 0000000000000002 ffff83055d64f200 ffff83055d658860 ffff83055d658288 (XEN) [2066-12-22 10:22:57] ffff83055d647ec8 ffff82d080129af7 ffffffffffffffff 0000000000000000 (XEN) [2066-12-22 10:22:57] ffff83055d647ea8 ffff82d0802e8200 ffff82d0802e8000 ffff83055d640000 (XEN) [2066-12-22 10:22:57] ffffffffffffffff 0000000000000000 ffff83055d647ef8 ffff82d08012660e (XEN) [2066-12-22 10:22:57] ffff83009fd14000 0000000000000100 00000000000009d3 0000000000000000 (XEN) [2066-12-22 10:22:57] ffff83055d647f08 ffff82d080126674 00007cfaa29b80c7 ffff82d08022b1b1 (XEN) [2066-12-22 10:22:57] 0000000000000000 0000000000000000 00000000000009d3 0000000000000100 (XEN) [2066-12-22 10:22:57] ffff88005907dc68 ffff88005907dc78 0000000000021270 0000000000000000 (XEN) [2066-12-22 10:22:57] 0000000000000000 0000000000000000 0000000000000001 0000000000000000 (XEN) [2066-12-22 10:22:57] ffff88005905d908 0000000000000000 ffff88005907dc78 000000fa00000000 (XEN) [2066-12-22 10:22:57] ffffffff810bc467 000000000000e033 0000000000000202 ffff88005907dc48 (XEN) [2066-12-22 10:22:57] 000000000000e02b 8010000537152067 8010000537151067 8010000537150067 (XEN) [2066-12-22 10:22:57] 801000053714f067 8010000500000004 ffff83009fd14000 00000034dd33de00 (XEN) [2066-12-22 10:22:57] 801000053714b067 (XEN) [2066-12-22 10:22:57] Xen call trace: (XEN) [2066-12-22 10:22:57] [<ffff82d080119bcc>] burn_credits+0x77/0xa8 (XEN) [2066-12-22 10:22:57] [<ffff82d08011b3c9>] csched_tick+0xf0/0x351 (XEN) [2066-12-22 10:22:57] [<ffff82d0801299f6>] execute_timer+0x4e/0x6c (XEN) [2066-12-22 10:22:57] [<ffff82d080129af7>] timer_softirq_action+0xe3/0x215 (XEN) [2066-12-22 10:22:57] [<ffff82d08012660e>] __do_softirq+0x8e/0x99 (XEN) [2066-12-22 10:22:57] [<ffff82d080126674>] do_softirq+0x13/0x15 (XEN) [2066-12-22 10:22:57] (XEN) [2066-12-22 10:22:58] (XEN) [2066-12-22 10:22:58] **************************************** (XEN) [2066-12-22 10:22:58] Panic on CPU 4: (XEN) [2066-12-22 10:22:58] Assertion ''credits == val'' failed at sched_credit.c:346 (XEN) [2066-12-22 10:22:58] **************************************** (XEN) [2066-12-22 10:22:58] (XEN) [2066-12-22 10:22:58] Reboot in five seconds... So i removed cpuidle and cpufreq=xen and tried "clocksource=pit" .. and now it doesn''t stall anymore (both on boot and on reboot) ... So it seems when using the hpet broadcast it gets stuck in an idle loop ... and hitting a key on the console gets it out ... I have attached a serial log from a boot with hpet as clocksource with some additional debug info. While making this debug-key "V" to dump the interupt remap tables seemed to have another surprise resulting in: (XEN) [2013-08-15 23:10:03] --- Dumping Per-dev IOMMU Interrupt Remapping Table --- (XEN) [2013-08-15 23:10:03] 0000:00:00:0: (XEN) [2013-08-15 23:10:03] Xen BUG at spinlock.c:48 (XEN) [2013-08-15 23:10:03] ----[ Xen-4.4-unstable x86_64 debug=y Not tainted ]---- (XEN) [2013-08-15 23:10:03] CPU: 0 (XEN) [2013-08-15 23:10:03] RIP: e008:[<ffff82d080126c77>] check_lock+0x37/0x43 (XEN) [2013-08-15 23:10:03] RFLAGS: 0000000000010046 CONTEXT: hypervisor (XEN) [2013-08-15 23:10:03] rax: 0000000000000000 rbx: ffff83055d700030 rcx: 0000000000000001 (XEN) [2013-08-15 23:10:03] rdx: 0000000000000000 rsi: 000000000000000a rdi: ffff83055d700034 (XEN) [2013-08-15 23:10:03] rbp: ffff82d0802cfdb0 rsp: ffff82d0802cfdb0 r8: ffff83055d670000 (XEN) [2013-08-15 23:10:03] r9: 0000000000000001 r10: 0000000000000003 r11: 0000000000000001 (XEN) [2013-08-15 23:10:03] r12: 0000000000000286 r13: ffff82d0801524bb r14: 0000000000000000 (XEN) [2013-08-15 23:10:03] r15: ffff82d080311280 cr0: 000000008005003b cr4: 00000000000006f0 (XEN) [2013-08-15 23:10:03] cr3: 000000009fc7b000 cr2: ffff8800570ac648 (XEN) [2013-08-15 23:10:03] ds: 0000 es: 0000 fs: 0000 gs: 0000 ss: e010 cs: e008 (XEN) [2013-08-15 23:10:03] Xen stack trace from rsp=ffff82d0802cfdb0: (XEN) [2013-08-15 23:10:03] ffff82d0802cfdd0 ffff82d080126d81 ffff83055d700000 ffff83055d700030 (XEN) [2013-08-15 23:10:03] ffff82d0802cfe00 ffff82d08015250d 0000000000000056 0000000000000000 (XEN) [2013-08-15 23:10:03] 0000000000000000 ffff82d0801524bb ffff82d0802cfe40 ffff82d08014ffda (XEN) [2013-08-15 23:10:03] ffff82d080311220 ffff83055d700000 ffff82d080282d70 0000000000000056 (XEN) [2013-08-15 23:10:03] 0000000000000000 ffffffffffffffff ffff82d0802cfe60 ffff82d0801528a7 (XEN) [2013-08-15 23:10:03] ffff82d0802cfe60 ffff82d080282d70 ffff82d0802cfe90 ffff82d080111c17 (XEN) [2013-08-15 23:10:03] ffff82d0802cfe90 ffff82d080282480 0000000000000000 ffff82d080311310 (XEN) [2013-08-15 23:10:03] ffff82d0802cfea0 ffff82d080111c58 ffff82d0802cfec0 ffff82d080128fd6 (XEN) [2013-08-15 23:10:03] ffff82d080126d19 ffff82d0803112f0 ffff82d0802cfef0 ffff82d08012931e (XEN) [2013-08-15 23:10:03] ffff82d0802c8000 ffff82d0802c8000 ffff82d0802c8000 ffff83009fd13000 (XEN) [2013-08-15 23:10:03] ffff82d0802cff10 ffff82d08015ce97 ffff83009fd13000 00000011d4ac53ea (XEN) [2013-08-15 23:10:03] ffff82d0802cfe10 0000000000000000 ffff88005fcf3040 ffffffff81f970c0 (XEN) [2013-08-15 23:10:03] ffffffff81edb630 ffffffff81e01e88 ffffffff81e01fd8 0000000000000246 (XEN) [2013-08-15 23:10:03] 0000000000000000 0000000000000000 0000000000000001 0000000000000000 (XEN) [2013-08-15 23:10:03] ffffffff810013aa ffffffff81e13440 00000000deadbeef 00000000deadbeef (XEN) [2013-08-15 23:10:03] 0000010000000000 ffffffff810013aa 000000000000e033 0000000000000246 (XEN) [2013-08-15 23:10:03] ffffffff81e01e70 000000000000e02b 0000000000000000 0000000000000000 (XEN) [2013-08-15 23:10:03] 0000000000000000 0000000000000000 0000000000000000 ffff83009fd13000 (XEN) [2013-08-15 23:10:03] 0000000000000000 0000000000000000 (XEN) [2013-08-15 23:10:03] Xen call trace: (XEN) [2013-08-15 23:10:03] [<ffff82d080126c77>] check_lock+0x37/0x43 (XEN) [2013-08-15 23:10:03] [<ffff82d080126d81>] _spin_lock_irqsave+0x17/0x72 (XEN) [2013-08-15 23:10:03] [<ffff82d08015250d>] dump_intremap_mapping+0x52/0x7c (XEN) [2013-08-15 23:10:03] [<ffff82d08014ffda>] iterate_ivrs_entries+0x65/0x98 (XEN) [2013-08-15 23:10:03] [<ffff82d0801528a7>] dump_intremap_tables+0x26/0x68 (XEN) [2013-08-15 23:10:03] [<ffff82d080111c17>] handle_keypress+0x70/0x9c (XEN) [2013-08-15 23:10:03] [<ffff82d080111c58>] keypress_action+0x15/0x17 (XEN) [2013-08-15 23:10:03] [<ffff82d080128fd6>] do_tasklet_work+0x8d/0xc8 (XEN) [2013-08-15 23:10:03] [<ffff82d08012931e>] do_tasklet+0x66/0x95 (XEN) [2013-08-15 23:10:03] [<ffff82d08015ce97>] idle_loop+0x60/0x6b (XEN) [2013-08-15 23:10:03] (XEN) [2013-08-15 23:10:04] (XEN) [2013-08-15 23:10:04] **************************************** (XEN) [2013-08-15 23:10:04] Panic on CPU 0: (XEN) [2013-08-15 23:10:04] Xen BUG at spinlock.c:48 (XEN) [2013-08-15 23:10:04] **************************************** (XEN) [2013-08-15 23:10:04] (XEN) [2013-08-15 23:10:04] Reboot in five seconds... _______________________________________________ Xen-devel mailing list Xen-devel@lists.xen.org http://lists.xen.org/xen-devel
Sander Eikelenboom
2013-Aug-15 23:41 UTC
Re: [xen-unstable] Commit 2ca9fbd739b8a72b16dd790d0fff7b75f5488fb8 AMD IOMMU: allocate IRTE entries instead of using a static mapping, makes dom0 boot process stall several times.
Friday, August 16, 2013, 1:22:28 AM, you wrote:> Thursday, August 15, 2013, 5:15:43 PM, you wrote:>>>>> On 15.08.13 at 16:43, Sander Eikelenboom <linux@eikelenboom.it> wrote: >>> Well apart from the dom0 boot stalls, everthing is working fine after the >>> system is booted, including the passthrough of 4 pci(e) devices. >>> From closer inspection it seems to be when enabling the sata controller and >>> the NICs during dom0 boot. >>> The question is why it stalls, and why it seems to resume when pressing any >>> key on the console.>> Once the system is up, can you check whether a sane amount of >> interrupts is arriving for SATA controller and NIC? The stalls could >> certainly be a result of there being interrupts missing the driver >> expects, potentially causing it to fall back to some polling mode.>> Jan> Hmm does seem to be a bit more random than i initially thought ... so that all seemed to be a red herring ..> Adding Andrew to CC Since i saw a thread about him working on a hpet interrupt issue ...> All this below was done running: > xen-unstable (git:ab7f9a7) > kernel: 3.9.0 (was using 3.11-rc''s before, but downgraded to rule that out)<HUGE SNIP>> So i removed cpuidle and cpufreq=xen and tried "clocksource=pit" .. and now it doesn''t stall anymore (both on boot and on reboot) ... > So it seems when using the hpet broadcast it gets stuck in an idle loop ... and hitting a key on the console gets it out ...Ok i have to revise ... *sigh* ... it gets stuck with clocksource=pit as well (although not always it seems) (XEN) [2013-08-16 00:29:03] *** Dumping CPU0 guest state (d0:v0): *** (XEN) [2013-08-16 00:29:03] ----[ Xen-4.4-unstable x86_64 debug=y Not tainted ]---- (XEN) [2013-08-16 00:29:03] CPU: 0 (XEN) [2013-08-16 00:29:03] RIP: e033:[<00007f41c6f445b0>] (XEN) [2013-08-16 00:29:03] RFLAGS: 0000000000000202 EM: 0 CONTEXT: pv guest (XEN) [2013-08-16 00:29:03] rax: 0000000000a82cf0 rbx: 000000001c2448da rcx: 000000000096a470 (XEN) [2013-08-16 00:29:03] rdx: 0000000000968570 rsi: 000000001c2448da rdi: 000000001c23f000 (XEN) [2013-08-16 00:29:03] rbp: 0000000000000001 rsp: 00007fff7c9b0b78 r8: 000000000000005f (XEN) [2013-08-16 00:29:03] r9: 0000000000000010 r10: 00007fff7c9ad920 r11: 0000000000000000 (XEN) [2013-08-16 00:29:03] r12: 000000001d1bcfd7 r13: 00000000009023d0 r14: 0000000000000001 (XEN) [2013-08-16 00:29:03] r15: 0000000000902000 cr0: 0000000080050033 cr4: 00000000000006f0 (XEN) [2013-08-16 00:29:03] cr3: 0000000544d01000 cr2: 000000000041b2f0 (XEN) [2013-08-16 00:29:03] ds: 0000 es: 0000 fs: 0000 gs: 0000 ss: e02b cs: e033 (XEN) [2013-08-16 00:29:03] Guest stack trace from rsp=00007fff7c9b0b78: (XEN) [2013-08-16 00:29:03] 000000000041b8ec 0000000000901e90 00007f4100000005 00007fff7c9b0ae0 (XEN) [2013-08-16 00:29:03] 0000000000003848 00000000000048da 0000000000000000 0000000000a8ed50 (XEN) [2013-08-16 00:29:03] 0000000000000000 0000000000000000 000000000040caa2 0000000000000000 (XEN) [2013-08-16 00:29:03] 0000000000000010 00000000009023d0 0000000000003a38 0000000000000000 (XEN) [2013-08-16 00:29:03] 0000000007470000 00000000520d6412 00000000000f3991 000000000000002c (XEN) [2013-08-16 00:29:03] 00000000000ae270 0000000000000000 00000000000d878a 0000000000a73000 (XEN) [2013-08-16 00:29:03] 0000000002e30800 0000000000001000 0000000000000000 0000000000000000 (XEN) [2013-08-16 00:29:03] 0000000000000000 0000000000000000 0000000000000000 0000000000000000 (XEN) [2013-08-16 00:29:03] 0000000000000000 0000000000000000 ffffffffffffffff 00000000ffffffff (XEN) [2013-08-16 00:29:03] 0000000000000000 0000000000000000 0000000000000000 0000000000000000 (XEN) [2013-08-16 00:29:04] 0000000000000000 0000000000000000 0000000000000000 0000000000000000 (XEN) [2013-08-16 00:29:04] ffffffffffffffff ffffffffffffffff ffffffffffffffff 00000000ffffffff (XEN) [2013-08-16 00:29:04] 0000000000000000 0000000000000000 0000000000000000 0000000000000000 (XEN) [2013-08-16 00:29:04] 000000000095af68 0000000018182fe1 0000000000000000 0000000000000002 (XEN) [2013-08-16 00:29:04] 0000000000003030 0000000000000000 00000000000009c8 0000000000000000 (XEN) [2013-08-16 00:29:04] 0000061b0000061c 0000000000902000 0000000000000000 00007fff7c9b0d10 (XEN) [2013-08-16 00:29:04] 000000000041ae10 0000000000638a08 0000000000000000 0000000000000000 (XEN) [2013-08-16 00:29:04] 0000000000902000 0000000000134001 000000000040e8f7 0000000000000000 (XEN) [2013-08-16 00:29:04] 0000000000902000 0000000000904230 0000000000000080 000000000042c818 (XEN) [2013-08-16 00:29:04] 000000000040ac0c 00007f41c737fba0 0000000000000009 000000000134bd5d (XEN) [2013-08-16 00:29:04] (XEN) [2013-08-16 00:29:04] *** Dumping CPU1 host state: *** (XEN) [2013-08-16 00:29:04] ----[ Xen-4.4-unstable x86_64 debug=y Not tainted ]---- (XEN) [2013-08-16 00:29:04] CPU: 1 (XEN) [2013-08-16 00:29:04] RIP: e008:[<ffff82d0801863c4>] pit_broadcast_exit+0/0x5d (XEN) [2013-08-16 00:29:04] RFLAGS: 0000000000000246 CONTEXT: hypervisor (XEN) [2013-08-16 00:29:04] rax: 0000000000000000 rbx: ffff83055d73a6c0 rcx: 20c49ba5e353f7cf (XEN) [2013-08-16 00:29:04] rdx: ffff83055d6db020 rsi: 0000037a68fc64d0 rdi: ffff83055d73a6e8 (XEN) [2013-08-16 00:29:04] rbp: ffff83055d6d7ef0 rsp: ffff83055d6d7e88 r8: 0000037a2ffe5b1d (XEN) [2013-08-16 00:29:04] r9: ffff83009fd17060 r10: 00000000deadbeef r11: 0000000000000246 (XEN) [2013-08-16 00:29:04] r12: ffff83055d73a730 r13: 0000037a687db225 r14: 0000037a68fc64d0 (XEN) [2013-08-16 00:29:04] r15: ffff83055d6db080 cr0: 000000008005003b cr4: 00000000000006f0 (XEN) [2013-08-16 00:29:04] cr3: 0000000542d2a000 cr2: ffffffffff600400 (XEN) [2013-08-16 00:29:04] ds: 002b es: 002b fs: 0000 gs: 0000 ss: e010 cs: e008 (XEN) [2013-08-16 00:29:04] Xen stack trace from rsp=ffff83055d6d7e88: (XEN) [2013-08-16 00:29:04] ffff82d0801a3f02 ffff82d0802e8000 ffff83055d6d0000 ffffffffffffffff (XEN) [2013-08-16 00:29:04] ffff83055d6db080 ffff83055d6d7ee0 0000000000000000 0000000000000000 (XEN) [2013-08-16 00:29:04] 000017c900002c46 ffff83055d6d0000 ffff83055d6d0000 00000000ffffffff (XEN) [2013-08-16 00:29:04] 0000000000000002 ffff83055d6d7f10 ffff82d08015ce92 ffff83009fafe000 (XEN) [2013-08-16 00:29:04] ffff83009fd17000 ffff83055d6d7dd8 0000000000000000 0000000000000000 (XEN) [2013-08-16 00:29:04] 0000000000000000 ffffffff81edb630 ffff880059bd5f10 ffff880059bd5fd8 (XEN) [2013-08-16 00:29:04] 0000000000000246 0000000000000000 0000000000000000 0000000000000001 (XEN) [2013-08-16 00:29:04] 0000000000000000 ffffffff810013aa ffff880059bd8000 00000000deadbeef (XEN) [2013-08-16 00:29:04] 00000000deadbeef 0000010000000000 ffffffff810013aa 000000000000e033 (XEN) [2013-08-16 00:29:04] 0000000000000246 ffff880059bd5ef8 000000000000e02b 64657a696c616974 (XEN) [2013-08-16 00:29:04] 312020205b0a0d0d 3332373831342e35 6f7465756c42205d 4943482000000001 (XEN) [2013-08-16 00:29:04] ffff83009fafe000 00000034dd3c9e00 7270202935482820 (XEN) [2013-08-16 00:29:04] Xen call trace: (XEN) [2013-08-16 00:29:04] [<ffff82d0801863c4>] pit_broadcast_exit+0/0x5d (XEN) [2013-08-16 00:29:04] [<ffff82d08015ce92>] idle_loop+0x5b/0x6b (XEN) [2013-08-16 00:29:04] (XEN) [2013-08-16 00:29:04] *** Dumping CPU2 host state: *** (XEN) [2013-08-16 00:29:04] ----[ Xen-4.4-unstable x86_64 debug=y Not tainted ]---- (XEN) [2013-08-16 00:29:04] CPU: 2 (XEN) [2013-08-16 00:29:05] RIP: e008:[<ffff82d0801863c4>] pit_broadcast_exit+0/0x5d (XEN) [2013-08-16 00:29:05] RFLAGS: 0000000000000246 CONTEXT: hypervisor (XEN) [2013-08-16 00:29:05] rax: 0000000000000000 rbx: ffff83055d73ab60 rcx: 20c49ba5e353f7cf (XEN) [2013-08-16 00:29:05] rdx: ffff83055d66c020 rsi: 0000037a914aa033 rdi: ffff83055d73ab88 (XEN) [2013-08-16 00:29:05] rbp: ffff83055d667ef0 rsp: ffff83055d667e88 r8: 0000037a2ffe5b1d (XEN) [2013-08-16 00:29:05] r9: ffff83009fd16060 r10: 00000000deadbeef r11: 0000000000000246 (XEN) [2013-08-16 00:29:05] r12: ffff83055d73abd0 r13: 0000037a90e6eee1 r14: 0000037a914aa033 (XEN) [2013-08-16 00:29:05] r15: ffff83055d66c080 cr0: 000000008005003b cr4: 00000000000006f0 (XEN) [2013-08-16 00:29:05] cr3: 000000054391f000 cr2: ffff880057020680 (XEN) [2013-08-16 00:29:05] ds: 002b es: 002b fs: 0000 gs: 0000 ss: e010 cs: e008 (XEN) [2013-08-16 00:29:05] Xen stack trace from rsp=ffff83055d667e88: (XEN) [2013-08-16 00:29:05] ffff82d0801a3f02 ffff82d0802e8000 ffff83055d660000 ffffffffffffffff (XEN) [2013-08-16 00:29:05] ffff83055d66c080 ffff83055d667ee0 0000000000000000 0000000000000000 (XEN) [2013-08-16 00:29:05] 00001bee00001acc ffff83055d660000 ffff83055d660000 00000000ffffffff (XEN) [2013-08-16 00:29:05] 0000000000000002 ffff83055d667f10 ffff82d08015ce92 ffff83009fafd000 (XEN) [2013-08-16 00:29:05] ffff83009fd16000 ffff83055d667dd8 0000000000000000 0000000000000000 (XEN) [2013-08-16 00:29:05] 0000000000000000 ffffffff81edb630 ffff880059bd7f10 ffff880059bd7fd8 (XEN) [2013-08-16 00:29:05] 0000000000000246 0000000000000000 0000000000000000 0000000000000001 (XEN) [2013-08-16 00:29:05] 0000000000000000 ffffffff810013aa ffff880059bd9070 00000000deadbeef (XEN) [2013-08-16 00:29:05] 00000000deadbeef 0000010000000000 ffffffff810013aa 000000000000e033 (XEN) [2013-08-16 00:29:05] 0000000000000246 ffff880059bd7ef8 000000000000e02b 0000000000000000 (XEN) [2013-08-16 00:29:05] 0000000000000000 0000000000000000 0000000000000000 0000000000000002 (XEN) [2013-08-16 00:29:05] ffff83009fafd000 00000034dd35ae00 0000000000000000 (XEN) [2013-08-16 00:29:05] Xen call trace: (XEN) [2013-08-16 00:29:05] [<ffff82d0801863c4>] pit_broadcast_exit+0/0x5d (XEN) [2013-08-16 00:29:05] [<ffff82d08015ce92>] idle_loop+0x5b/0x6b (XEN) [2013-08-16 00:29:05] (XEN) [2013-08-16 00:29:05] *** Dumping CPU3 host state: *** (XEN) [2013-08-16 00:29:05] ----[ Xen-4.4-unstable x86_64 debug=y Not tainted ]---- (XEN) [2013-08-16 00:29:05] CPU: 3 (XEN) [2013-08-16 00:29:05] RIP: e008:[<ffff82d0801863c4>] pit_broadcast_exit+0/0x5d (XEN) [2013-08-16 00:29:05] RFLAGS: 0000000000000246 CONTEXT: hypervisor (XEN) [2013-08-16 00:29:05] rax: 0000000000000000 rbx: ffff83055d658010 rcx: 20c49ba5e353f7cf (XEN) [2013-08-16 00:29:05] rdx: ffff83055d65e020 rsi: 0000037ab99907fb rdi: ffff83055d658038 (XEN) [2013-08-16 00:29:05] rbp: ffff83055d657ef0 rsp: ffff83055d657e88 r8: 0000037a2ffe5b1d (XEN) [2013-08-16 00:29:05] r9: ffff83009fd15060 r10: 00000000deadbeef r11: 0000000000000246 (XEN) [2013-08-16 00:29:05] r12: ffff83055d658080 r13: 0000037ab96eedc2 r14: 0000037ab99907fb (XEN) [2013-08-16 00:29:05] r15: ffff83055d65e080 cr0: 000000008005003b cr4: 00000000000006f0 (XEN) [2013-08-16 00:29:05] cr3: 000000054561b000 cr2: ffff88004bdb22a8 (XEN) [2013-08-16 00:29:05] ds: 002b es: 002b fs: 0000 gs: 0000 ss: e010 cs: e008 (XEN) [2013-08-16 00:29:05] Xen stack trace from rsp=ffff83055d657e88: (XEN) [2013-08-16 00:29:05] ffff82d0801a3f02 ffff82d0802e8000 ffff83055d650000 ffffffffffffffff (XEN) [2013-08-16 00:29:05] ffff83055d65e080 ffff83055d657ee0 0000000000000000 0000000000000000 (XEN) [2013-08-16 00:29:05] 00001fa800002642 ffff83055d650000 ffff83055d650000 00000000ffffffff (XEN) [2013-08-16 00:29:06] 0000000000000002 ffff83055d657f10 ffff82d08015ce92 ffff83009fafc000 (XEN) [2013-08-16 00:29:06] ffff83009fd15000 ffff83055d657dd8 0000000000000000 0000000000000000 (XEN) [2013-08-16 00:29:06] 0000000000000000 ffffffff81edb630 ffff880059be9f10 ffff880059be9fd8 (XEN) [2013-08-16 00:29:06] 0000000000000246 0000000000000000 0000000000000000 0000000000000001 (XEN) [2013-08-16 00:29:06] 0000000000000000 ffffffff810013aa ffff880059bda0e0 00000000deadbeef (XEN) [2013-08-16 00:29:06] 00000000deadbeef 0000010000000000 ffffffff810013aa 000000000000e033 (XEN) [2013-08-16 00:29:06] 0000000000000246 ffff880059be9ef8 000000000000e02b 0000000000000000 (XEN) [2013-08-16 00:29:06] 0000000000000000 0000000000000000 0000000000000000 0000000000000003 (XEN) [2013-08-16 00:29:06] ffff83009fafc000 00000034dd34ce00 0000000000000000 (XEN) [2013-08-16 00:29:06] Xen call trace: (XEN) [2013-08-16 00:29:06] [<ffff82d0801863c4>] pit_broadcast_exit+0/0x5d (XEN) [2013-08-16 00:29:06] [<ffff82d08015ce92>] idle_loop+0x5b/0x6b (XEN) [2013-08-16 00:29:06] (XEN) [2013-08-16 00:29:06] *** Dumping CPU4 host state: *** (XEN) [2013-08-16 00:29:06] ----[ Xen-4.4-unstable x86_64 debug=y Not tainted ]---- (XEN) [2013-08-16 00:29:06] CPU: 4 (XEN) [2013-08-16 00:29:06] RIP: e008:[<ffff82d0801863c4>] pit_broadcast_exit+0/0x5d (XEN) [2013-08-16 00:29:06] RFLAGS: 0000000000000246 CONTEXT: hypervisor (XEN) [2013-08-16 00:29:06] rax: 0000000000000000 rbx: ffff83055d6584b0 rcx: 20c49ba5e353f7cf (XEN) [2013-08-16 00:29:06] rdx: ffff83055d64f020 rsi: 0000037ae1e76b34 rdi: ffff83055d6584d8 (XEN) [2013-08-16 00:29:06] rbp: ffff83055d647ef0 rsp: ffff83055d647e88 r8: 0000037a2ffe5b1d (XEN) [2013-08-16 00:29:06] r9: ffff83009fd14060 r10: 00000000deadbeef r11: 0000000000000246 (XEN) [2013-08-16 00:29:06] r12: ffff83055d658520 r13: 0000037ae1cd132b r14: 0000037ae1e76b34 (XEN) [2013-08-16 00:29:06] r15: ffff83055d64f080 cr0: 000000008005003b cr4: 00000000000006f0 (XEN) [2013-08-16 00:29:06] cr3: 0000000549e0c000 cr2: 00007f325c7b0f30 (XEN) [2013-08-16 00:29:06] ds: 002b es: 002b fs: 0000 gs: 0000 ss: e010 cs: e008 (XEN) [2013-08-16 00:29:06] Xen stack trace from rsp=ffff83055d647e88: (XEN) [2013-08-16 00:29:06] ffff82d0801a3f02 ffff82d080225a00 0000037ae263aaa7 ffff82d0802e8200 (XEN) [2013-08-16 00:29:06] ffff82d0802e8000 ffff83055d640000 0000000000000000 0000000000000000 (XEN) [2013-08-16 00:29:06] 0000034b000002da ffff83055d640000 ffff83055d640000 00000000ffffffff (XEN) [2013-08-16 00:29:06] 0000000000000002 ffff83055d647f10 ffff82d08015ce92 ffff83009ff8b000 (XEN) [2013-08-16 00:29:06] ffff83009fd14000 ffff83055d647dd8 0000000000000000 0000000000000000 (XEN) [2013-08-16 00:29:06] 0000000000000000 ffffffff81edb630 ffff880059bebf10 ffff880059bebfd8 (XEN) [2013-08-16 00:29:06] 0000000000000246 0000000000000000 0000000000000000 0000000000000001 (XEN) [2013-08-16 00:29:06] 0000000000000000 ffffffff810013aa ffff880059bdb150 00000000deadbeef (XEN) [2013-08-16 00:29:06] 00000000deadbeef 0000010000000000 ffffffff810013aa 000000000000e033 (XEN) [2013-08-16 00:29:06] 0000000000000246 ffff880059bebef8 000000000000e02b 8010000537152067 (XEN) [2013-08-16 00:29:06] 8010000537151067 8010000537150067 801000053714f067 8010000500000004 (XEN) [2013-08-16 00:29:06] ffff83009ff8b000 00000034dd33de00 801000053714b067 (XEN) [2013-08-16 00:29:06] Xen call trace: (XEN) [2013-08-16 00:29:06] [<ffff82d0801863c4>] pit_broadcast_exit+0/0x5d (XEN) [2013-08-16 00:29:06] [<ffff82d08015ce92>] idle_loop+0x5b/0x6b (XEN) [2013-08-16 00:29:06] (XEN) [2013-08-16 00:29:06] *** Dumping CPU5 host state: *** (XEN) [2013-08-16 00:29:07] ----[ Xen-4.4-unstable x86_64 debug=y Not tainted ]---- (XEN) [2013-08-16 00:29:07] CPU: 5 (XEN) [2013-08-16 00:29:07] RIP: e008:[<ffff82d0801863c4>] pit_broadcast_exit+0/0x5d (XEN) [2013-08-16 00:29:07] RFLAGS: 0000000000000246 CONTEXT: hypervisor (XEN) [2013-08-16 00:29:07] rax: 0000000000000000 rbx: ffff83055d658950 rcx: 20c49ba5e353f7cf (XEN) [2013-08-16 00:29:07] rdx: ffff83055d649020 rsi: 0000037b0a35bd37 rdi: ffff83055d658978 (XEN) [2013-08-16 00:29:07] rbp: ffff83055d63fef0 rsp: ffff83055d63fe88 r8: 0000037a2ffe5b1d (XEN) [2013-08-16 00:29:07] r9: ffff83009fafb060 r10: 00000000deadbeef r11: 0000000000000246 (XEN) [2013-08-16 00:29:07] r12: ffff83055d6589c0 r13: 0000037b0a245bd4 r14: 0000037b0a35bd37 (XEN) [2013-08-16 00:29:07] r15: ffff83055d649080 cr0: 000000008005003b cr4: 00000000000006f0 (XEN) [2013-08-16 00:29:07] cr3: 000000054590c000 cr2: ffff8800585e34f8 (XEN) [2013-08-16 00:29:07] ds: 002b es: 002b fs: 0000 gs: 0000 ss: e010 cs: e008 (XEN) [2013-08-16 00:29:07] Xen stack trace from rsp=ffff83055d63fe88: (XEN) [2013-08-16 00:29:07] ffff82d0801a3f02 ffff82d080225a00 0000037b0ab91149 ffff82d0802e8280 (XEN) [2013-08-16 00:29:07] ffff82d0802e8000 ffff83055d638000 0000000000000000 0000000000000000 (XEN) [2013-08-16 00:29:07] 00000fc20000129b ffff83055d638000 ffff83055d638000 00000000ffffffff (XEN) [2013-08-16 00:29:07] 0000000000000002 ffff83055d63ff10 ffff82d08015ce92 ffff83009ff8a000 (XEN) [2013-08-16 00:29:07] ffff83009fafb000 ffff83055d63fdd8 0000000000000000 0000000000000000 (XEN) [2013-08-16 00:29:07] 0000000000000000 ffffffff81edb630 ffff880059bedf10 ffff880059bedfd8 (XEN) [2013-08-16 00:29:07] 0000000000000246 0000000000000000 0000000000000000 0000000000000001 (XEN) [2013-08-16 00:29:07] 0000000000000000 ffffffff810013aa ffff880059bdc1c0 00000000deadbeef (XEN) [2013-08-16 00:29:07] 00000000deadbeef 0000010000000000 ffffffff810013aa 000000000000e033 (XEN) [2013-08-16 00:29:07] 0000000000000246 ffff880059bedef8 000000000000e02b 0000000000000000 (XEN) [2013-08-16 00:29:07] 0000000000000000 0000000000000000 0000000000000000 0000000000000005 (XEN) [2013-08-16 00:29:07] ffff83009ff8a000 00000034dd337e00 0000000000000000 (XEN) [2013-08-16 00:29:07] Xen call trace: (XEN) [2013-08-16 00:29:07] [<ffff82d0801863c4>] pit_broadcast_exit+0/0x5d (XEN) [2013-08-16 00:29:07] [<ffff82d08015ce92>] idle_loop+0x5b/0x6b (XEN) [2013-08-16 00:29:07]
Jan Beulich
2013-Aug-16 07:21 UTC
Re: [xen-unstable] Commit 2ca9fbd739b8a72b16dd790d0fff7b75f5488fb8 AMD IOMMU: allocate IRTE entries instead of using a static mapping, makes dom0 boot process stall several times.
>>> On 16.08.13 at 01:41, Sander Eikelenboom <linux@eikelenboom.it> wrote: > Ok i have to revise ... *sigh* ... it gets stuck with clocksource=pit as > well (although not always it seems)Not that surprising. Doing it the other way round (suppressing use of cpuidle and cpufreq - first together, then separately - would seem like the more promising route with the information you gathered, with cpuidle being the more likely of the two. Jan
Sander Eikelenboom
2013-Aug-16 07:42 UTC
Re: [xen-unstable] Commit 2ca9fbd739b8a72b16dd790d0fff7b75f5488fb8 AMD IOMMU: allocate IRTE entries instead of using a static mapping, makes dom0 boot process stall several times.
Friday, August 16, 2013, 9:21:01 AM, you wrote:>>>> On 16.08.13 at 01:41, Sander Eikelenboom <linux@eikelenboom.it> wrote: >> Ok i have to revise ... *sigh* ... it gets stuck with clocksource=pit as >> well (although not always it seems)> Not that surprising. Doing it the other way round (suppressing > use of cpuidle and cpufreq - first together, then separately - > would seem like the more promising route with the information > you gathered, with cpuidle being the more likely of the two.Well not specifying "cpuidle" and "cpufreq=xen" on the xen boot line in grub, should not enable them for the clocksource=pit case right ? I did exactly that on this boot. (from http://wiki.xen.org/wiki/Xen_power_management#PIT_as_broadcast_timer_source_.28clocksource.29 i read: Currently, by default cpuidle will be selectively disabled while HPET is not available. So for system only with PIT, the cpuidle is still disabled by default. If user really wants cpuidle feature with PIT as broadcast source, please specify ''cpuidle'' grub option. ) -- Sander> Jan
Jan Beulich
2013-Aug-16 08:03 UTC
Re: [xen-unstable] Commit 2ca9fbd739b8a72b16dd790d0fff7b75f5488fb8 AMD IOMMU: allocate IRTE entries instead of using a static mapping, makes dom0 boot process stall several times.
>>> On 16.08.13 at 09:42, Sander Eikelenboom <linux@eikelenboom.it> wrote:> Friday, August 16, 2013, 9:21:01 AM, you wrote: > >>>>> On 16.08.13 at 01:41, Sander Eikelenboom <linux@eikelenboom.it> wrote: >>> Ok i have to revise ... *sigh* ... it gets stuck with clocksource=pit as >>> well (although not always it seems) > >> Not that surprising. Doing it the other way round (suppressing >> use of cpuidle and cpufreq - first together, then separately - >> would seem like the more promising route with the information >> you gathered, with cpuidle being the more likely of the two. > > Well not specifying "cpuidle" and "cpufreq=xen" on the xen boot line in > grub, should not enable them for the clocksource=pit case right ? > I did exactly that on this boot.Depends on which cpuidle driver the system is using - at least in the mwait_idle case, omitting "cpuidle" doesn''t help; you''d need to explicitly say "no-cpuidle" (or equivalent). Jan
Sander Eikelenboom
2013-Aug-16 08:40 UTC
Re: [xen-unstable] Commit 2ca9fbd739b8a72b16dd790d0fff7b75f5488fb8 AMD IOMMU: allocate IRTE entries instead of using a static mapping, makes dom0 boot process stall several times.
Friday, August 16, 2013, 10:03:31 AM, you wrote:>>>> On 16.08.13 at 09:42, Sander Eikelenboom <linux@eikelenboom.it> wrote:>> Friday, August 16, 2013, 9:21:01 AM, you wrote: >> >>>>>> On 16.08.13 at 01:41, Sander Eikelenboom <linux@eikelenboom.it> wrote: >>>> Ok i have to revise ... *sigh* ... it gets stuck with clocksource=pit as >>>> well (although not always it seems) >> >>> Not that surprising. Doing it the other way round (suppressing >>> use of cpuidle and cpufreq - first together, then separately - >>> would seem like the more promising route with the information >>> you gathered, with cpuidle being the more likely of the two. >> >> Well not specifying "cpuidle" and "cpufreq=xen" on the xen boot line in >> grub, should not enable them for the clocksource=pit case right ? >> I did exactly that on this boot.> Depends on which cpuidle driver the system is using - at least in > the mwait_idle case, omitting "cpuidle" doesn''t help; you''d need > to explicitly say "no-cpuidle" (or equivalent).Hmm only the "no-cpuidle" is needed (cpufreq=xen can stay) to make the stalls disappear, but makes me wonder how that is related to the commit the bisection found .. machine has been running with cpuidle enabled for ages ..> Jan
Jan Beulich
2013-Aug-16 09:18 UTC
Re: [xen-unstable] Commit 2ca9fbd739b8a72b16dd790d0fff7b75f5488fb8 AMD IOMMU: allocate IRTE entries instead of using a static mapping, makes dom0 boot process stall several times.
>>> On 16.08.13 at 10:40, Sander Eikelenboom <linux@eikelenboom.it> wrote: > Hmm only the "no-cpuidle" is needed (cpufreq=xen can stay) to make the stalls > disappear, > but makes me wonder how that is related to the commit the bisection found .. > machine has been running with cpuidle enabled for ages ..That''s odd indeed. If you''re up to do a little bit of debugging here, why don''t you log the sequence of interrupts arriving both with and without said commit. This might end up being a lot of data, so you may want to filter out uninteresting stuff and/or log only to a memory buffer which then gets dumped upon some debug key press. Similarly, checking whether the issue is reproducible with Xen running on only a single pCPU might help reducing the amount of data, or at least the time needed to analyze it. Jan
Sander Eikelenboom
2013-Aug-16 10:44 UTC
Re: [xen-unstable] Commit 2ca9fbd739b8a72b16dd790d0fff7b75f5488fb8 AMD IOMMU: allocate IRTE entries instead of using a static mapping, makes dom0 boot process stall several times.
Friday, August 16, 2013, 11:18:56 AM, you wrote:>>>> On 16.08.13 at 10:40, Sander Eikelenboom <linux@eikelenboom.it> wrote: >> Hmm only the "no-cpuidle" is needed (cpufreq=xen can stay) to make the stalls >> disappear, >> but makes me wonder how that is related to the commit the bisection found .. >> machine has been running with cpuidle enabled for ages ..> That''s odd indeed. If you''re up to do a little bit of debugging here, > why don''t you log the sequence of interrupts arriving both with > and without said commit. This might end up being a lot of data, so > you may want to filter out uninteresting stuff and/or log only to > a memory buffer which then gets dumped upon some debug key > press.Hmm making said debug patch is getting probably a bit out of my league .. since the generated interrupts will probably outpace flushing to the console. And i''m not sure in what things you are actually interested around the irq flow (probably the hpet msi ones ?).> Similarly, checking whether the issue is reproducible with > Xen running on only a single pCPU might help reducing the amount > of data, or at least the time needed to analyze it.Nope unfortunately it doesn''t seem to be reproducible with "nosmp". Also tried some other options (with cpuidle enabled) and to see if that could narrow it down more: - limiting the max_cstate to 2 instead of the possible 3 states .. but still stalls - using "tickle_one_idle_cpu".. but still stalls> Jan
Jan Beulich
2013-Aug-16 13:15 UTC
Re: [xen-unstable] Commit 2ca9fbd739b8a72b16dd790d0fff7b75f5488fb8 AMD IOMMU: allocate IRTE entries instead of using a static mapping, makes dom0 boot process stall several times.
>>> On 16.08.13 at 12:44, Sander Eikelenboom <linux@eikelenboom.it> wrote: > Friday, August 16, 2013, 11:18:56 AM, you wrote: >>>>> On 16.08.13 at 10:40, Sander Eikelenboom <linux@eikelenboom.it> wrote: >>> Hmm only the "no-cpuidle" is needed (cpufreq=xen can stay) to make the stalls >>> disappear, >>> but makes me wonder how that is related to the commit the bisection found .. >>> machine has been running with cpuidle enabled for ages .. > >> That''s odd indeed. If you''re up to do a little bit of debugging here, >> why don''t you log the sequence of interrupts arriving both with >> and without said commit. This might end up being a lot of data, so >> you may want to filter out uninteresting stuff and/or log only to >> a memory buffer which then gets dumped upon some debug key >> press. > > Hmm making said debug patch is getting probably a bit out of my league .. > since the generated interrupts will probably outpace flushing to the > console. > > And i''m not sure in what things you are actually interested around the irq > flow (probably the hpet msi ones ?).No, much more the ones from the devices that you say the drivers of which cause the stalls while initializing. The question mainly is whether the distribution of interrupts between CPUs changed in a way that made the system more susceptible to missing wakeups via HPET MSIs. Along that lines was also the question regarding interrupt counts for the devices in question, which if I''m not mistaken you didn''t answer yet. Jan
Sander Eikelenboom
2013-Aug-16 13:22 UTC
Re: [xen-unstable] Commit 2ca9fbd739b8a72b16dd790d0fff7b75f5488fb8 AMD IOMMU: allocate IRTE entries instead of using a static mapping, makes dom0 boot process stall several times.
Friday, August 16, 2013, 3:15:50 PM, you wrote:>>>> On 16.08.13 at 12:44, Sander Eikelenboom <linux@eikelenboom.it> wrote: >> Friday, August 16, 2013, 11:18:56 AM, you wrote: >>>>>> On 16.08.13 at 10:40, Sander Eikelenboom <linux@eikelenboom.it> wrote: >>>> Hmm only the "no-cpuidle" is needed (cpufreq=xen can stay) to make the stalls >>>> disappear, >>>> but makes me wonder how that is related to the commit the bisection found .. >>>> machine has been running with cpuidle enabled for ages .. >> >>> That''s odd indeed. If you''re up to do a little bit of debugging here, >>> why don''t you log the sequence of interrupts arriving both with >>> and without said commit. This might end up being a lot of data, so >>> you may want to filter out uninteresting stuff and/or log only to >>> a memory buffer which then gets dumped upon some debug key >>> press. >> >> Hmm making said debug patch is getting probably a bit out of my league .. >> since the generated interrupts will probably outpace flushing to the >> console. >> >> And i''m not sure in what things you are actually interested around the irq >> flow (probably the hpet msi ones ?).> No, much more the ones from the devices that you say the drivers > of which cause the stalls while initializing. The question mainly is > whether the distribution of interrupts between CPUs changed in a > way that made the system more susceptible to missing wakeups > via HPET MSIs.Hmm ah it doesn''t seem to be completly related to that i guess, it seem to happen most often around that and udevd starting. When stalling on reboot it seems to be just before disabling bus mastering on devices. But just how exact that is ..> Along that lines was also the question regarding interrupt counts > for the devices in question, which if I''m not mistaken you didn''t > answer yet.Ah nope, was on the other trail. Will do a compare of /proc/interrupts for: - xen-unstable-tip with cpuidle - xen-unstable-tip without cpuidle - xen-unstable just before bisected commit> Jan
Sander Eikelenboom
2013-Aug-16 14:43 UTC
Re: [xen-unstable] Commit 2ca9fbd739b8a72b16dd790d0fff7b75f5488fb8 AMD IOMMU: allocate IRTE entries instead of using a static mapping, makes dom0 boot process stall several times.
Friday, August 16, 2013, 3:15:50 PM, you wrote:>>>> On 16.08.13 at 12:44, Sander Eikelenboom <linux@eikelenboom.it> wrote: >> Friday, August 16, 2013, 11:18:56 AM, you wrote: >>>>>> On 16.08.13 at 10:40, Sander Eikelenboom <linux@eikelenboom.it> wrote: >>>> Hmm only the "no-cpuidle" is needed (cpufreq=xen can stay) to make the stalls >>>> disappear, >>>> but makes me wonder how that is related to the commit the bisection found .. >>>> machine has been running with cpuidle enabled for ages .. >> >>> That''s odd indeed. If you''re up to do a little bit of debugging here, >>> why don''t you log the sequence of interrupts arriving both with >>> and without said commit. This might end up being a lot of data, so >>> you may want to filter out uninteresting stuff and/or log only to >>> a memory buffer which then gets dumped upon some debug key >>> press. >> >> Hmm making said debug patch is getting probably a bit out of my league .. >> since the generated interrupts will probably outpace flushing to the >> console. >> >> And i''m not sure in what things you are actually interested around the irq >> flow (probably the hpet msi ones ?).> No, much more the ones from the devices that you say the drivers > of which cause the stalls while initializing. The question mainly is > whether the distribution of interrupts between CPUs changed in a > way that made the system more susceptible to missing wakeups > via HPET MSIs.> Along that lines was also the question regarding interrupt counts > for the devices in question, which if I''m not mistaken you didn''t > answer yet.I don''t see any shocking differences, /proc/interrupts attached.> Jan_______________________________________________ Xen-devel mailing list Xen-devel@lists.xen.org http://lists.xen.org/xen-devel
Sander Eikelenboom
2013-Aug-16 15:51 UTC
Re: [xen-unstable] Commit 2ca9fbd739b8a72b16dd790d0fff7b75f5488fb8 AMD IOMMU: allocate IRTE entries instead of using a static mapping, makes dom0 boot process stall several times.
Friday, August 16, 2013, 3:15:50 PM, you wrote:>>>> On 16.08.13 at 12:44, Sander Eikelenboom <linux@eikelenboom.it> wrote: >> Friday, August 16, 2013, 11:18:56 AM, you wrote: >>>>>> On 16.08.13 at 10:40, Sander Eikelenboom <linux@eikelenboom.it> wrote: >>>> Hmm only the "no-cpuidle" is needed (cpufreq=xen can stay) to make the stalls >>>> disappear, >>>> but makes me wonder how that is related to the commit the bisection found .. >>>> machine has been running with cpuidle enabled for ages .. >> >>> That''s odd indeed. If you''re up to do a little bit of debugging here, >>> why don''t you log the sequence of interrupts arriving both with >>> and without said commit. This might end up being a lot of data, so >>> you may want to filter out uninteresting stuff and/or log only to >>> a memory buffer which then gets dumped upon some debug key >>> press. >> >> Hmm making said debug patch is getting probably a bit out of my league .. >> since the generated interrupts will probably outpace flushing to the >> console. >> >> And i''m not sure in what things you are actually interested around the irq >> flow (probably the hpet msi ones ?).> No, much more the ones from the devices that you say the drivers > of which cause the stalls while initializing. The question mainly is > whether the distribution of interrupts between CPUs changed in a > way that made the system more susceptible to missing wakeups > via HPET MSIs.> Along that lines was also the question regarding interrupt counts > for the devices in question, which if I''m not mistaken you didn''t > answer yet.Have done a diff from the output of the msi, interrupts and ioapic debug keys. Maybe you can spot a key difference with your trained eyes :-) good = xen-unstable from just before the bisected commit tip = latest xen-unstable --- good-msi.txt 2013-08-16 17:39:25.000000000 +0200 +++ tip-msi.txt 2013-08-16 17:39:13.000000000 +0200 @@ -3 +3 @@ - HPET 57 vec=a0 lowest edge assert log lowest dest=00000004 mask=1/0/? + HPET 57 vec=a0 lowest edge assert log lowest dest=00000020 mask=1/0/? @@ -5 +5 @@ - HPET 59 vec=b0 lowest edge assert log lowest dest=00000020 mask=1/0/? + HPET 59 vec=b0 lowest edge assert log lowest dest=00000002 mask=1/0/? --- good-interrupt.txt 2013-08-16 17:40:57.000000000 +0200 +++ tip-interrupt.txt 2013-08-16 17:39:44.000000000 +0200 @@ -3 +3 @@ - IRQ: 1 affinity:01 vec:30 type=IO-APIC-edge status=00000034 in-flight=0 domain-list=0: 1(----), + IRQ: 1 affinity:01 vec:30 type=IO-APIC-edge status=00000030 in-flight=0 domain-list=0: 1(----), @@ -8 +8 @@ - IRQ: 7 affinity:01 vec:50 type=IO-APIC-edge status=00000002 mapped, unbound + IRQ: 7 affinity:01 vec:50 type=IO-APIC-edge status=00000006 mapped, unbound @@ -38 +38 @@ - IRQ: 57 affinity:04 vec:a0 type=HPET-MSI status=00000000 hpet_interrupt_handler+0/0x40 + IRQ: 57 affinity:20 vec:a0 type=HPET-MSI status=00000000 hpet_interrupt_handler+0/0x40 @@ -40 +40 @@ - IRQ: 59 affinity:20 vec:b0 type=HPET-MSI status=00000000 hpet_interrupt_handler+0/0x40 + IRQ: 59 affinity:02 vec:b0 type=HPET-MSI status=00000000 hpet_interrupt_handler+0/0x40 @@ -51,10 +51,10 @@ - IRQ: 70 affinity:01 vec:d9 type=PCI-MSI status=00000010 in-flight=0 domain-list=0:301(----), - IRQ: 71 affinity:01 vec:2a type=PCI-MSI status=00000010 in-flight=0 domain-list=0:300(----), - IRQ: 72 affinity:01 vec:3a type=PCI-MSI status=00000010 in-flight=0 domain-list=0:299(----), - IRQ: 73 affinity:01 vec:42 type=PCI-MSI/-X status=00000030 in-flight=0 domain-list=0:298(----), - IRQ: 74 affinity:01 vec:4a type=PCI-MSI/-X status=00000030 in-flight=0 domain-list=0:297(----), - IRQ: 75 affinity:01 vec:52 type=PCI-MSI/-X status=00000030 in-flight=0 domain-list=0:296(----), - IRQ: 76 affinity:01 vec:5a type=PCI-MSI/-X status=00000030 in-flight=0 domain-list=0:295(----), - IRQ: 77 affinity:01 vec:62 type=PCI-MSI/-X status=00000030 in-flight=0 domain-list=0:294(----), - IRQ: 78 affinity:01 vec:6a type=PCI-MSI/-X status=00000030 in-flight=0 domain-list=0:293(----), - IRQ: 79 affinity:01 vec:72 type=PCI-MSI/-X status=00000030 in-flight=0 domain-list=0:292(----), + IRQ: 70 affinity:01 vec:d9 type=PCI-MSI status=00000010 in-flight=0 domain-list=0:301(-S--), + IRQ: 71 affinity:01 vec:2a type=PCI-MSI status=00000010 in-flight=1 domain-list=0:300(PS-M), + IRQ: 72 affinity:01 vec:3a type=PCI-MSI status=00000010 in-flight=0 domain-list=0:299(-S--), + IRQ: 73 affinity:01 vec:42 type=PCI-MSI/-X status=00000030 in-flight=0 domain-list=0:298(-S--), + IRQ: 74 affinity:01 vec:4a type=PCI-MSI/-X status=00000030 in-flight=0 domain-list=0:297(-S--), + IRQ: 75 affinity:01 vec:52 type=PCI-MSI/-X status=00000030 in-flight=0 domain-list=0:296(-S--), + IRQ: 76 affinity:01 vec:5a type=PCI-MSI/-X status=00000030 in-flight=0 domain-list=0:295(-S--), + IRQ: 77 affinity:01 vec:62 type=PCI-MSI/-X status=00000030 in-flight=0 domain-list=0:294(-S--), + IRQ: 78 affinity:01 vec:6a type=PCI-MSI/-X status=00000030 in-flight=0 domain-list=0:293(-S--), + IRQ: 79 affinity:01 vec:72 type=PCI-MSI/-X status=00000030 in-flight=0 domain-list=0:292(-S--), @@ -65 +65 @@ - Apic 0x00, Pin 1: vec=30 delivery=LoPri dest=L status=0 polarity=0 irr=0 trig=E mask=0 dest_id:1 + Apic 0x00, Pin 1: vec=a8 delivery=LoPri dest=L status=0 polarity=0 irr=0 trig=E mask=0 dest_id:1 @@ -79 +79 @@ - Apic 0x00, Pin 9: vec=60 delivery=LoPri dest=L status=0 polarity=1 irr=0 trig=L mask=0 dest_id:1 + Apic 0x00, Pin 9: vec=60 delivery=Fixed dest=L status=0 polarity=1 irr=0 trig=L mask=0 dest_id:1 @@ -93 +93 @@ - Apic 0x00, Pin 16: vec=d0 delivery=LoPri dest=L status=0 polarity=1 irr=0 trig=L mask=1 dest_id:63 + Apic 0x00, Pin 16: vec=00 delivery=Fixed dest=L status=0 polarity=1 irr=0 trig=L mask=1 dest_id:63 @@ -95 +95 @@ - Apic 0x00, Pin 17: vec=21 delivery=LoPri dest=L status=0 polarity=1 irr=0 trig=L mask=0 dest_id:1 + Apic 0x00, Pin 17: vec=21 delivery=Fixed dest=L status=0 polarity=1 irr=0 trig=L mask=0 dest_id:1 @@ -97 +97 @@ - Apic 0x00, Pin 18: vec=d8 delivery=LoPri dest=L status=0 polarity=1 irr=0 trig=L mask=0 dest_id:1 + Apic 0x00, Pin 18: vec=d8 delivery=Fixed dest=L status=0 polarity=1 irr=0 trig=L mask=0 dest_id:1 @@ -99 +99 @@ - Apic 0x00, Pin 19: vec=d1 delivery=LoPri dest=L status=0 polarity=1 irr=0 trig=L mask=1 dest_id:63 + Apic 0x00, Pin 19: vec=00 delivery=Fixed dest=L status=0 polarity=1 irr=0 trig=L mask=1 dest_id:63 @@ -101 +101 @@ - Apic 0x00, Pin 22: vec=a1 delivery=LoPri dest=L status=0 polarity=1 irr=0 trig=L mask=1 dest_id:63 + Apic 0x00, Pin 22: vec=00 delivery=Fixed dest=L status=0 polarity=1 irr=0 trig=L mask=1 dest_id:63 @@ -103 +103 @@ - Apic 0x01, Pin 4: vec=c9 delivery=LoPri dest=L status=0 polarity=1 irr=0 trig=L mask=1 dest_id:63 + Apic 0x01, Pin 4: vec=00 delivery=Fixed dest=L status=0 polarity=1 irr=0 trig=L mask=1 dest_id:63 @@ -105 +105 @@ - Apic 0x01, Pin 5: vec=c1 delivery=LoPri dest=L status=0 polarity=1 irr=0 trig=L mask=1 dest_id:63 + Apic 0x01, Pin 5: vec=00 delivery=Fixed dest=L status=0 polarity=1 irr=0 trig=L mask=1 dest_id:63 @@ -107 +107 @@ - Apic 0x01, Pin 8: vec=b1 delivery=LoPri dest=L status=0 polarity=1 irr=0 trig=L mask=1 dest_id:63 + Apic 0x01, Pin 8: vec=00 delivery=Fixed dest=L status=0 polarity=1 irr=0 trig=L mask=1 dest_id:63 @@ -109 +109 @@ - Apic 0x01, Pin 9: vec=a9 delivery=LoPri dest=L status=0 polarity=1 irr=0 trig=L mask=1 dest_id:63 + Apic 0x01, Pin 9: vec=00 delivery=Fixed dest=L status=0 polarity=1 irr=0 trig=L mask=1 dest_id:63 @@ -111 +111 @@ - Apic 0x01, Pin 13: vec=31 delivery=LoPri dest=L status=0 polarity=1 irr=0 trig=L mask=1 dest_id:63 + Apic 0x01, Pin 13: vec=00 delivery=Fixed dest=L status=0 polarity=1 irr=0 trig=L mask=1 dest_id:63 @@ -113 +113 @@ - Apic 0x01, Pin 14: vec=39 delivery=LoPri dest=L status=0 polarity=1 irr=0 trig=L mask=1 dest_id:63 + Apic 0x01, Pin 14: vec=00 delivery=Fixed dest=L status=0 polarity=1 irr=0 trig=L mask=1 dest_id:63 @@ -115 +115 @@ - Apic 0x01, Pin 15: vec=41 delivery=LoPri dest=L status=0 polarity=1 irr=0 trig=L mask=1 dest_id:63 + Apic 0x01, Pin 15: vec=00 delivery=Fixed dest=L status=0 polarity=1 irr=0 trig=L mask=1 dest_id:63 @@ -117 +117 @@ - Apic 0x01, Pin 16: vec=49 delivery=LoPri dest=L status=0 polarity=1 irr=0 trig=L mask=1 dest_id:63 + Apic 0x01, Pin 16: vec=00 delivery=Fixed dest=L status=0 polarity=1 irr=0 trig=L mask=1 dest_id:63 @@ -119 +119 @@ - Apic 0x01, Pin 22: vec=22 delivery=LoPri dest=L status=0 polarity=1 irr=0 trig=L mask=1 dest_id:63 + Apic 0x01, Pin 22: vec=00 delivery=Fixed dest=L status=0 polarity=1 irr=0 trig=L mask=1 dest_id:63 @@ -121 +121 @@ - Apic 0x01, Pin 23: vec=b9 delivery=LoPri dest=L status=0 polarity=1 irr=0 trig=L mask=1 dest_id:63 + Apic 0x01, Pin 23: vec=00 delivery=Fixed dest=L status=0 polarity=1 irr=0 trig=L mask=1 dest_id:63 @@ -123 +123 @@ - Apic 0x01, Pin 24: vec=29 delivery=LoPri dest=L status=0 polarity=1 irr=0 trig=L mask=1 dest_id:63 + Apic 0x01, Pin 24: vec=00 delivery=Fixed dest=L status=0 polarity=1 irr=0 trig=L mask=1 dest_id:63 @@ -125 +125 @@ - Apic 0x01, Pin 27: vec=32 delivery=LoPri dest=L status=0 polarity=1 irr=0 trig=L mask=1 dest_id:63 + Apic 0x01, Pin 27: vec=00 delivery=Fixed dest=L status=0 polarity=1 irr=0 trig=L mask=1 dest_id:63 @@ -127 +127 @@ - Apic 0x01, Pin 28: vec=b8 delivery=LoPri dest=L status=0 polarity=1 irr=0 trig=L mask=1 dest_id:63 + Apic 0x01, Pin 28: vec=00 delivery=Fixed dest=L status=0 polarity=1 irr=0 trig=L mask=1 dest_id:63 @@ -129 +129 @@ - Apic 0x01, Pin 29: vec=c0 delivery=LoPri dest=L status=0 polarity=1 irr=0 trig=L mask=1 dest_id:63 + Apic 0x01, Pin 29: vec=00 delivery=Fixed dest=L status=0 polarity=1 irr=0 trig=L mask=1 dest_id:63 @@ -131 +131 @@ - Apic 0x01, Pin 30: vec=c8 delivery=LoPri dest=L status=0 polarity=1 irr=0 trig=L mask=1 dest_id:63 \ No newline at end of file + Apic 0x01, Pin 30: vec=00 delivery=Fixed dest=L status=0 polarity=1 irr=0 trig=L mask=1 dest_id:63 \ No newline at end of file --- good-ioapic.txt 2013-08-16 17:40:44.000000000 +0200 +++ tip-ioapic.txt 2013-08-16 17:40:23.000000000 +0200 @@ -20,2 +20,2 @@ - 00 000 00 1 0 0 0 0 0 0 00 - 01 001 01 0 0 0 0 0 1 1 30 + 00 000 00 1 0 0 0 0 0 1 A8 + 01 001 01 0 0 0 0 0 1 1 A8 @@ -29 +29 @@ - 09 001 01 0 1 0 1 0 1 1 60 + 09 001 01 0 1 0 1 0 1 0 60 @@ -36,8 +36,8 @@ - 10 03F 0F 1 1 0 1 0 1 1 D0 - 11 001 01 0 1 0 1 0 1 1 21 - 12 001 01 0 1 0 1 0 1 1 D8 - 13 03F 0F 1 1 0 1 0 1 1 D1 - 14 000 00 1 0 0 0 0 0 0 00 - 15 000 00 1 0 0 0 0 0 0 00 - 16 03F 0F 1 1 0 1 0 1 1 A1 - 17 000 00 1 0 0 0 0 0 0 00 + 10 03F 0F 1 1 0 1 0 1 0 00 + 11 001 01 0 1 0 1 0 1 0 21 + 12 001 01 0 1 0 1 0 1 0 D8 + 13 03F 0F 1 1 0 1 0 1 0 00 + 14 000 00 1 0 0 0 0 0 1 A8 + 15 000 00 1 0 0 0 0 0 1 A8 + 16 03F 0F 1 1 0 1 0 1 0 00 + 17 000 00 1 0 0 0 0 0 1 A8 @@ -57,32 +57,32 @@ - 00 000 00 1 0 0 0 0 0 0 00 - 01 000 00 1 0 0 0 0 0 0 00 - 02 000 00 1 0 0 0 0 0 0 00 - 03 000 00 1 0 0 0 0 0 0 00 - 04 03F 0F 1 1 0 1 0 1 1 C9 - 05 03F 0F 1 1 0 1 0 1 1 C1 - 06 000 00 1 0 0 0 0 0 0 00 - 07 000 00 1 0 0 0 0 0 0 00 - 08 03F 0F 1 1 0 1 0 1 1 B1 - 09 03F 0F 1 1 0 1 0 1 1 A9 - 0a 000 00 1 0 0 0 0 0 0 00 - 0b 000 00 1 0 0 0 0 0 0 00 - 0c 000 00 1 0 0 0 0 0 0 00 - 0d 03F 0F 1 1 0 1 0 1 1 31 - 0e 03F 0F 1 1 0 1 0 1 1 39 - 0f 03F 0F 1 1 0 1 0 1 1 41 - 10 03F 0F 1 1 0 1 0 1 1 49 - 11 000 00 1 0 0 0 0 0 0 00 - 12 000 00 1 0 0 0 0 0 0 00 - 13 000 00 1 0 0 0 0 0 0 00 - 14 000 00 1 0 0 0 0 0 0 00 - 15 000 00 1 0 0 0 0 0 0 00 - 16 03F 0F 1 1 0 1 0 1 1 22 - 17 03F 0F 1 1 0 1 0 1 1 B9 - 18 03F 0F 1 1 0 1 0 1 1 29 - 19 000 00 1 0 0 0 0 0 0 00 - 1a 000 00 1 0 0 0 0 0 0 00 - 1b 03F 0F 1 1 0 1 0 1 1 32 - 1c 03F 0F 1 1 0 1 0 1 1 B8 - 1d 03F 0F 1 1 0 1 0 1 1 C0 - 1e 03F 0F 1 1 0 1 0 1 1 C8 - 1f 000 00 1 0 0 0 0 0 0 00 + 00 000 00 1 0 0 0 0 0 1 A8 + 01 000 00 1 0 0 0 0 0 1 A8 + 02 000 00 1 0 0 0 0 0 1 A8 + 03 000 00 1 0 0 0 0 0 1 A8 + 04 03F 0F 1 1 0 1 0 1 0 00 + 05 03F 0F 1 1 0 1 0 1 0 00 + 06 000 00 1 0 0 0 0 0 1 A8 + 07 000 00 1 0 0 0 0 0 1 A8 + 08 03F 0F 1 1 0 1 0 1 0 00 + 09 03F 0F 1 1 0 1 0 1 0 00 + 0a 000 00 1 0 0 0 0 0 1 A8 + 0b 000 00 1 0 0 0 0 0 1 A8 + 0c 000 00 1 0 0 0 0 0 1 A8 + 0d 03F 0F 1 1 0 1 0 1 0 00 + 0e 03F 0F 1 1 0 1 0 1 0 00 + 0f 03F 0F 1 1 0 1 0 1 0 00 + 10 03F 0F 1 1 0 1 0 1 0 00 + 11 000 00 1 0 0 0 0 0 1 A8 + 12 000 00 1 0 0 0 0 0 1 A8 + 13 000 00 1 0 0 0 0 0 1 A8 + 14 000 00 1 0 0 0 0 0 1 A8 + 15 000 00 1 0 0 0 0 0 1 A8 + 16 03F 0F 1 1 0 1 0 1 0 00 + 17 03F 0F 1 1 0 1 0 1 0 00 + 18 03F 0F 1 1 0 1 0 1 0 00 + 19 000 00 1 0 0 0 0 0 1 A8 + 1a 000 00 1 0 0 0 0 0 1 A8 + 1b 03F 0F 1 1 0 1 0 1 0 00 + 1c 03F 0F 1 1 0 1 0 1 0 00 + 1d 03F 0F 1 1 0 1 0 1 0 00 + 1e 03F 0F 1 1 0 1 0 1 0 00 + 1f 000 00 1 0 0 0 0 0 1 A8> Jan
Sander Eikelenboom
2013-Aug-22 22:51 UTC
Re: [xen-unstable] Commit 2ca9fbd739b8a72b16dd790d0fff7b75f5488fb8 AMD IOMMU: allocate IRTE entries instead of using a static mapping, makes dom0 boot process stall several times.
Friday, August 16, 2013, 3:15:50 PM, you wrote:>>>> On 16.08.13 at 12:44, Sander Eikelenboom <linux@eikelenboom.it> wrote: >> Friday, August 16, 2013, 11:18:56 AM, you wrote: >>>>>> On 16.08.13 at 10:40, Sander Eikelenboom <linux@eikelenboom.it> wrote: >>>> Hmm only the "no-cpuidle" is needed (cpufreq=xen can stay) to make the stalls >>>> disappear, >>>> but makes me wonder how that is related to the commit the bisection found .. >>>> machine has been running with cpuidle enabled for ages .. >> >>> That''s odd indeed. If you''re up to do a little bit of debugging here, >>> why don''t you log the sequence of interrupts arriving both with >>> and without said commit. This might end up being a lot of data, so >>> you may want to filter out uninteresting stuff and/or log only to >>> a memory buffer which then gets dumped upon some debug key >>> press. >> >> Hmm making said debug patch is getting probably a bit out of my league .. >> since the generated interrupts will probably outpace flushing to the >> console. >> >> And i''m not sure in what things you are actually interested around the irq >> flow (probably the hpet msi ones ?).> No, much more the ones from the devices that you say the drivers > of which cause the stalls while initializing. The question mainly is > whether the distribution of interrupts between CPUs changed in a > way that made the system more susceptible to missing wakeups > via HPET MSIs.> Along that lines was also the question regarding interrupt counts > for the devices in question, which if I''m not mistaken you didn''t > answer yet.Hi Jan, Got things running again, first on baremetal linux I was having 2 seperate problems it seems: 1) the southbridge ioapic(6) isn''t in the IVRS tables, the Linux kernel has had a patch "iommu/amd: Add ioapic and hpet ivrs override" (https://lists.linux-foundation.org/pipermail/iommu/2013-April/005506.html) That patch makes it possible to override the incorrect IVRS tables on the command line. Using ivrs_ioapic[6]=00:14.0 ivrs_ioapic[7]=00:00.1 ivrs_hpet[0]=00:14.0 made it boot correctly and enable the iommu and interrupt remapping. That patch would probably be a good candidate to port to Xen too, considering the iommu massacre on at least boards with a 890fx chipset. (or make it a quirk for these earlier chipsets, since the BDF for northbridge and southridge ioapic and hpet seem to be known fixed values from what i read from earlier mailinglist and code comments, but perhaps Suravee could comment on that ... he seems to have tested the patch for Linux as well (https://lists.linux-foundation.org/pipermail/iommu/2013-April/005528.html)) 2) After that my sata controller gave read errors, but i found it was still in "ide" mode instead of "ahci" in the bios. A seperate but perhaps related issue (probably something with the enabling of multiple msi''s which the driver can not handle in "ide" mode, will sort that out later.) After i got things working on baremetal Linux, i adjusted Xen and hardcoded it to add a mapping for ioapic[6]=00:14.0. (the entries for ivrs_ioapic[7] and hpet[0] are actually correct in the bios tables, so they don''t need correction for me at the moment) And hey presto .. no stalls .. So i think porting the override patch to Xen (or make it a quirk and ignore the IVRS table for special devices on certain chipsets) could solve a lot of the reported iommu problems for AMD systems. -- Sander> Jan
Sander Eikelenboom
2013-Aug-22 23:42 UTC
Re: [xen-unstable] Commit 2ca9fbd739b8a72b16dd790d0fff7b75f5488fb8 AMD IOMMU: allocate IRTE entries instead of using a static mapping, makes dom0 boot process stall several times.
Friday, August 23, 2013, 12:51:28 AM, you wrote:> Friday, August 16, 2013, 3:15:50 PM, you wrote:>>>>> On 16.08.13 at 12:44, Sander Eikelenboom <linux@eikelenboom.it> wrote: >>> Friday, August 16, 2013, 11:18:56 AM, you wrote: >>>>>>> On 16.08.13 at 10:40, Sander Eikelenboom <linux@eikelenboom.it> wrote: >>>>> Hmm only the "no-cpuidle" is needed (cpufreq=xen can stay) to make the stalls >>>>> disappear, >>>>> but makes me wonder how that is related to the commit the bisection found .. >>>>> machine has been running with cpuidle enabled for ages .. >>> >>>> That''s odd indeed. If you''re up to do a little bit of debugging here, >>>> why don''t you log the sequence of interrupts arriving both with >>>> and without said commit. This might end up being a lot of data, so >>>> you may want to filter out uninteresting stuff and/or log only to >>>> a memory buffer which then gets dumped upon some debug key >>>> press. >>> >>> Hmm making said debug patch is getting probably a bit out of my league .. >>> since the generated interrupts will probably outpace flushing to the >>> console. >>> >>> And i''m not sure in what things you are actually interested around the irq >>> flow (probably the hpet msi ones ?).>> No, much more the ones from the devices that you say the drivers >> of which cause the stalls while initializing. The question mainly is >> whether the distribution of interrupts between CPUs changed in a >> way that made the system more susceptible to missing wakeups >> via HPET MSIs.>> Along that lines was also the question regarding interrupt counts >> for the devices in question, which if I''m not mistaken you didn''t >> answer yet.> Hi Jan,> Got things running again, first on baremetal linux > I was having 2 seperate problems it seems:> 1) the southbridge ioapic(6) isn''t in the IVRS tables, the Linux kernel has had a patch > "iommu/amd: Add ioapic and hpet ivrs override" (https://lists.linux-foundation.org/pipermail/iommu/2013-April/005506.html)> That patch makes it possible to override the incorrect IVRS tables on the command line. > Using ivrs_ioapic[6]=00:14.0 ivrs_ioapic[7]=00:00.1 ivrs_hpet[0]=00:14.0 made it boot correctly and enable the iommu and interrupt remapping.> That patch would probably be a good candidate to port to Xen too, considering the iommu massacre on at least boards with a 890fx chipset. > (or make it a quirk for these earlier chipsets, since the BDF for northbridge and southridge ioapic and hpet seem to be known fixed values > from what i read from earlier mailinglist and code comments, but perhaps Suravee could comment on that ... he seems to have tested the patch for Linux as well > (https://lists.linux-foundation.org/pipermail/iommu/2013-April/005528.html))> 2) After that my sata controller gave read errors, but i found it was still in "ide" mode instead of "ahci" in the bios. A seperate but perhaps related issue > (probably something with the enabling of multiple msi''s which the driver can not handle in "ide" mode, will sort that out later.)> After i got things working on baremetal Linux, i adjusted Xen and hardcoded it to add a mapping for ioapic[6]=00:14.0. > (the entries for ivrs_ioapic[7] and hpet[0] are actually correct in the bios tables, so they don''t need correction for me at the moment)> And hey presto .. no stalls ..Pfffrt i shouldn''t hit send when i''m tired and it''s quite late .. i had a stale "no-cpuidle" in my grub cfg .. no wonder .. So still stalls and now also a freeze when a passed through device is enabled in a HVM domain. Sorry and will continue investigating tomorrow .. -- Sander> So i think porting the override patch to Xen (or make it a quirk and ignore the IVRS table for special devices on certain chipsets) could solve a lot of the > reported iommu problems for AMD systems.> -- > Sander>> Jan
Jan Beulich
2013-Aug-23 14:28 UTC
Re: [xen-unstable] Commit 2ca9fbd739b8a72b16dd790d0fff7b75f5488fb8 AMD IOMMU: allocate IRTE entries instead of using a static mapping, makes dom0 boot process stall several times.
>>> On 23.08.13 at 00:51, Sander Eikelenboom <linux@eikelenboom.it> wrote: > After i got things working on baremetal Linux, i adjusted Xen and hardcoded > it to add a mapping for ioapic[6]=00:14.0. > (the entries for ivrs_ioapic[7] and hpet[0] are actually correct in the bios > tables, so they don''t need correction for me at the moment)Are you sure about the HPET part of this? I ask because that being wrong could be an explanation for the stalls you see when using cpuidle (as that could mean those HPET interrupts needed for waking CPUs don''t arrive). Speaking of which - why don''t you try whether when not using FSB-capable HPET channels, the stalls go away? All you''d need to change is hpet_fsb_cap_lookup() - it ought to return without doing anything (i.e., if you look at the code, as if acpi_gbl_FADT.boot_flags had ACPI_FADT_NO_MSI set). Jan
Sander Eikelenboom
2013-Aug-23 14:45 UTC
Re: [xen-unstable] Commit 2ca9fbd739b8a72b16dd790d0fff7b75f5488fb8 AMD IOMMU: allocate IRTE entries instead of using a static mapping, makes dom0 boot process stall several times.
Friday, August 23, 2013, 4:28:43 PM, you wrote:>>>> On 23.08.13 at 00:51, Sander Eikelenboom <linux@eikelenboom.it> wrote: >> After i got things working on baremetal Linux, i adjusted Xen and hardcoded >> it to add a mapping for ioapic[6]=00:14.0. >> (the entries for ivrs_ioapic[7] and hpet[0] are actually correct in the bios >> tables, so they don''t need correction for me at the moment)> Are you sure about the HPET part of this? I ask because that being > wrong could be an explanation for the stalls you see when using > cpuidle (as that could mean those HPET interrupts needed for > waking CPUs don''t arrive).Not entirely sure, but i don''t see the stalls booting on baremetal linux with iommu enabled by using only ioapic[6]=00:14.0 on the command line. (just double checked) Ok and somehow keypresses on the console seem to cause them to do arrive, because with a keypress i can make it continu before a stall occurs. BTW the stalls always start after starting the init process, so *after* loading the kernel. Most of the time the first time is around udevd is started, after that it will stall a few times more, at least when ifup/ifdown is setting up the nics.> Speaking of which - why don''t you try whether when not using > FSB-capable HPET channels, the stalls go away? All you''d need > to change is hpet_fsb_cap_lookup() - it ought to return without > doing anything (i.e., if you look at the code, as if > acpi_gbl_FADT.boot_flags had ACPI_FADT_NO_MSI set).Will have a go on that ...> Jan
Sander Eikelenboom
2013-Aug-23 15:05 UTC
Re: [xen-unstable] Commit 2ca9fbd739b8a72b16dd790d0fff7b75f5488fb8 AMD IOMMU: allocate IRTE entries instead of using a static mapping, makes dom0 boot process stall several times.
Friday, August 23, 2013, 4:28:43 PM, you wrote:>>>> On 23.08.13 at 00:51, Sander Eikelenboom <linux@eikelenboom.it> wrote: >> After i got things working on baremetal Linux, i adjusted Xen and hardcoded >> it to add a mapping for ioapic[6]=00:14.0. >> (the entries for ivrs_ioapic[7] and hpet[0] are actually correct in the bios >> tables, so they don''t need correction for me at the moment)> Are you sure about the HPET part of this? I ask because that being > wrong could be an explanation for the stalls you see when using > cpuidle (as that could mean those HPET interrupts needed for > waking CPUs don''t arrive).> Speaking of which - why don''t you try whether when not using > FSB-capable HPET channels, the stalls go away? All you''d need > to change is hpet_fsb_cap_lookup() - it ought to return without > doing anything (i.e., if you look at the code, as if > acpi_gbl_FADT.boot_flags had ACPI_FADT_NO_MSI set).Ok adding: @@ -392,6 +392,9 @@ static void __init hpet_fsb_cap_lookup(void) u32 id; unsigned int i, num_chs; + printk(XENLOG_INFO "SEIK HPET: return as if acpi_gbl_FADT.boot_flags & ACPI_FADT_NO_MSI\n"); + return; + if ( unlikely(acpi_gbl_FADT.boot_flags & ACPI_FADT_NO_MSI) ) return; Indeed made the stalls go away ..> Jan
Jan Beulich
2013-Aug-23 15:11 UTC
Re: [xen-unstable] Commit 2ca9fbd739b8a72b16dd790d0fff7b75f5488fb8 AMD IOMMU: allocate IRTE entries instead of using a static mapping, makes dom0 boot process stall several times.
>>> On 23.08.13 at 17:05, Sander Eikelenboom <linux@eikelenboom.it> wrote:> Friday, August 23, 2013, 4:28:43 PM, you wrote: > >>>>> On 23.08.13 at 00:51, Sander Eikelenboom <linux@eikelenboom.it> wrote: >>> After i got things working on baremetal Linux, i adjusted Xen and hardcoded >>> it to add a mapping for ioapic[6]=00:14.0. >>> (the entries for ivrs_ioapic[7] and hpet[0] are actually correct in the bios > >>> tables, so they don''t need correction for me at the moment) > >> Are you sure about the HPET part of this? I ask because that being >> wrong could be an explanation for the stalls you see when using >> cpuidle (as that could mean those HPET interrupts needed for >> waking CPUs don''t arrive). > >> Speaking of which - why don''t you try whether when not using >> FSB-capable HPET channels, the stalls go away? All you''d need >> to change is hpet_fsb_cap_lookup() - it ought to return without >> doing anything (i.e., if you look at the code, as if >> acpi_gbl_FADT.boot_flags had ACPI_FADT_NO_MSI set). > > Ok adding: > > @@ -392,6 +392,9 @@ static void __init hpet_fsb_cap_lookup(void) > u32 id; > unsigned int i, num_chs; > > + printk(XENLOG_INFO "SEIK HPET: return as if acpi_gbl_FADT.boot_flags & > ACPI_FADT_NO_MSI\n"); > + return; > + > if ( unlikely(acpi_gbl_FADT.boot_flags & ACPI_FADT_NO_MSI) ) > return; > > > Indeed made the stalls go away ..So if this time you didn''t leave a no-cpuidle in place somewhere ;-) this makes relatively clear that the stalls are due to the interrupts coming from the HPET not reaching their destinations. I still can''t connect this to the $subject commit yet, though. Jan
Jan Beulich
2013-Aug-23 15:21 UTC
Re: [xen-unstable] Commit 2ca9fbd739b8a72b16dd790d0fff7b75f5488fb8 AMD IOMMU: allocate IRTE entries instead of using a static mapping, makes dom0 boot process stall several times.
>>> On 23.08.13 at 17:11, "Jan Beulich" <JBeulich@suse.com> wrote: >>>> On 23.08.13 at 17:05, Sander Eikelenboom <linux@eikelenboom.it> wrote: > >> Friday, August 23, 2013, 4:28:43 PM, you wrote: >> >>>>>> On 23.08.13 at 00:51, Sander Eikelenboom <linux@eikelenboom.it> wrote: >>>> After i got things working on baremetal Linux, i adjusted Xen and hardcoded >>>> it to add a mapping for ioapic[6]=00:14.0. >>>> (the entries for ivrs_ioapic[7] and hpet[0] are actually correct in the bios > >> >>>> tables, so they don''t need correction for me at the moment) >> >>> Are you sure about the HPET part of this? I ask because that being >>> wrong could be an explanation for the stalls you see when using >>> cpuidle (as that could mean those HPET interrupts needed for >>> waking CPUs don''t arrive). >> >>> Speaking of which - why don''t you try whether when not using >>> FSB-capable HPET channels, the stalls go away? All you''d need >>> to change is hpet_fsb_cap_lookup() - it ought to return without >>> doing anything (i.e., if you look at the code, as if >>> acpi_gbl_FADT.boot_flags had ACPI_FADT_NO_MSI set). >> >> Ok adding: >> >> @@ -392,6 +392,9 @@ static void __init hpet_fsb_cap_lookup(void) >> u32 id; >> unsigned int i, num_chs; >> >> + printk(XENLOG_INFO "SEIK HPET: return as if acpi_gbl_FADT.boot_flags & >> ACPI_FADT_NO_MSI\n"); >> + return; >> + >> if ( unlikely(acpi_gbl_FADT.boot_flags & ACPI_FADT_NO_MSI) ) >> return; >> >> >> Indeed made the stalls go away .. > > So if this time you didn''t leave a no-cpuidle in place somewhere ;-) > this makes relatively clear that the stalls are due to the interrupts > coming from the HPET not reaching their destinations. I still can''t > connect this to the $subject commit yet, though.Could you provide ''M'' and ''V'' output for the bad (stalling) case? Jan
Sander Eikelenboom
2013-Aug-23 15:29 UTC
Re: [xen-unstable] Commit 2ca9fbd739b8a72b16dd790d0fff7b75f5488fb8 AMD IOMMU: allocate IRTE entries instead of using a static mapping, makes dom0 boot process stall several times.
Friday, August 23, 2013, 5:11:12 PM, you wrote:>>>> On 23.08.13 at 17:05, Sander Eikelenboom <linux@eikelenboom.it> wrote:>> Friday, August 23, 2013, 4:28:43 PM, you wrote: >> >>>>>> On 23.08.13 at 00:51, Sander Eikelenboom <linux@eikelenboom.it> wrote: >>>> After i got things working on baremetal Linux, i adjusted Xen and hardcoded >>>> it to add a mapping for ioapic[6]=00:14.0. >>>> (the entries for ivrs_ioapic[7] and hpet[0] are actually correct in the bios >> >>>> tables, so they don''t need correction for me at the moment) >> >>> Are you sure about the HPET part of this? I ask because that being >>> wrong could be an explanation for the stalls you see when using >>> cpuidle (as that could mean those HPET interrupts needed for >>> waking CPUs don''t arrive). >> >>> Speaking of which - why don''t you try whether when not using >>> FSB-capable HPET channels, the stalls go away? All you''d need >>> to change is hpet_fsb_cap_lookup() - it ought to return without >>> doing anything (i.e., if you look at the code, as if >>> acpi_gbl_FADT.boot_flags had ACPI_FADT_NO_MSI set). >> >> Ok adding: >> >> @@ -392,6 +392,9 @@ static void __init hpet_fsb_cap_lookup(void) >> u32 id; >> unsigned int i, num_chs; >> >> + printk(XENLOG_INFO "SEIK HPET: return as if acpi_gbl_FADT.boot_flags & >> ACPI_FADT_NO_MSI\n"); >> + return; >> + >> if ( unlikely(acpi_gbl_FADT.boot_flags & ACPI_FADT_NO_MSI) ) >> return; >> >> >> Indeed made the stalls go away ..> So if this time you didn''t leave a no-cpuidle in place somewhere ;-)pun taken :-p .. another cup of coffee .. double checked .. no it clearly states cpuidle :-)> this makes relatively clear that the stalls are due to the interrupts > coming from the HPET not reaching their destinations. I still can''t > connect this to the $subject commit yet, though.Hmm the debug key "V" now also doesn''t crash :-) Output of d, M, i , z and V for the stalling case ... [ 70.372469] r8169 0000:0a:00.0 eth1: link down [ 70.372537] r8169 0000:0a:00.0 eth1: link down [ 70.609123] r8169 0000:0b:00.0 eth0: link down [ 70.609150] r8169 0000:0b:00.0 eth0: link down [ 72.087919] r8169 0000:0a:00.0 eth1: link up [ 72.490312] r8169 0000:0b:00.0 eth0: link up (XEN) [2013-08-23 15:22:27] ''d'' pressed -> dumping registers (XEN) [2013-08-23 15:22:27] (XEN) [2013-08-23 15:22:27] *** Dumping CPU0 host state: *** (XEN) [2013-08-23 15:22:27] ----[ Xen-4.4-unstable x86_64 debug=y Not tainted ]---- (XEN) [2013-08-23 15:22:27] CPU: 0 (XEN) [2013-08-23 15:22:27] RIP: e008:[<ffff82d0801a1b6c>] hpet_broadcast_exit+0/0x171 (XEN) [2013-08-23 15:22:27] RFLAGS: 0000000000000246 CONTEXT: hypervisor (XEN) [2013-08-23 15:22:27] rax: 0000000000000000 rbx: ffff83055d660d70 rcx: 20c49ba5e353f7cf (XEN) [2013-08-23 15:22:27] rdx: ffff82d080311220 rsi: 00000016f4c046c6 rdi: ffff83055d660d98 (XEN) [2013-08-23 15:22:27] rbp: ffff82d0802cfef0 rsp: ffff82d0802cfe88 r8: 00000016f1686bc2 (XEN) [2013-08-23 15:22:27] r9: 0000000000000000 r10: 00000000deadbeef r11: 0000000000000246 (XEN) [2013-08-23 15:22:27] r12: ffff83055d660de0 r13: 00000016f4afec20 r14: 00000016f4c046c6 (XEN) [2013-08-23 15:22:27] r15: ffff82d080311280 cr0: 000000008005003b cr4: 00000000000006f0 (XEN) [2013-08-23 15:22:27] cr3: 00000005440f2000 cr2: 00007fa0dcdfee00 (XEN) [2013-08-23 15:22:27] ds: 0000 es: 0000 fs: 0000 gs: 0000 ss: e010 cs: e008 (XEN) [2013-08-23 15:22:27] Xen stack trace from rsp=ffff82d0802cfe88: (XEN) [2013-08-23 15:22:27] ffff82d0801a4052 aaaaaaaaaaaaaa00 00000016f4e4fa8e ffff82d0802e8000 (XEN) [2013-08-23 15:22:27] ffff82d0802e8000 ffff82d0802c8000 0000000000000000 0000000000000000 (XEN) [2013-08-23 15:22:27] 000001e100000b2b ffff82d0802c8000 ffff82d0802c8000 00000000ffffffff (XEN) [2013-08-23 15:22:28] 0000000000000002 ffff82d0802cff10 ffff82d08015cfe2 ffff83009fd13000 (XEN) [2013-08-23 15:22:28] ffff83009ff88000 ffff82d0802cfdd8 0000000000000000 ffff88005fcf3040 (XEN) [2013-08-23 15:22:28] ffffffff81f970c0 ffffffff81edb630 ffffffff81e01e88 ffffffff81e01fd8 (XEN) [2013-08-23 15:22:28] 0000000000000246 0000000000000000 0000000000000000 0000000000000001 (XEN) [2013-08-23 15:22:28] 0000000000000000 ffffffff810013aa ffffffff81e13440 00000000deadbeef (XEN) [2013-08-23 15:22:28] 00000000deadbeef 0000010000000000 ffffffff810013aa 000000000000e033 (XEN) [2013-08-23 15:22:28] 0000000000000246 ffffffff81e01e70 000000000000e02b 0000000000000000 (XEN) [2013-08-23 15:22:28] 0000000000000000 0000000000000000 0000000000000000 0000000000000000 (XEN) [2013-08-23 15:22:28] ffff83009fd13000 0000000000000000 0000000000000000 (XEN) [2013-08-23 15:22:28] Xen call trace: (XEN) [2013-08-23 15:22:28] [<ffff82d0801a1b6c>] hpet_broadcast_exit+0/0x171 (XEN) [2013-08-23 15:22:28] [<ffff82d08015cfe2>] idle_loop+0x5b/0x6b (XEN) [2013-08-23 15:22:28] (XEN) [2013-08-23 15:22:28] *** Dumping CPU1 host state: *** (XEN) [2013-08-23 15:22:28] ----[ Xen-4.4-unstable x86_64 debug=y Not tainted ]---- (XEN) [2013-08-23 15:22:28] CPU: 1 (XEN) [2013-08-23 15:22:28] RIP: e008:[<ffff82d0801a1b6c>] hpet_broadcast_exit+0/0x171 (XEN) [2013-08-23 15:22:28] RFLAGS: 0000000000000246 CONTEXT: hypervisor (XEN) [2013-08-23 15:22:28] rax: 0000000000000000 rbx: ffff83055d61a0a0 rcx: 20c49ba5e353f7cf (XEN) [2013-08-23 15:22:28] rdx: ffff83055d639020 rsi: 000000171e84497f rdi: ffff83055d61a0c8 (XEN) [2013-08-23 15:22:28] rbp: ffff83055d637ef0 rsp: ffff83055d637e88 r8: 00000016f1686bc2 (XEN) [2013-08-23 15:22:28] r9: 0000000000000002 r10: 00000000deadbeef r11: 0000000000000246 (XEN) [2013-08-23 15:22:28] r12: ffff83055d61a110 r13: 00000016f4566202 r14: 000000171e84497f (XEN) [2013-08-23 15:22:28] r15: ffff83055d639080 cr0: 000000008005003b cr4: 00000000000006f0 (XEN) [2013-08-23 15:22:28] cr3: 000000009fc7c000 cr2: 00007f20ba85ee02 (XEN) [2013-08-23 15:22:28] ds: 002b es: 002b fs: 0000 gs: 0000 ss: e010 cs: e008 (XEN) [2013-08-23 15:22:28] Xen stack trace from rsp=ffff83055d637e88: (XEN) [2013-08-23 15:22:28] ffff82d0801a4052 ffff82d0802e8000 ffff83055d630000 ffffffffffffffff (XEN) [2013-08-23 15:22:28] ffff83055d639080 ffff83055d637ee0 0000000000000000 0000000000000000 (XEN) [2013-08-23 15:22:28] 000005c200000897 ffff83055d630000 ffff83055d630000 00000000ffffffff (XEN) [2013-08-23 15:22:28] 0000000000000002 ffff83055d637f10 ffff82d08015cfe2 ffff83009fafe000 (XEN) [2013-08-23 15:22:28] ffff83009fd17000 ffff83055d637dd8 0000000000000000 0000000000000000 (XEN) [2013-08-23 15:22:28] 0000000000000000 ffffffff81edb630 ffff880059bd5f10 ffff880059bd5fd8 (XEN) [2013-08-23 15:22:28] 0000000000000246 0000000000000000 0000000000000000 0000000000000001 (XEN) [2013-08-23 15:22:28] 0000000000000000 ffffffff810013aa ffff880059bd8000 00000000deadbeef (XEN) [2013-08-23 15:22:28] 00000000deadbeef 0000010000000000 ffffffff810013aa 000000000000e033 (XEN) [2013-08-23 15:22:28] 0000000000000246 ffff880059bd5ef8 000000000000e02b f2fdde7fbe7ffffe (XEN) [2013-08-23 15:22:28] 6fffedeeffffdbcf fcdfe7ffff59ff7f ffbffffff7ffffff bfffedcf00000001 (XEN) [2013-08-23 15:22:28] ffff83009fafe000 00000034dd327e00 efffefefeeffffff (XEN) [2013-08-23 15:22:28] Xen call trace: (XEN) [2013-08-23 15:22:28] [<ffff82d0801a1b6c>] hpet_broadcast_exit+0/0x171 (XEN) [2013-08-23 15:22:28] [<ffff82d08015cfe2>] idle_loop+0x5b/0x6b (XEN) [2013-08-23 15:22:28] (XEN) [2013-08-23 15:22:28] *** Dumping CPU2 host state: *** (XEN) [2013-08-23 15:22:28] ----[ Xen-4.4-unstable x86_64 debug=y Not tainted ]---- (XEN) [2013-08-23 15:22:29] CPU: 2 (XEN) [2013-08-23 15:22:29] RIP: e008:[<ffff82d0801a1b6c>] hpet_broadcast_exit+0/0x171 (XEN) [2013-08-23 15:22:29] RFLAGS: 0000000000000246 CONTEXT: hypervisor (XEN) [2013-08-23 15:22:29] rax: 0000000000000000 rbx: ffff83055d61a4f0 rcx: 20c49ba5e353f7cf (XEN) [2013-08-23 15:22:29] rdx: ffff83055d619020 rsi: 0000001746e2898c rdi: ffff83055d61a518 (XEN) [2013-08-23 15:22:29] rbp: ffff83055d617ef0 rsp: ffff83055d617e88 r8: 00000016f1686bc2 (XEN) [2013-08-23 15:22:29] r9: ffff82cfffd76000 r10: 00000000deadbeef r11: 0000000000000246 (XEN) [2013-08-23 15:22:29] r12: ffff83055d61a560 r13: 000000172f1eb714 r14: 0000001746e2898c (XEN) [2013-08-23 15:22:29] r15: ffff83055d619080 cr0: 000000008005003b cr4: 00000000000006f0 (XEN) [2013-08-23 15:22:29] cr3: 0000000549e0c000 cr2: 00007fb0c138bf80 (XEN) [2013-08-23 15:22:29] ds: 002b es: 002b fs: 0000 gs: 0000 ss: e010 cs: e008 (XEN) [2013-08-23 15:22:29] Xen stack trace from rsp=ffff83055d617e88: (XEN) [2013-08-23 15:22:29] ffff82d0801a4052 ffff82d080226200 000000176a50ec1a ffff82d0802e8100 (XEN) [2013-08-23 15:22:29] ffff82d0802e8000 ffff83055d610000 0000000000000000 0000000000000000 (XEN) [2013-08-23 15:22:29] 0000149300057485 ffff83055d610000 ffff83055d610000 00000000ffffffff (XEN) [2013-08-23 15:22:29] 0000000000000002 ffff83055d617f10 ffff82d08015cfe2 ffff83009fafd000 (XEN) [2013-08-23 15:22:29] ffff83009fd16000 ffff83055d617dd8 0000000000000000 0000000000000000 (XEN) [2013-08-23 15:22:29] 0000000000000000 ffffffff81edb630 ffff880059bd7f10 ffff880059bd7fd8 (XEN) [2013-08-23 15:22:29] 0000000000000246 0000000000000000 0000000000000000 0000000000000001 (XEN) [2013-08-23 15:22:29] 0000000000000000 ffffffff810013aa ffff880059bd9070 00000000deadbeef (XEN) [2013-08-23 15:22:29] 00000000deadbeef 0000010000000000 ffffffff810013aa 000000000000e033 (XEN) [2013-08-23 15:22:29] 0000000000000246 ffff880059bd7ef8 000000000000e02b d8dbffeeedd7d7dc (XEN) [2013-08-23 15:22:29] fff7eaecf7edfff7 39b9bd7aef257fbe f7ff7fbdffff9edf 9cffedbd00000002 (XEN) [2013-08-23 15:22:29] ffff83009fafd000 00000034dd307e00 f5df7efbfeffb7df (XEN) [2013-08-23 15:22:29] Xen call trace: (XEN) [2013-08-23 15:22:29] [<ffff82d0801a1b6c>] hpet_broadcast_exit+0/0x171 (XEN) [2013-08-23 15:22:29] [<ffff82d08015cfe2>] idle_loop+0x5b/0x6b (XEN) [2013-08-23 15:22:29] (XEN) [2013-08-23 15:22:29] *** Dumping CPU3 host state: *** (XEN) [2013-08-23 15:22:29] ----[ Xen-4.4-unstable x86_64 debug=y Not tainted ]---- (XEN) [2013-08-23 15:22:29] CPU: 3 (XEN) [2013-08-23 15:22:29] RIP: e008:[<ffff82d0801a1b6c>] hpet_broadcast_exit+0/0x171 (XEN) [2013-08-23 15:22:29] RFLAGS: 0000000000000246 CONTEXT: hypervisor (XEN) [2013-08-23 15:22:29] rax: 0000000000000000 rbx: ffff83055d61a990 rcx: 20c49ba5e353f7cf (XEN) [2013-08-23 15:22:29] rdx: ffff83055d60b020 rsi: 000000176f40c8aa rdi: ffff83055d61a9b8 (XEN) [2013-08-23 15:22:29] rbp: ffff83055d607ef0 rsp: ffff83055d607e88 r8: 00000016f1686bc2 (XEN) [2013-08-23 15:22:29] r9: 0000000000000002 r10: 00000000deadbeef r11: 0000000000000246 (XEN) [2013-08-23 15:22:29] r12: ffff83055d61aa00 r13: 000000174715c9a8 r14: 000000176f40c8aa (XEN) [2013-08-23 15:22:29] r15: ffff83055d60b080 cr0: 000000008005003b cr4: 00000000000006f0 (XEN) [2013-08-23 15:22:29] cr3: 00000005445ee000 cr2: ffff88005608f288 (XEN) [2013-08-23 15:22:29] ds: 002b es: 002b fs: 0000 gs: 0000 ss: e010 cs: e008 (XEN) [2013-08-23 15:22:29] Xen stack trace from rsp=ffff83055d607e88: (XEN) [2013-08-23 15:22:29] ffff82d0801a4052 aaaaaaaaaaaaaa00 00000017478c04d3 ffff82d0802e8180 (XEN) [2013-08-23 15:22:29] ffff82d0802e8000 ffff83055d600000 0000000000000000 0000000000000000 (XEN) [2013-08-23 15:22:30] 00000c7c00024b0d ffff83055d600000 ffff83055d600000 00000000ffffffff (XEN) [2013-08-23 15:22:30] 0000000000000002 ffff83055d607f10 ffff82d08015cfe2 ffff83009fafc000 (XEN) [2013-08-23 15:22:30] ffff83009fd15000 ffff83055d607dd8 0000000000000000 0000000000000000 (XEN) [2013-08-23 15:22:30] 0000000000000000 ffffffff81edb630 ffff880059be9f10 ffff880059be9fd8 (XEN) [2013-08-23 15:22:30] 0000000000000246 0000000000000000 0000000000000000 0000000000000001 (XEN) [2013-08-23 15:22:30] 0000000000000000 ffffffff810013aa ffff880059bda0e0 00000000deadbeef (XEN) [2013-08-23 15:22:30] 00000000deadbeef 0000010000000000 ffffffff810013aa 000000000000e033 (XEN) [2013-08-23 15:22:30] 0000000000000246 ffff880059be9ef8 000000000000e02b fe8deff57affdfd9 (XEN) [2013-08-23 15:22:30] effedfe8ddff3eff e632f9b6f7f7fddd a6affeee7dfbc7f3 bcffbefe00000003 (XEN) [2013-08-23 15:22:30] ffff83009fafc000 00000034dd2f9e00 ddbdffd6cdd5dfff (XEN) [2013-08-23 15:22:30] Xen call trace: (XEN) [2013-08-23 15:22:30] [<ffff82d0801a1b6c>] hpet_broadcast_exit+0/0x171 (XEN) [2013-08-23 15:22:30] [<ffff82d08015cfe2>] idle_loop+0x5b/0x6b (XEN) [2013-08-23 15:22:30] (XEN) [2013-08-23 15:22:30] *** Dumping CPU4 host state: *** (XEN) [2013-08-23 15:22:30] ----[ Xen-4.4-unstable x86_64 debug=y Not tainted ]---- (XEN) [2013-08-23 15:22:30] CPU: 4 (XEN) [2013-08-23 15:22:30] RIP: e008:[<ffff82d0801a1b6c>] hpet_broadcast_exit+0/0x171 (XEN) [2013-08-23 15:22:30] RFLAGS: 0000000000000246 CONTEXT: hypervisor (XEN) [2013-08-23 15:22:30] rax: 0000000000000000 rbx: ffff83055d61ae30 rcx: 20c49ba5e353f7cf (XEN) [2013-08-23 15:22:30] rdx: ffff83054f5fd020 rsi: 00000017979f0345 rdi: ffff83055d61ae58 (XEN) [2013-08-23 15:22:30] rbp: ffff83054f5f7ef0 rsp: ffff83054f5f7e88 r8: 00000016f1686bc2 (XEN) [2013-08-23 15:22:30] r9: 0000000000000000 r10: 00000000deadbeef r11: 0000000000000246 (XEN) [2013-08-23 15:22:30] r12: ffff83055d61aea0 r13: 000000176fda8635 r14: 00000017979f0345 (XEN) [2013-08-23 15:22:30] r15: ffff83054f5fd080 cr0: 000000008005003b cr4: 00000000000006f0 (XEN) [2013-08-23 15:22:30] cr3: 0000000543a57000 cr2: ffff880055430550 (XEN) [2013-08-23 15:22:30] ds: 002b es: 002b fs: 0000 gs: 0000 ss: e010 cs: e008 (XEN) [2013-08-23 15:22:30] Xen stack trace from rsp=ffff83054f5f7e88: (XEN) [2013-08-23 15:22:30] ffff82d0801a4052 aaaaaaaaaaaaaa00 000000176fe1083a ffff82d0802e8200 (XEN) [2013-08-23 15:22:30] ffff82d0802e8000 ffff83054f5f0000 0000000000000000 0000000000000000 (XEN) [2013-08-23 15:22:30] 000001e000000192 ffff83054f5f0000 ffff83054f5f0000 00000000ffffffff (XEN) [2013-08-23 15:22:30] 0000000000000002 ffff83054f5f7f10 ffff82d08015cfe2 ffff83009ff8b000 (XEN) [2013-08-23 15:22:30] ffff83009fd14000 ffff83054f5f7dd8 0000000000000000 0000000000000000 (XEN) [2013-08-23 15:22:30] 0000000000000000 ffffffff81edb630 ffff880059bebf10 ffff880059bebfd8 (XEN) [2013-08-23 15:22:30] 0000000000000246 0000000000000000 0000000000000000 0000000000000001 (XEN) [2013-08-23 15:22:30] 0000000000000000 ffffffff810013aa ffff880059bdb150 00000000deadbeef (XEN) [2013-08-23 15:22:30] 00000000deadbeef 0000010000000000 ffffffff810013aa 000000000000e033 (XEN) [2013-08-23 15:22:30] 0000000000000246 ffff880059bebef8 000000000000e02b 0004000008004880 (XEN) [2013-08-23 15:22:30] 0000000000880008 0010002120041000 1083810011500024 0440080800000004 (XEN) [2013-08-23 15:22:30] ffff83009ff8b000 00000034cf2ebe00 0000000000040003 (XEN) [2013-08-23 15:22:30] Xen call trace: (XEN) [2013-08-23 15:22:30] [<ffff82d0801a1b6c>] hpet_broadcast_exit+0/0x171 (XEN) [2013-08-23 15:22:30] [<ffff82d08015cfe2>] idle_loop+0x5b/0x6b (XEN) [2013-08-23 15:22:30] (XEN) [2013-08-23 15:22:31] *** Dumping CPU5 host state: *** (XEN) [2013-08-23 15:22:31] ----[ Xen-4.4-unstable x86_64 debug=y Not tainted ]---- (XEN) [2013-08-23 15:22:31] CPU: 5 (XEN) [2013-08-23 15:22:31] RIP: e008:[<ffff82d0801a1b6c>] hpet_broadcast_exit+0/0x171 (XEN) [2013-08-23 15:22:31] RFLAGS: 0000000000000246 CONTEXT: hypervisor (XEN) [2013-08-23 15:22:31] rax: 0000000000000000 rbx: ffff83054f5ed2e0 rcx: 20c49ba5e353f7cf (XEN) [2013-08-23 15:22:31] rdx: ffff83054f5ee020 rsi: 00000017bffd4341 rdi: ffff83054f5ed308 (XEN) [2013-08-23 15:22:31] rbp: ffff83054f5e7ef0 rsp: ffff83054f5e7e88 r8: 00000016f1686bc2 (XEN) [2013-08-23 15:22:31] r9: 0000000000000000 r10: 00000000deadbeef r11: 0000000000000246 (XEN) [2013-08-23 15:22:31] r12: ffff83054f5ed350 r13: 0000001797b9255f r14: 00000017bffd4341 (XEN) [2013-08-23 15:22:31] r15: ffff83054f5ee080 cr0: 000000008005003b cr4: 00000000000006f0 (XEN) [2013-08-23 15:22:31] cr3: 000000054413d000 cr2: ffff88005608f288 (XEN) [2013-08-23 15:22:31] ds: 002b es: 002b fs: 0000 gs: 0000 ss: e010 cs: e008 (XEN) [2013-08-23 15:22:31] Xen stack trace from rsp=ffff83054f5e7e88: (XEN) [2013-08-23 15:22:31] ffff82d0801a4052 ffff82d080226200 00000017a3886eae ffff82d0802e8280 (XEN) [2013-08-23 15:22:31] ffff82d0802e8000 ffff83054f5e0000 0000000000000000 0000000000000000 (XEN) [2013-08-23 15:22:31] 000001380000059b ffff83054f5e0000 ffff83054f5e0000 00000000ffffffff (XEN) [2013-08-23 15:22:31] 0000000000000002 ffff83054f5e7f10 ffff82d08015cfe2 ffff83009ff8a000 (XEN) [2013-08-23 15:22:31] ffff83009fafb000 ffff83054f5e7dd8 0000000000000000 0000000000000000 (XEN) [2013-08-23 15:22:31] 0000000000000000 ffffffff81edb630 ffff880059bedf10 ffff880059bedfd8 (XEN) [2013-08-23 15:22:31] 0000000000000246 0000000000000000 0000000000000000 0000000000000001 (XEN) [2013-08-23 15:22:31] 0000000000000000 ffffffff810013aa ffff880059bdc1c0 00000000deadbeef (XEN) [2013-08-23 15:22:31] 00000000deadbeef 0000010000000000 ffffffff810013aa 000000000000e033 (XEN) [2013-08-23 15:22:31] 0000000000000246 ffff880059bedef8 000000000000e02b 8000000008000000 (XEN) [2013-08-23 15:22:31] 1000820000104080 0100000000082000 0010220000100000 4080080000000005 (XEN) [2013-08-23 15:22:31] ffff83009ff8a000 00000034cf2dce00 0000000200080000 (XEN) [2013-08-23 15:22:31] Xen call trace: (XEN) [2013-08-23 15:22:31] [<ffff82d0801a1b6c>] hpet_broadcast_exit+0/0x171 (XEN) [2013-08-23 15:22:31] [<ffff82d08015cfe2>] idle_loop+0x5b/0x6b (XEN) [2013-08-23 15:22:31] (XEN) [2013-08-23 15:22:32] ''c'' pressed -> printing ACPI Cx structures (XEN) [2013-08-23 15:22:32] ==cpu0=(XEN) [2013-08-23 15:22:32] active state: C0 (XEN) [2013-08-23 15:22:32] max_cstate: C7 (XEN) [2013-08-23 15:22:32] states: (XEN) [2013-08-23 15:22:32] C1: type[C1] latency[000] usage[00024686] method[ HALT] duration[10342579609] (XEN) [2013-08-23 15:22:32] C2: type[C2] latency[075] usage[00012058] method[SYSIO] duration[62162001141] (XEN) [2013-08-23 15:22:32] *C0: usage[00036744] duration[30816958226] (XEN) [2013-08-23 15:22:32] PC2[0] PC3[0] PC6[0] PC7[0] (XEN) [2013-08-23 15:22:32] CC3[0] CC6[0] CC7[0] (XEN) [2013-08-23 15:22:32] ==cpu1=(XEN) [2013-08-23 15:22:32] active state: C2 (XEN) [2013-08-23 15:22:32] max_cstate: C7 (XEN) [2013-08-23 15:22:32] states: (XEN) [2013-08-23 15:22:32] C1: type[C1] latency[000] usage[00009068] method[ HALT] duration[6911130782] (XEN) [2013-08-23 15:22:32] *C2: type[C2] latency[075] usage[00008655] method[SYSIO] duration[73973533181] (XEN) [2013-08-23 15:22:32] C0: usage[00017723] duration[22436949294] (XEN) [2013-08-23 15:22:32] PC2[0] PC3[0] PC6[0] PC7[0] (XEN) [2013-08-23 15:22:32] CC3[0] CC6[0] CC7[0] (XEN) [2013-08-23 15:22:32] ==cpu2=(XEN) [2013-08-23 15:22:32] active state: C2 (XEN) [2013-08-23 15:22:32] max_cstate: C7 (XEN) [2013-08-23 15:22:32] states: (XEN) [2013-08-23 15:22:32] C1: type[C1] latency[000] usage[00007151] method[ HALT] duration[4853618375] (XEN) [2013-08-23 15:22:32] *C2: type[C2] latency[075] usage[00007783] method[SYSIO] duration[74295782232] (XEN) [2013-08-23 15:22:32] C0: usage[00014934] duration[24172296662] (XEN) [2013-08-23 15:22:32] PC2[0] PC3[0] PC6[0] PC7[0] (XEN) [2013-08-23 15:22:32] CC3[0] CC6[0] CC7[0] (XEN) [2013-08-23 15:22:32] ==cpu3=(XEN) [2013-08-23 15:22:32] active state: C2 (XEN) [2013-08-23 15:22:32] max_cstate: C7 (XEN) [2013-08-23 15:22:32] states: (XEN) [2013-08-23 15:22:32] C1: type[C1] latency[000] usage[00008905] method[ HALT] duration[6618615267] (XEN) [2013-08-23 15:22:32] *C2: type[C2] latency[075] usage[00007283] method[SYSIO] duration[75236799237] (XEN) [2013-08-23 15:22:32] C0: usage[00016188] duration[21466365206] (XEN) [2013-08-23 15:22:32] PC2[0] PC3[0] PC6[0] PC7[0] (XEN) [2013-08-23 15:22:32] CC3[0] CC6[0] CC7[0] (XEN) [2013-08-23 15:22:32] ==cpu4=(XEN) [2013-08-23 15:22:32] active state: C2 (XEN) [2013-08-23 15:22:32] max_cstate: C7 (XEN) [2013-08-23 15:22:32] states: (XEN) [2013-08-23 15:22:32] C1: type[C1] latency[000] usage[00009266] method[ HALT] duration[6916664523] (XEN) [2013-08-23 15:22:32] *C2: type[C2] latency[075] usage[00007032] method[SYSIO] duration[76334009461] (XEN) [2013-08-23 15:22:32] C0: usage[00016298] duration[20071187759] (XEN) [2013-08-23 15:22:32] PC2[0] PC3[0] PC6[0] PC7[0] (XEN) [2013-08-23 15:22:32] CC3[0] CC6[0] CC7[0] (XEN) [2013-08-23 15:22:32] ==cpu5=(XEN) [2013-08-23 15:22:32] active state: C2 (XEN) [2013-08-23 15:22:32] max_cstate: C7 (XEN) [2013-08-23 15:22:32] states: (XEN) [2013-08-23 15:22:32] C1: type[C1] latency[000] usage[00007974] method[ HALT] duration[5790940609] (XEN) [2013-08-23 15:22:32] *C2: type[C2] latency[075] usage[00006719] method[SYSIO] duration[76829441425] (XEN) [2013-08-23 15:22:32] C0: usage[00014693] duration[20701562661] (XEN) [2013-08-23 15:22:32] PC2[0] PC3[0] PC6[0] PC7[0] (XEN) [2013-08-23 15:22:32] CC3[0] CC6[0] CC7[0] (XEN) [2013-08-23 15:22:35] number of MP IRQ sources: 15. (XEN) [2013-08-23 15:22:35] number of IO-APIC #6 registers: 24. (XEN) [2013-08-23 15:22:35] number of IO-APIC #7 registers: 32. (XEN) [2013-08-23 15:22:35] testing the IO APIC....................... (XEN) [2013-08-23 15:22:35] IO APIC #6...... (XEN) [2013-08-23 15:22:35] .... register #00: 06000000 (XEN) [2013-08-23 15:22:35] ....... : physical APIC id: 06 (XEN) [2013-08-23 15:22:35] ....... : Delivery Type: 0 (XEN) [2013-08-23 15:22:35] ....... : LTS : 0 (XEN) [2013-08-23 15:22:35] .... register #01: 00178021 (XEN) [2013-08-23 15:22:35] ....... : max redirection entries: 0017 (XEN) [2013-08-23 15:22:35] ....... : PRQ implemented: 1 (XEN) [2013-08-23 15:22:35] ....... : IO APIC version: 0021 (XEN) [2013-08-23 15:22:35] .... register #02: 06000000 (XEN) [2013-08-23 15:22:35] ....... : arbitration: 06 (XEN) [2013-08-23 15:22:35] .... register #03: 07000000 (XEN) [2013-08-23 15:22:35] ....... : Boot DT : 0 (XEN) [2013-08-23 15:22:35] .... IRQ redirection table: (XEN) [2013-08-23 15:22:35] NR Log Phy Mask Trig IRR Pol Stat Dest Deli Vect: (XEN) [2013-08-23 15:22:35] 00 000 00 1 0 0 0 0 0 1 A8 (XEN) [2013-08-23 15:22:35] 01 001 01 0 0 0 0 0 1 1 A8 (XEN) [2013-08-23 15:22:35] 02 001 01 0 0 0 0 0 1 1 F0 (XEN) [2013-08-23 15:22:35] 03 001 01 0 0 0 0 0 1 1 38 (XEN) [2013-08-23 15:22:35] 04 001 01 0 0 0 0 0 1 1 F1 (XEN) [2013-08-23 15:22:35] 05 001 01 0 0 0 0 0 1 1 40 (XEN) [2013-08-23 15:22:35] 06 001 01 0 0 0 0 0 1 1 48 (XEN) [2013-08-23 15:22:35] 07 001 01 0 0 0 0 0 1 1 50 (XEN) [2013-08-23 15:22:35] 08 001 01 0 0 0 0 0 1 1 58 (XEN) [2013-08-23 15:22:35] 09 001 01 0 1 0 1 0 1 0 60 (XEN) [2013-08-23 15:22:35] 0a 001 01 0 0 0 0 0 1 1 68 (XEN) [2013-08-23 15:22:35] 0b 001 01 0 0 0 0 0 1 1 70 (XEN) [2013-08-23 15:22:35] 0c 001 01 0 0 0 0 0 1 1 78 (XEN) [2013-08-23 15:22:35] 0d 03F 0F 1 0 0 0 0 1 1 88 (XEN) [2013-08-23 15:22:35] 0e 001 01 0 0 0 0 0 1 1 90 (XEN) [2013-08-23 15:22:35] 0f 001 01 0 0 0 0 0 1 1 98 (XEN) [2013-08-23 15:22:35] 10 03F 0F 1 1 0 1 0 1 0 00 (XEN) [2013-08-23 15:22:35] 11 001 01 0 1 0 1 0 1 0 21 (XEN) [2013-08-23 15:22:35] 12 001 01 0 1 0 1 0 1 0 D8 (XEN) [2013-08-23 15:22:35] 13 03F 0F 1 1 0 1 0 1 0 00 (XEN) [2013-08-23 15:22:35] 14 000 00 1 0 0 0 0 0 1 A8 (XEN) [2013-08-23 15:22:35] 15 000 00 1 0 0 0 0 0 1 A8 (XEN) [2013-08-23 15:22:35] 16 03F 0F 1 1 0 1 0 1 0 00 (XEN) [2013-08-23 15:22:35] 17 000 00 1 0 0 0 0 0 1 A8 (XEN) [2013-08-23 15:22:35] IO APIC #7...... (XEN) [2013-08-23 15:22:35] .... register #00: 07000000 (XEN) [2013-08-23 15:22:35] ....... : physical APIC id: 07 (XEN) [2013-08-23 15:22:35] ....... : Delivery Type: 0 (XEN) [2013-08-23 15:22:35] ....... : LTS : 0 (XEN) [2013-08-23 15:22:35] .... register #01: 001F8021 (XEN) [2013-08-23 15:22:35] ....... : max redirection entries: 001F (XEN) [2013-08-23 15:22:35] ....... : PRQ implemented: 1 (XEN) [2013-08-23 15:22:35] ....... : IO APIC version: 0021 (XEN) [2013-08-23 15:22:35] .... register #02: 00000000 (XEN) [2013-08-23 15:22:35] ....... : arbitration: 00 (XEN) [2013-08-23 15:22:35] .... IRQ redirection table: (XEN) [2013-08-23 15:22:35] NR Log Phy Mask Trig IRR Pol Stat Dest Deli Vect: (XEN) [2013-08-23 15:22:35] 00 000 00 1 0 0 0 0 0 0 00 (XEN) [2013-08-23 15:22:35] 01 000 00 1 0 0 0 0 0 0 00 (XEN) [2013-08-23 15:22:35] 02 000 00 1 0 0 0 0 0 0 00 (XEN) [2013-08-23 15:22:35] 03 000 00 1 0 0 0 0 0 0 00 (XEN) [2013-08-23 15:22:35] 04 03F 0F 1 1 0 1 0 1 0 00 (XEN) [2013-08-23 15:22:35] 05 03F 0F 1 1 0 1 0 1 0 00 (XEN) [2013-08-23 15:22:35] 06 000 00 1 0 0 0 0 0 0 00 (XEN) [2013-08-23 15:22:35] 07 000 00 1 0 0 0 0 0 0 00 (XEN) [2013-08-23 15:22:35] 08 03F 0F 1 1 0 1 0 1 0 00 (XEN) [2013-08-23 15:22:35] 09 03F 0F 1 1 0 1 0 1 0 00 (XEN) [2013-08-23 15:22:35] 0a 000 00 1 0 0 0 0 0 0 00 (XEN) [2013-08-23 15:22:35] 0b 000 00 1 0 0 0 0 0 0 00 (XEN) [2013-08-23 15:22:35] 0c 000 00 1 0 0 0 0 0 0 00 (XEN) [2013-08-23 15:22:35] 0d 03F 0F 1 1 0 1 0 1 0 00 (XEN) [2013-08-23 15:22:35] 0e 03F 0F 1 1 0 1 0 1 0 00 (XEN) [2013-08-23 15:22:35] 0f 03F 0F 1 1 0 1 0 1 0 00 (XEN) [2013-08-23 15:22:35] 10 03F 0F 1 1 0 1 0 1 0 00 (XEN) [2013-08-23 15:22:35] 11 000 00 1 0 0 0 0 0 0 00 (XEN) [2013-08-23 15:22:35] 12 000 00 1 0 0 0 0 0 0 00 (XEN) [2013-08-23 15:22:35] 13 000 00 1 0 0 0 0 0 0 00 (XEN) [2013-08-23 15:22:35] 14 000 00 1 0 0 0 0 0 0 00 (XEN) [2013-08-23 15:22:35] 15 000 00 1 0 0 0 0 0 0 00 (XEN) [2013-08-23 15:22:35] 16 03F 0F 1 1 0 1 0 1 0 00 (XEN) [2013-08-23 15:22:35] 17 03F 0F 1 1 0 1 0 1 0 00 (XEN) [2013-08-23 15:22:35] 18 03F 0F 1 1 0 1 0 1 0 00 (XEN) [2013-08-23 15:22:35] 19 000 00 1 0 0 0 0 0 0 00 (XEN) [2013-08-23 15:22:35] 1a 000 00 1 0 0 0 0 0 0 00 (XEN) [2013-08-23 15:22:35] 1b 03F 0F 1 1 0 1 0 1 0 00 (XEN) [2013-08-23 15:22:35] 1c 03F 0F 1 1 0 1 0 1 0 00 (XEN) [2013-08-23 15:22:35] 1d 03F 0F 1 1 0 1 0 1 0 00 (XEN) [2013-08-23 15:22:35] 1e 03F 0F 1 1 0 1 0 1 0 00 (XEN) [2013-08-23 15:22:35] 1f 000 00 1 0 0 0 0 0 0 00 (XEN) [2013-08-23 15:22:35] Using vector-based indexing (XEN) [2013-08-23 15:22:35] IRQ to pin mappings: (XEN) [2013-08-23 15:22:35] IRQ240 -> 0:2 (XEN) [2013-08-23 15:22:35] IRQ48 -> 0:1 (XEN) [2013-08-23 15:22:35] IRQ56 -> 0:3 (XEN) [2013-08-23 15:22:35] IRQ241 -> 0:4 (XEN) [2013-08-23 15:22:35] IRQ64 -> 0:5 (XEN) [2013-08-23 15:22:35] IRQ72 -> 0:6 (XEN) [2013-08-23 15:22:35] IRQ80 -> 0:7 (XEN) [2013-08-23 15:22:35] IRQ88 -> 0:8 (XEN) [2013-08-23 15:22:35] IRQ96 -> 0:9 (XEN) [2013-08-23 15:22:35] IRQ104 -> 0:10 (XEN) [2013-08-23 15:22:35] IRQ112 -> 0:11 (XEN) [2013-08-23 15:22:35] IRQ120 -> 0:12 (XEN) [2013-08-23 15:22:35] IRQ136 -> 0:13 (XEN) [2013-08-23 15:22:35] IRQ144 -> 0:14 (XEN) [2013-08-23 15:22:35] IRQ152 -> 0:15 (XEN) [2013-08-23 15:22:35] IRQ208 -> 0:16 (XEN) [2013-08-23 15:22:35] IRQ33 -> 0:17 (XEN) [2013-08-23 15:22:35] IRQ216 -> 0:18 (XEN) [2013-08-23 15:22:35] IRQ209 -> 0:19 (XEN) [2013-08-23 15:22:35] IRQ161 -> 0:22 (XEN) [2013-08-23 15:22:35] IRQ201 -> 1:4 (XEN) [2013-08-23 15:22:35] IRQ193 -> 1:5 (XEN) [2013-08-23 15:22:35] IRQ177 -> 1:8 (XEN) [2013-08-23 15:22:35] IRQ169 -> 1:9 (XEN) [2013-08-23 15:22:35] IRQ49 -> 1:13 (XEN) [2013-08-23 15:22:35] IRQ57 -> 1:14 (XEN) [2013-08-23 15:22:35] IRQ65 -> 1:15 (XEN) [2013-08-23 15:22:35] IRQ73 -> 1:16 (XEN) [2013-08-23 15:22:35] IRQ34 -> 1:22 (XEN) [2013-08-23 15:22:35] IRQ185 -> 1:23 (XEN) [2013-08-23 15:22:35] IRQ41 -> 1:24 (XEN) [2013-08-23 15:22:35] IRQ50 -> 1:27 (XEN) [2013-08-23 15:22:35] IRQ184 -> 1:28 (XEN) [2013-08-23 15:22:35] IRQ192 -> 1:29 (XEN) [2013-08-23 15:22:35] IRQ200 -> 1:30 (XEN) [2013-08-23 15:22:35] .................................... done. [ 109.270455] EXT4-fs (dm-2): mounted filesystem with ordered data mode. Opts: barrier=1,errors=remount-ro (XEN) [2013-08-23 15:22:39] MSI information: (XEN) [2013-08-23 15:22:39] MSI 56 vec=28 lowest edge assert log lowest dest=00000001 mask=0/0/? (XEN) [2013-08-23 15:22:39] HPET 57 vec=a0 lowest edge assert log lowest dest=00000001 mask=1/0/? (XEN) [2013-08-23 15:22:39] HPET 58 vec=a8 lowest edge assert log lowest dest=00000004 mask=1/0/? (XEN) [2013-08-23 15:22:39] HPET 59 vec=b0 lowest edge assert log lowest dest=00000004 mask=1/0/? (XEN) [2013-08-23 15:22:39] MSI 60 vec=51 lowest edge assert log lowest dest=0000003f mask=0/1/? (XEN) [2013-08-23 15:22:39] MSI 61 vec=59 lowest edge assert log lowest dest=0000003f mask=0/1/? (XEN) [2013-08-23 15:22:39] MSI 62 vec=61 lowest edge assert log lowest dest=0000003f mask=0/1/? (XEN) [2013-08-23 15:22:39] MSI 63 vec=69 lowest edge assert log lowest dest=0000003f mask=0/1/? (XEN) [2013-08-23 15:22:39] MSI 64 vec=71 lowest edge assert log lowest dest=0000003f mask=0/1/? (XEN) [2013-08-23 15:22:39] MSI 65 vec=79 lowest edge assert log lowest dest=0000003f mask=0/1/? (XEN) [2013-08-23 15:22:39] MSI 66 vec=81 lowest edge assert log lowest dest=0000003f mask=0/1/? (XEN) [2013-08-23 15:22:39] MSI 67 vec=89 lowest edge assert log lowest dest=0000003f mask=0/1/? (XEN) [2013-08-23 15:22:39] MSI 68 vec=91 lowest edge assert log lowest dest=0000003f mask=0/1/? (XEN) [2013-08-23 15:22:39] MSI 69 vec=99 lowest edge assert log lowest dest=0000003f mask=0/1/? (XEN) [2013-08-23 15:22:39] MSI 70 vec=d9 lowest edge assert log lowest dest=00000001 mask=0/1/? (XEN) [2013-08-23 15:22:39] MSI 71 vec=2a lowest edge assert log lowest dest=00000001 mask=0/1/? (XEN) [2013-08-23 15:22:39] MSI 72 vec=3a lowest edge assert log lowest dest=00000001 mask=0/1/? (XEN) [2013-08-23 15:22:39] MSI-X 73 vec=42 lowest edge assert log lowest dest=00000001 mask=1/0/0 (XEN) [2013-08-23 15:22:39] MSI-X 74 vec=4a lowest edge assert log lowest dest=00000001 mask=1/0/0 (XEN) [2013-08-23 15:22:39] MSI-X 75 vec=52 lowest edge assert log lowest dest=00000001 mask=1/0/0 (XEN) [2013-08-23 15:22:39] MSI-X 76 vec=5a lowest edge assert log lowest dest=00000001 mask=1/0/0 (XEN) [2013-08-23 15:22:39] MSI-X 77 vec=62 lowest edge assert log lowest dest=00000001 mask=1/0/0 (XEN) [2013-08-23 15:22:39] MSI-X 78 vec=6a lowest edge assert log lowest dest=00000001 mask=1/0/0 (XEN) [2013-08-23 15:22:39] MSI-X 79 vec=72 lowest edge assert log lowest dest=00000001 mask=1/0/0 (XEN) [2013-08-23 15:22:40] Guest interrupt information: (XEN) [2013-08-23 15:22:40] IRQ: 0 affinity:01 vec:f0 type=IO-APIC-edge status=00000000 timer_interrupt+0/0x14a (XEN) [2013-08-23 15:22:40] IRQ: 1 affinity:01 vec:30 type=IO-APIC-edge status=00000010 in-flight=0 domain-list=0: 1(----), (XEN) [2013-08-23 15:22:40] IRQ: 3 affinity:01 vec:38 type=IO-APIC-edge status=00000002 mapped, unbound (XEN) [2013-08-23 15:22:40] IRQ: 4 affinity:01 vec:f1 type=IO-APIC-edge status=00000000 ns16550_interrupt+0/0x68 (XEN) [2013-08-23 15:22:40] IRQ: 5 affinity:01 vec:40 type=IO-APIC-edge status=00000002 mapped, unbound (XEN) [2013-08-23 15:22:40] IRQ: 6 affinity:01 vec:48 type=IO-APIC-edge status=00000002 mapped, unbound (XEN) [2013-08-23 15:22:40] IRQ: 7 affinity:01 vec:50 type=IO-APIC-edge status=00000002 mapped, unbound (XEN) [2013-08-23 15:22:40] IRQ: 8 affinity:01 vec:58 type=IO-APIC-edge status=00000010 in-flight=0 domain-list=0: 8(----), (XEN) [2013-08-23 15:22:40] IRQ: 9 affinity:01 vec:60 type=IO-APIC-level status=00000010 in-flight=0 domain-list=0: 9(----), (XEN) [2013-08-23 15:22:40] IRQ: 10 affinity:01 vec:68 type=IO-APIC-edge status=00000002 mapped, unbound (XEN) [2013-08-23 15:22:40] IRQ: 11 affinity:01 vec:70 type=IO-APIC-edge status=00000002 mapped, unbound (XEN) [2013-08-23 15:22:40] IRQ: 12 affinity:01 vec:78 type=IO-APIC-edge status=00000010 in-flight=0 domain-list=0: 12(----), (XEN) [2013-08-23 15:22:40] IRQ: 13 affinity:3f vec:88 type=IO-APIC-edge status=00000002 mapped, unbound (XEN) [2013-08-23 15:22:40] IRQ: 14 affinity:01 vec:90 type=IO-APIC-edge status=00000002 mapped, unbound (XEN) [2013-08-23 15:22:40] IRQ: 15 affinity:01 vec:98 type=IO-APIC-edge status=00000002 mapped, unbound (XEN) [2013-08-23 15:22:40] IRQ: 16 affinity:3f vec:d0 type=IO-APIC-level status=00000002 mapped, unbound (XEN) [2013-08-23 15:22:40] IRQ: 17 affinity:01 vec:21 type=IO-APIC-level status=00000010 in-flight=0 domain-list=0: 17(----), (XEN) [2013-08-23 15:22:40] IRQ: 18 affinity:01 vec:d8 type=IO-APIC-level status=00000010 in-flight=0 domain-list=0: 18(----), (XEN) [2013-08-23 15:22:40] IRQ: 19 affinity:3f vec:d1 type=IO-APIC-level status=00000002 mapped, unbound (XEN) [2013-08-23 15:22:40] IRQ: 22 affinity:3f vec:a1 type=IO-APIC-level status=00000002 mapped, unbound (XEN) [2013-08-23 15:22:40] IRQ: 28 affinity:3f vec:c9 type=IO-APIC-level status=00000002 mapped, unbound (XEN) [2013-08-23 15:22:40] IRQ: 29 affinity:3f vec:c1 type=IO-APIC-level status=00000002 mapped, unbound (XEN) [2013-08-23 15:22:40] IRQ: 32 affinity:3f vec:b1 type=IO-APIC-level status=00000002 mapped, unbound (XEN) [2013-08-23 15:22:40] IRQ: 33 affinity:3f vec:a9 type=IO-APIC-level status=00000002 mapped, unbound (XEN) [2013-08-23 15:22:40] IRQ: 37 affinity:3f vec:31 type=IO-APIC-level status=00000002 mapped, unbound (XEN) [2013-08-23 15:22:40] IRQ: 38 affinity:3f vec:39 type=IO-APIC-level status=00000002 mapped, unbound (XEN) [2013-08-23 15:22:40] IRQ: 39 affinity:3f vec:41 type=IO-APIC-level status=00000002 mapped, unbound (XEN) [2013-08-23 15:22:40] IRQ: 40 affinity:3f vec:49 type=IO-APIC-level status=00000002 mapped, unbound (XEN) [2013-08-23 15:22:40] IRQ: 46 affinity:3f vec:22 type=IO-APIC-level status=00000002 mapped, unbound (XEN) [2013-08-23 15:22:40] IRQ: 47 affinity:3f vec:b9 type=IO-APIC-level status=00000002 mapped, unbound (XEN) [2013-08-23 15:22:40] IRQ: 48 affinity:3f vec:29 type=IO-APIC-level status=00000002 mapped, unbound (XEN) [2013-08-23 15:22:40] IRQ: 51 affinity:3f vec:32 type=IO-APIC-level status=00000002 mapped, unbound (XEN) [2013-08-23 15:22:40] IRQ: 52 affinity:3f vec:b8 type=IO-APIC-level status=00000002 mapped, unbound (XEN) [2013-08-23 15:22:40] IRQ: 53 affinity:3f vec:c0 type=IO-APIC-level status=00000002 mapped, unbound (XEN) [2013-08-23 15:22:40] IRQ: 54 affinity:3f vec:c8 type=IO-APIC-level status=00000002 mapped, unbound (XEN) [2013-08-23 15:22:40] IRQ: 56 affinity:01 vec:28 type=AMD-IOMMU-MSI status=00000000 iommu_interrupt_handler+0/0x54 (XEN) [2013-08-23 15:22:40] IRQ: 57 affinity:01 vec:a0 type=HPET-MSI status=00000000 hpet_interrupt_handler+0/0x40 (XEN) [2013-08-23 15:22:40] IRQ: 58 affinity:04 vec:a8 type=HPET-MSI status=00000000 hpet_interrupt_handler+0/0x40 (XEN) [2013-08-23 15:22:40] IRQ: 59 affinity:04 vec:b0 type=HPET-MSI status=00000000 hpet_interrupt_handler+0/0x40 (XEN) [2013-08-23 15:22:40] IRQ: 60 affinity:3f vec:51 type=PCI-MSI status=00000002 mapped, unbound (XEN) [2013-08-23 15:22:40] IRQ: 61 affinity:3f vec:59 type=PCI-MSI status=00000002 mapped, unbound (XEN) [2013-08-23 15:22:40] IRQ: 62 affinity:3f vec:61 type=PCI-MSI status=00000002 mapped, unbound (XEN) [2013-08-23 15:22:40] IRQ: 63 affinity:3f vec:69 type=PCI-MSI status=00000002 mapped, unbound (XEN) [2013-08-23 15:22:40] IRQ: 64 affinity:3f vec:71 type=PCI-MSI status=00000002 mapped, unbound (XEN) [2013-08-23 15:22:40] IRQ: 65 affinity:3f vec:79 type=PCI-MSI status=00000002 mapped, unbound (XEN) [2013-08-23 15:22:40] IRQ: 66 affinity:3f vec:81 type=PCI-MSI status=00000002 mapped, unbound (XEN) [2013-08-23 15:22:40] IRQ: 67 affinity:3f vec:89 type=PCI-MSI status=00000002 mapped, unbound (XEN) [2013-08-23 15:22:40] IRQ: 68 affinity:3f vec:91 type=PCI-MSI status=00000002 mapped, unbound (XEN) [2013-08-23 15:22:40] IRQ: 69 affinity:3f vec:99 type=PCI-MSI status=00000002 mapped, unbound (XEN) [2013-08-23 15:22:40] IRQ: 70 affinity:01 vec:d9 type=PCI-MSI status=00000010 in-flight=0 domain-list=0:301(----), (XEN) [2013-08-23 15:22:40] IRQ: 71 affinity:01 vec:2a type=PCI-MSI status=00000010 in-flight=0 domain-list=0:300(----), (XEN) [2013-08-23 15:22:40] IRQ: 72 affinity:01 vec:3a type=PCI-MSI status=00000010 in-flight=0 domain-list=0:299(----), (XEN) [2013-08-23 15:22:40] IRQ: 73 affinity:01 vec:42 type=PCI-MSI/-X status=00000010 in-flight=0 domain-list=0:298(----), (XEN) [2013-08-23 15:22:40] IRQ: 74 affinity:01 vec:4a type=PCI-MSI/-X status=00000010 in-flight=0 domain-list=0:297(----), (XEN) [2013-08-23 15:22:40] IRQ: 75 affinity:01 vec:52 type=PCI-MSI/-X status=00000010 in-flight=0 domain-list=0:296(----), (XEN) [2013-08-23 15:22:40] IRQ: 76 affinity:01 vec:5a type=PCI-MSI/-X status=00000010 in-flight=0 domain-list=0:295(----), (XEN) [2013-08-23 15:22:40] IRQ: 77 affinity:01 vec:62 type=PCI-MSI/-X status=00000010 in-flight=0 domain-list=0:294(----), (XEN) [2013-08-23 15:22:40] IRQ: 78 affinity:01 vec:6a type=PCI-MSI/-X status=00000010 in-flight=0 domain-list=0:293(----), (XEN) [2013-08-23 15:22:40] IRQ: 79 affinity:01 vec:72 type=PCI-MSI/-X status=00000010 in-flight=0 domain-list=0:292(----), (XEN) [2013-08-23 15:22:40] IO-APIC interrupt information: (XEN) [2013-08-23 15:22:40] IRQ 0 Vec240: (XEN) [2013-08-23 15:22:40] Apic 0x00, Pin 2: vec=f0 delivery=LoPri dest=L status=0 polarity=0 irr=0 trig=E mask=0 dest_id:1 (XEN) [2013-08-23 15:22:40] IRQ 1 Vec 48: (XEN) [2013-08-23 15:22:40] Apic 0x00, Pin 1: vec=a8 delivery=LoPri dest=L status=0 polarity=0 irr=0 trig=E mask=0 dest_id:1 (XEN) [2013-08-23 15:22:40] IRQ 3 Vec 56: (XEN) [2013-08-23 15:22:40] Apic 0x00, Pin 3: vec=38 delivery=LoPri dest=L status=0 polarity=0 irr=0 trig=E mask=0 dest_id:1 (XEN) [2013-08-23 15:22:40] IRQ 4 Vec241: (XEN) [2013-08-23 15:22:40] Apic 0x00, Pin 4: vec=f1 delivery=LoPri dest=L status=0 polarity=0 irr=0 trig=E mask=0 dest_id:1 (XEN) [2013-08-23 15:22:40] IRQ 5 Vec 64: (XEN) [2013-08-23 15:22:40] Apic 0x00, Pin 5: vec=40 delivery=LoPri dest=L status=0 polarity=0 irr=0 trig=E mask=0 dest_id:1 (XEN) [2013-08-23 15:22:40] IRQ 6 Vec 72: (XEN) [2013-08-23 15:22:40] Apic 0x00, Pin 6: vec=48 delivery=LoPri dest=L status=0 polarity=0 irr=0 trig=E mask=0 dest_id:1 (XEN) [2013-08-23 15:22:40] IRQ 7 Vec 80: (XEN) [2013-08-23 15:22:40] Apic 0x00, Pin 7: vec=50 delivery=LoPri dest=L status=0 polarity=0 irr=0 trig=E mask=0 dest_id:1 (XEN) [2013-08-23 15:22:40] IRQ 8 Vec 88: (XEN) [2013-08-23 15:22:40] Apic 0x00, Pin 8: vec=58 delivery=LoPri dest=L status=0 polarity=0 irr=0 trig=E mask=0 dest_id:1 (XEN) [2013-08-23 15:22:40] IRQ 9 Vec 96: (XEN) [2013-08-23 15:22:40] Apic 0x00, Pin 9: vec=60 delivery=Fixed dest=L status=0 polarity=1 irr=0 trig=L mask=0 dest_id:1 (XEN) [2013-08-23 15:22:40] IRQ 10 Vec104: (XEN) [2013-08-23 15:22:40] Apic 0x00, Pin 10: vec=68 delivery=LoPri dest=L status=0 polarity=0 irr=0 trig=E mask=0 dest_id:1 (XEN) [2013-08-23 15:22:40] IRQ 11 Vec112: (XEN) [2013-08-23 15:22:40] Apic 0x00, Pin 11: vec=70 delivery=LoPri dest=L status=0 polarity=0 irr=0 trig=E mask=0 dest_id:1 (XEN) [2013-08-23 15:22:40] IRQ 12 Vec120: (XEN) [2013-08-23 15:22:40] Apic 0x00, Pin 12: vec=78 delivery=LoPri dest=L status=0 polarity=0 irr=0 trig=E mask=0 dest_id:1 (XEN) [2013-08-23 15:22:40] IRQ 13 Vec136: (XEN) [2013-08-23 15:22:40] Apic 0x00, Pin 13: vec=88 delivery=LoPri dest=L status=0 polarity=0 irr=0 trig=E mask=1 dest_id:63 (XEN) [2013-08-23 15:22:40] IRQ 14 Vec144: (XEN) [2013-08-23 15:22:40] Apic 0x00, Pin 14: vec=90 delivery=LoPri dest=L status=0 polarity=0 irr=0 trig=E mask=0 dest_id:1 (XEN) [2013-08-23 15:22:40] IRQ 15 Vec152: (XEN) [2013-08-23 15:22:40] Apic 0x00, Pin 15: vec=98 delivery=LoPri dest=L status=0 polarity=0 irr=0 trig=E mask=0 dest_id:1 (XEN) [2013-08-23 15:22:40] IRQ 16 Vec208: (XEN) [2013-08-23 15:22:40] Apic 0x00, Pin 16: vec=00 delivery=Fixed dest=L status=0 polarity=1 irr=0 trig=L mask=1 dest_id:63 (XEN) [2013-08-23 15:22:40] IRQ 17 Vec 33: (XEN) [2013-08-23 15:22:40] Apic 0x00, Pin 17: vec=21 delivery=Fixed dest=L status=0 polarity=1 irr=0 trig=L mask=0 dest_id:1 (XEN) [2013-08-23 15:22:40] IRQ 18 Vec216: (XEN) [2013-08-23 15:22:40] Apic 0x00, Pin 18: vec=d8 delivery=Fixed dest=L status=0 polarity=1 irr=0 trig=L mask=0 dest_id:1 (XEN) [2013-08-23 15:22:40] IRQ 19 Vec209: (XEN) [2013-08-23 15:22:40] Apic 0x00, Pin 19: vec=00 delivery=Fixed dest=L status=0 polarity=1 irr=0 trig=L mask=1 dest_id:63 (XEN) [2013-08-23 15:22:40] IRQ 22 Vec161: (XEN) [2013-08-23 15:22:40] Apic 0x00, Pin 22: vec=00 delivery=Fixed dest=L status=0 polarity=1 irr=0 trig=L mask=1 dest_id:63 (XEN) [2013-08-23 15:22:40] IRQ 28 Vec201: (XEN) [2013-08-23 15:22:40] Apic 0x01, Pin 4: vec=00 delivery=Fixed dest=L status=0 polarity=1 irr=0 trig=L mask=1 dest_id:63 (XEN) [2013-08-23 15:22:40] IRQ 29 Vec193: (XEN) [2013-08-23 15:22:40] Apic 0x01, Pin 5: vec=00 delivery=Fixed dest=L status=0 polarity=1 irr=0 trig=L mask=1 dest_id:63 (XEN) [2013-08-23 15:22:40] IRQ 32 Vec177: (XEN) [2013-08-23 15:22:40] Apic 0x01, Pin 8: vec=00 delivery=Fixed dest=L status=0 polarity=1 irr=0 trig=L mask=1 dest_id:63 (XEN) [2013-08-23 15:22:40] IRQ 33 Vec169: (XEN) [2013-08-23 15:22:40] Apic 0x01, Pin 9: vec=00 delivery=Fixed dest=L status=0 polarity=1 irr=0 trig=L mask=1 dest_id:63 (XEN) [2013-08-23 15:22:40] IRQ 37 Vec 49: (XEN) [2013-08-23 15:22:40] Apic 0x01, Pin 13: vec=00 delivery=Fixed dest=L status=0 polarity=1 irr=0 trig=L mask=1 dest_id:63 (XEN) [2013-08-23 15:22:40] IRQ 38 Vec 57: (XEN) [2013-08-23 15:22:40] Apic 0x01, Pin 14: vec=00 delivery=Fixed dest=L status=0 polarity=1 irr=0 trig=L mask=1 dest_id:63 (XEN) [2013-08-23 15:22:40] IRQ 39 Vec 65: (XEN) [2013-08-23 15:22:40] Apic 0x01, Pin 15: vec=00 delivery=Fixed dest=L status=0 polarity=1 irr=0 trig=L mask=1 dest_id:63 (XEN) [2013-08-23 15:22:40] IRQ 40 Vec 73: (XEN) [2013-08-23 15:22:40] Apic 0x01, Pin 16: vec=00 delivery=Fixed dest=L status=0 polarity=1 irr=0 trig=L mask=1 dest_id:63 (XEN) [2013-08-23 15:22:40] IRQ 46 Vec 34: (XEN) [2013-08-23 15:22:40] Apic 0x01, Pin 22: vec=00 delivery=Fixed dest=L status=0 polarity=1 irr=0 trig=L mask=1 dest_id:63 (XEN) [2013-08-23 15:22:40] IRQ 47 Vec185: (XEN) [2013-08-23 15:22:40] Apic 0x01, Pin 23: vec=00 delivery=Fixed dest=L status=0 polarity=1 irr=0 trig=L mask=1 dest_id:63 (XEN) [2013-08-23 15:22:40] IRQ 48 Vec 41: (XEN) [2013-08-23 15:22:40] Apic 0x01, Pin 24: vec=00 delivery=Fixed dest=L status=0 polarity=1 irr=0 trig=L mask=1 dest_id:63 (XEN) [2013-08-23 15:22:40] IRQ 51 Vec 50: (XEN) [2013-08-23 15:22:40] Apic 0x01, Pin 27: vec=00 delivery=Fixed dest=L status=0 polarity=1 irr=0 trig=L mask=1 dest_id:63 (XEN) [2013-08-23 15:22:40] IRQ 52 Vec184: (XEN) [2013-08-23 15:22:40] Apic 0x01, Pin 28: vec=00 delivery=Fixed dest=L status=0 polarity=1 irr=0 trig=L mask=1 dest_id:63 (XEN) [2013-08-23 15:22:40] IRQ 53 Vec192: (XEN) [2013-08-23 15:22:40] Apic 0x01, Pin 29: vec=00 delivery=Fixed dest=L status=0 polarity=1 irr=0 trig=L mask=1 dest_id:63 (XEN) [2013-08-23 15:22:40] IRQ 54 Vec200: (XEN) [2013-08-23 15:22:40] Apic 0x01, Pin 30: vec=00 delivery=Fixed dest=L status=0 polarity=1 irr=0 trig=L mask=1 dest_id:63 [ 115.122727] EXT4-fs (dm-38): mounted filesystem with ordered data mode. Opts: barrier=1,errors=remount-ro (XEN) [2013-08-23 15:22:48] *********** VMCB Areas ************** (XEN) [2013-08-23 15:22:48] ************************************** [ 121.061739] EXT4-fs (dm-39): mounted filesystem with ordered data mode. Opts: barrier=1,errors=remount-ro (XEN) [2013-08-23 15:22:50] --- Dumping Per-dev IOMMU Interrupt Remapping Table --- (XEN) [2013-08-23 15:22:50] 0000:00:00:0: (XEN) [2013-08-23 15:22:50] 0000:00:00:1: (XEN) [2013-08-23 15:22:50] 0000:00:00:2: (XEN) [2013-08-23 15:22:50] 0000:00:00:3: (XEN) [2013-08-23 15:22:50] 0000:00:00:4: (XEN) [2013-08-23 15:22:50] 0000:00:00:5: (XEN) [2013-08-23 15:22:50] 0000:00:00:6: (XEN) [2013-08-23 15:22:50] 0000:00:00:7: (XEN) [2013-08-23 15:22:50] 0000:00:01:0: (XEN) [2013-08-23 15:22:50] 0000:00:01:1: (XEN) [2013-08-23 15:22:50] 0000:00:01:2: (XEN) [2013-08-23 15:22:50] 0000:00:01:3: (XEN) [2013-08-23 15:22:50] 0000:00:01:4: (XEN) [2013-08-23 15:22:50] 0000:00:01:5: (XEN) [2013-08-23 15:22:50] 0000:00:01:6: (XEN) [2013-08-23 15:22:50] 0000:00:01:7: (XEN) [2013-08-23 15:22:50] 0000:00:02:0: (XEN) [2013-08-23 15:22:50] IRTE[000] 00513f45 (XEN) [2013-08-23 15:22:50] 0000:00:02:1: (XEN) [2013-08-23 15:22:50] 0000:00:02:2: (XEN) [2013-08-23 15:22:50] 0000:00:02:3: (XEN) [2013-08-23 15:22:50] 0000:00:02:4: (XEN) [2013-08-23 15:22:50] 0000:00:02:5: (XEN) [2013-08-23 15:22:50] 0000:00:02:6: (XEN) [2013-08-23 15:22:50] 0000:00:02:7: (XEN) [2013-08-23 15:22:50] 0000:00:03:0: (XEN) [2013-08-23 15:22:50] IRTE[000] 00593f45 (XEN) [2013-08-23 15:22:50] 0000:00:03:1: (XEN) [2013-08-23 15:22:50] 0000:00:03:2: (XEN) [2013-08-23 15:22:50] 0000:00:03:3: (XEN) [2013-08-23 15:22:50] 0000:00:03:4: (XEN) [2013-08-23 15:22:50] 0000:00:03:5: (XEN) [2013-08-23 15:22:50] 0000:00:03:6: (XEN) [2013-08-23 15:22:50] 0000:00:03:7: (XEN) [2013-08-23 15:22:50] 0000:00:04:0: (XEN) [2013-08-23 15:22:50] 0000:00:04:1: (XEN) [2013-08-23 15:22:50] 0000:00:04:2: (XEN) [2013-08-23 15:22:50] 0000:00:04:3: (XEN) [2013-08-23 15:22:50] 0000:00:04:4: (XEN) [2013-08-23 15:22:50] 0000:00:04:5: (XEN) [2013-08-23 15:22:50] 0000:00:04:6: (XEN) [2013-08-23 15:22:50] 0000:00:04:7: (XEN) [2013-08-23 15:22:50] 0000:00:05:0: (XEN) [2013-08-23 15:22:50] IRTE[000] 00613f45 (XEN) [2013-08-23 15:22:50] 0000:00:05:1: (XEN) [2013-08-23 15:22:50] 0000:00:05:2: (XEN) [2013-08-23 15:22:50] 0000:00:05:3: (XEN) [2013-08-23 15:22:50] 0000:00:05:4: (XEN) [2013-08-23 15:22:50] 0000:00:05:5: (XEN) [2013-08-23 15:22:50] 0000:00:05:6: (XEN) [2013-08-23 15:22:50] 0000:00:05:7: (XEN) [2013-08-23 15:22:50] 0000:00:06:0: (XEN) [2013-08-23 15:22:50] IRTE[000] 00693f45 (XEN) [2013-08-23 15:22:50] 0000:00:06:1: (XEN) [2013-08-23 15:22:50] 0000:00:06:2: (XEN) [2013-08-23 15:22:50] 0000:00:06:3: (XEN) [2013-08-23 15:22:50] 0000:00:06:4: (XEN) [2013-08-23 15:22:50] 0000:00:06:5: (XEN) [2013-08-23 15:22:50] 0000:00:06:6: (XEN) [2013-08-23 15:22:50] 0000:00:06:7: (XEN) [2013-08-23 15:22:50] 0000:00:07:0: (XEN) [2013-08-23 15:22:50] 0000:00:07:1: (XEN) [2013-08-23 15:22:50] 0000:00:07:2: (XEN) [2013-08-23 15:22:50] 0000:00:07:3: (XEN) [2013-08-23 15:22:50] 0000:00:07:4: (XEN) [2013-08-23 15:22:50] 0000:00:07:5: (XEN) [2013-08-23 15:22:50] 0000:00:07:6: (XEN) [2013-08-23 15:22:50] 0000:00:07:7: (XEN) [2013-08-23 15:22:50] 0000:00:08:0: (XEN) [2013-08-23 15:22:50] 0000:00:08:1: (XEN) [2013-08-23 15:22:50] 0000:00:08:2: (XEN) [2013-08-23 15:22:50] 0000:00:08:3: (XEN) [2013-08-23 15:22:50] 0000:00:08:4: (XEN) [2013-08-23 15:22:50] 0000:00:08:5: (XEN) [2013-08-23 15:22:50] 0000:00:08:6: (XEN) [2013-08-23 15:22:50] 0000:00:08:7: (XEN) [2013-08-23 15:22:50] 0000:00:09:0: (XEN) [2013-08-23 15:22:50] IRTE[000] 00713f45 (XEN) [2013-08-23 15:22:50] 0000:00:09:1: (XEN) [2013-08-23 15:22:50] 0000:00:09:2: (XEN) [2013-08-23 15:22:50] 0000:00:09:3: (XEN) [2013-08-23 15:22:50] 0000:00:09:4: (XEN) [2013-08-23 15:22:50] 0000:00:09:5: (XEN) [2013-08-23 15:22:50] 0000:00:09:6: (XEN) [2013-08-23 15:22:50] 0000:00:09:7: (XEN) [2013-08-23 15:22:50] 0000:00:0a:0: (XEN) [2013-08-23 15:22:50] IRTE[000] 00793f45 (XEN) [2013-08-23 15:22:50] 0000:00:0a:1: (XEN) [2013-08-23 15:22:50] 0000:00:0a:2: (XEN) [2013-08-23 15:22:50] 0000:00:0a:3: (XEN) [2013-08-23 15:22:50] 0000:00:0a:4: (XEN) [2013-08-23 15:22:50] 0000:00:0a:5: (XEN) [2013-08-23 15:22:50] 0000:00:0a:6: (XEN) [2013-08-23 15:22:50] 0000:00:0a:7: (XEN) [2013-08-23 15:22:50] 0000:00:0b:0: (XEN) [2013-08-23 15:22:50] IRTE[000] 00813f45 (XEN) [2013-08-23 15:22:50] 0000:00:0b:1: (XEN) [2013-08-23 15:22:50] 0000:00:0b:2: (XEN) [2013-08-23 15:22:50] 0000:00:0b:3: (XEN) [2013-08-23 15:22:50] 0000:00:0b:4: (XEN) [2013-08-23 15:22:50] 0000:00:0b:5: (XEN) [2013-08-23 15:22:50] 0000:00:0b:6: (XEN) [2013-08-23 15:22:50] 0000:00:0b:7: (XEN) [2013-08-23 15:22:50] 0000:00:0c:0: (XEN) [2013-08-23 15:22:50] IRTE[000] 00893f45 (XEN) [2013-08-23 15:22:50] 0000:00:0c:1: (XEN) [2013-08-23 15:22:50] 0000:00:0c:2: (XEN) [2013-08-23 15:22:50] 0000:00:0c:3: (XEN) [2013-08-23 15:22:50] 0000:00:0c:4: (XEN) [2013-08-23 15:22:50] 0000:00:0c:5: (XEN) [2013-08-23 15:22:50] 0000:00:0c:6: (XEN) [2013-08-23 15:22:50] 0000:00:0c:7: (XEN) [2013-08-23 15:22:50] 0000:00:0d:0: (XEN) [2013-08-23 15:22:50] IRTE[000] 00913f45 (XEN) [2013-08-23 15:22:50] 0000:00:0d:1: (XEN) [2013-08-23 15:22:50] 0000:00:0d:2: (XEN) [2013-08-23 15:22:50] 0000:00:0d:3: (XEN) [2013-08-23 15:22:50] 0000:00:0d:4: (XEN) [2013-08-23 15:22:50] 0000:00:0d:5: (XEN) [2013-08-23 15:22:50] 0000:00:0d:6: (XEN) [2013-08-23 15:22:50] 0000:00:0d:7: (XEN) [2013-08-23 15:22:50] 0000:00:0e:0: (XEN) [2013-08-23 15:22:50] 0000:00:0e:1: (XEN) [2013-08-23 15:22:50] 0000:00:0e:2: (XEN) [2013-08-23 15:22:50] 0000:00:0e:3: (XEN) [2013-08-23 15:22:50] 0000:00:0e:4: (XEN) [2013-08-23 15:22:50] 0000:00:0e:5: (XEN) [2013-08-23 15:22:50] 0000:00:0e:6: (XEN) [2013-08-23 15:22:50] 0000:00:0e:7: (XEN) [2013-08-23 15:22:50] 0000:00:0f:0: (XEN) [2013-08-23 15:22:50] 0000:00:0f:1: (XEN) [2013-08-23 15:22:50] 0000:00:0f:2: (XEN) [2013-08-23 15:22:50] 0000:00:0f:3: (XEN) [2013-08-23 15:22:50] 0000:00:0f:4: (XEN) [2013-08-23 15:22:50] 0000:00:0f:5: (XEN) [2013-08-23 15:22:50] 0000:00:0f:6: (XEN) [2013-08-23 15:22:50] 0000:00:0f:7: (XEN) [2013-08-23 15:22:50] 0000:00:10:0: (XEN) [2013-08-23 15:22:50] 0000:00:10:1: (XEN) [2013-08-23 15:22:50] 0000:00:10:2: (XEN) [2013-08-23 15:22:50] 0000:00:10:3: (XEN) [2013-08-23 15:22:50] 0000:00:10:4: (XEN) [2013-08-23 15:22:50] 0000:00:10:5: (XEN) [2013-08-23 15:22:50] 0000:00:10:6: (XEN) [2013-08-23 15:22:50] 0000:00:10:7: (XEN) [2013-08-23 15:22:50] 0000:00:11:0: (XEN) [2013-08-23 15:22:50] IRTE[000] 00d90145 (XEN) [2013-08-23 15:22:50] 0000:00:11:1: (XEN) [2013-08-23 15:22:50] 0000:00:11:2: (XEN) [2013-08-23 15:22:50] 0000:00:11:3: (XEN) [2013-08-23 15:22:50] 0000:00:11:4: (XEN) [2013-08-23 15:22:50] 0000:00:11:5: (XEN) [2013-08-23 15:22:50] 0000:00:11:6: (XEN) [2013-08-23 15:22:50] 0000:00:11:7: (XEN) [2013-08-23 15:22:50] 0000:00:12:0: (XEN) [2013-08-23 15:22:50] 0000:00:12:1: (XEN) [2013-08-23 15:22:50] 0000:00:12:2: (XEN) [2013-08-23 15:22:50] 0000:00:12:3: (XEN) [2013-08-23 15:22:50] 0000:00:12:4: (XEN) [2013-08-23 15:22:50] 0000:00:12:5: (XEN) [2013-08-23 15:22:50] 0000:00:12:6: (XEN) [2013-08-23 15:22:50] 0000:00:12:7: (XEN) [2013-08-23 15:22:50] 0000:00:13:0: (XEN) [2013-08-23 15:22:50] 0000:00:13:1: (XEN) [2013-08-23 15:22:50] 0000:00:13:2: (XEN) [2013-08-23 15:22:50] 0000:00:13:3: (XEN) [2013-08-23 15:22:50] 0000:00:13:4: (XEN) [2013-08-23 15:22:50] 0000:00:13:5: (XEN) [2013-08-23 15:22:50] 0000:00:13:6: (XEN) [2013-08-23 15:22:50] 0000:00:13:7: (XEN) [2013-08-23 15:22:50] 0000:00:14:0: (XEN) [2013-08-23 15:22:50] IRTE[000] 00a80445 (XEN) [2013-08-23 15:22:50] IRTE[001] 00f00145 (XEN) [2013-08-23 15:22:50] IRTE[002] 00380145 (XEN) [2013-08-23 15:22:50] IRTE[003] 00f10145 (XEN) [2013-08-23 15:22:50] IRTE[004] 00400145 (XEN) [2013-08-23 15:22:50] IRTE[005] 00480145 (XEN) [2013-08-23 15:22:50] IRTE[006] 00500145 (XEN) [2013-08-23 15:22:50] IRTE[007] 00580145 (XEN) [2013-08-23 15:22:50] IRTE[008] 00680145 (XEN) [2013-08-23 15:22:50] IRTE[009] 00700145 (XEN) [2013-08-23 15:22:50] IRTE[00a] 00780145 (XEN) [2013-08-23 15:22:50] IRTE[00b] 00883f45 (XEN) [2013-08-23 15:22:50] IRTE[00c] 00900145 (XEN) [2013-08-23 15:22:50] IRTE[00d] 00980145 (XEN) [2013-08-23 15:22:50] IRTE[00e] 00600141 (XEN) [2013-08-23 15:22:50] IRTE[00f] 00210141 (XEN) [2013-08-23 15:22:50] IRTE[010] 00d80141 (XEN) [2013-08-23 15:22:50] 0000:00:14:1: (XEN) [2013-08-23 15:22:50] 0000:00:14:2: (XEN) [2013-08-23 15:22:50] 0000:00:14:3: (XEN) [2013-08-23 15:22:50] 0000:00:14:4: (XEN) [2013-08-23 15:22:50] 0000:00:14:5: (XEN) [2013-08-23 15:22:50] 0000:00:14:6: (XEN) [2013-08-23 15:22:50] 0000:00:14:7: (XEN) [2013-08-23 15:22:50] 0000:00:15:0: (XEN) [2013-08-23 15:22:50] IRTE[000] 00993f45 (XEN) [2013-08-23 15:22:50] 0000:00:15:1: (XEN) [2013-08-23 15:22:50] 0000:00:15:2: (XEN) [2013-08-23 15:22:50] 0000:00:15:3: (XEN) [2013-08-23 15:22:50] 0000:00:15:4: (XEN) [2013-08-23 15:22:50] 0000:00:15:5: (XEN) [2013-08-23 15:22:50] 0000:00:15:6: (XEN) [2013-08-23 15:22:50] 0000:00:15:7: (XEN) [2013-08-23 15:22:50] 0000:00:16:0: (XEN) [2013-08-23 15:22:50] 0000:00:16:1: (XEN) [2013-08-23 15:22:50] 0000:00:16:2: (XEN) [2013-08-23 15:22:50] 0000:00:16:3: (XEN) [2013-08-23 15:22:50] 0000:00:16:4: (XEN) [2013-08-23 15:22:50] 0000:00:16:5: (XEN) [2013-08-23 15:22:50] 0000:00:16:6: (XEN) [2013-08-23 15:22:50] 0000:00:16:7: (XEN) [2013-08-23 15:22:50] 0000:00:17:0: (XEN) [2013-08-23 15:22:50] 0000:00:17:1: (XEN) [2013-08-23 15:22:50] 0000:00:17:2: (XEN) [2013-08-23 15:22:50] 0000:00:17:3: (XEN) [2013-08-23 15:22:50] 0000:00:17:4: (XEN) [2013-08-23 15:22:50] 0000:00:17:5: (XEN) [2013-08-23 15:22:50] 0000:00:17:6: (XEN) [2013-08-23 15:22:50] 0000:00:17:7: (XEN) [2013-08-23 15:22:50] 0000:00:18:0: (XEN) [2013-08-23 15:22:50] 0000:00:18:1: (XEN) [2013-08-23 15:22:50] 0000:00:18:2: (XEN) [2013-08-23 15:22:50] 0000:00:18:3: (XEN) [2013-08-23 15:22:50] 0000:00:18:4: (XEN) [2013-08-23 15:22:50] 0000:00:18:5: (XEN) [2013-08-23 15:22:50] 0000:00:18:6: (XEN) [2013-08-23 15:22:50] 0000:00:18:7: (XEN) [2013-08-23 15:22:50] 0000:00:19:0: (XEN) [2013-08-23 15:22:50] 0000:00:19:1: (XEN) [2013-08-23 15:22:50] 0000:00:19:2: (XEN) [2013-08-23 15:22:50] 0000:00:19:3: (XEN) [2013-08-23 15:22:50] 0000:00:19:4: (XEN) [2013-08-23 15:22:50] 0000:00:19:5: (XEN) [2013-08-23 15:22:50] 0000:00:19:6: (XEN) [2013-08-23 15:22:50] 0000:00:19:7: (XEN) [2013-08-23 15:22:50] 0000:00:1a:0: (XEN) [2013-08-23 15:22:50] 0000:00:1a:1: (XEN) [2013-08-23 15:22:50] 0000:00:1a:2: (XEN) [2013-08-23 15:22:50] 0000:00:1a:3: (XEN) [2013-08-23 15:22:50] 0000:00:1a:4: (XEN) [2013-08-23 15:22:50] 0000:00:1a:5: (XEN) [2013-08-23 15:22:50] 0000:00:1a:6: (XEN) [2013-08-23 15:22:50] 0000:00:1a:7: (XEN) [2013-08-23 15:22:50] 0000:00:1b:0: (XEN) [2013-08-23 15:22:50] 0000:00:1b:1: (XEN) [2013-08-23 15:22:50] 0000:00:1b:2: (XEN) [2013-08-23 15:22:50] 0000:00:1b:3: (XEN) [2013-08-23 15:22:50] 0000:00:1b:4: (XEN) [2013-08-23 15:22:50] 0000:00:1b:5: (XEN) [2013-08-23 15:22:50] 0000:00:1b:6: (XEN) [2013-08-23 15:22:50] 0000:00:1b:7: (XEN) [2013-08-23 15:22:50] 0000:00:1c:0: (XEN) [2013-08-23 15:22:50] 0000:00:1c:1: (XEN) [2013-08-23 15:22:50] 0000:00:1c:2: (XEN) [2013-08-23 15:22:50] 0000:00:1c:3: (XEN) [2013-08-23 15:22:50] 0000:00:1c:4: (XEN) [2013-08-23 15:22:50] 0000:00:1c:5: (XEN) [2013-08-23 15:22:50] 0000:00:1c:6: (XEN) [2013-08-23 15:22:50] 0000:00:1c:7: (XEN) [2013-08-23 15:22:50] 0000:00:1d:0: (XEN) [2013-08-23 15:22:50] 0000:00:1d:1: (XEN) [2013-08-23 15:22:50] 0000:00:1d:2: (XEN) [2013-08-23 15:22:50] 0000:00:1d:3: (XEN) [2013-08-23 15:22:50] 0000:00:1d:4: (XEN) [2013-08-23 15:22:50] 0000:00:1d:5: (XEN) [2013-08-23 15:22:50] 0000:00:1d:6: (XEN) [2013-08-23 15:22:50] 0000:00:1d:7: (XEN) [2013-08-23 15:22:50] 0000:00:1e:0: (XEN) [2013-08-23 15:22:50] 0000:00:1e:1: (XEN) [2013-08-23 15:22:50] 0000:00:1e:2: (XEN) [2013-08-23 15:22:50] 0000:00:1e:3: (XEN) [2013-08-23 15:22:50] 0000:00:1e:4: (XEN) [2013-08-23 15:22:50] 0000:00:1e:5: (XEN) [2013-08-23 15:22:50] 0000:00:1e:6: (XEN) [2013-08-23 15:22:50] 0000:00:1e:7: (XEN) [2013-08-23 15:22:50] 0000:00:1f:0: (XEN) [2013-08-23 15:22:50] 0000:00:1f:1: (XEN) [2013-08-23 15:22:50] 0000:00:1f:2: (XEN) [2013-08-23 15:22:50] 0000:00:1f:3: (XEN) [2013-08-23 15:22:50] 0000:00:1f:4: (XEN) [2013-08-23 15:22:50] 0000:00:1f:5: (XEN) [2013-08-23 15:22:50] 0000:00:1f:6: (XEN) [2013-08-23 15:22:50] 0000:00:1f:7: (XEN) [2013-08-23 15:22:50] 0000:01:00:0: (XEN) [2013-08-23 15:22:50] 0000:01:00:1: (XEN) [2013-08-23 15:22:50] 0000:01:00:2: (XEN) [2013-08-23 15:22:50] 0000:01:00:3: (XEN) [2013-08-23 15:22:50] 0000:01:00:4: (XEN) [2013-08-23 15:22:50] 0000:01:00:5: (XEN) [2013-08-23 15:22:50] 0000:01:00:6: (XEN) [2013-08-23 15:22:50] 0000:01:00:7: (XEN) [2013-08-23 15:22:50] 0000:01:01:0: (XEN) [2013-08-23 15:22:50] 0000:01:01:1: (XEN) [2013-08-23 15:22:50] 0000:01:01:2: (XEN) [2013-08-23 15:22:50] 0000:01:01:3: (XEN) [2013-08-23 15:22:50] 0000:01:01:4: (XEN) [2013-08-23 15:22:50] 0000:01:01:5: (XEN) [2013-08-23 15:22:50] 0000:01:01:6: (XEN) [2013-08-23 15:22:50] 0000:01:01:7: (XEN) [2013-08-23 15:22:50] 0000:01:02:0: (XEN) [2013-08-23 15:22:50] 0000:01:02:1: (XEN) [2013-08-23 15:22:50] 0000:01:02:2: (XEN) [2013-08-23 15:22:50] 0000:01:02:3: (XEN) [2013-08-23 15:22:50] 0000:01:02:4: (XEN) [2013-08-23 15:22:50] 0000:01:02:5: (XEN) [2013-08-23 15:22:50] 0000:01:02:6: (XEN) [2013-08-23 15:22:50] 0000:01:02:7: (XEN) [2013-08-23 15:22:50] 0000:01:03:0: (XEN) [2013-08-23 15:22:50] 0000:01:03:1: (XEN) [2013-08-23 15:22:50] 0000:01:03:2: (XEN) [2013-08-23 15:22:50] 0000:01:03:3: (XEN) [2013-08-23 15:22:50] 0000:01:03:4: (XEN) [2013-08-23 15:22:50] 0000:01:03:5: (XEN) [2013-08-23 15:22:50] 0000:01:03:6: (XEN) [2013-08-23 15:22:50] 0000:01:03:7: (XEN) [2013-08-23 15:22:50] 0000:01:04:0: (XEN) [2013-08-23 15:22:50] 0000:01:04:1: (XEN) [2013-08-23 15:22:50] 0000:01:04:2: (XEN) [2013-08-23 15:22:50] 0000:01:04:3: (XEN) [2013-08-23 15:22:50] 0000:01:04:4: (XEN) [2013-08-23 15:22:50] 0000:01:04:5: (XEN) [2013-08-23 15:22:50] 0000:01:04:6: (XEN) [2013-08-23 15:22:50] 0000:01:04:7: (XEN) [2013-08-23 15:22:50] 0000:01:05:0: (XEN) [2013-08-23 15:22:50] 0000:01:05:1: (XEN) [2013-08-23 15:22:50] 0000:01:05:2: (XEN) [2013-08-23 15:22:50] 0000:01:05:3: (XEN) [2013-08-23 15:22:50] 0000:01:05:4: (XEN) [2013-08-23 15:22:50] 0000:01:05:5: (XEN) [2013-08-23 15:22:50] 0000:01:05:6: (XEN) [2013-08-23 15:22:50] 0000:01:05:7: (XEN) [2013-08-23 15:22:50] 0000:01:06:0: (XEN) [2013-08-23 15:22:50] 0000:01:06:1: (XEN) [2013-08-23 15:22:50] 0000:01:06:2: (XEN) [2013-08-23 15:22:50] 0000:01:06:3: (XEN) [2013-08-23 15:22:50] 0000:01:06:4: (XEN) [2013-08-23 15:22:50] 0000:01:06:5: (XEN) [2013-08-23 15:22:50] 0000:01:06:6: (XEN) [2013-08-23 15:22:50] 0000:01:06:7: (XEN) [2013-08-23 15:22:50] 0000:01:07:0: (XEN) [2013-08-23 15:22:50] 0000:01:07:1: (XEN) [2013-08-23 15:22:50] 0000:01:07:2: (XEN) [2013-08-23 15:22:50] 0000:01:07:3: (XEN) [2013-08-23 15:22:50] 0000:01:07:4: (XEN) [2013-08-23 15:22:50] 0000:01:07:5: (XEN) [2013-08-23 15:22:50] 0000:01:07:6: (XEN) [2013-08-23 15:22:50] 0000:01:07:7: (XEN) [2013-08-23 15:22:50] 0000:01:08:0: (XEN) [2013-08-23 15:22:50] 0000:01:08:1: (XEN) [2013-08-23 15:22:50] 0000:01:08:2: (XEN) [2013-08-23 15:22:50] 0000:01:08:3: (XEN) [2013-08-23 15:22:50] 0000:01:08:4: (XEN) [2013-08-23 15:22:50] 0000:01:08:5: (XEN) [2013-08-23 15:22:50] 0000:01:08:6: (XEN) [2013-08-23 15:22:50] 0000:01:08:7: (XEN) [2013-08-23 15:22:50] 0000:01:09:0: (XEN) [2013-08-23 15:22:50] 0000:01:09:1: (XEN) [2013-08-23 15:22:50] 0000:01:09:2: (XEN) [2013-08-23 15:22:50] 0000:01:09:3: (XEN) [2013-08-23 15:22:50] 0000:01:09:4: (XEN) [2013-08-23 15:22:50] 0000:01:09:5: (XEN) [2013-08-23 15:22:50] 0000:01:09:6: (XEN) [2013-08-23 15:22:50] 0000:01:09:7: (XEN) [2013-08-23 15:22:50] 0000:01:0a:0: (XEN) [2013-08-23 15:22:50] 0000:01:0a:1: (XEN) [2013-08-23 15:22:50] 0000:01:0a:2: (XEN) [2013-08-23 15:22:50] 0000:01:0a:3: (XEN) [2013-08-23 15:22:50] 0000:01:0a:4: (XEN) [2013-08-23 15:22:50] 0000:01:0a:5: (XEN) [2013-08-23 15:22:50] 0000:01:0a:6: (XEN) [2013-08-23 15:22:50] 0000:01:0a:7: (XEN) [2013-08-23 15:22:50] 0000:01:0b:0: (XEN) [2013-08-23 15:22:50] 0000:01:0b:1: (XEN) [2013-08-23 15:22:50] 0000:01:0b:2: (XEN) [2013-08-23 15:22:50] 0000:01:0b:3: (XEN) [2013-08-23 15:22:50] 0000:01:0b:4: (XEN) [2013-08-23 15:22:50] 0000:01:0b:5: (XEN) [2013-08-23 15:22:50] 0000:01:0b:6: (XEN) [2013-08-23 15:22:50] 0000:01:0b:7: (XEN) [2013-08-23 15:22:50] 0000:01:0c:0: (XEN) [2013-08-23 15:22:50] 0000:01:0c:1: (XEN) [2013-08-23 15:22:50] 0000:01:0c:2: (XEN) [2013-08-23 15:22:51] 0000:01:0c:3: (XEN) [2013-08-23 15:22:51] 0000:01:0c:4: (XEN) [2013-08-23 15:22:51] 0000:01:0c:5: (XEN) [2013-08-23 15:22:51] 0000:01:0c:6: (XEN) [2013-08-23 15:22:51] 0000:01:0c:7: (XEN) [2013-08-23 15:22:51] 0000:01:0d:0: (XEN) [2013-08-23 15:22:51] 0000:01:0d:1: (XEN) [2013-08-23 15:22:51] 0000:01:0d:2: (XEN) [2013-08-23 15:22:51] 0000:01:0d:3: (XEN) [2013-08-23 15:22:51] 0000:01:0d:4: (XEN) [2013-08-23 15:22:51] 0000:01:0d:5: (XEN) [2013-08-23 15:22:51] 0000:01:0d:6: (XEN) [2013-08-23 15:22:51] 0000:01:0d:7: (XEN) [2013-08-23 15:22:51] 0000:01:0e:0: (XEN) [2013-08-23 15:22:51] 0000:01:0e:1: (XEN) [2013-08-23 15:22:51] 0000:01:0e:2: (XEN) [2013-08-23 15:22:51] 0000:01:0e:3: (XEN) [2013-08-23 15:22:51] 0000:01:0e:4: (XEN) [2013-08-23 15:22:51] 0000:01:0e:5: (XEN) [2013-08-23 15:22:51] 0000:01:0e:6: (XEN) [2013-08-23 15:22:51] 0000:01:0e:7: (XEN) [2013-08-23 15:22:51] 0000:01:0f:0: (XEN) [2013-08-23 15:22:51] 0000:01:0f:1: (XEN) [2013-08-23 15:22:51] 0000:01:0f:2: (XEN) [2013-08-23 15:22:51] 0000:01:0f:3: (XEN) [2013-08-23 15:22:51] 0000:01:0f:4: (XEN) [2013-08-23 15:22:51] 0000:01:0f:5: (XEN) [2013-08-23 15:22:51] 0000:01:0f:6: (XEN) [2013-08-23 15:22:51] 0000:01:0f:7: (XEN) [2013-08-23 15:22:51] 0000:01:10:0: (XEN) [2013-08-23 15:22:51] 0000:01:10:1: (XEN) [2013-08-23 15:22:51] 0000:01:10:2: (XEN) [2013-08-23 15:22:51] 0000:01:10:3: (XEN) [2013-08-23 15:22:51] 0000:01:10:4: (XEN) [2013-08-23 15:22:51] 0000:01:10:5: (XEN) [2013-08-23 15:22:51] 0000:01:10:6: (XEN) [2013-08-23 15:22:51] 0000:01:10:7: (XEN) [2013-08-23 15:22:51] 0000:01:11:0: (XEN) [2013-08-23 15:22:51] 0000:01:11:1: (XEN) [2013-08-23 15:22:51] 0000:01:11:2: (XEN) [2013-08-23 15:22:51] 0000:01:11:3: (XEN) [2013-08-23 15:22:51] 0000:01:11:4: (XEN) [2013-08-23 15:22:51] 0000:01:11:5: (XEN) [2013-08-23 15:22:51] 0000:01:11:6: (XEN) [2013-08-23 15:22:51] 0000:01:11:7: (XEN) [2013-08-23 15:22:51] 0000:01:12:0: (XEN) [2013-08-23 15:22:51] 0000:01:12:1: (XEN) [2013-08-23 15:22:51] 0000:01:12:2: (XEN) [2013-08-23 15:22:51] 0000:01:12:3: (XEN) [2013-08-23 15:22:51] 0000:01:12:4: (XEN) [2013-08-23 15:22:51] 0000:01:12:5: (XEN) [2013-08-23 15:22:51] 0000:01:12:6: (XEN) [2013-08-23 15:22:51] 0000:01:12:7: (XEN) [2013-08-23 15:22:51] 0000:01:13:0: (XEN) [2013-08-23 15:22:51] 0000:01:13:1: (XEN) [2013-08-23 15:22:51] 0000:01:13:2: (XEN) [2013-08-23 15:22:51] 0000:01:13:3: (XEN) [2013-08-23 15:22:51] 0000:01:13:4: (XEN) [2013-08-23 15:22:51] 0000:01:13:5: (XEN) [2013-08-23 15:22:51] 0000:01:13:6: (XEN) [2013-08-23 15:22:51] 0000:01:13:7: (XEN) [2013-08-23 15:22:51] 0000:01:14:0: (XEN) [2013-08-23 15:22:51] 0000:01:14:1: (XEN) [2013-08-23 15:22:51] 0000:01:14:2: (XEN) [2013-08-23 15:22:51] 0000:01:14:3: (XEN) [2013-08-23 15:22:51] 0000:01:14:4: (XEN) [2013-08-23 15:22:51] 0000:01:14:5: (XEN) [2013-08-23 15:22:51] 0000:01:14:6: (XEN) [2013-08-23 15:22:51] 0000:01:14:7: (XEN) [2013-08-23 15:22:51] 0000:01:15:0: (XEN) [2013-08-23 15:22:51] 0000:01:15:1: (XEN) [2013-08-23 15:22:51] 0000:01:15:2: (XEN) [2013-08-23 15:22:51] 0000:01:15:3: (XEN) [2013-08-23 15:22:51] 0000:01:15:4: (XEN) [2013-08-23 15:22:51] 0000:01:15:5: (XEN) [2013-08-23 15:22:51] 0000:01:15:6: (XEN) [2013-08-23 15:22:51] 0000:01:15:7: (XEN) [2013-08-23 15:22:51] 0000:01:16:0: (XEN) [2013-08-23 15:22:51] 0000:01:16:1: (XEN) [2013-08-23 15:22:51] 0000:01:16:2: (XEN) [2013-08-23 15:22:51] 0000:01:16:3: (XEN) [2013-08-23 15:22:51] 0000:01:16:4: (XEN) [2013-08-23 15:22:51] 0000:01:16:5: (XEN) [2013-08-23 15:22:51] 0000:01:16:6: (XEN) [2013-08-23 15:22:51] 0000:01:16:7: (XEN) [2013-08-23 15:22:51] 0000:01:17:0: (XEN) [2013-08-23 15:22:52] 0000:01:17:1: (XEN) [2013-08-23 15:22:52] 0000:01:17:2: (XEN) [2013-08-23 15:22:52] 0000:01:17:3: (XEN) [2013-08-23 15:22:52] 0000:01:17:4: (XEN) [2013-08-23 15:22:52] 0000:01:17:5: (XEN) [2013-08-23 15:22:52] 0000:01:17:6: (XEN) [2013-08-23 15:22:52] 0000:01:17:7: (XEN) [2013-08-23 15:22:52] 0000:01:18:0: (XEN) [2013-08-23 15:22:52] 0000:01:18:1: (XEN) [2013-08-23 15:22:52] 0000:01:18:2: (XEN) [2013-08-23 15:22:52] 0000:01:18:3: (XEN) [2013-08-23 15:22:52] 0000:01:18:4: (XEN) [2013-08-23 15:22:52] 0000:01:18:5: (XEN) [2013-08-23 15:22:52] 0000:01:18:6: (XEN) [2013-08-23 15:22:52] 0000:01:18:7: (XEN) [2013-08-23 15:22:52] 0000:01:19:0: (XEN) [2013-08-23 15:22:52] 0000:01:19:1: (XEN) [2013-08-23 15:22:52] 0000:01:19:2: (XEN) [2013-08-23 15:22:52] 0000:01:19:3: (XEN) [2013-08-23 15:22:52] 0000:01:19:4: (XEN) [2013-08-23 15:22:52] 0000:01:19:5: (XEN) [2013-08-23 15:22:52] 0000:01:19:6: (XEN) [2013-08-23 15:22:52] 0000:01:19:7: (XEN) [2013-08-23 15:22:52] 0000:01:1a:0: (XEN) [2013-08-23 15:22:52] 0000:01:1a:1: (XEN) [2013-08-23 15:22:52] 0000:01:1a:2: (XEN) [2013-08-23 15:22:52] 0000:01:1a:3: (XEN) [2013-08-23 15:22:52] 0000:01:1a:4: (XEN) [2013-08-23 15:22:52] 0000:01:1a:5: (XEN) [2013-08-23 15:22:52] 0000:01:1a:6: (XEN) [2013-08-23 15:22:52] 0000:01:1a:7: (XEN) [2013-08-23 15:22:52] 0000:01:1b:0: (XEN) [2013-08-23 15:22:52] 0000:01:1b:1: (XEN) [2013-08-23 15:22:52] 0000:01:1b:2: (XEN) [2013-08-23 15:22:52] 0000:01:1b:3: (XEN) [2013-08-23 15:22:52] 0000:01:1b:4: (XEN) [2013-08-23 15:22:52] 0000:01:1b:5: (XEN) [2013-08-23 15:22:52] 0000:01:1b:6: (XEN) [2013-08-23 15:22:52] 0000:01:1b:7: (XEN) [2013-08-23 15:22:52] 0000:01:1c:0: (XEN) [2013-08-23 15:22:52] 0000:01:1c:1: (XEN) [2013-08-23 15:22:52] 0000:01:1c:2: (XEN) [2013-08-23 15:22:52] 0000:01:1c:3: (XEN) [2013-08-23 15:22:52] 0000:01:1c:4: (XEN) [2013-08-23 15:22:52] 0000:01:1c:5: (XEN) [2013-08-23 15:22:52] 0000:01:1c:6: (XEN) [2013-08-23 15:22:52] 0000:01:1c:7: (XEN) [2013-08-23 15:22:52] 0000:01:1d:0: (XEN) [2013-08-23 15:22:52] 0000:01:1d:1: (XEN) [2013-08-23 15:22:52] 0000:01:1d:2: (XEN) [2013-08-23 15:22:52] 0000:01:1d:3: (XEN) [2013-08-23 15:22:52] 0000:01:1d:4: (XEN) [2013-08-23 15:22:52] 0000:01:1d:5: (XEN) [2013-08-23 15:22:52] 0000:01:1d:6: (XEN) [2013-08-23 15:22:52] 0000:01:1d:7: (XEN) [2013-08-23 15:22:52] 0000:01:1e:0: (XEN) [2013-08-23 15:22:52] 0000:01:1e:1: (XEN) [2013-08-23 15:22:52] 0000:01:1e:2: (XEN) [2013-08-23 15:22:52] 0000:01:1e:3: (XEN) [2013-08-23 15:22:52] 0000:01:1e:4: (XEN) [2013-08-23 15:22:52] 0000:01:1e:5: (XEN) [2013-08-23 15:22:52] 0000:01:1e:6: (XEN) [2013-08-23 15:22:52] 0000:01:1e:7: (XEN) [2013-08-23 15:22:52] 0000:01:1f:0: (XEN) [2013-08-23 15:22:52] 0000:01:1f:1: (XEN) [2013-08-23 15:22:52] 0000:01:1f:2: (XEN) [2013-08-23 15:22:52] 0000:01:1f:3: (XEN) [2013-08-23 15:22:52] 0000:01:1f:4: (XEN) [2013-08-23 15:22:52] 0000:01:1f:5: (XEN) [2013-08-23 15:22:52] 0000:01:1f:6: (XEN) [2013-08-23 15:22:52] 0000:01:1f:7: (XEN) [2013-08-23 15:22:52] 0000:02:00:0: (XEN) [2013-08-23 15:22:52] 0000:02:00:1: (XEN) [2013-08-23 15:22:52] 0000:02:00:2: (XEN) [2013-08-23 15:22:52] 0000:02:00:3: (XEN) [2013-08-23 15:22:52] 0000:02:00:4: (XEN) [2013-08-23 15:22:52] 0000:02:00:5: (XEN) [2013-08-23 15:22:52] 0000:02:00:6: (XEN) [2013-08-23 15:22:52] 0000:02:00:7: (XEN) [2013-08-23 15:22:52] 0000:02:01:0: (XEN) [2013-08-23 15:22:52] 0000:02:01:1: (XEN) [2013-08-23 15:22:52] 0000:02:01:2: (XEN) [2013-08-23 15:22:52] 0000:02:01:3: (XEN) [2013-08-23 15:22:52] 0000:02:01:4: (XEN) [2013-08-23 15:22:52] 0000:02:01:5: (XEN) [2013-08-23 15:22:52] 0000:02:01:6: (XEN) [2013-08-23 15:22:53] 0000:02:01:7: (XEN) [2013-08-23 15:22:53] 0000:02:02:0: (XEN) [2013-08-23 15:22:53] 0000:02:02:1: (XEN) [2013-08-23 15:22:53] 0000:02:02:2: (XEN) [2013-08-23 15:22:53] 0000:02:02:3: (XEN) [2013-08-23 15:22:53] 0000:02:02:4: (XEN) [2013-08-23 15:22:53] 0000:02:02:5: (XEN) [2013-08-23 15:22:53] 0000:02:02:6: (XEN) [2013-08-23 15:22:53] 0000:02:02:7: (XEN) [2013-08-23 15:22:53] 0000:02:03:0: (XEN) [2013-08-23 15:22:53] 0000:02:03:1: (XEN) [2013-08-23 15:22:53] 0000:02:03:2: (XEN) [2013-08-23 15:22:53] 0000:02:03:3: (XEN) [2013-08-23 15:22:53] 0000:02:03:4: (XEN) [2013-08-23 15:22:53] 0000:02:03:5: (XEN) [2013-08-23 15:22:53] 0000:02:03:6: (XEN) [2013-08-23 15:22:53] 0000:02:03:7: (XEN) [2013-08-23 15:22:53] 0000:02:04:0: (XEN) [2013-08-23 15:22:53] 0000:02:04:1: (XEN) [2013-08-23 15:22:53] 0000:02:04:2: (XEN) [2013-08-23 15:22:53] 0000:02:04:3: (XEN) [2013-08-23 15:22:53] 0000:02:04:4: (XEN) [2013-08-23 15:22:53] 0000:02:04:5: (XEN) [2013-08-23 15:22:53] 0000:02:04:6: (XEN) [2013-08-23 15:22:53] 0000:02:04:7: (XEN) [2013-08-23 15:22:53] 0000:02:05:0: (XEN) [2013-08-23 15:22:53] 0000:02:05:1: (XEN) [2013-08-23 15:22:53] 0000:02:05:2: (XEN) [2013-08-23 15:22:53] 0000:02:05:3: (XEN) [2013-08-23 15:22:53] 0000:02:05:4: (XEN) [2013-08-23 15:22:53] 0000:02:05:5: (XEN) [2013-08-23 15:22:53] 0000:02:05:6: (XEN) [2013-08-23 15:22:53] 0000:02:05:7: (XEN) [2013-08-23 15:22:53] 0000:02:06:0: (XEN) [2013-08-23 15:22:53] 0000:02:06:1: (XEN) [2013-08-23 15:22:53] 0000:02:06:2: (XEN) [2013-08-23 15:22:53] 0000:02:06:3: (XEN) [2013-08-23 15:22:53] 0000:02:06:4: (XEN) [2013-08-23 15:22:53] 0000:02:06:5: (XEN) [2013-08-23 15:22:53] 0000:02:06:6: (XEN) [2013-08-23 15:22:53] 0000:02:06:7: (XEN) [2013-08-23 15:22:53] 0000:02:07:0: (XEN) [2013-08-23 15:22:53] 0000:02:07:1: (XEN) [2013-08-23 15:22:53] 0000:02:07:2: (XEN) [2013-08-23 15:22:53] 0000:02:07:3: (XEN) [2013-08-23 15:22:53] 0000:02:07:4: (XEN) [2013-08-23 15:22:53] 0000:02:07:5: (XEN) [2013-08-23 15:22:53] 0000:02:07:6: (XEN) [2013-08-23 15:22:53] 0000:02:07:7: (XEN) [2013-08-23 15:22:53] 0000:02:08:0: (XEN) [2013-08-23 15:22:53] 0000:02:08:1: (XEN) [2013-08-23 15:22:53] 0000:02:08:2: (XEN) [2013-08-23 15:22:53] 0000:02:08:3: (XEN) [2013-08-23 15:22:53] 0000:02:08:4: (XEN) [2013-08-23 15:22:53] 0000:02:08:5: (XEN) [2013-08-23 15:22:53] 0000:02:08:6: (XEN) [2013-08-23 15:22:53] 0000:02:08:7: (XEN) [2013-08-23 15:22:53] 0000:02:09:0: (XEN) [2013-08-23 15:22:53] 0000:02:09:1: (XEN) [2013-08-23 15:22:53] 0000:02:09:2: (XEN) [2013-08-23 15:22:53] 0000:02:09:3: (XEN) [2013-08-23 15:22:53] 0000:02:09:4: (XEN) [2013-08-23 15:22:53] 0000:02:09:5: (XEN) [2013-08-23 15:22:53] 0000:02:09:6: (XEN) [2013-08-23 15:22:53] 0000:02:09:7: (XEN) [2013-08-23 15:22:53] 0000:02:0a:0: (XEN) [2013-08-23 15:22:53] 0000:02:0a:1: (XEN) [2013-08-23 15:22:53] 0000:02:0a:2: (XEN) [2013-08-23 15:22:53] 0000:02:0a:3: (XEN) [2013-08-23 15:22:53] 0000:02:0a:4: (XEN) [2013-08-23 15:22:53] 0000:02:0a:5: (XEN) [2013-08-23 15:22:53] 0000:02:0a:6: (XEN) [2013-08-23 15:22:53] 0000:02:0a:7: (XEN) [2013-08-23 15:22:53] 0000:02:0b:0: (XEN) [2013-08-23 15:22:53] 0000:02:0b:1: (XEN) [2013-08-23 15:22:53] 0000:02:0b:2: (XEN) [2013-08-23 15:22:53] 0000:02:0b:3: (XEN) [2013-08-23 15:22:53] 0000:02:0b:4: (XEN) [2013-08-23 15:22:53] 0000:02:0b:5: (XEN) [2013-08-23 15:22:53] 0000:02:0b:6: (XEN) [2013-08-23 15:22:53] 0000:02:0b:7: (XEN) [2013-08-23 15:22:53] 0000:02:0c:0: (XEN) [2013-08-23 15:22:53] 0000:02:0c:1: (XEN) [2013-08-23 15:22:53] 0000:02:0c:2: (XEN) [2013-08-23 15:22:53] 0000:02:0c:3: (XEN) [2013-08-23 15:22:54] 0000:02:0c:4: (XEN) [2013-08-23 15:22:54] 0000:02:0c:5: (XEN) [2013-08-23 15:22:54] 0000:02:0c:6: (XEN) [2013-08-23 15:22:54] 0000:02:0c:7: (XEN) [2013-08-23 15:22:54] 0000:02:0d:0: (XEN) [2013-08-23 15:22:54] 0000:02:0d:1: (XEN) [2013-08-23 15:22:54] 0000:02:0d:2: (XEN) [2013-08-23 15:22:54] 0000:02:0d:3: (XEN) [2013-08-23 15:22:54] 0000:02:0d:4: (XEN) [2013-08-23 15:22:54] 0000:02:0d:5: (XEN) [2013-08-23 15:22:54] 0000:02:0d:6: (XEN) [2013-08-23 15:22:54] 0000:02:0d:7: (XEN) [2013-08-23 15:22:54] 0000:02:0e:0: (XEN) [2013-08-23 15:22:54] 0000:02:0e:1: (XEN) [2013-08-23 15:22:54] 0000:02:0e:2: (XEN) [2013-08-23 15:22:54] 0000:02:0e:3: (XEN) [2013-08-23 15:22:54] 0000:02:0e:4: (XEN) [2013-08-23 15:22:54] 0000:02:0e:5: (XEN) [2013-08-23 15:22:54] 0000:02:0e:6: (XEN) [2013-08-23 15:22:54] 0000:02:0e:7: (XEN) [2013-08-23 15:22:54] 0000:02:0f:0: (XEN) [2013-08-23 15:22:54] 0000:02:0f:1: (XEN) [2013-08-23 15:22:54] 0000:02:0f:2: (XEN) [2013-08-23 15:22:54] 0000:02:0f:3: (XEN) [2013-08-23 15:22:54] 0000:02:0f:4: (XEN) [2013-08-23 15:22:54] 0000:02:0f:5: (XEN) [2013-08-23 15:22:54] 0000:02:0f:6: (XEN) [2013-08-23 15:22:54] 0000:02:0f:7: (XEN) [2013-08-23 15:22:54] 0000:02:10:0: (XEN) [2013-08-23 15:22:54] 0000:02:10:1: (XEN) [2013-08-23 15:22:54] 0000:02:10:2: (XEN) [2013-08-23 15:22:54] 0000:02:10:3: (XEN) [2013-08-23 15:22:54] 0000:02:10:4: (XEN) [2013-08-23 15:22:54] 0000:02:10:5: (XEN) [2013-08-23 15:22:54] 0000:02:10:6: (XEN) [2013-08-23 15:22:54] 0000:02:10:7: (XEN) [2013-08-23 15:22:54] 0000:02:11:0: (XEN) [2013-08-23 15:22:54] 0000:02:11:1: (XEN) [2013-08-23 15:22:54] 0000:02:11:2: (XEN) [2013-08-23 15:22:54] 0000:02:11:3: (XEN) [2013-08-23 15:22:54] 0000:02:11:4: (XEN) [2013-08-23 15:22:54] 0000:02:11:5: (XEN) [2013-08-23 15:22:54] 0000:02:11:6: (XEN) [2013-08-23 15:22:54] 0000:02:11:7: (XEN) [2013-08-23 15:22:54] 0000:02:12:0: (XEN) [2013-08-23 15:22:54] 0000:02:12:1: (XEN) [2013-08-23 15:22:54] 0000:02:12:2: (XEN) [2013-08-23 15:22:54] 0000:02:12:3: (XEN) [2013-08-23 15:22:54] 0000:02:12:4: (XEN) [2013-08-23 15:22:54] 0000:02:12:5: (XEN) [2013-08-23 15:22:54] 0000:02:12:6: (XEN) [2013-08-23 15:22:54] 0000:02:12:7: (XEN) [2013-08-23 15:22:54] 0000:02:13:0: (XEN) [2013-08-23 15:22:54] 0000:02:13:1: (XEN) [2013-08-23 15:22:54] 0000:02:13:2: (XEN) [2013-08-23 15:22:54] 0000:02:13:3: (XEN) [2013-08-23 15:22:54] 0000:02:13:4: (XEN) [2013-08-23 15:22:54] 0000:02:13:5: (XEN) [2013-08-23 15:22:54] 0000:02:13:6: (XEN) [2013-08-23 15:22:54] 0000:02:13:7: (XEN) [2013-08-23 15:22:54] 0000:02:14:0: (XEN) [2013-08-23 15:22:54] 0000:02:14:1: (XEN) [2013-08-23 15:22:54] 0000:02:14:2: (XEN) [2013-08-23 15:22:54] 0000:02:14:3: (XEN) [2013-08-23 15:22:54] 0000:02:14:4: (XEN) [2013-08-23 15:22:54] 0000:02:14:5: (XEN) [2013-08-23 15:22:54] 0000:02:14:6: (XEN) [2013-08-23 15:22:54] 0000:02:14:7: (XEN) [2013-08-23 15:22:54] 0000:02:15:0: (XEN) [2013-08-23 15:22:54] 0000:02:15:1: (XEN) [2013-08-23 15:22:54] 0000:02:15:2: (XEN) [2013-08-23 15:22:54] 0000:02:15:3: (XEN) [2013-08-23 15:22:54] 0000:02:15:4: (XEN) [2013-08-23 15:22:54] 0000:02:15:5: (XEN) [2013-08-23 15:22:54] 0000:02:15:6: (XEN) [2013-08-23 15:22:54] 0000:02:15:7: (XEN) [2013-08-23 15:22:54] 0000:02:16:0: (XEN) [2013-08-23 15:22:54] 0000:02:16:1: (XEN) [2013-08-23 15:22:54] 0000:02:16:2: (XEN) [2013-08-23 15:22:54] 0000:02:16:3: (XEN) [2013-08-23 15:22:54] 0000:02:16:4: (XEN) [2013-08-23 15:22:54] 0000:02:16:5: (XEN) [2013-08-23 15:22:54] 0000:02:16:6: (XEN) [2013-08-23 15:22:54] 0000:02:16:7: (XEN) [2013-08-23 15:22:54] 0000:02:17:0: (XEN) [2013-08-23 15:22:55] 0000:02:17:1: (XEN) [2013-08-23 15:22:55] 0000:02:17:2: (XEN) [2013-08-23 15:22:55] 0000:02:17:3: (XEN) [2013-08-23 15:22:55] 0000:02:17:4: (XEN) [2013-08-23 15:22:55] 0000:02:17:5: (XEN) [2013-08-23 15:22:55] 0000:02:17:6: (XEN) [2013-08-23 15:22:55] 0000:02:17:7: (XEN) [2013-08-23 15:22:55] 0000:02:18:0: (XEN) [2013-08-23 15:22:55] 0000:02:18:1: (XEN) [2013-08-23 15:22:55] 0000:02:18:2: (XEN) [2013-08-23 15:22:55] 0000:02:18:3: (XEN) [2013-08-23 15:22:55] 0000:02:18:4: (XEN) [2013-08-23 15:22:55] 0000:02:18:5: (XEN) [2013-08-23 15:22:55] 0000:02:18:6: (XEN) [2013-08-23 15:22:55] 0000:02:18:7: (XEN) [2013-08-23 15:22:55] 0000:02:19:0: (XEN) [2013-08-23 15:22:55] 0000:02:19:1: (XEN) [2013-08-23 15:22:55] 0000:02:19:2: (XEN) [2013-08-23 15:22:55] 0000:02:19:3: (XEN) [2013-08-23 15:22:55] 0000:02:19:4: (XEN) [2013-08-23 15:22:55] 0000:02:19:5: (XEN) [2013-08-23 15:22:55] 0000:02:19:6: (XEN) [2013-08-23 15:22:55] 0000:02:19:7: (XEN) [2013-08-23 15:22:55] 0000:02:1a:0: (XEN) [2013-08-23 15:22:55] 0000:02:1a:1: (XEN) [2013-08-23 15:22:55] 0000:02:1a:2: (XEN) [2013-08-23 15:22:55] 0000:02:1a:3: (XEN) [2013-08-23 15:22:55] 0000:02:1a:4: (XEN) [2013-08-23 15:22:55] 0000:02:1a:5: (XEN) [2013-08-23 15:22:55] 0000:02:1a:6: (XEN) [2013-08-23 15:22:55] 0000:02:1a:7: (XEN) [2013-08-23 15:22:55] 0000:02:1b:0: (XEN) [2013-08-23 15:22:55] 0000:02:1b:1: (XEN) [2013-08-23 15:22:55] 0000:02:1b:2: (XEN) [2013-08-23 15:22:55] 0000:02:1b:3: (XEN) [2013-08-23 15:22:55] 0000:02:1b:4: (XEN) [2013-08-23 15:22:55] 0000:02:1b:5: (XEN) [2013-08-23 15:22:55] 0000:02:1b:6: (XEN) [2013-08-23 15:22:55] 0000:02:1b:7: (XEN) [2013-08-23 15:22:55] 0000:02:1c:0: (XEN) [2013-08-23 15:22:55] 0000:02:1c:1: (XEN) [2013-08-23 15:22:55] 0000:02:1c:2: (XEN) [2013-08-23 15:22:55] 0000:02:1c:3: (XEN) [2013-08-23 15:22:55] 0000:02:1c:4: (XEN) [2013-08-23 15:22:55] 0000:02:1c:5: (XEN) [2013-08-23 15:22:55] 0000:02:1c:6: (XEN) [2013-08-23 15:22:55] 0000:02:1c:7: (XEN) [2013-08-23 15:22:55] 0000:02:1d:0: (XEN) [2013-08-23 15:22:55] 0000:02:1d:1: (XEN) [2013-08-23 15:22:55] 0000:02:1d:2: (XEN) [2013-08-23 15:22:55] 0000:02:1d:3: (XEN) [2013-08-23 15:22:55] 0000:02:1d:4: (XEN) [2013-08-23 15:22:55] 0000:02:1d:5: (XEN) [2013-08-23 15:22:55] 0000:02:1d:6: (XEN) [2013-08-23 15:22:55] 0000:02:1d:7: (XEN) [2013-08-23 15:22:55] 0000:02:1e:0: (XEN) [2013-08-23 15:22:55] 0000:02:1e:1: (XEN) [2013-08-23 15:22:55] 0000:02:1e:2: (XEN) [2013-08-23 15:22:55] 0000:02:1e:3: (XEN) [2013-08-23 15:22:55] 0000:02:1e:4: (XEN) [2013-08-23 15:22:55] 0000:02:1e:5: (XEN) [2013-08-23 15:22:55] 0000:02:1e:6: (XEN) [2013-08-23 15:22:55] 0000:02:1e:7: (XEN) [2013-08-23 15:22:55] 0000:02:1f:0: (XEN) [2013-08-23 15:22:55] 0000:02:1f:1: (XEN) [2013-08-23 15:22:55] 0000:02:1f:2: (XEN) [2013-08-23 15:22:55] 0000:02:1f:3: (XEN) [2013-08-23 15:22:55] 0000:02:1f:4: (XEN) [2013-08-23 15:22:55] 0000:02:1f:5: (XEN) [2013-08-23 15:22:55] 0000:02:1f:6: (XEN) [2013-08-23 15:22:55] 0000:02:1f:7: (XEN) [2013-08-23 15:22:55] 0000:00:14:4: (XEN) [2013-08-23 15:22:55] 0000:00:14:4: (XEN) [2013-08-23 15:22:55] 0000:00:14:4: (XEN) [2013-08-23 15:22:55] 0000:00:14:4: (XEN) [2013-08-23 15:22:55] 0000:00:14:4: (XEN) [2013-08-23 15:22:55] 0000:00:14:4: (XEN) [2013-08-23 15:22:55] 0000:00:14:4: (XEN) [2013-08-23 15:22:55] 0000:00:14:4: (XEN) [2013-08-23 15:22:55] 0000:00:14:4: (XEN) [2013-08-23 15:22:55] 0000:00:14:4: (XEN) [2013-08-23 15:22:55] 0000:00:14:4: (XEN) [2013-08-23 15:22:55] 0000:00:14:4: (XEN) [2013-08-23 15:22:55] 0000:00:14:4: (XEN) [2013-08-23 15:22:55] 0000:00:14:4: (XEN) [2013-08-23 15:22:55] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:56] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:57] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:00:14:4: (XEN) [2013-08-23 15:22:58] 0000:04:00:0: (XEN) [2013-08-23 15:22:58] 0000:04:00:1: (XEN) [2013-08-23 15:22:58] 0000:04:00:2: (XEN) [2013-08-23 15:22:58] 0000:04:00:3: (XEN) [2013-08-23 15:22:58] 0000:04:00:4: (XEN) [2013-08-23 15:22:58] 0000:04:00:5: (XEN) [2013-08-23 15:22:58] 0000:04:00:6: (XEN) [2013-08-23 15:22:58] 0000:04:00:7: (XEN) [2013-08-23 15:22:58] 0000:04:01:0: (XEN) [2013-08-23 15:22:58] 0000:04:01:1: (XEN) [2013-08-23 15:22:58] 0000:04:01:2: (XEN) [2013-08-23 15:22:58] 0000:04:01:3: (XEN) [2013-08-23 15:22:58] 0000:04:01:4: (XEN) [2013-08-23 15:22:58] 0000:04:01:5: (XEN) [2013-08-23 15:22:58] 0000:04:01:6: (XEN) [2013-08-23 15:22:59] 0000:04:01:7: (XEN) [2013-08-23 15:22:59] 0000:04:02:0: (XEN) [2013-08-23 15:22:59] 0000:04:02:1: (XEN) [2013-08-23 15:22:59] 0000:04:02:2: (XEN) [2013-08-23 15:22:59] 0000:04:02:3: (XEN) [2013-08-23 15:22:59] 0000:04:02:4: (XEN) [2013-08-23 15:22:59] 0000:04:02:5: (XEN) [2013-08-23 15:22:59] 0000:04:02:6: (XEN) [2013-08-23 15:22:59] 0000:04:02:7: (XEN) [2013-08-23 15:22:59] 0000:04:03:0: (XEN) [2013-08-23 15:22:59] 0000:04:03:1: (XEN) [2013-08-23 15:22:59] 0000:04:03:2: (XEN) [2013-08-23 15:22:59] 0000:04:03:3: (XEN) [2013-08-23 15:22:59] 0000:04:03:4: (XEN) [2013-08-23 15:22:59] 0000:04:03:5: (XEN) [2013-08-23 15:22:59] 0000:04:03:6: (XEN) [2013-08-23 15:22:59] 0000:04:03:7: (XEN) [2013-08-23 15:22:59] 0000:04:04:0: (XEN) [2013-08-23 15:22:59] 0000:04:04:1: (XEN) [2013-08-23 15:22:59] 0000:04:04:2: (XEN) [2013-08-23 15:22:59] 0000:04:04:3: (XEN) [2013-08-23 15:22:59] 0000:04:04:4: (XEN) [2013-08-23 15:22:59] 0000:04:04:5: (XEN) [2013-08-23 15:22:59] 0000:04:04:6: (XEN) [2013-08-23 15:22:59] 0000:04:04:7: (XEN) [2013-08-23 15:22:59] 0000:04:05:0: (XEN) [2013-08-23 15:22:59] 0000:04:05:1: (XEN) [2013-08-23 15:22:59] 0000:04:05:2: (XEN) [2013-08-23 15:22:59] 0000:04:05:3: (XEN) [2013-08-23 15:22:59] 0000:04:05:4: (XEN) [2013-08-23 15:22:59] 0000:04:05:5: (XEN) [2013-08-23 15:22:59] 0000:04:05:6: (XEN) [2013-08-23 15:22:59] 0000:04:05:7: (XEN) [2013-08-23 15:22:59] 0000:04:06:0: (XEN) [2013-08-23 15:22:59] 0000:04:06:1: (XEN) [2013-08-23 15:22:59] 0000:04:06:2: (XEN) [2013-08-23 15:22:59] 0000:04:06:3: (XEN) [2013-08-23 15:22:59] 0000:04:06:4: (XEN) [2013-08-23 15:22:59] 0000:04:06:5: (XEN) [2013-08-23 15:22:59] 0000:04:06:6: (XEN) [2013-08-23 15:22:59] 0000:04:06:7: (XEN) [2013-08-23 15:22:59] 0000:04:07:0: (XEN) [2013-08-23 15:22:59] 0000:04:07:1: (XEN) [2013-08-23 15:22:59] 0000:04:07:2: (XEN) [2013-08-23 15:22:59] 0000:04:07:3: (XEN) [2013-08-23 15:22:59] 0000:04:07:4: (XEN) [2013-08-23 15:22:59] 0000:04:07:5: (XEN) [2013-08-23 15:22:59] 0000:04:07:6: (XEN) [2013-08-23 15:22:59] 0000:04:07:7: (XEN) [2013-08-23 15:22:59] 0000:04:08:0: (XEN) [2013-08-23 15:22:59] 0000:04:08:1: (XEN) [2013-08-23 15:22:59] 0000:04:08:2: (XEN) [2013-08-23 15:22:59] 0000:04:08:3: (XEN) [2013-08-23 15:22:59] 0000:04:08:4: (XEN) [2013-08-23 15:22:59] 0000:04:08:5: (XEN) [2013-08-23 15:22:59] 0000:04:08:6: (XEN) [2013-08-23 15:22:59] 0000:04:08:7: (XEN) [2013-08-23 15:22:59] 0000:04:09:0: (XEN) [2013-08-23 15:22:59] 0000:04:09:1: (XEN) [2013-08-23 15:22:59] 0000:04:09:2: (XEN) [2013-08-23 15:22:59] 0000:04:09:3: (XEN) [2013-08-23 15:22:59] 0000:04:09:4: (XEN) [2013-08-23 15:22:59] 0000:04:09:5: (XEN) [2013-08-23 15:22:59] 0000:04:09:6: (XEN) [2013-08-23 15:22:59] 0000:04:09:7: (XEN) [2013-08-23 15:22:59] 0000:04:0a:0: (XEN) [2013-08-23 15:22:59] 0000:04:0a:1: (XEN) [2013-08-23 15:22:59] 0000:04:0a:2: (XEN) [2013-08-23 15:22:59] 0000:04:0a:3: (XEN) [2013-08-23 15:22:59] 0000:04:0a:4: (XEN) [2013-08-23 15:22:59] 0000:04:0a:5: (XEN) [2013-08-23 15:22:59] 0000:04:0a:6: (XEN) [2013-08-23 15:22:59] 0000:04:0a:7: (XEN) [2013-08-23 15:22:59] 0000:04:0b:0: (XEN) [2013-08-23 15:22:59] 0000:04:0b:1: (XEN) [2013-08-23 15:22:59] 0000:04:0b:2: (XEN) [2013-08-23 15:22:59] 0000:04:0b:3: (XEN) [2013-08-23 15:22:59] 0000:04:0b:4: (XEN) [2013-08-23 15:22:59] 0000:04:0b:5: (XEN) [2013-08-23 15:22:59] 0000:04:0b:6: (XEN) [2013-08-23 15:22:59] 0000:04:0b:7: (XEN) [2013-08-23 15:22:59] 0000:04:0c:0: (XEN) [2013-08-23 15:22:59] 0000:04:0c:1: (XEN) [2013-08-23 15:22:59] 0000:04:0c:2: (XEN) [2013-08-23 15:22:59] 0000:04:0c:3: (XEN) [2013-08-23 15:22:59] 0000:04:0c:4: (XEN) [2013-08-23 15:23:00] 0000:04:0c:5: (XEN) [2013-08-23 15:23:00] 0000:04:0c:6: (XEN) [2013-08-23 15:23:00] 0000:04:0c:7: (XEN) [2013-08-23 15:23:00] 0000:04:0d:0: (XEN) [2013-08-23 15:23:00] 0000:04:0d:1: (XEN) [2013-08-23 15:23:00] 0000:04:0d:2: (XEN) [2013-08-23 15:23:00] 0000:04:0d:3: (XEN) [2013-08-23 15:23:00] 0000:04:0d:4: (XEN) [2013-08-23 15:23:00] 0000:04:0d:5: (XEN) [2013-08-23 15:23:00] 0000:04:0d:6: (XEN) [2013-08-23 15:23:00] 0000:04:0d:7: (XEN) [2013-08-23 15:23:00] 0000:04:0e:0: (XEN) [2013-08-23 15:23:00] 0000:04:0e:1: (XEN) [2013-08-23 15:23:00] 0000:04:0e:2: (XEN) [2013-08-23 15:23:00] 0000:04:0e:3: (XEN) [2013-08-23 15:23:00] 0000:04:0e:4: (XEN) [2013-08-23 15:23:00] 0000:04:0e:5: (XEN) [2013-08-23 15:23:00] 0000:04:0e:6: (XEN) [2013-08-23 15:23:00] 0000:04:0e:7: (XEN) [2013-08-23 15:23:00] 0000:04:0f:0: (XEN) [2013-08-23 15:23:00] 0000:04:0f:1: (XEN) [2013-08-23 15:23:00] 0000:04:0f:2: (XEN) [2013-08-23 15:23:00] 0000:04:0f:3: (XEN) [2013-08-23 15:23:00] 0000:04:0f:4: (XEN) [2013-08-23 15:23:00] 0000:04:0f:5: (XEN) [2013-08-23 15:23:00] 0000:04:0f:6: (XEN) [2013-08-23 15:23:00] 0000:04:0f:7: (XEN) [2013-08-23 15:23:00] 0000:04:10:0: (XEN) [2013-08-23 15:23:00] 0000:04:10:1: (XEN) [2013-08-23 15:23:00] 0000:04:10:2: (XEN) [2013-08-23 15:23:00] 0000:04:10:3: (XEN) [2013-08-23 15:23:00] 0000:04:10:4: (XEN) [2013-08-23 15:23:00] 0000:04:10:5: (XEN) [2013-08-23 15:23:00] 0000:04:10:6: (XEN) [2013-08-23 15:23:00] 0000:04:10:7: (XEN) [2013-08-23 15:23:00] 0000:04:11:0: (XEN) [2013-08-23 15:23:00] 0000:04:11:1: (XEN) [2013-08-23 15:23:00] 0000:04:11:2: (XEN) [2013-08-23 15:23:00] 0000:04:11:3: (XEN) [2013-08-23 15:23:00] 0000:04:11:4: (XEN) [2013-08-23 15:23:00] 0000:04:11:5: (XEN) [2013-08-23 15:23:00] 0000:04:11:6: (XEN) [2013-08-23 15:23:00] 0000:04:11:7: (XEN) [2013-08-23 15:23:00] 0000:04:12:0: (XEN) [2013-08-23 15:23:00] 0000:04:12:1: (XEN) [2013-08-23 15:23:00] 0000:04:12:2: (XEN) [2013-08-23 15:23:00] 0000:04:12:3: (XEN) [2013-08-23 15:23:00] 0000:04:12:4: (XEN) [2013-08-23 15:23:00] 0000:04:12:5: (XEN) [2013-08-23 15:23:00] 0000:04:12:6: (XEN) [2013-08-23 15:23:00] 0000:04:12:7: (XEN) [2013-08-23 15:23:00] 0000:04:13:0: (XEN) [2013-08-23 15:23:00] 0000:04:13:1: (XEN) [2013-08-23 15:23:00] 0000:04:13:2: (XEN) [2013-08-23 15:23:00] 0000:04:13:3: (XEN) [2013-08-23 15:23:00] 0000:04:13:4: (XEN) [2013-08-23 15:23:00] 0000:04:13:5: (XEN) [2013-08-23 15:23:00] 0000:04:13:6: (XEN) [2013-08-23 15:23:00] 0000:04:13:7: (XEN) [2013-08-23 15:23:00] 0000:04:14:0: (XEN) [2013-08-23 15:23:00] 0000:04:14:1: (XEN) [2013-08-23 15:23:00] 0000:04:14:2: (XEN) [2013-08-23 15:23:00] 0000:04:14:3: (XEN) [2013-08-23 15:23:00] 0000:04:14:4: (XEN) [2013-08-23 15:23:00] 0000:04:14:5: (XEN) [2013-08-23 15:23:00] 0000:04:14:6: (XEN) [2013-08-23 15:23:00] 0000:04:14:7: (XEN) [2013-08-23 15:23:00] 0000:04:15:0: (XEN) [2013-08-23 15:23:00] 0000:04:15:1: (XEN) [2013-08-23 15:23:00] 0000:04:15:2: (XEN) [2013-08-23 15:23:00] 0000:04:15:3: (XEN) [2013-08-23 15:23:00] 0000:04:15:4: (XEN) [2013-08-23 15:23:00] 0000:04:15:5: (XEN) [2013-08-23 15:23:00] 0000:04:15:6: (XEN) [2013-08-23 15:23:00] 0000:04:15:7: (XEN) [2013-08-23 15:23:00] 0000:04:16:0: (XEN) [2013-08-23 15:23:00] 0000:04:16:1: (XEN) [2013-08-23 15:23:00] 0000:04:16:2: (XEN) [2013-08-23 15:23:00] 0000:04:16:3: (XEN) [2013-08-23 15:23:00] 0000:04:16:4: (XEN) [2013-08-23 15:23:00] 0000:04:16:5: (XEN) [2013-08-23 15:23:00] 0000:04:16:6: (XEN) [2013-08-23 15:23:00] 0000:04:16:7: (XEN) [2013-08-23 15:23:00] 0000:04:17:0: (XEN) [2013-08-23 15:23:00] 0000:04:17:1: (XEN) [2013-08-23 15:23:01] 0000:04:17:2: (XEN) [2013-08-23 15:23:01] 0000:04:17:3: (XEN) [2013-08-23 15:23:01] 0000:04:17:4: (XEN) [2013-08-23 15:23:01] 0000:04:17:5: (XEN) [2013-08-23 15:23:01] 0000:04:17:6: (XEN) [2013-08-23 15:23:01] 0000:04:17:7: (XEN) [2013-08-23 15:23:01] 0000:04:18:0: (XEN) [2013-08-23 15:23:01] 0000:04:18:1: (XEN) [2013-08-23 15:23:01] 0000:04:18:2: (XEN) [2013-08-23 15:23:01] 0000:04:18:3: (XEN) [2013-08-23 15:23:01] 0000:04:18:4: (XEN) [2013-08-23 15:23:01] 0000:04:18:5: (XEN) [2013-08-23 15:23:01] 0000:04:18:6: (XEN) [2013-08-23 15:23:01] 0000:04:18:7: (XEN) [2013-08-23 15:23:01] 0000:04:19:0: (XEN) [2013-08-23 15:23:01] 0000:04:19:1: (XEN) [2013-08-23 15:23:01] 0000:04:19:2: (XEN) [2013-08-23 15:23:01] 0000:04:19:3: (XEN) [2013-08-23 15:23:01] 0000:04:19:4: (XEN) [2013-08-23 15:23:01] 0000:04:19:5: (XEN) [2013-08-23 15:23:01] 0000:04:19:6: (XEN) [2013-08-23 15:23:01] 0000:04:19:7: (XEN) [2013-08-23 15:23:01] 0000:04:1a:0: (XEN) [2013-08-23 15:23:01] 0000:04:1a:1: (XEN) [2013-08-23 15:23:01] 0000:04:1a:2: (XEN) [2013-08-23 15:23:01] 0000:04:1a:3: (XEN) [2013-08-23 15:23:01] 0000:04:1a:4: (XEN) [2013-08-23 15:23:01] 0000:04:1a:5: (XEN) [2013-08-23 15:23:01] 0000:04:1a:6: (XEN) [2013-08-23 15:23:01] 0000:04:1a:7: (XEN) [2013-08-23 15:23:01] 0000:04:1b:0: (XEN) [2013-08-23 15:23:01] 0000:04:1b:1: (XEN) [2013-08-23 15:23:01] 0000:04:1b:2: (XEN) [2013-08-23 15:23:01] 0000:04:1b:3: (XEN) [2013-08-23 15:23:01] 0000:04:1b:4: (XEN) [2013-08-23 15:23:01] 0000:04:1b:5: (XEN) [2013-08-23 15:23:01] 0000:04:1b:6: (XEN) [2013-08-23 15:23:01] 0000:04:1b:7: (XEN) [2013-08-23 15:23:01] 0000:04:1c:0: (XEN) [2013-08-23 15:23:01] 0000:04:1c:1: (XEN) [2013-08-23 15:23:01] 0000:04:1c:2: (XEN) [2013-08-23 15:23:01] 0000:04:1c:3: (XEN) [2013-08-23 15:23:01] 0000:04:1c:4: (XEN) [2013-08-23 15:23:01] 0000:04:1c:5: (XEN) [2013-08-23 15:23:01] 0000:04:1c:6: (XEN) [2013-08-23 15:23:01] 0000:04:1c:7: (XEN) [2013-08-23 15:23:01] 0000:04:1d:0: (XEN) [2013-08-23 15:23:01] 0000:04:1d:1: (XEN) [2013-08-23 15:23:01] 0000:04:1d:2: (XEN) [2013-08-23 15:23:01] 0000:04:1d:3: (XEN) [2013-08-23 15:23:01] 0000:04:1d:4: (XEN) [2013-08-23 15:23:01] 0000:04:1d:5: (XEN) [2013-08-23 15:23:01] 0000:04:1d:6: (XEN) [2013-08-23 15:23:01] 0000:04:1d:7: (XEN) [2013-08-23 15:23:01] 0000:04:1e:0: (XEN) [2013-08-23 15:23:01] 0000:04:1e:1: (XEN) [2013-08-23 15:23:01] 0000:04:1e:2: (XEN) [2013-08-23 15:23:01] 0000:04:1e:3: (XEN) [2013-08-23 15:23:01] 0000:04:1e:4: (XEN) [2013-08-23 15:23:01] 0000:04:1e:5: (XEN) [2013-08-23 15:23:01] 0000:04:1e:6: (XEN) [2013-08-23 15:23:01] 0000:04:1e:7: (XEN) [2013-08-23 15:23:01] 0000:04:1f:0: (XEN) [2013-08-23 15:23:01] 0000:04:1f:1: (XEN) [2013-08-23 15:23:01] 0000:04:1f:2: (XEN) [2013-08-23 15:23:01] 0000:04:1f:3: (XEN) [2013-08-23 15:23:01] 0000:04:1f:4: (XEN) [2013-08-23 15:23:01] 0000:04:1f:5: (XEN) [2013-08-23 15:23:01] 0000:04:1f:6: (XEN) [2013-08-23 15:23:01] 0000:04:1f:7: (XEN) [2013-08-23 15:23:01] 0000:05:00:0: (XEN) [2013-08-23 15:23:01] 0000:05:00:1: (XEN) [2013-08-23 15:23:01] 0000:05:00:2: (XEN) [2013-08-23 15:23:01] 0000:05:00:3: (XEN) [2013-08-23 15:23:01] 0000:05:00:4: (XEN) [2013-08-23 15:23:01] 0000:05:00:5: (XEN) [2013-08-23 15:23:01] 0000:05:00:6: (XEN) [2013-08-23 15:23:01] 0000:05:00:7: (XEN) [2013-08-23 15:23:01] 0000:05:01:0: (XEN) [2013-08-23 15:23:01] 0000:05:01:1: (XEN) [2013-08-23 15:23:01] 0000:05:01:2: (XEN) [2013-08-23 15:23:01] 0000:05:01:3: (XEN) [2013-08-23 15:23:01] 0000:05:01:4: (XEN) [2013-08-23 15:23:01] 0000:05:01:5: (XEN) [2013-08-23 15:23:01] 0000:05:01:6: (XEN) [2013-08-23 15:23:01] 0000:05:01:7: (XEN) [2013-08-23 15:23:02] 0000:05:02:0: (XEN) [2013-08-23 15:23:02] 0000:05:02:1: (XEN) [2013-08-23 15:23:02] 0000:05:02:2: (XEN) [2013-08-23 15:23:02] 0000:05:02:3: (XEN) [2013-08-23 15:23:02] 0000:05:02:4: (XEN) [2013-08-23 15:23:02] 0000:05:02:5: (XEN) [2013-08-23 15:23:02] 0000:05:02:6: (XEN) [2013-08-23 15:23:02] 0000:05:02:7: (XEN) [2013-08-23 15:23:02] 0000:05:03:0: (XEN) [2013-08-23 15:23:02] 0000:05:03:1: (XEN) [2013-08-23 15:23:02] 0000:05:03:2: (XEN) [2013-08-23 15:23:02] 0000:05:03:3: (XEN) [2013-08-23 15:23:02] 0000:05:03:4: (XEN) [2013-08-23 15:23:02] 0000:05:03:5: (XEN) [2013-08-23 15:23:02] 0000:05:03:6: (XEN) [2013-08-23 15:23:02] 0000:05:03:7: (XEN) [2013-08-23 15:23:02] 0000:05:04:0: (XEN) [2013-08-23 15:23:02] 0000:05:04:1: (XEN) [2013-08-23 15:23:02] 0000:05:04:2: (XEN) [2013-08-23 15:23:02] 0000:05:04:3: (XEN) [2013-08-23 15:23:02] 0000:05:04:4: (XEN) [2013-08-23 15:23:02] 0000:05:04:5: (XEN) [2013-08-23 15:23:02] 0000:05:04:6: (XEN) [2013-08-23 15:23:02] 0000:05:04:7: (XEN) [2013-08-23 15:23:02] 0000:05:05:0: (XEN) [2013-08-23 15:23:02] 0000:05:05:1: (XEN) [2013-08-23 15:23:02] 0000:05:05:2: (XEN) [2013-08-23 15:23:02] 0000:05:05:3: (XEN) [2013-08-23 15:23:02] 0000:05:05:4: (XEN) [2013-08-23 15:23:02] 0000:05:05:5: (XEN) [2013-08-23 15:23:02] 0000:05:05:6: (XEN) [2013-08-23 15:23:02] 0000:05:05:7: (XEN) [2013-08-23 15:23:02] 0000:05:06:0: (XEN) [2013-08-23 15:23:02] 0000:05:06:1: (XEN) [2013-08-23 15:23:02] 0000:05:06:2: (XEN) [2013-08-23 15:23:02] 0000:05:06:3: (XEN) [2013-08-23 15:23:02] 0000:05:06:4: (XEN) [2013-08-23 15:23:02] 0000:05:06:5: (XEN) [2013-08-23 15:23:02] 0000:05:06:6: (XEN) [2013-08-23 15:23:02] 0000:05:06:7: (XEN) [2013-08-23 15:23:02] 0000:05:07:0: (XEN) [2013-08-23 15:23:02] 0000:05:07:1: (XEN) [2013-08-23 15:23:02] 0000:05:07:2: (XEN) [2013-08-23 15:23:02] 0000:05:07:3: (XEN) [2013-08-23 15:23:02] 0000:05:07:4: (XEN) [2013-08-23 15:23:02] 0000:05:07:5: (XEN) [2013-08-23 15:23:02] 0000:05:07:6: (XEN) [2013-08-23 15:23:02] 0000:05:07:7: (XEN) [2013-08-23 15:23:02] 0000:05:08:0: (XEN) [2013-08-23 15:23:02] 0000:05:08:1: (XEN) [2013-08-23 15:23:02] 0000:05:08:2: (XEN) [2013-08-23 15:23:02] 0000:05:08:3: (XEN) [2013-08-23 15:23:02] 0000:05:08:4: (XEN) [2013-08-23 15:23:02] 0000:05:08:5: (XEN) [2013-08-23 15:23:02] 0000:05:08:6: (XEN) [2013-08-23 15:23:02] 0000:05:08:7: (XEN) [2013-08-23 15:23:02] 0000:05:09:0: (XEN) [2013-08-23 15:23:02] 0000:05:09:1: (XEN) [2013-08-23 15:23:02] 0000:05:09:2: (XEN) [2013-08-23 15:23:02] 0000:05:09:3: (XEN) [2013-08-23 15:23:02] 0000:05:09:4: (XEN) [2013-08-23 15:23:02] 0000:05:09:5: (XEN) [2013-08-23 15:23:02] 0000:05:09:6: (XEN) [2013-08-23 15:23:02] 0000:05:09:7: (XEN) [2013-08-23 15:23:02] 0000:05:0a:0: (XEN) [2013-08-23 15:23:02] 0000:05:0a:1: (XEN) [2013-08-23 15:23:02] 0000:05:0a:2: (XEN) [2013-08-23 15:23:02] 0000:05:0a:3: (XEN) [2013-08-23 15:23:02] 0000:05:0a:4: (XEN) [2013-08-23 15:23:02] 0000:05:0a:5: (XEN) [2013-08-23 15:23:02] 0000:05:0a:6: (XEN) [2013-08-23 15:23:02] 0000:05:0a:7: (XEN) [2013-08-23 15:23:02] 0000:05:0b:0: (XEN) [2013-08-23 15:23:02] 0000:05:0b:1: (XEN) [2013-08-23 15:23:02] 0000:05:0b:2: (XEN) [2013-08-23 15:23:02] 0000:05:0b:3: (XEN) [2013-08-23 15:23:02] 0000:05:0b:4: (XEN) [2013-08-23 15:23:02] 0000:05:0b:5: (XEN) [2013-08-23 15:23:02] 0000:05:0b:6: (XEN) [2013-08-23 15:23:02] 0000:05:0b:7: (XEN) [2013-08-23 15:23:02] 0000:05:0c:0: (XEN) [2013-08-23 15:23:02] 0000:05:0c:1: (XEN) [2013-08-23 15:23:02] 0000:05:0c:2: (XEN) [2013-08-23 15:23:02] 0000:05:0c:3: (XEN) [2013-08-23 15:23:02] 0000:05:0c:4: (XEN) [2013-08-23 15:23:03] 0000:05:0c:5: (XEN) [2013-08-23 15:23:03] 0000:05:0c:6: (XEN) [2013-08-23 15:23:03] 0000:05:0c:7: (XEN) [2013-08-23 15:23:03] 0000:05:0d:0: (XEN) [2013-08-23 15:23:03] 0000:05:0d:1: (XEN) [2013-08-23 15:23:03] 0000:05:0d:2: (XEN) [2013-08-23 15:23:03] 0000:05:0d:3: (XEN) [2013-08-23 15:23:03] 0000:05:0d:4: (XEN) [2013-08-23 15:23:03] 0000:05:0d:5: (XEN) [2013-08-23 15:23:03] 0000:05:0d:6: (XEN) [2013-08-23 15:23:03] 0000:05:0d:7: (XEN) [2013-08-23 15:23:03] 0000:05:0e:0: (XEN) [2013-08-23 15:23:03] 0000:05:0e:1: (XEN) [2013-08-23 15:23:03] 0000:05:0e:2: (XEN) [2013-08-23 15:23:03] 0000:05:0e:3: (XEN) [2013-08-23 15:23:03] 0000:05:0e:4: (XEN) [2013-08-23 15:23:03] 0000:05:0e:5: (XEN) [2013-08-23 15:23:03] 0000:05:0e:6: (XEN) [2013-08-23 15:23:03] 0000:05:0e:7: (XEN) [2013-08-23 15:23:03] 0000:05:0f:0: (XEN) [2013-08-23 15:23:03] 0000:05:0f:1: (XEN) [2013-08-23 15:23:03] 0000:05:0f:2: (XEN) [2013-08-23 15:23:03] 0000:05:0f:3: (XEN) [2013-08-23 15:23:03] 0000:05:0f:4: (XEN) [2013-08-23 15:23:03] 0000:05:0f:5: (XEN) [2013-08-23 15:23:03] 0000:05:0f:6: (XEN) [2013-08-23 15:23:03] 0000:05:0f:7: (XEN) [2013-08-23 15:23:03] 0000:05:10:0: (XEN) [2013-08-23 15:23:03] 0000:05:10:1: (XEN) [2013-08-23 15:23:03] 0000:05:10:2: (XEN) [2013-08-23 15:23:03] 0000:05:10:3: (XEN) [2013-08-23 15:23:03] 0000:05:10:4: (XEN) [2013-08-23 15:23:03] 0000:05:10:5: (XEN) [2013-08-23 15:23:03] 0000:05:10:6: (XEN) [2013-08-23 15:23:03] 0000:05:10:7: (XEN) [2013-08-23 15:23:03] 0000:05:11:0: (XEN) [2013-08-23 15:23:03] 0000:05:11:1: (XEN) [2013-08-23 15:23:03] 0000:05:11:2: (XEN) [2013-08-23 15:23:03] 0000:05:11:3: (XEN) [2013-08-23 15:23:03] 0000:05:11:4: (XEN) [2013-08-23 15:23:03] 0000:05:11:5: (XEN) [2013-08-23 15:23:03] 0000:05:11:6: (XEN) [2013-08-23 15:23:03] 0000:05:11:7: (XEN) [2013-08-23 15:23:03] 0000:05:12:0: (XEN) [2013-08-23 15:23:03] 0000:05:12:1: (XEN) [2013-08-23 15:23:03] 0000:05:12:2: (XEN) [2013-08-23 15:23:03] 0000:05:12:3: (XEN) [2013-08-23 15:23:03] 0000:05:12:4: (XEN) [2013-08-23 15:23:03] 0000:05:12:5: (XEN) [2013-08-23 15:23:03] 0000:05:12:6: (XEN) [2013-08-23 15:23:03] 0000:05:12:7: (XEN) [2013-08-23 15:23:03] 0000:05:13:0: (XEN) [2013-08-23 15:23:03] 0000:05:13:1: (XEN) [2013-08-23 15:23:03] 0000:05:13:2: (XEN) [2013-08-23 15:23:03] 0000:05:13:3: (XEN) [2013-08-23 15:23:03] 0000:05:13:4: (XEN) [2013-08-23 15:23:03] 0000:05:13:5: (XEN) [2013-08-23 15:23:03] 0000:05:13:6: (XEN) [2013-08-23 15:23:03] 0000:05:13:7: (XEN) [2013-08-23 15:23:03] 0000:05:14:0: (XEN) [2013-08-23 15:23:03] 0000:05:14:1: (XEN) [2013-08-23 15:23:03] 0000:05:14:2: (XEN) [2013-08-23 15:23:03] 0000:05:14:3: (XEN) [2013-08-23 15:23:03] 0000:05:14:4: (XEN) [2013-08-23 15:23:03] 0000:05:14:5: (XEN) [2013-08-23 15:23:03] 0000:05:14:6: (XEN) [2013-08-23 15:23:03] 0000:05:14:7: (XEN) [2013-08-23 15:23:03] 0000:05:15:0: (XEN) [2013-08-23 15:23:03] 0000:05:15:1: (XEN) [2013-08-23 15:23:03] 0000:05:15:2: (XEN) [2013-08-23 15:23:03] 0000:05:15:3: (XEN) [2013-08-23 15:23:03] 0000:05:15:4: (XEN) [2013-08-23 15:23:03] 0000:05:15:5: (XEN) [2013-08-23 15:23:03] 0000:05:15:6: (XEN) [2013-08-23 15:23:03] 0000:05:15:7: (XEN) [2013-08-23 15:23:03] 0000:05:16:0: (XEN) [2013-08-23 15:23:03] 0000:05:16:1: (XEN) [2013-08-23 15:23:03] 0000:05:16:2: (XEN) [2013-08-23 15:23:03] 0000:05:16:3: (XEN) [2013-08-23 15:23:03] 0000:05:16:4: (XEN) [2013-08-23 15:23:03] 0000:05:16:5: (XEN) [2013-08-23 15:23:03] 0000:05:16:6: (XEN) [2013-08-23 15:23:03] 0000:05:16:7: (XEN) [2013-08-23 15:23:03] 0000:05:17:0: (XEN) [2013-08-23 15:23:03] 0000:05:17:1: (XEN) [2013-08-23 15:23:03] 0000:05:17:2: (XEN) [2013-08-23 15:23:04] 0000:05:17:3: (XEN) [2013-08-23 15:23:04] 0000:05:17:4: (XEN) [2013-08-23 15:23:04] 0000:05:17:5: (XEN) [2013-08-23 15:23:04] 0000:05:17:6: (XEN) [2013-08-23 15:23:04] 0000:05:17:7: (XEN) [2013-08-23 15:23:04] 0000:05:18:0: (XEN) [2013-08-23 15:23:04] 0000:05:18:1: (XEN) [2013-08-23 15:23:04] 0000:05:18:2: (XEN) [2013-08-23 15:23:04] 0000:05:18:3: (XEN) [2013-08-23 15:23:04] 0000:05:18:4: (XEN) [2013-08-23 15:23:04] 0000:05:18:5: (XEN) [2013-08-23 15:23:04] 0000:05:18:6: (XEN) [2013-08-23 15:23:04] 0000:05:18:7: (XEN) [2013-08-23 15:23:04] 0000:05:19:0: (XEN) [2013-08-23 15:23:04] 0000:05:19:1: (XEN) [2013-08-23 15:23:04] 0000:05:19:2: (XEN) [2013-08-23 15:23:04] 0000:05:19:3: (XEN) [2013-08-23 15:23:04] 0000:05:19:4: (XEN) [2013-08-23 15:23:04] 0000:05:19:5: (XEN) [2013-08-23 15:23:04] 0000:05:19:6: (XEN) [2013-08-23 15:23:04] 0000:05:19:7: (XEN) [2013-08-23 15:23:04] 0000:05:1a:0: (XEN) [2013-08-23 15:23:04] 0000:05:1a:1: (XEN) [2013-08-23 15:23:04] 0000:05:1a:2: (XEN) [2013-08-23 15:23:04] 0000:05:1a:3: (XEN) [2013-08-23 15:23:04] 0000:05:1a:4: (XEN) [2013-08-23 15:23:04] 0000:05:1a:5: (XEN) [2013-08-23 15:23:04] 0000:05:1a:6: (XEN) [2013-08-23 15:23:04] 0000:05:1a:7: (XEN) [2013-08-23 15:23:04] 0000:05:1b:0: (XEN) [2013-08-23 15:23:04] 0000:05:1b:1: (XEN) [2013-08-23 15:23:04] 0000:05:1b:2: (XEN) [2013-08-23 15:23:04] 0000:05:1b:3: (XEN) [2013-08-23 15:23:04] 0000:05:1b:4: (XEN) [2013-08-23 15:23:04] 0000:05:1b:5: (XEN) [2013-08-23 15:23:04] 0000:05:1b:6: (XEN) [2013-08-23 15:23:04] 0000:05:1b:7: (XEN) [2013-08-23 15:23:04] 0000:05:1c:0: (XEN) [2013-08-23 15:23:04] 0000:05:1c:1: (XEN) [2013-08-23 15:23:04] 0000:05:1c:2: (XEN) [2013-08-23 15:23:04] 0000:05:1c:3: (XEN) [2013-08-23 15:23:04] 0000:05:1c:4: (XEN) [2013-08-23 15:23:04] 0000:05:1c:5: (XEN) [2013-08-23 15:23:04] 0000:05:1c:6: (XEN) [2013-08-23 15:23:04] 0000:05:1c:7: (XEN) [2013-08-23 15:23:04] 0000:05:1d:0: (XEN) [2013-08-23 15:23:04] 0000:05:1d:1: (XEN) [2013-08-23 15:23:04] 0000:05:1d:2: (XEN) [2013-08-23 15:23:04] 0000:05:1d:3: (XEN) [2013-08-23 15:23:04] 0000:05:1d:4: (XEN) [2013-08-23 15:23:04] 0000:05:1d:5: (XEN) [2013-08-23 15:23:04] 0000:05:1d:6: (XEN) [2013-08-23 15:23:04] 0000:05:1d:7: (XEN) [2013-08-23 15:23:04] 0000:05:1e:0: (XEN) [2013-08-23 15:23:04] 0000:05:1e:1: (XEN) [2013-08-23 15:23:04] 0000:05:1e:2: (XEN) [2013-08-23 15:23:04] 0000:05:1e:3: (XEN) [2013-08-23 15:23:04] 0000:05:1e:4: (XEN) [2013-08-23 15:23:04] 0000:05:1e:5: (XEN) [2013-08-23 15:23:04] 0000:05:1e:6: (XEN) [2013-08-23 15:23:04] 0000:05:1e:7: (XEN) [2013-08-23 15:23:04] 0000:05:1f:0: (XEN) [2013-08-23 15:23:04] 0000:05:1f:1: (XEN) [2013-08-23 15:23:04] 0000:05:1f:2: (XEN) [2013-08-23 15:23:04] 0000:05:1f:3: (XEN) [2013-08-23 15:23:04] 0000:05:1f:4: (XEN) [2013-08-23 15:23:04] 0000:05:1f:5: (XEN) [2013-08-23 15:23:04] 0000:05:1f:6: (XEN) [2013-08-23 15:23:04] 0000:05:1f:7: (XEN) [2013-08-23 15:23:04] 0000:06:00:0: (XEN) [2013-08-23 15:23:04] 0000:06:00:1: (XEN) [2013-08-23 15:23:04] 0000:06:00:2: (XEN) [2013-08-23 15:23:04] 0000:06:00:3: (XEN) [2013-08-23 15:23:04] 0000:06:00:4: (XEN) [2013-08-23 15:23:04] 0000:06:00:5: (XEN) [2013-08-23 15:23:04] 0000:06:00:6: (XEN) [2013-08-23 15:23:04] 0000:06:00:7: (XEN) [2013-08-23 15:23:04] 0000:06:00:0: (XEN) [2013-08-23 15:23:04] 0000:06:00:0: (XEN) [2013-08-23 15:23:04] 0000:06:00:0: (XEN) [2013-08-23 15:23:04] 0000:06:00:0: (XEN) [2013-08-23 15:23:04] 0000:06:00:0: (XEN) [2013-08-23 15:23:04] 0000:06:00:0: (XEN) [2013-08-23 15:23:04] 0000:06:00:0: (XEN) [2013-08-23 15:23:04] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:05] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:06] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:06:00:0: (XEN) [2013-08-23 15:23:07] 0000:07:00:0: (XEN) [2013-08-23 15:23:07] 0000:07:00:1: (XEN) [2013-08-23 15:23:07] 0000:07:00:2: (XEN) [2013-08-23 15:23:07] 0000:07:00:3: (XEN) [2013-08-23 15:23:07] 0000:07:00:4: (XEN) [2013-08-23 15:23:07] 0000:07:00:5: (XEN) [2013-08-23 15:23:07] 0000:07:00:6: (XEN) [2013-08-23 15:23:07] 0000:07:00:7: (XEN) [2013-08-23 15:23:07] 0000:07:01:0: (XEN) [2013-08-23 15:23:07] 0000:07:01:1: (XEN) [2013-08-23 15:23:07] 0000:07:01:2: (XEN) [2013-08-23 15:23:07] 0000:07:01:3: (XEN) [2013-08-23 15:23:07] 0000:07:01:4: (XEN) [2013-08-23 15:23:07] 0000:07:01:5: (XEN) [2013-08-23 15:23:07] 0000:07:01:6: (XEN) [2013-08-23 15:23:07] 0000:07:01:7: (XEN) [2013-08-23 15:23:07] 0000:07:02:0: (XEN) [2013-08-23 15:23:08] 0000:07:02:1: (XEN) [2013-08-23 15:23:08] 0000:07:02:2: (XEN) [2013-08-23 15:23:08] 0000:07:02:3: (XEN) [2013-08-23 15:23:08] 0000:07:02:4: (XEN) [2013-08-23 15:23:08] 0000:07:02:5: (XEN) [2013-08-23 15:23:08] 0000:07:02:6: (XEN) [2013-08-23 15:23:08] 0000:07:02:7: (XEN) [2013-08-23 15:23:08] 0000:07:03:0: (XEN) [2013-08-23 15:23:08] 0000:07:03:1: (XEN) [2013-08-23 15:23:08] 0000:07:03:2: (XEN) [2013-08-23 15:23:08] 0000:07:03:3: (XEN) [2013-08-23 15:23:08] 0000:07:03:4: (XEN) [2013-08-23 15:23:08] 0000:07:03:5: (XEN) [2013-08-23 15:23:08] 0000:07:03:6: (XEN) [2013-08-23 15:23:08] 0000:07:03:7: (XEN) [2013-08-23 15:23:08] 0000:07:04:0: (XEN) [2013-08-23 15:23:08] 0000:07:04:1: (XEN) [2013-08-23 15:23:08] 0000:07:04:2: (XEN) [2013-08-23 15:23:08] 0000:07:04:3: (XEN) [2013-08-23 15:23:08] 0000:07:04:4: (XEN) [2013-08-23 15:23:08] 0000:07:04:5: (XEN) [2013-08-23 15:23:08] 0000:07:04:6: (XEN) [2013-08-23 15:23:08] 0000:07:04:7: (XEN) [2013-08-23 15:23:08] 0000:07:05:0: (XEN) [2013-08-23 15:23:08] 0000:07:05:1: (XEN) [2013-08-23 15:23:08] 0000:07:05:2: (XEN) [2013-08-23 15:23:08] 0000:07:05:3: (XEN) [2013-08-23 15:23:08] 0000:07:05:4: (XEN) [2013-08-23 15:23:08] 0000:07:05:5: (XEN) [2013-08-23 15:23:08] 0000:07:05:6: (XEN) [2013-08-23 15:23:08] 0000:07:05:7: (XEN) [2013-08-23 15:23:08] 0000:07:06:0: (XEN) [2013-08-23 15:23:08] 0000:07:06:1: (XEN) [2013-08-23 15:23:08] 0000:07:06:2: (XEN) [2013-08-23 15:23:08] 0000:07:06:3: (XEN) [2013-08-23 15:23:08] 0000:07:06:4: (XEN) [2013-08-23 15:23:08] 0000:07:06:5: (XEN) [2013-08-23 15:23:08] 0000:07:06:6: (XEN) [2013-08-23 15:23:08] 0000:07:06:7: (XEN) [2013-08-23 15:23:08] 0000:07:07:0: (XEN) [2013-08-23 15:23:08] 0000:07:07:1: (XEN) [2013-08-23 15:23:08] 0000:07:07:2: (XEN) [2013-08-23 15:23:08] 0000:07:07:3: (XEN) [2013-08-23 15:23:08] 0000:07:07:4: (XEN) [2013-08-23 15:23:08] 0000:07:07:5: (XEN) [2013-08-23 15:23:08] 0000:07:07:6: (XEN) [2013-08-23 15:23:08] 0000:07:07:7: (XEN) [2013-08-23 15:23:08] 0000:07:08:0: (XEN) [2013-08-23 15:23:08] 0000:07:08:1: (XEN) [2013-08-23 15:23:08] 0000:07:08:2: (XEN) [2013-08-23 15:23:08] 0000:07:08:3: (XEN) [2013-08-23 15:23:08] 0000:07:08:4: (XEN) [2013-08-23 15:23:08] 0000:07:08:5: (XEN) [2013-08-23 15:23:08] 0000:07:08:6: (XEN) [2013-08-23 15:23:08] 0000:07:08:7: (XEN) [2013-08-23 15:23:08] 0000:07:09:0: (XEN) [2013-08-23 15:23:08] 0000:07:09:1: (XEN) [2013-08-23 15:23:08] 0000:07:09:2: (XEN) [2013-08-23 15:23:08] 0000:07:09:3: (XEN) [2013-08-23 15:23:08] 0000:07:09:4: (XEN) [2013-08-23 15:23:08] 0000:07:09:5: (XEN) [2013-08-23 15:23:08] 0000:07:09:6: (XEN) [2013-08-23 15:23:08] 0000:07:09:7: (XEN) [2013-08-23 15:23:08] 0000:07:0a:0: (XEN) [2013-08-23 15:23:08] 0000:07:0a:1: (XEN) [2013-08-23 15:23:08] 0000:07:0a:2: (XEN) [2013-08-23 15:23:08] 0000:07:0a:3: (XEN) [2013-08-23 15:23:08] 0000:07:0a:4: (XEN) [2013-08-23 15:23:08] 0000:07:0a:5: (XEN) [2013-08-23 15:23:08] 0000:07:0a:6: (XEN) [2013-08-23 15:23:08] 0000:07:0a:7: (XEN) [2013-08-23 15:23:08] 0000:07:0b:0: (XEN) [2013-08-23 15:23:08] 0000:07:0b:1: (XEN) [2013-08-23 15:23:08] 0000:07:0b:2: (XEN) [2013-08-23 15:23:08] 0000:07:0b:3: (XEN) [2013-08-23 15:23:08] 0000:07:0b:4: (XEN) [2013-08-23 15:23:08] 0000:07:0b:5: (XEN) [2013-08-23 15:23:08] 0000:07:0b:6: (XEN) [2013-08-23 15:23:08] 0000:07:0b:7: (XEN) [2013-08-23 15:23:08] 0000:07:0c:0: (XEN) [2013-08-23 15:23:08] 0000:07:0c:1: (XEN) [2013-08-23 15:23:08] 0000:07:0c:2: (XEN) [2013-08-23 15:23:08] 0000:07:0c:3: (XEN) [2013-08-23 15:23:08] 0000:07:0c:4: (XEN) [2013-08-23 15:23:08] 0000:07:0c:5: (XEN) [2013-08-23 15:23:09] 0000:07:0c:6: (XEN) [2013-08-23 15:23:09] 0000:07:0c:7: (XEN) [2013-08-23 15:23:09] 0000:07:0d:0: (XEN) [2013-08-23 15:23:09] 0000:07:0d:1: (XEN) [2013-08-23 15:23:09] 0000:07:0d:2: (XEN) [2013-08-23 15:23:09] 0000:07:0d:3: (XEN) [2013-08-23 15:23:09] 0000:07:0d:4: (XEN) [2013-08-23 15:23:09] 0000:07:0d:5: (XEN) [2013-08-23 15:23:09] 0000:07:0d:6: (XEN) [2013-08-23 15:23:09] 0000:07:0d:7: (XEN) [2013-08-23 15:23:09] 0000:07:0e:0: (XEN) [2013-08-23 15:23:09] 0000:07:0e:1: (XEN) [2013-08-23 15:23:09] 0000:07:0e:2: (XEN) [2013-08-23 15:23:09] 0000:07:0e:3: (XEN) [2013-08-23 15:23:09] 0000:07:0e:4: (XEN) [2013-08-23 15:23:09] 0000:07:0e:5: (XEN) [2013-08-23 15:23:09] 0000:07:0e:6: (XEN) [2013-08-23 15:23:09] 0000:07:0e:7: (XEN) [2013-08-23 15:23:09] 0000:07:0f:0: (XEN) [2013-08-23 15:23:09] 0000:07:0f:1: (XEN) [2013-08-23 15:23:09] 0000:07:0f:2: (XEN) [2013-08-23 15:23:09] 0000:07:0f:3: (XEN) [2013-08-23 15:23:09] 0000:07:0f:4: (XEN) [2013-08-23 15:23:09] 0000:07:0f:5: (XEN) [2013-08-23 15:23:09] 0000:07:0f:6: (XEN) [2013-08-23 15:23:09] 0000:07:0f:7: (XEN) [2013-08-23 15:23:09] 0000:07:10:0: (XEN) [2013-08-23 15:23:09] 0000:07:10:1: (XEN) [2013-08-23 15:23:09] 0000:07:10:2: (XEN) [2013-08-23 15:23:09] 0000:07:10:3: (XEN) [2013-08-23 15:23:09] 0000:07:10:4: (XEN) [2013-08-23 15:23:09] 0000:07:10:5: (XEN) [2013-08-23 15:23:09] 0000:07:10:6: (XEN) [2013-08-23 15:23:09] 0000:07:10:7: (XEN) [2013-08-23 15:23:09] 0000:07:11:0: (XEN) [2013-08-23 15:23:09] 0000:07:11:1: (XEN) [2013-08-23 15:23:09] 0000:07:11:2: (XEN) [2013-08-23 15:23:09] 0000:07:11:3: (XEN) [2013-08-23 15:23:09] 0000:07:11:4: (XEN) [2013-08-23 15:23:09] 0000:07:11:5: (XEN) [2013-08-23 15:23:09] 0000:07:11:6: (XEN) [2013-08-23 15:23:09] 0000:07:11:7: (XEN) [2013-08-23 15:23:09] 0000:07:12:0: (XEN) [2013-08-23 15:23:09] 0000:07:12:1: (XEN) [2013-08-23 15:23:09] 0000:07:12:2: (XEN) [2013-08-23 15:23:09] 0000:07:12:3: (XEN) [2013-08-23 15:23:09] 0000:07:12:4: (XEN) [2013-08-23 15:23:09] 0000:07:12:5: (XEN) [2013-08-23 15:23:09] 0000:07:12:6: (XEN) [2013-08-23 15:23:09] 0000:07:12:7: (XEN) [2013-08-23 15:23:09] 0000:07:13:0: (XEN) [2013-08-23 15:23:09] 0000:07:13:1: (XEN) [2013-08-23 15:23:09] 0000:07:13:2: (XEN) [2013-08-23 15:23:09] 0000:07:13:3: (XEN) [2013-08-23 15:23:09] 0000:07:13:4: (XEN) [2013-08-23 15:23:09] 0000:07:13:5: (XEN) [2013-08-23 15:23:09] 0000:07:13:6: (XEN) [2013-08-23 15:23:09] 0000:07:13:7: (XEN) [2013-08-23 15:23:09] 0000:07:14:0: (XEN) [2013-08-23 15:23:09] 0000:07:14:1: (XEN) [2013-08-23 15:23:09] 0000:07:14:2: (XEN) [2013-08-23 15:23:09] 0000:07:14:3: (XEN) [2013-08-23 15:23:09] 0000:07:14:4: (XEN) [2013-08-23 15:23:09] 0000:07:14:5: (XEN) [2013-08-23 15:23:09] 0000:07:14:6: (XEN) [2013-08-23 15:23:09] 0000:07:14:7: (XEN) [2013-08-23 15:23:09] 0000:07:15:0: (XEN) [2013-08-23 15:23:09] 0000:07:15:1: (XEN) [2013-08-23 15:23:09] 0000:07:15:2: (XEN) [2013-08-23 15:23:09] 0000:07:15:3: (XEN) [2013-08-23 15:23:09] 0000:07:15:4: (XEN) [2013-08-23 15:23:09] 0000:07:15:5: (XEN) [2013-08-23 15:23:09] 0000:07:15:6: (XEN) [2013-08-23 15:23:09] 0000:07:15:7: (XEN) [2013-08-23 15:23:09] 0000:07:16:0: (XEN) [2013-08-23 15:23:09] 0000:07:16:1: (XEN) [2013-08-23 15:23:09] 0000:07:16:2: (XEN) [2013-08-23 15:23:09] 0000:07:16:3: (XEN) [2013-08-23 15:23:09] 0000:07:16:4: (XEN) [2013-08-23 15:23:09] 0000:07:16:5: (XEN) [2013-08-23 15:23:09] 0000:07:16:6: (XEN) [2013-08-23 15:23:09] 0000:07:16:7: (XEN) [2013-08-23 15:23:09] 0000:07:17:0: (XEN) [2013-08-23 15:23:09] 0000:07:17:1: (XEN) [2013-08-23 15:23:09] 0000:07:17:2: (XEN) [2013-08-23 15:23:10] 0000:07:17:3: (XEN) [2013-08-23 15:23:10] 0000:07:17:4: (XEN) [2013-08-23 15:23:10] 0000:07:17:5: (XEN) [2013-08-23 15:23:10] 0000:07:17:6: (XEN) [2013-08-23 15:23:10] 0000:07:17:7: (XEN) [2013-08-23 15:23:10] 0000:07:18:0: (XEN) [2013-08-23 15:23:10] 0000:07:18:1: (XEN) [2013-08-23 15:23:10] 0000:07:18:2: (XEN) [2013-08-23 15:23:10] 0000:07:18:3: (XEN) [2013-08-23 15:23:10] 0000:07:18:4: (XEN) [2013-08-23 15:23:10] 0000:07:18:5: (XEN) [2013-08-23 15:23:10] 0000:07:18:6: (XEN) [2013-08-23 15:23:10] 0000:07:18:7: (XEN) [2013-08-23 15:23:10] 0000:07:19:0: (XEN) [2013-08-23 15:23:10] 0000:07:19:1: (XEN) [2013-08-23 15:23:10] 0000:07:19:2: (XEN) [2013-08-23 15:23:10] 0000:07:19:3: (XEN) [2013-08-23 15:23:10] 0000:07:19:4: (XEN) [2013-08-23 15:23:10] 0000:07:19:5: (XEN) [2013-08-23 15:23:10] 0000:07:19:6: (XEN) [2013-08-23 15:23:10] 0000:07:19:7: (XEN) [2013-08-23 15:23:10] 0000:07:1a:0: (XEN) [2013-08-23 15:23:10] 0000:07:1a:1: (XEN) [2013-08-23 15:23:10] 0000:07:1a:2: (XEN) [2013-08-23 15:23:10] 0000:07:1a:3: (XEN) [2013-08-23 15:23:10] 0000:07:1a:4: (XEN) [2013-08-23 15:23:10] 0000:07:1a:5: (XEN) [2013-08-23 15:23:10] 0000:07:1a:6: (XEN) [2013-08-23 15:23:10] 0000:07:1a:7: (XEN) [2013-08-23 15:23:10] 0000:07:1b:0: (XEN) [2013-08-23 15:23:10] 0000:07:1b:1: (XEN) [2013-08-23 15:23:10] 0000:07:1b:2: (XEN) [2013-08-23 15:23:10] 0000:07:1b:3: (XEN) [2013-08-23 15:23:10] 0000:07:1b:4: (XEN) [2013-08-23 15:23:10] 0000:07:1b:5: (XEN) [2013-08-23 15:23:10] 0000:07:1b:6: (XEN) [2013-08-23 15:23:10] 0000:07:1b:7: (XEN) [2013-08-23 15:23:10] 0000:07:1c:0: (XEN) [2013-08-23 15:23:10] 0000:07:1c:1: (XEN) [2013-08-23 15:23:10] 0000:07:1c:2: (XEN) [2013-08-23 15:23:10] 0000:07:1c:3: (XEN) [2013-08-23 15:23:10] 0000:07:1c:4: (XEN) [2013-08-23 15:23:10] 0000:07:1c:5: (XEN) [2013-08-23 15:23:10] 0000:07:1c:6: (XEN) [2013-08-23 15:23:10] 0000:07:1c:7: (XEN) [2013-08-23 15:23:10] 0000:07:1d:0: (XEN) [2013-08-23 15:23:10] 0000:07:1d:1: (XEN) [2013-08-23 15:23:10] 0000:07:1d:2: (XEN) [2013-08-23 15:23:10] 0000:07:1d:3: (XEN) [2013-08-23 15:23:10] 0000:07:1d:4: (XEN) [2013-08-23 15:23:10] 0000:07:1d:5: (XEN) [2013-08-23 15:23:10] 0000:07:1d:6: (XEN) [2013-08-23 15:23:10] 0000:07:1d:7: (XEN) [2013-08-23 15:23:10] 0000:07:1e:0: (XEN) [2013-08-23 15:23:10] 0000:07:1e:1: (XEN) [2013-08-23 15:23:10] 0000:07:1e:2: (XEN) [2013-08-23 15:23:10] 0000:07:1e:3: (XEN) [2013-08-23 15:23:10] 0000:07:1e:4: (XEN) [2013-08-23 15:23:10] 0000:07:1e:5: (XEN) [2013-08-23 15:23:10] 0000:07:1e:6: (XEN) [2013-08-23 15:23:10] 0000:07:1e:7: (XEN) [2013-08-23 15:23:10] 0000:07:1f:0: (XEN) [2013-08-23 15:23:10] 0000:07:1f:1: (XEN) [2013-08-23 15:23:10] 0000:07:1f:2: (XEN) [2013-08-23 15:23:10] 0000:07:1f:3: (XEN) [2013-08-23 15:23:10] 0000:07:1f:4: (XEN) [2013-08-23 15:23:10] 0000:07:1f:5: (XEN) [2013-08-23 15:23:10] 0000:07:1f:6: (XEN) [2013-08-23 15:23:10] 0000:07:1f:7: (XEN) [2013-08-23 15:23:10] 0000:08:00:0: (XEN) [2013-08-23 15:23:10] 0000:08:00:1: (XEN) [2013-08-23 15:23:10] 0000:08:00:2: (XEN) [2013-08-23 15:23:10] 0000:08:00:3: (XEN) [2013-08-23 15:23:10] 0000:08:00:4: (XEN) [2013-08-23 15:23:10] 0000:08:00:5: (XEN) [2013-08-23 15:23:10] 0000:08:00:6: (XEN) [2013-08-23 15:23:10] 0000:08:00:7: (XEN) [2013-08-23 15:23:10] 0000:08:01:0: (XEN) [2013-08-23 15:23:10] 0000:08:01:1: (XEN) [2013-08-23 15:23:10] 0000:08:01:2: (XEN) [2013-08-23 15:23:10] 0000:08:01:3: (XEN) [2013-08-23 15:23:10] 0000:08:01:4: (XEN) [2013-08-23 15:23:10] 0000:08:01:5: (XEN) [2013-08-23 15:23:10] 0000:08:01:6: (XEN) [2013-08-23 15:23:10] 0000:08:01:7: (XEN) [2013-08-23 15:23:10] 0000:08:02:0: (XEN) [2013-08-23 15:23:11] 0000:08:02:1: (XEN) [2013-08-23 15:23:11] 0000:08:02:2: (XEN) [2013-08-23 15:23:11] 0000:08:02:3: (XEN) [2013-08-23 15:23:11] 0000:08:02:4: (XEN) [2013-08-23 15:23:11] 0000:08:02:5: (XEN) [2013-08-23 15:23:11] 0000:08:02:6: (XEN) [2013-08-23 15:23:11] 0000:08:02:7: (XEN) [2013-08-23 15:23:11] 0000:08:03:0: (XEN) [2013-08-23 15:23:11] 0000:08:03:1: (XEN) [2013-08-23 15:23:11] 0000:08:03:2: (XEN) [2013-08-23 15:23:11] 0000:08:03:3: (XEN) [2013-08-23 15:23:11] 0000:08:03:4: (XEN) [2013-08-23 15:23:11] 0000:08:03:5: (XEN) [2013-08-23 15:23:11] 0000:08:03:6: (XEN) [2013-08-23 15:23:11] 0000:08:03:7: (XEN) [2013-08-23 15:23:11] 0000:08:04:0: (XEN) [2013-08-23 15:23:11] 0000:08:04:1: (XEN) [2013-08-23 15:23:11] 0000:08:04:2: (XEN) [2013-08-23 15:23:11] 0000:08:04:3: (XEN) [2013-08-23 15:23:11] 0000:08:04:4: (XEN) [2013-08-23 15:23:11] 0000:08:04:5: (XEN) [2013-08-23 15:23:11] 0000:08:04:6: (XEN) [2013-08-23 15:23:11] 0000:08:04:7: (XEN) [2013-08-23 15:23:11] 0000:08:05:0: (XEN) [2013-08-23 15:23:11] 0000:08:05:1: (XEN) [2013-08-23 15:23:11] 0000:08:05:2: (XEN) [2013-08-23 15:23:11] 0000:08:05:3: (XEN) [2013-08-23 15:23:11] 0000:08:05:4: (XEN) [2013-08-23 15:23:11] 0000:08:05:5: (XEN) [2013-08-23 15:23:11] 0000:08:05:6: (XEN) [2013-08-23 15:23:11] 0000:08:05:7: (XEN) [2013-08-23 15:23:11] 0000:08:06:0: (XEN) [2013-08-23 15:23:11] 0000:08:06:1: (XEN) [2013-08-23 15:23:11] 0000:08:06:2: (XEN) [2013-08-23 15:23:11] 0000:08:06:3: (XEN) [2013-08-23 15:23:11] 0000:08:06:4: (XEN) [2013-08-23 15:23:11] 0000:08:06:5: (XEN) [2013-08-23 15:23:11] 0000:08:06:6: (XEN) [2013-08-23 15:23:11] 0000:08:06:7: (XEN) [2013-08-23 15:23:11] 0000:08:07:0: (XEN) [2013-08-23 15:23:11] 0000:08:07:1: (XEN) [2013-08-23 15:23:11] 0000:08:07:2: (XEN) [2013-08-23 15:23:11] 0000:08:07:3: (XEN) [2013-08-23 15:23:11] 0000:08:07:4: (XEN) [2013-08-23 15:23:11] 0000:08:07:5: (XEN) [2013-08-23 15:23:11] 0000:08:07:6: (XEN) [2013-08-23 15:23:11] 0000:08:07:7: (XEN) [2013-08-23 15:23:11] 0000:08:08:0: (XEN) [2013-08-23 15:23:11] 0000:08:08:1: (XEN) [2013-08-23 15:23:11] 0000:08:08:2: (XEN) [2013-08-23 15:23:11] 0000:08:08:3: (XEN) [2013-08-23 15:23:11] 0000:08:08:4: (XEN) [2013-08-23 15:23:11] 0000:08:08:5: (XEN) [2013-08-23 15:23:11] 0000:08:08:6: (XEN) [2013-08-23 15:23:11] 0000:08:08:7: (XEN) [2013-08-23 15:23:11] 0000:08:09:0: (XEN) [2013-08-23 15:23:11] 0000:08:09:1: (XEN) [2013-08-23 15:23:11] 0000:08:09:2: (XEN) [2013-08-23 15:23:11] 0000:08:09:3: (XEN) [2013-08-23 15:23:11] 0000:08:09:4: (XEN) [2013-08-23 15:23:11] 0000:08:09:5: (XEN) [2013-08-23 15:23:11] 0000:08:09:6: (XEN) [2013-08-23 15:23:11] 0000:08:09:7: (XEN) [2013-08-23 15:23:11] 0000:08:0a:0: (XEN) [2013-08-23 15:23:11] 0000:08:0a:1: (XEN) [2013-08-23 15:23:11] 0000:08:0a:2: (XEN) [2013-08-23 15:23:11] 0000:08:0a:3: (XEN) [2013-08-23 15:23:11] 0000:08:0a:4: (XEN) [2013-08-23 15:23:11] 0000:08:0a:5: (XEN) [2013-08-23 15:23:11] 0000:08:0a:6: (XEN) [2013-08-23 15:23:11] 0000:08:0a:7: (XEN) [2013-08-23 15:23:11] 0000:08:0b:0: (XEN) [2013-08-23 15:23:11] 0000:08:0b:1: (XEN) [2013-08-23 15:23:11] 0000:08:0b:2: (XEN) [2013-08-23 15:23:11] 0000:08:0b:3: (XEN) [2013-08-23 15:23:11] 0000:08:0b:4: (XEN) [2013-08-23 15:23:11] 0000:08:0b:5: (XEN) [2013-08-23 15:23:11] 0000:08:0b:6: (XEN) [2013-08-23 15:23:11] 0000:08:0b:7: (XEN) [2013-08-23 15:23:11] 0000:08:0c:0: (XEN) [2013-08-23 15:23:11] 0000:08:0c:1: (XEN) [2013-08-23 15:23:11] 0000:08:0c:2: (XEN) [2013-08-23 15:23:11] 0000:08:0c:3: (XEN) [2013-08-23 15:23:11] 0000:08:0c:4: (XEN) [2013-08-23 15:23:11] 0000:08:0c:5: (XEN) [2013-08-23 15:23:12] 0000:08:0c:6: (XEN) [2013-08-23 15:23:12] 0000:08:0c:7: (XEN) [2013-08-23 15:23:12] 0000:08:0d:0: (XEN) [2013-08-23 15:23:12] 0000:08:0d:1: (XEN) [2013-08-23 15:23:12] 0000:08:0d:2: (XEN) [2013-08-23 15:23:12] 0000:08:0d:3: (XEN) [2013-08-23 15:23:12] 0000:08:0d:4: (XEN) [2013-08-23 15:23:12] 0000:08:0d:5: (XEN) [2013-08-23 15:23:12] 0000:08:0d:6: (XEN) [2013-08-23 15:23:12] 0000:08:0d:7: (XEN) [2013-08-23 15:23:12] 0000:08:0e:0: (XEN) [2013-08-23 15:23:12] 0000:08:0e:1: (XEN) [2013-08-23 15:23:12] 0000:08:0e:2: (XEN) [2013-08-23 15:23:12] 0000:08:0e:3: (XEN) [2013-08-23 15:23:12] 0000:08:0e:4: (XEN) [2013-08-23 15:23:12] 0000:08:0e:5: (XEN) [2013-08-23 15:23:12] 0000:08:0e:6: (XEN) [2013-08-23 15:23:12] 0000:08:0e:7: (XEN) [2013-08-23 15:23:12] 0000:08:0f:0: (XEN) [2013-08-23 15:23:12] 0000:08:0f:1: (XEN) [2013-08-23 15:23:12] 0000:08:0f:2: (XEN) [2013-08-23 15:23:12] 0000:08:0f:3: (XEN) [2013-08-23 15:23:12] 0000:08:0f:4: (XEN) [2013-08-23 15:23:12] 0000:08:0f:5: (XEN) [2013-08-23 15:23:12] 0000:08:0f:6: (XEN) [2013-08-23 15:23:12] 0000:08:0f:7: (XEN) [2013-08-23 15:23:12] 0000:08:10:0: (XEN) [2013-08-23 15:23:12] 0000:08:10:1: (XEN) [2013-08-23 15:23:12] 0000:08:10:2: (XEN) [2013-08-23 15:23:12] 0000:08:10:3: (XEN) [2013-08-23 15:23:12] 0000:08:10:4: (XEN) [2013-08-23 15:23:12] 0000:08:10:5: (XEN) [2013-08-23 15:23:12] 0000:08:10:6: (XEN) [2013-08-23 15:23:12] 0000:08:10:7: (XEN) [2013-08-23 15:23:12] 0000:08:11:0: (XEN) [2013-08-23 15:23:12] 0000:08:11:1: (XEN) [2013-08-23 15:23:12] 0000:08:11:2: (XEN) [2013-08-23 15:23:12] 0000:08:11:3: (XEN) [2013-08-23 15:23:12] 0000:08:11:4: (XEN) [2013-08-23 15:23:12] 0000:08:11:5: (XEN) [2013-08-23 15:23:12] 0000:08:11:6: (XEN) [2013-08-23 15:23:12] 0000:08:11:7: (XEN) [2013-08-23 15:23:12] 0000:08:12:0: (XEN) [2013-08-23 15:23:12] 0000:08:12:1: (XEN) [2013-08-23 15:23:12] 0000:08:12:2: (XEN) [2013-08-23 15:23:12] 0000:08:12:3: (XEN) [2013-08-23 15:23:12] 0000:08:12:4: (XEN) [2013-08-23 15:23:12] 0000:08:12:5: (XEN) [2013-08-23 15:23:12] 0000:08:12:6: (XEN) [2013-08-23 15:23:12] 0000:08:12:7: (XEN) [2013-08-23 15:23:12] 0000:08:13:0: (XEN) [2013-08-23 15:23:12] 0000:08:13:1: (XEN) [2013-08-23 15:23:12] 0000:08:13:2: (XEN) [2013-08-23 15:23:12] 0000:08:13:3: (XEN) [2013-08-23 15:23:12] 0000:08:13:4: (XEN) [2013-08-23 15:23:12] 0000:08:13:5: (XEN) [2013-08-23 15:23:12] 0000:08:13:6: (XEN) [2013-08-23 15:23:12] 0000:08:13:7: (XEN) [2013-08-23 15:23:12] 0000:08:14:0: (XEN) [2013-08-23 15:23:12] 0000:08:14:1: (XEN) [2013-08-23 15:23:12] 0000:08:14:2: (XEN) [2013-08-23 15:23:12] 0000:08:14:3: (XEN) [2013-08-23 15:23:12] 0000:08:14:4: (XEN) [2013-08-23 15:23:12] 0000:08:14:5: (XEN) [2013-08-23 15:23:12] 0000:08:14:6: (XEN) [2013-08-23 15:23:12] 0000:08:14:7: (XEN) [2013-08-23 15:23:12] 0000:08:15:0: (XEN) [2013-08-23 15:23:12] 0000:08:15:1: (XEN) [2013-08-23 15:23:12] 0000:08:15:2: (XEN) [2013-08-23 15:23:12] 0000:08:15:3: (XEN) [2013-08-23 15:23:12] 0000:08:15:4: (XEN) [2013-08-23 15:23:12] 0000:08:15:5: (XEN) [2013-08-23 15:23:12] 0000:08:15:6: (XEN) [2013-08-23 15:23:12] 0000:08:15:7: (XEN) [2013-08-23 15:23:12] 0000:08:16:0: (XEN) [2013-08-23 15:23:12] 0000:08:16:1: (XEN) [2013-08-23 15:23:12] 0000:08:16:2: (XEN) [2013-08-23 15:23:12] 0000:08:16:3: (XEN) [2013-08-23 15:23:12] 0000:08:16:4: (XEN) [2013-08-23 15:23:12] 0000:08:16:5: (XEN) [2013-08-23 15:23:12] 0000:08:16:6: (XEN) [2013-08-23 15:23:12] 0000:08:16:7: (XEN) [2013-08-23 15:23:12] 0000:08:17:0: (XEN) [2013-08-23 15:23:12] 0000:08:17:1: (XEN) [2013-08-23 15:23:12] 0000:08:17:2: (XEN) [2013-08-23 15:23:12] 0000:08:17:3: (XEN) [2013-08-23 15:23:13] 0000:08:17:4: (XEN) [2013-08-23 15:23:13] 0000:08:17:5: (XEN) [2013-08-23 15:23:13] 0000:08:17:6: (XEN) [2013-08-23 15:23:13] 0000:08:17:7: (XEN) [2013-08-23 15:23:13] 0000:08:18:0: (XEN) [2013-08-23 15:23:13] 0000:08:18:1: (XEN) [2013-08-23 15:23:13] 0000:08:18:2: (XEN) [2013-08-23 15:23:13] 0000:08:18:3: (XEN) [2013-08-23 15:23:13] 0000:08:18:4: (XEN) [2013-08-23 15:23:13] 0000:08:18:5: (XEN) [2013-08-23 15:23:13] 0000:08:18:6: (XEN) [2013-08-23 15:23:13] 0000:08:18:7: (XEN) [2013-08-23 15:23:13] 0000:08:19:0: (XEN) [2013-08-23 15:23:13] 0000:08:19:1: (XEN) [2013-08-23 15:23:13] 0000:08:19:2: (XEN) [2013-08-23 15:23:13] 0000:08:19:3: (XEN) [2013-08-23 15:23:13] 0000:08:19:4: (XEN) [2013-08-23 15:23:13] 0000:08:19:5: (XEN) [2013-08-23 15:23:13] 0000:08:19:6: (XEN) [2013-08-23 15:23:13] 0000:08:19:7: (XEN) [2013-08-23 15:23:13] 0000:08:1a:0: (XEN) [2013-08-23 15:23:13] 0000:08:1a:1: (XEN) [2013-08-23 15:23:13] 0000:08:1a:2: (XEN) [2013-08-23 15:23:13] 0000:08:1a:3: (XEN) [2013-08-23 15:23:13] 0000:08:1a:4: (XEN) [2013-08-23 15:23:13] 0000:08:1a:5: (XEN) [2013-08-23 15:23:13] 0000:08:1a:6: (XEN) [2013-08-23 15:23:13] 0000:08:1a:7: (XEN) [2013-08-23 15:23:13] 0000:08:1b:0: (XEN) [2013-08-23 15:23:13] 0000:08:1b:1: (XEN) [2013-08-23 15:23:13] 0000:08:1b:2: (XEN) [2013-08-23 15:23:13] 0000:08:1b:3: (XEN) [2013-08-23 15:23:13] 0000:08:1b:4: (XEN) [2013-08-23 15:23:13] 0000:08:1b:5: (XEN) [2013-08-23 15:23:13] 0000:08:1b:6: (XEN) [2013-08-23 15:23:13] 0000:08:1b:7: (XEN) [2013-08-23 15:23:13] 0000:08:1c:0: (XEN) [2013-08-23 15:23:13] 0000:08:1c:1: (XEN) [2013-08-23 15:23:13] 0000:08:1c:2: (XEN) [2013-08-23 15:23:13] 0000:08:1c:3: (XEN) [2013-08-23 15:23:13] 0000:08:1c:4: (XEN) [2013-08-23 15:23:13] 0000:08:1c:5: (XEN) [2013-08-23 15:23:13] 0000:08:1c:6: (XEN) [2013-08-23 15:23:13] 0000:08:1c:7: (XEN) [2013-08-23 15:23:13] 0000:08:1d:0: (XEN) [2013-08-23 15:23:13] 0000:08:1d:1: (XEN) [2013-08-23 15:23:13] 0000:08:1d:2: (XEN) [2013-08-23 15:23:13] 0000:08:1d:3: (XEN) [2013-08-23 15:23:13] 0000:08:1d:4: (XEN) [2013-08-23 15:23:13] 0000:08:1d:5: (XEN) [2013-08-23 15:23:13] 0000:08:1d:6: (XEN) [2013-08-23 15:23:13] 0000:08:1d:7: (XEN) [2013-08-23 15:23:13] 0000:08:1e:0: (XEN) [2013-08-23 15:23:13] 0000:08:1e:1: (XEN) [2013-08-23 15:23:13] 0000:08:1e:2: (XEN) [2013-08-23 15:23:13] 0000:08:1e:3: (XEN) [2013-08-23 15:23:13] 0000:08:1e:4: (XEN) [2013-08-23 15:23:13] 0000:08:1e:5: (XEN) [2013-08-23 15:23:13] 0000:08:1e:6: (XEN) [2013-08-23 15:23:13] 0000:08:1e:7: (XEN) [2013-08-23 15:23:13] 0000:08:1f:0: (XEN) [2013-08-23 15:23:13] 0000:08:1f:1: (XEN) [2013-08-23 15:23:13] 0000:08:1f:2: (XEN) [2013-08-23 15:23:13] 0000:08:1f:3: (XEN) [2013-08-23 15:23:13] 0000:08:1f:4: (XEN) [2013-08-23 15:23:13] 0000:08:1f:5: (XEN) [2013-08-23 15:23:13] 0000:08:1f:6: (XEN) [2013-08-23 15:23:13] 0000:08:1f:7: (XEN) [2013-08-23 15:23:13] 0000:09:00:0: (XEN) [2013-08-23 15:23:13] IRTE[000] 00420145 (XEN) [2013-08-23 15:23:13] IRTE[001] 004a0145 (XEN) [2013-08-23 15:23:13] IRTE[002] 00520145 (XEN) [2013-08-23 15:23:13] IRTE[003] 005a0145 (XEN) [2013-08-23 15:23:13] IRTE[004] 00620145 (XEN) [2013-08-23 15:23:13] IRTE[005] 006a0145 (XEN) [2013-08-23 15:23:13] IRTE[006] 00720145 (XEN) [2013-08-23 15:23:13] 0000:09:00:1: (XEN) [2013-08-23 15:23:13] 0000:09:00:2: (XEN) [2013-08-23 15:23:13] 0000:09:00:3: (XEN) [2013-08-23 15:23:13] 0000:09:00:4: (XEN) [2013-08-23 15:23:13] 0000:09:00:5: (XEN) [2013-08-23 15:23:13] 0000:09:00:6: (XEN) [2013-08-23 15:23:13] 0000:09:00:7: (XEN) [2013-08-23 15:23:13] 0000:09:01:0: (XEN) [2013-08-23 15:23:14] 0000:09:01:1: (XEN) [2013-08-23 15:23:14] 0000:09:01:2: (XEN) [2013-08-23 15:23:14] 0000:09:01:3: (XEN) [2013-08-23 15:23:14] 0000:09:01:4: (XEN) [2013-08-23 15:23:14] 0000:09:01:5: (XEN) [2013-08-23 15:23:14] 0000:09:01:6: (XEN) [2013-08-23 15:23:14] 0000:09:01:7: (XEN) [2013-08-23 15:23:14] 0000:09:02:0: (XEN) [2013-08-23 15:23:14] 0000:09:02:1: (XEN) [2013-08-23 15:23:14] 0000:09:02:2: (XEN) [2013-08-23 15:23:14] 0000:09:02:3: (XEN) [2013-08-23 15:23:14] 0000:09:02:4: (XEN) [2013-08-23 15:23:14] 0000:09:02:5: (XEN) [2013-08-23 15:23:14] 0000:09:02:6: (XEN) [2013-08-23 15:23:14] 0000:09:02:7: (XEN) [2013-08-23 15:23:14] 0000:09:03:0: (XEN) [2013-08-23 15:23:14] 0000:09:03:1: (XEN) [2013-08-23 15:23:14] 0000:09:03:2: (XEN) [2013-08-23 15:23:14] 0000:09:03:3: (XEN) [2013-08-23 15:23:14] 0000:09:03:4: (XEN) [2013-08-23 15:23:14] 0000:09:03:5: (XEN) [2013-08-23 15:23:14] 0000:09:03:6: (XEN) [2013-08-23 15:23:14] 0000:09:03:7: (XEN) [2013-08-23 15:23:14] 0000:09:04:0: (XEN) [2013-08-23 15:23:14] 0000:09:04:1: (XEN) [2013-08-23 15:23:14] 0000:09:04:2: (XEN) [2013-08-23 15:23:14] 0000:09:04:3: (XEN) [2013-08-23 15:23:14] 0000:09:04:4: (XEN) [2013-08-23 15:23:14] 0000:09:04:5: (XEN) [2013-08-23 15:23:14] 0000:09:04:6: (XEN) [2013-08-23 15:23:14] 0000:09:04:7: (XEN) [2013-08-23 15:23:14] 0000:09:05:0: (XEN) [2013-08-23 15:23:14] 0000:09:05:1: (XEN) [2013-08-23 15:23:14] 0000:09:05:2: (XEN) [2013-08-23 15:23:14] 0000:09:05:3: (XEN) [2013-08-23 15:23:14] 0000:09:05:4: (XEN) [2013-08-23 15:23:14] 0000:09:05:5: (XEN) [2013-08-23 15:23:14] 0000:09:05:6: (XEN) [2013-08-23 15:23:14] 0000:09:05:7: (XEN) [2013-08-23 15:23:14] 0000:09:06:0: (XEN) [2013-08-23 15:23:14] 0000:09:06:1: (XEN) [2013-08-23 15:23:14] 0000:09:06:2: (XEN) [2013-08-23 15:23:14] 0000:09:06:3: (XEN) [2013-08-23 15:23:14] 0000:09:06:4: (XEN) [2013-08-23 15:23:14] 0000:09:06:5: (XEN) [2013-08-23 15:23:14] 0000:09:06:6: (XEN) [2013-08-23 15:23:14] 0000:09:06:7: (XEN) [2013-08-23 15:23:14] 0000:09:07:0: (XEN) [2013-08-23 15:23:14] 0000:09:07:1: (XEN) [2013-08-23 15:23:14] 0000:09:07:2: (XEN) [2013-08-23 15:23:14] 0000:09:07:3: (XEN) [2013-08-23 15:23:14] 0000:09:07:4: (XEN) [2013-08-23 15:23:14] 0000:09:07:5: (XEN) [2013-08-23 15:23:14] 0000:09:07:6: (XEN) [2013-08-23 15:23:14] 0000:09:07:7: (XEN) [2013-08-23 15:23:14] 0000:09:08:0: (XEN) [2013-08-23 15:23:14] 0000:09:08:1: (XEN) [2013-08-23 15:23:14] 0000:09:08:2: (XEN) [2013-08-23 15:23:14] 0000:09:08:3: (XEN) [2013-08-23 15:23:14] 0000:09:08:4: (XEN) [2013-08-23 15:23:14] 0000:09:08:5: (XEN) [2013-08-23 15:23:14] 0000:09:08:6: (XEN) [2013-08-23 15:23:14] 0000:09:08:7: (XEN) [2013-08-23 15:23:14] 0000:09:09:0: (XEN) [2013-08-23 15:23:14] 0000:09:09:1: (XEN) [2013-08-23 15:23:14] 0000:09:09:2: (XEN) [2013-08-23 15:23:14] 0000:09:09:3: (XEN) [2013-08-23 15:23:14] 0000:09:09:4: (XEN) [2013-08-23 15:23:14] 0000:09:09:5: (XEN) [2013-08-23 15:23:14] 0000:09:09:6: (XEN) [2013-08-23 15:23:14] 0000:09:09:7: (XEN) [2013-08-23 15:23:14] 0000:09:0a:0: (XEN) [2013-08-23 15:23:14] 0000:09:0a:1: (XEN) [2013-08-23 15:23:14] 0000:09:0a:2: (XEN) [2013-08-23 15:23:14] 0000:09:0a:3: (XEN) [2013-08-23 15:23:14] 0000:09:0a:4: (XEN) [2013-08-23 15:23:14] 0000:09:0a:5: (XEN) [2013-08-23 15:23:14] 0000:09:0a:6: (XEN) [2013-08-23 15:23:14] 0000:09:0a:7: (XEN) [2013-08-23 15:23:14] 0000:09:0b:0: (XEN) [2013-08-23 15:23:14] 0000:09:0b:1: (XEN) [2013-08-23 15:23:14] 0000:09:0b:2: (XEN) [2013-08-23 15:23:14] 0000:09:0b:3: (XEN) [2013-08-23 15:23:14] 0000:09:0b:4: (XEN) [2013-08-23 15:23:14] 0000:09:0b:5: (XEN) [2013-08-23 15:23:14] 0000:09:0b:6: (XEN) [2013-08-23 15:23:15] 0000:09:0b:7: (XEN) [2013-08-23 15:23:15] 0000:09:0c:0: (XEN) [2013-08-23 15:23:15] 0000:09:0c:1: (XEN) [2013-08-23 15:23:15] 0000:09:0c:2: (XEN) [2013-08-23 15:23:15] 0000:09:0c:3: (XEN) [2013-08-23 15:23:15] 0000:09:0c:4: (XEN) [2013-08-23 15:23:15] 0000:09:0c:5: (XEN) [2013-08-23 15:23:15] 0000:09:0c:6: (XEN) [2013-08-23 15:23:15] 0000:09:0c:7: (XEN) [2013-08-23 15:23:15] 0000:09:0d:0: (XEN) [2013-08-23 15:23:15] 0000:09:0d:1: (XEN) [2013-08-23 15:23:15] 0000:09:0d:2: (XEN) [2013-08-23 15:23:15] 0000:09:0d:3: (XEN) [2013-08-23 15:23:15] 0000:09:0d:4: (XEN) [2013-08-23 15:23:15] 0000:09:0d:5: (XEN) [2013-08-23 15:23:15] 0000:09:0d:6: (XEN) [2013-08-23 15:23:15] 0000:09:0d:7: (XEN) [2013-08-23 15:23:15] 0000:09:0e:0: (XEN) [2013-08-23 15:23:15] 0000:09:0e:1: (XEN) [2013-08-23 15:23:15] 0000:09:0e:2: (XEN) [2013-08-23 15:23:15] 0000:09:0e:3: (XEN) [2013-08-23 15:23:15] 0000:09:0e:4: (XEN) [2013-08-23 15:23:15] 0000:09:0e:5: (XEN) [2013-08-23 15:23:15] 0000:09:0e:6: (XEN) [2013-08-23 15:23:15] 0000:09:0e:7: (XEN) [2013-08-23 15:23:15] 0000:09:0f:0: (XEN) [2013-08-23 15:23:15] 0000:09:0f:1: (XEN) [2013-08-23 15:23:15] 0000:09:0f:2: (XEN) [2013-08-23 15:23:15] 0000:09:0f:3: (XEN) [2013-08-23 15:23:15] 0000:09:0f:4: (XEN) [2013-08-23 15:23:15] 0000:09:0f:5: (XEN) [2013-08-23 15:23:15] 0000:09:0f:6: (XEN) [2013-08-23 15:23:15] 0000:09:0f:7: (XEN) [2013-08-23 15:23:15] 0000:09:10:0: (XEN) [2013-08-23 15:23:15] 0000:09:10:1: (XEN) [2013-08-23 15:23:15] 0000:09:10:2: (XEN) [2013-08-23 15:23:15] 0000:09:10:3: (XEN) [2013-08-23 15:23:15] 0000:09:10:4: (XEN) [2013-08-23 15:23:15] 0000:09:10:5: (XEN) [2013-08-23 15:23:15] 0000:09:10:6: (XEN) [2013-08-23 15:23:15] 0000:09:10:7: (XEN) [2013-08-23 15:23:15] 0000:09:11:0: (XEN) [2013-08-23 15:23:15] 0000:09:11:1: (XEN) [2013-08-23 15:23:15] 0000:09:11:2: (XEN) [2013-08-23 15:23:15] 0000:09:11:3: (XEN) [2013-08-23 15:23:15] 0000:09:11:4: (XEN) [2013-08-23 15:23:15] 0000:09:11:5: (XEN) [2013-08-23 15:23:15] 0000:09:11:6: (XEN) [2013-08-23 15:23:15] 0000:09:11:7: (XEN) [2013-08-23 15:23:15] 0000:09:12:0: (XEN) [2013-08-23 15:23:15] 0000:09:12:1: (XEN) [2013-08-23 15:23:15] 0000:09:12:2: (XEN) [2013-08-23 15:23:15] 0000:09:12:3: (XEN) [2013-08-23 15:23:15] 0000:09:12:4: (XEN) [2013-08-23 15:23:15] 0000:09:12:5: (XEN) [2013-08-23 15:23:15] 0000:09:12:6: (XEN) [2013-08-23 15:23:15] 0000:09:12:7: (XEN) [2013-08-23 15:23:15] 0000:09:13:0: (XEN) [2013-08-23 15:23:15] 0000:09:13:1: (XEN) [2013-08-23 15:23:15] 0000:09:13:2: (XEN) [2013-08-23 15:23:15] 0000:09:13:3: (XEN) [2013-08-23 15:23:15] 0000:09:13:4: (XEN) [2013-08-23 15:23:15] 0000:09:13:5: (XEN) [2013-08-23 15:23:15] 0000:09:13:6: (XEN) [2013-08-23 15:23:15] 0000:09:13:7: (XEN) [2013-08-23 15:23:15] 0000:09:14:0: (XEN) [2013-08-23 15:23:15] 0000:09:14:1: (XEN) [2013-08-23 15:23:15] 0000:09:14:2: (XEN) [2013-08-23 15:23:15] 0000:09:14:3: (XEN) [2013-08-23 15:23:15] 0000:09:14:4: (XEN) [2013-08-23 15:23:15] 0000:09:14:5: (XEN) [2013-08-23 15:23:15] 0000:09:14:6: (XEN) [2013-08-23 15:23:15] 0000:09:14:7: (XEN) [2013-08-23 15:23:15] 0000:09:15:0: (XEN) [2013-08-23 15:23:15] 0000:09:15:1: (XEN) [2013-08-23 15:23:15] 0000:09:15:2: (XEN) [2013-08-23 15:23:15] 0000:09:15:3: (XEN) [2013-08-23 15:23:15] 0000:09:15:4: (XEN) [2013-08-23 15:23:15] 0000:09:15:5: (XEN) [2013-08-23 15:23:15] 0000:09:15:6: (XEN) [2013-08-23 15:23:15] 0000:09:15:7: (XEN) [2013-08-23 15:23:15] 0000:09:16:0: (XEN) [2013-08-23 15:23:15] 0000:09:16:1: (XEN) [2013-08-23 15:23:15] 0000:09:16:2: (XEN) [2013-08-23 15:23:15] 0000:09:16:3: (XEN) [2013-08-23 15:23:16] 0000:09:16:4: (XEN) [2013-08-23 15:23:16] 0000:09:16:5: (XEN) [2013-08-23 15:23:16] 0000:09:16:6: (XEN) [2013-08-23 15:23:16] 0000:09:16:7: (XEN) [2013-08-23 15:23:16] 0000:09:17:0: (XEN) [2013-08-23 15:23:16] 0000:09:17:1: (XEN) [2013-08-23 15:23:16] 0000:09:17:2: (XEN) [2013-08-23 15:23:16] 0000:09:17:3: (XEN) [2013-08-23 15:23:16] 0000:09:17:4: (XEN) [2013-08-23 15:23:16] 0000:09:17:5: (XEN) [2013-08-23 15:23:16] 0000:09:17:6: (XEN) [2013-08-23 15:23:16] 0000:09:17:7: (XEN) [2013-08-23 15:23:16] 0000:09:18:0: (XEN) [2013-08-23 15:23:16] 0000:09:18:1: (XEN) [2013-08-23 15:23:16] 0000:09:18:2: (XEN) [2013-08-23 15:23:16] 0000:09:18:3: (XEN) [2013-08-23 15:23:16] 0000:09:18:4: (XEN) [2013-08-23 15:23:16] 0000:09:18:5: (XEN) [2013-08-23 15:23:16] 0000:09:18:6: (XEN) [2013-08-23 15:23:16] 0000:09:18:7: (XEN) [2013-08-23 15:23:16] 0000:09:19:0: (XEN) [2013-08-23 15:23:16] 0000:09:19:1: (XEN) [2013-08-23 15:23:16] 0000:09:19:2: (XEN) [2013-08-23 15:23:16] 0000:09:19:3: (XEN) [2013-08-23 15:23:16] 0000:09:19:4: (XEN) [2013-08-23 15:23:16] 0000:09:19:5: (XEN) [2013-08-23 15:23:16] 0000:09:19:6: (XEN) [2013-08-23 15:23:16] 0000:09:19:7: (XEN) [2013-08-23 15:23:16] 0000:09:1a:0: (XEN) [2013-08-23 15:23:16] 0000:09:1a:1: (XEN) [2013-08-23 15:23:16] 0000:09:1a:2: (XEN) [2013-08-23 15:23:16] 0000:09:1a:3: (XEN) [2013-08-23 15:23:16] 0000:09:1a:4: (XEN) [2013-08-23 15:23:16] 0000:09:1a:5: (XEN) [2013-08-23 15:23:16] 0000:09:1a:6: (XEN) [2013-08-23 15:23:16] 0000:09:1a:7: (XEN) [2013-08-23 15:23:16] 0000:09:1b:0: (XEN) [2013-08-23 15:23:16] 0000:09:1b:1: (XEN) [2013-08-23 15:23:16] 0000:09:1b:2: (XEN) [2013-08-23 15:23:16] 0000:09:1b:3: (XEN) [2013-08-23 15:23:16] 0000:09:1b:4: (XEN) [2013-08-23 15:23:16] 0000:09:1b:5: (XEN) [2013-08-23 15:23:16] 0000:09:1b:6: (XEN) [2013-08-23 15:23:16] 0000:09:1b:7: (XEN) [2013-08-23 15:23:16] 0000:09:1c:0: (XEN) [2013-08-23 15:23:16] 0000:09:1c:1: (XEN) [2013-08-23 15:23:16] 0000:09:1c:2: (XEN) [2013-08-23 15:23:16] 0000:09:1c:3: (XEN) [2013-08-23 15:23:16] 0000:09:1c:4: (XEN) [2013-08-23 15:23:16] 0000:09:1c:5: (XEN) [2013-08-23 15:23:16] 0000:09:1c:6: (XEN) [2013-08-23 15:23:16] 0000:09:1c:7: (XEN) [2013-08-23 15:23:16] 0000:09:1d:0: (XEN) [2013-08-23 15:23:16] 0000:09:1d:1: (XEN) [2013-08-23 15:23:16] 0000:09:1d:2: (XEN) [2013-08-23 15:23:16] 0000:09:1d:3: (XEN) [2013-08-23 15:23:16] 0000:09:1d:4: (XEN) [2013-08-23 15:23:16] 0000:09:1d:5: (XEN) [2013-08-23 15:23:16] 0000:09:1d:6: (XEN) [2013-08-23 15:23:16] 0000:09:1d:7: (XEN) [2013-08-23 15:23:16] 0000:09:1e:0: (XEN) [2013-08-23 15:23:16] 0000:09:1e:1: (XEN) [2013-08-23 15:23:16] 0000:09:1e:2: (XEN) [2013-08-23 15:23:16] 0000:09:1e:3: (XEN) [2013-08-23 15:23:16] 0000:09:1e:4: (XEN) [2013-08-23 15:23:16] 0000:09:1e:5: (XEN) [2013-08-23 15:23:16] 0000:09:1e:6: (XEN) [2013-08-23 15:23:16] 0000:09:1e:7: (XEN) [2013-08-23 15:23:16] 0000:09:1f:0: (XEN) [2013-08-23 15:23:16] 0000:09:1f:1: (XEN) [2013-08-23 15:23:16] 0000:09:1f:2: (XEN) [2013-08-23 15:23:16] 0000:09:1f:3: (XEN) [2013-08-23 15:23:16] 0000:09:1f:4: (XEN) [2013-08-23 15:23:16] 0000:09:1f:5: (XEN) [2013-08-23 15:23:16] 0000:09:1f:6: (XEN) [2013-08-23 15:23:16] 0000:09:1f:7: (XEN) [2013-08-23 15:23:16] 0000:0a:00:0: (XEN) [2013-08-23 15:23:16] IRTE[000] 003a0145 (XEN) [2013-08-23 15:23:16] 0000:0a:00:1: (XEN) [2013-08-23 15:23:16] 0000:0a:00:2: (XEN) [2013-08-23 15:23:16] 0000:0a:00:3: (XEN) [2013-08-23 15:23:16] 0000:0a:00:4: (XEN) [2013-08-23 15:23:16] 0000:0a:00:5: (XEN) [2013-08-23 15:23:16] 0000:0a:00:6: (XEN) [2013-08-23 15:23:16] 0000:0a:00:7: (XEN) [2013-08-23 15:23:17] 0000:0a:01:0: (XEN) [2013-08-23 15:23:17] 0000:0a:01:1: (XEN) [2013-08-23 15:23:17] 0000:0a:01:2: (XEN) [2013-08-23 15:23:17] 0000:0a:01:3: (XEN) [2013-08-23 15:23:17] 0000:0a:01:4: (XEN) [2013-08-23 15:23:17] 0000:0a:01:5: (XEN) [2013-08-23 15:23:17] 0000:0a:01:6: (XEN) [2013-08-23 15:23:17] 0000:0a:01:7: (XEN) [2013-08-23 15:23:17] 0000:0a:02:0: (XEN) [2013-08-23 15:23:17] 0000:0a:02:1: (XEN) [2013-08-23 15:23:17] 0000:0a:02:2: (XEN) [2013-08-23 15:23:17] 0000:0a:02:3: (XEN) [2013-08-23 15:23:17] 0000:0a:02:4: (XEN) [2013-08-23 15:23:17] 0000:0a:02:5: (XEN) [2013-08-23 15:23:17] 0000:0a:02:6: (XEN) [2013-08-23 15:23:17] 0000:0a:02:7: (XEN) [2013-08-23 15:23:17] 0000:0a:03:0: (XEN) [2013-08-23 15:23:17] 0000:0a:03:1: (XEN) [2013-08-23 15:23:17] 0000:0a:03:2: (XEN) [2013-08-23 15:23:17] 0000:0a:03:3: (XEN) [2013-08-23 15:23:17] 0000:0a:03:4: (XEN) [2013-08-23 15:23:17] 0000:0a:03:5: (XEN) [2013-08-23 15:23:17] 0000:0a:03:6: (XEN) [2013-08-23 15:23:17] 0000:0a:03:7: (XEN) [2013-08-23 15:23:17] 0000:0a:04:0: (XEN) [2013-08-23 15:23:17] 0000:0a:04:1: (XEN) [2013-08-23 15:23:17] 0000:0a:04:2: (XEN) [2013-08-23 15:23:17] 0000:0a:04:3: (XEN) [2013-08-23 15:23:17] 0000:0a:04:4: (XEN) [2013-08-23 15:23:17] 0000:0a:04:5: (XEN) [2013-08-23 15:23:17] 0000:0a:04:6: (XEN) [2013-08-23 15:23:17] 0000:0a:04:7: (XEN) [2013-08-23 15:23:17] 0000:0a:05:0: (XEN) [2013-08-23 15:23:17] 0000:0a:05:1: (XEN) [2013-08-23 15:23:17] 0000:0a:05:2: (XEN) [2013-08-23 15:23:17] 0000:0a:05:3: (XEN) [2013-08-23 15:23:17] 0000:0a:05:4: (XEN) [2013-08-23 15:23:17] 0000:0a:05:5: (XEN) [2013-08-23 15:23:17] 0000:0a:05:6: (XEN) [2013-08-23 15:23:17] 0000:0a:05:7: (XEN) [2013-08-23 15:23:17] 0000:0a:06:0: (XEN) [2013-08-23 15:23:17] 0000:0a:06:1: (XEN) [2013-08-23 15:23:17] 0000:0a:06:2: (XEN) [2013-08-23 15:23:17] 0000:0a:06:3: (XEN) [2013-08-23 15:23:17] 0000:0a:06:4: (XEN) [2013-08-23 15:23:17] 0000:0a:06:5: (XEN) [2013-08-23 15:23:17] 0000:0a:06:6: (XEN) [2013-08-23 15:23:17] 0000:0a:06:7: (XEN) [2013-08-23 15:23:17] 0000:0a:07:0: (XEN) [2013-08-23 15:23:17] 0000:0a:07:1: (XEN) [2013-08-23 15:23:17] 0000:0a:07:2: (XEN) [2013-08-23 15:23:17] 0000:0a:07:3: (XEN) [2013-08-23 15:23:17] 0000:0a:07:4: (XEN) [2013-08-23 15:23:17] 0000:0a:07:5: (XEN) [2013-08-23 15:23:17] 0000:0a:07:6: (XEN) [2013-08-23 15:23:17] 0000:0a:07:7: (XEN) [2013-08-23 15:23:17] 0000:0a:08:0: (XEN) [2013-08-23 15:23:17] 0000:0a:08:1: (XEN) [2013-08-23 15:23:17] 0000:0a:08:2: (XEN) [2013-08-23 15:23:17] 0000:0a:08:3: (XEN) [2013-08-23 15:23:17] 0000:0a:08:4: (XEN) [2013-08-23 15:23:17] 0000:0a:08:5: (XEN) [2013-08-23 15:23:17] 0000:0a:08:6: (XEN) [2013-08-23 15:23:17] 0000:0a:08:7: (XEN) [2013-08-23 15:23:17] 0000:0a:09:0: (XEN) [2013-08-23 15:23:17] 0000:0a:09:1: (XEN) [2013-08-23 15:23:17] 0000:0a:09:2: (XEN) [2013-08-23 15:23:17] 0000:0a:09:3: (XEN) [2013-08-23 15:23:17] 0000:0a:09:4: (XEN) [2013-08-23 15:23:17] 0000:0a:09:5: (XEN) [2013-08-23 15:23:17] 0000:0a:09:6: (XEN) [2013-08-23 15:23:17] 0000:0a:09:7: (XEN) [2013-08-23 15:23:17] 0000:0a:0a:0: (XEN) [2013-08-23 15:23:17] 0000:0a:0a:1: (XEN) [2013-08-23 15:23:17] 0000:0a:0a:2: (XEN) [2013-08-23 15:23:17] 0000:0a:0a:3: (XEN) [2013-08-23 15:23:17] 0000:0a:0a:4: (XEN) [2013-08-23 15:23:17] 0000:0a:0a:5: (XEN) [2013-08-23 15:23:17] 0000:0a:0a:6: (XEN) [2013-08-23 15:23:17] 0000:0a:0a:7: (XEN) [2013-08-23 15:23:17] 0000:0a:0b:0: (XEN) [2013-08-23 15:23:17] 0000:0a:0b:1: (XEN) [2013-08-23 15:23:17] 0000:0a:0b:2: (XEN) [2013-08-23 15:23:17] 0000:0a:0b:3: (XEN) [2013-08-23 15:23:17] 0000:0a:0b:4: (XEN) [2013-08-23 15:23:17] 0000:0a:0b:5: (XEN) [2013-08-23 15:23:18] 0000:0a:0b:6: (XEN) [2013-08-23 15:23:18] 0000:0a:0b:7: (XEN) [2013-08-23 15:23:18] 0000:0a:0c:0: (XEN) [2013-08-23 15:23:18] 0000:0a:0c:1: (XEN) [2013-08-23 15:23:18] 0000:0a:0c:2: (XEN) [2013-08-23 15:23:18] 0000:0a:0c:3: (XEN) [2013-08-23 15:23:18] 0000:0a:0c:4: (XEN) [2013-08-23 15:23:18] 0000:0a:0c:5: (XEN) [2013-08-23 15:23:18] 0000:0a:0c:6: (XEN) [2013-08-23 15:23:18] 0000:0a:0c:7: (XEN) [2013-08-23 15:23:18] 0000:0a:0d:0: (XEN) [2013-08-23 15:23:18] 0000:0a:0d:1: (XEN) [2013-08-23 15:23:18] 0000:0a:0d:2: (XEN) [2013-08-23 15:23:18] 0000:0a:0d:3: (XEN) [2013-08-23 15:23:18] 0000:0a:0d:4: (XEN) [2013-08-23 15:23:18] 0000:0a:0d:5: (XEN) [2013-08-23 15:23:18] 0000:0a:0d:6: (XEN) [2013-08-23 15:23:18] 0000:0a:0d:7: (XEN) [2013-08-23 15:23:18] 0000:0a:0e:0: (XEN) [2013-08-23 15:23:18] 0000:0a:0e:1: (XEN) [2013-08-23 15:23:18] 0000:0a:0e:2: (XEN) [2013-08-23 15:23:18] 0000:0a:0e:3: (XEN) [2013-08-23 15:23:18] 0000:0a:0e:4: (XEN) [2013-08-23 15:23:18] 0000:0a:0e:5: (XEN) [2013-08-23 15:23:18] 0000:0a:0e:6: (XEN) [2013-08-23 15:23:18] 0000:0a:0e:7: (XEN) [2013-08-23 15:23:18] 0000:0a:0f:0: (XEN) [2013-08-23 15:23:18] 0000:0a:0f:1: (XEN) [2013-08-23 15:23:18] 0000:0a:0f:2: (XEN) [2013-08-23 15:23:18] 0000:0a:0f:3: (XEN) [2013-08-23 15:23:18] 0000:0a:0f:4: (XEN) [2013-08-23 15:23:18] 0000:0a:0f:5: (XEN) [2013-08-23 15:23:18] 0000:0a:0f:6: (XEN) [2013-08-23 15:23:18] 0000:0a:0f:7: (XEN) [2013-08-23 15:23:18] 0000:0a:10:0: (XEN) [2013-08-23 15:23:18] 0000:0a:10:1: (XEN) [2013-08-23 15:23:18] 0000:0a:10:2: (XEN) [2013-08-23 15:23:18] 0000:0a:10:3: (XEN) [2013-08-23 15:23:18] 0000:0a:10:4: (XEN) [2013-08-23 15:23:18] 0000:0a:10:5: (XEN) [2013-08-23 15:23:18] 0000:0a:10:6: (XEN) [2013-08-23 15:23:18] 0000:0a:10:7: (XEN) [2013-08-23 15:23:18] 0000:0a:11:0: (XEN) [2013-08-23 15:23:18] 0000:0a:11:1: (XEN) [2013-08-23 15:23:18] 0000:0a:11:2: (XEN) [2013-08-23 15:23:18] 0000:0a:11:3: (XEN) [2013-08-23 15:23:18] 0000:0a:11:4: (XEN) [2013-08-23 15:23:18] 0000:0a:11:5: (XEN) [2013-08-23 15:23:18] 0000:0a:11:6: (XEN) [2013-08-23 15:23:18] 0000:0a:11:7: (XEN) [2013-08-23 15:23:18] 0000:0a:12:0: (XEN) [2013-08-23 15:23:18] 0000:0a:12:1: (XEN) [2013-08-23 15:23:18] 0000:0a:12:2: (XEN) [2013-08-23 15:23:18] 0000:0a:12:3: (XEN) [2013-08-23 15:23:18] 0000:0a:12:4: (XEN) [2013-08-23 15:23:18] 0000:0a:12:5: (XEN) [2013-08-23 15:23:18] 0000:0a:12:6: (XEN) [2013-08-23 15:23:18] 0000:0a:12:7: (XEN) [2013-08-23 15:23:18] 0000:0a:13:0: (XEN) [2013-08-23 15:23:18] 0000:0a:13:1: (XEN) [2013-08-23 15:23:18] 0000:0a:13:2: (XEN) [2013-08-23 15:23:18] 0000:0a:13:3: (XEN) [2013-08-23 15:23:18] 0000:0a:13:4: (XEN) [2013-08-23 15:23:18] 0000:0a:13:5: (XEN) [2013-08-23 15:23:18] 0000:0a:13:6: (XEN) [2013-08-23 15:23:18] 0000:0a:13:7: (XEN) [2013-08-23 15:23:18] 0000:0a:14:0: (XEN) [2013-08-23 15:23:18] 0000:0a:14:1: (XEN) [2013-08-23 15:23:18] 0000:0a:14:2: (XEN) [2013-08-23 15:23:18] 0000:0a:14:3: (XEN) [2013-08-23 15:23:18] 0000:0a:14:4: (XEN) [2013-08-23 15:23:18] 0000:0a:14:5: (XEN) [2013-08-23 15:23:18] 0000:0a:14:6: (XEN) [2013-08-23 15:23:18] 0000:0a:14:7: (XEN) [2013-08-23 15:23:18] 0000:0a:15:0: (XEN) [2013-08-23 15:23:18] 0000:0a:15:1: (XEN) [2013-08-23 15:23:18] 0000:0a:15:2: (XEN) [2013-08-23 15:23:18] 0000:0a:15:3: (XEN) [2013-08-23 15:23:18] 0000:0a:15:4: (XEN) [2013-08-23 15:23:18] 0000:0a:15:5: (XEN) [2013-08-23 15:23:18] 0000:0a:15:6: (XEN) [2013-08-23 15:23:18] 0000:0a:15:7: (XEN) [2013-08-23 15:23:18] 0000:0a:16:0: (XEN) [2013-08-23 15:23:18] 0000:0a:16:1: (XEN) [2013-08-23 15:23:18] 0000:0a:16:2: (XEN) [2013-08-23 15:23:19] 0000:0a:16:3: (XEN) [2013-08-23 15:23:19] 0000:0a:16:4: (XEN) [2013-08-23 15:23:19] 0000:0a:16:5: (XEN) [2013-08-23 15:23:19] 0000:0a:16:6: (XEN) [2013-08-23 15:23:19] 0000:0a:16:7: (XEN) [2013-08-23 15:23:19] 0000:0a:17:0: (XEN) [2013-08-23 15:23:19] 0000:0a:17:1: (XEN) [2013-08-23 15:23:19] 0000:0a:17:2: (XEN) [2013-08-23 15:23:19] 0000:0a:17:3: (XEN) [2013-08-23 15:23:19] 0000:0a:17:4: (XEN) [2013-08-23 15:23:19] 0000:0a:17:5: (XEN) [2013-08-23 15:23:19] 0000:0a:17:6: (XEN) [2013-08-23 15:23:19] 0000:0a:17:7: (XEN) [2013-08-23 15:23:19] 0000:0a:18:0: (XEN) [2013-08-23 15:23:19] 0000:0a:18:1: (XEN) [2013-08-23 15:23:19] 0000:0a:18:2: (XEN) [2013-08-23 15:23:19] 0000:0a:18:3: (XEN) [2013-08-23 15:23:19] 0000:0a:18:4: (XEN) [2013-08-23 15:23:19] 0000:0a:18:5: (XEN) [2013-08-23 15:23:19] 0000:0a:18:6: (XEN) [2013-08-23 15:23:19] 0000:0a:18:7: (XEN) [2013-08-23 15:23:19] 0000:0a:19:0: (XEN) [2013-08-23 15:23:19] 0000:0a:19:1: (XEN) [2013-08-23 15:23:19] 0000:0a:19:2: (XEN) [2013-08-23 15:23:19] 0000:0a:19:3: (XEN) [2013-08-23 15:23:19] 0000:0a:19:4: (XEN) [2013-08-23 15:23:19] 0000:0a:19:5: (XEN) [2013-08-23 15:23:19] 0000:0a:19:6: (XEN) [2013-08-23 15:23:19] 0000:0a:19:7: (XEN) [2013-08-23 15:23:19] 0000:0a:1a:0: (XEN) [2013-08-23 15:23:19] 0000:0a:1a:1: (XEN) [2013-08-23 15:23:19] 0000:0a:1a:2: (XEN) [2013-08-23 15:23:19] 0000:0a:1a:3: (XEN) [2013-08-23 15:23:19] 0000:0a:1a:4: (XEN) [2013-08-23 15:23:19] 0000:0a:1a:5: (XEN) [2013-08-23 15:23:19] 0000:0a:1a:6: (XEN) [2013-08-23 15:23:19] 0000:0a:1a:7: (XEN) [2013-08-23 15:23:19] 0000:0a:1b:0: (XEN) [2013-08-23 15:23:19] 0000:0a:1b:1: (XEN) [2013-08-23 15:23:19] 0000:0a:1b:2: (XEN) [2013-08-23 15:23:19] 0000:0a:1b:3: (XEN) [2013-08-23 15:23:19] 0000:0a:1b:4: (XEN) [2013-08-23 15:23:19] 0000:0a:1b:5: (XEN) [2013-08-23 15:23:19] 0000:0a:1b:6: (XEN) [2013-08-23 15:23:19] 0000:0a:1b:7: (XEN) [2013-08-23 15:23:19] 0000:0a:1c:0: (XEN) [2013-08-23 15:23:19] 0000:0a:1c:1: (XEN) [2013-08-23 15:23:19] 0000:0a:1c:2: (XEN) [2013-08-23 15:23:19] 0000:0a:1c:3: (XEN) [2013-08-23 15:23:19] 0000:0a:1c:4: (XEN) [2013-08-23 15:23:19] 0000:0a:1c:5: (XEN) [2013-08-23 15:23:19] 0000:0a:1c:6: (XEN) [2013-08-23 15:23:19] 0000:0a:1c:7: (XEN) [2013-08-23 15:23:19] 0000:0a:1d:0: (XEN) [2013-08-23 15:23:19] 0000:0a:1d:1: (XEN) [2013-08-23 15:23:19] 0000:0a:1d:2: (XEN) [2013-08-23 15:23:19] 0000:0a:1d:3: (XEN) [2013-08-23 15:23:19] 0000:0a:1d:4: (XEN) [2013-08-23 15:23:19] 0000:0a:1d:5: (XEN) [2013-08-23 15:23:19] 0000:0a:1d:6: (XEN) [2013-08-23 15:23:19] 0000:0a:1d:7: (XEN) [2013-08-23 15:23:19] 0000:0a:1e:0: (XEN) [2013-08-23 15:23:19] 0000:0a:1e:1: (XEN) [2013-08-23 15:23:19] 0000:0a:1e:2: (XEN) [2013-08-23 15:23:19] 0000:0a:1e:3: (XEN) [2013-08-23 15:23:19] 0000:0a:1e:4: (XEN) [2013-08-23 15:23:19] 0000:0a:1e:5: (XEN) [2013-08-23 15:23:19] 0000:0a:1e:6: (XEN) [2013-08-23 15:23:19] 0000:0a:1e:7: (XEN) [2013-08-23 15:23:19] 0000:0a:1f:0: (XEN) [2013-08-23 15:23:19] 0000:0a:1f:1: (XEN) [2013-08-23 15:23:19] 0000:0a:1f:2: (XEN) [2013-08-23 15:23:19] 0000:0a:1f:3: (XEN) [2013-08-23 15:23:19] 0000:0a:1f:4: (XEN) [2013-08-23 15:23:19] 0000:0a:1f:5: (XEN) [2013-08-23 15:23:19] 0000:0a:1f:6: (XEN) [2013-08-23 15:23:19] 0000:0a:1f:7: (XEN) [2013-08-23 15:23:19] 0000:0b:00:0: (XEN) [2013-08-23 15:23:19] IRTE[000] 002a0145 (XEN) [2013-08-23 15:23:19] 0000:0b:00:1: (XEN) [2013-08-23 15:23:19] 0000:0b:00:2: (XEN) [2013-08-23 15:23:19] 0000:0b:00:3: (XEN) [2013-08-23 15:23:19] 0000:0b:00:4: (XEN) [2013-08-23 15:23:19] 0000:0b:00:5: (XEN) [2013-08-23 15:23:19] 0000:0b:00:6: (XEN) [2013-08-23 15:23:19] 0000:0b:00:7: (XEN) [2013-08-23 15:23:20] 0000:0b:01:0: (XEN) [2013-08-23 15:23:20] 0000:0b:01:1: (XEN) [2013-08-23 15:23:20] 0000:0b:01:2: (XEN) [2013-08-23 15:23:20] 0000:0b:01:3: (XEN) [2013-08-23 15:23:20] 0000:0b:01:4: (XEN) [2013-08-23 15:23:20] 0000:0b:01:5: (XEN) [2013-08-23 15:23:20] 0000:0b:01:6: (XEN) [2013-08-23 15:23:20] 0000:0b:01:7: (XEN) [2013-08-23 15:23:20] 0000:0b:02:0: (XEN) [2013-08-23 15:23:20] 0000:0b:02:1: (XEN) [2013-08-23 15:23:20] 0000:0b:02:2: (XEN) [2013-08-23 15:23:20] 0000:0b:02:3: (XEN) [2013-08-23 15:23:20] 0000:0b:02:4: (XEN) [2013-08-23 15:23:20] 0000:0b:02:5: (XEN) [2013-08-23 15:23:20] 0000:0b:02:6: (XEN) [2013-08-23 15:23:20] 0000:0b:02:7: (XEN) [2013-08-23 15:23:20] 0000:0b:03:0: (XEN) [2013-08-23 15:23:20] 0000:0b:03:1: (XEN) [2013-08-23 15:23:20] 0000:0b:03:2: (XEN) [2013-08-23 15:23:20] 0000:0b:03:3: (XEN) [2013-08-23 15:23:20] 0000:0b:03:4: (XEN) [2013-08-23 15:23:20] 0000:0b:03:5: (XEN) [2013-08-23 15:23:20] 0000:0b:03:6: (XEN) [2013-08-23 15:23:20] 0000:0b:03:7: (XEN) [2013-08-23 15:23:20] 0000:0b:04:0: (XEN) [2013-08-23 15:23:20] 0000:0b:04:1: (XEN) [2013-08-23 15:23:20] 0000:0b:04:2: (XEN) [2013-08-23 15:23:20] 0000:0b:04:3: (XEN) [2013-08-23 15:23:20] 0000:0b:04:4: (XEN) [2013-08-23 15:23:20] 0000:0b:04:5: (XEN) [2013-08-23 15:23:20] 0000:0b:04:6: (XEN) [2013-08-23 15:23:20] 0000:0b:04:7: (XEN) [2013-08-23 15:23:20] 0000:0b:05:0: (XEN) [2013-08-23 15:23:20] 0000:0b:05:1: (XEN) [2013-08-23 15:23:20] 0000:0b:05:2: (XEN) [2013-08-23 15:23:20] 0000:0b:05:3: (XEN) [2013-08-23 15:23:20] 0000:0b:05:4: (XEN) [2013-08-23 15:23:20] 0000:0b:05:5: (XEN) [2013-08-23 15:23:20] 0000:0b:05:6: (XEN) [2013-08-23 15:23:20] 0000:0b:05:7: (XEN) [2013-08-23 15:23:20] 0000:0b:06:0: (XEN) [2013-08-23 15:23:20] 0000:0b:06:1: (XEN) [2013-08-23 15:23:20] 0000:0b:06:2: (XEN) [2013-08-23 15:23:20] 0000:0b:06:3: (XEN) [2013-08-23 15:23:20] 0000:0b:06:4: (XEN) [2013-08-23 15:23:20] 0000:0b:06:5: (XEN) [2013-08-23 15:23:20] 0000:0b:06:6: (XEN) [2013-08-23 15:23:20] 0000:0b:06:7: (XEN) [2013-08-23 15:23:20] 0000:0b:07:0: (XEN) [2013-08-23 15:23:20] 0000:0b:07:1: (XEN) [2013-08-23 15:23:20] 0000:0b:07:2: (XEN) [2013-08-23 15:23:20] 0000:0b:07:3: (XEN) [2013-08-23 15:23:20] 0000:0b:07:4: (XEN) [2013-08-23 15:23:20] 0000:0b:07:5: (XEN) [2013-08-23 15:23:20] 0000:0b:07:6: (XEN) [2013-08-23 15:23:20] 0000:0b:07:7: (XEN) [2013-08-23 15:23:20] 0000:0b:08:0: (XEN) [2013-08-23 15:23:20] 0000:0b:08:1: (XEN) [2013-08-23 15:23:20] 0000:0b:08:2: (XEN) [2013-08-23 15:23:20] 0000:0b:08:3: (XEN) [2013-08-23 15:23:20] 0000:0b:08:4: (XEN) [2013-08-23 15:23:20] 0000:0b:08:5: (XEN) [2013-08-23 15:23:20] 0000:0b:08:6: (XEN) [2013-08-23 15:23:20] 0000:0b:08:7: (XEN) [2013-08-23 15:23:20] 0000:0b:09:0: (XEN) [2013-08-23 15:23:20] 0000:0b:09:1: (XEN) [2013-08-23 15:23:20] 0000:0b:09:2: (XEN) [2013-08-23 15:23:20] 0000:0b:09:3: (XEN) [2013-08-23 15:23:20] 0000:0b:09:4: (XEN) [2013-08-23 15:23:20] 0000:0b:09:5: (XEN) [2013-08-23 15:23:20] 0000:0b:09:6: (XEN) [2013-08-23 15:23:20] 0000:0b:09:7: (XEN) [2013-08-23 15:23:20] 0000:0b:0a:0: (XEN) [2013-08-23 15:23:20] 0000:0b:0a:1: (XEN) [2013-08-23 15:23:20] 0000:0b:0a:2: (XEN) [2013-08-23 15:23:20] 0000:0b:0a:3: (XEN) [2013-08-23 15:23:20] 0000:0b:0a:4: (XEN) [2013-08-23 15:23:20] 0000:0b:0a:5: (XEN) [2013-08-23 15:23:20] 0000:0b:0a:6: (XEN) [2013-08-23 15:23:20] 0000:0b:0a:7: (XEN) [2013-08-23 15:23:20] 0000:0b:0b:0: (XEN) [2013-08-23 15:23:20] 0000:0b:0b:1: (XEN) [2013-08-23 15:23:20] 0000:0b:0b:2: (XEN) [2013-08-23 15:23:20] 0000:0b:0b:3: (XEN) [2013-08-23 15:23:20] 0000:0b:0b:4: (XEN) [2013-08-23 15:23:21] 0000:0b:0b:5: (XEN) [2013-08-23 15:23:21] 0000:0b:0b:6: (XEN) [2013-08-23 15:23:21] 0000:0b:0b:7: (XEN) [2013-08-23 15:23:21] 0000:0b:0c:0: (XEN) [2013-08-23 15:23:21] 0000:0b:0c:1: (XEN) [2013-08-23 15:23:21] 0000:0b:0c:2: (XEN) [2013-08-23 15:23:21] 0000:0b:0c:3: (XEN) [2013-08-23 15:23:21] 0000:0b:0c:4: (XEN) [2013-08-23 15:23:21] 0000:0b:0c:5: (XEN) [2013-08-23 15:23:21] 0000:0b:0c:6: (XEN) [2013-08-23 15:23:21] 0000:0b:0c:7: (XEN) [2013-08-23 15:23:21] 0000:0b:0d:0: (XEN) [2013-08-23 15:23:21] 0000:0b:0d:1: (XEN) [2013-08-23 15:23:21] 0000:0b:0d:2: (XEN) [2013-08-23 15:23:21] 0000:0b:0d:3: (XEN) [2013-08-23 15:23:21] 0000:0b:0d:4: (XEN) [2013-08-23 15:23:21] 0000:0b:0d:5: (XEN) [2013-08-23 15:23:21] 0000:0b:0d:6: (XEN) [2013-08-23 15:23:21] 0000:0b:0d:7: (XEN) [2013-08-23 15:23:21] 0000:0b:0e:0: (XEN) [2013-08-23 15:23:21] 0000:0b:0e:1: (XEN) [2013-08-23 15:23:21] 0000:0b:0e:2: (XEN) [2013-08-23 15:23:21] 0000:0b:0e:3: (XEN) [2013-08-23 15:23:21] 0000:0b:0e:4: (XEN) [2013-08-23 15:23:21] 0000:0b:0e:5: (XEN) [2013-08-23 15:23:21] 0000:0b:0e:6: (XEN) [2013-08-23 15:23:21] 0000:0b:0e:7: (XEN) [2013-08-23 15:23:21] 0000:0b:0f:0: (XEN) [2013-08-23 15:23:21] 0000:0b:0f:1: (XEN) [2013-08-23 15:23:21] 0000:0b:0f:2: (XEN) [2013-08-23 15:23:21] 0000:0b:0f:3: (XEN) [2013-08-23 15:23:21] 0000:0b:0f:4: (XEN) [2013-08-23 15:23:21] 0000:0b:0f:5: (XEN) [2013-08-23 15:23:21] 0000:0b:0f:6: (XEN) [2013-08-23 15:23:21] 0000:0b:0f:7: (XEN) [2013-08-23 15:23:21] 0000:0b:10:0: (XEN) [2013-08-23 15:23:21] 0000:0b:10:1: (XEN) [2013-08-23 15:23:21] 0000:0b:10:2: (XEN) [2013-08-23 15:23:21] 0000:0b:10:3: (XEN) [2013-08-23 15:23:21] 0000:0b:10:4: (XEN) [2013-08-23 15:23:21] 0000:0b:10:5: (XEN) [2013-08-23 15:23:21] 0000:0b:10:6: (XEN) [2013-08-23 15:23:21] 0000:0b:10:7: (XEN) [2013-08-23 15:23:21] 0000:0b:11:0: (XEN) [2013-08-23 15:23:21] 0000:0b:11:1: (XEN) [2013-08-23 15:23:21] 0000:0b:11:2: (XEN) [2013-08-23 15:23:21] 0000:0b:11:3: (XEN) [2013-08-23 15:23:21] 0000:0b:11:4: (XEN) [2013-08-23 15:23:21] 0000:0b:11:5: (XEN) [2013-08-23 15:23:21] 0000:0b:11:6: (XEN) [2013-08-23 15:23:21] 0000:0b:11:7: (XEN) [2013-08-23 15:23:21] 0000:0b:12:0: (XEN) [2013-08-23 15:23:21] 0000:0b:12:1: (XEN) [2013-08-23 15:23:21] 0000:0b:12:2: (XEN) [2013-08-23 15:23:21] 0000:0b:12:3: (XEN) [2013-08-23 15:23:21] 0000:0b:12:4: (XEN) [2013-08-23 15:23:21] 0000:0b:12:5: (XEN) [2013-08-23 15:23:21] 0000:0b:12:6: (XEN) [2013-08-23 15:23:21] 0000:0b:12:7: (XEN) [2013-08-23 15:23:21] 0000:0b:13:0: (XEN) [2013-08-23 15:23:21] 0000:0b:13:1: (XEN) [2013-08-23 15:23:21] 0000:0b:13:2: (XEN) [2013-08-23 15:23:21] 0000:0b:13:3: (XEN) [2013-08-23 15:23:21] 0000:0b:13:4: (XEN) [2013-08-23 15:23:21] 0000:0b:13:5: (XEN) [2013-08-23 15:23:21] 0000:0b:13:6: (XEN) [2013-08-23 15:23:21] 0000:0b:13:7: (XEN) [2013-08-23 15:23:21] 0000:0b:14:0: (XEN) [2013-08-23 15:23:21] 0000:0b:14:1: (XEN) [2013-08-23 15:23:21] 0000:0b:14:2: (XEN) [2013-08-23 15:23:21] 0000:0b:14:3: (XEN) [2013-08-23 15:23:21] 0000:0b:14:4: (XEN) [2013-08-23 15:23:21] 0000:0b:14:5: (XEN) [2013-08-23 15:23:21] 0000:0b:14:6: (XEN) [2013-08-23 15:23:21] 0000:0b:14:7: (XEN) [2013-08-23 15:23:21] 0000:0b:15:0: (XEN) [2013-08-23 15:23:21] 0000:0b:15:1: (XEN) [2013-08-23 15:23:21] 0000:0b:15:2: (XEN) [2013-08-23 15:23:21] 0000:0b:15:3: (XEN) [2013-08-23 15:23:21] 0000:0b:15:4: (XEN) [2013-08-23 15:23:21] 0000:0b:15:5: (XEN) [2013-08-23 15:23:21] 0000:0b:15:6: (XEN) [2013-08-23 15:23:21] 0000:0b:15:7: (XEN) [2013-08-23 15:23:21] 0000:0b:16:0: (XEN) [2013-08-23 15:23:21] 0000:0b:16:1: (XEN) [2013-08-23 15:23:21] 0000:0b:16:2: (XEN) [2013-08-23 15:23:22] 0000:0b:16:3: (XEN) [2013-08-23 15:23:22] 0000:0b:16:4: (XEN) [2013-08-23 15:23:22] 0000:0b:16:5: (XEN) [2013-08-23 15:23:22] 0000:0b:16:6: (XEN) [2013-08-23 15:23:22] 0000:0b:16:7: (XEN) [2013-08-23 15:23:22] 0000:0b:17:0: (XEN) [2013-08-23 15:23:22] 0000:0b:17:1: (XEN) [2013-08-23 15:23:22] 0000:0b:17:2: (XEN) [2013-08-23 15:23:22] 0000:0b:17:3: (XEN) [2013-08-23 15:23:22] 0000:0b:17:4: (XEN) [2013-08-23 15:23:22] 0000:0b:17:5: (XEN) [2013-08-23 15:23:22] 0000:0b:17:6: (XEN) [2013-08-23 15:23:22] 0000:0b:17:7: (XEN) [2013-08-23 15:23:22] 0000:0b:18:0: (XEN) [2013-08-23 15:23:22] 0000:0b:18:1: (XEN) [2013-08-23 15:23:22] 0000:0b:18:2: (XEN) [2013-08-23 15:23:22] 0000:0b:18:3: (XEN) [2013-08-23 15:23:22] 0000:0b:18:4: (XEN) [2013-08-23 15:23:22] 0000:0b:18:5: (XEN) [2013-08-23 15:23:22] 0000:0b:18:6: (XEN) [2013-08-23 15:23:22] 0000:0b:18:7: (XEN) [2013-08-23 15:23:22] 0000:0b:19:0: (XEN) [2013-08-23 15:23:22] 0000:0b:19:1: (XEN) [2013-08-23 15:23:22] 0000:0b:19:2: (XEN) [2013-08-23 15:23:22] 0000:0b:19:3: (XEN) [2013-08-23 15:23:22] 0000:0b:19:4: (XEN) [2013-08-23 15:23:22] 0000:0b:19:5: (XEN) [2013-08-23 15:23:22] 0000:0b:19:6: (XEN) [2013-08-23 15:23:22] 0000:0b:19:7: (XEN) [2013-08-23 15:23:22] 0000:0b:1a:0: (XEN) [2013-08-23 15:23:22] 0000:0b:1a:1: (XEN) [2013-08-23 15:23:22] 0000:0b:1a:2: (XEN) [2013-08-23 15:23:22] 0000:0b:1a:3: (XEN) [2013-08-23 15:23:22] 0000:0b:1a:4: (XEN) [2013-08-23 15:23:22] 0000:0b:1a:5: (XEN) [2013-08-23 15:23:22] 0000:0b:1a:6: (XEN) [2013-08-23 15:23:22] 0000:0b:1a:7: (XEN) [2013-08-23 15:23:22] 0000:0b:1b:0: (XEN) [2013-08-23 15:23:22] 0000:0b:1b:1: (XEN) [2013-08-23 15:23:22] 0000:0b:1b:2: (XEN) [2013-08-23 15:23:22] 0000:0b:1b:3: (XEN) [2013-08-23 15:23:22] 0000:0b:1b:4: (XEN) [2013-08-23 15:23:22] 0000:0b:1b:5: (XEN) [2013-08-23 15:23:22] 0000:0b:1b:6: (XEN) [2013-08-23 15:23:22] 0000:0b:1b:7: (XEN) [2013-08-23 15:23:22] 0000:0b:1c:0: (XEN) [2013-08-23 15:23:22] 0000:0b:1c:1: (XEN) [2013-08-23 15:23:22] 0000:0b:1c:2: (XEN) [2013-08-23 15:23:22] 0000:0b:1c:3: (XEN) [2013-08-23 15:23:22] 0000:0b:1c:4: (XEN) [2013-08-23 15:23:22] 0000:0b:1c:5: (XEN) [2013-08-23 15:23:22] 0000:0b:1c:6: (XEN) [2013-08-23 15:23:22] 0000:0b:1c:7: (XEN) [2013-08-23 15:23:22] 0000:0b:1d:0: (XEN) [2013-08-23 15:23:22] 0000:0b:1d:1: (XEN) [2013-08-23 15:23:22] 0000:0b:1d:2: (XEN) [2013-08-23 15:23:22] 0000:0b:1d:3: (XEN) [2013-08-23 15:23:22] 0000:0b:1d:4: (XEN) [2013-08-23 15:23:22] 0000:0b:1d:5: (XEN) [2013-08-23 15:23:22] 0000:0b:1d:6: (XEN) [2013-08-23 15:23:22] 0000:0b:1d:7: (XEN) [2013-08-23 15:23:22] 0000:0b:1e:0: (XEN) [2013-08-23 15:23:22] 0000:0b:1e:1: (XEN) [2013-08-23 15:23:22] 0000:0b:1e:2: (XEN) [2013-08-23 15:23:22] 0000:0b:1e:3: (XEN) [2013-08-23 15:23:22] 0000:0b:1e:4: (XEN) [2013-08-23 15:23:22] 0000:0b:1e:5: (XEN) [2013-08-23 15:23:22] 0000:0b:1e:6: (XEN) [2013-08-23 15:23:22] 0000:0b:1e:7: (XEN) [2013-08-23 15:23:22] 0000:0b:1f:0: (XEN) [2013-08-23 15:23:22] 0000:0b:1f:1: (XEN) [2013-08-23 15:23:22] 0000:0b:1f:2: (XEN) [2013-08-23 15:23:22] 0000:0b:1f:3: (XEN) [2013-08-23 15:23:22] 0000:0b:1f:4: (XEN) [2013-08-23 15:23:22] 0000:0b:1f:5: (XEN) [2013-08-23 15:23:22] 0000:0b:1f:6: (XEN) [2013-08-23 15:23:22] 0000:0b:1f:7: (XEN) [2013-08-23 15:23:22] 0000:0c:00:0: (XEN) [2013-08-23 15:23:22] 0000:0c:00:1: (XEN) [2013-08-23 15:23:22] 0000:0c:00:2: (XEN) [2013-08-23 15:23:22] 0000:0c:00:3: (XEN) [2013-08-23 15:23:22] 0000:0c:00:4: (XEN) [2013-08-23 15:23:22] 0000:0c:00:5: (XEN) [2013-08-23 15:23:22] 0000:0c:00:6: (XEN) [2013-08-23 15:23:22] 0000:0c:00:7: (XEN) [2013-08-23 15:23:23] 0000:0c:01:0: (XEN) [2013-08-23 15:23:23] 0000:0c:01:1: (XEN) [2013-08-23 15:23:23] 0000:0c:01:2: (XEN) [2013-08-23 15:23:23] 0000:0c:01:3: (XEN) [2013-08-23 15:23:23] 0000:0c:01:4: (XEN) [2013-08-23 15:23:23] 0000:0c:01:5: (XEN) [2013-08-23 15:23:23] 0000:0c:01:6: (XEN) [2013-08-23 15:23:23] 0000:0c:01:7: (XEN) [2013-08-23 15:23:23] 0000:0c:02:0: (XEN) [2013-08-23 15:23:23] 0000:0c:02:1: (XEN) [2013-08-23 15:23:23] 0000:0c:02:2: (XEN) [2013-08-23 15:23:23] 0000:0c:02:3: (XEN) [2013-08-23 15:23:23] 0000:0c:02:4: (XEN) [2013-08-23 15:23:23] 0000:0c:02:5: (XEN) [2013-08-23 15:23:23] 0000:0c:02:6: (XEN) [2013-08-23 15:23:23] 0000:0c:02:7: (XEN) [2013-08-23 15:23:23] 0000:0c:03:0: (XEN) [2013-08-23 15:23:23] 0000:0c:03:1: (XEN) [2013-08-23 15:23:23] 0000:0c:03:2: (XEN) [2013-08-23 15:23:23] 0000:0c:03:3: (XEN) [2013-08-23 15:23:23] 0000:0c:03:4: (XEN) [2013-08-23 15:23:23] 0000:0c:03:5: (XEN) [2013-08-23 15:23:23] 0000:0c:03:6: (XEN) [2013-08-23 15:23:23] 0000:0c:03:7: (XEN) [2013-08-23 15:23:23] 0000:0c:04:0: (XEN) [2013-08-23 15:23:23] 0000:0c:04:1: (XEN) [2013-08-23 15:23:23] 0000:0c:04:2: (XEN) [2013-08-23 15:23:23] 0000:0c:04:3: (XEN) [2013-08-23 15:23:23] 0000:0c:04:4: (XEN) [2013-08-23 15:23:23] 0000:0c:04:5: (XEN) [2013-08-23 15:23:23] 0000:0c:04:6: (XEN) [2013-08-23 15:23:23] 0000:0c:04:7: (XEN) [2013-08-23 15:23:23] 0000:0c:05:0: (XEN) [2013-08-23 15:23:23] 0000:0c:05:1: (XEN) [2013-08-23 15:23:23] 0000:0c:05:2: (XEN) [2013-08-23 15:23:23] 0000:0c:05:3: (XEN) [2013-08-23 15:23:23] 0000:0c:05:4: (XEN) [2013-08-23 15:23:23] 0000:0c:05:5: (XEN) [2013-08-23 15:23:23] 0000:0c:05:6: (XEN) [2013-08-23 15:23:23] 0000:0c:05:7: (XEN) [2013-08-23 15:23:23] 0000:0c:06:0: (XEN) [2013-08-23 15:23:23] 0000:0c:06:1: (XEN) [2013-08-23 15:23:23] 0000:0c:06:2: (XEN) [2013-08-23 15:23:23] 0000:0c:06:3: (XEN) [2013-08-23 15:23:23] 0000:0c:06:4: (XEN) [2013-08-23 15:23:23] 0000:0c:06:5: (XEN) [2013-08-23 15:23:23] 0000:0c:06:6: (XEN) [2013-08-23 15:23:23] 0000:0c:06:7: (XEN) [2013-08-23 15:23:23] 0000:0c:07:0: (XEN) [2013-08-23 15:23:23] 0000:0c:07:1: (XEN) [2013-08-23 15:23:23] 0000:0c:07:2: (XEN) [2013-08-23 15:23:23] 0000:0c:07:3: (XEN) [2013-08-23 15:23:23] 0000:0c:07:4: (XEN) [2013-08-23 15:23:23] 0000:0c:07:5: (XEN) [2013-08-23 15:23:23] 0000:0c:07:6: (XEN) [2013-08-23 15:23:23] 0000:0c:07:7: (XEN) [2013-08-23 15:23:23] 0000:0c:08:0: (XEN) [2013-08-23 15:23:23] 0000:0c:08:1: (XEN) [2013-08-23 15:23:23] 0000:0c:08:2: (XEN) [2013-08-23 15:23:23] 0000:0c:08:3: (XEN) [2013-08-23 15:23:23] 0000:0c:08:4: (XEN) [2013-08-23 15:23:23] 0000:0c:08:5: (XEN) [2013-08-23 15:23:23] 0000:0c:08:6: (XEN) [2013-08-23 15:23:23] 0000:0c:08:7: (XEN) [2013-08-23 15:23:23] 0000:0c:09:0: (XEN) [2013-08-23 15:23:23] 0000:0c:09:1: (XEN) [2013-08-23 15:23:23] 0000:0c:09:2: (XEN) [2013-08-23 15:23:23] 0000:0c:09:3: (XEN) [2013-08-23 15:23:23] 0000:0c:09:4: (XEN) [2013-08-23 15:23:23] 0000:0c:09:5: (XEN) [2013-08-23 15:23:23] 0000:0c:09:6: (XEN) [2013-08-23 15:23:23] 0000:0c:09:7: (XEN) [2013-08-23 15:23:23] 0000:0c:0a:0: (XEN) [2013-08-23 15:23:23] 0000:0c:0a:1: (XEN) [2013-08-23 15:23:23] 0000:0c:0a:2: (XEN) [2013-08-23 15:23:23] 0000:0c:0a:3: (XEN) [2013-08-23 15:23:23] 0000:0c:0a:4: (XEN) [2013-08-23 15:23:23] 0000:0c:0a:5: (XEN) [2013-08-23 15:23:23] 0000:0c:0a:6: (XEN) [2013-08-23 15:23:23] 0000:0c:0a:7: (XEN) [2013-08-23 15:23:23] 0000:0c:0b:0: (XEN) [2013-08-23 15:23:23] 0000:0c:0b:1: (XEN) [2013-08-23 15:23:23] 0000:0c:0b:2: (XEN) [2013-08-23 15:23:23] 0000:0c:0b:3: (XEN) [2013-08-23 15:23:23] 0000:0c:0b:4: (XEN) [2013-08-23 15:23:23] 0000:0c:0b:5: (XEN) [2013-08-23 15:23:24] 0000:0c:0b:6: (XEN) [2013-08-23 15:23:24] 0000:0c:0b:7: (XEN) [2013-08-23 15:23:24] 0000:0c:0c:0: (XEN) [2013-08-23 15:23:24] 0000:0c:0c:1: (XEN) [2013-08-23 15:23:24] 0000:0c:0c:2: (XEN) [2013-08-23 15:23:24] 0000:0c:0c:3: (XEN) [2013-08-23 15:23:24] 0000:0c:0c:4: (XEN) [2013-08-23 15:23:24] 0000:0c:0c:5: (XEN) [2013-08-23 15:23:24] 0000:0c:0c:6: (XEN) [2013-08-23 15:23:24] 0000:0c:0c:7: (XEN) [2013-08-23 15:23:24] 0000:0c:0d:0: (XEN) [2013-08-23 15:23:24] 0000:0c:0d:1: (XEN) [2013-08-23 15:23:24] 0000:0c:0d:2: (XEN) [2013-08-23 15:23:24] 0000:0c:0d:3: (XEN) [2013-08-23 15:23:24] 0000:0c:0d:4: (XEN) [2013-08-23 15:23:24] 0000:0c:0d:5: (XEN) [2013-08-23 15:23:24] 0000:0c:0d:6: (XEN) [2013-08-23 15:23:24] 0000:0c:0d:7: (XEN) [2013-08-23 15:23:24] 0000:0c:0e:0: (XEN) [2013-08-23 15:23:24] 0000:0c:0e:1: (XEN) [2013-08-23 15:23:24] 0000:0c:0e:2: (XEN) [2013-08-23 15:23:24] 0000:0c:0e:3: (XEN) [2013-08-23 15:23:24] 0000:0c:0e:4: (XEN) [2013-08-23 15:23:24] 0000:0c:0e:5: (XEN) [2013-08-23 15:23:24] 0000:0c:0e:6: (XEN) [2013-08-23 15:23:24] 0000:0c:0e:7: (XEN) [2013-08-23 15:23:24] 0000:0c:0f:0: (XEN) [2013-08-23 15:23:24] 0000:0c:0f:1: (XEN) [2013-08-23 15:23:24] 0000:0c:0f:2: (XEN) [2013-08-23 15:23:24] 0000:0c:0f:3: (XEN) [2013-08-23 15:23:24] 0000:0c:0f:4: (XEN) [2013-08-23 15:23:24] 0000:0c:0f:5: (XEN) [2013-08-23 15:23:24] 0000:0c:0f:6: (XEN) [2013-08-23 15:23:24] 0000:0c:0f:7: (XEN) [2013-08-23 15:23:24] 0000:0c:10:0: (XEN) [2013-08-23 15:23:24] 0000:0c:10:1: (XEN) [2013-08-23 15:23:24] 0000:0c:10:2: (XEN) [2013-08-23 15:23:24] 0000:0c:10:3: (XEN) [2013-08-23 15:23:24] 0000:0c:10:4: (XEN) [2013-08-23 15:23:24] 0000:0c:10:5: (XEN) [2013-08-23 15:23:24] 0000:0c:10:6: (XEN) [2013-08-23 15:23:24] 0000:0c:10:7: (XEN) [2013-08-23 15:23:24] 0000:0c:11:0: (XEN) [2013-08-23 15:23:24] 0000:0c:11:1: (XEN) [2013-08-23 15:23:24] 0000:0c:11:2: (XEN) [2013-08-23 15:23:24] 0000:0c:11:3: (XEN) [2013-08-23 15:23:24] 0000:0c:11:4: (XEN) [2013-08-23 15:23:24] 0000:0c:11:5: (XEN) [2013-08-23 15:23:24] 0000:0c:11:6: (XEN) [2013-08-23 15:23:24] 0000:0c:11:7: (XEN) [2013-08-23 15:23:24] 0000:0c:12:0: (XEN) [2013-08-23 15:23:24] 0000:0c:12:1: (XEN) [2013-08-23 15:23:24] 0000:0c:12:2: (XEN) [2013-08-23 15:23:24] 0000:0c:12:3: (XEN) [2013-08-23 15:23:24] 0000:0c:12:4: (XEN) [2013-08-23 15:23:24] 0000:0c:12:5: (XEN) [2013-08-23 15:23:24] 0000:0c:12:6: (XEN) [2013-08-23 15:23:24] 0000:0c:12:7: (XEN) [2013-08-23 15:23:24] 0000:0c:13:0: (XEN) [2013-08-23 15:23:24] 0000:0c:13:1: (XEN) [2013-08-23 15:23:24] 0000:0c:13:2: (XEN) [2013-08-23 15:23:24] 0000:0c:13:3: (XEN) [2013-08-23 15:23:24] 0000:0c:13:4: (XEN) [2013-08-23 15:23:24] 0000:0c:13:5: (XEN) [2013-08-23 15:23:24] 0000:0c:13:6: (XEN) [2013-08-23 15:23:24] 0000:0c:13:7: (XEN) [2013-08-23 15:23:24] 0000:0c:14:0: (XEN) [2013-08-23 15:23:24] 0000:0c:14:1: (XEN) [2013-08-23 15:23:24] 0000:0c:14:2: (XEN) [2013-08-23 15:23:24] 0000:0c:14:3: (XEN) [2013-08-23 15:23:24] 0000:0c:14:4: (XEN) [2013-08-23 15:23:24] 0000:0c:14:5: (XEN) [2013-08-23 15:23:24] 0000:0c:14:6: (XEN) [2013-08-23 15:23:24] 0000:0c:14:7: (XEN) [2013-08-23 15:23:24] 0000:0c:15:0: (XEN) [2013-08-23 15:23:24] 0000:0c:15:1: (XEN) [2013-08-23 15:23:24] 0000:0c:15:2: (XEN) [2013-08-23 15:23:24] 0000:0c:15:3: (XEN) [2013-08-23 15:23:24] 0000:0c:15:4: (XEN) [2013-08-23 15:23:24] 0000:0c:15:5: (XEN) [2013-08-23 15:23:24] 0000:0c:15:6: (XEN) [2013-08-23 15:23:24] 0000:0c:15:7: (XEN) [2013-08-23 15:23:24] 0000:0c:16:0: (XEN) [2013-08-23 15:23:24] 0000:0c:16:1: (XEN) [2013-08-23 15:23:24] 0000:0c:16:2: (XEN) [2013-08-23 15:23:25] 0000:0c:16:3: (XEN) [2013-08-23 15:23:25] 0000:0c:16:4: (XEN) [2013-08-23 15:23:25] 0000:0c:16:5: (XEN) [2013-08-23 15:23:25] 0000:0c:16:6: (XEN) [2013-08-23 15:23:25] 0000:0c:16:7: (XEN) [2013-08-23 15:23:25] 0000:0c:17:0: (XEN) [2013-08-23 15:23:25] 0000:0c:17:1: (XEN) [2013-08-23 15:23:25] 0000:0c:17:2: (XEN) [2013-08-23 15:23:25] 0000:0c:17:3: (XEN) [2013-08-23 15:23:25] 0000:0c:17:4: (XEN) [2013-08-23 15:23:25] 0000:0c:17:5: (XEN) [2013-08-23 15:23:25] 0000:0c:17:6: (XEN) [2013-08-23 15:23:25] 0000:0c:17:7: (XEN) [2013-08-23 15:23:25] 0000:0c:18:0: (XEN) [2013-08-23 15:23:25] 0000:0c:18:1: (XEN) [2013-08-23 15:23:25] 0000:0c:18:2: (XEN) [2013-08-23 15:23:25] 0000:0c:18:3: (XEN) [2013-08-23 15:23:25] 0000:0c:18:4: (XEN) [2013-08-23 15:23:25] 0000:0c:18:5: (XEN) [2013-08-23 15:23:25] 0000:0c:18:6: (XEN) [2013-08-23 15:23:25] 0000:0c:18:7: (XEN) [2013-08-23 15:23:25] 0000:0c:19:0: (XEN) [2013-08-23 15:23:25] 0000:0c:19:1: (XEN) [2013-08-23 15:23:25] 0000:0c:19:2: (XEN) [2013-08-23 15:23:25] 0000:0c:19:3: (XEN) [2013-08-23 15:23:25] 0000:0c:19:4: (XEN) [2013-08-23 15:23:25] 0000:0c:19:5: (XEN) [2013-08-23 15:23:25] 0000:0c:19:6: (XEN) [2013-08-23 15:23:25] 0000:0c:19:7: (XEN) [2013-08-23 15:23:25] 0000:0c:1a:0: (XEN) [2013-08-23 15:23:25] 0000:0c:1a:1: (XEN) [2013-08-23 15:23:25] 0000:0c:1a:2: (XEN) [2013-08-23 15:23:25] 0000:0c:1a:3: (XEN) [2013-08-23 15:23:25] 0000:0c:1a:4: (XEN) [2013-08-23 15:23:25] 0000:0c:1a:5: (XEN) [2013-08-23 15:23:25] 0000:0c:1a:6: (XEN) [2013-08-23 15:23:25] 0000:0c:1a:7: (XEN) [2013-08-23 15:23:25] 0000:0c:1b:0: (XEN) [2013-08-23 15:23:25] 0000:0c:1b:1: (XEN) [2013-08-23 15:23:25] 0000:0c:1b:2: (XEN) [2013-08-23 15:23:25] 0000:0c:1b:3: (XEN) [2013-08-23 15:23:25] 0000:0c:1b:4: (XEN) [2013-08-23 15:23:25] 0000:0c:1b:5: (XEN) [2013-08-23 15:23:25] 0000:0c:1b:6: (XEN) [2013-08-23 15:23:25] 0000:0c:1b:7: (XEN) [2013-08-23 15:23:25] 0000:0c:1c:0: (XEN) [2013-08-23 15:23:25] 0000:0c:1c:1: (XEN) [2013-08-23 15:23:25] 0000:0c:1c:2: (XEN) [2013-08-23 15:23:25] 0000:0c:1c:3: (XEN) [2013-08-23 15:23:25] 0000:0c:1c:4: (XEN) [2013-08-23 15:23:25] 0000:0c:1c:5: (XEN) [2013-08-23 15:23:25] 0000:0c:1c:6: (XEN) [2013-08-23 15:23:25] 0000:0c:1c:7: (XEN) [2013-08-23 15:23:25] 0000:0c:1d:0: (XEN) [2013-08-23 15:23:25] 0000:0c:1d:1: (XEN) [2013-08-23 15:23:25] 0000:0c:1d:2: (XEN) [2013-08-23 15:23:25] 0000:0c:1d:3: (XEN) [2013-08-23 15:23:25] 0000:0c:1d:4: (XEN) [2013-08-23 15:23:25] 0000:0c:1d:5: (XEN) [2013-08-23 15:23:25] 0000:0c:1d:6: (XEN) [2013-08-23 15:23:25] 0000:0c:1d:7: (XEN) [2013-08-23 15:23:25] 0000:0c:1e:0: (XEN) [2013-08-23 15:23:25] 0000:0c:1e:1: (XEN) [2013-08-23 15:23:25] 0000:0c:1e:2: (XEN) [2013-08-23 15:23:25] 0000:0c:1e:3: (XEN) [2013-08-23 15:23:25] 0000:0c:1e:4: (XEN) [2013-08-23 15:23:25] 0000:0c:1e:5: (XEN) [2013-08-23 15:23:25] 0000:0c:1e:6: (XEN) [2013-08-23 15:23:25] 0000:0c:1e:7: (XEN) [2013-08-23 15:23:25] 0000:0c:1f:0: (XEN) [2013-08-23 15:23:25] 0000:0c:1f:1: (XEN) [2013-08-23 15:23:25] 0000:0c:1f:2: (XEN) [2013-08-23 15:23:25] 0000:0c:1f:3: (XEN) [2013-08-23 15:23:25] 0000:0c:1f:4: (XEN) [2013-08-23 15:23:25] 0000:0c:1f:5: (XEN) [2013-08-23 15:23:25] 0000:0c:1f:6: (XEN) [2013-08-23 15:23:25] 0000:0c:1f:7: (XEN) [2013-08-23 15:23:25] 0000:0d:00:0: (XEN) [2013-08-23 15:23:25] 0000:0d:00:1: (XEN) [2013-08-23 15:23:25] 0000:0d:00:2: (XEN) [2013-08-23 15:23:25] 0000:0d:00:3: (XEN) [2013-08-23 15:23:25] 0000:0d:00:4: (XEN) [2013-08-23 15:23:25] 0000:0d:00:5: (XEN) [2013-08-23 15:23:25] 0000:0d:00:6: (XEN) [2013-08-23 15:23:25] 0000:0d:00:7: (XEN) [2013-08-23 15:23:25] --- Dumping Shared IOMMU Interrupt Remapping Table ---> Jan
Sander Eikelenboom
2013-Aug-23 15:48 UTC
Re: [xen-unstable] Commit 2ca9fbd739b8a72b16dd790d0fff7b75f5488fb8 AMD IOMMU: allocate IRTE entries instead of using a static mapping, makes dom0 boot process stall several times.
Friday, August 23, 2013, 5:21:26 PM, you wrote:>>>> On 23.08.13 at 17:11, "Jan Beulich" <JBeulich@suse.com> wrote: >>>>> On 23.08.13 at 17:05, Sander Eikelenboom <linux@eikelenboom.it> wrote: >> >>> Friday, August 23, 2013, 4:28:43 PM, you wrote: >>> >>>>>>> On 23.08.13 at 00:51, Sander Eikelenboom <linux@eikelenboom.it> wrote: >>>>> After i got things working on baremetal Linux, i adjusted Xen and hardcoded >>>>> it to add a mapping for ioapic[6]=00:14.0. >>>>> (the entries for ivrs_ioapic[7] and hpet[0] are actually correct in the bios >> >>> >>>>> tables, so they don''t need correction for me at the moment) >>> >>>> Are you sure about the HPET part of this? I ask because that being >>>> wrong could be an explanation for the stalls you see when using >>>> cpuidle (as that could mean those HPET interrupts needed for >>>> waking CPUs don''t arrive). >>> >>>> Speaking of which - why don''t you try whether when not using >>>> FSB-capable HPET channels, the stalls go away? All you''d need >>>> to change is hpet_fsb_cap_lookup() - it ought to return without >>>> doing anything (i.e., if you look at the code, as if >>>> acpi_gbl_FADT.boot_flags had ACPI_FADT_NO_MSI set). >>> >>> Ok adding: >>> >>> @@ -392,6 +392,9 @@ static void __init hpet_fsb_cap_lookup(void) >>> u32 id; >>> unsigned int i, num_chs; >>> >>> + printk(XENLOG_INFO "SEIK HPET: return as if acpi_gbl_FADT.boot_flags & >>> ACPI_FADT_NO_MSI\n"); >>> + return; >>> + >>> if ( unlikely(acpi_gbl_FADT.boot_flags & ACPI_FADT_NO_MSI) ) >>> return; >>> >>> >>> Indeed made the stalls go away .. >> >> So if this time you didn''t leave a no-cpuidle in place somewhere ;-) >> this makes relatively clear that the stalls are due to the interrupts >> coming from the HPET not reaching their destinations. I still can''t >> connect this to the $subject commit yet, though.> Could you provide ''M'' and ''V'' output for the bad (stalling) case?Could it be some priority fight / locking issue with some other MSI(X) enabled devices. (which happen to be the pci-e and ... the SATA controller ... and the Ethernet controllers)> Jan
Jan Beulich
2013-Aug-23 16:01 UTC
Re: [xen-unstable] Commit 2ca9fbd739b8a72b16dd790d0fff7b75f5488fb8 AMD IOMMU: allocate IRTE entries instead of using a static mapping, makes dom0 boot process stall several times.
>>> On 23.08.13 at 17:48, Sander Eikelenboom <linux@eikelenboom.it> wrote:> Friday, August 23, 2013, 5:21:26 PM, you wrote: > >>>>> On 23.08.13 at 17:11, "Jan Beulich" <JBeulich@suse.com> wrote: >>>>>> On 23.08.13 at 17:05, Sander Eikelenboom <linux@eikelenboom.it> wrote: >>> >>>> Friday, August 23, 2013, 4:28:43 PM, you wrote: >>>> >>>>>>>> On 23.08.13 at 00:51, Sander Eikelenboom <linux@eikelenboom.it> wrote: >>>>>> After i got things working on baremetal Linux, i adjusted Xen and hardcoded >>>>>> it to add a mapping for ioapic[6]=00:14.0. >>>>>> (the entries for ivrs_ioapic[7] and hpet[0] are actually correct in the bios > >>> >>>> >>>>>> tables, so they don''t need correction for me at the moment) >>>> >>>>> Are you sure about the HPET part of this? I ask because that being >>>>> wrong could be an explanation for the stalls you see when using >>>>> cpuidle (as that could mean those HPET interrupts needed for >>>>> waking CPUs don''t arrive). >>>> >>>>> Speaking of which - why don''t you try whether when not using >>>>> FSB-capable HPET channels, the stalls go away? All you''d need >>>>> to change is hpet_fsb_cap_lookup() - it ought to return without >>>>> doing anything (i.e., if you look at the code, as if >>>>> acpi_gbl_FADT.boot_flags had ACPI_FADT_NO_MSI set). >>>> >>>> Ok adding: >>>> >>>> @@ -392,6 +392,9 @@ static void __init hpet_fsb_cap_lookup(void) >>>> u32 id; >>>> unsigned int i, num_chs; >>>> >>>> + printk(XENLOG_INFO "SEIK HPET: return as if acpi_gbl_FADT.boot_flags & >>>> ACPI_FADT_NO_MSI\n"); >>>> + return; >>>> + >>>> if ( unlikely(acpi_gbl_FADT.boot_flags & ACPI_FADT_NO_MSI) ) >>>> return; >>>> >>>> >>>> Indeed made the stalls go away .. >>> >>> So if this time you didn''t leave a no-cpuidle in place somewhere ;-) >>> this makes relatively clear that the stalls are due to the interrupts >>> coming from the HPET not reaching their destinations. I still can''t >>> connect this to the $subject commit yet, though. > >> Could you provide ''M'' and ''V'' output for the bad (stalling) case? > > Could it be some priority fight / locking issue with some other MSI(X) > enabled devices. > (which happen to be the pci-e and ... the SATA controller ... and the > Ethernet controllers)I don''t think so. The logs you sent before this mail are interesting though - at a first glance there appear to be missing two out of the three IRTEs supposedly associated with the three HPET channels. And _that_ of course can be related to them now getting allocated instead of their offsets being derived from vector and delivery mode. I''ll have to look deeper, but for the moment I''m trying to implement that IO-APIC/HPET override thing. Jan
Sander Eikelenboom
2013-Aug-23 16:06 UTC
Re: [xen-unstable] Commit 2ca9fbd739b8a72b16dd790d0fff7b75f5488fb8 AMD IOMMU: allocate IRTE entries instead of using a static mapping, makes dom0 boot process stall several times.
Friday, August 23, 2013, 6:01:33 PM, you wrote:>>>> On 23.08.13 at 17:48, Sander Eikelenboom <linux@eikelenboom.it> wrote:>> Friday, August 23, 2013, 5:21:26 PM, you wrote: >> >>>>>> On 23.08.13 at 17:11, "Jan Beulich" <JBeulich@suse.com> wrote: >>>>>>> On 23.08.13 at 17:05, Sander Eikelenboom <linux@eikelenboom.it> wrote: >>>> >>>>> Friday, August 23, 2013, 4:28:43 PM, you wrote: >>>>> >>>>>>>>> On 23.08.13 at 00:51, Sander Eikelenboom <linux@eikelenboom.it> wrote: >>>>>>> After i got things working on baremetal Linux, i adjusted Xen and hardcoded >>>>>>> it to add a mapping for ioapic[6]=00:14.0. >>>>>>> (the entries for ivrs_ioapic[7] and hpet[0] are actually correct in the bios >> >>>> >>>>> >>>>>>> tables, so they don''t need correction for me at the moment) >>>>> >>>>>> Are you sure about the HPET part of this? I ask because that being >>>>>> wrong could be an explanation for the stalls you see when using >>>>>> cpuidle (as that could mean those HPET interrupts needed for >>>>>> waking CPUs don''t arrive). >>>>> >>>>>> Speaking of which - why don''t you try whether when not using >>>>>> FSB-capable HPET channels, the stalls go away? All you''d need >>>>>> to change is hpet_fsb_cap_lookup() - it ought to return without >>>>>> doing anything (i.e., if you look at the code, as if >>>>>> acpi_gbl_FADT.boot_flags had ACPI_FADT_NO_MSI set). >>>>> >>>>> Ok adding: >>>>> >>>>> @@ -392,6 +392,9 @@ static void __init hpet_fsb_cap_lookup(void) >>>>> u32 id; >>>>> unsigned int i, num_chs; >>>>> >>>>> + printk(XENLOG_INFO "SEIK HPET: return as if acpi_gbl_FADT.boot_flags & >>>>> ACPI_FADT_NO_MSI\n"); >>>>> + return; >>>>> + >>>>> if ( unlikely(acpi_gbl_FADT.boot_flags & ACPI_FADT_NO_MSI) ) >>>>> return; >>>>> >>>>> >>>>> Indeed made the stalls go away .. >>>> >>>> So if this time you didn''t leave a no-cpuidle in place somewhere ;-) >>>> this makes relatively clear that the stalls are due to the interrupts >>>> coming from the HPET not reaching their destinations. I still can''t >>>> connect this to the $subject commit yet, though. >> >>> Could you provide ''M'' and ''V'' output for the bad (stalling) case? >> >> Could it be some priority fight / locking issue with some other MSI(X) >> enabled devices. >> (which happen to be the pci-e and ... the SATA controller ... and the >> Ethernet controllers)> I don''t think so. The logs you sent before this mail are interesting > though - at a first glance there appear to be missing two out of the > three IRTEs supposedly associated with the three HPET channels. > And _that_ of course can be related to them now getting allocated > instead of their offsets being derived from vector and delivery mode.> I''ll have to look deeper, but for the moment I''m trying to implement > that IO-APIC/HPET override thing.Ok thx, would have been nice if Suravee had perhaps indicated it''s existence in Linux .. i just stumbled upon it by accident. If you would like me to run some more debug patches that could provide you with the info in a easier way .. feel free to send> Jan
Sander Eikelenboom
2013-Aug-23 17:01 UTC
Re: [xen-unstable] Commit 2ca9fbd739b8a72b16dd790d0fff7b75f5488fb8 AMD IOMMU: allocate IRTE entries instead of using a static mapping, makes dom0 boot process stall several times.
Friday, August 23, 2013, 6:01:33 PM, you wrote:>>>> On 23.08.13 at 17:48, Sander Eikelenboom <linux@eikelenboom.it> wrote:>> Friday, August 23, 2013, 5:21:26 PM, you wrote: >> >>>>>> On 23.08.13 at 17:11, "Jan Beulich" <JBeulich@suse.com> wrote: >>>>>>> On 23.08.13 at 17:05, Sander Eikelenboom <linux@eikelenboom.it> wrote: >>>> >>>>> Friday, August 23, 2013, 4:28:43 PM, you wrote: >>>>> >>>>>>>>> On 23.08.13 at 00:51, Sander Eikelenboom <linux@eikelenboom.it> wrote: >>>>>>> After i got things working on baremetal Linux, i adjusted Xen and hardcoded >>>>>>> it to add a mapping for ioapic[6]=00:14.0. >>>>>>> (the entries for ivrs_ioapic[7] and hpet[0] are actually correct in the bios >> >>>> >>>>> >>>>>>> tables, so they don''t need correction for me at the moment) >>>>> >>>>>> Are you sure about the HPET part of this? I ask because that being >>>>>> wrong could be an explanation for the stalls you see when using >>>>>> cpuidle (as that could mean those HPET interrupts needed for >>>>>> waking CPUs don''t arrive). >>>>> >>>>>> Speaking of which - why don''t you try whether when not using >>>>>> FSB-capable HPET channels, the stalls go away? All you''d need >>>>>> to change is hpet_fsb_cap_lookup() - it ought to return without >>>>>> doing anything (i.e., if you look at the code, as if >>>>>> acpi_gbl_FADT.boot_flags had ACPI_FADT_NO_MSI set). >>>>> >>>>> Ok adding: >>>>> >>>>> @@ -392,6 +392,9 @@ static void __init hpet_fsb_cap_lookup(void) >>>>> u32 id; >>>>> unsigned int i, num_chs; >>>>> >>>>> + printk(XENLOG_INFO "SEIK HPET: return as if acpi_gbl_FADT.boot_flags & >>>>> ACPI_FADT_NO_MSI\n"); >>>>> + return; >>>>> + >>>>> if ( unlikely(acpi_gbl_FADT.boot_flags & ACPI_FADT_NO_MSI) ) >>>>> return; >>>>> >>>>> >>>>> Indeed made the stalls go away .. >>>> >>>> So if this time you didn''t leave a no-cpuidle in place somewhere ;-) >>>> this makes relatively clear that the stalls are due to the interrupts >>>> coming from the HPET not reaching their destinations. I still can''t >>>> connect this to the $subject commit yet, though. >> >>> Could you provide ''M'' and ''V'' output for the bad (stalling) case? >> >> Could it be some priority fight / locking issue with some other MSI(X) >> enabled devices. >> (which happen to be the pci-e and ... the SATA controller ... and the >> Ethernet controllers)> I don''t think so. The logs you sent before this mail are interesting > though - at a first glance there appear to be missing two out of the > three IRTEs supposedly associated with the three HPET channels. > And _that_ of course can be related to them now getting allocated > instead of their offsets being derived from vector and delivery mode.> I''ll have to look deeper, but for the moment I''m trying to implement > that IO-APIC/HPET override thing.Don''t know if it helps, but i have annotated linux amd iommu init code with some extra printk''s. As it doesn''t have stalls. What attracts my eye is erratum 63, a grep in xen code doesn''t return a hit for that one ... [ 0.005631] ACPI: All ACPI Tables successfully acquired [ 0.007980] AMD-Vi: device: 00:00.2 cap: 0040 seg: 0 flags: 3e info 1300 [ 0.007986] AMD-Vi: mmio-addr: 00000000f6000000 [ 0.008008] AMD-Vi: add_special_device for IOAPIC id 6 devid 0xa0 [ 0.008013] AMD-Vi: DEV_SELECT_RANGE_START devid: 00:00.0 flags: 00 [ 0.008017] AMD-Vi: DEV_RANGE_END devid: 00:00.2 [ 0.008020] AMD-Vi: set_dev_entry_from_acpi for devid 0x0 flags: 0x0 ext_flags: 0x0 [ 0.008033] AMD-Vi: set_dev_entry_from_acpi for devid 0x1 flags: 0x0 ext_flags: 0x0 [ 0.008038] AMD-Vi: set_dev_entry_from_acpi for devid 0x2 flags: 0x0 ext_flags: 0x0 [ 0.008043] AMD-Vi: DEV_SELECT devid: 00:02.0 flags: 00 [ 0.008046] AMD-Vi: set_dev_entry_from_acpi for devid 0x10 flags: 0x0 ext_flags: 0x0 [ 0.008050] AMD-Vi: DEV_SELECT devid: 0d:00.0 flags: 00 [ 0.008053] AMD-Vi: set_dev_entry_from_acpi for devid 0xd00 flags: 0x0 ext_flags: 0x0 [ 0.008057] AMD-Vi: DEV_SELECT devid: 00:03.0 flags: 00 [ 0.008060] AMD-Vi: set_dev_entry_from_acpi for devid 0x18 flags: 0x0 ext_flags: 0x0 [ 0.008063] AMD-Vi: DEV_SELECT_RANGE_START devid: 0c:00.0 flags: 00 [ 0.008067] AMD-Vi: DEV_RANGE_END devid: 0c:00.1 [ 0.008069] AMD-Vi: set_dev_entry_from_acpi for devid 0xc00 flags: 0x0 ext_flags: 0x0 [ 0.008073] AMD-Vi: set_dev_entry_from_acpi for devid 0xc01 flags: 0x0 ext_flags: 0x0 [ 0.008077] AMD-Vi: DEV_SELECT devid: 00:05.0 flags: 00 [ 0.008080] AMD-Vi: set_dev_entry_from_acpi for devid 0x28 flags: 0x0 ext_flags: 0x0 [ 0.008083] AMD-Vi: DEV_SELECT devid: 0b:00.0 flags: 00 [ 0.008086] AMD-Vi: set_dev_entry_from_acpi for devid 0xb00 flags: 0x0 ext_flags: 0x0 [ 0.008090] AMD-Vi: DEV_SELECT devid: 00:06.0 flags: 00 [ 0.008093] AMD-Vi: set_dev_entry_from_acpi for devid 0x30 flags: 0x0 ext_flags: 0x0 [ 0.008097] AMD-Vi: DEV_SELECT devid: 0a:00.0 flags: 00 [ 0.008100] AMD-Vi: set_dev_entry_from_acpi for devid 0xa00 flags: 0x0 ext_flags: 0x0 [ 0.008103] AMD-Vi: DEV_SELECT devid: 00:09.0 flags: 00 [ 0.008106] AMD-Vi: set_dev_entry_from_acpi for devid 0x48 flags: 0x0 ext_flags: 0x0 [ 0.008110] AMD-Vi: DEV_SELECT devid: 09:00.0 flags: 00 [ 0.008113] AMD-Vi: set_dev_entry_from_acpi for devid 0x900 flags: 0x0 ext_flags: 0x0 [ 0.008117] AMD-Vi: DEV_SELECT devid: 00:0a.0 flags: 00 [ 0.008120] AMD-Vi: set_dev_entry_from_acpi for devid 0x50 flags: 0x0 ext_flags: 0x0 [ 0.008123] AMD-Vi: DEV_SELECT devid: 08:00.0 flags: 00 [ 0.008126] AMD-Vi: set_dev_entry_from_acpi for devid 0x800 flags: 0x0 ext_flags: 0x0 [ 0.008130] AMD-Vi: DEV_SELECT devid: 00:0b.0 flags: 00 [ 0.008133] AMD-Vi: set_dev_entry_from_acpi for devid 0x58 flags: 0x0 ext_flags: 0x0 [ 0.008137] AMD-Vi: DEV_SELECT_RANGE_START devid: 07:00.0 flags: 00 [ 0.008140] AMD-Vi: DEV_RANGE_END devid: 07:00.1 [ 0.008143] AMD-Vi: set_dev_entry_from_acpi for devid 0x700 flags: 0x0 ext_flags: 0x0 [ 0.008146] AMD-Vi: set_dev_entry_from_acpi for devid 0x701 flags: 0x0 ext_flags: 0x0 [ 0.008150] AMD-Vi: DEV_SELECT devid: 00:0c.0 flags: 00 [ 0.008153] AMD-Vi: set_dev_entry_from_acpi for devid 0x60 flags: 0x0 ext_flags: 0x0 [ 0.008157] AMD-Vi: DEV_SELECT devid: 05:00.0 flags: 00 [ 0.008160] AMD-Vi: set_dev_entry_from_acpi for devid 0x500 flags: 0x0 ext_flags: 0x0 [ 0.008164] AMD-Vi: DEV_ALIAS_RANGE devid: 06:01.0 flags: 00 devid_to: 06:00.0 [ 0.008167] AMD-Vi: DEV_RANGE_END devid: 06:1f.7 [ 0.008170] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008174] AMD-Vi: set_dev_entry_from_acpi for devid 0x608 flags: 0x0 ext_flags: 0x0 [ 0.008178] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008181] AMD-Vi: set_dev_entry_from_acpi for devid 0x609 flags: 0x0 ext_flags: 0x0 [ 0.008185] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008189] AMD-Vi: set_dev_entry_from_acpi for devid 0x60a flags: 0x0 ext_flags: 0x0 [ 0.008193] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008196] AMD-Vi: set_dev_entry_from_acpi for devid 0x60b flags: 0x0 ext_flags: 0x0 [ 0.008200] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008204] AMD-Vi: set_dev_entry_from_acpi for devid 0x60c flags: 0x0 ext_flags: 0x0 [ 0.008208] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008211] AMD-Vi: set_dev_entry_from_acpi for devid 0x60d flags: 0x0 ext_flags: 0x0 [ 0.008215] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008219] AMD-Vi: set_dev_entry_from_acpi for devid 0x60e flags: 0x0 ext_flags: 0x0 [ 0.008223] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008226] AMD-Vi: set_dev_entry_from_acpi for devid 0x60f flags: 0x0 ext_flags: 0x0 [ 0.008230] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008234] AMD-Vi: set_dev_entry_from_acpi for devid 0x610 flags: 0x0 ext_flags: 0x0 [ 0.008238] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008241] AMD-Vi: set_dev_entry_from_acpi for devid 0x611 flags: 0x0 ext_flags: 0x0 [ 0.008245] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008249] AMD-Vi: set_dev_entry_from_acpi for devid 0x612 flags: 0x0 ext_flags: 0x0 [ 0.008253] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008256] AMD-Vi: set_dev_entry_from_acpi for devid 0x613 flags: 0x0 ext_flags: 0x0 [ 0.008260] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008264] AMD-Vi: set_dev_entry_from_acpi for devid 0x614 flags: 0x0 ext_flags: 0x0 [ 0.008268] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008271] AMD-Vi: set_dev_entry_from_acpi for devid 0x615 flags: 0x0 ext_flags: 0x0 [ 0.008275] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008279] AMD-Vi: set_dev_entry_from_acpi for devid 0x616 flags: 0x0 ext_flags: 0x0 [ 0.008282] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008286] AMD-Vi: set_dev_entry_from_acpi for devid 0x617 flags: 0x0 ext_flags: 0x0 [ 0.008290] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008294] AMD-Vi: set_dev_entry_from_acpi for devid 0x618 flags: 0x0 ext_flags: 0x0 [ 0.008297] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008301] AMD-Vi: set_dev_entry_from_acpi for devid 0x619 flags: 0x0 ext_flags: 0x0 [ 0.008305] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008309] AMD-Vi: set_dev_entry_from_acpi for devid 0x61a flags: 0x0 ext_flags: 0x0 [ 0.008312] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008316] AMD-Vi: set_dev_entry_from_acpi for devid 0x61b flags: 0x0 ext_flags: 0x0 [ 0.008320] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008324] AMD-Vi: set_dev_entry_from_acpi for devid 0x61c flags: 0x0 ext_flags: 0x0 [ 0.008327] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008331] AMD-Vi: set_dev_entry_from_acpi for devid 0x61d flags: 0x0 ext_flags: 0x0 [ 0.008335] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008339] AMD-Vi: set_dev_entry_from_acpi for devid 0x61e flags: 0x0 ext_flags: 0x0 [ 0.008342] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008346] AMD-Vi: set_dev_entry_from_acpi for devid 0x61f flags: 0x0 ext_flags: 0x0 [ 0.008350] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008354] AMD-Vi: set_dev_entry_from_acpi for devid 0x620 flags: 0x0 ext_flags: 0x0 [ 0.008357] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008361] AMD-Vi: set_dev_entry_from_acpi for devid 0x621 flags: 0x0 ext_flags: 0x0 [ 0.008365] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008368] AMD-Vi: set_dev_entry_from_acpi for devid 0x622 flags: 0x0 ext_flags: 0x0 [ 0.008372] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008376] AMD-Vi: set_dev_entry_from_acpi for devid 0x623 flags: 0x0 ext_flags: 0x0 [ 0.008380] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008383] AMD-Vi: set_dev_entry_from_acpi for devid 0x624 flags: 0x0 ext_flags: 0x0 [ 0.008387] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008391] AMD-Vi: set_dev_entry_from_acpi for devid 0x625 flags: 0x0 ext_flags: 0x0 [ 0.008395] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008399] AMD-Vi: set_dev_entry_from_acpi for devid 0x626 flags: 0x0 ext_flags: 0x0 [ 0.008402] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008406] AMD-Vi: set_dev_entry_from_acpi for devid 0x627 flags: 0x0 ext_flags: 0x0 [ 0.008410] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008414] AMD-Vi: set_dev_entry_from_acpi for devid 0x628 flags: 0x0 ext_flags: 0x0 [ 0.008417] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008421] AMD-Vi: set_dev_entry_from_acpi for devid 0x629 flags: 0x0 ext_flags: 0x0 [ 0.008425] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008429] AMD-Vi: set_dev_entry_from_acpi for devid 0x62a flags: 0x0 ext_flags: 0x0 [ 0.008433] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008436] AMD-Vi: set_dev_entry_from_acpi for devid 0x62b flags: 0x0 ext_flags: 0x0 [ 0.008440] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008444] AMD-Vi: set_dev_entry_from_acpi for devid 0x62c flags: 0x0 ext_flags: 0x0 [ 0.008448] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008451] AMD-Vi: set_dev_entry_from_acpi for devid 0x62d flags: 0x0 ext_flags: 0x0 [ 0.008455] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008459] AMD-Vi: set_dev_entry_from_acpi for devid 0x62e flags: 0x0 ext_flags: 0x0 [ 0.008463] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008466] AMD-Vi: set_dev_entry_from_acpi for devid 0x62f flags: 0x0 ext_flags: 0x0 [ 0.008470] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008474] AMD-Vi: set_dev_entry_from_acpi for devid 0x630 flags: 0x0 ext_flags: 0x0 [ 0.008478] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008481] AMD-Vi: set_dev_entry_from_acpi for devid 0x631 flags: 0x0 ext_flags: 0x0 [ 0.008485] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008489] AMD-Vi: set_dev_entry_from_acpi for devid 0x632 flags: 0x0 ext_flags: 0x0 [ 0.008493] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008496] AMD-Vi: set_dev_entry_from_acpi for devid 0x633 flags: 0x0 ext_flags: 0x0 [ 0.008500] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008504] AMD-Vi: set_dev_entry_from_acpi for devid 0x634 flags: 0x0 ext_flags: 0x0 [ 0.008508] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008511] AMD-Vi: set_dev_entry_from_acpi for devid 0x635 flags: 0x0 ext_flags: 0x0 [ 0.008515] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008519] AMD-Vi: set_dev_entry_from_acpi for devid 0x636 flags: 0x0 ext_flags: 0x0 [ 0.008522] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008526] AMD-Vi: set_dev_entry_from_acpi for devid 0x637 flags: 0x0 ext_flags: 0x0 [ 0.008530] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008534] AMD-Vi: set_dev_entry_from_acpi for devid 0x638 flags: 0x0 ext_flags: 0x0 [ 0.008537] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008541] AMD-Vi: set_dev_entry_from_acpi for devid 0x639 flags: 0x0 ext_flags: 0x0 [ 0.008545] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008549] AMD-Vi: set_dev_entry_from_acpi for devid 0x63a flags: 0x0 ext_flags: 0x0 [ 0.008553] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008556] AMD-Vi: set_dev_entry_from_acpi for devid 0x63b flags: 0x0 ext_flags: 0x0 [ 0.008560] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008564] AMD-Vi: set_dev_entry_from_acpi for devid 0x63c flags: 0x0 ext_flags: 0x0 [ 0.008567] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008571] AMD-Vi: set_dev_entry_from_acpi for devid 0x63d flags: 0x0 ext_flags: 0x0 [ 0.008575] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008579] AMD-Vi: set_dev_entry_from_acpi for devid 0x63e flags: 0x0 ext_flags: 0x0 [ 0.008582] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008586] AMD-Vi: set_dev_entry_from_acpi for devid 0x63f flags: 0x0 ext_flags: 0x0 [ 0.008590] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008594] AMD-Vi: set_dev_entry_from_acpi for devid 0x640 flags: 0x0 ext_flags: 0x0 [ 0.008597] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008601] AMD-Vi: set_dev_entry_from_acpi for devid 0x641 flags: 0x0 ext_flags: 0x0 [ 0.008605] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008609] AMD-Vi: set_dev_entry_from_acpi for devid 0x642 flags: 0x0 ext_flags: 0x0 [ 0.008612] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008616] AMD-Vi: set_dev_entry_from_acpi for devid 0x643 flags: 0x0 ext_flags: 0x0 [ 0.008620] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008624] AMD-Vi: set_dev_entry_from_acpi for devid 0x644 flags: 0x0 ext_flags: 0x0 [ 0.008627] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008631] AMD-Vi: set_dev_entry_from_acpi for devid 0x645 flags: 0x0 ext_flags: 0x0 [ 0.008635] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008639] AMD-Vi: set_dev_entry_from_acpi for devid 0x646 flags: 0x0 ext_flags: 0x0 [ 0.008642] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008646] AMD-Vi: set_dev_entry_from_acpi for devid 0x647 flags: 0x0 ext_flags: 0x0 [ 0.008650] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008653] AMD-Vi: set_dev_entry_from_acpi for devid 0x648 flags: 0x0 ext_flags: 0x0 [ 0.008657] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008661] AMD-Vi: set_dev_entry_from_acpi for devid 0x649 flags: 0x0 ext_flags: 0x0 [ 0.008665] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008668] AMD-Vi: set_dev_entry_from_acpi for devid 0x64a flags: 0x0 ext_flags: 0x0 [ 0.008672] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008676] AMD-Vi: set_dev_entry_from_acpi for devid 0x64b flags: 0x0 ext_flags: 0x0 [ 0.008680] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008683] AMD-Vi: set_dev_entry_from_acpi for devid 0x64c flags: 0x0 ext_flags: 0x0 [ 0.008687] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008691] AMD-Vi: set_dev_entry_from_acpi for devid 0x64d flags: 0x0 ext_flags: 0x0 [ 0.008695] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008698] AMD-Vi: set_dev_entry_from_acpi for devid 0x64e flags: 0x0 ext_flags: 0x0 [ 0.008702] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008706] AMD-Vi: set_dev_entry_from_acpi for devid 0x64f flags: 0x0 ext_flags: 0x0 [ 0.008710] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008713] AMD-Vi: set_dev_entry_from_acpi for devid 0x650 flags: 0x0 ext_flags: 0x0 [ 0.008717] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008721] AMD-Vi: set_dev_entry_from_acpi for devid 0x651 flags: 0x0 ext_flags: 0x0 [ 0.008725] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008728] AMD-Vi: set_dev_entry_from_acpi for devid 0x652 flags: 0x0 ext_flags: 0x0 [ 0.008732] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008736] AMD-Vi: set_dev_entry_from_acpi for devid 0x653 flags: 0x0 ext_flags: 0x0 [ 0.008740] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008743] AMD-Vi: set_dev_entry_from_acpi for devid 0x654 flags: 0x0 ext_flags: 0x0 [ 0.008747] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008751] AMD-Vi: set_dev_entry_from_acpi for devid 0x655 flags: 0x0 ext_flags: 0x0 [ 0.008755] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008758] AMD-Vi: set_dev_entry_from_acpi for devid 0x656 flags: 0x0 ext_flags: 0x0 [ 0.008762] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008766] AMD-Vi: set_dev_entry_from_acpi for devid 0x657 flags: 0x0 ext_flags: 0x0 [ 0.008769] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008773] AMD-Vi: set_dev_entry_from_acpi for devid 0x658 flags: 0x0 ext_flags: 0x0 [ 0.008777] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008781] AMD-Vi: set_dev_entry_from_acpi for devid 0x659 flags: 0x0 ext_flags: 0x0 [ 0.008784] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008788] AMD-Vi: set_dev_entry_from_acpi for devid 0x65a flags: 0x0 ext_flags: 0x0 [ 0.008792] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008796] AMD-Vi: set_dev_entry_from_acpi for devid 0x65b flags: 0x0 ext_flags: 0x0 [ 0.008799] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008803] AMD-Vi: set_dev_entry_from_acpi for devid 0x65c flags: 0x0 ext_flags: 0x0 [ 0.008807] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008811] AMD-Vi: set_dev_entry_from_acpi for devid 0x65d flags: 0x0 ext_flags: 0x0 [ 0.008814] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008818] AMD-Vi: set_dev_entry_from_acpi for devid 0x65e flags: 0x0 ext_flags: 0x0 [ 0.008822] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008826] AMD-Vi: set_dev_entry_from_acpi for devid 0x65f flags: 0x0 ext_flags: 0x0 [ 0.008829] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008833] AMD-Vi: set_dev_entry_from_acpi for devid 0x660 flags: 0x0 ext_flags: 0x0 [ 0.008837] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008841] AMD-Vi: set_dev_entry_from_acpi for devid 0x661 flags: 0x0 ext_flags: 0x0 [ 0.008844] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008848] AMD-Vi: set_dev_entry_from_acpi for devid 0x662 flags: 0x0 ext_flags: 0x0 [ 0.008852] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008856] AMD-Vi: set_dev_entry_from_acpi for devid 0x663 flags: 0x0 ext_flags: 0x0 [ 0.008859] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008863] AMD-Vi: set_dev_entry_from_acpi for devid 0x664 flags: 0x0 ext_flags: 0x0 [ 0.008867] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008870] AMD-Vi: set_dev_entry_from_acpi for devid 0x665 flags: 0x0 ext_flags: 0x0 [ 0.008874] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008878] AMD-Vi: set_dev_entry_from_acpi for devid 0x666 flags: 0x0 ext_flags: 0x0 [ 0.008882] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008886] AMD-Vi: set_dev_entry_from_acpi for devid 0x667 flags: 0x0 ext_flags: 0x0 [ 0.008889] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008893] AMD-Vi: set_dev_entry_from_acpi for devid 0x668 flags: 0x0 ext_flags: 0x0 [ 0.008897] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008900] AMD-Vi: set_dev_entry_from_acpi for devid 0x669 flags: 0x0 ext_flags: 0x0 [ 0.008904] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008908] AMD-Vi: set_dev_entry_from_acpi for devid 0x66a flags: 0x0 ext_flags: 0x0 [ 0.008912] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008915] AMD-Vi: set_dev_entry_from_acpi for devid 0x66b flags: 0x0 ext_flags: 0x0 [ 0.008919] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008923] AMD-Vi: set_dev_entry_from_acpi for devid 0x66c flags: 0x0 ext_flags: 0x0 [ 0.008927] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008930] AMD-Vi: set_dev_entry_from_acpi for devid 0x66d flags: 0x0 ext_flags: 0x0 [ 0.008934] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008938] AMD-Vi: set_dev_entry_from_acpi for devid 0x66e flags: 0x0 ext_flags: 0x0 [ 0.008942] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008945] AMD-Vi: set_dev_entry_from_acpi for devid 0x66f flags: 0x0 ext_flags: 0x0 [ 0.008949] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008953] AMD-Vi: set_dev_entry_from_acpi for devid 0x670 flags: 0x0 ext_flags: 0x0 [ 0.008957] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008960] AMD-Vi: set_dev_entry_from_acpi for devid 0x671 flags: 0x0 ext_flags: 0x0 [ 0.008964] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008968] AMD-Vi: set_dev_entry_from_acpi for devid 0x672 flags: 0x0 ext_flags: 0x0 [ 0.008972] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008975] AMD-Vi: set_dev_entry_from_acpi for devid 0x673 flags: 0x0 ext_flags: 0x0 [ 0.008979] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008983] AMD-Vi: set_dev_entry_from_acpi for devid 0x674 flags: 0x0 ext_flags: 0x0 [ 0.008986] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008990] AMD-Vi: set_dev_entry_from_acpi for devid 0x675 flags: 0x0 ext_flags: 0x0 [ 0.008994] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.008998] AMD-Vi: set_dev_entry_from_acpi for devid 0x676 flags: 0x0 ext_flags: 0x0 [ 0.009001] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009005] AMD-Vi: set_dev_entry_from_acpi for devid 0x677 flags: 0x0 ext_flags: 0x0 [ 0.009009] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009013] AMD-Vi: set_dev_entry_from_acpi for devid 0x678 flags: 0x0 ext_flags: 0x0 [ 0.009016] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009020] AMD-Vi: set_dev_entry_from_acpi for devid 0x679 flags: 0x0 ext_flags: 0x0 [ 0.009024] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009028] AMD-Vi: set_dev_entry_from_acpi for devid 0x67a flags: 0x0 ext_flags: 0x0 [ 0.009031] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009035] AMD-Vi: set_dev_entry_from_acpi for devid 0x67b flags: 0x0 ext_flags: 0x0 [ 0.009039] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009043] AMD-Vi: set_dev_entry_from_acpi for devid 0x67c flags: 0x0 ext_flags: 0x0 [ 0.009046] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009050] AMD-Vi: set_dev_entry_from_acpi for devid 0x67d flags: 0x0 ext_flags: 0x0 [ 0.009054] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009058] AMD-Vi: set_dev_entry_from_acpi for devid 0x67e flags: 0x0 ext_flags: 0x0 [ 0.009061] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009065] AMD-Vi: set_dev_entry_from_acpi for devid 0x67f flags: 0x0 ext_flags: 0x0 [ 0.009069] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009073] AMD-Vi: set_dev_entry_from_acpi for devid 0x680 flags: 0x0 ext_flags: 0x0 [ 0.009076] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009080] AMD-Vi: set_dev_entry_from_acpi for devid 0x681 flags: 0x0 ext_flags: 0x0 [ 0.009084] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009088] AMD-Vi: set_dev_entry_from_acpi for devid 0x682 flags: 0x0 ext_flags: 0x0 [ 0.009091] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009095] AMD-Vi: set_dev_entry_from_acpi for devid 0x683 flags: 0x0 ext_flags: 0x0 [ 0.009099] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009103] AMD-Vi: set_dev_entry_from_acpi for devid 0x684 flags: 0x0 ext_flags: 0x0 [ 0.009106] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009110] AMD-Vi: set_dev_entry_from_acpi for devid 0x685 flags: 0x0 ext_flags: 0x0 [ 0.009114] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009118] AMD-Vi: set_dev_entry_from_acpi for devid 0x686 flags: 0x0 ext_flags: 0x0 [ 0.009121] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009125] AMD-Vi: set_dev_entry_from_acpi for devid 0x687 flags: 0x0 ext_flags: 0x0 [ 0.009129] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009133] AMD-Vi: set_dev_entry_from_acpi for devid 0x688 flags: 0x0 ext_flags: 0x0 [ 0.009136] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009140] AMD-Vi: set_dev_entry_from_acpi for devid 0x689 flags: 0x0 ext_flags: 0x0 [ 0.009144] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009148] AMD-Vi: set_dev_entry_from_acpi for devid 0x68a flags: 0x0 ext_flags: 0x0 [ 0.009151] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009155] AMD-Vi: set_dev_entry_from_acpi for devid 0x68b flags: 0x0 ext_flags: 0x0 [ 0.009159] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009163] AMD-Vi: set_dev_entry_from_acpi for devid 0x68c flags: 0x0 ext_flags: 0x0 [ 0.009166] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009170] AMD-Vi: set_dev_entry_from_acpi for devid 0x68d flags: 0x0 ext_flags: 0x0 [ 0.009174] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009178] AMD-Vi: set_dev_entry_from_acpi for devid 0x68e flags: 0x0 ext_flags: 0x0 [ 0.009181] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009185] AMD-Vi: set_dev_entry_from_acpi for devid 0x68f flags: 0x0 ext_flags: 0x0 [ 0.009189] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009193] AMD-Vi: set_dev_entry_from_acpi for devid 0x690 flags: 0x0 ext_flags: 0x0 [ 0.009196] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009200] AMD-Vi: set_dev_entry_from_acpi for devid 0x691 flags: 0x0 ext_flags: 0x0 [ 0.009204] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009207] AMD-Vi: set_dev_entry_from_acpi for devid 0x692 flags: 0x0 ext_flags: 0x0 [ 0.009211] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009215] AMD-Vi: set_dev_entry_from_acpi for devid 0x693 flags: 0x0 ext_flags: 0x0 [ 0.009219] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009223] AMD-Vi: set_dev_entry_from_acpi for devid 0x694 flags: 0x0 ext_flags: 0x0 [ 0.009226] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009230] AMD-Vi: set_dev_entry_from_acpi for devid 0x695 flags: 0x0 ext_flags: 0x0 [ 0.009234] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009237] AMD-Vi: set_dev_entry_from_acpi for devid 0x696 flags: 0x0 ext_flags: 0x0 [ 0.009241] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009245] AMD-Vi: set_dev_entry_from_acpi for devid 0x697 flags: 0x0 ext_flags: 0x0 [ 0.009249] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009252] AMD-Vi: set_dev_entry_from_acpi for devid 0x698 flags: 0x0 ext_flags: 0x0 [ 0.009256] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009260] AMD-Vi: set_dev_entry_from_acpi for devid 0x699 flags: 0x0 ext_flags: 0x0 [ 0.009264] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009267] AMD-Vi: set_dev_entry_from_acpi for devid 0x69a flags: 0x0 ext_flags: 0x0 [ 0.009271] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009275] AMD-Vi: set_dev_entry_from_acpi for devid 0x69b flags: 0x0 ext_flags: 0x0 [ 0.009279] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009282] AMD-Vi: set_dev_entry_from_acpi for devid 0x69c flags: 0x0 ext_flags: 0x0 [ 0.009286] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009290] AMD-Vi: set_dev_entry_from_acpi for devid 0x69d flags: 0x0 ext_flags: 0x0 [ 0.009294] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009297] AMD-Vi: set_dev_entry_from_acpi for devid 0x69e flags: 0x0 ext_flags: 0x0 [ 0.009301] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009305] AMD-Vi: set_dev_entry_from_acpi for devid 0x69f flags: 0x0 ext_flags: 0x0 [ 0.009309] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009312] AMD-Vi: set_dev_entry_from_acpi for devid 0x6a0 flags: 0x0 ext_flags: 0x0 [ 0.009316] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009320] AMD-Vi: set_dev_entry_from_acpi for devid 0x6a1 flags: 0x0 ext_flags: 0x0 [ 0.009323] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009327] AMD-Vi: set_dev_entry_from_acpi for devid 0x6a2 flags: 0x0 ext_flags: 0x0 [ 0.009331] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009335] AMD-Vi: set_dev_entry_from_acpi for devid 0x6a3 flags: 0x0 ext_flags: 0x0 [ 0.009338] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009342] AMD-Vi: set_dev_entry_from_acpi for devid 0x6a4 flags: 0x0 ext_flags: 0x0 [ 0.009346] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009350] AMD-Vi: set_dev_entry_from_acpi for devid 0x6a5 flags: 0x0 ext_flags: 0x0 [ 0.009353] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009357] AMD-Vi: set_dev_entry_from_acpi for devid 0x6a6 flags: 0x0 ext_flags: 0x0 [ 0.009361] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009365] AMD-Vi: set_dev_entry_from_acpi for devid 0x6a7 flags: 0x0 ext_flags: 0x0 [ 0.009368] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009372] AMD-Vi: set_dev_entry_from_acpi for devid 0x6a8 flags: 0x0 ext_flags: 0x0 [ 0.009376] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009380] AMD-Vi: set_dev_entry_from_acpi for devid 0x6a9 flags: 0x0 ext_flags: 0x0 [ 0.009383] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009387] AMD-Vi: set_dev_entry_from_acpi for devid 0x6aa flags: 0x0 ext_flags: 0x0 [ 0.009391] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009395] AMD-Vi: set_dev_entry_from_acpi for devid 0x6ab flags: 0x0 ext_flags: 0x0 [ 0.009398] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009402] AMD-Vi: set_dev_entry_from_acpi for devid 0x6ac flags: 0x0 ext_flags: 0x0 [ 0.009406] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009410] AMD-Vi: set_dev_entry_from_acpi for devid 0x6ad flags: 0x0 ext_flags: 0x0 [ 0.009413] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009417] AMD-Vi: set_dev_entry_from_acpi for devid 0x6ae flags: 0x0 ext_flags: 0x0 [ 0.009421] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009425] AMD-Vi: set_dev_entry_from_acpi for devid 0x6af flags: 0x0 ext_flags: 0x0 [ 0.009428] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009432] AMD-Vi: set_dev_entry_from_acpi for devid 0x6b0 flags: 0x0 ext_flags: 0x0 [ 0.009436] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009439] AMD-Vi: set_dev_entry_from_acpi for devid 0x6b1 flags: 0x0 ext_flags: 0x0 [ 0.009443] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009447] AMD-Vi: set_dev_entry_from_acpi for devid 0x6b2 flags: 0x0 ext_flags: 0x0 [ 0.009451] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009454] AMD-Vi: set_dev_entry_from_acpi for devid 0x6b3 flags: 0x0 ext_flags: 0x0 [ 0.009458] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009462] AMD-Vi: set_dev_entry_from_acpi for devid 0x6b4 flags: 0x0 ext_flags: 0x0 [ 0.009466] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009469] AMD-Vi: set_dev_entry_from_acpi for devid 0x6b5 flags: 0x0 ext_flags: 0x0 [ 0.009473] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009477] AMD-Vi: set_dev_entry_from_acpi for devid 0x6b6 flags: 0x0 ext_flags: 0x0 [ 0.009481] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009484] AMD-Vi: set_dev_entry_from_acpi for devid 0x6b7 flags: 0x0 ext_flags: 0x0 [ 0.009488] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009492] AMD-Vi: set_dev_entry_from_acpi for devid 0x6b8 flags: 0x0 ext_flags: 0x0 [ 0.009496] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009499] AMD-Vi: set_dev_entry_from_acpi for devid 0x6b9 flags: 0x0 ext_flags: 0x0 [ 0.009503] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009507] AMD-Vi: set_dev_entry_from_acpi for devid 0x6ba flags: 0x0 ext_flags: 0x0 [ 0.009511] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009514] AMD-Vi: set_dev_entry_from_acpi for devid 0x6bb flags: 0x0 ext_flags: 0x0 [ 0.009518] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009522] AMD-Vi: set_dev_entry_from_acpi for devid 0x6bc flags: 0x0 ext_flags: 0x0 [ 0.009525] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009529] AMD-Vi: set_dev_entry_from_acpi for devid 0x6bd flags: 0x0 ext_flags: 0x0 [ 0.009533] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009537] AMD-Vi: set_dev_entry_from_acpi for devid 0x6be flags: 0x0 ext_flags: 0x0 [ 0.009540] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009544] AMD-Vi: set_dev_entry_from_acpi for devid 0x6bf flags: 0x0 ext_flags: 0x0 [ 0.009548] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009552] AMD-Vi: set_dev_entry_from_acpi for devid 0x6c0 flags: 0x0 ext_flags: 0x0 [ 0.009555] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009559] AMD-Vi: set_dev_entry_from_acpi for devid 0x6c1 flags: 0x0 ext_flags: 0x0 [ 0.009563] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009567] AMD-Vi: set_dev_entry_from_acpi for devid 0x6c2 flags: 0x0 ext_flags: 0x0 [ 0.009570] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009574] AMD-Vi: set_dev_entry_from_acpi for devid 0x6c3 flags: 0x0 ext_flags: 0x0 [ 0.009578] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009582] AMD-Vi: set_dev_entry_from_acpi for devid 0x6c4 flags: 0x0 ext_flags: 0x0 [ 0.009585] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009589] AMD-Vi: set_dev_entry_from_acpi for devid 0x6c5 flags: 0x0 ext_flags: 0x0 [ 0.009593] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009597] AMD-Vi: set_dev_entry_from_acpi for devid 0x6c6 flags: 0x0 ext_flags: 0x0 [ 0.009600] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009604] AMD-Vi: set_dev_entry_from_acpi for devid 0x6c7 flags: 0x0 ext_flags: 0x0 [ 0.009608] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009612] AMD-Vi: set_dev_entry_from_acpi for devid 0x6c8 flags: 0x0 ext_flags: 0x0 [ 0.009615] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009619] AMD-Vi: set_dev_entry_from_acpi for devid 0x6c9 flags: 0x0 ext_flags: 0x0 [ 0.009623] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009627] AMD-Vi: set_dev_entry_from_acpi for devid 0x6ca flags: 0x0 ext_flags: 0x0 [ 0.009630] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009634] AMD-Vi: set_dev_entry_from_acpi for devid 0x6cb flags: 0x0 ext_flags: 0x0 [ 0.009638] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009642] AMD-Vi: set_dev_entry_from_acpi for devid 0x6cc flags: 0x0 ext_flags: 0x0 [ 0.009645] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009649] AMD-Vi: set_dev_entry_from_acpi for devid 0x6cd flags: 0x0 ext_flags: 0x0 [ 0.009653] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009656] AMD-Vi: set_dev_entry_from_acpi for devid 0x6ce flags: 0x0 ext_flags: 0x0 [ 0.009660] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009664] AMD-Vi: set_dev_entry_from_acpi for devid 0x6cf flags: 0x0 ext_flags: 0x0 [ 0.009668] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009671] AMD-Vi: set_dev_entry_from_acpi for devid 0x6d0 flags: 0x0 ext_flags: 0x0 [ 0.009675] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009679] AMD-Vi: set_dev_entry_from_acpi for devid 0x6d1 flags: 0x0 ext_flags: 0x0 [ 0.009683] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009686] AMD-Vi: set_dev_entry_from_acpi for devid 0x6d2 flags: 0x0 ext_flags: 0x0 [ 0.009690] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009694] AMD-Vi: set_dev_entry_from_acpi for devid 0x6d3 flags: 0x0 ext_flags: 0x0 [ 0.009698] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009701] AMD-Vi: set_dev_entry_from_acpi for devid 0x6d4 flags: 0x0 ext_flags: 0x0 [ 0.009705] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009709] AMD-Vi: set_dev_entry_from_acpi for devid 0x6d5 flags: 0x0 ext_flags: 0x0 [ 0.009713] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009716] AMD-Vi: set_dev_entry_from_acpi for devid 0x6d6 flags: 0x0 ext_flags: 0x0 [ 0.009720] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009724] AMD-Vi: set_dev_entry_from_acpi for devid 0x6d7 flags: 0x0 ext_flags: 0x0 [ 0.009728] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009731] AMD-Vi: set_dev_entry_from_acpi for devid 0x6d8 flags: 0x0 ext_flags: 0x0 [ 0.009735] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009739] AMD-Vi: set_dev_entry_from_acpi for devid 0x6d9 flags: 0x0 ext_flags: 0x0 [ 0.009743] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009747] AMD-Vi: set_dev_entry_from_acpi for devid 0x6da flags: 0x0 ext_flags: 0x0 [ 0.009750] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009754] AMD-Vi: set_dev_entry_from_acpi for devid 0x6db flags: 0x0 ext_flags: 0x0 [ 0.009758] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009762] AMD-Vi: set_dev_entry_from_acpi for devid 0x6dc flags: 0x0 ext_flags: 0x0 [ 0.009765] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009769] AMD-Vi: set_dev_entry_from_acpi for devid 0x6dd flags: 0x0 ext_flags: 0x0 [ 0.009773] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009777] AMD-Vi: set_dev_entry_from_acpi for devid 0x6de flags: 0x0 ext_flags: 0x0 [ 0.009780] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009784] AMD-Vi: set_dev_entry_from_acpi for devid 0x6df flags: 0x0 ext_flags: 0x0 [ 0.009788] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009792] AMD-Vi: set_dev_entry_from_acpi for devid 0x6e0 flags: 0x0 ext_flags: 0x0 [ 0.009795] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009799] AMD-Vi: set_dev_entry_from_acpi for devid 0x6e1 flags: 0x0 ext_flags: 0x0 [ 0.009803] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009807] AMD-Vi: set_dev_entry_from_acpi for devid 0x6e2 flags: 0x0 ext_flags: 0x0 [ 0.009810] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009814] AMD-Vi: set_dev_entry_from_acpi for devid 0x6e3 flags: 0x0 ext_flags: 0x0 [ 0.009818] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009822] AMD-Vi: set_dev_entry_from_acpi for devid 0x6e4 flags: 0x0 ext_flags: 0x0 [ 0.009825] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009829] AMD-Vi: set_dev_entry_from_acpi for devid 0x6e5 flags: 0x0 ext_flags: 0x0 [ 0.009833] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009837] AMD-Vi: set_dev_entry_from_acpi for devid 0x6e6 flags: 0x0 ext_flags: 0x0 [ 0.009840] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009844] AMD-Vi: set_dev_entry_from_acpi for devid 0x6e7 flags: 0x0 ext_flags: 0x0 [ 0.009848] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009852] AMD-Vi: set_dev_entry_from_acpi for devid 0x6e8 flags: 0x0 ext_flags: 0x0 [ 0.009855] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009859] AMD-Vi: set_dev_entry_from_acpi for devid 0x6e9 flags: 0x0 ext_flags: 0x0 [ 0.009863] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009867] AMD-Vi: set_dev_entry_from_acpi for devid 0x6ea flags: 0x0 ext_flags: 0x0 [ 0.009870] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009874] AMD-Vi: set_dev_entry_from_acpi for devid 0x6eb flags: 0x0 ext_flags: 0x0 [ 0.009878] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009882] AMD-Vi: set_dev_entry_from_acpi for devid 0x6ec flags: 0x0 ext_flags: 0x0 [ 0.009885] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009889] AMD-Vi: set_dev_entry_from_acpi for devid 0x6ed flags: 0x0 ext_flags: 0x0 [ 0.009893] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009897] AMD-Vi: set_dev_entry_from_acpi for devid 0x6ee flags: 0x0 ext_flags: 0x0 [ 0.009900] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009904] AMD-Vi: set_dev_entry_from_acpi for devid 0x6ef flags: 0x0 ext_flags: 0x0 [ 0.009908] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009912] AMD-Vi: set_dev_entry_from_acpi for devid 0x6f0 flags: 0x0 ext_flags: 0x0 [ 0.009915] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009919] AMD-Vi: set_dev_entry_from_acpi for devid 0x6f1 flags: 0x0 ext_flags: 0x0 [ 0.009923] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009927] AMD-Vi: set_dev_entry_from_acpi for devid 0x6f2 flags: 0x0 ext_flags: 0x0 [ 0.009930] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009934] AMD-Vi: set_dev_entry_from_acpi for devid 0x6f3 flags: 0x0 ext_flags: 0x0 [ 0.009938] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009942] AMD-Vi: set_dev_entry_from_acpi for devid 0x6f4 flags: 0x0 ext_flags: 0x0 [ 0.009945] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009949] AMD-Vi: set_dev_entry_from_acpi for devid 0x6f5 flags: 0x0 ext_flags: 0x0 [ 0.009953] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009956] AMD-Vi: set_dev_entry_from_acpi for devid 0x6f6 flags: 0x0 ext_flags: 0x0 [ 0.009960] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009964] AMD-Vi: set_dev_entry_from_acpi for devid 0x6f7 flags: 0x0 ext_flags: 0x0 [ 0.009968] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009971] AMD-Vi: set_dev_entry_from_acpi for devid 0x6f8 flags: 0x0 ext_flags: 0x0 [ 0.009975] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009979] AMD-Vi: set_dev_entry_from_acpi for devid 0x6f9 flags: 0x0 ext_flags: 0x0 [ 0.009983] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009986] AMD-Vi: set_dev_entry_from_acpi for devid 0x6fa flags: 0x0 ext_flags: 0x0 [ 0.009990] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.009994] AMD-Vi: set_dev_entry_from_acpi for devid 0x6fb flags: 0x0 ext_flags: 0x0 [ 0.009998] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.010001] AMD-Vi: set_dev_entry_from_acpi for devid 0x6fc flags: 0x0 ext_flags: 0x0 [ 0.010005] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.010009] AMD-Vi: set_dev_entry_from_acpi for devid 0x6fd flags: 0x0 ext_flags: 0x0 [ 0.010013] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.010016] AMD-Vi: set_dev_entry_from_acpi for devid 0x6fe flags: 0x0 ext_flags: 0x0 [ 0.010020] AMD-Vi: set_dev_entry_from_acpi for devid 0x600 flags: 0x0 ext_flags: 0x0 [ 0.010024] AMD-Vi: set_dev_entry_from_acpi for devid 0x6ff flags: 0x0 ext_flags: 0x0 [ 0.010028] AMD-Vi: DEV_SELECT devid: 00:0d.0 flags: 00 [ 0.010031] AMD-Vi: set_dev_entry_from_acpi for devid 0x68 flags: 0x0 ext_flags: 0x0 [ 0.010034] AMD-Vi: DEV_SELECT devid: 04:00.0 flags: 00 [ 0.010037] AMD-Vi: set_dev_entry_from_acpi for devid 0x400 flags: 0x0 ext_flags: 0x0 [ 0.010041] AMD-Vi: DEV_SELECT devid: 00:11.0 flags: 00 [ 0.010044] AMD-Vi: set_dev_entry_from_acpi for devid 0x88 flags: 0x0 ext_flags: 0x0 [ 0.010048] AMD-Vi: DEV_SELECT_RANGE_START devid: 00:12.0 flags: 00 [ 0.010051] AMD-Vi: DEV_RANGE_END devid: 00:12.2 [ 0.010054] AMD-Vi: set_dev_entry_from_acpi for devid 0x90 flags: 0x0 ext_flags: 0x0 [ 0.010057] AMD-Vi: set_dev_entry_from_acpi for devid 0x91 flags: 0x0 ext_flags: 0x0 [ 0.010061] AMD-Vi: set_dev_entry_from_acpi for devid 0x92 flags: 0x0 ext_flags: 0x0 [ 0.010065] AMD-Vi: DEV_SELECT_RANGE_START devid: 00:13.0 flags: 00 [ 0.010068] AMD-Vi: DEV_RANGE_END devid: 00:13.2 [ 0.010071] AMD-Vi: set_dev_entry_from_acpi for devid 0x98 flags: 0x0 ext_flags: 0x0 [ 0.010075] AMD-Vi: set_dev_entry_from_acpi for devid 0x99 flags: 0x0 ext_flags: 0x0 [ 0.010078] AMD-Vi: set_dev_entry_from_acpi for devid 0x9a flags: 0x0 ext_flags: 0x0 [ 0.010082] AMD-Vi: DEV_SELECT devid: 00:14.0 flags: d7 [ 0.010085] AMD-Vi: set_dev_entry_from_acpi for devid 0xa0 flags: 0xd7 ext_flags: 0x0 [ 0.010089] AMD-Vi: applying erratum 63 for devid 0xa0 [ 0.010092] AMD-Vi: DEV_SELECT devid: 00:14.3 flags: 00 [ 0.010094] AMD-Vi: set_dev_entry_from_acpi for devid 0xa3 flags: 0x0 ext_flags: 0x0 [ 0.010098] AMD-Vi: DEV_SELECT devid: 00:14.4 flags: 00 [ 0.010101] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010105] AMD-Vi: DEV_ALIAS_RANGE devid: 03:00.0 flags: 00 devid_to: 00:14.4 [ 0.010109] AMD-Vi: DEV_RANGE_END devid: 03:1f.7 [ 0.010112] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010115] AMD-Vi: set_dev_entry_from_acpi for devid 0x300 flags: 0x0 ext_flags: 0x0 [ 0.010119] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010123] AMD-Vi: set_dev_entry_from_acpi for devid 0x301 flags: 0x0 ext_flags: 0x0 [ 0.010127] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010130] AMD-Vi: set_dev_entry_from_acpi for devid 0x302 flags: 0x0 ext_flags: 0x0 [ 0.010134] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010138] AMD-Vi: set_dev_entry_from_acpi for devid 0x303 flags: 0x0 ext_flags: 0x0 [ 0.010142] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010145] AMD-Vi: set_dev_entry_from_acpi for devid 0x304 flags: 0x0 ext_flags: 0x0 [ 0.010149] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010153] AMD-Vi: set_dev_entry_from_acpi for devid 0x305 flags: 0x0 ext_flags: 0x0 [ 0.010156] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010160] AMD-Vi: set_dev_entry_from_acpi for devid 0x306 flags: 0x0 ext_flags: 0x0 [ 0.010164] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010168] AMD-Vi: set_dev_entry_from_acpi for devid 0x307 flags: 0x0 ext_flags: 0x0 [ 0.010171] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010175] AMD-Vi: set_dev_entry_from_acpi for devid 0x308 flags: 0x0 ext_flags: 0x0 [ 0.010179] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010183] AMD-Vi: set_dev_entry_from_acpi for devid 0x309 flags: 0x0 ext_flags: 0x0 [ 0.010186] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010190] AMD-Vi: set_dev_entry_from_acpi for devid 0x30a flags: 0x0 ext_flags: 0x0 [ 0.010194] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010198] AMD-Vi: set_dev_entry_from_acpi for devid 0x30b flags: 0x0 ext_flags: 0x0 [ 0.010201] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010205] AMD-Vi: set_dev_entry_from_acpi for devid 0x30c flags: 0x0 ext_flags: 0x0 [ 0.010209] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010213] AMD-Vi: set_dev_entry_from_acpi for devid 0x30d flags: 0x0 ext_flags: 0x0 [ 0.010216] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010220] AMD-Vi: set_dev_entry_from_acpi for devid 0x30e flags: 0x0 ext_flags: 0x0 [ 0.010224] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010228] AMD-Vi: set_dev_entry_from_acpi for devid 0x30f flags: 0x0 ext_flags: 0x0 [ 0.010232] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010235] AMD-Vi: set_dev_entry_from_acpi for devid 0x310 flags: 0x0 ext_flags: 0x0 [ 0.010239] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010243] AMD-Vi: set_dev_entry_from_acpi for devid 0x311 flags: 0x0 ext_flags: 0x0 [ 0.010247] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010250] AMD-Vi: set_dev_entry_from_acpi for devid 0x312 flags: 0x0 ext_flags: 0x0 [ 0.010254] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010258] AMD-Vi: set_dev_entry_from_acpi for devid 0x313 flags: 0x0 ext_flags: 0x0 [ 0.010262] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010265] AMD-Vi: set_dev_entry_from_acpi for devid 0x314 flags: 0x0 ext_flags: 0x0 [ 0.010269] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010273] AMD-Vi: set_dev_entry_from_acpi for devid 0x315 flags: 0x0 ext_flags: 0x0 [ 0.010277] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010280] AMD-Vi: set_dev_entry_from_acpi for devid 0x316 flags: 0x0 ext_flags: 0x0 [ 0.010284] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010288] AMD-Vi: set_dev_entry_from_acpi for devid 0x317 flags: 0x0 ext_flags: 0x0 [ 0.010292] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010305] AMD-Vi: set_dev_entry_from_acpi for devid 0x318 flags: 0x0 ext_flags: 0x0 [ 0.010309] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010313] AMD-Vi: set_dev_entry_from_acpi for devid 0x319 flags: 0x0 ext_flags: 0x0 [ 0.010316] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010320] AMD-Vi: set_dev_entry_from_acpi for devid 0x31a flags: 0x0 ext_flags: 0x0 [ 0.010324] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010327] AMD-Vi: set_dev_entry_from_acpi for devid 0x31b flags: 0x0 ext_flags: 0x0 [ 0.010331] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010335] AMD-Vi: set_dev_entry_from_acpi for devid 0x31c flags: 0x0 ext_flags: 0x0 [ 0.010339] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010342] AMD-Vi: set_dev_entry_from_acpi for devid 0x31d flags: 0x0 ext_flags: 0x0 [ 0.010346] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010350] AMD-Vi: set_dev_entry_from_acpi for devid 0x31e flags: 0x0 ext_flags: 0x0 [ 0.010354] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010358] AMD-Vi: set_dev_entry_from_acpi for devid 0x31f flags: 0x0 ext_flags: 0x0 [ 0.010361] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010365] AMD-Vi: set_dev_entry_from_acpi for devid 0x320 flags: 0x0 ext_flags: 0x0 [ 0.010369] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010373] AMD-Vi: set_dev_entry_from_acpi for devid 0x321 flags: 0x0 ext_flags: 0x0 [ 0.010376] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010380] AMD-Vi: set_dev_entry_from_acpi for devid 0x322 flags: 0x0 ext_flags: 0x0 [ 0.010384] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010387] AMD-Vi: set_dev_entry_from_acpi for devid 0x323 flags: 0x0 ext_flags: 0x0 [ 0.010391] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010395] AMD-Vi: set_dev_entry_from_acpi for devid 0x324 flags: 0x0 ext_flags: 0x0 [ 0.010399] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010403] AMD-Vi: set_dev_entry_from_acpi for devid 0x325 flags: 0x0 ext_flags: 0x0 [ 0.010406] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010410] AMD-Vi: set_dev_entry_from_acpi for devid 0x326 flags: 0x0 ext_flags: 0x0 [ 0.010414] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010417] AMD-Vi: set_dev_entry_from_acpi for devid 0x327 flags: 0x0 ext_flags: 0x0 [ 0.010421] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010425] AMD-Vi: set_dev_entry_from_acpi for devid 0x328 flags: 0x0 ext_flags: 0x0 [ 0.010429] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010432] AMD-Vi: set_dev_entry_from_acpi for devid 0x329 flags: 0x0 ext_flags: 0x0 [ 0.010436] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010440] AMD-Vi: set_dev_entry_from_acpi for devid 0x32a flags: 0x0 ext_flags: 0x0 [ 0.010444] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010447] AMD-Vi: set_dev_entry_from_acpi for devid 0x32b flags: 0x0 ext_flags: 0x0 [ 0.010451] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010455] AMD-Vi: set_dev_entry_from_acpi for devid 0x32c flags: 0x0 ext_flags: 0x0 [ 0.010459] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010462] AMD-Vi: set_dev_entry_from_acpi for devid 0x32d flags: 0x0 ext_flags: 0x0 [ 0.010466] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010470] AMD-Vi: set_dev_entry_from_acpi for devid 0x32e flags: 0x0 ext_flags: 0x0 [ 0.010474] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010477] AMD-Vi: set_dev_entry_from_acpi for devid 0x32f flags: 0x0 ext_flags: 0x0 [ 0.010481] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010485] AMD-Vi: set_dev_entry_from_acpi for devid 0x330 flags: 0x0 ext_flags: 0x0 [ 0.010489] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010492] AMD-Vi: set_dev_entry_from_acpi for devid 0x331 flags: 0x0 ext_flags: 0x0 [ 0.010496] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010500] AMD-Vi: set_dev_entry_from_acpi for devid 0x332 flags: 0x0 ext_flags: 0x0 [ 0.010504] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010507] AMD-Vi: set_dev_entry_from_acpi for devid 0x333 flags: 0x0 ext_flags: 0x0 [ 0.010511] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010515] AMD-Vi: set_dev_entry_from_acpi for devid 0x334 flags: 0x0 ext_flags: 0x0 [ 0.010519] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010522] AMD-Vi: set_dev_entry_from_acpi for devid 0x335 flags: 0x0 ext_flags: 0x0 [ 0.010526] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010530] AMD-Vi: set_dev_entry_from_acpi for devid 0x336 flags: 0x0 ext_flags: 0x0 [ 0.010534] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010537] AMD-Vi: set_dev_entry_from_acpi for devid 0x337 flags: 0x0 ext_flags: 0x0 [ 0.010541] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010545] AMD-Vi: set_dev_entry_from_acpi for devid 0x338 flags: 0x0 ext_flags: 0x0 [ 0.010549] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010552] AMD-Vi: set_dev_entry_from_acpi for devid 0x339 flags: 0x0 ext_flags: 0x0 [ 0.010556] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010560] AMD-Vi: set_dev_entry_from_acpi for devid 0x33a flags: 0x0 ext_flags: 0x0 [ 0.010564] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010567] AMD-Vi: set_dev_entry_from_acpi for devid 0x33b flags: 0x0 ext_flags: 0x0 [ 0.010571] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010575] AMD-Vi: set_dev_entry_from_acpi for devid 0x33c flags: 0x0 ext_flags: 0x0 [ 0.010579] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010583] AMD-Vi: set_dev_entry_from_acpi for devid 0x33d flags: 0x0 ext_flags: 0x0 [ 0.010586] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010590] AMD-Vi: set_dev_entry_from_acpi for devid 0x33e flags: 0x0 ext_flags: 0x0 [ 0.010594] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010598] AMD-Vi: set_dev_entry_from_acpi for devid 0x33f flags: 0x0 ext_flags: 0x0 [ 0.010601] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010605] AMD-Vi: set_dev_entry_from_acpi for devid 0x340 flags: 0x0 ext_flags: 0x0 [ 0.010609] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010613] AMD-Vi: set_dev_entry_from_acpi for devid 0x341 flags: 0x0 ext_flags: 0x0 [ 0.010616] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010620] AMD-Vi: set_dev_entry_from_acpi for devid 0x342 flags: 0x0 ext_flags: 0x0 [ 0.010624] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010628] AMD-Vi: set_dev_entry_from_acpi for devid 0x343 flags: 0x0 ext_flags: 0x0 [ 0.010631] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010635] AMD-Vi: set_dev_entry_from_acpi for devid 0x344 flags: 0x0 ext_flags: 0x0 [ 0.010639] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010643] AMD-Vi: set_dev_entry_from_acpi for devid 0x345 flags: 0x0 ext_flags: 0x0 [ 0.010646] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010650] AMD-Vi: set_dev_entry_from_acpi for devid 0x346 flags: 0x0 ext_flags: 0x0 [ 0.010654] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010658] AMD-Vi: set_dev_entry_from_acpi for devid 0x347 flags: 0x0 ext_flags: 0x0 [ 0.010661] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010665] AMD-Vi: set_dev_entry_from_acpi for devid 0x348 flags: 0x0 ext_flags: 0x0 [ 0.010669] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010673] AMD-Vi: set_dev_entry_from_acpi for devid 0x349 flags: 0x0 ext_flags: 0x0 [ 0.010676] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010680] AMD-Vi: set_dev_entry_from_acpi for devid 0x34a flags: 0x0 ext_flags: 0x0 [ 0.010684] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010688] AMD-Vi: set_dev_entry_from_acpi for devid 0x34b flags: 0x0 ext_flags: 0x0 [ 0.010691] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010695] AMD-Vi: set_dev_entry_from_acpi for devid 0x34c flags: 0x0 ext_flags: 0x0 [ 0.010699] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010703] AMD-Vi: set_dev_entry_from_acpi for devid 0x34d flags: 0x0 ext_flags: 0x0 [ 0.010706] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010710] AMD-Vi: set_dev_entry_from_acpi for devid 0x34e flags: 0x0 ext_flags: 0x0 [ 0.010714] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010718] AMD-Vi: set_dev_entry_from_acpi for devid 0x34f flags: 0x0 ext_flags: 0x0 [ 0.010721] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010725] AMD-Vi: set_dev_entry_from_acpi for devid 0x350 flags: 0x0 ext_flags: 0x0 [ 0.010729] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010733] AMD-Vi: set_dev_entry_from_acpi for devid 0x351 flags: 0x0 ext_flags: 0x0 [ 0.010736] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010740] AMD-Vi: set_dev_entry_from_acpi for devid 0x352 flags: 0x0 ext_flags: 0x0 [ 0.010744] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010748] AMD-Vi: set_dev_entry_from_acpi for devid 0x353 flags: 0x0 ext_flags: 0x0 [ 0.010751] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010755] AMD-Vi: set_dev_entry_from_acpi for devid 0x354 flags: 0x0 ext_flags: 0x0 [ 0.010759] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010763] AMD-Vi: set_dev_entry_from_acpi for devid 0x355 flags: 0x0 ext_flags: 0x0 [ 0.010766] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010770] AMD-Vi: set_dev_entry_from_acpi for devid 0x356 flags: 0x0 ext_flags: 0x0 [ 0.010774] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010778] AMD-Vi: set_dev_entry_from_acpi for devid 0x357 flags: 0x0 ext_flags: 0x0 [ 0.010781] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010785] AMD-Vi: set_dev_entry_from_acpi for devid 0x358 flags: 0x0 ext_flags: 0x0 [ 0.010789] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010793] AMD-Vi: set_dev_entry_from_acpi for devid 0x359 flags: 0x0 ext_flags: 0x0 [ 0.010796] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010800] AMD-Vi: set_dev_entry_from_acpi for devid 0x35a flags: 0x0 ext_flags: 0x0 [ 0.010804] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010807] AMD-Vi: set_dev_entry_from_acpi for devid 0x35b flags: 0x0 ext_flags: 0x0 [ 0.010811] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010815] AMD-Vi: set_dev_entry_from_acpi for devid 0x35c flags: 0x0 ext_flags: 0x0 [ 0.010819] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010822] AMD-Vi: set_dev_entry_from_acpi for devid 0x35d flags: 0x0 ext_flags: 0x0 [ 0.010826] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010830] AMD-Vi: set_dev_entry_from_acpi for devid 0x35e flags: 0x0 ext_flags: 0x0 [ 0.010834] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010837] AMD-Vi: set_dev_entry_from_acpi for devid 0x35f flags: 0x0 ext_flags: 0x0 [ 0.010841] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010845] AMD-Vi: set_dev_entry_from_acpi for devid 0x360 flags: 0x0 ext_flags: 0x0 [ 0.010849] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010852] AMD-Vi: set_dev_entry_from_acpi for devid 0x361 flags: 0x0 ext_flags: 0x0 [ 0.010856] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010860] AMD-Vi: set_dev_entry_from_acpi for devid 0x362 flags: 0x0 ext_flags: 0x0 [ 0.010864] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010867] AMD-Vi: set_dev_entry_from_acpi for devid 0x363 flags: 0x0 ext_flags: 0x0 [ 0.010871] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010875] AMD-Vi: set_dev_entry_from_acpi for devid 0x364 flags: 0x0 ext_flags: 0x0 [ 0.010879] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010882] AMD-Vi: set_dev_entry_from_acpi for devid 0x365 flags: 0x0 ext_flags: 0x0 [ 0.010886] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010890] AMD-Vi: set_dev_entry_from_acpi for devid 0x366 flags: 0x0 ext_flags: 0x0 [ 0.010894] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010897] AMD-Vi: set_dev_entry_from_acpi for devid 0x367 flags: 0x0 ext_flags: 0x0 [ 0.010901] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010905] AMD-Vi: set_dev_entry_from_acpi for devid 0x368 flags: 0x0 ext_flags: 0x0 [ 0.010909] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010912] AMD-Vi: set_dev_entry_from_acpi for devid 0x369 flags: 0x0 ext_flags: 0x0 [ 0.010916] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010920] AMD-Vi: set_dev_entry_from_acpi for devid 0x36a flags: 0x0 ext_flags: 0x0 [ 0.010924] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010927] AMD-Vi: set_dev_entry_from_acpi for devid 0x36b flags: 0x0 ext_flags: 0x0 [ 0.010931] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010935] AMD-Vi: set_dev_entry_from_acpi for devid 0x36c flags: 0x0 ext_flags: 0x0 [ 0.010939] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010942] AMD-Vi: set_dev_entry_from_acpi for devid 0x36d flags: 0x0 ext_flags: 0x0 [ 0.010946] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010950] AMD-Vi: set_dev_entry_from_acpi for devid 0x36e flags: 0x0 ext_flags: 0x0 [ 0.010954] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010957] AMD-Vi: set_dev_entry_from_acpi for devid 0x36f flags: 0x0 ext_flags: 0x0 [ 0.010961] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010965] AMD-Vi: set_dev_entry_from_acpi for devid 0x370 flags: 0x0 ext_flags: 0x0 [ 0.010969] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010972] AMD-Vi: set_dev_entry_from_acpi for devid 0x371 flags: 0x0 ext_flags: 0x0 [ 0.010976] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010980] AMD-Vi: set_dev_entry_from_acpi for devid 0x372 flags: 0x0 ext_flags: 0x0 [ 0.010984] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010987] AMD-Vi: set_dev_entry_from_acpi for devid 0x373 flags: 0x0 ext_flags: 0x0 [ 0.010991] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.010995] AMD-Vi: set_dev_entry_from_acpi for devid 0x374 flags: 0x0 ext_flags: 0x0 [ 0.010999] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011002] AMD-Vi: set_dev_entry_from_acpi for devid 0x375 flags: 0x0 ext_flags: 0x0 [ 0.011006] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011010] AMD-Vi: set_dev_entry_from_acpi for devid 0x376 flags: 0x0 ext_flags: 0x0 [ 0.011014] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011017] AMD-Vi: set_dev_entry_from_acpi for devid 0x377 flags: 0x0 ext_flags: 0x0 [ 0.011021] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011025] AMD-Vi: set_dev_entry_from_acpi for devid 0x378 flags: 0x0 ext_flags: 0x0 [ 0.011029] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011032] AMD-Vi: set_dev_entry_from_acpi for devid 0x379 flags: 0x0 ext_flags: 0x0 [ 0.011036] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011040] AMD-Vi: set_dev_entry_from_acpi for devid 0x37a flags: 0x0 ext_flags: 0x0 [ 0.011044] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011047] AMD-Vi: set_dev_entry_from_acpi for devid 0x37b flags: 0x0 ext_flags: 0x0 [ 0.011051] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011055] AMD-Vi: set_dev_entry_from_acpi for devid 0x37c flags: 0x0 ext_flags: 0x0 [ 0.011059] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011062] AMD-Vi: set_dev_entry_from_acpi for devid 0x37d flags: 0x0 ext_flags: 0x0 [ 0.011066] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011070] AMD-Vi: set_dev_entry_from_acpi for devid 0x37e flags: 0x0 ext_flags: 0x0 [ 0.011074] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011077] AMD-Vi: set_dev_entry_from_acpi for devid 0x37f flags: 0x0 ext_flags: 0x0 [ 0.011081] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011085] AMD-Vi: set_dev_entry_from_acpi for devid 0x380 flags: 0x0 ext_flags: 0x0 [ 0.011089] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011092] AMD-Vi: set_dev_entry_from_acpi for devid 0x381 flags: 0x0 ext_flags: 0x0 [ 0.011096] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011100] AMD-Vi: set_dev_entry_from_acpi for devid 0x382 flags: 0x0 ext_flags: 0x0 [ 0.011104] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011107] AMD-Vi: set_dev_entry_from_acpi for devid 0x383 flags: 0x0 ext_flags: 0x0 [ 0.011111] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011115] AMD-Vi: set_dev_entry_from_acpi for devid 0x384 flags: 0x0 ext_flags: 0x0 [ 0.011119] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011123] AMD-Vi: set_dev_entry_from_acpi for devid 0x385 flags: 0x0 ext_flags: 0x0 [ 0.011126] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011130] AMD-Vi: set_dev_entry_from_acpi for devid 0x386 flags: 0x0 ext_flags: 0x0 [ 0.011134] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011138] AMD-Vi: set_dev_entry_from_acpi for devid 0x387 flags: 0x0 ext_flags: 0x0 [ 0.011141] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011145] AMD-Vi: set_dev_entry_from_acpi for devid 0x388 flags: 0x0 ext_flags: 0x0 [ 0.011149] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011153] AMD-Vi: set_dev_entry_from_acpi for devid 0x389 flags: 0x0 ext_flags: 0x0 [ 0.011156] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011160] AMD-Vi: set_dev_entry_from_acpi for devid 0x38a flags: 0x0 ext_flags: 0x0 [ 0.011164] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011168] AMD-Vi: set_dev_entry_from_acpi for devid 0x38b flags: 0x0 ext_flags: 0x0 [ 0.011172] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011175] AMD-Vi: set_dev_entry_from_acpi for devid 0x38c flags: 0x0 ext_flags: 0x0 [ 0.011179] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011183] AMD-Vi: set_dev_entry_from_acpi for devid 0x38d flags: 0x0 ext_flags: 0x0 [ 0.011187] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011190] AMD-Vi: set_dev_entry_from_acpi for devid 0x38e flags: 0x0 ext_flags: 0x0 [ 0.011194] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011198] AMD-Vi: set_dev_entry_from_acpi for devid 0x38f flags: 0x0 ext_flags: 0x0 [ 0.011202] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011205] AMD-Vi: set_dev_entry_from_acpi for devid 0x390 flags: 0x0 ext_flags: 0x0 [ 0.011209] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011213] AMD-Vi: set_dev_entry_from_acpi for devid 0x391 flags: 0x0 ext_flags: 0x0 [ 0.011217] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011220] AMD-Vi: set_dev_entry_from_acpi for devid 0x392 flags: 0x0 ext_flags: 0x0 [ 0.011224] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011228] AMD-Vi: set_dev_entry_from_acpi for devid 0x393 flags: 0x0 ext_flags: 0x0 [ 0.011232] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011235] AMD-Vi: set_dev_entry_from_acpi for devid 0x394 flags: 0x0 ext_flags: 0x0 [ 0.011239] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011243] AMD-Vi: set_dev_entry_from_acpi for devid 0x395 flags: 0x0 ext_flags: 0x0 [ 0.011247] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011250] AMD-Vi: set_dev_entry_from_acpi for devid 0x396 flags: 0x0 ext_flags: 0x0 [ 0.011254] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011258] AMD-Vi: set_dev_entry_from_acpi for devid 0x397 flags: 0x0 ext_flags: 0x0 [ 0.011262] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011265] AMD-Vi: set_dev_entry_from_acpi for devid 0x398 flags: 0x0 ext_flags: 0x0 [ 0.011269] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011273] AMD-Vi: set_dev_entry_from_acpi for devid 0x399 flags: 0x0 ext_flags: 0x0 [ 0.011277] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011280] AMD-Vi: set_dev_entry_from_acpi for devid 0x39a flags: 0x0 ext_flags: 0x0 [ 0.011284] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011288] AMD-Vi: set_dev_entry_from_acpi for devid 0x39b flags: 0x0 ext_flags: 0x0 [ 0.011292] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011295] AMD-Vi: set_dev_entry_from_acpi for devid 0x39c flags: 0x0 ext_flags: 0x0 [ 0.011299] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011303] AMD-Vi: set_dev_entry_from_acpi for devid 0x39d flags: 0x0 ext_flags: 0x0 [ 0.011307] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011310] AMD-Vi: set_dev_entry_from_acpi for devid 0x39e flags: 0x0 ext_flags: 0x0 [ 0.011314] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011318] AMD-Vi: set_dev_entry_from_acpi for devid 0x39f flags: 0x0 ext_flags: 0x0 [ 0.011322] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011325] AMD-Vi: set_dev_entry_from_acpi for devid 0x3a0 flags: 0x0 ext_flags: 0x0 [ 0.011329] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011333] AMD-Vi: set_dev_entry_from_acpi for devid 0x3a1 flags: 0x0 ext_flags: 0x0 [ 0.011336] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011340] AMD-Vi: set_dev_entry_from_acpi for devid 0x3a2 flags: 0x0 ext_flags: 0x0 [ 0.011344] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011348] AMD-Vi: set_dev_entry_from_acpi for devid 0x3a3 flags: 0x0 ext_flags: 0x0 [ 0.011351] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011355] AMD-Vi: set_dev_entry_from_acpi for devid 0x3a4 flags: 0x0 ext_flags: 0x0 [ 0.011359] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011363] AMD-Vi: set_dev_entry_from_acpi for devid 0x3a5 flags: 0x0 ext_flags: 0x0 [ 0.011366] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011370] AMD-Vi: set_dev_entry_from_acpi for devid 0x3a6 flags: 0x0 ext_flags: 0x0 [ 0.011374] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011378] AMD-Vi: set_dev_entry_from_acpi for devid 0x3a7 flags: 0x0 ext_flags: 0x0 [ 0.011381] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011385] AMD-Vi: set_dev_entry_from_acpi for devid 0x3a8 flags: 0x0 ext_flags: 0x0 [ 0.011389] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011393] AMD-Vi: set_dev_entry_from_acpi for devid 0x3a9 flags: 0x0 ext_flags: 0x0 [ 0.011396] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011400] AMD-Vi: set_dev_entry_from_acpi for devid 0x3aa flags: 0x0 ext_flags: 0x0 [ 0.011404] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011408] AMD-Vi: set_dev_entry_from_acpi for devid 0x3ab flags: 0x0 ext_flags: 0x0 [ 0.011411] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011415] AMD-Vi: set_dev_entry_from_acpi for devid 0x3ac flags: 0x0 ext_flags: 0x0 [ 0.011419] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011423] AMD-Vi: set_dev_entry_from_acpi for devid 0x3ad flags: 0x0 ext_flags: 0x0 [ 0.011426] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011430] AMD-Vi: set_dev_entry_from_acpi for devid 0x3ae flags: 0x0 ext_flags: 0x0 [ 0.011434] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011438] AMD-Vi: set_dev_entry_from_acpi for devid 0x3af flags: 0x0 ext_flags: 0x0 [ 0.011441] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011445] AMD-Vi: set_dev_entry_from_acpi for devid 0x3b0 flags: 0x0 ext_flags: 0x0 [ 0.011449] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011453] AMD-Vi: set_dev_entry_from_acpi for devid 0x3b1 flags: 0x0 ext_flags: 0x0 [ 0.011456] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011460] AMD-Vi: set_dev_entry_from_acpi for devid 0x3b2 flags: 0x0 ext_flags: 0x0 [ 0.011464] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011468] AMD-Vi: set_dev_entry_from_acpi for devid 0x3b3 flags: 0x0 ext_flags: 0x0 [ 0.011471] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011475] AMD-Vi: set_dev_entry_from_acpi for devid 0x3b4 flags: 0x0 ext_flags: 0x0 [ 0.011479] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011483] AMD-Vi: set_dev_entry_from_acpi for devid 0x3b5 flags: 0x0 ext_flags: 0x0 [ 0.011486] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011490] AMD-Vi: set_dev_entry_from_acpi for devid 0x3b6 flags: 0x0 ext_flags: 0x0 [ 0.011494] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011498] AMD-Vi: set_dev_entry_from_acpi for devid 0x3b7 flags: 0x0 ext_flags: 0x0 [ 0.011501] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011505] AMD-Vi: set_dev_entry_from_acpi for devid 0x3b8 flags: 0x0 ext_flags: 0x0 [ 0.011509] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011513] AMD-Vi: set_dev_entry_from_acpi for devid 0x3b9 flags: 0x0 ext_flags: 0x0 [ 0.011516] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011520] AMD-Vi: set_dev_entry_from_acpi for devid 0x3ba flags: 0x0 ext_flags: 0x0 [ 0.011524] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011528] AMD-Vi: set_dev_entry_from_acpi for devid 0x3bb flags: 0x0 ext_flags: 0x0 [ 0.011531] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011535] AMD-Vi: set_dev_entry_from_acpi for devid 0x3bc flags: 0x0 ext_flags: 0x0 [ 0.011539] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011543] AMD-Vi: set_dev_entry_from_acpi for devid 0x3bd flags: 0x0 ext_flags: 0x0 [ 0.011546] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011550] AMD-Vi: set_dev_entry_from_acpi for devid 0x3be flags: 0x0 ext_flags: 0x0 [ 0.011554] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011558] AMD-Vi: set_dev_entry_from_acpi for devid 0x3bf flags: 0x0 ext_flags: 0x0 [ 0.011561] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011565] AMD-Vi: set_dev_entry_from_acpi for devid 0x3c0 flags: 0x0 ext_flags: 0x0 [ 0.011569] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011572] AMD-Vi: set_dev_entry_from_acpi for devid 0x3c1 flags: 0x0 ext_flags: 0x0 [ 0.011576] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011580] AMD-Vi: set_dev_entry_from_acpi for devid 0x3c2 flags: 0x0 ext_flags: 0x0 [ 0.011584] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011587] AMD-Vi: set_dev_entry_from_acpi for devid 0x3c3 flags: 0x0 ext_flags: 0x0 [ 0.011591] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011595] AMD-Vi: set_dev_entry_from_acpi for devid 0x3c4 flags: 0x0 ext_flags: 0x0 [ 0.011599] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011603] AMD-Vi: set_dev_entry_from_acpi for devid 0x3c5 flags: 0x0 ext_flags: 0x0 [ 0.011606] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011610] AMD-Vi: set_dev_entry_from_acpi for devid 0x3c6 flags: 0x0 ext_flags: 0x0 [ 0.011614] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011618] AMD-Vi: set_dev_entry_from_acpi for devid 0x3c7 flags: 0x0 ext_flags: 0x0 [ 0.011621] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011625] AMD-Vi: set_dev_entry_from_acpi for devid 0x3c8 flags: 0x0 ext_flags: 0x0 [ 0.011629] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011632] AMD-Vi: set_dev_entry_from_acpi for devid 0x3c9 flags: 0x0 ext_flags: 0x0 [ 0.011636] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011640] AMD-Vi: set_dev_entry_from_acpi for devid 0x3ca flags: 0x0 ext_flags: 0x0 [ 0.011644] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011647] AMD-Vi: set_dev_entry_from_acpi for devid 0x3cb flags: 0x0 ext_flags: 0x0 [ 0.011651] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011655] AMD-Vi: set_dev_entry_from_acpi for devid 0x3cc flags: 0x0 ext_flags: 0x0 [ 0.011659] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011662] AMD-Vi: set_dev_entry_from_acpi for devid 0x3cd flags: 0x0 ext_flags: 0x0 [ 0.011666] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011670] AMD-Vi: set_dev_entry_from_acpi for devid 0x3ce flags: 0x0 ext_flags: 0x0 [ 0.011674] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011677] AMD-Vi: set_dev_entry_from_acpi for devid 0x3cf flags: 0x0 ext_flags: 0x0 [ 0.011681] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011685] AMD-Vi: set_dev_entry_from_acpi for devid 0x3d0 flags: 0x0 ext_flags: 0x0 [ 0.011689] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011692] AMD-Vi: set_dev_entry_from_acpi for devid 0x3d1 flags: 0x0 ext_flags: 0x0 [ 0.011696] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011700] AMD-Vi: set_dev_entry_from_acpi for devid 0x3d2 flags: 0x0 ext_flags: 0x0 [ 0.011704] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011707] AMD-Vi: set_dev_entry_from_acpi for devid 0x3d3 flags: 0x0 ext_flags: 0x0 [ 0.011711] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011715] AMD-Vi: set_dev_entry_from_acpi for devid 0x3d4 flags: 0x0 ext_flags: 0x0 [ 0.011719] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011722] AMD-Vi: set_dev_entry_from_acpi for devid 0x3d5 flags: 0x0 ext_flags: 0x0 [ 0.011726] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011730] AMD-Vi: set_dev_entry_from_acpi for devid 0x3d6 flags: 0x0 ext_flags: 0x0 [ 0.011734] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011737] AMD-Vi: set_dev_entry_from_acpi for devid 0x3d7 flags: 0x0 ext_flags: 0x0 [ 0.011741] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011745] AMD-Vi: set_dev_entry_from_acpi for devid 0x3d8 flags: 0x0 ext_flags: 0x0 [ 0.011749] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011752] AMD-Vi: set_dev_entry_from_acpi for devid 0x3d9 flags: 0x0 ext_flags: 0x0 [ 0.011756] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011760] AMD-Vi: set_dev_entry_from_acpi for devid 0x3da flags: 0x0 ext_flags: 0x0 [ 0.011764] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011767] AMD-Vi: set_dev_entry_from_acpi for devid 0x3db flags: 0x0 ext_flags: 0x0 [ 0.011771] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011775] AMD-Vi: set_dev_entry_from_acpi for devid 0x3dc flags: 0x0 ext_flags: 0x0 [ 0.011779] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011782] AMD-Vi: set_dev_entry_from_acpi for devid 0x3dd flags: 0x0 ext_flags: 0x0 [ 0.011786] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011790] AMD-Vi: set_dev_entry_from_acpi for devid 0x3de flags: 0x0 ext_flags: 0x0 [ 0.011794] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011797] AMD-Vi: set_dev_entry_from_acpi for devid 0x3df flags: 0x0 ext_flags: 0x0 [ 0.011801] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011805] AMD-Vi: set_dev_entry_from_acpi for devid 0x3e0 flags: 0x0 ext_flags: 0x0 [ 0.011809] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011812] AMD-Vi: set_dev_entry_from_acpi for devid 0x3e1 flags: 0x0 ext_flags: 0x0 [ 0.011816] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011820] AMD-Vi: set_dev_entry_from_acpi for devid 0x3e2 flags: 0x0 ext_flags: 0x0 [ 0.011824] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011827] AMD-Vi: set_dev_entry_from_acpi for devid 0x3e3 flags: 0x0 ext_flags: 0x0 [ 0.011831] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011835] AMD-Vi: set_dev_entry_from_acpi for devid 0x3e4 flags: 0x0 ext_flags: 0x0 [ 0.011839] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011842] AMD-Vi: set_dev_entry_from_acpi for devid 0x3e5 flags: 0x0 ext_flags: 0x0 [ 0.011846] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011850] AMD-Vi: set_dev_entry_from_acpi for devid 0x3e6 flags: 0x0 ext_flags: 0x0 [ 0.011854] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011857] AMD-Vi: set_dev_entry_from_acpi for devid 0x3e7 flags: 0x0 ext_flags: 0x0 [ 0.011861] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011865] AMD-Vi: set_dev_entry_from_acpi for devid 0x3e8 flags: 0x0 ext_flags: 0x0 [ 0.011869] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011872] AMD-Vi: set_dev_entry_from_acpi for devid 0x3e9 flags: 0x0 ext_flags: 0x0 [ 0.011876] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011880] AMD-Vi: set_dev_entry_from_acpi for devid 0x3ea flags: 0x0 ext_flags: 0x0 [ 0.011884] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011887] AMD-Vi: set_dev_entry_from_acpi for devid 0x3eb flags: 0x0 ext_flags: 0x0 [ 0.011891] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011895] AMD-Vi: set_dev_entry_from_acpi for devid 0x3ec flags: 0x0 ext_flags: 0x0 [ 0.011899] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011902] AMD-Vi: set_dev_entry_from_acpi for devid 0x3ed flags: 0x0 ext_flags: 0x0 [ 0.011906] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011910] AMD-Vi: set_dev_entry_from_acpi for devid 0x3ee flags: 0x0 ext_flags: 0x0 [ 0.011913] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011917] AMD-Vi: set_dev_entry_from_acpi for devid 0x3ef flags: 0x0 ext_flags: 0x0 [ 0.011921] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011925] AMD-Vi: set_dev_entry_from_acpi for devid 0x3f0 flags: 0x0 ext_flags: 0x0 [ 0.011928] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011932] AMD-Vi: set_dev_entry_from_acpi for devid 0x3f1 flags: 0x0 ext_flags: 0x0 [ 0.011936] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011940] AMD-Vi: set_dev_entry_from_acpi for devid 0x3f2 flags: 0x0 ext_flags: 0x0 [ 0.011944] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011947] AMD-Vi: set_dev_entry_from_acpi for devid 0x3f3 flags: 0x0 ext_flags: 0x0 [ 0.011951] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011955] AMD-Vi: set_dev_entry_from_acpi for devid 0x3f4 flags: 0x0 ext_flags: 0x0 [ 0.011959] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011962] AMD-Vi: set_dev_entry_from_acpi for devid 0x3f5 flags: 0x0 ext_flags: 0x0 [ 0.011966] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011970] AMD-Vi: set_dev_entry_from_acpi for devid 0x3f6 flags: 0x0 ext_flags: 0x0 [ 0.011974] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011977] AMD-Vi: set_dev_entry_from_acpi for devid 0x3f7 flags: 0x0 ext_flags: 0x0 [ 0.011981] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011985] AMD-Vi: set_dev_entry_from_acpi for devid 0x3f8 flags: 0x0 ext_flags: 0x0 [ 0.011988] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.011992] AMD-Vi: set_dev_entry_from_acpi for devid 0x3f9 flags: 0x0 ext_flags: 0x0 [ 0.011996] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.012000] AMD-Vi: set_dev_entry_from_acpi for devid 0x3fa flags: 0x0 ext_flags: 0x0 [ 0.012003] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.012007] AMD-Vi: set_dev_entry_from_acpi for devid 0x3fb flags: 0x0 ext_flags: 0x0 [ 0.012011] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.012015] AMD-Vi: set_dev_entry_from_acpi for devid 0x3fc flags: 0x0 ext_flags: 0x0 [ 0.012018] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.012022] AMD-Vi: set_dev_entry_from_acpi for devid 0x3fd flags: 0x0 ext_flags: 0x0 [ 0.012026] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.012030] AMD-Vi: set_dev_entry_from_acpi for devid 0x3fe flags: 0x0 ext_flags: 0x0 [ 0.012033] AMD-Vi: set_dev_entry_from_acpi for devid 0xa4 flags: 0x0 ext_flags: 0x0 [ 0.012037] AMD-Vi: set_dev_entry_from_acpi for devid 0x3ff flags: 0x0 ext_flags: 0x0 [ 0.012041] AMD-Vi: DEV_SELECT devid: 00:14.5 flags: 00 [ 0.012044] AMD-Vi: set_dev_entry_from_acpi for devid 0xa5 flags: 0x0 ext_flags: 0x0 [ 0.012048] AMD-Vi: DEV_SELECT devid: 00:15.0 flags: 00 [ 0.012051] AMD-Vi: set_dev_entry_from_acpi for devid 0xa8 flags: 0x0 ext_flags: 0x0 [ 0.012054] AMD-Vi: DEV_SELECT devid: 00:15.1 flags: 00 [ 0.012057] AMD-Vi: set_dev_entry_from_acpi for devid 0xa9 flags: 0x0 ext_flags: 0x0 [ 0.012061] AMD-Vi: DEV_SELECT devid: 01:00.0 flags: 00 [ 0.012064] AMD-Vi: set_dev_entry_from_acpi for devid 0x100 flags: 0x0 ext_flags: 0x0 [ 0.012068] AMD-Vi: DEV_SELECT_RANGE_START devid: 00:16.0 flags: 00 [ 0.012071] AMD-Vi: DEV_RANGE_END devid: 00:16.2 [ 0.012074] AMD-Vi: set_dev_entry_from_acpi for devid 0xb0 flags: 0x0 ext_flags: 0x0 [ 0.012077] AMD-Vi: set_dev_entry_from_acpi for devid 0xb1 flags: 0x0 ext_flags: 0x0 [ 0.012081] AMD-Vi: set_dev_entry_from_acpi for devid 0xb2 flags: 0x0 ext_flags: 0x0 [ 0.012085] AMD-Vi: DEV_SPECIAL(HPET[0]) devid: 00:14.0 [ 0.012088] AMD-Vi: set_dev_entry_from_acpi for devid 0xa0 flags: 0xd7 ext_flags: 0x0 [ 0.012092] AMD-Vi: applying erratum 63 for devid 0xa0 [ 0.012095] AMD-Vi: add_special_device for HPET id 0 devid 0xa0 [ 0.012098] AMD-Vi: DEV_SPECIAL(IOAPIC[7]) devid: 00:00.1 [ 0.012101] AMD-Vi: set_dev_entry_from_acpi for devid 0x1 flags: 0x0 ext_flags: 0x0 [ 0.012104] AMD-Vi: add_special_device for IOAPIC id 7 devid 0x1 [ 0.012108] AMD-Vi: IOAPIC[6] in IVRS table with devid:160 [ 0.012111] AMD-Vi: IOAPIC[7] in IVRS table with devid:1> Jan
Jan Beulich
2013-Aug-26 06:59 UTC
Re: [xen-unstable] Commit 2ca9fbd739b8a72b16dd790d0fff7b75f5488fb8 AMD IOMMU: allocate IRTE entries instead of using a static mapping, makes dom0 boot process stall several times.
>>> On 23.08.13 at 17:29, Sander Eikelenboom <linux@eikelenboom.it> wrote: > (XEN) [2013-08-23 15:22:50] 0000:00:14:0: > (XEN) [2013-08-23 15:22:50] IRTE[000] 00a80445 > (XEN) [2013-08-23 15:22:50] IRTE[001] 00f00145 > (XEN) [2013-08-23 15:22:50] IRTE[002] 00380145 > (XEN) [2013-08-23 15:22:50] IRTE[003] 00f10145 > (XEN) [2013-08-23 15:22:50] IRTE[004] 00400145 > (XEN) [2013-08-23 15:22:50] IRTE[005] 00480145 > (XEN) [2013-08-23 15:22:50] IRTE[006] 00500145 > (XEN) [2013-08-23 15:22:50] IRTE[007] 00580145 > (XEN) [2013-08-23 15:22:50] IRTE[008] 00680145 > (XEN) [2013-08-23 15:22:50] IRTE[009] 00700145 > (XEN) [2013-08-23 15:22:50] IRTE[00a] 00780145 > (XEN) [2013-08-23 15:22:50] IRTE[00b] 00883f45 > (XEN) [2013-08-23 15:22:50] IRTE[00c] 00900145 > (XEN) [2013-08-23 15:22:50] IRTE[00d] 00980145 > (XEN) [2013-08-23 15:22:50] IRTE[00e] 00600141 > (XEN) [2013-08-23 15:22:50] IRTE[00f] 00210141 > (XEN) [2013-08-23 15:22:50] IRTE[010] 00d80141The use on only entry 0 here made clear that this was a really trivial oversight of the original patch. Please try the additional change below. It also alters a bogus comparison in the original code (note the extra ! in (!msi_desc->hpet_id != hpet_sbdf.id)) - I can''t see why it would have been coded that way, but double checking the output with "iommu=debug" for the absence of the respective message would be very helpful. Jan --- a/xen/drivers/passthrough/amd/iommu_intr.c +++ b/xen/drivers/passthrough/amd/iommu_intr.c @@ -595,14 +595,31 @@ void* __init amd_iommu_alloc_intremap_ta int __init amd_setup_hpet_msi(struct msi_desc *msi_desc) { - if ( (!msi_desc->hpet_id != hpet_sbdf.id) || - (hpet_sbdf.iommu == NULL) ) + spinlock_t *lock; + unsigned long flags; + int rc = 0; + + if ( msi_desc->hpet_id != hpet_sbdf.id || !hpet_sbdf.iommu ) { - AMD_IOMMU_DEBUG("Fail to setup HPET MSI remapping\n"); - return 1; + AMD_IOMMU_DEBUG("Failed to setup HPET MSI remapping: %s\n", + hpet_sbdf.iommu ? "Wrong HPET" : "No IOMMU"); + return -ENODEV; } - return 0; + lock = get_intremap_lock(hpet_sbdf.seg, hpet_sbdf.bdf); + spin_lock_irqsave(lock, flags); + + msi_desc->remap_index = alloc_intremap_entry(hpet_sbdf.seg, + hpet_sbdf.bdf, 1); + if ( msi_desc->remap_index >= INTREMAP_ENTRIES ) + { + msi_desc->remap_index = -1; + rc = -ENXIO; + } + + spin_unlock_irqrestore(lock, flags); + + return rc; } static void dump_intremap_table(const u32 *table)
Sander Eikelenboom
2013-Aug-26 09:51 UTC
Re: [xen-unstable] Commit 2ca9fbd739b8a72b16dd790d0fff7b75f5488fb8 AMD IOMMU: allocate IRTE entries instead of using a static mapping, makes dom0 boot process stall several times.
Monday, August 26, 2013, 8:59:24 AM, you wrote:>>>> On 23.08.13 at 17:29, Sander Eikelenboom <linux@eikelenboom.it> wrote: >> (XEN) [2013-08-23 15:22:50] 0000:00:14:0: >> (XEN) [2013-08-23 15:22:50] IRTE[000] 00a80445 >> (XEN) [2013-08-23 15:22:50] IRTE[001] 00f00145 >> (XEN) [2013-08-23 15:22:50] IRTE[002] 00380145 >> (XEN) [2013-08-23 15:22:50] IRTE[003] 00f10145 >> (XEN) [2013-08-23 15:22:50] IRTE[004] 00400145 >> (XEN) [2013-08-23 15:22:50] IRTE[005] 00480145 >> (XEN) [2013-08-23 15:22:50] IRTE[006] 00500145 >> (XEN) [2013-08-23 15:22:50] IRTE[007] 00580145 >> (XEN) [2013-08-23 15:22:50] IRTE[008] 00680145 >> (XEN) [2013-08-23 15:22:50] IRTE[009] 00700145 >> (XEN) [2013-08-23 15:22:50] IRTE[00a] 00780145 >> (XEN) [2013-08-23 15:22:50] IRTE[00b] 00883f45 >> (XEN) [2013-08-23 15:22:50] IRTE[00c] 00900145 >> (XEN) [2013-08-23 15:22:50] IRTE[00d] 00980145 >> (XEN) [2013-08-23 15:22:50] IRTE[00e] 00600141 >> (XEN) [2013-08-23 15:22:50] IRTE[00f] 00210141 >> (XEN) [2013-08-23 15:22:50] IRTE[010] 00d80141> The use on only entry 0 here made clear that this was a really trivial > oversight of the original patch. Please try the additional change > below.> It also alters a bogus comparison in the original code (note the > extra ! in (!msi_desc->hpet_id != hpet_sbdf.id)) - I can''t see why > it would have been coded that way, but double checking the > output with "iommu=debug" for the absence of the respective > message would be very helpful.Hi Jan, With the patch below i end up with: (XEN) [2013-08-26 09:42:53] AMD-Vi: Failed to setup HPET MSI remapping: Wrong HPET msi_desc->hpet_id: 0x2 hpet_sbdf.id: 0 (XEN) [2013-08-26 09:42:53] AMD-Vi: Failed to setup HPET MSI remapping: Wrong HPET msi_desc->hpet_id: 0x2 hpet_sbdf.id: 0 (XEN) [2013-08-26 09:42:53] AMD-Vi: Failed to setup HPET MSI remapping: Wrong HPET msi_desc->hpet_id: 0x2 hpet_sbdf.id: 0 Complete serial.log attached -- Sander> Jan> --- a/xen/drivers/passthrough/amd/iommu_intr.c > +++ b/xen/drivers/passthrough/amd/iommu_intr.c > @@ -595,14 +595,31 @@ void* __init amd_iommu_alloc_intremap_ta > > int __init amd_setup_hpet_msi(struct msi_desc *msi_desc) > { > - if ( (!msi_desc->hpet_id != hpet_sbdf.id) || > - (hpet_sbdf.iommu == NULL) ) > + spinlock_t *lock; > + unsigned long flags; > + int rc = 0; > ++ if ( msi_desc->>hpet_id != hpet_sbdf.id || !hpet_sbdf.iommu )> { > - AMD_IOMMU_DEBUG("Fail to setup HPET MSI remapping\n"); > - return 1; > + AMD_IOMMU_DEBUG("Failed to setup HPET MSI remapping: %s\n", > + hpet_sbdf.iommu ? "Wrong HPET" : "No IOMMU"); > + return -ENODEV; > } > > - return 0; > + lock = get_intremap_lock(hpet_sbdf.seg, hpet_sbdf.bdf); > + spin_lock_irqsave(lock, flags); > ++ msi_desc->>remap_index = alloc_intremap_entry(hpet_sbdf.seg,> + hpet_sbdf.bdf, 1);+ if ( msi_desc->>remap_index >= INTREMAP_ENTRIES )> + {+ msi_desc->>remap_index = -1;> + rc = -ENXIO; > + } > + > + spin_unlock_irqrestore(lock, flags); > + > + return rc; > } > > static void dump_intremap_table(const u32 *table)_______________________________________________ Xen-devel mailing list Xen-devel@lists.xen.org http://lists.xen.org/xen-devel
Jan Beulich
2013-Aug-26 10:33 UTC
Re: [xen-unstable] Commit 2ca9fbd739b8a72b16dd790d0fff7b75f5488fb8 AMD IOMMU: allocate IRTE entries instead of using a static mapping, makes dom0 boot process stall several times.
>>> On 26.08.13 at 11:51, Sander Eikelenboom <linux@eikelenboom.it> wrote: > Monday, August 26, 2013, 8:59:24 AM, you wrote: >> It also alters a bogus comparison in the original code (note the >> extra ! in (!msi_desc->hpet_id != hpet_sbdf.id)) - I can''t see why >> it would have been coded that way, but double checking the >> output with "iommu=debug" for the absence of the respective >> message would be very helpful. > > With the patch below i end up with: > > (XEN) [2013-08-26 09:42:53] AMD-Vi: Failed to setup HPET MSI remapping: Wrong > HPET msi_desc->hpet_id: 0x2 hpet_sbdf.id: 0 > (XEN) [2013-08-26 09:42:53] AMD-Vi: Failed to setup HPET MSI remapping: Wrong > HPET msi_desc->hpet_id: 0x2 hpet_sbdf.id: 0 > (XEN) [2013-08-26 09:42:53] AMD-Vi: Failed to setup HPET MSI remapping: Wrong > HPET msi_desc->hpet_id: 0x2 hpet_sbdf.id: 0So that''s exactly the bogus comparison mentioned above. And you say that you do have working HPET MSI on the native kernel, without any extra overrides? I ask because I don''t see any workarounds for apparently broken firmware like here... To be sure it''s the firmware, could you - send the dump of the ACPI HPET table - try restoring the bogus "!" Jan
Sander Eikelenboom
2013-Aug-26 11:07 UTC
Re: [xen-unstable] Commit 2ca9fbd739b8a72b16dd790d0fff7b75f5488fb8 AMD IOMMU: allocate IRTE entries instead of using a static mapping, makes dom0 boot process stall several times.
Monday, August 26, 2013, 12:33:16 PM, you wrote:>>>> On 26.08.13 at 11:51, Sander Eikelenboom <linux@eikelenboom.it> wrote: >> Monday, August 26, 2013, 8:59:24 AM, you wrote: >>> It also alters a bogus comparison in the original code (note the >>> extra ! in (!msi_desc->hpet_id != hpet_sbdf.id)) - I can''t see why >>> it would have been coded that way, but double checking the >>> output with "iommu=debug" for the absence of the respective >>> message would be very helpful. >> >> With the patch below i end up with: >> >> (XEN) [2013-08-26 09:42:53] AMD-Vi: Failed to setup HPET MSI remapping: Wrong >> HPET msi_desc->hpet_id: 0x2 hpet_sbdf.id: 0 >> (XEN) [2013-08-26 09:42:53] AMD-Vi: Failed to setup HPET MSI remapping: Wrong >> HPET msi_desc->hpet_id: 0x2 hpet_sbdf.id: 0 >> (XEN) [2013-08-26 09:42:53] AMD-Vi: Failed to setup HPET MSI remapping: Wrong >> HPET msi_desc->hpet_id: 0x2 hpet_sbdf.id: 0> So that''s exactly the bogus comparison mentioned above. And > you say that you do have working HPET MSI on the native kernel, > without any extra overrides? I ask because I don''t see any > workarounds for apparently broken firmware like here...Don''t know that for sure, will check if there are any related messages in dmesg I only see it enabling HPET, but i don''t see anything about MSI .. I now did spot a message about a erratum 400 related to the idle routine that perhaps could be of interest. The commit message here https://lkml.org/lkml/2011/5/5/381 seems to quite accurately describe what i''m seeing. So i see at least 2 errata that are probably not in Xen, 63 and 400. And it seems to limit to 1 cstate ... [ 0.000000] ACPI: HPET id: 0x8300 base: 0xfed00000 ... [ 0.000000] hpet clockevent registered [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.003333] tsc: Detected 3199.896 MHz processor [ 0.000003] Calibrating delay loop (skipped), value calculated using timer frequency.. 6402.45 BogoMIPS (lpj=10666320) [ 0.000009] pid_max: default: 32768 minimum: 301 ... [ 0.001277] process: using AMD E400 aware idle routine ... [ 0.012104] AMD-Vi: DEV_SPECIAL(HPET[0]) devid: 00:14.0 [ 0.012107] AMD-Vi: set_dev_entry_from_acpi for devid 0xa0 flags: 0xd7 ext_flags: 0x0 [ 0.012110] AMD-Vi: applying erratum 63 for devid 0xa0 [ 0.012113] AMD-Vi: add_special_device for HPET id 0 devid 0xa0 ... [ 0.114136] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 ... [ 0.253795] process: System has AMD C1E enabled ... [ 0.253808] process: Switch to broadcast mode on CPU0 ... [ 0.310865] process: Switch to broadcast mode on CPU1 ... [ 0.330650] process: Switch to broadcast mode on CPU2 ... [ 0.350680] process: Switch to broadcast mode on CPU3 ... [ 0.370778] process: Switch to broadcast mode on CPU4 ... [ 0.390822] process: Switch to broadcast mode on CPU5 ... [ 0.770940] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 [ 0.770946] hpet0: 3 comparators, 32-bit 14.318180 MHz counter [ 0.774014] Switching to clocksource hpet [ 3.882637] rtc_cmos 00:03: alarms up to one month, y3k, 114 bytes nvram, hpet irqs ... [ 2.088031] ACPI: processor limited to max C-state 1 complete dmesg from baremetal attached. -- Sander> To be sure it''s the firmware, could you > - send the dump of the ACPI HPET table > - try restoring the bogus "!"> Jan_______________________________________________ Xen-devel mailing list Xen-devel@lists.xen.org http://lists.xen.org/xen-devel
Sander Eikelenboom
2013-Aug-26 11:21 UTC
Re: [xen-unstable] Commit 2ca9fbd739b8a72b16dd790d0fff7b75f5488fb8 AMD IOMMU: allocate IRTE entries instead of using a static mapping, makes dom0 boot process stall several times.
Monday, August 26, 2013, 12:33:16 PM, you wrote:>>>> On 26.08.13 at 11:51, Sander Eikelenboom <linux@eikelenboom.it> wrote: >> Monday, August 26, 2013, 8:59:24 AM, you wrote: >>> It also alters a bogus comparison in the original code (note the >>> extra ! in (!msi_desc->hpet_id != hpet_sbdf.id)) - I can''t see why >>> it would have been coded that way, but double checking the >>> output with "iommu=debug" for the absence of the respective >>> message would be very helpful. >> >> With the patch below i end up with: >> >> (XEN) [2013-08-26 09:42:53] AMD-Vi: Failed to setup HPET MSI remapping: Wrong >> HPET msi_desc->hpet_id: 0x2 hpet_sbdf.id: 0 >> (XEN) [2013-08-26 09:42:53] AMD-Vi: Failed to setup HPET MSI remapping: Wrong >> HPET msi_desc->hpet_id: 0x2 hpet_sbdf.id: 0 >> (XEN) [2013-08-26 09:42:53] AMD-Vi: Failed to setup HPET MSI remapping: Wrong >> HPET msi_desc->hpet_id: 0x2 hpet_sbdf.id: 0> So that''s exactly the bogus comparison mentioned above. And > you say that you do have working HPET MSI on the native kernel, > without any extra overrides? I ask because I don''t see any > workarounds for apparently broken firmware like here...> To be sure it''s the firmware, could you > - send the dump of the ACPI HPET table > - try restoring the bogus "!"acpidump attached .. xl-dmesg attached .. And restoring the bogus "!", makes the stalls go away .. So it seems your fix is ok, but it was bailing out on another firmware glitch previous masked ?> Jan_______________________________________________ Xen-devel mailing list Xen-devel@lists.xen.org http://lists.xen.org/xen-devel
Jan Beulich
2013-Aug-26 11:23 UTC
Re: [xen-unstable] Commit 2ca9fbd739b8a72b16dd790d0fff7b75f5488fb8 AMD IOMMU: allocate IRTE entries instead of using a static mapping, makes dom0 boot process stall several times.
>>> On 26.08.13 at 13:07, Sander Eikelenboom <linux@eikelenboom.it> wrote: > Don''t know that for sure, will check if there are any related messages in > dmesg > I only see it enabling HPET, but i don''t see anything about MSI ..The primary indicator, if I''m not mistaken, would be 3 IRQs in /proc/interrupts that show type HPET_MSI (and I suspect you don''t see any).> And it seems to limit to 1 cstate ...With that, the absence of the entries above may not mean much. Jan
Jan Beulich
2013-Aug-26 11:25 UTC
Re: [xen-unstable] Commit 2ca9fbd739b8a72b16dd790d0fff7b75f5488fb8 AMD IOMMU: allocate IRTE entries instead of using a static mapping, makes dom0 boot process stall several times.
>>> On 26.08.13 at 13:21, Sander Eikelenboom <linux@eikelenboom.it> wrote: > Monday, August 26, 2013, 12:33:16 PM, you wrote: >> To be sure it''s the firmware, could you >> - send the dump of the ACPI HPET table >> - try restoring the bogus "!" > > acpidump attached .. > xl-dmesg attached .. > > And restoring the bogus "!", makes the stalls go away .. > So it seems your fix is ok, but it was bailing out on another firmware > glitch previous masked ?Right, that''s what it looks like. Sadly the author of that code isn''t working on Xen anymore. Suravee, do you have any insight here? Jan
Jan Beulich
2013-Aug-26 11:29 UTC
Re: [xen-unstable] Commit 2ca9fbd739b8a72b16dd790d0fff7b75f5488fb8 AMD IOMMU: allocate IRTE entries instead of using a static mapping, makes dom0 boot process stall several times.
>>> On 26.08.13 at 13:21, Sander Eikelenboom <linux@eikelenboom.it> wrote:> Monday, August 26, 2013, 12:33:16 PM, you wrote: > >>>>> On 26.08.13 at 11:51, Sander Eikelenboom <linux@eikelenboom.it> wrote: >>> Monday, August 26, 2013, 8:59:24 AM, you wrote: >>>> It also alters a bogus comparison in the original code (note the >>>> extra ! in (!msi_desc->hpet_id != hpet_sbdf.id)) - I can''t see why >>>> it would have been coded that way, but double checking the >>>> output with "iommu=debug" for the absence of the respective >>>> message would be very helpful. >>> >>> With the patch below i end up with: >>> >>> (XEN) [2013-08-26 09:42:53] AMD-Vi: Failed to setup HPET MSI remapping: Wrong >>> HPET msi_desc->hpet_id: 0x2 hpet_sbdf.id: 0 >>> (XEN) [2013-08-26 09:42:53] AMD-Vi: Failed to setup HPET MSI remapping: Wrong >>> HPET msi_desc->hpet_id: 0x2 hpet_sbdf.id: 0 >>> (XEN) [2013-08-26 09:42:53] AMD-Vi: Failed to setup HPET MSI remapping: Wrong >>> HPET msi_desc->hpet_id: 0x2 hpet_sbdf.id: 0 > >> So that''s exactly the bogus comparison mentioned above. And >> you say that you do have working HPET MSI on the native kernel, >> without any extra overrides? I ask because I don''t see any >> workarounds for apparently broken firmware like here... > >> To be sure it''s the firmware, could you >> - send the dump of the ACPI HPET table >> - try restoring the bogus "!" > > acpidump attached ..So as already suspected HPET and IVRS tables conflict with one another in the IDs used for the (apparently) single HPET in the system. Jan
Sander Eikelenboom
2013-Aug-26 11:36 UTC
Re: [xen-unstable] Commit 2ca9fbd739b8a72b16dd790d0fff7b75f5488fb8 AMD IOMMU: allocate IRTE entries instead of using a static mapping, makes dom0 boot process stall several times.
Monday, August 26, 2013, 1:29:12 PM, you wrote:>>>> On 26.08.13 at 13:21, Sander Eikelenboom <linux@eikelenboom.it> wrote:>> Monday, August 26, 2013, 12:33:16 PM, you wrote: >> >>>>>> On 26.08.13 at 11:51, Sander Eikelenboom <linux@eikelenboom.it> wrote: >>>> Monday, August 26, 2013, 8:59:24 AM, you wrote: >>>>> It also alters a bogus comparison in the original code (note the >>>>> extra ! in (!msi_desc->hpet_id != hpet_sbdf.id)) - I can''t see why >>>>> it would have been coded that way, but double checking the >>>>> output with "iommu=debug" for the absence of the respective >>>>> message would be very helpful. >>>> >>>> With the patch below i end up with: >>>> >>>> (XEN) [2013-08-26 09:42:53] AMD-Vi: Failed to setup HPET MSI remapping: Wrong >>>> HPET msi_desc->hpet_id: 0x2 hpet_sbdf.id: 0 >>>> (XEN) [2013-08-26 09:42:53] AMD-Vi: Failed to setup HPET MSI remapping: Wrong >>>> HPET msi_desc->hpet_id: 0x2 hpet_sbdf.id: 0 >>>> (XEN) [2013-08-26 09:42:53] AMD-Vi: Failed to setup HPET MSI remapping: Wrong >>>> HPET msi_desc->hpet_id: 0x2 hpet_sbdf.id: 0 >> >>> So that''s exactly the bogus comparison mentioned above. And >>> you say that you do have working HPET MSI on the native kernel, >>> without any extra overrides? I ask because I don''t see any >>> workarounds for apparently broken firmware like here... >> >>> To be sure it''s the firmware, could you >>> - send the dump of the ACPI HPET table >>> - try restoring the bogus "!" >> >> acpidump attached ..> So as already suspected HPET and IVRS tables conflict with one > another in the IDs used for the (apparently) single HPET in the > system.Yes that was wat i meant with another firmware glitch, masking the fact that your fix seems actually ok. Will see if i can flash a newer bios. All of them have iommu problems, so i am/was stuck on a very old one that at least semi-works, but perhaps with the new overrides i can get a more recent one to boot and function now. Thx so far ! -- Sander> Jan
Sander Eikelenboom
2013-Aug-26 12:34 UTC
Re: [xen-unstable] Commit 2ca9fbd739b8a72b16dd790d0fff7b75f5488fb8 AMD IOMMU: allocate IRTE entries instead of using a static mapping, makes dom0 boot process stall several times.
Monday, August 26, 2013, 1:23:01 PM, you wrote:>>>> On 26.08.13 at 13:07, Sander Eikelenboom <linux@eikelenboom.it> wrote: >> Don''t know that for sure, will check if there are any related messages in >> dmesg >> I only see it enabling HPET, but i don''t see anything about MSI ..> The primary indicator, if I''m not mistaken, would be 3 IRQs in > /proc/interrupts that show type HPET_MSI (and I suspect you > don''t see any).Ah found out why, another quirk and silently applying: /* * HPET MSI on some boards (ATI SB700/SB800) has side effect on * floppy DMA. Disable HPET MSI on such platforms. * See erratum #27 (Misinterpreted MSI Requests May Result in * Corrupted LPC DMA Data) in AMD Publication #46837, * "SB700 Family Product Errata", Rev. 1.0, March 2010. */ static void force_disable_hpet_msi(struct pci_dev *unused) { hpet_msi_disable = 1; } how many quirks can a machine have ...>> And it seems to limit to 1 cstate ...> With that, the absence of the entries above may not mean much.> Jan
Jan Beulich
2013-Aug-26 14:15 UTC
Re: [xen-unstable] Commit 2ca9fbd739b8a72b16dd790d0fff7b75f5488fb8 AMD IOMMU: allocate IRTE entries instead of using a static mapping, makes dom0 boot process stall several times.
>>> On 26.08.13 at 14:34, Sander Eikelenboom <linux@eikelenboom.it> wrote:> Monday, August 26, 2013, 1:23:01 PM, you wrote: > >>>>> On 26.08.13 at 13:07, Sander Eikelenboom <linux@eikelenboom.it> wrote: >>> Don''t know that for sure, will check if there are any related messages in >>> dmesg >>> I only see it enabling HPET, but i don''t see anything about MSI .. > >> The primary indicator, if I''m not mistaken, would be 3 IRQs in >> /proc/interrupts that show type HPET_MSI (and I suspect you >> don''t see any). > > Ah found out why, another quirk and silently applying: > > /* > * HPET MSI on some boards (ATI SB700/SB800) has side effect on > * floppy DMA. Disable HPET MSI on such platforms. > * See erratum #27 (Misinterpreted MSI Requests May Result in > * Corrupted LPC DMA Data) in AMD Publication #46837, > * "SB700 Family Product Errata", Rev. 1.0, March 2010. > */ > static void force_disable_hpet_msi(struct pci_dev *unused) > { > hpet_msi_disable = 1; > } > > how many quirks can a machine have ...Indeed. In any case - I take this as a sign that I''ll submit the earlier patch as is, without your Tested-by (because you couldn''t really test other than that your box doesn''t stall anymore). Thanks for your patience, Jan
Sander Eikelenboom
2013-Aug-26 14:35 UTC
Re: [xen-unstable] Commit 2ca9fbd739b8a72b16dd790d0fff7b75f5488fb8 AMD IOMMU: allocate IRTE entries instead of using a static mapping, makes dom0 boot process stall several times.
Monday, August 26, 2013, 4:15:10 PM, you wrote:>>>> On 26.08.13 at 14:34, Sander Eikelenboom <linux@eikelenboom.it> wrote:>> Monday, August 26, 2013, 1:23:01 PM, you wrote: >> >>>>>> On 26.08.13 at 13:07, Sander Eikelenboom <linux@eikelenboom.it> wrote: >>>> Don''t know that for sure, will check if there are any related messages in >>>> dmesg >>>> I only see it enabling HPET, but i don''t see anything about MSI .. >> >>> The primary indicator, if I''m not mistaken, would be 3 IRQs in >>> /proc/interrupts that show type HPET_MSI (and I suspect you >>> don''t see any). >> >> Ah found out why, another quirk and silently applying: >> >> /* >> * HPET MSI on some boards (ATI SB700/SB800) has side effect on >> * floppy DMA. Disable HPET MSI on such platforms. >> * See erratum #27 (Misinterpreted MSI Requests May Result in >> * Corrupted LPC DMA Data) in AMD Publication #46837, >> * "SB700 Family Product Errata", Rev. 1.0, March 2010. >> */ >> static void force_disable_hpet_msi(struct pci_dev *unused) >> { >> hpet_msi_disable = 1; >> } >> >> how many quirks can a machine have ...> Indeed.> In any case - I take this as a sign that I''ll submit the earlier > patch as is, without your Tested-by (because you couldn''t > really test other than that your box doesn''t stall anymore).Well my problem of the ACPI table not being correct is perhaps not the major issue but the erratum above probably is .. if wikipedia is not mistaken .. this one seems to be in 3 series of southbridges: HPET operation with MSI causes LPC DMA corruption on devices using LPC DMA (floppy, parallel port, serial port in FIR mode) because MSI requests are misinterpreted as DMA cycles by the broken LPC controller[5] With the 900 series having a nice extra problem with sata and multi msi vectors .. hope linux already has a quirk for that .. with regard to recent changes. http://en.wikipedia.org/wiki/AMD_900_chipset_series http://en.wikipedia.org/wiki/AMD_800_chipset_series http://en.wikipedia.org/wiki/AMD_700_chipset_series Floppy and parallel are probably not the most used devices anymore, serial perhaps, so don''t know if it shouldn''t be disabled altogether on these southbridges. But i assume someone from AMD would be best to comment on that ...> Thanks for your patience, > Jan
Suravee Suthikulpanit
2013-Aug-26 15:10 UTC
Re: [xen-unstable] Commit 2ca9fbd739b8a72b16dd790d0fff7b75f5488fb8 AMD IOMMU: allocate IRTE entries instead of using a static mapping, makes dom0 boot process stall several times.
On 8/23/2013 11:06 AM, Sander Eikelenboom wrote:>> >I''ll have to look deeper, but for the moment I''m trying to implement >> >that IO-APIC/HPET override thing. > Ok thx, would have been nice if Suravee had perhaps indicated it''s existence in Linux ..Sorry for late reply. I have been catching up on this thread. I can also help working on porting this workaround for Xen. Suravee
Jan Beulich
2013-Aug-26 15:33 UTC
Re: [xen-unstable] Commit 2ca9fbd739b8a72b16dd790d0fff7b75f5488fb8 AMD IOMMU: allocate IRTE entries instead of using a static mapping, makes dom0 boot process stall several times.
>>> On 26.08.13 at 17:10, Suravee Suthikulpanit <suravee.suthikulpanit@amd.com> wrote: > On 8/23/2013 11:06 AM, Sander Eikelenboom wrote: >>> >I''ll have to look deeper, but for the moment I''m trying to implement >>> >that IO-APIC/HPET override thing. >> Ok thx, would have been nice if Suravee had perhaps indicated it''s existence > in Linux .. > Sorry for late reply. I have been catching up on this thread. I can > also help working on porting this workaround for Xen.Porting is not needed I guess, as I''m almost done (though other work kept me from finishing this today). Input on the various issues would of course be appreciated, as well as a review of the one patch sent so far. Jan
Suravee Suthikulpanit
2013-Aug-26 15:37 UTC
Re: [xen-unstable] Commit 2ca9fbd739b8a72b16dd790d0fff7b75f5488fb8 AMD IOMMU: allocate IRTE entries instead of using a static mapping, makes dom0 boot process stall several times.
On 8/26/2013 6:36 AM, Sander Eikelenboom wrote:>> >So as already suspected HPET and IVRS tables conflict with one >> >another in the IDs used for the (apparently) single HPET in the >> >system. > Yes that was wat i meant with another firmware glitch, masking the fact that your fix seems actually ok. >I have seen many issues with the IVRS table regarding IOAPIC. This is the first time I see with the HPET, in which case, your patch simply So, my understanding is the patch still does not solve the issue where the IVRS and HPET table has conflicts here. This means we should also have the override mechanism for the HPET entry of the IVRS (i.e. the variety 2 as well)? Suravee
Suravee Suthikulpanit
2013-Aug-26 15:50 UTC
Re: [xen-unstable] Commit 2ca9fbd739b8a72b16dd790d0fff7b75f5488fb8 AMD IOMMU: allocate IRTE entries instead of using a static mapping, makes dom0 boot process stall several times.
On 8/26/2013 10:37 AM, Suravee Suthikulpanit wrote:> On 8/26/2013 6:36 AM, Sander Eikelenboom wrote: >>> >So as already suspected HPET and IVRS tables conflict with one >>> >another in the IDs used for the (apparently) single HPET in the >>> >system. >> Yes that was wat i meant with another firmware glitch, masking the >> fact that your fix seems actually ok. >> > I have seen many issues with the IVRS table regarding IOAPIC. This is > the first time I see with the HPET, in which case, your patch simply > So, my understanding is the patch still does not solve the issue where > the IVRS and HPET table has conflicts here. This means we should also > have the override mechanism for the HPET entry of the IVRS (i.e. the > variety 2 as well)? > > Suravee >Nevermind, there is also the kernel option "ivrs_hpet" for that. Suravee _______________________________________________ Xen-devel mailing list Xen-devel@lists.xen.org http://lists.xen.org/xen-devel
Jan Beulich
2013-Aug-26 15:50 UTC
Re: [xen-unstable] Commit 2ca9fbd739b8a72b16dd790d0fff7b75f5488fb8 AMD IOMMU: allocate IRTE entries instead of using a static mapping, makes dom0 boot process stall several times.
>>> On 26.08.13 at 17:37, Suravee Suthikulpanit <suravee.suthikulpanit@amd.com>wrote:> On 8/26/2013 6:36 AM, Sander Eikelenboom wrote: >>> >So as already suspected HPET and IVRS tables conflict with one >>> >another in the IDs used for the (apparently) single HPET in the >>> >system. >> Yes that was wat i meant with another firmware glitch, masking the fact that > your fix seems actually ok. >> > I have seen many issues with the IVRS table regarding IOAPIC. This is > the first time I see with the HPET, in which case, your patch simply So, > my understanding is the patch still does not solve the issue where the > IVRS and HPET table has conflicts here. This means we should also have > the override mechanism for the HPET entry of the IVRS (i.e. the variety > 2 as well)?Except that the override as is (coming from Linux) won''t help afaict, as it assumes that at least the ID is correct (and uses the ID to associate the rest of the information with the right instance). Let me get finished with the first draft of the ported over workaround (hopefully tomorrow), and then we should discuss if/how to deal with Sander''s problem. But we shouldn''t forget that he already found out that enabling HPET MSI on his system isn''t desirable due to other errata, so in a way I''m inclined to leave this specific unaddressed, thus not risking him to run into further problems (with the patch sent earlier at least the stalls he saw went away, albeit not in the way that was intended to happen). Jan
Sander Eikelenboom
2013-Aug-26 16:19 UTC
Re: [xen-unstable] Commit 2ca9fbd739b8a72b16dd790d0fff7b75f5488fb8 AMD IOMMU: allocate IRTE entries instead of using a static mapping, makes dom0 boot process stall several times.
Monday, August 26, 2013, 5:50:41 PM, you wrote:>>>> On 26.08.13 at 17:37, Suravee Suthikulpanit <suravee.suthikulpanit@amd.com> > wrote: >> On 8/26/2013 6:36 AM, Sander Eikelenboom wrote: >>>> >So as already suspected HPET and IVRS tables conflict with one >>>> >another in the IDs used for the (apparently) single HPET in the >>>> >system. >>> Yes that was wat i meant with another firmware glitch, masking the fact that >> your fix seems actually ok. >>> >> I have seen many issues with the IVRS table regarding IOAPIC. This is >> the first time I see with the HPET, in which case, your patch simply So, >> my understanding is the patch still does not solve the issue where the >> IVRS and HPET table has conflicts here. This means we should also have >> the override mechanism for the HPET entry of the IVRS (i.e. the variety >> 2 as well)?> Except that the override as is (coming from Linux) won''t help afaict, > as it assumes that at least the ID is correct (and uses the ID to > associate the rest of the information with the right instance). Let > me get finished with the first draft of the ported over workaround > (hopefully tomorrow), and then we should discuss if/how to deal > with Sander''s problem. But we shouldn''t forget that he already > found out that enabling HPET MSI on his system isn''t desirable due > to other errata, so in a way I''m inclined to leave this specific > unaddressed, thus not risking him to run into further problems > (with the patch sent earlier at least the stalls he saw went away, > albeit not in the way that was intended to happen).Well i don''t know that for sure, since serial port etc seems to be handelt by a super i/o chip, and not directly by the southbridge ? Running with HPET MSI enabled now for the rest of the today .. serial console enabled .. haven''t seen any other issues so far. Linux seems to also provide a way to not only override these special case faults in these tables, but to even completely overrule complete acpi-tables from initrd. Albeit having it fixed by a bios update would be the best, but MSI seems quite ignorant to requests to fix it. (first it wasn''t supported by the chipset (and hence no bios option even present), then it was supported by the chipset, but not by them since it was a server feature in there mind, and after that a deafening silence) Which is a shame because the board is actually stable and has a nice amount of pci-e slots and a dual nic.> Jan
Jan Beulich
2013-Aug-27 08:00 UTC
[PATCH RFC 0/2] AMD IOMMU: allow command line overrides for broken IVRS tables
1: PCI: centralize parsing of device coordinates in command line options 2: AMD IOMMU: allow command line overrides for broken IVRS tables Signed-off-by: Jan Beulich <jbeulich@suse.com>
Jan Beulich
2013-Aug-27 08:05 UTC
[PATCH RFC 1/2] PCI: centralize parsing of device coordinates in command line options
With yet another case to come in a subsequent patch, it seems time to do this in a single place rather than hand crafting it in various scattered around locations. Signed-off-by: Jan Beulich <jbeulich@suse.com> --- a/xen/drivers/char/ehci-dbgp.c +++ b/xen/drivers/char/ehci-dbgp.c @@ -1482,31 +1482,25 @@ void __init ehci_dbgp_init(void) } else if ( strncmp(opt_dbgp + 4, "@pci", 4) == 0 ) { - unsigned long val = simple_strtoul(opt_dbgp + 8, &e, 16); + unsigned int bus, slot, func; - dbgp->bus = val; - if ( dbgp->bus != val || *e != '':'' ) + e = parse_pci(opt_dbgp + 8, NULL, &bus, &slot, &func); + if ( !e || *e ) return; - val = simple_strtoul(e + 1, &e, 16); - if ( PCI_SLOT(PCI_DEVFN(val, 0)) != val || *e != ''.'' ) - return; - dbgp->slot = val; - - val = simple_strtoul(e + 1, &e, 16); - if ( PCI_FUNC(PCI_DEVFN(0, val)) != val || *e ) - return; - dbgp->func = val; + dbgp->bus = bus; + dbgp->slot = slot; + dbgp->func = func; - if ( !pci_device_detect(0, dbgp->bus, dbgp->slot, dbgp->func) ) + if ( !pci_device_detect(0, bus, slot, func) ) return; - dbgp->cap = __find_dbgp(dbgp->bus, dbgp->slot, dbgp->func); + dbgp->cap = __find_dbgp(bus, slot, func); if ( !dbgp->cap ) return; dbgp_printk("Using EHCI debug port on %02x:%02x.%u\n", - dbgp->bus, dbgp->slot, dbgp->func); + bus, slot, func); } else return; --- a/xen/drivers/char/ns16550.c +++ b/xen/drivers/char/ns16550.c @@ -403,19 +403,6 @@ static int __init parse_parity_char(int return 0; } -static void __init parse_pci_bdf(const char **conf, unsigned int bdf[3]) -{ - bdf[0] = simple_strtoul(*conf, conf, 16); - if ( **conf != '':'' ) - return; - (*conf)++; - bdf[1] = simple_strtoul(*conf, conf, 16); - if ( **conf != ''.'' ) - return; - (*conf)++; - bdf[2] = simple_strtoul(*conf, conf, 16); -} - static int __init check_existence(struct ns16550 *uart) { unsigned char status, scratch, scratch2, scratch3; @@ -593,14 +580,19 @@ static void __init ns16550_parse_port_co if ( *conf == '','' && *++conf != '','' ) { + conf = parse_pci(conf, NULL, &uart->ps_bdf[0], + &uart->ps_bdf[1], &uart->ps_bdf[2]); + if ( !conf ) + PARSE_ERR("Bad port PCI coordinates"); uart->ps_bdf_enable = 1; - parse_pci_bdf(&conf, &uart->ps_bdf[0]); } if ( *conf == '','' && *++conf != '','' ) { + if ( !parse_pci(conf, NULL, &uart->pb_bdf[0], + &uart->pb_bdf[1], &uart->pb_bdf[2]) ) + PARSE_ERR("Bad bridge PCI coordinates"); uart->pb_bdf_enable = 1; - parse_pci_bdf(&conf, &uart->pb_bdf[0]); } config_parsed: --- a/xen/drivers/passthrough/pci.c +++ b/xen/drivers/passthrough/pci.c @@ -127,29 +127,20 @@ static unsigned int nr_phantom_devs; static void __init parse_phantom_dev(char *str) { const char *s = str; + unsigned int seg, bus, slot; struct phantom_dev phantom; if ( !s || !*s || nr_phantom_devs >= ARRAY_SIZE(phantom_devs) ) return; - phantom.seg = simple_strtol(s, &s, 16); - if ( *s != '':'' ) + s = parse_pci(s, &seg, &bus, &slot, NULL); + if ( !s || *s != '','' ) return; - phantom.bus = simple_strtol(s + 1, &s, 16); - if ( *s == '','' ) - { - phantom.slot = phantom.bus; - phantom.bus = phantom.seg; - phantom.seg = 0; - } - else if ( *s == '':'' ) - phantom.slot = simple_strtol(s + 1, &s, 16); - else - return; + phantom.seg = seg; + phantom.bus = bus; + phantom.slot = slot; - if ( *s != '','' ) - return; switch ( phantom.stride = simple_strtol(s + 1, &s, 0) ) { case 1: case 2: case 4: --- a/xen/drivers/pci/pci.c +++ b/xen/drivers/pci/pci.c @@ -4,6 +4,7 @@ * Architecture-independent PCI access functions. */ +#include <xen/init.h> #include <xen/pci.h> #include <xen/pci_regs.h> @@ -102,3 +103,44 @@ int pci_find_ext_capability(int seg, int } return 0; } + +const char *__init parse_pci(const char *s, unsigned int *seg_p, + unsigned int *bus_p, unsigned int *dev_p, + unsigned int *func_p) +{ + unsigned long seg = simple_strtoul(s, &s, 16), bus, dev, func; + + if ( *s != '':'' ) + return NULL; + bus = simple_strtoul(s + 1, &s, 16); + if ( *s == '':'' ) + dev = simple_strtoul(s + 1, &s, 16); + else + { + dev = bus; + bus = seg; + seg = 0; + } + if ( func_p ) + { + if ( *s != ''.'' ) + return NULL; + func = simple_strtoul(s + 1, &s, 0); + } + else + func = 0; + if ( seg != (seg_p ? (u16)seg : 0) || + bus != PCI_BUS(PCI_BDF2(bus, 0)) || + dev != PCI_SLOT(PCI_DEVFN(dev, 0)) || + func != PCI_FUNC(PCI_DEVFN(0, func)) ) + return NULL; + + if ( seg_p ) + *seg_p = seg; + *bus_p = bus; + *dev_p = dev; + if ( func_p ) + *func_p = func; + + return s; +} --- a/xen/include/xen/pci.h +++ b/xen/include/xen/pci.h @@ -139,6 +139,8 @@ int pci_mmcfg_write(unsigned int seg, un int pci_find_cap_offset(u16 seg, u8 bus, u8 dev, u8 func, u8 cap); int pci_find_next_cap(u16 seg, u8 bus, unsigned int devfn, u8 pos, int cap); int pci_find_ext_capability(int seg, int bus, int devfn, int cap); +const char *parse_pci(const char *, unsigned int *seg, unsigned int *bus, + unsigned int *dev, unsigned int *func); struct pirq; int msixtbl_pt_register(struct domain *, struct pirq *, uint64_t gtable); _______________________________________________ Xen-devel mailing list Xen-devel@lists.xen.org http://lists.xen.org/xen-devel
Jan Beulich
2013-Aug-27 08:05 UTC
[PATCH RFC 2/2] AMD IOMMU: allow command line overrides for broken IVRS tables
With there being so many systems with broken ACPI tables, and with it generally being known what''s wrong with those tables, give people a handle to overcome the resulting disabling of their IOMMUs. Inspired by Linux side patches providing similar functionality. TODO: documentation Suggested-by: Sander Eikelenboom <linux@eikelenboom.it> Signed-off-by: Jan Beulich <jbeulich@suse.com> --- a/xen/common/kernel.c +++ b/xen/common/kernel.c @@ -81,9 +81,15 @@ void __init cmdline_parse(const char *cm /* Search for value part of a key=value option. */ optval = strchr(opt, ''=''); if ( optval != NULL ) + { *optval++ = ''\0''; /* nul-terminate the option value */ + q = strpbrk(opt, "([{<"); + } else + { optval = q; /* default option value is empty string */ + q = NULL; + } /* Boolean parameters can be inverted with ''no-'' prefix. */ bool_assert = !!strncmp("no-", optkey, 3); @@ -93,7 +99,17 @@ void __init cmdline_parse(const char *cm for ( param = &__setup_start; param < &__setup_end; param++ ) { if ( strcmp(param->name, optkey) ) + { + if ( param->type == OPT_CUSTOM && q && + strlen(param->name) == q + 1 - opt && + !strncmp(param->name, opt, q + 1 - opt) ) + { + optval[-1] = ''=''; + ((void (*)(const char *))param->var)(q); + optval[-1] = ''\0''; + } continue; + } switch ( param->type ) { --- a/xen/drivers/passthrough/amd/iommu_acpi.c +++ b/xen/drivers/passthrough/amd/iommu_acpi.c @@ -633,6 +633,50 @@ static u16 __init parse_ivhd_device_exte return dev_length; } +static __initdata DECLARE_BITMAP(ioapic_cmdline, ARRAY_SIZE(ioapic_sbdf)); + +static void __init parse_ivrs_ioapic(char *str) +{ + const char *s = str; + unsigned long id; + unsigned int seg, bus, dev, func; + + ASSERT(*s == ''[''); + id = simple_strtoul(s + 1, &s, 0); + if ( id >= ARRAY_SIZE(ioapic_sbdf) || *s != '']'' || *++s != ''='' ) + return; + + s = parse_pci(s + 1, &seg, &bus, &dev, &func); + if ( !s || *s ) + return; + + ioapic_sbdf[id].bdf = PCI_BDF(bus, dev, func); + ioapic_sbdf[id].seg = seg; + __set_bit(id, ioapic_cmdline); +} +custom_param("ivrs_ioapic[", parse_ivrs_ioapic); + +static void __init parse_ivrs_hpet(char *str) +{ + const char *s = str; + unsigned long id; + unsigned int seg, bus, dev, func; + + ASSERT(*s == ''[''); + id = simple_strtoul(s + 1, &s, 0); + if ( id != (typeof(hpet_sbdf.id))id || *s != '']'' || *++s != ''='' ) + return; + + s = parse_pci(s + 1, &seg, &bus, &dev, &func); + if ( !s || *s ) + return; + + hpet_sbdf.bdf = PCI_BDF(bus, dev, func); + hpet_sbdf.seg = seg; + hpet_sbdf.cmdline = 1; +} +custom_param("ivrs_hpet[", parse_ivrs_hpet); + static u16 __init parse_ivhd_device_special( const struct acpi_ivrs_device8c *special, u16 seg, u16 header_length, u16 block_length, struct amd_iommu *iommu) @@ -674,7 +718,17 @@ static u16 __init parse_ivhd_device_spec if ( IO_APIC_ID(apic) != special->handle ) continue; - if ( ioapic_sbdf[special->handle].pin_2_idx ) + if ( special->handle >= ARRAY_SIZE(ioapic_sbdf) ) + { + printk(XENLOG_ERR "IVHD Error: IO-APIC %#x entry beyond bounds\n", + special->handle); + return 0; + } + + if ( test_bit(special->handle, ioapic_cmdline) ) + AMD_IOMMU_DEBUG("IVHD: Command line override present for IO-APIC %#x\n", + special->handle); + else if ( ioapic_sbdf[special->handle].pin_2_idx ) { if ( ioapic_sbdf[special->handle].bdf == bdf && ioapic_sbdf[special->handle].seg == seg ) @@ -717,14 +771,18 @@ static u16 __init parse_ivhd_device_spec break; case ACPI_IVHD_HPET: /* set device id of hpet */ - if ( hpet_sbdf.iommu ) + if ( hpet_sbdf.iommu || + (hpet_sbdf.cmdline && hpet_sbdf.id != special->handle) ) { printk(XENLOG_WARNING "Only one IVHD HPET entry is supported\n"); break; } hpet_sbdf.id = special->handle; - hpet_sbdf.bdf = bdf; - hpet_sbdf.seg = seg; + if ( !hpet_sbdf.cmdline ) + { + hpet_sbdf.bdf = bdf; + hpet_sbdf.seg = seg; + } hpet_sbdf.iommu = iommu; break; default: @@ -935,21 +993,23 @@ static int __init parse_ivrs_table(struc ioapic_sbdf[IO_APIC_ID(apic)].pin_2_idx ) continue; - printk(XENLOG_ERR "IVHD Error: no information for IO-APIC %#x\n", - IO_APIC_ID(apic)); - if ( amd_iommu_perdev_intremap ) - error = -ENXIO; - else + if ( !test_bit(IO_APIC_ID(apic), ioapic_cmdline) ) { - ioapic_sbdf[IO_APIC_ID(apic)].pin_2_idx = xmalloc_array( - u16, nr_ioapic_entries[apic]); - if ( !ioapic_sbdf[IO_APIC_ID(apic)].pin_2_idx ) - { - printk(XENLOG_ERR "IVHD Error: Out of memory\n"); - error = -ENOMEM; - } + printk(XENLOG_ERR "IVHD Error: no information for IO-APIC %#x\n", + IO_APIC_ID(apic)); + if ( amd_iommu_perdev_intremap ) + return -ENXIO; + } + + ioapic_sbdf[IO_APIC_ID(apic)].pin_2_idx = xmalloc_array( + u16, nr_ioapic_entries[apic]); + if ( ioapic_sbdf[IO_APIC_ID(apic)].pin_2_idx ) memset(ioapic_sbdf[IO_APIC_ID(apic)].pin_2_idx, -1, nr_ioapic_entries[apic] * sizeof(*ioapic_sbdf->pin_2_idx)); + else + { + printk(XENLOG_ERR "IVHD Error: Out of memory\n"); + error = -ENOMEM; } } --- a/xen/include/asm-x86/hvm/svm/amd-iommu-proto.h +++ b/xen/include/asm-x86/hvm/svm/amd-iommu-proto.h @@ -108,6 +108,7 @@ extern struct ioapic_sbdf { extern struct hpet_sbdf { u16 bdf, seg, id; + bool_t cmdline; struct amd_iommu *iommu; } hpet_sbdf; _______________________________________________ Xen-devel mailing list Xen-devel@lists.xen.org http://lists.xen.org/xen-devel
Jan Beulich
2013-Aug-27 08:23 UTC
Re: [xen-unstable] Commit 2ca9fbd739b8a72b16dd790d0fff7b75f5488fb8 AMD IOMMU: allocate IRTE entries instead of using a static mapping, makes dom0 boot process stall several times.
>>> On 26.08.13 at 17:50, Suravee Suthikulpanit <suravee.suthikulpanit@amd.com>wrote:> On 8/26/2013 10:37 AM, Suravee Suthikulpanit wrote: >> On 8/26/2013 6:36 AM, Sander Eikelenboom wrote: >>>> >So as already suspected HPET and IVRS tables conflict with one >>>> >another in the IDs used for the (apparently) single HPET in the >>>> >system. >>> Yes that was wat i meant with another firmware glitch, masking the >>> fact that your fix seems actually ok. >>> >> I have seen many issues with the IVRS table regarding IOAPIC. This is >> the first time I see with the HPET, in which case, your patch simply >> So, my understanding is the patch still does not solve the issue where >> the IVRS and HPET table has conflicts here. This means we should also >> have the override mechanism for the HPET entry of the IVRS (i.e. the >> variety 2 as well)? >> > Nevermind, there is also the kernel option "ivrs_hpet" for that.I think I said this before - afaict that command line option is _not_ suitable for Sander''s case. Jan
Sander Eikelenboom
2013-Aug-27 09:52 UTC
Re: [PATCH RFC 2/2] AMD IOMMU: allow command line overrides for broken IVRS tables
Tuesday, August 27, 2013, 10:05:41 AM, you wrote:> With there being so many systems with broken ACPI tables, and with it > generally being known what''s wrong with those tables, give people a > handle to overcome the resulting disabling of their IOMMUs.> Inspired by Linux side patches providing similar functionality.> TODO: documentationHi Jan, Would the syntax be the same as linux ? f.e. ivrs_ioapic[6]=00:14.0 for my case ? I''m asking because using it on the command line seems to enable the iommu fine (which it shouldn''t without the override), but i don''t seem to see the "IVHD: Command line override present for IO-APIC %#x" in my xl dmesg... -- Sander> Suggested-by: Sander Eikelenboom <linux@eikelenboom.it> > Signed-off-by: Jan Beulich <jbeulich@suse.com>> --- a/xen/common/kernel.c > +++ b/xen/common/kernel.c > @@ -81,9 +81,15 @@ void __init cmdline_parse(const char *cm > /* Search for value part of a key=value option. */ > optval = strchr(opt, ''=''); > if ( optval != NULL ) > + { > *optval++ = ''\0''; /* nul-terminate the option value */ > + q = strpbrk(opt, "([{<"); > + } > else > + { > optval = q; /* default option value is empty string */ > + q = NULL; > + } > > /* Boolean parameters can be inverted with ''no-'' prefix. */ > bool_assert = !!strncmp("no-", optkey, 3); > @@ -93,7 +99,17 @@ void __init cmdline_parse(const char *cm > for ( param = &__setup_start; param < &__setup_end; param++ ) > { > if ( strcmp(param->name, optkey) ) > + { > + if ( param->type == OPT_CUSTOM && q && > + strlen(param->name) == q + 1 - opt && > + !strncmp(param->name, opt, q + 1 - opt) ) > + { > + optval[-1] = ''=''; > + ((void (*)(const char *))param->var)(q); > + optval[-1] = ''\0''; > + } > continue; > + } > > switch ( param->type ) > { > --- a/xen/drivers/passthrough/amd/iommu_acpi.c > +++ b/xen/drivers/passthrough/amd/iommu_acpi.c > @@ -633,6 +633,50 @@ static u16 __init parse_ivhd_device_exte > return dev_length; > } > > +static __initdata DECLARE_BITMAP(ioapic_cmdline, ARRAY_SIZE(ioapic_sbdf)); > + > +static void __init parse_ivrs_ioapic(char *str) > +{ > + const char *s = str; > + unsigned long id; > + unsigned int seg, bus, dev, func; > + > + ASSERT(*s == ''[''); > + id = simple_strtoul(s + 1, &s, 0);+ if ( id >>= ARRAY_SIZE(ioapic_sbdf) || *s != '']'' || *++s != ''='' )> + return; > + > + s = parse_pci(s + 1, &seg, &bus, &dev, &func); > + if ( !s || *s ) > + return; > + > + ioapic_sbdf[id].bdf = PCI_BDF(bus, dev, func); > + ioapic_sbdf[id].seg = seg; > + __set_bit(id, ioapic_cmdline); > +} > +custom_param("ivrs_ioapic[", parse_ivrs_ioapic); > + > +static void __init parse_ivrs_hpet(char *str) > +{ > + const char *s = str; > + unsigned long id; > + unsigned int seg, bus, dev, func; > + > + ASSERT(*s == ''[''); > + id = simple_strtoul(s + 1, &s, 0); > + if ( id != (typeof(hpet_sbdf.id))id || *s != '']'' || *++s != ''='' ) > + return; > + > + s = parse_pci(s + 1, &seg, &bus, &dev, &func); > + if ( !s || *s ) > + return; > + > + hpet_sbdf.bdf = PCI_BDF(bus, dev, func); > + hpet_sbdf.seg = seg; > + hpet_sbdf.cmdline = 1; > +} > +custom_param("ivrs_hpet[", parse_ivrs_hpet); > + > static u16 __init parse_ivhd_device_special( > const struct acpi_ivrs_device8c *special, u16 seg, > u16 header_length, u16 block_length, struct amd_iommu *iommu) > @@ -674,7 +718,17 @@ static u16 __init parse_ivhd_device_spec > if ( IO_APIC_ID(apic) != special->handle ) > continue; > > - if ( ioapic_sbdf[special->handle].pin_2_idx ) > + if ( special->handle >= ARRAY_SIZE(ioapic_sbdf) ) > + { > + printk(XENLOG_ERR "IVHD Error: IO-APIC %#x entry beyond bounds\n", > + special->handle); > + return 0; > + } > + > + if ( test_bit(special->handle, ioapic_cmdline) ) > + AMD_IOMMU_DEBUG("IVHD: Command line override present for IO-APIC %#x\n", > + special->handle); > + else if ( ioapic_sbdf[special->handle].pin_2_idx ) > { > if ( ioapic_sbdf[special->handle].bdf == bdf && > ioapic_sbdf[special->handle].seg == seg ) > @@ -717,14 +771,18 @@ static u16 __init parse_ivhd_device_spec > break; > case ACPI_IVHD_HPET: > /* set device id of hpet */ > - if ( hpet_sbdf.iommu ) > + if ( hpet_sbdf.iommu || > + (hpet_sbdf.cmdline && hpet_sbdf.id != special->handle) ) > { > printk(XENLOG_WARNING "Only one IVHD HPET entry is supported\n"); > break; > } > hpet_sbdf.id = special->handle; > - hpet_sbdf.bdf = bdf; > - hpet_sbdf.seg = seg; > + if ( !hpet_sbdf.cmdline ) > + { > + hpet_sbdf.bdf = bdf; > + hpet_sbdf.seg = seg; > + } > hpet_sbdf.iommu = iommu; > break; > default: > @@ -935,21 +993,23 @@ static int __init parse_ivrs_table(struc > ioapic_sbdf[IO_APIC_ID(apic)].pin_2_idx ) > continue; > > - printk(XENLOG_ERR "IVHD Error: no information for IO-APIC %#x\n", > - IO_APIC_ID(apic)); > - if ( amd_iommu_perdev_intremap ) > - error = -ENXIO; > - else > + if ( !test_bit(IO_APIC_ID(apic), ioapic_cmdline) ) > { > - ioapic_sbdf[IO_APIC_ID(apic)].pin_2_idx = xmalloc_array( > - u16, nr_ioapic_entries[apic]); > - if ( !ioapic_sbdf[IO_APIC_ID(apic)].pin_2_idx ) > - { > - printk(XENLOG_ERR "IVHD Error: Out of memory\n"); > - error = -ENOMEM; > - } > + printk(XENLOG_ERR "IVHD Error: no information for IO-APIC %#x\n", > + IO_APIC_ID(apic)); > + if ( amd_iommu_perdev_intremap ) > + return -ENXIO; > + } > + > + ioapic_sbdf[IO_APIC_ID(apic)].pin_2_idx = xmalloc_array( > + u16, nr_ioapic_entries[apic]); > + if ( ioapic_sbdf[IO_APIC_ID(apic)].pin_2_idx ) > memset(ioapic_sbdf[IO_APIC_ID(apic)].pin_2_idx, -1, > nr_ioapic_entries[apic] * sizeof(*ioapic_sbdf->pin_2_idx)); > + else > + { > + printk(XENLOG_ERR "IVHD Error: Out of memory\n"); > + error = -ENOMEM; > } > } > > --- a/xen/include/asm-x86/hvm/svm/amd-iommu-proto.h > +++ b/xen/include/asm-x86/hvm/svm/amd-iommu-proto.h > @@ -108,6 +108,7 @@ extern struct ioapic_sbdf { > > extern struct hpet_sbdf { > u16 bdf, seg, id; > + bool_t cmdline; > struct amd_iommu *iommu; > } hpet_sbdf; >
Sander Eikelenboom
2013-Aug-27 11:09 UTC
Re: [PATCH RFC 2/2] AMD IOMMU: allow command line overrides for broken IVRS tables
Tuesday, August 27, 2013, 11:52:36 AM, you wrote:> Tuesday, August 27, 2013, 10:05:41 AM, you wrote:>> With there being so many systems with broken ACPI tables, and with it >> generally being known what''s wrong with those tables, give people a >> handle to overcome the resulting disabling of their IOMMUs.>> Inspired by Linux side patches providing similar functionality.>> TODO: documentation> Hi Jan,> Would the syntax be the same as linux ? > f.e. ivrs_ioapic[6]=00:14.0 for my case ?> I''m asking because using it on the command line seems to enable the iommu fine (which it shouldn''t without the override), but i don''t seem to see the > "IVHD: Command line override present for IO-APIC %#x" in my xl dmesg...Hrrrmm could it be due to the fact that in my case it actually shouldn''t override a present IVRS entry, but add a extra one ?> -- > Sander>> Suggested-by: Sander Eikelenboom <linux@eikelenboom.it> >> Signed-off-by: Jan Beulich <jbeulich@suse.com>>> --- a/xen/common/kernel.c >> +++ b/xen/common/kernel.c >> @@ -81,9 +81,15 @@ void __init cmdline_parse(const char *cm >> /* Search for value part of a key=value option. */ >> optval = strchr(opt, ''=''); >> if ( optval != NULL ) >> + { >> *optval++ = ''\0''; /* nul-terminate the option value */ >> + q = strpbrk(opt, "([{<"); >> + } >> else >> + { >> optval = q; /* default option value is empty string */ >> + q = NULL; >> + } >> >> /* Boolean parameters can be inverted with ''no-'' prefix. */ >> bool_assert = !!strncmp("no-", optkey, 3); >> @@ -93,7 +99,17 @@ void __init cmdline_parse(const char *cm >> for ( param = &__setup_start; param < &__setup_end; param++ ) >> { >> if ( strcmp(param->name, optkey) ) >> + { >> + if ( param->type == OPT_CUSTOM && q && >> + strlen(param->name) == q + 1 - opt && >> + !strncmp(param->name, opt, q + 1 - opt) ) >> + { >> + optval[-1] = ''=''; >> + ((void (*)(const char *))param->var)(q); >> + optval[-1] = ''\0''; >> + } >> continue; >> + } >> >> switch ( param->type ) >> { >> --- a/xen/drivers/passthrough/amd/iommu_acpi.c >> +++ b/xen/drivers/passthrough/amd/iommu_acpi.c >> @@ -633,6 +633,50 @@ static u16 __init parse_ivhd_device_exte >> return dev_length; >> } >> >> +static __initdata DECLARE_BITMAP(ioapic_cmdline, ARRAY_SIZE(ioapic_sbdf)); >> + >> +static void __init parse_ivrs_ioapic(char *str) >> +{ >> + const char *s = str; >> + unsigned long id; >> + unsigned int seg, bus, dev, func; >> + >> + ASSERT(*s == ''[''); >> + id = simple_strtoul(s + 1, &s, 0);+ if ( id >>>= ARRAY_SIZE(ioapic_sbdf) || *s != '']'' || *++s != ''='' )>> + return; >> + >> + s = parse_pci(s + 1, &seg, &bus, &dev, &func); >> + if ( !s || *s ) >> + return; >> + >> + ioapic_sbdf[id].bdf = PCI_BDF(bus, dev, func); >> + ioapic_sbdf[id].seg = seg; >> + __set_bit(id, ioapic_cmdline); >> +} >> +custom_param("ivrs_ioapic[", parse_ivrs_ioapic); >> + >> +static void __init parse_ivrs_hpet(char *str) >> +{ >> + const char *s = str; >> + unsigned long id; >> + unsigned int seg, bus, dev, func; >> + >> + ASSERT(*s == ''[''); >> + id = simple_strtoul(s + 1, &s, 0); >> + if ( id != (typeof(hpet_sbdf.id))id || *s != '']'' || *++s != ''='' ) >> + return; >> + >> + s = parse_pci(s + 1, &seg, &bus, &dev, &func); >> + if ( !s || *s ) >> + return; >> + >> + hpet_sbdf.bdf = PCI_BDF(bus, dev, func); >> + hpet_sbdf.seg = seg; >> + hpet_sbdf.cmdline = 1; >> +} >> +custom_param("ivrs_hpet[", parse_ivrs_hpet); >> + >> static u16 __init parse_ivhd_device_special( >> const struct acpi_ivrs_device8c *special, u16 seg, >> u16 header_length, u16 block_length, struct amd_iommu *iommu) >> @@ -674,7 +718,17 @@ static u16 __init parse_ivhd_device_spec >> if ( IO_APIC_ID(apic) != special->handle ) >> continue; >> >> - if ( ioapic_sbdf[special->handle].pin_2_idx ) >> + if ( special->handle >= ARRAY_SIZE(ioapic_sbdf) ) >> + { >> + printk(XENLOG_ERR "IVHD Error: IO-APIC %#x entry beyond bounds\n", >> + special->handle); >> + return 0; >> + } >> + >> + if ( test_bit(special->handle, ioapic_cmdline) ) >> + AMD_IOMMU_DEBUG("IVHD: Command line override present for IO-APIC %#x\n", >> + special->handle); >> + else if ( ioapic_sbdf[special->handle].pin_2_idx ) >> { >> if ( ioapic_sbdf[special->handle].bdf == bdf && >> ioapic_sbdf[special->handle].seg == seg ) >> @@ -717,14 +771,18 @@ static u16 __init parse_ivhd_device_spec >> break; >> case ACPI_IVHD_HPET: >> /* set device id of hpet */ >> - if ( hpet_sbdf.iommu ) >> + if ( hpet_sbdf.iommu || >> + (hpet_sbdf.cmdline && hpet_sbdf.id != special->handle) ) >> { >> printk(XENLOG_WARNING "Only one IVHD HPET entry is supported\n"); >> break; >> } >> hpet_sbdf.id = special->handle; >> - hpet_sbdf.bdf = bdf; >> - hpet_sbdf.seg = seg; >> + if ( !hpet_sbdf.cmdline ) >> + { >> + hpet_sbdf.bdf = bdf; >> + hpet_sbdf.seg = seg; >> + } >> hpet_sbdf.iommu = iommu; >> break; >> default: >> @@ -935,21 +993,23 @@ static int __init parse_ivrs_table(struc >> ioapic_sbdf[IO_APIC_ID(apic)].pin_2_idx ) >> continue; >> >> - printk(XENLOG_ERR "IVHD Error: no information for IO-APIC %#x\n", >> - IO_APIC_ID(apic)); >> - if ( amd_iommu_perdev_intremap ) >> - error = -ENXIO; >> - else >> + if ( !test_bit(IO_APIC_ID(apic), ioapic_cmdline) ) >> { >> - ioapic_sbdf[IO_APIC_ID(apic)].pin_2_idx = xmalloc_array( >> - u16, nr_ioapic_entries[apic]); >> - if ( !ioapic_sbdf[IO_APIC_ID(apic)].pin_2_idx ) >> - { >> - printk(XENLOG_ERR "IVHD Error: Out of memory\n"); >> - error = -ENOMEM; >> - } >> + printk(XENLOG_ERR "IVHD Error: no information for IO-APIC %#x\n", >> + IO_APIC_ID(apic)); >> + if ( amd_iommu_perdev_intremap ) >> + return -ENXIO; >> + } >> + >> + ioapic_sbdf[IO_APIC_ID(apic)].pin_2_idx = xmalloc_array( >> + u16, nr_ioapic_entries[apic]); >> + if ( ioapic_sbdf[IO_APIC_ID(apic)].pin_2_idx ) >> memset(ioapic_sbdf[IO_APIC_ID(apic)].pin_2_idx, -1, >> nr_ioapic_entries[apic] * sizeof(*ioapic_sbdf->pin_2_idx)); >> + else >> + { >> + printk(XENLOG_ERR "IVHD Error: Out of memory\n"); >> + error = -ENOMEM; >> } >> } >> >> --- a/xen/include/asm-x86/hvm/svm/amd-iommu-proto.h >> +++ b/xen/include/asm-x86/hvm/svm/amd-iommu-proto.h >> @@ -108,6 +108,7 @@ extern struct ioapic_sbdf { >> >> extern struct hpet_sbdf { >> u16 bdf, seg, id; >> + bool_t cmdline; >> struct amd_iommu *iommu; >> } hpet_sbdf; >>
Jan Beulich
2013-Aug-27 12:04 UTC
Re: [PATCH RFC 2/2] AMD IOMMU: allow command line overrides for broken IVRS tables
>>> On 27.08.13 at 13:09, Sander Eikelenboom <linux@eikelenboom.it> wrote: >> Would the syntax be the same as linux ? >> f.e. ivrs_ioapic[6]=00:14.0 for my case ?Yes.>> I''m asking because using it on the command line seems to enable the iommu > fine (which it shouldn''t without the override), but i don''t seem to see the >> "IVHD: Command line override present for IO-APIC %#x" in my xl dmesg... > > Hrrrmm could it be due to the fact that in my case it actually shouldn''t > override a present IVRS entry, but add a extra one ?Yes. Does Linux print something even in that case? Jan
Sander Eikelenboom
2013-Aug-27 13:32 UTC
Re: [PATCH RFC 2/2] AMD IOMMU: allow command line overrides for broken IVRS tables
Tuesday, August 27, 2013, 2:04:38 PM, you wrote:>>>> On 27.08.13 at 13:09, Sander Eikelenboom <linux@eikelenboom.it> wrote: >>> Would the syntax be the same as linux ? >>> f.e. ivrs_ioapic[6]=00:14.0 for my case ?> Yes.>>> I''m asking because using it on the command line seems to enable the iommu >> fine (which it shouldn''t without the override), but i don''t seem to see the >>> "IVHD: Command line override present for IO-APIC %#x" in my xl dmesg... >> >> Hrrrmm could it be due to the fact that in my case it actually shouldn''t >> override a present IVRS entry, but add a extra one ?> Yes. Does Linux print something even in that case?Hmmm even with: static void __init parse_ivrs_ioapic(char *str) { const char *s = str; unsigned long id; unsigned int seg, bus, dev, func; AMD_IOMMU_DEBUG(" will be parsing things: %s" , str); ASSERT(*s == ''[''); id = simple_strtoul(s + 1, &s, 0); if ( id >= ARRAY_SIZE(ioapic_sbdf) || *s != '']'' || *++s != ''='' ){ AMD_IOMMU_DEBUG("bailing out here %lu" , id); return; } s = parse_pci(s + 1, &seg, &bus, &dev, &func); if ( !s || *s ){ AMD_IOMMU_DEBUG(" Something went wrong parsing things: %s" , str); return; } AMD_IOMMU_DEBUG("parsed things: %lu, %d, %d , %d" ,id, bus, dev, func); ioapic_sbdf[id].bdf = PCI_BDF(bus, dev, func); ioapic_sbdf[id].seg = seg; __set_bit(id, ioapic_cmdline); } custom_param("ivrs_ioapic[", parse_ivrs_ioapic); I don''t see anything ...> Jan
Jan Beulich
2013-Aug-27 13:55 UTC
Re: [PATCH RFC 2/2] AMD IOMMU: allow command line overrides for broken IVRS tables
>>> On 27.08.13 at 15:32, Sander Eikelenboom <linux@eikelenboom.it> wrote: > Hmmm even with: > > static void __init parse_ivrs_ioapic(char *str) > { > const char *s = str; > unsigned long id; > unsigned int seg, bus, dev, func; > > AMD_IOMMU_DEBUG(" will be parsing things: %s" , str); > > ASSERT(*s == ''[''); > id = simple_strtoul(s + 1, &s, 0); > if ( id >= ARRAY_SIZE(ioapic_sbdf) || *s != '']'' || *++s != ''='' ){ > AMD_IOMMU_DEBUG("bailing out here %lu" , id); > > return; > } > s = parse_pci(s + 1, &seg, &bus, &dev, &func); > if ( !s || *s ){ > > AMD_IOMMU_DEBUG(" Something went wrong parsing things: %s" , > str); > return; > } > AMD_IOMMU_DEBUG("parsed things: %lu, %d, %d , %d" ,id, bus, dev, func); > > ioapic_sbdf[id].bdf = PCI_BDF(bus, dev, func); > ioapic_sbdf[id].seg = seg; > __set_bit(id, ioapic_cmdline); > } > custom_param("ivrs_ioapic[", parse_ivrs_ioapic); > > I don''t see anything ...That''s not surprising - command line parsing happens before any consoles get set up. Jan
Jan Beulich
2013-Aug-27 14:11 UTC
Re: [PATCH RFC 2/2] AMD IOMMU: allow command line overrides for broken IVRS tables
>>> On 27.08.13 at 14:04, "Jan Beulich" <JBeulich@suse.com> wrote: >>>> On 27.08.13 at 13:09, Sander Eikelenboom <linux@eikelenboom.it> wrote: >>> Would the syntax be the same as linux ? >>> f.e. ivrs_ioapic[6]=00:14.0 for my case ? > > Yes. > >>> I''m asking because using it on the command line seems to enable the iommu >> fine (which it shouldn''t without the override), but i don''t seem to see the >>> "IVHD: Command line override present for IO-APIC %#x" in my xl dmesg... >> >> Hrrrmm could it be due to the fact that in my case it actually shouldn''t >> override a present IVRS entry, but add a extra one ? > > Yes. Does Linux print something even in that case?Just looked at their code once more, and I can''t see how they would print something in that case. Jan
Andrew Cooper
2013-Aug-27 14:15 UTC
Re: [PATCH RFC 2/2] AMD IOMMU: allow command line overrides for broken IVRS tables
On 27/08/13 14:55, Jan Beulich wrote:>>>> On 27.08.13 at 15:32, Sander Eikelenboom <linux@eikelenboom.it> wrote: >> Hmmm even with: >> >> static void __init parse_ivrs_ioapic(char *str) >> { >> const char *s = str; >> unsigned long id; >> unsigned int seg, bus, dev, func; >> >> AMD_IOMMU_DEBUG(" will be parsing things: %s" , str); >> >> ASSERT(*s == ''[''); >> id = simple_strtoul(s + 1, &s, 0); >> if ( id >= ARRAY_SIZE(ioapic_sbdf) || *s != '']'' || *++s != ''='' ){ >> AMD_IOMMU_DEBUG("bailing out here %lu" , id); >> >> return; >> } >> s = parse_pci(s + 1, &seg, &bus, &dev, &func); >> if ( !s || *s ){ >> >> AMD_IOMMU_DEBUG(" Something went wrong parsing things: %s" , >> str); >> return; >> } >> AMD_IOMMU_DEBUG("parsed things: %lu, %d, %d , %d" ,id, bus, dev, func); >> >> ioapic_sbdf[id].bdf = PCI_BDF(bus, dev, func); >> ioapic_sbdf[id].seg = seg; >> __set_bit(id, ioapic_cmdline); >> } >> custom_param("ivrs_ioapic[", parse_ivrs_ioapic); >> >> I don''t see anything ... > That''s not surprising - command line parsing happens before any > consoles get set up. > > Jan >If you have a serial console enabled, then you will see those prints, but they will not show up in `xl dmesg` ~Andrew
Sander Eikelenboom
2013-Aug-27 14:15 UTC
Re: [PATCH RFC 2/2] AMD IOMMU: allow command line overrides for broken IVRS tables
Tuesday, August 27, 2013, 4:11:51 PM, you wrote:>>>> On 27.08.13 at 14:04, "Jan Beulich" <JBeulich@suse.com> wrote: >>>>> On 27.08.13 at 13:09, Sander Eikelenboom <linux@eikelenboom.it> wrote: >>>> Would the syntax be the same as linux ? >>>> f.e. ivrs_ioapic[6]=00:14.0 for my case ? >> >> Yes. >> >>>> I''m asking because using it on the command line seems to enable the iommu >>> fine (which it shouldn''t without the override), but i don''t seem to see the >>>> "IVHD: Command line override present for IO-APIC %#x" in my xl dmesg... >>> >>> Hrrrmm could it be due to the fact that in my case it actually shouldn''t >>> override a present IVRS entry, but add a extra one ? >> >> Yes. Does Linux print something even in that case?> Just looked at their code once more, and I can''t see how they > would print something in that case.> JanAh yeah that was smart from me :-) Hmm looking at the code, could it be a implementation difference with the linux variant ? Linux seems to first make a list by looping through the special devices, skipping what will be overridden. And after that add the mappings parsed from the command line. It seems to use that list to for walking the parse_ivhd_special function mapping them. This allows for not only overriding but also adding missing entries. Where as your implementation seems to only walk the list present from bios and override a specific entry when it''s mapping them in parse_ivhd_special ?
Jan Beulich
2013-Aug-27 15:59 UTC
Re: [PATCH RFC 2/2] AMD IOMMU: allow command line overrides for broken IVRS tables
>>> On 27.08.13 at 16:15, Sander Eikelenboom <linux@eikelenboom.it> wrote: > Where as your implementation seems to only walk the list present from bios > and override a specific entry when it''s mapping them in parse_ivhd_special ?No, the code change to parse_ivrs_table() should be setting up necessary information. Jan
Sander Eikelenboom
2013-Aug-27 16:14 UTC
Re: [PATCH RFC 2/2] AMD IOMMU: allow command line overrides for broken IVRS tables
Tuesday, August 27, 2013, 5:59:28 PM, you wrote:>>>> On 27.08.13 at 16:15, Sander Eikelenboom <linux@eikelenboom.it> wrote: >> Where as your implementation seems to only walk the list present from bios >> and override a specific entry when it''s mapping them in parse_ivhd_special ?> No, the code change to parse_ivrs_table() should be setting up > necessary information.Well i just checked, and in parse_ivhd_device_special() doing a: printk(XENLOG_ERR "is apic 0x6 override parsed ? %d ", test_bit(0x6, ioapic_cmdline )); returns 1 ... so the parsing part seems to be OK. but parse_ivhd_device_special() isn''t called for ioapic 0x6, because there is no entry for it in the bios provided tables in my case. and since that seems to be what is iterated .. -- Sander> Jan
Jan Beulich
2013-Aug-27 16:17 UTC
Re: [PATCH RFC 2/2] AMD IOMMU: allow command line overrides for broken IVRS tables
>>> On 27.08.13 at 16:15, Andrew Cooper <andrew.cooper3@citrix.com> wrote: > If you have a serial console enabled, then you will see those prints, > but they will not show up in `xl dmesg`I don''t think that''s universally the case (i.e. at least depends on the order of items on the command line). Jan
Sander Eikelenboom
2013-Aug-27 16:19 UTC
Re: [PATCH RFC 2/2] AMD IOMMU: allow command line overrides for broken IVRS tables
Tuesday, August 27, 2013, 6:17:29 PM, you wrote:>>>> On 27.08.13 at 16:15, Andrew Cooper <andrew.cooper3@citrix.com> wrote: >> If you have a serial console enabled, then you will see those prints, >> but they will not show up in `xl dmesg`> I don''t think that''s universally the case (i.e. at least depends on the > order of items on the command line).Didn''t seem to be the case, but just worked around it to find out the parsing seems to be done ok. (at least to the point something should have been printed)> Jan
Jan Beulich
2013-Aug-27 16:21 UTC
Re: [PATCH RFC 2/2] AMD IOMMU: allow command line overrides for broken IVRS tables
>>> On 27.08.13 at 18:14, Sander Eikelenboom <linux@eikelenboom.it> wrote: > Tuesday, August 27, 2013, 5:59:28 PM, you wrote: > >>>>> On 27.08.13 at 16:15, Sander Eikelenboom <linux@eikelenboom.it> wrote: >>> Where as your implementation seems to only walk the list present from bios >>> and override a specific entry when it''s mapping them in parse_ivhd_special ? > >> No, the code change to parse_ivrs_table() should be setting up >> necessary information. > > Well i just checked, and in parse_ivhd_device_special() doing a: > > printk(XENLOG_ERR "is apic 0x6 override parsed ? %d ", test_bit(0x6, > ioapic_cmdline )); > > returns 1 ... so the parsing part seems to be OK. > > but parse_ivhd_device_special() isn''t called for ioapic 0x6, because there > is no entry for it in the bios provided tables in my case. > and since that seems to be what is iterated ..As said, the handling of missing entries should be done by the tail of parse_ivrs_table(). Jan
Sander Eikelenboom
2013-Aug-27 16:30 UTC
Re: [PATCH RFC 2/2] AMD IOMMU: allow command line overrides for broken IVRS tables
Tuesday, August 27, 2013, 6:21:02 PM, you wrote:>>>> On 27.08.13 at 18:14, Sander Eikelenboom <linux@eikelenboom.it> wrote: >> Tuesday, August 27, 2013, 5:59:28 PM, you wrote: >> >>>>>> On 27.08.13 at 16:15, Sander Eikelenboom <linux@eikelenboom.it> wrote: >>>> Where as your implementation seems to only walk the list present from bios >>>> and override a specific entry when it''s mapping them in parse_ivhd_special ? >> >>> No, the code change to parse_ivrs_table() should be setting up >>> necessary information. >> >> Well i just checked, and in parse_ivhd_device_special() doing a: >> >> printk(XENLOG_ERR "is apic 0x6 override parsed ? %d ", test_bit(0x6, >> ioapic_cmdline )); >> >> returns 1 ... so the parsing part seems to be OK. >> >> but parse_ivhd_device_special() isn''t called for ioapic 0x6, because there >> is no entry for it in the bios provided tables in my case. >> and since that seems to be what is iterated ..> As said, the handling of missing entries should be done by the tail > of parse_ivrs_table().Ah whoops, it does the setup as well .. of course my printk''s in parse_ivhd_device_special() don''t show anything then ... /* Each IO-APIC must have been mentioned in the table. */ for ( apic = 0; !error && iommu_intremap && apic < nr_ioapics; ++apic ) { if ( !nr_ioapic_entries[apic] || ioapic_sbdf[IO_APIC_ID(apic)].pin_2_idx ) continue; if ( !test_bit(IO_APIC_ID(apic), ioapic_cmdline) ) { printk(XENLOG_ERR "IVHD Error: no information for IO-APIC %#x\n", IO_APIC_ID(apic)); if ( amd_iommu_perdev_intremap ) return -ENXIO; } wouldn''t an extra printk mentioning the addition of an entry from cmdline be nice here ? ioapic_sbdf[IO_APIC_ID(apic)].pin_2_idx = xmalloc_array( u16, nr_ioapic_entries[apic]); if ( ioapic_sbdf[IO_APIC_ID(apic)].pin_2_idx ) memset(ioapic_sbdf[IO_APIC_ID(apic)].pin_2_idx, -1, nr_ioapic_entries[apic] * sizeof(*ioapic_sbdf->pin_2_idx)); else { printk(XENLOG_ERR "IVHD Error: Out of memory\n"); error = -ENOMEM; } }> Jan
Sander Eikelenboom
2013-Aug-27 17:09 UTC
Re: [PATCH RFC 2/2] AMD IOMMU: allow command line overrides for broken IVRS tables
Tuesday, August 27, 2013, 6:30:32 PM, you wrote:> Tuesday, August 27, 2013, 6:21:02 PM, you wrote:>>>>> On 27.08.13 at 18:14, Sander Eikelenboom <linux@eikelenboom.it> wrote: >>> Tuesday, August 27, 2013, 5:59:28 PM, you wrote: >>> >>>>>>> On 27.08.13 at 16:15, Sander Eikelenboom <linux@eikelenboom.it> wrote: >>>>> Where as your implementation seems to only walk the list present from bios >>>>> and override a specific entry when it''s mapping them in parse_ivhd_special ? >>> >>>> No, the code change to parse_ivrs_table() should be setting up >>>> necessary information. >>> >>> Well i just checked, and in parse_ivhd_device_special() doing a: >>> >>> printk(XENLOG_ERR "is apic 0x6 override parsed ? %d ", test_bit(0x6, >>> ioapic_cmdline )); >>> >>> returns 1 ... so the parsing part seems to be OK. >>> >>> but parse_ivhd_device_special() isn''t called for ioapic 0x6, because there >>> is no entry for it in the bios provided tables in my case. >>> and since that seems to be what is iterated ..>> As said, the handling of missing entries should be done by the tail >> of parse_ivrs_table().> Ah whoops, it does the setup as well .. of course my printk''s in parse_ivhd_device_special() don''t show anything then ...> /* Each IO-APIC must have been mentioned in the table. */ > for ( apic = 0; !error && iommu_intremap && apic < nr_ioapics; ++apic ) > { > if ( !nr_ioapic_entries[apic] || > ioapic_sbdf[IO_APIC_ID(apic)].pin_2_idx ) > continue;> if ( !test_bit(IO_APIC_ID(apic), ioapic_cmdline) ) > { > printk(XENLOG_ERR "IVHD Error: no information for IO-APIC %#x\n", > IO_APIC_ID(apic)); > if ( amd_iommu_perdev_intremap ) > return -ENXIO; > }> wouldn''t an extra printk mentioning the addition of an entry from cmdline be nice here ?> ioapic_sbdf[IO_APIC_ID(apic)].pin_2_idx = xmalloc_array( > u16, nr_ioapic_entries[apic]); > if ( ioapic_sbdf[IO_APIC_ID(apic)].pin_2_idx ) > memset(ioapic_sbdf[IO_APIC_ID(apic)].pin_2_idx, -1, > nr_ioapic_entries[apic] * sizeof(*ioapic_sbdf->pin_2_idx)); > else > { > printk(XENLOG_ERR "IVHD Error: Out of memory\n"); > error = -ENOMEM; > } > }>> JanHi Jan, I just added a printk there and all seems to work fine .. sorry for the noise so apart from perhaps adding some verbosity when actually applying the vodoo ... at least for the IOAPIC part: Tested-By: Sander Eikelenboom <linux@eikelenboom.it> -- Sander
Keir Fraser
2013-Aug-27 18:07 UTC
Re: [PATCH RFC 0/2] AMD IOMMU: allow command line overrides for broken IVRS tables
On 27/08/2013 09:00, "Jan Beulich" <JBeulich@suse.com> wrote:> 1: PCI: centralize parsing of device coordinates in command line options > 2: AMD IOMMU: allow command line overrides for broken IVRS tables > > Signed-off-by: Jan Beulich <jbeulich@suse.com>Acked-by: Keir Fraser <keir@xen.org>
Jan Beulich
2013-Aug-28 08:06 UTC
Re: [PATCH RFC 2/2] AMD IOMMU: allow command line overrides for broken IVRS tables
>>> On 27.08.13 at 18:30, Sander Eikelenboom <linux@eikelenboom.it> wrote: > Tuesday, August 27, 2013, 6:21:02 PM, you wrote: >> As said, the handling of missing entries should be done by the tail >> of parse_ivrs_table(). > > Ah whoops, it does the setup as well .. of course my printk''s in > parse_ivhd_device_special() don''t show anything then ... > > /* Each IO-APIC must have been mentioned in the table. */ > for ( apic = 0; !error && iommu_intremap && apic < nr_ioapics; ++apic ) > { > if ( !nr_ioapic_entries[apic] || > ioapic_sbdf[IO_APIC_ID(apic)].pin_2_idx ) > continue; > > if ( !test_bit(IO_APIC_ID(apic), ioapic_cmdline) ) > { > printk(XENLOG_ERR "IVHD Error: no information for IO-APIC %#x\n", > IO_APIC_ID(apic)); > if ( amd_iommu_perdev_intremap ) > return -ENXIO; > } > > wouldn''t an extra printk mentioning the addition of an entry from cmdline be > nice here ?I''m not sure - I don''t really like the trivial echoing of command line options. Messages should imo be printed only when something has an effect that one can''t immediately imply from specified options (like is the case when some information from the firmware is being ignored). So I''d favor keeping the patch as is, pending the outcome of Suravee''s testing. Jan
Suravee Suthikulpanit
2013-Aug-28 14:59 UTC
Re: [PATCH RFC 2/2] AMD IOMMU: allow command line overrides for broken IVRS tables
Jan, The current patch does not handle the case where the "handle" value is mis-configured in the IVRS. I have also included the patch which has additional check. Below is the output from the patch. (XEN) AMD-Vi: IVHD Device Entry: type 0x48 id 0 flags 0xd7 (XEN) AMD-Vi: IVHD Special: 0000:00:14.0 variety 0x1 handle 0xff used_id 0xa0 (XEN) AMD-Vi: IVHD Special: Usinging command override value for IO-APIC 0x8, bdf=0xa0 (XEN) AMD-Vi: IVHD Device Entry: type 0x48 id 0 flags 0xd7 (XEN) AMD-Vi: IVHD Special: 0000:00:14.0 variety 0x2 handle 0 used_id 0xa0 (XEN) AMD-Vi: IVHD Device Entry: type 0x48 id 0 flags 0 (XEN) AMD-Vi: IVHD Special: 0000:00:00.1 variety 0x1 handle 0xff used_id 0x1 (XEN) AMD-Vi: IVHD Special: Usinging command override value for IO-APIC 0x8, bdf=0xa0 (XEN) AMD-Vi: IOMMU 0 Enabled. (XEN) I/O virtualisation enabled Suravee ------- PATCH SNIPPET------- From 86bf8c318a43e409d404377f4534fe586785a5c4 Mon Sep 17 00:00:00 2001 From: Suravee Suthikulpanit <suravee.suthikulpanit@amd.com> Date: Wed, 28 Aug 2013 09:49:32 -0500 Subject: [PATCH] Add additional check invalid special->handle This patch add an additional logic to check for the case when the speciail->handle is invalid due to firmware bugs, and use the overide value instead. Signed-off: Suravee Suthikulpanit <suravee.suthikulpanit@amd.com> --- xen/drivers/passthrough/amd/iommu_acpi.c | 53 ++++++++++++++++++++---------- 1 file changed, 35 insertions(+), 18 deletions(-) diff --git a/xen/drivers/passthrough/amd/iommu_acpi.c b/xen/drivers/passthrough/amd/iommu_acpi.c index 89b359c..8fb4c3f 100644 --- a/xen/drivers/passthrough/amd/iommu_acpi.c +++ b/xen/drivers/passthrough/amd/iommu_acpi.c @@ -698,14 +698,16 @@ static u16 __init parse_ivhd_device_special( return 0; } - AMD_IOMMU_DEBUG("IVHD Special: %04x:%02x:%02x.%u variety %#x handle %#x\n", + AMD_IOMMU_DEBUG("IVHD Special: %04x:%02x:%02x.%u variety %#x handle %#x used_id %#x\n", seg, PCI_BUS(bdf), PCI_SLOT(bdf), PCI_FUNC(bdf), - special->variety, special->handle); + special->variety, special->handle, special->used_id); add_ivrs_mapping_entry(bdf, bdf, special->header.data_setting, iommu); switch ( special->variety ) { case ACPI_IVHD_IOAPIC: + { + unsigned int apic_id = 0; if ( !iommu_intremap ) break; /* @@ -715,29 +717,43 @@ static u16 __init parse_ivhd_device_special( */ for ( apic = 0; apic < nr_ioapics; apic++ ) { - if ( IO_APIC_ID(apic) != special->handle ) - continue; + apic_id = special->handle; - if ( special->handle >= ARRAY_SIZE(ioapic_sbdf) ) + if ( IO_APIC_ID(apic) != apic_id ) + { + /* Some BIOSes have invalid value in the special->handle. + * Here we check to see if the user is overiding them from commandline + */ + if ( test_bit(IO_APIC_ID(apic), ioapic_cmdline) ) + { + apic_id = IO_APIC_ID(apic); + AMD_IOMMU_DEBUG ("IVHD Special: Usinging command override " + "value for IO-APIC %#x, bdf=%#x\n", + apic_id, ioapic_sbdf[apic_id].bdf); + } + else + continue; + } + + if ( apic_id >= ARRAY_SIZE(ioapic_sbdf) ) { printk(XENLOG_ERR "IVHD Error: IO-APIC %#x entry beyond bounds\n", - special->handle); + apic_id); return 0; } - if ( test_bit(special->handle, ioapic_cmdline) ) - AMD_IOMMU_DEBUG("IVHD: Command line override present for IO-APIC %#x\n", - special->handle); - else if ( ioapic_sbdf[special->handle].pin_2_idx ) + if ( test_bit(apic_id, ioapic_cmdline) ) + break; + else if ( ioapic_sbdf[apic_id].pin_2_idx ) { - if ( ioapic_sbdf[special->handle].bdf == bdf && - ioapic_sbdf[special->handle].seg == seg ) + if ( ioapic_sbdf[apic_id].bdf == bdf && + ioapic_sbdf[apic_id].seg == seg ) AMD_IOMMU_DEBUG("IVHD Warning: Duplicate IO-APIC %#x entries\n", - special->handle); + apic_id); else { printk(XENLOG_ERR "IVHD Error: Conflicting IO-APIC %#x entries\n", - special->handle); + apic_id); if ( amd_iommu_perdev_intremap ) return 0; } @@ -745,10 +761,10 @@ static u16 __init parse_ivhd_device_special( else { /* set device id of ioapic */ - ioapic_sbdf[special->handle].bdf = bdf; - ioapic_sbdf[special->handle].seg = seg; + ioapic_sbdf[apic_id].bdf = bdf; + ioapic_sbdf[apic_id].seg = seg; - ioapic_sbdf[special->handle].pin_2_idx = xmalloc_array( + ioapic_sbdf[apic_id].pin_2_idx = xmalloc_array( u16, nr_ioapic_entries[apic]); if ( nr_ioapic_entries[apic] && !ioapic_sbdf[IO_APIC_ID(apic)].pin_2_idx ) @@ -765,10 +781,11 @@ static u16 __init parse_ivhd_device_special( if ( apic == nr_ioapics ) { printk(XENLOG_ERR "IVHD Error: Invalid IO-APIC %#x\n", - special->handle); + apic_id); return 0; } break; + } case ACPI_IVHD_HPET: /* set device id of hpet */ if ( hpet_sbdf.iommu || -- 1.7.10.4 _______________________________________________ Xen-devel mailing list Xen-devel@lists.xen.org http://lists.xen.org/xen-devel
Jan Beulich
2013-Aug-28 15:18 UTC
Re: [PATCH RFC 2/2] AMD IOMMU: allow command line overrides for broken IVRS tables
>>> On 28.08.13 at 16:59, Suravee Suthikulpanit <suravee.suthikulpanit@amd.com> wrote: > The current patch does not handle the case where the "handle" value is > mis-configured in the IVRS.Right, but I don''t think we can handle all possible cases here. And in any case (not the least because your patch seems to be incremental to my earlier one) - do you still see any issues with that one, or does the mail here represent sort of an ack to that earlier one (in its split form - as indicated earlier, I broke out the actual bug fixes from the workaround, which really is an enhancement)?> I have also included the patch which has additional check. Below is the > output from the patch. > > (XEN) AMD-Vi: IVHD Device Entry: type 0x48 id 0 flags 0xd7 > (XEN) AMD-Vi: IVHD Special: 0000:00:14.0 variety 0x1 handle 0xff used_id > 0xa0 > (XEN) AMD-Vi: IVHD Special: Usinging command override value for IO-APIC 0x8, bdf=0xa0 > (XEN) AMD-Vi: IVHD Device Entry: type 0x48 id 0 flags 0xd7 > (XEN) AMD-Vi: IVHD Special: 0000:00:14.0 variety 0x2 handle 0 used_id 0xa0 > (XEN) AMD-Vi: IVHD Device Entry: type 0x48 id 0 flags 0 > (XEN) AMD-Vi: IVHD Special: 0000:00:00.1 variety 0x1 handle 0xff used_id 0x1 > (XEN) AMD-Vi: IVHD Special: Usinging command override value for IO-APIC 0x8, bdf=0xa0 > (XEN) AMD-Vi: IOMMU 0 Enabled. > (XEN) I/O virtualisation enabledWhich already indicates that you apparently only considered the single IO-APIC case, because on a multi IO-APIC system ...> @@ -715,29 +717,43 @@ static u16 __init parse_ivhd_device_special( > */ > for ( apic = 0; apic < nr_ioapics; apic++ ) > { > - if ( IO_APIC_ID(apic) != special->handle ) > - continue; > + apic_id = special->handle; > > - if ( special->handle >= ARRAY_SIZE(ioapic_sbdf) ) > + if ( IO_APIC_ID(apic) != apic_id )... this would otherwise trigger on all IO-APICs but the one we''re currently supposed to deal with ...> + { > + /* Some BIOSes have invalid value in the special->handle. > + * Here we check to see if the user is overiding them from commandline > + */ > + if ( test_bit(IO_APIC_ID(apic), ioapic_cmdline) ) > + { > + apic_id = IO_APIC_ID(apic); > + AMD_IOMMU_DEBUG ("IVHD Special: Usinging command override " > + "value for IO-APIC %#x, bdf=%#x\n", > + apic_id, ioapic_sbdf[apic_id].bdf); > + }... and hence if overridden each IVRS entry - correct or not - would get overruled here. Jan
Seemingly Similar Threads
- [PATCH 1/1 V3] x86/AMD-Vi: Add additional check for invalid special->handle
- AMD IOMMU disabled - No Perdev Intremap
- [PATCH V2] x86/AMD-Vi: Add additional check for invalid special->handle
- linux 3.3-pre-rc1: Starting domU fails with Error: Failed to query current memory allocation of dom0.
- [PATCH] amd iommu: Dump flags of IO page faults