Bruce Edge
2010-Sep-30 14:31 UTC
[Xen-devel] Post 2.6.21 pv-ops kernels hang Nahelem systems when domU is started - BUG: soft lockup - CPU#0 stuck for 61s! [swapper:0]
I didn't report this earlier as I thought it must have been my fault
as I pruned out a lot of modules from the pvops kernel. With the .23
release and the same behavior with the same config that was working
with 2.6.32.18, I felt I needed to report this now as I don't think
it's my fault anymore.
The dom0 boot's OK, bu hangs as soon as a pvops domU is started. The
HVM domU is OK.
On the domU I get:
┌────────────────────────────────────────────────────────────────────────┐
│ dpm-domu 6.0.15-01, with Linux 2.6.32.23-3-rollback-to-18-config │
│ Memory test (memtest86+) │
│ Memory test (memtest86+, serial console 115200) │
│ │
│ │
│ │
│ │
│ │
└────────────────────────────────────────────────────────────────────────┘
Use the ^ and v keys to select which entry is highlighted.
Press enter to boot the selected OS, 'e' to edit the
commands before booting, 'a' to modify the kernel arguments
before booting, or 'c' for a command line.
Started domain dpm (id=1)
The Dom0 console shows:
(XEN) tmem: all pools frozen for all domains
(XEN) tmem: all pools thawed for all domains
(XEN) tmem: all pools frozen for all domains
(XEN) tmem: all pools thawed for all domains
mapping kernel into physical memory
about to get started...
<one minute passes...>
[46287.941296] BUG: soft lockup - CPU#0 stuck for 61s! [swapper:0]
[46353.441235] BUG: soft lockup - CPU#0 stuck for 61s! [swapper:0] one
more of these every 60 sec.
[46418.941235] BUG: soft lockup - CPU#0 stuck for 61s! [swapper:0]
This is consistent with xen 4.1 and 4.0.2rc1pre
Kernel config and boot log attached.
-Bruce
_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xensource.com
http://lists.xensource.com/xen-devel
Bruce Edge
2010-Sep-30 16:56 UTC
[Xen-devel] Re: Post 2.6.21 pv-ops kernels hang Nahelem systems when domU is started - BUG: soft lockup - CPU#0 stuck for 61s! [swapper:0]
On Thu, Sep 30, 2010 at 7:31 AM, Bruce Edge <bruce.edge@gmail.com> wrote:> I didn''t report this earlier as I thought it must have been my fault > as I pruned out a lot of modules from the pvops kernel. With the .23 > release and the same behavior with the same config that was working > with 2.6.32.18, I felt I needed to report this now as I don''t think > it''s my fault anymore. > > The dom0 boot''s OK, bu hangs as soon as a pvops domU is started. The > HVM domU is OK. > > On the domU I get: > > ┌────────────────────────────────────────────────────────────────────────┐ > │ dpm-domu 6.0.15-01, with Linux 2.6.32.23-3-rollback-to-18-config │ > │ Memory test (memtest86+) │ > │ Memory test (memtest86+, serial console 115200) │ > │ │ > │ │ > │ │ > │ │ > │ │ > └────────────────────────────────────────────────────────────────────────┘ > Use the ^ and v keys to select which entry is highlighted. > Press enter to boot the selected OS, ''e'' to edit the > commands before booting, ''a'' to modify the kernel arguments > before booting, or ''c'' for a command line. > > > Started domain dpm (id=1) > > > > The Dom0 console shows: > > (XEN) tmem: all pools frozen for all domains > (XEN) tmem: all pools thawed for all domains > (XEN) tmem: all pools frozen for all domains > (XEN) tmem: all pools thawed for all domains > mapping kernel into physical memory > about to get started... > > <one minute passes...> > > [46287.941296] BUG: soft lockup - CPU#0 stuck for 61s! [swapper:0] > [46353.441235] BUG: soft lockup - CPU#0 stuck for 61s! [swapper:0] one > more of these every 60 sec. > [46418.941235] BUG: soft lockup - CPU#0 stuck for 61s! [swapper:0] > > > This is consistent with xen 4.1 and 4.0.2rc1pre > > Kernel config and boot log attached. > > -Bruce >The xen console is still responsive. Attached is the ''*'' dump from xen 4.0.2.rc1pre after the dom0 hangs with the: BUG: soft lockup - CPU#0 stuck for 61s! [swapper:0] error. Many of the CPUs have hpet_broadcast_exit on the stack. Is this related to this patch: http://lists.xensource.com/archives/html/xen-devel/2010-09/msg00556.html Here are the CPU states: (XEN) *** Dumping CPU0 host state: *** (XEN) ----[ Xen-4.0.2-rc1-pre x86_64 debug=n Not tainted ]---- (XEN) CPU: 0 (XEN) RIP: e008:[<ffff82c480111131>] __dump_execstate+0x1/0x60 (XEN) RFLAGS: 0000000000010246 CONTEXT: hypervisor (XEN) rax: 0000000000000000 rbx: 0000000000000080 rcx: 0000000000000000 (XEN) rdx: 0000000000000000 rsi: 000000000000000a rdi: 0000000000000000 (XEN) rbp: ffff82c480367f28 rsp: ffff82c480367da8 r8: 0000000000010000 (XEN) r9: 000000000000ffff r10: ffff83011fce0000 r11: 0000000000000400 (XEN) r12: ffff82c480375408 r13: ffff82c480367f28 r14: ffff82c480133ca0 (XEN) r15: ffff82c480380288 cr0: 000000008005003b cr4: 00000000000026f0 (XEN) cr3: 00000000c73ec000 cr2: ffff880035648fe8 (XEN) ds: 0000 es: 0000 fs: 0000 gs: 0000 ss: 0000 cs: e008 (XEN) Xen stack trace from rsp=ffff82c480367da8: (XEN) 0000000000000080 ffff82c4801111e2 ffff82c4802297c0 0000000000000065 (XEN) ffff82c480375408 ffff82c480110818 0000008650a60b55 ffff82c4802298a0 (XEN) 000000000000002a ffff82c480367f28 ffff82c480367f28 ffff82c4801108d0 (XEN) ffff82c480226de0 ffff82c480226e58 0000000000000296 ffff82c480135166 (XEN) ffff82c48025e240 2a00000000000292 ffff82c480380260 ffff82c480226de0 (XEN) ffff82c480367f28 0000000000000001 ffff82c480367f28 ffff82c48013472e (XEN) 0000000000000005 ffff82c48025e9c0 0000000000000005 ffff82c48037a980 (XEN) ffff83011fd80300 ffff82c480159632 ffff8300df772000 ffff82c400000000 (XEN) ffff82c480367f28 ffff82c480367ed8 ffff82c480367f28 0000000000000000 (XEN) ffff83011fd80334 ffff82c48037e980 ffff82c48037a980 ffff82c48011d77e (XEN) 0000000000000246 ffff880010310040 ffff8800103089d0 00000000000001f4 (XEN) ffff880035739e30 0000000000000000 0000000000000001 ffff82c480152400 (XEN) 0000000000000001 0000000000000000 ffff880035739e30 00000000000001f4 (XEN) ffff8800103089d0 ffff880010310040 0000000000000001 0000000000000000 (XEN) 0000000000000001 0000000000000001 000000000000b018 0000000000000018 (XEN) ffff880010305000 0000000000000000 ffff880010310040 000000f100000000 (XEN) ffffffff8103b826 000000000000e033 0000000000000286 ffff880010308990 (XEN) 000000000000e02b 0000000000000000 0000000000000000 0000000000000000 (XEN) 0000000000000000 0000000000000000 ffff8300df772000 (XEN) Xen call trace: (XEN) [<ffff82c480111131>] __dump_execstate+0x1/0x60 (XEN) [<ffff82c4801111e2>] dump_registers+0x52/0x110 (XEN) [<ffff82c480110818>] run_all_keyhandlers+0x78/0xa0 (XEN) [<ffff82c4801108d0>] handle_keypress+0x90/0xe0 (XEN) [<ffff82c480135166>] serial_rx_interrupt+0x66/0xe0 (XEN) [<ffff82c48013472e>] ns16550_interrupt+0x6e/0xd0 (XEN) [<ffff82c480159632>] do_IRQ+0x562/0x6b0 (XEN) [<ffff82c48011d77e>] __do_softirq+0x6e/0x90 (XEN) [<ffff82c480152400>] common_interrupt+0x20/0x30 (XEN) (XEN) *** Dumping CPU0 guest state: *** (XEN) ----[ Xen-4.0.2-rc1-pre x86_64 debug=n Not tainted ]---- (XEN) CPU: 0 (XEN) RIP: e033:[<ffffffff8103b826>] (XEN) RFLAGS: 0000000000000286 EM: 1 CONTEXT: pv guest (XEN) rax: 000000000000b018 rbx: ffff880010310040 rcx: 0000000000000018 (XEN) rdx: ffff880010305000 rsi: 0000000000000000 rdi: ffff880010310040 (XEN) rbp: ffff8800103089d0 rsp: ffff880010308990 r8: 0000000000000001 (XEN) r9: 0000000000000001 r10: 0000000000000000 r11: 0000000000000001 (XEN) r12: 00000000000001f4 r13: ffff880035739e30 r14: 0000000000000000 (XEN) r15: 0000000000000001 cr0: 000000008005003b cr4: 00000000000026f0 (XEN) cr3: 00000000c73ec000 cr2: 00000000025fdd30 (XEN) ds: 0000 es: 0000 fs: 0000 gs: 0000 ss: e02b cs: e033 (XEN) Guest stack trace from rsp=ffff880010308990: (XEN) 0000000000000001 00000000ffffffff 0000000000000001 0000000000000000 (XEN) 0000000000000000 ffff880035739e30 0000000000000000 0000000000000001 (XEN) ffff8800103089e0 ffffffff81010d21 ffff8800103089f0 ffffffff8101c329 (XEN) ffff880010308a10 ffffffff81098aed ffffffff818c0028 0000000000000000 (XEN) ffff880010308a30 ffffffff81098b62 ffffffff818c5420 0000000000000002 (XEN) ffff880010308b10 ffffffff810a9569 ffff880010308a50 0000000000000000 (XEN) ffffffff818c5458 ffffffff00000001 ffff880010308ae0 00000039c3e99100 (XEN) ffff880010315360 ffff880010308ae0 ffffffff818c5bf8 000000000000001d (XEN) ffff880010308ae0 ffffffff8103b84f 0000000000000001 ffffffffffffffff (XEN) 0000000000000001 0000000000000001 ffffffff810106cd ffff880010308b40 (XEN) ffffffff81010f42 0000000000000001 0000000000000000 ffffffff818c5420 (XEN) 0000000000000002 0000000000000000 0000000000000000 0000000000000000 (XEN) ffff880010308b90 ffffffff810aa974 0000000000000000 ffffffff810e1502 (XEN) 0000000000000000 0000000000000000 0000000000000008 0000000000000154 (XEN) 00000000000003a0 0000000000000000 ffffffff81010f2f ffff880035739e18 (XEN) ffff880035739e30 00000000000001dd 0000000000000001 0000000000000100 (XEN) ffff880010308bc0 ffffffff815e1796 ffffffff810e1502 ffffffff815e15cb (XEN) ffff880035739da8 ffff880035739e18 ffff880010308bf0 ffffffff810e1502 (XEN) 0000000000000000 ffffffffff57a000 0000000000000000 0000000000000001 (XEN) ffff880010308c70 ffffffff813af4bb ffffffff000001dd 00000000001d3150 (XEN) (XEN) *** Dumping CPU1 host state: *** (XEN) ----[ Xen-4.0.2-rc1-pre x86_64 debug=n Not tainted ]---- (XEN) CPU: 1 (XEN) RIP: e008:[<ffff82c480111131>] __dump_execstate+0x1/0x60 (XEN) RFLAGS: 0000000000010002 CONTEXT: hypervisor (XEN) rax: ffff82c480111130 rbx: ffff82c48037a980 rcx: 0000000000000001 (XEN) rdx: 0000000000000080 rsi: 0000000000000002 rdi: 0000000000000000 (XEN) rbp: 0000000000000000 rsp: ffff83011fd67d88 r8: 0000000000000000 (XEN) r9: 0000000000000000 r10: 0000000000000001 r11: 0000000000000001 (XEN) r12: 0000000000d6d991 r13: 0000000000b516c5 r14: ffff82c48038df00 (XEN) r15: ffff82c48038de00 cr0: 000000008005003b cr4: 00000000000026f0 (XEN) cr3: 00000000df56c000 cr2: 0000000000000000 (XEN) ds: 0000 es: 0000 fs: 0000 gs: 0000 ss: 0000 cs: e008 (XEN) Xen stack trace from rsp=ffff83011fd67d88: (XEN) ffff82c48037a980 ffff82c48016ccd2 ffff82c48025e9c0 ffff82c48016d3ef (XEN) ffff82c48025e9c0 ffff83010c827a90 ffff83010c827b20 ffff82c4801470ba (XEN) ffff82c48038de00 ffff82c48038df00 0000000000b516c5 0000000000d6d991 (XEN) ffff83010c827b20 ffff83010c827a90 0000000000000001 0000000000000001 (XEN) 0000000000000000 0000000000000000 0000000000000002 0000000000000000 (XEN) 0000000000000240 0000000000000002 0000000000002000 000000fb00000000 (XEN) ffff82c48018bda0 000000000000e008 0000000000000297 ffff83011fd67e78 (XEN) 0000000000000000 0000000000d6d991 ffff82c48018de9a ffff83011fd67f28 (XEN) ffff82c480260110 ffff82c48037aa00 ffff82c48037aa00 ffffffffffffffff (XEN) ffff82c48037a980 0000000000000000 0000000000000000 000000018037a980 (XEN) 00001c8d0013b80a 000000fb00000000 ffff83011fd67f28 ffff82c48025eb00 (XEN) ffff83011fd67f28 0000000000000001 ffff82c48038df00 ffff82c48038de00 (XEN) ffff82c48014f0ce 0000000000000001 ffff83011fd67f28 0000000000000001 (XEN) 2bba2bbafc00fc00 7a7a7a7ab77cb77c a6bda6bd1ae41ae4 a075a075a050a050 (XEN) 3fa83fa8cb99cb99 7d577d57ea63ea63 62b062b0236e236e 39553955eb31eb31 (XEN) 2bba2bbafc00fc00 7a7a7a7ab77cb77c a6bda6bd1ae41ae4 ad47ad4796419641 (XEN) 259025908d148d14 f5e0f5e0c975c975 b872b872c2f1c2f1 06090609afa8afa8 (XEN) cec2cec257315731 2d292d29b2b0b2b0 eb25eb2561486148 ad47ad4796419641 (XEN) 259025908d148d14 f5e0f5e0c975c975 b872b872c2f1c2f1 06090609afa8afa8 (XEN) cec2cec257315731 2d292d2900000001 ffff8300df55e000 (XEN) Xen call trace: (XEN) [<ffff82c480111131>] __dump_execstate+0x1/0x60 (XEN) [<ffff82c48016ccd2>] __smp_call_function_interrupt+0x82/0x90 (XEN) [<ffff82c48016d3ef>] smp_call_function_interrupt+0x4f/0x90 (XEN) [<ffff82c4801470ba>] call_function_interrupt+0x2a/0x30 (XEN) [<ffff82c48018bda0>] hpet_broadcast_exit+0x0/0x160 (XEN) [<ffff82c48018de9a>] acpi_processor_idle+0x24a/0x820 (XEN) [<ffff82c48014f0ce>] idle_loop+0x2e/0x90 (XEN) (XEN) *** Dumping CPU1 guest state: *** (XEN) No guest context (CPU is idle). (XEN) (XEN) *** Dumping CPU2 host state: *** (XEN) ----[ Xen-4.0.2-rc1-pre x86_64 debug=n Not tainted ]---- (XEN) CPU: 2 (XEN) RIP: e008:[<ffff82c480111131>] __dump_execstate+0x1/0x60 (XEN) RFLAGS: 0000000000010002 CONTEXT: hypervisor (XEN) rax: ffff82c480111130 rbx: ffff82c48037a980 rcx: 0000000000000001 (XEN) rdx: 0000000000000100 rsi: 0000000000000023 rdi: 0000000000000000 (XEN) rbp: 0000000000000000 rsp: ffff83011fd57d38 r8: ffff8800042c3000 (XEN) r9: 0000000000000000 r10: ffff82c480200f20 r11: 0000000000000246 (XEN) r12: 0000000000000002 r13: ffffffff818bfd6f r14: ffffffffffffffda (XEN) r15: 0000000000000010 cr0: 000000008005003b cr4: 00000000000026f0 (XEN) cr3: 0000000109fb7000 cr2: ffff88000438b000 (XEN) ds: 0000 es: 0000 fs: 0000 gs: 0000 ss: e010 cs: e008 (XEN) Xen stack trace from rsp=ffff83011fd57d38: (XEN) ffff82c48037a980 ffff82c48016ccd2 ffff82c48025e9c0 ffff82c48016d3ef (XEN) ffff82c48037a980 ffff83011fcfa000 0000000000000023 ffff82c4801470ba (XEN) 0000000000000010 ffffffffffffffda ffffffff818bfd6f 0000000000000002 (XEN) 0000000000000023 ffff83011fcfa000 0000000000000246 ffff82c480200f20 (XEN) 0000000000000000 ffff8800042c3000 ffff8300df77c000 0000000000000000 (XEN) ffff83011fd73fe0 0000000000000023 ffff8300df772000 000000fb00000000 (XEN) ffff82c480107450 000000000000e008 0000000000000296 ffff83011fd57e28 (XEN) 000000000000e010 ffff82c480262100 ffff83010c95cf70 ffff8300c7624000 (XEN) 0000003a639c3914 ffff83010c95a180 ffff83010c95a000 ffff82c4801078ff (XEN) ffffffff818bfd08 ffffffff818bfd48 0000000000000000 ffff82c480107f64 (XEN) ffff8300c7624000 0000000001c9c380 ffff82c480262100 ffff82c48011f5d7 (XEN) ffff8300c7624000 0000000001c9c380 0000000000004000 ffff82c48037aa80 (XEN) ffffffffffffffff ffff82c48037a980 ffff830100000002 ffff82c48037e980 (XEN) ffff82c48037a980 ffff82c48011d770 0000000000000001 ffff8300c7624000 (XEN) ffffffff818bfd48 0000000000000000 ffffffff818bfd6f ffff880000000000 (XEN) 0000000000000010 ffff82c4801eb169 0000000000000010 ffff880000000000 (XEN) ffffffff818bfd6f 0000000000000000 ffffffff818bfd48 ffffffff818bfd08 (XEN) 0000000000000246 ffffffff818d0958 0000000000000000 ffff8800042c3000 (XEN) 0000000000000020 ffffffff8100940a 0000000000000800 ffffffff818bfd08 (XEN) 0000000000000004 0000010000000000 ffffffff8100940a 000000000000e033 (XEN) Xen call trace: (XEN) [<ffff82c480111131>] __dump_execstate+0x1/0x60 (XEN) [<ffff82c48016ccd2>] __smp_call_function_interrupt+0x82/0x90 (XEN) [<ffff82c48016d3ef>] smp_call_function_interrupt+0x4f/0x90 (XEN) [<ffff82c4801470ba>] call_function_interrupt+0x2a/0x30 (XEN) [<ffff82c480107450>] evtchn_set_pending+0x10/0x1a0 (XEN) [<ffff82c4801078ff>] evtchn_send+0xcf/0x140 (XEN) [<ffff82c480107f64>] do_event_channel_op+0x5f4/0x1000 (XEN) [<ffff82c48011f5d7>] timer_softirq_action+0x227/0x370 (XEN) [<ffff82c48011d770>] __do_softirq+0x60/0x90 (XEN) [<ffff82c4801eb169>] syscall_enter+0xa9/0xae (XEN) (XEN) *** Dumping CPU2 guest state: *** (XEN) ----[ Xen-4.0.2-rc1-pre x86_64 debug=n Not tainted ]---- (XEN) CPU: 2 (XEN) RIP: e033:[<ffffffff8100940a>] (XEN) RFLAGS: 0000000000000246 EM: 1 CONTEXT: pv guest (XEN) rax: 0000000000000020 rbx: ffffffff818bfd08 rcx: ffffffff8100940a (XEN) rdx: 0000000000000800 rsi: ffffffff818bfd08 rdi: 0000000000000004 (XEN) rbp: ffffffff818bfd48 rsp: ffffffff818bfcc0 r8: ffff8800042c3000 (XEN) r9: 0000000000000000 r10: ffffffff818d0958 r11: 0000000000000246 (XEN) r12: 0000000000000000 r13: ffffffff818bfd6f r14: ffff880000000000 (XEN) r15: 0000000000000010 cr0: 000000008005003b cr4: 00000000000026f0 (XEN) cr3: 0000000109fb7000 cr2: 0000000000000000 (XEN) ds: 0000 es: 0000 fs: 0000 gs: 0000 ss: e02b cs: e033 (XEN) Guest stack trace from rsp=ffffffff818bfcc0: (XEN) 0000000000000009 ffffffff818bfd6f ffffffff813e375e ffffffff00000000 (XEN) ffffffff818bfcec ffffffffffffffff 0000000000c46deb 0000003332373638 (XEN) 3d5d956d9796447f 0000000000000002 ffffffff818bfe6f ffffffff817db37f (XEN) 0000000000000010 0000000000000022 0000000000000010 0000000000000000 (XEN) ffffffff81c46def ffffffff818bfdb8 ffffffff813e26c1 0000006cffffffff (XEN) 0000000000000000 302e30202020205b 2e205d3030303030 0000000000000000 (XEN) 3d5d956d9796447f ffffffff810106cd ffffffff81920c60 ffffffff8198fe98 (XEN) 00000000000014ef 0000000000000032 00000000ffffffff ffffffff818bfde8 (XEN) ffffffff8106b5f5 0000000000001521 0000000000001521 0000000000001521 (XEN) 0000000000000000 ffffffff818bfe08 ffffffff8106b65a 0000000000000035 (XEN) 00000000ffffeadf ffffffff818bfe38 ffffffff8106bba4 ffffffff81c85943 (XEN) 0000000000000035 ffffffff818bfe68 0000000000000034 ffffffff818bfed8 (XEN) ffffffff8106c176 ffffffff818bfe76 0000000000000200 0000000f825ba990 (XEN) ffffffff818bfe77 302e30202020205b 00205d3030303030 ffffffff818bfea8 (XEN) ffffffff810a6123 ffffffff00000000 ffffffff827090c0 ffffffffffffffff (XEN) 3d5d956d9796447f ffffffff818bfeb8 ffffffff81bb0540 ffffffff81bb3d60 (XEN) 0000000000000000 ffffffffffffffff 0000000000000000 ffffffff818bff38 (XEN) ffffffff815ddc14 ffffffff00000010 ffffffff818bff48 ffffffff818bff08 (XEN) 0000000000000000 ffffffffffffffff 0000000000008000 0000000000000000 (XEN) 0000000000000000 0000000000000002 0000000000000000 ffffffff818bff48 (XEN) (XEN) *** Dumping CPU3 host state: *** (XEN) ----[ Xen-4.0.2-rc1-pre x86_64 debug=n Not tainted ]---- (XEN) CPU: 3 (XEN) RIP: e008:[<ffff82c480111131>] __dump_execstate+0x1/0x60 (XEN) RFLAGS: 0000000000010002 CONTEXT: hypervisor (XEN) rax: ffff82c480111130 rbx: ffff82c48037a980 rcx: 0000000000000001 (XEN) rdx: 0000000000000180 rsi: 0000000000000002 rdi: 0000000000000000 (XEN) rbp: 0000000000000000 rsp: ffff83011fd47d88 r8: 0000000000000000 (XEN) r9: 0000000000000001 r10: ffff82c480380450 r11: 0000000000000000 (XEN) r12: 0000000000ff1ba8 r13: 00000000009cb9d0 r14: ffff82c48038e100 (XEN) r15: ffff82c48038de00 cr0: 000000008005003b cr4: 00000000000026f0 (XEN) cr3: 00000000df56c000 cr2: 0000000000000000 (XEN) ds: 0000 es: 0000 fs: 0000 gs: 0000 ss: 0000 cs: e008 (XEN) Xen stack trace from rsp=ffff83011fd47d88: (XEN) ffff82c48037a980 ffff82c48016ccd2 ffff82c48025e9c0 ffff82c48016d3ef (XEN) 00000000007f31db ffff83010c826e00 ffff83010c826ec0 ffff82c4801470ba (XEN) ffff82c48038de00 ffff82c48038e100 00000000009cb9d0 0000000000ff1ba8 (XEN) ffff83010c826ec0 ffff83010c826e00 0000000000000000 ffff82c480380450 (XEN) 0000000000000001 0000000000000000 0000000000000002 0000000000000000 (XEN) 0000000000000240 0000000000000002 0000000000006000 000000fb00000000 (XEN) ffff82c48018bda0 000000000000e008 0000000000000297 ffff83011fd47e78 (XEN) 0000000000000000 0000000000ff1ba8 ffff82c48018de9a 0000000000000000 (XEN) ffff82c480264110 ffff82c48037ab00 0000000000000100 ffff82c48037a980 (XEN) ffff82c480171a24 0000000000000000 0000000000000000 00000000ffffffff (XEN) 00000d11000b53c2 000000f900000000 ffff83011fd47f28 ffff82c48025eb00 (XEN) ffff83011fd47f28 0000000000000003 ffff82c48038e100 ffff82c48038de00 (XEN) ffff82c48014f0ce 0000000000000003 ffff83011fd47f28 0000000000000003 (XEN) 2bba2bbafc00fc00 7a7a7a7ab77cb77c 59425942e51be51b 5f8a5f8a5faf5faf (XEN) c057c05734663466 7d577d57ea63ea63 62b062b0236e236e c6aac6aa14ce14ce (XEN) 2bba2bbafc00fc00 7a7a7a7ab77cb77c 59425942e51be51b ad47ad4796419641 (XEN) 259025908d148d14 0a1f0a1f368a368a 478d478d3d0e3d0e 06090609afa8afa8 (XEN) cec2cec257315731 2d292d29b2b0b2b0 14da14da9eb79eb7 ad47ad4796419641 (XEN) 259025908d148d14 0a1f0a1f368a368a 478d478d3d0e3d0e 06090609afa8afa8 (XEN) cec2cec257315731 2d292d2900000003 ffff8300df778000 (XEN) Xen call trace: (XEN) [<ffff82c480111131>] __dump_execstate+0x1/0x60 (XEN) [<ffff82c48016ccd2>] __smp_call_function_interrupt+0x82/0x90 (XEN) [<ffff82c48016d3ef>] smp_call_function_interrupt+0x4f/0x90 (XEN) [<ffff82c4801470ba>] call_function_interrupt+0x2a/0x30 (XEN) [<ffff82c48018bda0>] hpet_broadcast_exit+0x0/0x160 (XEN) [<ffff82c48018de9a>] acpi_processor_idle+0x24a/0x820 (XEN) [<ffff82c480171a24>] local_time_calibration+0x1b4/0x1c0 (XEN) [<ffff82c48014f0ce>] idle_loop+0x2e/0x90 (XEN) (XEN) *** Dumping CPU3 guest state: *** (XEN) No guest context (CPU is idle). (XEN) (XEN) *** Dumping CPU4 host state: *** (XEN) ----[ Xen-4.0.2-rc1-pre x86_64 debug=n Not tainted ]---- (XEN) CPU: 4 (XEN) RIP: e008:[<ffff82c480111131>] __dump_execstate+0x1/0x60 (XEN) RFLAGS: 0000000000010002 CONTEXT: hypervisor (XEN) rax: ffff82c480111130 rbx: ffff82c48037a980 rcx: 0000000000000001 (XEN) rdx: 0000000000000200 rsi: 0000000000000002 rdi: 0000000000000000 (XEN) rbp: 0000000000000000 rsp: ffff83011fd37d88 r8: 0000000000000000 (XEN) r9: 0000000000000001 r10: ffff82c480380480 r11: 0000000000000000 (XEN) r12: 00000000000d89ca r13: 00000000009cb9c1 r14: ffff82c48038e200 (XEN) r15: ffff82c48038de00 cr0: 000000008005003b cr4: 00000000000026f0 (XEN) cr3: 00000000df56c000 cr2: 0000000000000000 (XEN) ds: 0000 es: 0000 fs: 0000 gs: 0000 ss: 0000 cs: e008 (XEN) Xen stack trace from rsp=ffff83011fd37d88: (XEN) ffff82c48037a980 ffff82c48016ccd2 ffff82c48025e9c0 ffff82c48016d3ef (XEN) 0000000000c0267b ffff83010c8257d0 ffff83010c825890 ffff82c4801470ba (XEN) ffff82c48038de00 ffff82c48038e200 00000000009cb9c1 00000000000d89ca (XEN) ffff83010c825890 ffff83010c8257d0 0000000000000000 ffff82c480380480 (XEN) 0000000000000001 0000000000000000 0000000000000002 0000000000000000 (XEN) 0000000000000240 0000000000000002 0000000000008000 000000fb00000000 (XEN) ffff82c48018bda0 000000000000e008 0000000000000297 ffff83011fd37e78 (XEN) 0000000000000000 00000000000d89ca ffff82c48018de9a ffff83011fd37f28 (XEN) ffff82c480266110 ffff82c48037ab80 0000000000000100 ffff82c48037a980 (XEN) ffff82c480171a24 0000000000000000 0000000000000000 00000000ffffffff (XEN) 00000d110007429f 000000f900000000 ffff83011fd37f28 ffff82c48025eb00 (XEN) ffff83011fd37f28 0000000000000004 ffff82c48038e200 ffff82c48038de00 (XEN) ffff82c48014f0ce 0000000000000004 ffff83011fd37f28 0000000000000004 (XEN) 2bba2bbafc00fc00 7a7a7a7ab77cb77c a6bda6bd1ae41ae4 5f8a5f8a5faf5faf (XEN) 3fa83fa8cb99cb99 82a882a8159c159c 9d4f9d4fdc91dc91 c6aac6aa14ce14ce (XEN) 2bba2bbafc00fc00 7a7a7a7ab77cb77c a6bda6bd1ae41ae4 ad47ad4796419641 (XEN) 259025908d148d14 0a1f0a1f368a368a b872b872c2f1c2f1 f9f6f9f650575057 (XEN) 313d313da8cea8ce d2d6d2d64d4f4d4f 14da14da9eb79eb7 ad47ad4796419641 (XEN) 259025908d148d14 0a1f0a1f368a368a b872b872c2f1c2f1 f9f6f9f650575057 (XEN) 313d313da8cea8ce d2d6d2d600000004 ffff8300df2fa000 (XEN) Xen call trace: (XEN) [<ffff82c480111131>] __dump_execstate+0x1/0x60 (XEN) [<ffff82c48016ccd2>] __smp_call_function_interrupt+0x82/0x90 (XEN) [<ffff82c48016d3ef>] smp_call_function_interrupt+0x4f/0x90 (XEN) [<ffff82c4801470ba>] call_function_interrupt+0x2a/0x30 (XEN) [<ffff82c48018bda0>] hpet_broadcast_exit+0x0/0x160 (XEN) [<ffff82c48018de9a>] acpi_processor_idle+0x24a/0x820 (XEN) [<ffff82c480171a24>] local_time_calibration+0x1b4/0x1c0 (XEN) [<ffff82c48014f0ce>] idle_loop+0x2e/0x90 (XEN) (XEN) *** Dumping CPU4 guest state: *** (XEN) No guest context (CPU is idle). (XEN) (XEN) *** Dumping CPU5 host state: *** (XEN) ----[ Xen-4.0.2-rc1-pre x86_64 debug=n Not tainted ]---- (XEN) CPU: 5 (XEN) RIP: e008:[<ffff82c480111131>] __dump_execstate+0x1/0x60 (XEN) RFLAGS: 0000000000010002 CONTEXT: hypervisor (XEN) rax: ffff82c480111130 rbx: ffff82c48037a980 rcx: 0000000000000001 (XEN) rdx: 0000000000000280 rsi: 0000000000000002 rdi: 0000000000000000 (XEN) rbp: 0000000000000000 rsp: ffff83011fd2fd88 r8: 0000000000000000 (XEN) r9: 0000000000000001 r10: ffff82c4803804b0 r11: 0000000000000001 (XEN) r12: 00000000001bf94f r13: 0000000000b52901 r14: ffff82c48038e300 (XEN) r15: ffff82c48038de00 cr0: 000000008005003b cr4: 00000000000026f0 (XEN) cr3: 00000000df56c000 cr2: 0000000000000000 (XEN) ds: 0000 es: 0000 fs: 0000 gs: 0000 ss: 0000 cs: e008 (XEN) Xen stack trace from rsp=ffff83011fd2fd88: (XEN) ffff82c48037a980 ffff82c48016ccd2 ffff82c48025e9c0 ffff82c48016d3ef (XEN) 0000000000b516c1 ffff83010c824340 ffff83010c824400 ffff82c4801470ba (XEN) ffff82c48038de00 ffff82c48038e300 0000000000b52901 00000000001bf94f (XEN) ffff83010c824400 ffff83010c824340 0000000000000001 ffff82c4803804b0 (XEN) 0000000000000001 0000000000000000 0000000000000002 0000000000000000 (XEN) 0000000000000240 0000000000000002 000000000000a000 000000fb00000000 (XEN) ffff82c48018bda0 000000000000e008 0000000000000297 ffff83011fd2fe78 (XEN) 0000000000000000 00000000001bf94f ffff82c48018de9a ffff83011fd2ff28 (XEN) ffff82c480268110 ffff82c48037ac00 ffff82c48037ac00 ffffffffffffffff (XEN) ffff82c48037a980 0000000000000000 0000000000000000 000000008037a980 (XEN) 0000176e000fb957 000000f900000000 ffff83011fd2ff28 ffff82c48025eb00 (XEN) ffff83011fd2ff28 0000000000000005 ffff82c48038e300 ffff82c48038de00 (XEN) ffff82c48014f0ce 0000000000000005 ffff83011fd2ff28 0000000000000005 (XEN) 1b7b1b7b2a942a94 18b218b203b603b6 87498749052d052d 2acd2acd93f393f3 (XEN) aedaaeda2e372e37 6dc46dc4351e351e da8cda8c28222822 96c296c2dc7bdc7b (XEN) 1b7b1b7b2a942a94 18b218b203b603b6 87498749052d052d d800d8005a1d5a1d (XEN) b4e2b4e268ba68ba 1a8c1a8ce9f7e9f7 004e004ec9bdc9bd a99ea99e98e298e2 (XEN) 01fc01fc7e5a7e5a 4fe14fe1067a067a cad1cad17e817e81 d800d8005a1d5a1d (XEN) b4e2b4e268ba68ba 1a8c1a8ce9f7e9f7 004e004ec9bdc9bd a99ea99e98e298e2 (XEN) 01fc01fc7e5a7e5a 4fe14fe100000005 ffff8300df2f8000 (XEN) Xen call trace: (XEN) [<ffff82c480111131>] __dump_execstate+0x1/0x60 (XEN) [<ffff82c48016ccd2>] __smp_call_function_interrupt+0x82/0x90 (XEN) [<ffff82c48016d3ef>] smp_call_function_interrupt+0x4f/0x90 (XEN) [<ffff82c4801470ba>] call_function_interrupt+0x2a/0x30 (XEN) [<ffff82c48018bda0>] hpet_broadcast_exit+0x0/0x160 (XEN) [<ffff82c48018de9a>] acpi_processor_idle+0x24a/0x820 (XEN) [<ffff82c48014f0ce>] idle_loop+0x2e/0x90 (XEN) (XEN) *** Dumping CPU5 guest state: *** (XEN) No guest context (CPU is idle). (XEN) (XEN) *** Dumping CPU6 host state: *** (XEN) ----[ Xen-4.0.2-rc1-pre x86_64 debug=n Not tainted ]---- (XEN) CPU: 6 (XEN) RIP: e008:[<ffff82c480111131>] __dump_execstate+0x1/0x60 (XEN) RFLAGS: 0000000000010002 CONTEXT: hypervisor (XEN) rax: ffff82c480111130 rbx: ffff82c48037a980 rcx: 0000000000000001 (XEN) rdx: 0000000000000300 rsi: 0000000000000002 rdi: 0000000000000000 (XEN) rbp: 0000000000000000 rsp: ffff83011fd1fd88 r8: 0000000000000000 (XEN) r9: 0000000000000000 r10: 0000000000000001 r11: 0000000000000001 (XEN) r12: 00000000002a17c9 r13: 0000000000c54ce7 r14: ffff82c48038e400 (XEN) r15: ffff82c48038de00 cr0: 000000008005003b cr4: 00000000000026f0 (XEN) cr3: 00000000df56c000 cr2: 0000000000000000 (XEN) ds: 0000 es: 0000 fs: 0000 gs: 0000 ss: 0000 cs: e008 (XEN) Xen stack trace from rsp=ffff83011fd1fd88: (XEN) ffff82c48037a980 ffff82c48016ccd2 ffff82c48025e9c0 ffff82c48016d3ef (XEN) 0000000000c534c2 ffff83010c824b60 ffff83010c824bf0 ffff82c4801470ba (XEN) ffff82c48038de00 ffff82c48038e400 0000000000c54ce7 00000000002a17c9 (XEN) ffff83010c824bf0 ffff83010c824b60 0000000000000001 0000000000000001 (XEN) 0000000000000000 0000000000000000 0000000000000002 0000000000000000 (XEN) 0000000000000240 0000000000000002 000000000000c000 000000fb00000000 (XEN) ffff82c48018bda0 000000000000e008 0000000000000297 ffff83011fd1fe78 (XEN) 0000000000000000 00000000002a17c9 ffff82c48018de9a ffff83011fd1ff28 (XEN) ffff82c48026a110 ffff82c48037ac80 ffff82c48037ac80 ffffffffffffffff (XEN) ffff82c48037a980 0000000000000000 0000000000000000 000000018037a980 (XEN) 000001fe00000149 000000f900000000 ffff83011fd1ff28 ffff82c48025eb00 (XEN) ffff83011fd1ff28 0000000000000006 ffff82c48038e400 ffff82c48038de00 (XEN) ffff82c48014f0ce 0000000000000006 ffff83011fd1ff28 0000000000000006 (XEN) e484e484d56bd56b 18b218b203b603b6 87498749052d052d d532d5326c0c6c0c (XEN) aedaaeda2e372e37 6dc46dc4351e351e da8cda8c28222822 693d693d23842384 (XEN) e484e484d56bd56b 18b218b203b603b6 87498749052d052d 27ff27ffa5e2a5e2 (XEN) b4e2b4e268ba68ba e573e57316081608 ffb1ffb136423642 56615661671d671d (XEN) fe03fe0381a581a5 4fe14fe1067a067a cad1cad17e817e81 27ff27ffa5e2a5e2 (XEN) b4e2b4e268ba68ba e573e57316081608 ffb1ffb136423642 56615661671d671d (XEN) fe03fe0381a581a5 4fe14fe100000006 ffff8300df776000 (XEN) Xen call trace: (XEN) [<ffff82c480111131>] __dump_execstate+0x1/0x60 (XEN) [<ffff82c48016ccd2>] __smp_call_function_interrupt+0x82/0x90 (XEN) [<ffff82c48016d3ef>] smp_call_function_interrupt+0x4f/0x90 (XEN) [<ffff82c4801470ba>] call_function_interrupt+0x2a/0x30 (XEN) [<ffff82c48018bda0>] hpet_broadcast_exit+0x0/0x160 (XEN) [<ffff82c48018de9a>] acpi_processor_idle+0x24a/0x820 (XEN) [<ffff82c48014f0ce>] idle_loop+0x2e/0x90 (XEN) (XEN) *** Dumping CPU6 guest state: *** (XEN) No guest context (CPU is idle). (XEN) (XEN) *** Dumping CPU7 host state: *** (XEN) ----[ Xen-4.0.2-rc1-pre x86_64 debug=n Not tainted ]---- (XEN) CPU: 7 (XEN) RIP: e008:[<ffff82c480111131>] __dump_execstate+0x1/0x60 (XEN) RFLAGS: 0000000000010002 CONTEXT: hypervisor (XEN) rax: ffff82c480111130 rbx: ffff82c48037a980 rcx: 0000000000000001 (XEN) rdx: 0000000000000380 rsi: 0000000000000002 rdi: 0000000000000000 (XEN) rbp: 0000000000000000 rsp: ffff83011fd0fd88 r8: 0000000000000000 (XEN) r9: 0000000000000000 r10: 0000000000000001 r11: 0000000000000001 (XEN) r12: 0000000000383753 r13: 0000000000ff1bcd r14: ffff82c48038e500 (XEN) r15: ffff82c48038de00 cr0: 000000008005003b cr4: 00000000000026f0 (XEN) cr3: 00000000df56c000 cr2: 0000000000000000 (XEN) ds: 0000 es: 0000 fs: 0000 gs: 0000 ss: 0000 cs: e008 (XEN) Xen stack trace from rsp=ffff83011fd0fd88: (XEN) ffff82c48037a980 ffff82c48016ccd2 ffff82c48025e9c0 ffff82c48016d3ef (XEN) ffff82c48025e9c0 ffff830108823520 ffff8301088235b0 ffff82c4801470ba (XEN) ffff82c48038de00 ffff82c48038e500 0000000000ff1bcd 0000000000383753 (XEN) ffff8301088235b0 ffff830108823520 0000000000000001 0000000000000001 (XEN) 0000000000000000 0000000000000000 0000000000000002 0000000000000000 (XEN) 0000000000000240 0000000000000002 000000000000e000 000000fb00000000 (XEN) ffff82c48018bda0 000000000000e008 0000000000000297 ffff83011fd0fe78 (XEN) 0000000000000000 0000000000383753 ffff82c48018de9a ffff83011fd0ff28 (XEN) ffff82c48026c110 ffff82c48037ad00 ffff82c48037ad00 ffffffffffffffff (XEN) ffff82c48037a980 0000000000000000 0000000000000000 000000018037a980 (XEN) 000008720009ee92 000000f900000000 ffff83011fd0ff28 ffff82c48025eb00 (XEN) ffff83011fd0ff28 0000000000000007 ffff82c48038e500 ffff82c48038de00 (XEN) ffff82c48014f0ce 0000000000000007 ffff83011fd0ff28 0000000000000007 (XEN) 1b7b1b7b2a942a94 18b218b203b603b6 87498749052d052d d532d5326c0c6c0c (XEN) 51255125d1c8d1c8 6dc46dc4351e351e 25732573d7ddd7dd 693d693d23842384 (XEN) 1b7b1b7b2a942a94 18b218b203b603b6 87498749052d052d d800d8005a1d5a1d (XEN) b4e2b4e268ba68ba 1a8c1a8ce9f7e9f7 ffb1ffb136423642 a99ea99e98e298e2 (XEN) 01fc01fc7e5a7e5a b01eb01ef985f985 cad1cad17e817e81 d800d8005a1d5a1d (XEN) b4e2b4e268ba68ba 1a8c1a8ce9f7e9f7 ffb1ffb136423642 a99ea99e98e298e2 (XEN) 01fc01fc7e5a7e5a b01eb01e00000007 ffff8300df774000 (XEN) Xen call trace: (XEN) [<ffff82c480111131>] __dump_execstate+0x1/0x60 (XEN) [<ffff82c48016ccd2>] __smp_call_function_interrupt+0x82/0x90 (XEN) [<ffff82c48016d3ef>] smp_call_function_interrupt+0x4f/0x90 (XEN) [<ffff82c4801470ba>] call_function_interrupt+0x2a/0x30 (XEN) [<ffff82c48018bda0>] hpet_broadcast_exit+0x0/0x160 (XEN) [<ffff82c48018de9a>] acpi_processor_idle+0x24a/0x820 (XEN) [<ffff82c48014f0ce>] idle_loop+0x2e/0x90 (XEN) -Bruce _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel