thr3ads.net - Xen users - [Xen-users] pv_ops domU crashes on pv

If this information is useful, please help other people find it:
Share via:

Markus Schuster

2009-Dec-05 22:52 UTC

[Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

Hi list, 

I''m experiencing some really strange behavior when booting a pv_ops
domU more
recent than kernel 2.6.29 (!) on a pv_ops dom0 (directly from git). 
I''m using XEN 3.4.2 (Debian unstable packages (3.4.2-2) compiled for
lenny) on
Debian lenny. 
I''ve checked out pv_ops dom0 source as described in the wiki -
currently I''m
working with changeset 8735edb4a976105fd29c97c00c6d14760537e4ee. 
domU kernel is a prebuilt kernel image from Debian unstable.

The strange thing: With the same binaries, I can''t trigger this problem
in my
test environment (Athlon 64 3500+ socket 939, 2G RAM), only on my production 
server (2x Opteron 2218 (dual core) socket F, 8GB RAM) - maybe it''s a
SMP
related problem?

dom0 .config:
http://markus.schuster.name/bugreport/xen/dom0-config.txt

kernel output of crashing domU
http://markus.schuster.name/bugreport/xen/domU-2.6.31.txt
http://markus.schuster.name/bugreport/xen/domU-2.6.32-rc8.txt

kernel output of working domU
http://markus.schuster.name/bugreport/xen/domU-2.6.29.txt

For those just wanting to have a quick look, here is the relevant kernel 
output from a 2.6.31 domU:
[..]
[    0.012368] Booting paravirtualized kernel on Xen
[    0.012368] Xen version: 3.4 (preserve-AD)
[    0.012368] Grant table initialized
[    0.012368] regulator: core version 0.5
[    0.012368] NET: Registered protocol family 16
[    0.108050] PCI: Fatal: No config space access function found
[    0.108555] bio: create slab <bio-0> at 0
[    0.108555] ACPI: Interpreter disabled.
[    0.108555] xen_balloon: Initialising balloon driver.
[    0.112044] usbcore: registered new interface driver usbfs
[    0.112074] usbcore: registered new interface driver hub
[    0.112099] usbcore: registered new device driver usb
[    0.112099] PCI: System does not support PCI
[    0.112099] PCI: System does not support PCI
[    0.125982] pnp: PnP ACPI: disabled
[    0.126234] NET: Registered protocol family 2
[    0.126234] IP route cache hash table entries: 65536 (order: 7, 524288 
bytes)
[    0.128563] TCP established hash table entries: 262144 (order: 10, 4194304 
bytes)
[    0.130630] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[    0.131149] TCP: Hash tables configured (established 262144 bind 65536)
[    0.131164] TCP reno registered
[    0.131416] NET: Registered protocol family 1
[    0.131510] Unpacking initramfs...
[    0.162893] Freeing initrd memory: 21240k freed
[    0.176404] platform rtc_cmos: registered platform RTC device (no PNP 
device found)
[    0.176433] BUG: unable to handle kernel NULL pointer dereference at (null)
[    0.176445] IP: [<ffffffff81386142>] cache_add_dev+0x2e/0x2ae
[    0.176461] PGD 0
[    0.176468] Oops: 0000 [#1] SMP
[    0.176477] last sysfs file:
[    0.176484] CPU 0
[    0.176490] Modules linked in:
[    0.176500] Pid: 1, comm: swapper Tainted: G        W  2.6.31-1-amd64 #1
[    0.176508] RIP: e030:[<ffffffff81386142>]  [<ffffffff81386142>] 
cache_add_dev+0x2e/0x2ae
[    0.176522] RSP: e02b:ffff88007ffe5e50  EFLAGS: 00010246
[    0.176529] RAX: 0000000000000003 RBX: 0000000000000000 RCX: 
000000008a54cc73
[    0.176537] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 
0000000000000000
[    0.176545] RBP: ffffffff8152df60 R08: 0000000000000200 R09: 
ffffffff8152df60
[    0.176553] R10: 0000000000000000 R11: ffffffff81200d1d R12: 
00000000fffffffe
[    0.176561] R13: ffffffff8152dfa0 R14: ffffffff8158af20 R15: 
0000000000000000
[    0.176573] FS:  0000000000000000(0000) GS:ffffc90000000000(0000) 
knlGS:0000000000000000
[    0.176583] CS:  e033 DS: 0000 ES: 0000 CR0: 000000008005003b
[    0.176590] CR2: 0000000000000000 CR3: 0000000001001000 CR4: 
0000000000000660
[    0.176599] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 
0000000000000000
[    0.176607] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 
0000000000000400
[    0.176615] Process swapper (pid: 1, threadinfo ffff88007ffe4000, task 
ffff88007ffc6740)
[    0.176625] Stack:
[    0.176630]  0000000000000002 00000000ffffffea ffffffff8152dfa0 
ffffffff8158af20
[    0.176643] <0> 000000008a54cc73 0000000000000000 ffffffff8152df60 
0000000000000000
[    0.176658] <0> ffffffff8152dfa0 ffffffff8158af20 00000000014bd800 
ffffffff81386503
[    0.176677] Call Trace:
[    0.176687]  [<ffffffff81386503>] ? cache_sysfs_init+0x3b/0x86
[    0.176699]  [<ffffffff81550787>] ? i8237A_init_sysfs+0x0/0x5e
[    0.176708]  [<ffffffff813864c8>] ? cache_sysfs_init+0x0/0x86
[    0.176718]  [<ffffffff8100a0a6>] ? do_one_initcall+0x78/0x1a8
[    0.176727]  [<ffffffff81549a5b>] ? kernel_init+0x178/0x1e5
[    0.176738]  [<ffffffff81012f2a>] ? child_rip+0xa/0x20
[    0.180013]  [<ffffffff810120e7>] ? int_ret_from_sys_call+0x7/0x1b
[    0.180013]  [<ffffffff8101289d>] ? retint_restore_args+0x5/0x6
[    0.180013]  [<ffffffff81200d1d>] ? dummycon_dummy+0x0/0x2e
[    0.180013]  [<ffffffff81200d1d>] ? dummycon_dummy+0x0/0x2e
[    0.180013]  [<ffffffff81012f20>] ? child_rip+0x0/0x20
[    0.180013] Code: 89 ff 41 56 41 55 41 54 41 bc fe ff ff ff 55 53 48 83 ec 
28 65 48 8b 04 25 28 00 00 00 48 89 44 24 20 31 c0 66 8b 05 4e 35 29 00
<44>
8b 37 66 85 c0 0f 84 4d 02 00 00 45 89 f5 0f b7 f8 48 c7 c5
[    0.180013] RIP  [<ffffffff81386142>] cache_add_dev+0x2e/0x2ae
[    0.180013]  RSP <ffff88007ffe5e50>
[    0.180013] CR2: 0000000000000000
[    0.180013] ---[ end trace a7919e7f17c0a726 ]---
[    0.209859] Kernel panic - not syncing: Attempted to kill init!
[    0.209869] Pid: 1, comm: swapper Tainted: G      D W  2.6.31-1-amd64 #1
[    0.209877] Call Trace:
[    0.209886]  [<ffffffff8138df3c>] ? panic+0x96/0x14a
[    0.209895]  [<ffffffff81200d1d>] ? dummycon_dummy+0x0/0x2e
[    0.209906]  [<ffffffff8100e592>] ? check_events+0x12/0x20
[    0.209915]  [<ffffffff813908a6>] ? _write_lock_irq+0x1b/0x43
[    0.209926]  [<ffffffff8106828b>] ? exit_ptrace+0xb7/0x14b
[    0.209935]  [<ffffffff813908a6>] ? _write_lock_irq+0x1b/0x43
[    0.209945]  [<ffffffff81060184>] ? do_exit+0x82/0x698
[    0.209955]  [<ffffffff8105cd81>] ? release_console_sem+0x1a4/0x1ed
[    0.209965]  [<ffffffff8101685f>] ? oops_end+0xc3/0xdf
[    0.209974]  [<ffffffff8103bcab>] ? no_context+0x1fc/0x220
[    0.209984]  [<ffffffff81200d1d>] ? dummycon_dummy+0x0/0x2e
[    0.209993]  [<ffffffff8103be6f>] ? __bad_area_nosemaphore+0x1a0/0x1dc
[    0.210002]  [<ffffffff8100e57f>] ? xen_restore_fl_direct_end+0x0/0x1
[    0.210012]  [<ffffffff8105d46c>] ? vprintk+0x300/0x343
[    0.210021]  [<ffffffff8100db31>] ? xen_force_evtchn_callback+0x1d/0x37
[    0.210031]  [<ffffffff8103c16c>] ? do_page_fault+0xae/0x315
[    0.210040]  [<ffffffff81391095>] ? page_fault+0x25/0x30
[    0.210049]  [<ffffffff81200d1d>] ? dummycon_dummy+0x0/0x2e
[    0.210058]  [<ffffffff81386142>] ? cache_add_dev+0x2e/0x2ae
[    0.210068]  [<ffffffff81386503>] ? cache_sysfs_init+0x3b/0x86
[    0.210079]  [<ffffffff81550787>] ? i8237A_init_sysfs+0x0/0x5e
[    0.210088]  [<ffffffff813864c8>] ? cache_sysfs_init+0x0/0x86
[    0.210097]  [<ffffffff8100a0a6>] ? do_one_initcall+0x78/0x1a8
[    0.210107]  [<ffffffff81549a5b>] ? kernel_init+0x178/0x1e5
[    0.210116]  [<ffffffff81012f2a>] ? child_rip+0xa/0x20
[    0.210125]  [<ffffffff810120e7>] ? int_ret_from_sys_call+0x7/0x1b
[    0.210133]  [<ffffffff8101289d>] ? retint_restore_args+0x5/0x6
[    0.210143]  [<ffffffff81200d1d>] ? dummycon_dummy+0x0/0x2e
[    0.210152]  [<ffffffff81200d1d>] ? dummycon_dummy+0x0/0x2e
[    0.210161]  [<ffffffff81012f20>] ? child_rip+0x0/0x20

Regards,
Markus Schuster

_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

Pasi Kärkkäinen

2009-Dec-06 00:40 UTC

head link

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

Hello,

Jeremy: Is this already known bug/crash?

-- Pasi

On Sat, Dec 05, 2009 at 11:52:06PM +0100, Markus Schuster
wrote:> Hi list, 
> 
> I''m experiencing some really strange behavior when booting a
pv_ops domU more
> recent than kernel 2.6.29 (!) on a pv_ops dom0 (directly from git). 
> I''m using XEN 3.4.2 (Debian unstable packages (3.4.2-2) compiled
for lenny) on
> Debian lenny. 
> I''ve checked out pv_ops dom0 source as described in the wiki -
currently I''m
> working with changeset 8735edb4a976105fd29c97c00c6d14760537e4ee. 
> domU kernel is a prebuilt kernel image from Debian unstable.
> 
> The strange thing: With the same binaries, I can''t trigger this
problem in my
> test environment (Athlon 64 3500+ socket 939, 2G RAM), only on my
production
> server (2x Opteron 2218 (dual core) socket F, 8GB RAM) - maybe
it''s a SMP
> related problem?
> 
> dom0 .config:
> http://markus.schuster.name/bugreport/xen/dom0-config.txt
> 
> kernel output of crashing domU
> http://markus.schuster.name/bugreport/xen/domU-2.6.31.txt
> http://markus.schuster.name/bugreport/xen/domU-2.6.32-rc8.txt
> 
> kernel output of working domU
> http://markus.schuster.name/bugreport/xen/domU-2.6.29.txt
> 
> For those just wanting to have a quick look, here is the relevant kernel 
> output from a 2.6.31 domU:
> [..]
> [    0.012368] Booting paravirtualized kernel on Xen
> [    0.012368] Xen version: 3.4 (preserve-AD)
> [    0.012368] Grant table initialized
> [    0.012368] regulator: core version 0.5
> [    0.012368] NET: Registered protocol family 16
> [    0.108050] PCI: Fatal: No config space access function found
> [    0.108555] bio: create slab <bio-0> at 0
> [    0.108555] ACPI: Interpreter disabled.
> [    0.108555] xen_balloon: Initialising balloon driver.
> [    0.112044] usbcore: registered new interface driver usbfs
> [    0.112074] usbcore: registered new interface driver hub
> [    0.112099] usbcore: registered new device driver usb
> [    0.112099] PCI: System does not support PCI
> [    0.112099] PCI: System does not support PCI
> [    0.125982] pnp: PnP ACPI: disabled
> [    0.126234] NET: Registered protocol family 2
> [    0.126234] IP route cache hash table entries: 65536 (order: 7, 524288 
> bytes)
> [    0.128563] TCP established hash table entries: 262144 (order: 10,
4194304
> bytes)
> [    0.130630] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
> [    0.131149] TCP: Hash tables configured (established 262144 bind 65536)
> [    0.131164] TCP reno registered
> [    0.131416] NET: Registered protocol family 1
> [    0.131510] Unpacking initramfs...
> [    0.162893] Freeing initrd memory: 21240k freed
> [    0.176404] platform rtc_cmos: registered platform RTC device (no PNP 
> device found)
> [    0.176433] BUG: unable to handle kernel NULL pointer dereference at
(null)
> [    0.176445] IP: [<ffffffff81386142>] cache_add_dev+0x2e/0x2ae
> [    0.176461] PGD 0
> [    0.176468] Oops: 0000 [#1] SMP
> [    0.176477] last sysfs file:
> [    0.176484] CPU 0
> [    0.176490] Modules linked in:
> [    0.176500] Pid: 1, comm: swapper Tainted: G        W  2.6.31-1-amd64 #1
> [    0.176508] RIP: e030:[<ffffffff81386142>] 
[<ffffffff81386142>]
> cache_add_dev+0x2e/0x2ae
> [    0.176522] RSP: e02b:ffff88007ffe5e50  EFLAGS: 00010246
> [    0.176529] RAX: 0000000000000003 RBX: 0000000000000000 RCX: 
> 000000008a54cc73
> [    0.176537] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 
> 0000000000000000
> [    0.176545] RBP: ffffffff8152df60 R08: 0000000000000200 R09: 
> ffffffff8152df60
> [    0.176553] R10: 0000000000000000 R11: ffffffff81200d1d R12: 
> 00000000fffffffe
> [    0.176561] R13: ffffffff8152dfa0 R14: ffffffff8158af20 R15: 
> 0000000000000000
> [    0.176573] FS:  0000000000000000(0000) GS:ffffc90000000000(0000) 
> knlGS:0000000000000000
> [    0.176583] CS:  e033 DS: 0000 ES: 0000 CR0: 000000008005003b
> [    0.176590] CR2: 0000000000000000 CR3: 0000000001001000 CR4: 
> 0000000000000660
> [    0.176599] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 
> 0000000000000000
> [    0.176607] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 
> 0000000000000400
> [    0.176615] Process swapper (pid: 1, threadinfo ffff88007ffe4000, task 
> ffff88007ffc6740)
> [    0.176625] Stack:
> [    0.176630]  0000000000000002 00000000ffffffea ffffffff8152dfa0 
> ffffffff8158af20
> [    0.176643] <0> 000000008a54cc73 0000000000000000 ffffffff8152df60
> 0000000000000000
> [    0.176658] <0> ffffffff8152dfa0 ffffffff8158af20 00000000014bd800
> ffffffff81386503
> [    0.176677] Call Trace:
> [    0.176687]  [<ffffffff81386503>] ? cache_sysfs_init+0x3b/0x86
> [    0.176699]  [<ffffffff81550787>] ? i8237A_init_sysfs+0x0/0x5e
> [    0.176708]  [<ffffffff813864c8>] ? cache_sysfs_init+0x0/0x86
> [    0.176718]  [<ffffffff8100a0a6>] ? do_one_initcall+0x78/0x1a8
> [    0.176727]  [<ffffffff81549a5b>] ? kernel_init+0x178/0x1e5
> [    0.176738]  [<ffffffff81012f2a>] ? child_rip+0xa/0x20
> [    0.180013]  [<ffffffff810120e7>] ? int_ret_from_sys_call+0x7/0x1b
> [    0.180013]  [<ffffffff8101289d>] ? retint_restore_args+0x5/0x6
> [    0.180013]  [<ffffffff81200d1d>] ? dummycon_dummy+0x0/0x2e
> [    0.180013]  [<ffffffff81200d1d>] ? dummycon_dummy+0x0/0x2e
> [    0.180013]  [<ffffffff81012f20>] ? child_rip+0x0/0x20
> [    0.180013] Code: 89 ff 41 56 41 55 41 54 41 bc fe ff ff ff 55 53 48 83
ec
> 28 65 48 8b 04 25 28 00 00 00 48 89 44 24 20 31 c0 66 8b 05 4e 35 29 00
<44>
> 8b 37 66 85 c0 0f 84 4d 02 00 00 45 89 f5 0f b7 f8 48 c7 c5
> [    0.180013] RIP  [<ffffffff81386142>] cache_add_dev+0x2e/0x2ae
> [    0.180013]  RSP <ffff88007ffe5e50>
> [    0.180013] CR2: 0000000000000000
> [    0.180013] ---[ end trace a7919e7f17c0a726 ]---
> [    0.209859] Kernel panic - not syncing: Attempted to kill init!
> [    0.209869] Pid: 1, comm: swapper Tainted: G      D W  2.6.31-1-amd64 #1
> [    0.209877] Call Trace:
> [    0.209886]  [<ffffffff8138df3c>] ? panic+0x96/0x14a
> [    0.209895]  [<ffffffff81200d1d>] ? dummycon_dummy+0x0/0x2e
> [    0.209906]  [<ffffffff8100e592>] ? check_events+0x12/0x20
> [    0.209915]  [<ffffffff813908a6>] ? _write_lock_irq+0x1b/0x43
> [    0.209926]  [<ffffffff8106828b>] ? exit_ptrace+0xb7/0x14b
> [    0.209935]  [<ffffffff813908a6>] ? _write_lock_irq+0x1b/0x43
> [    0.209945]  [<ffffffff81060184>] ? do_exit+0x82/0x698
> [    0.209955]  [<ffffffff8105cd81>] ?
release_console_sem+0x1a4/0x1ed
> [    0.209965]  [<ffffffff8101685f>] ? oops_end+0xc3/0xdf
> [    0.209974]  [<ffffffff8103bcab>] ? no_context+0x1fc/0x220
> [    0.209984]  [<ffffffff81200d1d>] ? dummycon_dummy+0x0/0x2e
> [    0.209993]  [<ffffffff8103be6f>] ?
__bad_area_nosemaphore+0x1a0/0x1dc
> [    0.210002]  [<ffffffff8100e57f>] ?
xen_restore_fl_direct_end+0x0/0x1
> [    0.210012]  [<ffffffff8105d46c>] ? vprintk+0x300/0x343
> [    0.210021]  [<ffffffff8100db31>] ?
xen_force_evtchn_callback+0x1d/0x37
> [    0.210031]  [<ffffffff8103c16c>] ? do_page_fault+0xae/0x315
> [    0.210040]  [<ffffffff81391095>] ? page_fault+0x25/0x30
> [    0.210049]  [<ffffffff81200d1d>] ? dummycon_dummy+0x0/0x2e
> [    0.210058]  [<ffffffff81386142>] ? cache_add_dev+0x2e/0x2ae
> [    0.210068]  [<ffffffff81386503>] ? cache_sysfs_init+0x3b/0x86
> [    0.210079]  [<ffffffff81550787>] ? i8237A_init_sysfs+0x0/0x5e
> [    0.210088]  [<ffffffff813864c8>] ? cache_sysfs_init+0x0/0x86
> [    0.210097]  [<ffffffff8100a0a6>] ? do_one_initcall+0x78/0x1a8
> [    0.210107]  [<ffffffff81549a5b>] ? kernel_init+0x178/0x1e5
> [    0.210116]  [<ffffffff81012f2a>] ? child_rip+0xa/0x20
> [    0.210125]  [<ffffffff810120e7>] ? int_ret_from_sys_call+0x7/0x1b
> [    0.210133]  [<ffffffff8101289d>] ? retint_restore_args+0x5/0x6
> [    0.210143]  [<ffffffff81200d1d>] ? dummycon_dummy+0x0/0x2e
> [    0.210152]  [<ffffffff81200d1d>] ? dummycon_dummy+0x0/0x2e
> [    0.210161]  [<ffffffff81012f20>] ? child_rip+0x0/0x20
> 
> Regards,
> Markus Schuster
> 
> _______________________________________________
> Xen-users mailing list
> Xen-users@lists.xensource.com
> http://lists.xensource.com/xen-users
_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

Florian Gleixner

2009-Dec-06 13:18 UTC

head link

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

Hi,

i have crashes when domU and/or dom0 is OpenSuse 11.2 - kernel 2.6.31.5.
See https://bugzilla.novell.com/show_bug.cgi?id=551695

Latest test was with a recent single core Notebook. I think the crash
can be caused by high disk IO on domU. I usually use lvm for domU disks
- probably this is the problem? A test installation of a domU using a
file for the domU disk worked without crash.

You know how i can get a full stack trace if i have no serial line?

Florian


Markus Schuster wrote:> Hi list, 
> 
> I''m experiencing some really strange behavior when booting a
pv_ops domU more
> recent than kernel 2.6.29 (!) on a pv_ops dom0 (directly from git). 
> I''m using XEN 3.4.2 (Debian unstable packages (3.4.2-2) compiled
for lenny) on
> Debian lenny. 
> I''ve checked out pv_ops dom0 source as described in the wiki -
currently I''m
> working with changeset 8735edb4a976105fd29c97c00c6d14760537e4ee. 
> domU kernel is a prebuilt kernel image from Debian unstable.
> 
> The strange thing: With the same binaries, I can''t trigger this
problem in my
> test environment (Athlon 64 3500+ socket 939, 2G RAM), only on my
production
> server (2x Opteron 2218 (dual core) socket F, 8GB RAM) - maybe
it''s a SMP
> related problem?
> 
> dom0 .config:
> http://markus.schuster.name/bugreport/xen/dom0-config.txt
> 
> kernel output of crashing domU
> http://markus.schuster.name/bugreport/xen/domU-2.6.31.txt
> http://markus.schuster.name/bugreport/xen/domU-2.6.32-rc8.txt
> 
> kernel output of working domU
> http://markus.schuster.name/bugreport/xen/domU-2.6.29.txt
> 
> For those just wanting to have a quick look, here is the relevant kernel 
> output from a 2.6.31 domU:
> [..]
> [    0.012368] Booting paravirtualized kernel on Xen
> [    0.012368] Xen version: 3.4 (preserve-AD)
> [    0.012368] Grant table initialized
> [    0.012368] regulator: core version 0.5
> [    0.012368] NET: Registered protocol family 16
> [    0.108050] PCI: Fatal: No config space access function found
> [    0.108555] bio: create slab <bio-0> at 0
> [    0.108555] ACPI: Interpreter disabled.
> [    0.108555] xen_balloon: Initialising balloon driver.
> [    0.112044] usbcore: registered new interface driver usbfs
> [    0.112074] usbcore: registered new interface driver hub
> [    0.112099] usbcore: registered new device driver usb
> [    0.112099] PCI: System does not support PCI
> [    0.112099] PCI: System does not support PCI
> [    0.125982] pnp: PnP ACPI: disabled
> [    0.126234] NET: Registered protocol family 2
> [    0.126234] IP route cache hash table entries: 65536 (order: 7, 524288 
> bytes)
> [    0.128563] TCP established hash table entries: 262144 (order: 10,
4194304
> bytes)
> [    0.130630] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
> [    0.131149] TCP: Hash tables configured (established 262144 bind 65536)
> [    0.131164] TCP reno registered
> [    0.131416] NET: Registered protocol family 1
> [    0.131510] Unpacking initramfs...
> [    0.162893] Freeing initrd memory: 21240k freed
> [    0.176404] platform rtc_cmos: registered platform RTC device (no PNP 
> device found)
> [    0.176433] BUG: unable to handle kernel NULL pointer dereference at
(null)
> [    0.176445] IP: [<ffffffff81386142>] cache_add_dev+0x2e/0x2ae
> [    0.176461] PGD 0
> [    0.176468] Oops: 0000 [#1] SMP
> [    0.176477] last sysfs file:
> [    0.176484] CPU 0
> [    0.176490] Modules linked in:
> [    0.176500] Pid: 1, comm: swapper Tainted: G        W  2.6.31-1-amd64 #1
> [    0.176508] RIP: e030:[<ffffffff81386142>] 
[<ffffffff81386142>]
> cache_add_dev+0x2e/0x2ae
> [    0.176522] RSP: e02b:ffff88007ffe5e50  EFLAGS: 00010246
> [    0.176529] RAX: 0000000000000003 RBX: 0000000000000000 RCX: 
> 000000008a54cc73
> [    0.176537] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 
> 0000000000000000
> [    0.176545] RBP: ffffffff8152df60 R08: 0000000000000200 R09: 
> ffffffff8152df60
> [    0.176553] R10: 0000000000000000 R11: ffffffff81200d1d R12: 
> 00000000fffffffe
> [    0.176561] R13: ffffffff8152dfa0 R14: ffffffff8158af20 R15: 
> 0000000000000000
> [    0.176573] FS:  0000000000000000(0000) GS:ffffc90000000000(0000) 
> knlGS:0000000000000000
> [    0.176583] CS:  e033 DS: 0000 ES: 0000 CR0: 000000008005003b
> [    0.176590] CR2: 0000000000000000 CR3: 0000000001001000 CR4: 
> 0000000000000660
> [    0.176599] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 
> 0000000000000000
> [    0.176607] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 
> 0000000000000400
> [    0.176615] Process swapper (pid: 1, threadinfo ffff88007ffe4000, task 
> ffff88007ffc6740)
> [    0.176625] Stack:
> [    0.176630]  0000000000000002 00000000ffffffea ffffffff8152dfa0 
> ffffffff8158af20
> [    0.176643] <0> 000000008a54cc73 0000000000000000 ffffffff8152df60
> 0000000000000000
> [    0.176658] <0> ffffffff8152dfa0 ffffffff8158af20 00000000014bd800
> ffffffff81386503
> [    0.176677] Call Trace:
> [    0.176687]  [<ffffffff81386503>] ? cache_sysfs_init+0x3b/0x86
> [    0.176699]  [<ffffffff81550787>] ? i8237A_init_sysfs+0x0/0x5e
> [    0.176708]  [<ffffffff813864c8>] ? cache_sysfs_init+0x0/0x86
> [    0.176718]  [<ffffffff8100a0a6>] ? do_one_initcall+0x78/0x1a8
> [    0.176727]  [<ffffffff81549a5b>] ? kernel_init+0x178/0x1e5
> [    0.176738]  [<ffffffff81012f2a>] ? child_rip+0xa/0x20
> [    0.180013]  [<ffffffff810120e7>] ? int_ret_from_sys_call+0x7/0x1b
> [    0.180013]  [<ffffffff8101289d>] ? retint_restore_args+0x5/0x6
> [    0.180013]  [<ffffffff81200d1d>] ? dummycon_dummy+0x0/0x2e
> [    0.180013]  [<ffffffff81200d1d>] ? dummycon_dummy+0x0/0x2e
> [    0.180013]  [<ffffffff81012f20>] ? child_rip+0x0/0x20
> [    0.180013] Code: 89 ff 41 56 41 55 41 54 41 bc fe ff ff ff 55 53 48 83
ec
> 28 65 48 8b 04 25 28 00 00 00 48 89 44 24 20 31 c0 66 8b 05 4e 35 29 00
<44>
> 8b 37 66 85 c0 0f 84 4d 02 00 00 45 89 f5 0f b7 f8 48 c7 c5
> [    0.180013] RIP  [<ffffffff81386142>] cache_add_dev+0x2e/0x2ae
> [    0.180013]  RSP <ffff88007ffe5e50>
> [    0.180013] CR2: 0000000000000000
> [    0.180013] ---[ end trace a7919e7f17c0a726 ]---
> [    0.209859] Kernel panic - not syncing: Attempted to kill init!
> [    0.209869] Pid: 1, comm: swapper Tainted: G      D W  2.6.31-1-amd64 #1
> [    0.209877] Call Trace:
> [    0.209886]  [<ffffffff8138df3c>] ? panic+0x96/0x14a
> [    0.209895]  [<ffffffff81200d1d>] ? dummycon_dummy+0x0/0x2e
> [    0.209906]  [<ffffffff8100e592>] ? check_events+0x12/0x20
> [    0.209915]  [<ffffffff813908a6>] ? _write_lock_irq+0x1b/0x43
> [    0.209926]  [<ffffffff8106828b>] ? exit_ptrace+0xb7/0x14b
> [    0.209935]  [<ffffffff813908a6>] ? _write_lock_irq+0x1b/0x43
> [    0.209945]  [<ffffffff81060184>] ? do_exit+0x82/0x698
> [    0.209955]  [<ffffffff8105cd81>] ?
release_console_sem+0x1a4/0x1ed
> [    0.209965]  [<ffffffff8101685f>] ? oops_end+0xc3/0xdf
> [    0.209974]  [<ffffffff8103bcab>] ? no_context+0x1fc/0x220
> [    0.209984]  [<ffffffff81200d1d>] ? dummycon_dummy+0x0/0x2e
> [    0.209993]  [<ffffffff8103be6f>] ?
__bad_area_nosemaphore+0x1a0/0x1dc
> [    0.210002]  [<ffffffff8100e57f>] ?
xen_restore_fl_direct_end+0x0/0x1
> [    0.210012]  [<ffffffff8105d46c>] ? vprintk+0x300/0x343
> [    0.210021]  [<ffffffff8100db31>] ?
xen_force_evtchn_callback+0x1d/0x37
> [    0.210031]  [<ffffffff8103c16c>] ? do_page_fault+0xae/0x315
> [    0.210040]  [<ffffffff81391095>] ? page_fault+0x25/0x30
> [    0.210049]  [<ffffffff81200d1d>] ? dummycon_dummy+0x0/0x2e
> [    0.210058]  [<ffffffff81386142>] ? cache_add_dev+0x2e/0x2ae
> [    0.210068]  [<ffffffff81386503>] ? cache_sysfs_init+0x3b/0x86
> [    0.210079]  [<ffffffff81550787>] ? i8237A_init_sysfs+0x0/0x5e
> [    0.210088]  [<ffffffff813864c8>] ? cache_sysfs_init+0x0/0x86
> [    0.210097]  [<ffffffff8100a0a6>] ? do_one_initcall+0x78/0x1a8
> [    0.210107]  [<ffffffff81549a5b>] ? kernel_init+0x178/0x1e5
> [    0.210116]  [<ffffffff81012f2a>] ? child_rip+0xa/0x20
> [    0.210125]  [<ffffffff810120e7>] ? int_ret_from_sys_call+0x7/0x1b
> [    0.210133]  [<ffffffff8101289d>] ? retint_restore_args+0x5/0x6
> [    0.210143]  [<ffffffff81200d1d>] ? dummycon_dummy+0x0/0x2e
> [    0.210152]  [<ffffffff81200d1d>] ? dummycon_dummy+0x0/0x2e
> [    0.210161]  [<ffffffff81012f20>] ? child_rip+0x0/0x20
> 
> Regards,
> Markus Schuster
> 
> _______________________________________________
> Xen-users mailing list
> Xen-users@lists.xensource.com
> http://lists.xensource.com/xen-users



_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

Jeremy Fitzhardinge

2009-Dec-06 19:04 UTC

head link

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

On 12/05/09 16:40, Pasi Kärkkäinen wrote:> Hello,
>
> Jeremy: Is this already known bug/crash?
>    
I don''t recognize it.  What CPU is it?  It would be useful to work out 
exactly what line is crashing.

     J
> -- Pasi
>
> On Sat, Dec 05, 2009 at 11:52:06PM +0100, Markus Schuster wrote:
>    
>> Hi list,
>>
>> I''m experiencing some really strange behavior when booting a
pv_ops domU more
>> recent than kernel 2.6.29 (!) on a pv_ops dom0 (directly from git).
>> I''m using XEN 3.4.2 (Debian unstable packages (3.4.2-2)
compiled for lenny) on
>> Debian lenny.
>> I''ve checked out pv_ops dom0 source as described in the wiki -
currently I''m
>> working with changeset 8735edb4a976105fd29c97c00c6d14760537e4ee.
>> domU kernel is a prebuilt kernel image from Debian unstable.
>>
>> The strange thing: With the same binaries, I can''t trigger
this problem in my
>> test environment (Athlon 64 3500+ socket 939, 2G RAM), only on my
production
>> server (2x Opteron 2218 (dual core) socket F, 8GB RAM) - maybe
it''s a SMP
>> related problem?
>>
>> dom0 .config:
>> http://markus.schuster.name/bugreport/xen/dom0-config.txt
>>
>> kernel output of crashing domU
>> http://markus.schuster.name/bugreport/xen/domU-2.6.31.txt
>> http://markus.schuster.name/bugreport/xen/domU-2.6.32-rc8.txt
>>
>> kernel output of working domU
>> http://markus.schuster.name/bugreport/xen/domU-2.6.29.txt
>>
>> For those just wanting to have a quick look, here is the relevant
kernel
>> output from a 2.6.31 domU:
>> [..]
>> [    0.012368] Booting paravirtualized kernel on Xen
>> [    0.012368] Xen version: 3.4 (preserve-AD)
>> [    0.012368] Grant table initialized
>> [    0.012368] regulator: core version 0.5
>> [    0.012368] NET: Registered protocol family 16
>> [    0.108050] PCI: Fatal: No config space access function found
>> [    0.108555] bio: create slab<bio-0>  at 0
>> [    0.108555] ACPI: Interpreter disabled.
>> [    0.108555] xen_balloon: Initialising balloon driver.
>> [    0.112044] usbcore: registered new interface driver usbfs
>> [    0.112074] usbcore: registered new interface driver hub
>> [    0.112099] usbcore: registered new device driver usb
>> [    0.112099] PCI: System does not support PCI
>> [    0.112099] PCI: System does not support PCI
>> [    0.125982] pnp: PnP ACPI: disabled
>> [    0.126234] NET: Registered protocol family 2
>> [    0.126234] IP route cache hash table entries: 65536 (order: 7,
524288
>> bytes)
>> [    0.128563] TCP established hash table entries: 262144 (order: 10,
4194304
>> bytes)
>> [    0.130630] TCP bind hash table entries: 65536 (order: 8, 1048576
bytes)
>> [    0.131149] TCP: Hash tables configured (established 262144 bind
65536)
>> [    0.131164] TCP reno registered
>> [    0.131416] NET: Registered protocol family 1
>> [    0.131510] Unpacking initramfs...
>> [    0.162893] Freeing initrd memory: 21240k freed
>> [    0.176404] platform rtc_cmos: registered platform RTC device (no
PNP
>> device found)
>> [    0.176433] BUG: unable to handle kernel NULL pointer dereference at
(null)
>> [    0.176445] IP: [<ffffffff81386142>] cache_add_dev+0x2e/0x2ae
>> [    0.176461] PGD 0
>> [    0.176468] Oops: 0000 [#1] SMP
>> [    0.176477] last sysfs file:
>> [    0.176484] CPU 0
>> [    0.176490] Modules linked in:
>> [    0.176500] Pid: 1, comm: swapper Tainted: G        W 
2.6.31-1-amd64 #1
>> [    0.176508] RIP: e030:[<ffffffff81386142>] 
[<ffffffff81386142>]
>> cache_add_dev+0x2e/0x2ae
>> [    0.176522] RSP: e02b:ffff88007ffe5e50  EFLAGS: 00010246
>> [    0.176529] RAX: 0000000000000003 RBX: 0000000000000000 RCX:
>> 000000008a54cc73
>> [    0.176537] RDX: 0000000000000000 RSI: 0000000000000000 RDI:
>> 0000000000000000
>> [    0.176545] RBP: ffffffff8152df60 R08: 0000000000000200 R09:
>> ffffffff8152df60
>> [    0.176553] R10: 0000000000000000 R11: ffffffff81200d1d R12:
>> 00000000fffffffe
>> [    0.176561] R13: ffffffff8152dfa0 R14: ffffffff8158af20 R15:
>> 0000000000000000
>> [    0.176573] FS:  0000000000000000(0000) GS:ffffc90000000000(0000)
>> knlGS:0000000000000000
>> [    0.176583] CS:  e033 DS: 0000 ES: 0000 CR0: 000000008005003b
>> [    0.176590] CR2: 0000000000000000 CR3: 0000000001001000 CR4:
>> 0000000000000660
>> [    0.176599] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
>> 0000000000000000
>> [    0.176607] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7:
>> 0000000000000400
>> [    0.176615] Process swapper (pid: 1, threadinfo ffff88007ffe4000,
task
>> ffff88007ffc6740)
>> [    0.176625] Stack:
>> [    0.176630]  0000000000000002 00000000ffffffea ffffffff8152dfa0
>> ffffffff8158af20
>> [    0.176643]<0>  000000008a54cc73 0000000000000000
ffffffff8152df60
>> 0000000000000000
>> [    0.176658]<0>  ffffffff8152dfa0 ffffffff8158af20
00000000014bd800
>> ffffffff81386503
>> [    0.176677] Call Trace:
>> [    0.176687]  [<ffffffff81386503>] ? cache_sysfs_init+0x3b/0x86
>> [    0.176699]  [<ffffffff81550787>] ? i8237A_init_sysfs+0x0/0x5e
>> [    0.176708]  [<ffffffff813864c8>] ? cache_sysfs_init+0x0/0x86
>> [    0.176718]  [<ffffffff8100a0a6>] ? do_one_initcall+0x78/0x1a8
>> [    0.176727]  [<ffffffff81549a5b>] ? kernel_init+0x178/0x1e5
>> [    0.176738]  [<ffffffff81012f2a>] ? child_rip+0xa/0x20
>> [    0.180013]  [<ffffffff810120e7>] ?
int_ret_from_sys_call+0x7/0x1b
>> [    0.180013]  [<ffffffff8101289d>] ?
retint_restore_args+0x5/0x6
>> [    0.180013]  [<ffffffff81200d1d>] ? dummycon_dummy+0x0/0x2e
>> [    0.180013]  [<ffffffff81200d1d>] ? dummycon_dummy+0x0/0x2e
>> [    0.180013]  [<ffffffff81012f20>] ? child_rip+0x0/0x20
>> [    0.180013] Code: 89 ff 41 56 41 55 41 54 41 bc fe ff ff ff 55 53 48
83 ec
>> 28 65 48 8b 04 25 28 00 00 00 48 89 44 24 20 31 c0 66 8b 05 4e 35 29
00<44>
>> 8b 37 66 85 c0 0f 84 4d 02 00 00 45 89 f5 0f b7 f8 48 c7 c5
>> [    0.180013] RIP  [<ffffffff81386142>] cache_add_dev+0x2e/0x2ae
>> [    0.180013]  RSP<ffff88007ffe5e50>
>> [    0.180013] CR2: 0000000000000000
>> [    0.180013] ---[ end trace a7919e7f17c0a726 ]---
>> [    0.209859] Kernel panic - not syncing: Attempted to kill init!
>> [    0.209869] Pid: 1, comm: swapper Tainted: G      D W 
2.6.31-1-amd64 #1
>> [    0.209877] Call Trace:
>> [    0.209886]  [<ffffffff8138df3c>] ? panic+0x96/0x14a
>> [    0.209895]  [<ffffffff81200d1d>] ? dummycon_dummy+0x0/0x2e
>> [    0.209906]  [<ffffffff8100e592>] ? check_events+0x12/0x20
>> [    0.209915]  [<ffffffff813908a6>] ? _write_lock_irq+0x1b/0x43
>> [    0.209926]  [<ffffffff8106828b>] ? exit_ptrace+0xb7/0x14b
>> [    0.209935]  [<ffffffff813908a6>] ? _write_lock_irq+0x1b/0x43
>> [    0.209945]  [<ffffffff81060184>] ? do_exit+0x82/0x698
>> [    0.209955]  [<ffffffff8105cd81>] ?
release_console_sem+0x1a4/0x1ed
>> [    0.209965]  [<ffffffff8101685f>] ? oops_end+0xc3/0xdf
>> [    0.209974]  [<ffffffff8103bcab>] ? no_context+0x1fc/0x220
>> [    0.209984]  [<ffffffff81200d1d>] ? dummycon_dummy+0x0/0x2e
>> [    0.209993]  [<ffffffff8103be6f>] ?
__bad_area_nosemaphore+0x1a0/0x1dc
>> [    0.210002]  [<ffffffff8100e57f>] ?
xen_restore_fl_direct_end+0x0/0x1
>> [    0.210012]  [<ffffffff8105d46c>] ? vprintk+0x300/0x343
>> [    0.210021]  [<ffffffff8100db31>] ?
xen_force_evtchn_callback+0x1d/0x37
>> [    0.210031]  [<ffffffff8103c16c>] ? do_page_fault+0xae/0x315
>> [    0.210040]  [<ffffffff81391095>] ? page_fault+0x25/0x30
>> [    0.210049]  [<ffffffff81200d1d>] ? dummycon_dummy+0x0/0x2e
>> [    0.210058]  [<ffffffff81386142>] ? cache_add_dev+0x2e/0x2ae
>> [    0.210068]  [<ffffffff81386503>] ? cache_sysfs_init+0x3b/0x86
>> [    0.210079]  [<ffffffff81550787>] ? i8237A_init_sysfs+0x0/0x5e
>> [    0.210088]  [<ffffffff813864c8>] ? cache_sysfs_init+0x0/0x86
>> [    0.210097]  [<ffffffff8100a0a6>] ? do_one_initcall+0x78/0x1a8
>> [    0.210107]  [<ffffffff81549a5b>] ? kernel_init+0x178/0x1e5
>> [    0.210116]  [<ffffffff81012f2a>] ? child_rip+0xa/0x20
>> [    0.210125]  [<ffffffff810120e7>] ?
int_ret_from_sys_call+0x7/0x1b
>> [    0.210133]  [<ffffffff8101289d>] ?
retint_restore_args+0x5/0x6
>> [    0.210143]  [<ffffffff81200d1d>] ? dummycon_dummy+0x0/0x2e
>> [    0.210152]  [<ffffffff81200d1d>] ? dummycon_dummy+0x0/0x2e
>> [    0.210161]  [<ffffffff81012f20>] ? child_rip+0x0/0x20
>>
>> Regards,
>> Markus Schuster
>>
>> _______________________________________________
>> Xen-users mailing list
>> Xen-users@lists.xensource.com
>> http://lists.xensource.com/xen-users
>>      
>    

_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

Markus Schuster

2009-Dec-06 22:08 UTC

head link

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

On Sunday 06 December 2009 20:04:49 Jeremy Fitzhardinge
wrote:> On 12/05/09 16:40, Pasi Kärkkäinen wrote:
> > Hello,
> >
> > Jeremy: Is this already known bug/crash?
> 
> I don''t recognize it.  What CPU is it?  It would be useful to work
out
> exactly what line is crashing.
The server is equipted with two AMD Opteron 2218. 
What to do to find out the line in code that crashes?

Regards, 
Markus

_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

Jeremy Fitzhardinge

2009-Dec-07 23:45 UTC

head link

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

On 12/06/09 14:08, Markus Schuster wrote:> On Sunday 06 December 2009 20:04:49 Jeremy Fitzhardinge wrote:
>    
>> On 12/05/09 16:40, Pasi Kärkkäinen wrote:
>>      
>>> Hello,
>>>
>>> Jeremy: Is this already known bug/crash?
>>>        
>> I don''t recognize it.  What CPU is it?  It would be useful to
work out
>> exactly what line is crashing.
>>      
> The server is equipted with two AMD Opteron 2218.
> What to do to find out the line in code that crashes?
>    
If you built the kernel, then:

$ gdb vmlinux
(gdb) x/i 0xffffffff81386142  (or whatever the RIP line says)
...
(gdb) list *0xffffffff81386142
...

The first just shows the faulting instruction, and the second should 
list the actual corresponding source line.

You''ll get best results if you enable CONFIG_DEBUG_INFO.

Thanks,
     J

_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

Markus Schuster

2009-Dec-09 21:35 UTC

head link

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

On Tuesday 08 December 2009 00:45:19 Jeremy Fitzhardinge
wrote:> On 12/06/09 14:08, Markus Schuster wrote:
> [..]
> > What to do to find out the line in code that crashes?
> 
> If you built the kernel, then:
> [..]
> 
> You''ll get best results if you enable CONFIG_DEBUG_INFO.
Sorry for the delay, but I used a Debian binary kernel, so I had to grab 
Debian sources and rebuild it in order to have reproduceable results.
I''ve
enabled CONFIG_DEBUG_INFO from the start - it produced giant binaries :)


So I''ve done:
# gdb vmlinux
[..]
This GDB was configured as "x86_64-linux-gnu"...
(gdb) x/i 0xffffffff813861af
0xffffffff813861af <cache_add_dev+46>:  mov    (%rdi),%r14d
(gdb) 
(gdb) list *0xffffffff813861af
0xffffffff813861af is in cache_add_dev 
(/root/linux-2.6/linux-2.6-2.6.31/debian/build/source_amd64_none/arch/x86/kernel/cpu/intel_cacheinfo.c:902).
897     static DECLARE_BITMAP(cache_dev_map, NR_CPUS);
898
899     /* Add/Remove cache interface for CPU device */
900     static int __cpuinit cache_add_dev(struct sys_device * sys_dev)
901     {
902             unsigned int cpu = sys_dev->id;
903             unsigned long i, j;
904             struct _index_kobject *this_object;
905             int retval;
906
(gdb)


The crash looks the following with my build:
[    0.044270] BUG: unable to handle kernel NULL pointer dereference at (null)
[    0.044281] IP: [<ffffffff813861af>] cache_add_dev+0x2e/0x2ae
[    0.044297] PGD 0
[    0.044305] Oops: 0000 [#1] SMP
[    0.044313] last sysfs file:
[    0.044320] CPU 1
[    0.044328] Modules linked in:
[    0.044338] Pid: 1, comm: swapper Tainted: G        W  2.6.31-1-amd64 #1
[    0.044345] RIP: e030:[<ffffffff813861af>]  [<ffffffff813861af>] 
cache_add_dev+0x2e/0x2ae
[    0.044359] RSP: e02b:ffff880017d99e50  EFLAGS: 00010246
[    0.044366] RAX: 0000000000000003 RBX: 0000000000000000 RCX: 
000000004125c4ce
[    0.044374] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 
0000000000000000
[    0.044382] RBP: ffffffff8152ff60 R08: 0000000000000200 R09: 
ffffffff8152ff60
[    0.060007] R10: 0000000000000000 R11: ffffffff81200d95 R12: 
00000000fffffffe
[    0.060007] R13: ffffffff8152ffa0 R14: ffffffff8158cee0 R15: 
0000000000000000
[    0.060007] FS:  0000000000000000(0000) GS:ffffc90000018000(0000) 
knlGS:0000000000000000
[    0.060007] CS:  e033 DS: 0000 ES: 0000 CR0: 000000008005003b
[    0.060007] CR2: 0000000000000000 CR3: 0000000001001000 CR4: 
0000000000000660
[    0.060007] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 
0000000000000000
[    0.060007] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 
0000000000000400
[    0.060007] Process swapper (pid: 1, threadinfo ffff880017d98000, task 
ffff880017d7e740)
[    0.060007] Stack:
[    0.060007]  0000000000000002 00000000ffffffea ffffffff8152ffa0 
ffffffff8158cee0
[    0.060007] <0> 000000004125c4ce 0000000000000000 ffffffff8152ff60 
0000000000000000
[    0.060007] <0> ffffffff8152ffa0 ffffffff8158cee0 0000000000000000 
ffffffff81386570
[    0.060007] Call Trace:
[    0.060007]  [<ffffffff81386570>] ? cache_sysfs_init+0x3b/0x86
[    0.060007]  [<ffffffff8155278e>] ? i8237A_init_sysfs+0x0/0x5e
[    0.060007]  [<ffffffff81386535>] ? cache_sysfs_init+0x0/0x86
[    0.060007]  [<ffffffff8100a0a6>] ? do_one_initcall+0x78/0x1a8
[    0.060007]  [<ffffffff8154ba5b>] ? kernel_init+0x178/0x1e5
[    0.060007]  [<ffffffff81012f2a>] ? child_rip+0xa/0x20
[    0.060007]  [<ffffffff810120e7>] ? int_ret_from_sys_call+0x7/0x1b
[    0.060007]  [<ffffffff8101289d>] ? retint_restore_args+0x5/0x6
[    0.060007]  [<ffffffff81200d95>] ? dummycon_dummy+0x0/0x2e
[    0.060007]  [<ffffffff81200d95>] ? dummycon_dummy+0x0/0x2e
[    0.060007]  [<ffffffff81012f20>] ? child_rip+0x0/0x20
[    0.060007] Code: 89 ff 41 56 41 55 41 54 41 bc fe ff ff ff 55 53 48 83 ec 
28 65 48 8b 04 25 28 00 00 00 48 89 44 24 20 31 c0 66 8b 05 e1 44 29 00
<44>
8b 37 66 85 c0 0f 84 4d 02 00 00 45 89 f5 0f b7 f8 48 c7 c5
[    0.060007] RIP  [<ffffffff813861af>] cache_add_dev+0x2e/0x2ae
[    0.060007]  RSP <ffff880017d99e50>
[    0.060007] CR2: 0000000000000000
[    0.060007] ---[ end trace a7919e7f17c0a726 ]---
[    0.136850] Kernel panic - not syncing: Attempted to kill init!
[    0.136859] Pid: 1, comm: swapper Tainted: G      D W  2.6.31-1-amd64 #1
[    0.136867] Call Trace:
[    0.136876]  [<ffffffff8138dfb5>] ? panic+0x96/0x14a
[    0.136885]  [<ffffffff81200d95>] ? dummycon_dummy+0x0/0x2e
[    0.136895]  [<ffffffff8100e592>] ? check_events+0x12/0x20
[    0.136904]  [<ffffffff8139091e>] ? _write_lock_irq+0x1b/0x43
[    0.136915]  [<ffffffff81068287>] ? exit_ptrace+0xb7/0x14b
[    0.136924]  [<ffffffff8139091e>] ? _write_lock_irq+0x1b/0x43
[    0.136935]  [<ffffffff81060180>] ? do_exit+0x82/0x698
[    0.136944]  [<ffffffff8105cd79>] ? release_console_sem+0x1a4/0x1ed
[    0.136955]  [<ffffffff8101685f>] ? oops_end+0xc3/0xdf
[    0.136965]  [<ffffffff8103bc9f>] ? no_context+0x1fc/0x220
[    0.136973]  [<ffffffff81200d95>] ? dummycon_dummy+0x0/0x2e
[    0.136982]  [<ffffffff8103be63>] ? __bad_area_nosemaphore+0x1a0/0x1dc
[    0.136992]  [<ffffffff8100e57f>] ? xen_restore_fl_direct_end+0x0/0x1
[    0.137003]  [<ffffffff8105d464>] ? vprintk+0x300/0x343
[    0.137012]  [<ffffffff8100db31>] ? xen_force_evtchn_callback+0x1d/0x37
[    0.137021]  [<ffffffff8103c160>] ? do_page_fault+0xae/0x315
[    0.137030]  [<ffffffff81391115>] ? page_fault+0x25/0x30
[    0.137039]  [<ffffffff81200d95>] ? dummycon_dummy+0x0/0x2e
[    0.137047]  [<ffffffff813861af>] ? cache_add_dev+0x2e/0x2ae
[    0.137056]  [<ffffffff81386570>] ? cache_sysfs_init+0x3b/0x86
[    0.137065]  [<ffffffff8155278e>] ? i8237A_init_sysfs+0x0/0x5e
[    0.137074]  [<ffffffff81386535>] ? cache_sysfs_init+0x0/0x86
[    0.137082]  [<ffffffff8100a0a6>] ? do_one_initcall+0x78/0x1a8
[    0.137091]  [<ffffffff8154ba5b>] ? kernel_init+0x178/0x1e5
[    0.137100]  [<ffffffff81012f2a>] ? child_rip+0xa/0x20
[    0.137108]  [<ffffffff810120e7>] ? int_ret_from_sys_call+0x7/0x1b
[    0.137117]  [<ffffffff8101289d>] ? retint_restore_args+0x5/0x6
[    0.137126]  [<ffffffff81200d95>] ? dummycon_dummy+0x0/0x2e
[    0.137134]  [<ffffffff81200d95>] ? dummycon_dummy+0x0/0x2e
[    0.137143]  [<ffffffff81012f20>] ? child_rip+0x0/0x20

Hope this helps. 

Regards,
Markus

_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

Markus Schuster

2009-Dec-15 12:49 UTC

head link

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

On Wednesday 09 December 2009 22:35:44 Markus Schuster
wrote:> On Tuesday 08 December 2009 00:45:19 Jeremy Fitzhardinge wrote:
> > On 12/06/09 14:08, Markus Schuster wrote:
> > [..]
> >
> > > What to do to find out the line in code that crashes?
> >
> > If you built the kernel, then:
> > [..]
> >
> > You''ll get best results if you enable CONFIG_DEBUG_INFO.
> 
> Sorry for the delay, but I used a Debian binary kernel, so I had to grab
> Debian sources and rebuild it in order to have reproduceable results.
I''ve
> enabled CONFIG_DEBUG_INFO from the start - it produced giant binaries :)
> 
> 
> So I''ve done:
> # gdb vmlinux
> [..]
> This GDB was configured as "x86_64-linux-gnu"...
> (gdb) x/i 0xffffffff813861af
> 0xffffffff813861af <cache_add_dev+46>:  mov    (%rdi),%r14d
> (gdb)
> (gdb) list *0xffffffff813861af
> 0xffffffff813861af is in cache_add_dev
> (/root/linux-2.6/linux-2.6-2.6.31/debian/build/source_amd64_none/arch/x86/k
> ernel/cpu/intel_cacheinfo.c:902). 897     static
>  DECLARE_BITMAP(cache_dev_map, NR_CPUS);
> 898
> 899     /* Add/Remove cache interface for CPU device */
> 900     static int __cpuinit cache_add_dev(struct sys_device * sys_dev)
> 901     {
> 902             unsigned int cpu = sys_dev->id;
> 903             unsigned long i, j;
> 904             struct _index_kobject *this_object;
> 905             int retval;
> 906
> (gdb)
Hi Jeremy, sorry for beeing a bit cumbersome, but have you been able to get 
some findings from my debugger output? Do you need additional input?

Regards,
Markus

_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

Jeremy Fitzhardinge

2009-Dec-15 19:57 UTC

head link

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

On 12/15/2009 04:49 AM, Markus Schuster wrote:> On Wednesday 09 December 2009 22:35:44 Markus Schuster wrote:
>    
>> On Tuesday 08 December 2009 00:45:19 Jeremy Fitzhardinge wrote:
>>      
>>> On 12/06/09 14:08, Markus Schuster wrote:
>>> [..]
>>>
>>>        
>>>> What to do to find out the line in code that crashes?
>>>>          
>>> If you built the kernel, then:
>>> [..]
>>>
>>> You''ll get best results if you enable CONFIG_DEBUG_INFO.
>>>        
>> Sorry for the delay, but I used a Debian binary kernel, so I had to
grab
>> Debian sources and rebuild it in order to have reproduceable results.
I''ve
>> enabled CONFIG_DEBUG_INFO from the start - it produced giant binaries
:)
>>
>>
>> So I''ve done:
>> # gdb vmlinux
>> [..]
>> This GDB was configured as "x86_64-linux-gnu"...
>> (gdb) x/i 0xffffffff813861af
>> 0xffffffff813861af<cache_add_dev+46>:  mov    (%rdi),%r14d
>> (gdb)
>> (gdb) list *0xffffffff813861af
>> 0xffffffff813861af is in cache_add_dev
>>
(/root/linux-2.6/linux-2.6-2.6.31/debian/build/source_amd64_none/arch/x86/k
>> ernel/cpu/intel_cacheinfo.c:902). 897     static
>>   DECLARE_BITMAP(cache_dev_map, NR_CPUS);
>> 898
>> 899     /* Add/Remove cache interface for CPU device */
>> 900     static int __cpuinit cache_add_dev(struct sys_device * sys_dev)
>> 901     {
>> 902             unsigned int cpu = sys_dev->id;
>> 903             unsigned long i, j;
>> 904             struct _index_kobject *this_object;
>> 905             int retval;
>> 906
>> (gdb)
>>      
> Hi Jeremy, sorry for beeing a bit cumbersome, but have you been able to get
> some findings from my debugger output? Do you need additional input?
>    
I don''t understand what''s happening here.  It looks like
there''s some
kind of initialization order problem in sysfs, but I don''t have any 
handle on the details here.

It would be interesting to compare the .config of the working kernel 
with the crashing one (using scripts/diffconfig in the kernel source 
tree) to see if there''s some kernel option which may be related to the 
crash.

     J

_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

Markus Schuster

2009-Dec-16 10:58 UTC

head link

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

On Tuesday 15 December 2009 20:57:30 Jeremy Fitzhardinge
wrote:> [..]
> It would be interesting to compare the .config of the working kernel
> with the crashing one (using scripts/diffconfig in the kernel source
> tree) to see if there''s some kernel option which may be related to
the
> crash.
Hi Jeremy,

config-2.6.29-2-amd64 is working
config-2.6.31-1-amd64 is not working

# ./diffconfig /root/config-2.6.29-2-amd64 /root/config-2.6.31-1-amd64
-ANDROID_BINDER_IPC n
-ANDROID_LOGGER n
-ANDROID_LOW_MEMORY_KILLER n
-ANDROID_RAM_CONSOLE n
-B43LEGACY_RFKILL y
-B43_RFKILL y
-COMPAT_NET_DEV_OPS y
-CPU_SUP_CENTAUR_64 y
-DVB_DRX397XD m
-DVB_DUMMY_FE m
-DVB_LGDT3304 m
-DVB_S921 m
-DVB_SIANO_SMS1XXX m
-DVB_SIANO_SMS1XXX_SMS_IDS y
-DYNAMIC_PRINTK_DEBUG n
-FB_INTEL m
-FB_INTEL_DEBUG n
-FB_INTEL_I2C y
-FB_TRIDENT_ACCEL n
-GIGASET_UNDOCREQ n
-HID_COMPAT y
-IGB_LRO n
-IWL3945_DEBUG n
-IWL3945_LEDS y
-IWL3945_RFKILL y
-IWLAGN_LEDS y
-IWLAGN_SPECTRUM_MEASUREMENT y
-IWLCORE m
-IWLWIFI_RFKILL y
-MAC80211_MESH y
-MD_RAID5_RESHAPE y
-ME4000 n
-MEDIA_TUNER_CUSTOMIZE n
-MTD_DILNETPC m
-MTD_DILNETPC_BOOTSIZE 0x80000
-NL80211 y
-NUMA_MIGRATE_IRQ_DESC y
-OTUS n
-PLIST y
-PSS_MIXER y
-RIO m
-RIO_OLDPCI y
-SC6600 y
-SC6600_CDROM 4
-SC6600_CDROMBASE 0x0
-SC6600_JOY y
-SECURITY_DEFAULT_MMAP_MIN_ADDR 0
-SENSORS_MAX6875 m
-SGI_GRU m
-SGI_GRU_DEBUG n
-SGI_XP m
-SOUND_AEDSP16 m
-SOUND_DMAP n
-SOUND_KAHLUA m
-SOUND_MPU401 m
-SOUND_MSS m
-SOUND_OSS m
-SOUND_PAS m
-SOUND_PSS m
-SOUND_SB m
-SOUND_SSCAPE m
-SOUND_TRACEINIT n
-SOUND_TRIX m
-SOUND_UART6850 m
-SOUND_VMIDI m
-SOUND_YM3812 m
-SUNRPC_REGISTER_V4 n
-SX m
-THINKPAD_ACPI_BAY y
-TRACE_BRANCH_PROFILING n
-UNEVICTABLE_LRU y
-USB_PHIDGET m
-USB_PHIDGETKIT m
-USB_PHIDGETMOTORCONTROL m
-USB_PHIDGETSERVO m
-USB_SERIAL_CP2101 m
-VIDEO_SAA7111 m
-VIDEO_SAA7114 m
-VIDEO_TDA9875 m
-WDT_501_PCI y
-X86_BIOS_REBOOT y
-X86_ELAN n
-X86_FIND_SMP_CONFIG y
-X86_GENERICARCH n
-X86_PC y
-X86_POWERNOW_K8_ACPI y
-X86_SMP y
-X86_VOYAGER n
-X86_VSMP n
 BLK_DEV_JMICRON m -> n
 BLK_DEV_RAM y -> m
 CRYPTO_CRYPTD n -> m
 DEBUG_INFO n -> y
 DEBUG_RODATA n -> y
 DEVKMEM y -> n
 DMAR n -> y
 GFS2_FS_LOCKING_DLM m -> y
 GREENASIA_FF m -> y
 INET_LRO m -> y
 IPV6 m -> y
 IPV6_MIP6 m -> y
 MTD_NAND_NANDSIM n -> m
 NLS m -> y
 NUMA_EMU n -> y
 PATA_JMICRON n -> m
 PHYSICAL_ALIGN 0x200000 -> 0x1000000
 PHYSICAL_START 0x200000 -> 0x1000000
 PREEMPT_NONE y -> n
 PREEMPT_VOLUNTARY n -> y
 REGULATOR_FIXED_VOLTAGE n -> m
 RELOCATABLE n -> y
 RFKILL_INPUT m -> y
 SENSORS_G760A n -> m
 SND_SEQUENCER_OSS y -> n
 SOUND_PRIME m -> n
 SYS_HYPERVISOR n -> y
 THRUSTMASTER_FF m -> y
 UEVENT_HELPER_PATH "/sbin/hotplug" -> ""
 USB_ATMEL m -> n
 USB_DEVICE_CLASS y -> n
 USB_OV511 m -> n
 USB_QUICKCAM_MESSENGER m -> n
 USB_STORAGE_ALAUDA y -> m
 USB_STORAGE_CYPRESS_ATACB y -> m
 USB_STORAGE_DATAFAB y -> m
 USB_STORAGE_FREECOM y -> m
 USB_STORAGE_ISD200 y -> m
 USB_STORAGE_JUMPSHOT y -> m
 USB_STORAGE_KARMA y -> m
 USB_STORAGE_ONETOUCH y -> m
 USB_STORAGE_SDDR09 y -> m
 USB_STORAGE_SDDR55 y -> m
 USB_STORAGE_USBAT y -> m
 X86_INTERNODE_CACHE_BYTES 128 -> 64
 X86_L1_CACHE_BYTES 128 -> 64
 X86_L1_CACHE_SHIFT 7 -> 6
 X86_PAT n -> y
 ZEROPLUS_FF m -> y
 ZLIB_INFLATE m -> y
+3C359 m
+AB3100_CORE m
+ACERHDF m
+AFS_FSCACHE y
+AR9170_LEDS y
+AR9170_USB m
+ARCH_SUPPORTS_DEBUG_PAGEALLOC y
+ASYNC_TX_DMA y
+AT76C50X_USB m
+ATH_COMMON m
+AUFS_BDEV_LOOP y
+AUFS_BRANCH_MAX_1023 n
+AUFS_BRANCH_MAX_127 y
+AUFS_BRANCH_MAX_32767 n
+AUFS_BRANCH_MAX_511 n
+AUFS_BR_FUSE n
+AUFS_BR_RAMFS n
+AUFS_DEBUG n
+AUFS_EXPORT n
+AUFS_FS m
+AUFS_HINOTIFY n
+AUFS_RDU n
+AUFS_SHWH n
+B3DFG n
+B43LEGACY_HWRNG y
+B43_HWRNG y
+BATTERY_DS2782 n
+BATTERY_MAX17040 m
+BINARY_PRINTF y
+BLK_DEV_OSD m
+BNX2X m
+BOOTPARAM_HUNG_TASK_PANIC n
+BOOTPARAM_HUNG_TASK_PANIC_VALUE 0
+BRANCH_PROFILE_NONE y
+CACHEFILES m
+CACHEFILES_DEBUG n
+CACHEFILES_HISTOGRAM n
+CAN_CALC_BITTIMING y
+CAN_DEV m
+CAN_EMS_PCI m
+CAN_KVASER_PCI m
+CAN_SJA1000 m
+CAN_SJA1000_PLATFORM m
+CB710_CORE m
+CB710_DEBUG n
+CB710_DEBUG_ASSUMPTIONS y
+CC_STACKPROTECTOR y
+CC_STACKPROTECTOR_ALL y
+CFG80211_DEBUGFS n
+CNIC m
+COMEDI_DEBUG n
+COMEDI_PCMCIA_DRIVERS m
+CONSTRUCTORS y
+CPU_SUP_CENTAUR y
+CRYPTO_AES_NI_INTEL m
+CRYPTO_DEV_PADLOCK m
+CRYPTO_DEV_PADLOCK_AES m
+CRYPTO_DEV_PADLOCK_SHA m
+CRYPTO_FPU m
+CRYPTO_PCOMP y
+CRYPTO_WORKQUEUE y
+CRYPTO_ZLIB m
+CUSE m
+DE2104X_DSL 0
+DEBUG_KMEMLEAK n
+DEBUG_RODATA_TEST n
+DECOMPRESS_BZIP2 y
+DECOMPRESS_GZIP y
+DECOMPRESS_LZMA y
+DEFAULT_MMAP_MIN_ADDR 65536
+DELL_WMI m
+DETECT_HUNG_TASK y
+DMAR_BROKEN_GFX_WA n
+DMAR_DEFAULT_ON n
+DMAR_FLOPPY_WA y
+DMA_API_DEBUG n
+DM_LOG_USERSPACE m
+DM_MULTIPATH_QL m
+DM_MULTIPATH_ST m
+DRAGONRISE_FF y
+DRM_RADEON_KMS n
+DST n
+DVB_LGDT3305 m
+DVB_STV0900 m
+DVB_STV6110 m
+DVB_USB_CE6230 m
+DVB_ZL10036 m
+DYNAMIC_DEBUG n
+EDAC_AMD64 m
+EDAC_AMD64_ERROR_INJECTION n
+EEPROM_MAX6875 m
+ETHOC m
+EVENT_PROFILE y
+EVENT_TRACING y
+EXOFS_DEBUG n
+EXOFS_FS m
+EXT3_DEFAULTS_TO_ORDERED y
+EZX_PCAP n
+FB_3DFX_I2C y
+FB_BROADSHEET n
+FB_UDL n
+FCOE_FNIC m
+FIREWIRE_NET m
+FSCACHE m
+FSCACHE_DEBUG n
+FSCACHE_HISTOGRAM n
+FSCACHE_STATS y
+FSNOTIFY y
+FTRACE y
+FTRACE_STARTUP_TEST n
+FTRACE_SYSCALLS n
+GCOV_KERNEL n
+GENERIC_HARDIRQS_NO__DO_IRQ y
+GENERIC_TRACER y
+HAVE_ARCH_KMEMCHECK y
+HAVE_DMA_API_DEBUG y
+HAVE_DMA_ATTRS y
+HAVE_DYNAMIC_PER_CPU_AREA y
+HAVE_FTRACE_SYSCALLS y
+HAVE_FUNCTION_GRAPH_FP_TEST y
+HAVE_KERNEL_BZIP2 y
+HAVE_KERNEL_GZIP y
+HAVE_KERNEL_LZMA y
+HAVE_MLOCK y
+HAVE_MLOCKED_PAGE_BIT y
+HAVE_PERF_COUNTERS y
+HECI n
+HIBERNATION_NVS y
+HID_DRAGONRISE m
+HID_GREENASIA m
+HID_KENSINGTON m
+HID_KYE m
+HID_SMARTJOYPLUS m
+HID_THRUSTMASTER m
+HID_WACOM m
+HID_ZEROPLUS m
+HW_RANDOM_TIMERIOMEM m
+HW_RANDOM_VIA m
+IDE_PHISON n
+IDE_XFER_MODE y
+IEEE802154 m
+IEEE802154_DRIVERS m
+IEEE802154_FAKEHARD m
+IGBVF m
+IMA n
+IOMMU_STRESS n
+ISL29003 m
+IWLWIFI_SPECTRUM_MEASUREMENT y
+IWM m
+IWM_DEBUG n
+KERNEL_BZIP2 n
+KERNEL_GZIP y
+KERNEL_LZMA n
+KEXEC_JUMP n
+KEYBOARD_LM8323 n
+KMEMTRACE n
+KS8842 n
+KS8851 n
+LEDS_BD2802 m
+LEDS_DAC124S085 m
+LEDS_LP3944 m
+LIBERTAS_SPI m
+LIBFCOE m
+LINE6_USB n
+LSM_MMAP_MIN_ADDR 65536
+MAC80211_DEFAULT_PS y
+MAC80211_DEFAULT_PS_VALUE 1
+MDIO m
+MD_RAID6_PQ m
+MEDIA_SUPPORT m
+MEDIA_TUNER_CUSTOMISE n
+MEDIA_TUNER_MC44S803 m
+MMC_CB710 m
+MMC_SDHCI_PLTFM m
+MMC_VIA_SDMMC m
+MOUSE_SYNAPTICS_I2C m
+MWL8K m
+NETFILTER_XT_MATCH_CLUSTER m
+NETFILTER_XT_MATCH_HL m
+NETFILTER_XT_MATCH_OSF m
+NETFILTER_XT_TARGET_HL m
+NETFILTER_XT_TARGET_LED m
+NET_DROP_MONITOR n
+NFS_FSCACHE y
+NFS_V4_1 n
+NILFS2_FS m
+NLATTR y
+NOP_USB_XCEIV m
+NUMA_IRQ_DESC y
+OUTPUT_FORMAT "elf64-x86-64"
+P54_LEDS y
+P54_SPI m
+PARAVIRT_SPINLOCKS n
+PCIEAER_INJECT m
+PCIE_ECRC n
+PCI_IOV y
+PERF_COUNTERS y
+PLAN9AUTH n
+POHMELFS m
+POHMELFS_CRYPTO y
+POHMELFS_DEBUG n
+POSIX_MQUEUE_SYSCTL y
+PPS m
+PPS_DEBUG n
+PROFILE_ALL_BRANCHES n
+PROFILE_ANNOTATED_BRANCHES n
+RDC_17F3101X n
+RDS m
+RDS_DEBUG n
+RD_BZIP2 y
+RD_GZIP y
+RD_LZMA y
+REGULATOR_LP3971 m
+REGULATOR_MAX1586 m
+REGULATOR_USERSPACE_CONSUMER m
+RING_BUFFER_BENCHMARK n
+ROMFS_BACKED_BY_BLOCK n
+ROMFS_BACKED_BY_BOTH y
+ROMFS_BACKED_BY_MTD n
+ROMFS_ON_BLOCK y
+ROMFS_ON_MTD y
+RT2800USB m
+RT2X00_LIB_HT y
+RT3070 m
+RTC_DRV_RX8025 m
+RTL8187_LEDS y
+SCSI_BNX2_ISCSI m
+SCSI_MPT2SAS m
+SCSI_MPT2SAS_LOGGING n
+SCSI_MPT2SAS_MAX_SGE 128
+SCSI_MVSAS_DEBUG n
+SCSI_OSD_DEBUG n
+SCSI_OSD_DPRINT_SENSE 1
+SCSI_OSD_INITIATOR m
+SCSI_OSD_ULD m
+SECURITY_TOMOYO n
+SENSORS_ATK0110 m
+SENSORS_LM95241 m
+SENSORS_LTC4215 m
+SENSORS_TMP401 m
+SERIAL_MAX3100 m
+SLOW_WORK y
+SMARTJOYPLUS_FF y
+SMS_SDIO_DRV m
+SMS_SIANO_MDTV m
+SMS_USB_DRV m
+SND_CS46XX m
+SND_CTXFI m
+SND_EMU10K1_SEQ m
+SND_HDA_CODEC_CA0110 y
+SND_HDA_INPUT_JACK y
+SND_INDIGODJX m
+SND_INDIGOIOX m
+SND_LX6464ES m
+SND_OPL3_LIB_SEQ m
+SND_OPL4_LIB_SEQ n
+SND_RAWMIDI_SEQ m
+SND_SBAWE_SEQ n
+SPEAKUP m
+SPEAKUP_SYNTH_ACNTPC m
+SPEAKUP_SYNTH_ACNTSA m
+SPEAKUP_SYNTH_APOLLO m
+SPEAKUP_SYNTH_AUDPTR m
+SPEAKUP_SYNTH_BNS m
+SPEAKUP_SYNTH_DECEXT m
+SPEAKUP_SYNTH_DECTLK m
+SPEAKUP_SYNTH_DTLK m
+SPEAKUP_SYNTH_DUMMY m
+SPEAKUP_SYNTH_KEYPC m
+SPEAKUP_SYNTH_LTLK m
+SPEAKUP_SYNTH_SOFT m
+SPEAKUP_SYNTH_SPKOUT m
+SPEAKUP_SYNTH_TXPRT m
+STLC45XX n
+STRIP_ASM_SYMS y
+THINKPAD_ACPI_UNSAFE_LEDS n
+TOUCHSCREEN_AD7877 m
+TOUCHSCREEN_AD7879 m
+TOUCHSCREEN_AD7879_I2C m
+TOUCHSCREEN_EETI m
+TOUCHSCREEN_W90X900 m
+TRACING_SUPPORT y
+UIO_AEC m
+USB_CDC_PHONET m
+USB_CPC n
+USB_GSPCA_MR97310A m
+USB_GSPCA_SN9C20X m
+USB_GSPCA_SN9C20X_EVDEV y
+USB_GSPCA_SQ905 m
+USB_GSPCA_SQ905C m
+USB_NET_CDC_EEM m
+USB_NET_INT51X1 m
+USB_OTG_UTILS y
+USB_PWC_INPUT_EVDEV y
+USB_SERIAL_CP210X m
+USB_SERIAL_QUALCOMM m
+USB_SERIAL_QUATECH2 n
+USB_SERIAL_SYMBOL m
+USB_XHCI_HCD m
+USB_XHCI_HCD_DEBUGGING n
+VIDEO_CX231XX m
+VIDEO_CX231XX_ALSA m
+VIDEO_CX231XX_DVB m
+VIDEO_HDPVR m
+VIDEO_MT9V011 m
+VT6655 n
+VXGE m
+VXGE_DEBUG_TRACE_ALL n
+WL12XX m
+WORKQUEUE_TRACER n
+X86_CPU_DEBUG m
+X86_EXTENDED_PLATFORM n
+X86_MCE_INJECT m
+X86_MCE_THRESHOLD y
+X86_NEW_MCE y
+X86_THERMAL_VECTOR y
+X86_X2APIC y
+XEN_DEV_EVTCHN m
+XEN_SYS_HYPERVISOR y
+YAM m

Regards,
Markus

_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

Markus Schuster

2009-Dec-29 01:42 UTC

head link

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

Hi Jeremy,

just to keep this discussion alive: I''ve compiled a vanilla linux
kernel
version 2.6.32.2 (downloaded today from kernel.org) with the config of Debians 
2.6.32 kernel image and it crashes the same way (in cache_add_dev()) as the 
Debian build does - so it''s no problem related to a Debian patch, the
problem
seems to be in mainline. 

Regards,
Markus

_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

Pasi Kärkkäinen

2009-Dec-29 10:52 UTC

head link

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

On Tue, Dec 29, 2009 at 02:42:46AM +0100, Markus Schuster
wrote:> Hi Jeremy,
> 
> just to keep this discussion alive: I''ve compiled a vanilla linux
kernel
> version 2.6.32.2 (downloaded today from kernel.org) with the config of
Debians
> 2.6.32 kernel image and it crashes the same way (in cache_add_dev()) as the
> Debian build does - so it''s no problem related to a Debian patch,
the problem
> seems to be in mainline. 
> 
Markus: I think Jeremy is away on vacations for two weeks or so..

-- Pasi


_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

Markus Schuster

2009-Dec-29 21:56 UTC

head link

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

On Tuesday 29 December 2009 11:52:01 Pasi Kärkkäinen
wrote:> On Tue, Dec 29, 2009 at 02:42:46AM +0100, Markus Schuster wrote:
> > Hi Jeremy,
> >
> > just to keep this discussion alive: I''ve compiled a vanilla
linux kernel
> > version 2.6.32.2 (downloaded today from kernel.org) with the config of
> > Debians 2.6.32 kernel image and it crashes the same way (in
> > cache_add_dev()) as the Debian build does - so it''s no
problem related to
> > a Debian patch, the problem seems to be in mainline.
> 
> Markus: I think Jeremy is away on vacations for two weeks or so..
OK, that''s fine - I think Jeremy really deserves it :)

Regards,
Markus

_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

Markus Schuster

2010-Jan-13 10:53 UTC

head link

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

On Tuesday 29 December 2009 22:56:06 Markus Schuster
wrote:> On Tuesday 29 December 2009 11:52:01 Pasi Kärkkäinen wrote:
> > On Tue, Dec 29, 2009 at 02:42:46AM +0100, Markus Schuster wrote:
> > > Hi Jeremy,
> > >
> > > just to keep this discussion alive: I''ve compiled a
vanilla linux
> > > kernel version 2.6.32.2 (downloaded today from kernel.org) with
the
> > > config of Debians 2.6.32 kernel image and it crashes the same way
(in
> > > cache_add_dev()) as the Debian build does - so it''s no
problem related
> > > to a Debian patch, the problem seems to be in mainline.
> >
> > Markus: I think Jeremy is away on vacations for two weeks or so..
> 
> OK, that''s fine - I think Jeremy really deserves it :)
Hi guys - anything new or further ideas regarding my problem?
Would it be better to repost to xen-devel or open a bug in Bugzilla?

Regards,
Markus

_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

Markus Schuster

2010-Jan-19 10:24 UTC

head link

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

Hi together, 

some new findings from my side: I tried booting a 32bit PAE 2.6.32 kernel (for 
some 32bit domU) and that WORKS :)
So the bug seems to lay in the 64bit part of some code (Remember: I use 64bit 
XEN and dom0). 

Regards,
Markus

_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

Pasi Kärkkäinen

2010-Jan-19 10:51 UTC

head link

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

On Tue, Jan 19, 2010 at 11:24:02AM +0100, Markus Schuster
wrote:> Hi together, 
> 
> some new findings from my side: I tried booting a 32bit PAE 2.6.32 kernel
(for
> some 32bit domU) and that WORKS :)
> So the bug seems to lay in the 64bit part of some code (Remember: I use
64bit
> XEN and dom0). 
> 
Did you try the latest 2.6.32.3 version? 

-- Pasi


_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

Markus Schuster

2010-Jan-19 11:10 UTC

head link

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

On Tuesday 19 January 2010 11:51:52 Pasi Kärkkäinen
wrote:> On Tue, Jan 19, 2010 at 11:24:02AM +0100, Markus Schuster wrote:
> > Hi together,
> >
> > some new findings from my side: I tried booting a 32bit PAE 2.6.32
kernel
> > (for some 32bit domU) and that WORKS :)
> > So the bug seems to lay in the 64bit part of some code (Remember: I
use
> > 64bit XEN and dom0).
> 
> Did you try the latest 2.6.32.3 version?
I tried Debians
"linux-image-2.6.32-trunk-686-bigmem_2.6.32-5_i386.deb" and
according to Debians changelog it''s indeed based on 2.6.32.3. 
But I tried this kernel image in it''s amd64 flavor, too - and there it 
chrashes like evey other version before...

Regards,
Markus

_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

Pasi Kärkkäinen

2010-Jan-19 11:17 UTC

head link

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

On Tue, Jan 19, 2010 at 12:10:12PM +0100, Markus Schuster
wrote:> On Tuesday 19 January 2010 11:51:52 Pasi Kärkkäinen wrote:
> > On Tue, Jan 19, 2010 at 11:24:02AM +0100, Markus Schuster wrote:
> > > Hi together,
> > >
> > > some new findings from my side: I tried booting a 32bit PAE
2.6.32 kernel
> > > (for some 32bit domU) and that WORKS :)
> > > So the bug seems to lay in the 64bit part of some code (Remember:
I use
> > > 64bit XEN and dom0).
> > 
> > Did you try the latest 2.6.32.3 version?
> 
> I tried Debians
"linux-image-2.6.32-trunk-686-bigmem_2.6.32-5_i386.deb" and
> according to Debians changelog it''s indeed based on 2.6.32.3. 
> But I tried this kernel image in it''s amd64 flavor, too - and
there it
> chrashes like evey other version before...
> 
What''s the hypervisor version btw?

Can you configure the guest to have on_crash=preserve in /etc/xen/<guest>
cfgfile
and then use xenctx to get a stacktrace of the crashed guest.

When the guest is crashed, run in dom0:

/usr/lib/xen/bin/xenctx -s System.map-domUkernelversion <domid>

In 64b dom0 xenctx might be under /usr/lib64/

-- Pasi


_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

Markus Schuster

2010-Jan-19 11:38 UTC

head link

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

On Tuesday 19 January 2010 12:17:33 Pasi Kärkkäinen
wrote:> What''s the hypervisor version btw?
That''s 3.4.2 (from Debian sid)

> When the guest is crashed, run in dom0:
> 
> /usr/lib/xen/bin/xenctx -s System.map-domUkernelversion <domid>
Here we go:
rip: ffffffff8100930a _stext+0x30a
flags: 00001246 i z p
rsp: ffff880002c33e60
rax: 0000000000000000   rcx: ffffffff8100930a   rdx: 0000000000000000
rbx: 0000000000000000   rsi: 0000000000000000   rdi: 0000000000000002
rbp: ffff880002c5d1d0    r8: ffff880002c3c590    r9: ffff880002c33e90
r10: 00025c9e9c681d15   r11: 0000000000000246   r12: ffff880002c33e88
r13: 0000000000000004   r14: 0000000000000000   r15: 0000000000000000
 cs: e033        ss: e02b        ds: 0000        es: 0000
 fs: 0000 @ 0000000000000000
 gs: 0000 @ ffff880002c30000/0000000000000000
Code (instr addr ffffffff8100930a)
cc cc cc cc cc cc cc cc cc cc cc 51 41 53 b8 18 00 00 00 0f 05 <41> 5b 59
c3
cc cc cc cc cc cc cc


Stack:
 ffffffff811e49da 0000000000000080 ffffffff8100e656 0000000000000001
 ffffffff8107498b ffff880002c33e88 ffff880002c33e88 ffffffff8142d740
 ffff880017c14180 0000000000000004 ffffffff8100e834 0000000067559fe6
 ffffffff810937c8 ffff880002c45f00 ffffffff8142d740 ffffffff8142d7ac

Call Trace:
  [<ffffffff8100930a>] _stext+0x30a  <--
  [<ffffffff811e49da>] set_affinity_irq+0x5a
  [<ffffffff8100e656>] stop_self+0x2e
  [<ffffffff8107498b>] generic_smp_call_function_single_interrupt+0xc0
  [<ffffffff8100e834>] xen_call_function_single_interrupt+0xe
  [<ffffffff810937c8>] handle_IRQ_event+0x58
  [<ffffffff81095150>] handle_level_irq+0x6a
  [<ffffffff81013917>] handle_irq+0x17
  [<ffffffff811e454c>] xen_evtchn_do_upcall+0x102
  [<ffffffff81011cbe>] xen_do_hypervisor_callback+0x1e

Regards, 
Markus

_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

Pasi Kärkkäinen

2010-Jan-19 11:46 UTC

head link

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

On Tue, Jan 19, 2010 at 12:38:47PM +0100, Markus Schuster
wrote:> On Tuesday 19 January 2010 12:17:33 Pasi Kärkkäinen wrote:
> > What''s the hypervisor version btw?
> 
> That''s 3.4.2 (from Debian sid)
> 
> 
> > When the guest is crashed, run in dom0:
> > 
> > /usr/lib/xen/bin/xenctx -s System.map-domUkernelversion <domid>
> 
> Here we go:
> rip: ffffffff8100930a _stext+0x30a
> flags: 00001246 i z p
> rsp: ffff880002c33e60
> rax: 0000000000000000   rcx: ffffffff8100930a   rdx: 0000000000000000
> rbx: 0000000000000000   rsi: 0000000000000000   rdi: 0000000000000002
> rbp: ffff880002c5d1d0    r8: ffff880002c3c590    r9: ffff880002c33e90
> r10: 00025c9e9c681d15   r11: 0000000000000246   r12: ffff880002c33e88
> r13: 0000000000000004   r14: 0000000000000000   r15: 0000000000000000
>  cs: e033        ss: e02b        ds: 0000        es: 0000
>  fs: 0000 @ 0000000000000000
>  gs: 0000 @ ffff880002c30000/0000000000000000
> Code (instr addr ffffffff8100930a)
> cc cc cc cc cc cc cc cc cc cc cc 51 41 53 b8 18 00 00 00 0f 05 <41>
5b 59 c3
> cc cc cc cc cc cc cc
> 
> 
> Stack:
>  ffffffff811e49da 0000000000000080 ffffffff8100e656 0000000000000001
>  ffffffff8107498b ffff880002c33e88 ffff880002c33e88 ffffffff8142d740
>  ffff880017c14180 0000000000000004 ffffffff8100e834 0000000067559fe6
>  ffffffff810937c8 ffff880002c45f00 ffffffff8142d740 ffffffff8142d7ac
> 
> Call Trace:
>   [<ffffffff8100930a>] _stext+0x30a  <--
>   [<ffffffff811e49da>] set_affinity_irq+0x5a
>   [<ffffffff8100e656>] stop_self+0x2e
>   [<ffffffff8107498b>]
generic_smp_call_function_single_interrupt+0xc0
>   [<ffffffff8100e834>] xen_call_function_single_interrupt+0xe
>   [<ffffffff810937c8>] handle_IRQ_event+0x58
>   [<ffffffff81095150>] handle_level_irq+0x6a
>   [<ffffffff81013917>] handle_irq+0x17
>   [<ffffffff811e454c>] xen_evtchn_do_upcall+0x102
>   [<ffffffff81011cbe>] xen_do_hypervisor_callback+0x1e
> 
Ok, thanks. Also please do:

gdb vmlinux

x/i 0xffffffff8100930a
list *0xffffffff8100930a
disas 0xffffffff8100930a

Those should be useful to debug this.

-- Pasi


_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

Markus Schuster

2010-Jan-19 12:10 UTC

head link

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

On Tuesday 19 January 2010 12:46:37 Pasi Kärkkäinen
wrote:> On Tue, Jan 19, 2010 at 12:38:47PM +0100, Markus Schuster wrote:
> > On Tuesday 19 January 2010 12:17:33 Pasi Kärkkäinen wrote:
> > > What''s the hypervisor version btw?
> >
> > That''s 3.4.2 (from Debian sid)
> >
> > > When the guest is crashed, run in dom0:
> > >
> > > /usr/lib/xen/bin/xenctx -s System.map-domUkernelversion
<domid>
> >
> > Here we go:
> > rip: ffffffff8100930a _stext+0x30a
> > flags: 00001246 i z p
> > rsp: ffff880002c33e60
> > rax: 0000000000000000   rcx: ffffffff8100930a   rdx: 0000000000000000
> > rbx: 0000000000000000   rsi: 0000000000000000   rdi: 0000000000000002
> > rbp: ffff880002c5d1d0    r8: ffff880002c3c590    r9: ffff880002c33e90
> > r10: 00025c9e9c681d15   r11: 0000000000000246   r12: ffff880002c33e88
> > r13: 0000000000000004   r14: 0000000000000000   r15: 0000000000000000
> >  cs: e033        ss: e02b        ds: 0000        es: 0000
> >  fs: 0000 @ 0000000000000000
> >  gs: 0000 @ ffff880002c30000/0000000000000000
> > Code (instr addr ffffffff8100930a)
> > cc cc cc cc cc cc cc cc cc cc cc 51 41 53 b8 18 00 00 00 0f 05
<41> 5b 59
> > c3 cc cc cc cc cc cc cc
> >
> >
> > Stack:
> >  ffffffff811e49da 0000000000000080 ffffffff8100e656 0000000000000001
> >  ffffffff8107498b ffff880002c33e88 ffff880002c33e88 ffffffff8142d740
> >  ffff880017c14180 0000000000000004 ffffffff8100e834 0000000067559fe6
> >  ffffffff810937c8 ffff880002c45f00 ffffffff8142d740 ffffffff8142d7ac
> >
> > Call Trace:
> >   [<ffffffff8100930a>] _stext+0x30a  <--
> >   [<ffffffff811e49da>] set_affinity_irq+0x5a
> >   [<ffffffff8100e656>] stop_self+0x2e
> >   [<ffffffff8107498b>]
generic_smp_call_function_single_interrupt+0xc0
> >   [<ffffffff8100e834>] xen_call_function_single_interrupt+0xe
> >   [<ffffffff810937c8>] handle_IRQ_event+0x58
> >   [<ffffffff81095150>] handle_level_irq+0x6a
> >   [<ffffffff81013917>] handle_irq+0x17
> >   [<ffffffff811e454c>] xen_evtchn_do_upcall+0x102
> >   [<ffffffff81011cbe>] xen_do_hypervisor_callback+0x1e
> 
> Ok, thanks. Also please do:
> 
> gdb vmlinux
> 
> x/i 0xffffffff8100930a
> list *0xffffffff8100930a
> disas 0xffffffff8100930a
> 
> Those should be useful to debug this.
OK, that''s not so easy as I''m using binary kernel packages
from Debian so I
only have vmlinuz images laying around (and gdb is not happy about them). 
I have to recompile Debians kernel to have a vmlinux file (not a big problem - 
costs a bit of time, that''s all).
Should I activate CONFIG_DEBUG_INFO btw?

You may remember, Jeremy was interested in similar information (but he 
extracted the memory address (??) to pass to gdb from the kernels crash dump) 
- I will forward you my old e-mail off-list, maybe it''s interesting :) 

Regards,
Markus

_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

Pasi Kärkkäinen

2010-Jan-19 12:21 UTC

head link

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

On Tue, Jan 19, 2010 at 01:10:27PM +0100, Markus Schuster
wrote:> On Tuesday 19 January 2010 12:46:37 Pasi Kärkkäinen wrote:
> > On Tue, Jan 19, 2010 at 12:38:47PM +0100, Markus Schuster wrote:
> > > On Tuesday 19 January 2010 12:17:33 Pasi Kärkkäinen wrote:
> > > > What''s the hypervisor version btw?
> > >
> > > That''s 3.4.2 (from Debian sid)
> > >
> > > > When the guest is crashed, run in dom0:
> > > >
> > > > /usr/lib/xen/bin/xenctx -s System.map-domUkernelversion
<domid>
> > >
> > > Here we go:
> > > rip: ffffffff8100930a _stext+0x30a
> > > flags: 00001246 i z p
> > > rsp: ffff880002c33e60
> > > rax: 0000000000000000   rcx: ffffffff8100930a   rdx:
0000000000000000
> > > rbx: 0000000000000000   rsi: 0000000000000000   rdi:
0000000000000002
> > > rbp: ffff880002c5d1d0    r8: ffff880002c3c590    r9:
ffff880002c33e90
> > > r10: 00025c9e9c681d15   r11: 0000000000000246   r12:
ffff880002c33e88
> > > r13: 0000000000000004   r14: 0000000000000000   r15:
0000000000000000
> > >  cs: e033        ss: e02b        ds: 0000        es: 0000
> > >  fs: 0000 @ 0000000000000000
> > >  gs: 0000 @ ffff880002c30000/0000000000000000
> > > Code (instr addr ffffffff8100930a)
> > > cc cc cc cc cc cc cc cc cc cc cc 51 41 53 b8 18 00 00 00 0f 05
<41> 5b 59
> > > c3 cc cc cc cc cc cc cc
> > >
> > >
> > > Stack:
> > >  ffffffff811e49da 0000000000000080 ffffffff8100e656
0000000000000001
> > >  ffffffff8107498b ffff880002c33e88 ffff880002c33e88
ffffffff8142d740
> > >  ffff880017c14180 0000000000000004 ffffffff8100e834
0000000067559fe6
> > >  ffffffff810937c8 ffff880002c45f00 ffffffff8142d740
ffffffff8142d7ac
> > >
> > > Call Trace:
> > >   [<ffffffff8100930a>] _stext+0x30a  <--
> > >   [<ffffffff811e49da>] set_affinity_irq+0x5a
> > >   [<ffffffff8100e656>] stop_self+0x2e
> > >   [<ffffffff8107498b>]
generic_smp_call_function_single_interrupt+0xc0
> > >   [<ffffffff8100e834>]
xen_call_function_single_interrupt+0xe
> > >   [<ffffffff810937c8>] handle_IRQ_event+0x58
> > >   [<ffffffff81095150>] handle_level_irq+0x6a
> > >   [<ffffffff81013917>] handle_irq+0x17
> > >   [<ffffffff811e454c>] xen_evtchn_do_upcall+0x102
> > >   [<ffffffff81011cbe>] xen_do_hypervisor_callback+0x1e
> > 
> > Ok, thanks. Also please do:
> > 
> > gdb vmlinux
> > 
> > x/i 0xffffffff8100930a
> > list *0xffffffff8100930a
> > disas 0xffffffff8100930a
> > 
> > Those should be useful to debug this.
> 
> OK, that''s not so easy as I''m using binary kernel
packages from Debian so I
> only have vmlinuz images laying around (and gdb is not happy about them). 
> I have to recompile Debians kernel to have a vmlinux file (not a big
problem -
> costs a bit of time, that''s all).
> Should I activate CONFIG_DEBUG_INFO btw?
> 
> You may remember, Jeremy was interested in similar information (but he 
> extracted the memory address (??) to pass to gdb from the kernels crash
dump)
> - I will forward you my old e-mail off-list, maybe it''s
interesting :)
> 
The memory address in that earlier try was different, and the function name
looked
different aswell..

And yeah, I guess CONFIG_DEBUG_INFO doesn''t hurt :)

so it would be good to check/verify those again for this exact kernel. 
After you''ve rebuilt the kernel, run xenctx again to verify the rip/eip
address and run the gdb commands for that address.

-- Pasi


_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

Markus Schuster

2010-Jan-19 16:24 UTC

head link

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

On Tuesday 19 January 2010 13:21:52 Pasi Kärkkäinen
wrote:> so it would be good to check/verify those again for this exact kernel.
> After you''ve rebuilt the kernel, run xenctx again to verify the
rip/eip
> address and run the gdb commands for that address.
OK, I''ve completed the compile run and booted the new kernel (as with
Jeremy,
I had to disable initramfs ''cause when compiled with CONFIG_DEBUG_INFO
it
causes the domU to die badly when loaded with pvgrub - maybe a > 70MB 
initramfs is just way too large ;)). 

So here we go:
rip: ffffffff8100930a _stext+0x30a
flags: 00001246 i z p
rsp: ffff880001785e60
rax: 0000000000000000   rcx: ffffffff8100930a   rdx: 0000000000000000
rbx: 0000000000000000   rsi: 0000000000000000   rdi: 0000000000000002
rbp: ffff8800017af1d0    r8: ffff88000178e590    r9: ffff880001785e90
r10: 00026b01b6f1cb68   r11: 0000000000000246   r12: ffff880001785e88
r13: 0000000000000004   r14: 0000000000000000   r15: 0000000000000000
 cs: e033        ss: e02b        ds: 0000        es: 0000
 fs: 0000 @ 0000000000000000
 gs: 0000 @ ffff880001782000/0000000000000000
Code (instr addr ffffffff8100930a)
cc cc cc cc cc cc cc cc cc cc cc 51 41 53 b8 18 00 00 00 0f 05 <41> 5b 59
c3
cc cc cc cc cc cc cc


Stack:
 ffffffff811e4a2e 0000000000000080 ffffffff8100e656 0000000000000001
 ffffffff81074957 ffff880001785e88 ffff880001785e88 ffffffff81429740
 ffff880017c14180 0000000000000004 ffffffff8100e834 000000006e6ac043
 ffffffff8109372c ffff880001797f00 ffffffff81429740 ffffffff814297ac

Call Trace:
  [<ffffffff8100930a>] _stext+0x30a  <--
  [<ffffffff811e4a2e>] set_affinity_irq+0x5a
  [<ffffffff8100e656>] stop_self+0x2e
  [<ffffffff81074957>] generic_smp_call_function_single_interrupt+0xc0
  [<ffffffff8100e834>] xen_call_function_single_interrupt+0xe
  [<ffffffff8109372c>] handle_IRQ_event+0x58
  [<ffffffff810950b4>] handle_level_irq+0x6a
  [<ffffffff81013917>] handle_irq+0x17
  [<ffffffff811e45a0>] xen_evtchn_do_upcall+0x102
  [<ffffffff81011cbe>] xen_do_hypervisor_callback+0x1e


Same memory address as with Debians pre-built image (I think that''s
good for
reproducibility :))
And here''s gdb output (It''s very long - I hope it''s
okay to put inline):

GNU gdb 6.8-debian
Copyright (C) 2008 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later
<http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.  Type "show
copying"
and "show warranty" for details.
This GDB was configured as "x86_64-linux-gnu"...
(gdb) x/i 0xffffffff8100930a
0xffffffff8100930a <hypercall_page+778>:	add    %al,(%rax)
(gdb) list *0xffffffff8100930a
No source file for address 0xffffffff8100930a.
(gdb) disas 0xffffffff8100930a
Dump of assembler code for function hypercall_page:
0xffffffff81009000 <hypercall_page+0>:	add    %al,(%rax)
0xffffffff81009002 <hypercall_page+2>:	add    %al,(%rax)
0xffffffff81009004 <hypercall_page+4>:	add    %al,(%rax)
0xffffffff81009006 <hypercall_page+6>:	add    %al,(%rax)
0xffffffff81009008 <hypercall_page+8>:	add    %al,(%rax)
0xffffffff8100900a <hypercall_page+10>:	add    %al,(%rax)
0xffffffff8100900c <hypercall_page+12>:	add    %al,(%rax)
0xffffffff8100900e <hypercall_page+14>:	add    %al,(%rax)
0xffffffff81009010 <hypercall_page+16>:	add    %al,(%rax)
0xffffffff81009012 <hypercall_page+18>:	add    %al,(%rax)
0xffffffff81009014 <hypercall_page+20>:	add    %al,(%rax)
0xffffffff81009016 <hypercall_page+22>:	add    %al,(%rax)
0xffffffff81009018 <hypercall_page+24>:	add    %al,(%rax)
0xffffffff8100901a <hypercall_page+26>:	add    %al,(%rax)
0xffffffff8100901c <hypercall_page+28>:	add    %al,(%rax)
0xffffffff8100901e <hypercall_page+30>:	add    %al,(%rax)
0xffffffff81009020 <hypercall_page+32>:	add    %al,(%rax)
0xffffffff81009022 <hypercall_page+34>:	add    %al,(%rax)
0xffffffff81009024 <hypercall_page+36>:	add    %al,(%rax)
0xffffffff81009026 <hypercall_page+38>:	add    %al,(%rax)
0xffffffff81009028 <hypercall_page+40>:	add    %al,(%rax)
0xffffffff8100902a <hypercall_page+42>:	add    %al,(%rax)
0xffffffff8100902c <hypercall_page+44>:	add    %al,(%rax)
0xffffffff8100902e <hypercall_page+46>:	add    %al,(%rax)
0xffffffff81009030 <hypercall_page+48>:	add    %al,(%rax)
0xffffffff81009032 <hypercall_page+50>:	add    %al,(%rax)
0xffffffff81009034 <hypercall_page+52>:	add    %al,(%rax)
0xffffffff81009036 <hypercall_page+54>:	add    %al,(%rax)
0xffffffff81009038 <hypercall_page+56>:	add    %al,(%rax)
0xffffffff8100903a <hypercall_page+58>:	add    %al,(%rax)
0xffffffff8100903c <hypercall_page+60>:	add    %al,(%rax)
0xffffffff8100903e <hypercall_page+62>:	add    %al,(%rax)
0xffffffff81009040 <hypercall_page+64>:	add    %al,(%rax)
0xffffffff81009042 <hypercall_page+66>:	add    %al,(%rax)
0xffffffff81009044 <hypercall_page+68>:	add    %al,(%rax)
0xffffffff81009046 <hypercall_page+70>:	add    %al,(%rax)
0xffffffff81009048 <hypercall_page+72>:	add    %al,(%rax)
0xffffffff8100904a <hypercall_page+74>:	add    %al,(%rax)
0xffffffff8100904c <hypercall_page+76>:	add    %al,(%rax)
0xffffffff8100904e <hypercall_page+78>:	add    %al,(%rax)
0xffffffff81009050 <hypercall_page+80>:	add    %al,(%rax)
0xffffffff81009052 <hypercall_page+82>:	add    %al,(%rax)
0xffffffff81009054 <hypercall_page+84>:	add    %al,(%rax)
0xffffffff81009056 <hypercall_page+86>:	add    %al,(%rax)
0xffffffff81009058 <hypercall_page+88>:	add    %al,(%rax)
0xffffffff8100905a <hypercall_page+90>:	add    %al,(%rax)
0xffffffff8100905c <hypercall_page+92>:	add    %al,(%rax)
0xffffffff8100905e <hypercall_page+94>:	add    %al,(%rax)
0xffffffff81009060 <hypercall_page+96>:	add    %al,(%rax)
0xffffffff81009062 <hypercall_page+98>:	add    %al,(%rax)
0xffffffff81009064 <hypercall_page+100>:	add    %al,(%rax)
0xffffffff81009066 <hypercall_page+102>:	add    %al,(%rax)
0xffffffff81009068 <hypercall_page+104>:	add    %al,(%rax)
0xffffffff8100906a <hypercall_page+106>:	add    %al,(%rax)
0xffffffff8100906c <hypercall_page+108>:	add    %al,(%rax)
0xffffffff8100906e <hypercall_page+110>:	add    %al,(%rax)
0xffffffff81009070 <hypercall_page+112>:	add    %al,(%rax)
0xffffffff81009072 <hypercall_page+114>:	add    %al,(%rax)
0xffffffff81009074 <hypercall_page+116>:	add    %al,(%rax)
0xffffffff81009076 <hypercall_page+118>:	add    %al,(%rax)
0xffffffff81009078 <hypercall_page+120>:	add    %al,(%rax)
0xffffffff8100907a <hypercall_page+122>:	add    %al,(%rax)
0xffffffff8100907c <hypercall_page+124>:	add    %al,(%rax)
0xffffffff8100907e <hypercall_page+126>:	add    %al,(%rax)
0xffffffff81009080 <hypercall_page+128>:	add    %al,(%rax)
0xffffffff81009082 <hypercall_page+130>:	add    %al,(%rax)
0xffffffff81009084 <hypercall_page+132>:	add    %al,(%rax)
0xffffffff81009086 <hypercall_page+134>:	add    %al,(%rax)
0xffffffff81009088 <hypercall_page+136>:	add    %al,(%rax)
0xffffffff8100908a <hypercall_page+138>:	add    %al,(%rax)
0xffffffff8100908c <hypercall_page+140>:	add    %al,(%rax)
0xffffffff8100908e <hypercall_page+142>:	add    %al,(%rax)
0xffffffff81009090 <hypercall_page+144>:	add    %al,(%rax)
0xffffffff81009092 <hypercall_page+146>:	add    %al,(%rax)
0xffffffff81009094 <hypercall_page+148>:	add    %al,(%rax)
0xffffffff81009096 <hypercall_page+150>:	add    %al,(%rax)
0xffffffff81009098 <hypercall_page+152>:	add    %al,(%rax)
0xffffffff8100909a <hypercall_page+154>:	add    %al,(%rax)
0xffffffff8100909c <hypercall_page+156>:	add    %al,(%rax)
0xffffffff8100909e <hypercall_page+158>:	add    %al,(%rax)
0xffffffff810090a0 <hypercall_page+160>:	add    %al,(%rax)
0xffffffff810090a2 <hypercall_page+162>:	add    %al,(%rax)
0xffffffff810090a4 <hypercall_page+164>:	add    %al,(%rax)
0xffffffff810090a6 <hypercall_page+166>:	add    %al,(%rax)
0xffffffff810090a8 <hypercall_page+168>:	add    %al,(%rax)
0xffffffff810090aa <hypercall_page+170>:	add    %al,(%rax)
0xffffffff810090ac <hypercall_page+172>:	add    %al,(%rax)
0xffffffff810090ae <hypercall_page+174>:	add    %al,(%rax)
0xffffffff810090b0 <hypercall_page+176>:	add    %al,(%rax)
0xffffffff810090b2 <hypercall_page+178>:	add    %al,(%rax)
0xffffffff810090b4 <hypercall_page+180>:	add    %al,(%rax)
0xffffffff810090b6 <hypercall_page+182>:	add    %al,(%rax)
0xffffffff810090b8 <hypercall_page+184>:	add    %al,(%rax)
0xffffffff810090ba <hypercall_page+186>:	add    %al,(%rax)
0xffffffff810090bc <hypercall_page+188>:	add    %al,(%rax)
0xffffffff810090be <hypercall_page+190>:	add    %al,(%rax)
0xffffffff810090c0 <hypercall_page+192>:	add    %al,(%rax)
0xffffffff810090c2 <hypercall_page+194>:	add    %al,(%rax)
0xffffffff810090c4 <hypercall_page+196>:	add    %al,(%rax)
0xffffffff810090c6 <hypercall_page+198>:	add    %al,(%rax)
0xffffffff810090c8 <hypercall_page+200>:	add    %al,(%rax)
0xffffffff810090ca <hypercall_page+202>:	add    %al,(%rax)
0xffffffff810090cc <hypercall_page+204>:	add    %al,(%rax)
0xffffffff810090ce <hypercall_page+206>:	add    %al,(%rax)
0xffffffff810090d0 <hypercall_page+208>:	add    %al,(%rax)
0xffffffff810090d2 <hypercall_page+210>:	add    %al,(%rax)
0xffffffff810090d4 <hypercall_page+212>:	add    %al,(%rax)
0xffffffff810090d6 <hypercall_page+214>:	add    %al,(%rax)
0xffffffff810090d8 <hypercall_page+216>:	add    %al,(%rax)
0xffffffff810090da <hypercall_page+218>:	add    %al,(%rax)
0xffffffff810090dc <hypercall_page+220>:	add    %al,(%rax)
0xffffffff810090de <hypercall_page+222>:	add    %al,(%rax)
0xffffffff810090e0 <hypercall_page+224>:	add    %al,(%rax)
0xffffffff810090e2 <hypercall_page+226>:	add    %al,(%rax)
0xffffffff810090e4 <hypercall_page+228>:	add    %al,(%rax)
0xffffffff810090e6 <hypercall_page+230>:	add    %al,(%rax)
0xffffffff810090e8 <hypercall_page+232>:	add    %al,(%rax)
0xffffffff810090ea <hypercall_page+234>:	add    %al,(%rax)
0xffffffff810090ec <hypercall_page+236>:	add    %al,(%rax)
0xffffffff810090ee <hypercall_page+238>:	add    %al,(%rax)
0xffffffff810090f0 <hypercall_page+240>:	add    %al,(%rax)
0xffffffff810090f2 <hypercall_page+242>:	add    %al,(%rax)
0xffffffff810090f4 <hypercall_page+244>:	add    %al,(%rax)
0xffffffff810090f6 <hypercall_page+246>:	add    %al,(%rax)
0xffffffff810090f8 <hypercall_page+248>:	add    %al,(%rax)
0xffffffff810090fa <hypercall_page+250>:	add    %al,(%rax)
0xffffffff810090fc <hypercall_page+252>:	add    %al,(%rax)
0xffffffff810090fe <hypercall_page+254>:	add    %al,(%rax)
0xffffffff81009100 <hypercall_page+256>:	add    %al,(%rax)
0xffffffff81009102 <hypercall_page+258>:	add    %al,(%rax)
0xffffffff81009104 <hypercall_page+260>:	add    %al,(%rax)
0xffffffff81009106 <hypercall_page+262>:	add    %al,(%rax)
0xffffffff81009108 <hypercall_page+264>:	add    %al,(%rax)
0xffffffff8100910a <hypercall_page+266>:	add    %al,(%rax)
0xffffffff8100910c <hypercall_page+268>:	add    %al,(%rax)
0xffffffff8100910e <hypercall_page+270>:	add    %al,(%rax)
0xffffffff81009110 <hypercall_page+272>:	add    %al,(%rax)
0xffffffff81009112 <hypercall_page+274>:	add    %al,(%rax)
0xffffffff81009114 <hypercall_page+276>:	add    %al,(%rax)
0xffffffff81009116 <hypercall_page+278>:	add    %al,(%rax)
0xffffffff81009118 <hypercall_page+280>:	add    %al,(%rax)
0xffffffff8100911a <hypercall_page+282>:	add    %al,(%rax)
0xffffffff8100911c <hypercall_page+284>:	add    %al,(%rax)
0xffffffff8100911e <hypercall_page+286>:	add    %al,(%rax)
0xffffffff81009120 <hypercall_page+288>:	add    %al,(%rax)
0xffffffff81009122 <hypercall_page+290>:	add    %al,(%rax)
0xffffffff81009124 <hypercall_page+292>:	add    %al,(%rax)
0xffffffff81009126 <hypercall_page+294>:	add    %al,(%rax)
0xffffffff81009128 <hypercall_page+296>:	add    %al,(%rax)
0xffffffff8100912a <hypercall_page+298>:	add    %al,(%rax)
0xffffffff8100912c <hypercall_page+300>:	add    %al,(%rax)
0xffffffff8100912e <hypercall_page+302>:	add    %al,(%rax)
0xffffffff81009130 <hypercall_page+304>:	add    %al,(%rax)
0xffffffff81009132 <hypercall_page+306>:	add    %al,(%rax)
0xffffffff81009134 <hypercall_page+308>:	add    %al,(%rax)
0xffffffff81009136 <hypercall_page+310>:	add    %al,(%rax)
0xffffffff81009138 <hypercall_page+312>:	add    %al,(%rax)
0xffffffff8100913a <hypercall_page+314>:	add    %al,(%rax)
0xffffffff8100913c <hypercall_page+316>:	add    %al,(%rax)
0xffffffff8100913e <hypercall_page+318>:	add    %al,(%rax)
0xffffffff81009140 <hypercall_page+320>:	add    %al,(%rax)
0xffffffff81009142 <hypercall_page+322>:	add    %al,(%rax)
0xffffffff81009144 <hypercall_page+324>:	add    %al,(%rax)
0xffffffff81009146 <hypercall_page+326>:	add    %al,(%rax)
0xffffffff81009148 <hypercall_page+328>:	add    %al,(%rax)
0xffffffff8100914a <hypercall_page+330>:	add    %al,(%rax)
0xffffffff8100914c <hypercall_page+332>:	add    %al,(%rax)
0xffffffff8100914e <hypercall_page+334>:	add    %al,(%rax)
0xffffffff81009150 <hypercall_page+336>:	add    %al,(%rax)
0xffffffff81009152 <hypercall_page+338>:	add    %al,(%rax)
0xffffffff81009154 <hypercall_page+340>:	add    %al,(%rax)
0xffffffff81009156 <hypercall_page+342>:	add    %al,(%rax)
0xffffffff81009158 <hypercall_page+344>:	add    %al,(%rax)
0xffffffff8100915a <hypercall_page+346>:	add    %al,(%rax)
0xffffffff8100915c <hypercall_page+348>:	add    %al,(%rax)
0xffffffff8100915e <hypercall_page+350>:	add    %al,(%rax)
0xffffffff81009160 <hypercall_page+352>:	add    %al,(%rax)
0xffffffff81009162 <hypercall_page+354>:	add    %al,(%rax)
0xffffffff81009164 <hypercall_page+356>:	add    %al,(%rax)
0xffffffff81009166 <hypercall_page+358>:	add    %al,(%rax)
0xffffffff81009168 <hypercall_page+360>:	add    %al,(%rax)
0xffffffff8100916a <hypercall_page+362>:	add    %al,(%rax)
0xffffffff8100916c <hypercall_page+364>:	add    %al,(%rax)
0xffffffff8100916e <hypercall_page+366>:	add    %al,(%rax)
0xffffffff81009170 <hypercall_page+368>:	add    %al,(%rax)
0xffffffff81009172 <hypercall_page+370>:	add    %al,(%rax)
0xffffffff81009174 <hypercall_page+372>:	add    %al,(%rax)
0xffffffff81009176 <hypercall_page+374>:	add    %al,(%rax)
0xffffffff81009178 <hypercall_page+376>:	add    %al,(%rax)
0xffffffff8100917a <hypercall_page+378>:	add    %al,(%rax)
0xffffffff8100917c <hypercall_page+380>:	add    %al,(%rax)
0xffffffff8100917e <hypercall_page+382>:	add    %al,(%rax)
0xffffffff81009180 <hypercall_page+384>:	add    %al,(%rax)
0xffffffff81009182 <hypercall_page+386>:	add    %al,(%rax)
0xffffffff81009184 <hypercall_page+388>:	add    %al,(%rax)
0xffffffff81009186 <hypercall_page+390>:	add    %al,(%rax)
0xffffffff81009188 <hypercall_page+392>:	add    %al,(%rax)
0xffffffff8100918a <hypercall_page+394>:	add    %al,(%rax)
0xffffffff8100918c <hypercall_page+396>:	add    %al,(%rax)
0xffffffff8100918e <hypercall_page+398>:	add    %al,(%rax)
0xffffffff81009190 <hypercall_page+400>:	add    %al,(%rax)
0xffffffff81009192 <hypercall_page+402>:	add    %al,(%rax)
0xffffffff81009194 <hypercall_page+404>:	add    %al,(%rax)
0xffffffff81009196 <hypercall_page+406>:	add    %al,(%rax)
0xffffffff81009198 <hypercall_page+408>:	add    %al,(%rax)
0xffffffff8100919a <hypercall_page+410>:	add    %al,(%rax)
0xffffffff8100919c <hypercall_page+412>:	add    %al,(%rax)
0xffffffff8100919e <hypercall_page+414>:	add    %al,(%rax)
0xffffffff810091a0 <hypercall_page+416>:	add    %al,(%rax)
0xffffffff810091a2 <hypercall_page+418>:	add    %al,(%rax)
0xffffffff810091a4 <hypercall_page+420>:	add    %al,(%rax)
0xffffffff810091a6 <hypercall_page+422>:	add    %al,(%rax)
0xffffffff810091a8 <hypercall_page+424>:	add    %al,(%rax)
0xffffffff810091aa <hypercall_page+426>:	add    %al,(%rax)
0xffffffff810091ac <hypercall_page+428>:	add    %al,(%rax)
0xffffffff810091ae <hypercall_page+430>:	add    %al,(%rax)
0xffffffff810091b0 <hypercall_page+432>:	add    %al,(%rax)
0xffffffff810091b2 <hypercall_page+434>:	add    %al,(%rax)
0xffffffff810091b4 <hypercall_page+436>:	add    %al,(%rax)
0xffffffff810091b6 <hypercall_page+438>:	add    %al,(%rax)
0xffffffff810091b8 <hypercall_page+440>:	add    %al,(%rax)
0xffffffff810091ba <hypercall_page+442>:	add    %al,(%rax)
0xffffffff810091bc <hypercall_page+444>:	add    %al,(%rax)
0xffffffff810091be <hypercall_page+446>:	add    %al,(%rax)
0xffffffff810091c0 <hypercall_page+448>:	add    %al,(%rax)
0xffffffff810091c2 <hypercall_page+450>:	add    %al,(%rax)
0xffffffff810091c4 <hypercall_page+452>:	add    %al,(%rax)
0xffffffff810091c6 <hypercall_page+454>:	add    %al,(%rax)
0xffffffff810091c8 <hypercall_page+456>:	add    %al,(%rax)
0xffffffff810091ca <hypercall_page+458>:	add    %al,(%rax)
0xffffffff810091cc <hypercall_page+460>:	add    %al,(%rax)
0xffffffff810091ce <hypercall_page+462>:	add    %al,(%rax)
0xffffffff810091d0 <hypercall_page+464>:	add    %al,(%rax)
0xffffffff810091d2 <hypercall_page+466>:	add    %al,(%rax)
0xffffffff810091d4 <hypercall_page+468>:	add    %al,(%rax)
0xffffffff810091d6 <hypercall_page+470>:	add    %al,(%rax)
0xffffffff810091d8 <hypercall_page+472>:	add    %al,(%rax)
0xffffffff810091da <hypercall_page+474>:	add    %al,(%rax)
0xffffffff810091dc <hypercall_page+476>:	add    %al,(%rax)
0xffffffff810091de <hypercall_page+478>:	add    %al,(%rax)
0xffffffff810091e0 <hypercall_page+480>:	add    %al,(%rax)
0xffffffff810091e2 <hypercall_page+482>:	add    %al,(%rax)
0xffffffff810091e4 <hypercall_page+484>:	add    %al,(%rax)
0xffffffff810091e6 <hypercall_page+486>:	add    %al,(%rax)
0xffffffff810091e8 <hypercall_page+488>:	add    %al,(%rax)
0xffffffff810091ea <hypercall_page+490>:	add    %al,(%rax)
0xffffffff810091ec <hypercall_page+492>:	add    %al,(%rax)
0xffffffff810091ee <hypercall_page+494>:	add    %al,(%rax)
0xffffffff810091f0 <hypercall_page+496>:	add    %al,(%rax)
0xffffffff810091f2 <hypercall_page+498>:	add    %al,(%rax)
0xffffffff810091f4 <hypercall_page+500>:	add    %al,(%rax)
0xffffffff810091f6 <hypercall_page+502>:	add    %al,(%rax)
0xffffffff810091f8 <hypercall_page+504>:	add    %al,(%rax)
0xffffffff810091fa <hypercall_page+506>:	add    %al,(%rax)
0xffffffff810091fc <hypercall_page+508>:	add    %al,(%rax)
0xffffffff810091fe <hypercall_page+510>:	add    %al,(%rax)
0xffffffff81009200 <hypercall_page+512>:	add    %al,(%rax)
0xffffffff81009202 <hypercall_page+514>:	add    %al,(%rax)
0xffffffff81009204 <hypercall_page+516>:	add    %al,(%rax)
0xffffffff81009206 <hypercall_page+518>:	add    %al,(%rax)
0xffffffff81009208 <hypercall_page+520>:	add    %al,(%rax)
0xffffffff8100920a <hypercall_page+522>:	add    %al,(%rax)
0xffffffff8100920c <hypercall_page+524>:	add    %al,(%rax)
0xffffffff8100920e <hypercall_page+526>:	add    %al,(%rax)
0xffffffff81009210 <hypercall_page+528>:	add    %al,(%rax)
0xffffffff81009212 <hypercall_page+530>:	add    %al,(%rax)
0xffffffff81009214 <hypercall_page+532>:	add    %al,(%rax)
0xffffffff81009216 <hypercall_page+534>:	add    %al,(%rax)
0xffffffff81009218 <hypercall_page+536>:	add    %al,(%rax)
0xffffffff8100921a <hypercall_page+538>:	add    %al,(%rax)
0xffffffff8100921c <hypercall_page+540>:	add    %al,(%rax)
0xffffffff8100921e <hypercall_page+542>:	add    %al,(%rax)
0xffffffff81009220 <hypercall_page+544>:	add    %al,(%rax)
0xffffffff81009222 <hypercall_page+546>:	add    %al,(%rax)
0xffffffff81009224 <hypercall_page+548>:	add    %al,(%rax)
0xffffffff81009226 <hypercall_page+550>:	add    %al,(%rax)
0xffffffff81009228 <hypercall_page+552>:	add    %al,(%rax)
0xffffffff8100922a <hypercall_page+554>:	add    %al,(%rax)
0xffffffff8100922c <hypercall_page+556>:	add    %al,(%rax)
0xffffffff8100922e <hypercall_page+558>:	add    %al,(%rax)
0xffffffff81009230 <hypercall_page+560>:	add    %al,(%rax)
0xffffffff81009232 <hypercall_page+562>:	add    %al,(%rax)
0xffffffff81009234 <hypercall_page+564>:	add    %al,(%rax)
0xffffffff81009236 <hypercall_page+566>:	add    %al,(%rax)
0xffffffff81009238 <hypercall_page+568>:	add    %al,(%rax)
0xffffffff8100923a <hypercall_page+570>:	add    %al,(%rax)
0xffffffff8100923c <hypercall_page+572>:	add    %al,(%rax)
0xffffffff8100923e <hypercall_page+574>:	add    %al,(%rax)
0xffffffff81009240 <hypercall_page+576>:	add    %al,(%rax)
0xffffffff81009242 <hypercall_page+578>:	add    %al,(%rax)
0xffffffff81009244 <hypercall_page+580>:	add    %al,(%rax)
0xffffffff81009246 <hypercall_page+582>:	add    %al,(%rax)
0xffffffff81009248 <hypercall_page+584>:	add    %al,(%rax)
0xffffffff8100924a <hypercall_page+586>:	add    %al,(%rax)
0xffffffff8100924c <hypercall_page+588>:	add    %al,(%rax)
0xffffffff8100924e <hypercall_page+590>:	add    %al,(%rax)
0xffffffff81009250 <hypercall_page+592>:	add    %al,(%rax)
0xffffffff81009252 <hypercall_page+594>:	add    %al,(%rax)
0xffffffff81009254 <hypercall_page+596>:	add    %al,(%rax)
0xffffffff81009256 <hypercall_page+598>:	add    %al,(%rax)
0xffffffff81009258 <hypercall_page+600>:	add    %al,(%rax)
0xffffffff8100925a <hypercall_page+602>:	add    %al,(%rax)
0xffffffff8100925c <hypercall_page+604>:	add    %al,(%rax)
0xffffffff8100925e <hypercall_page+606>:	add    %al,(%rax)
0xffffffff81009260 <hypercall_page+608>:	add    %al,(%rax)
0xffffffff81009262 <hypercall_page+610>:	add    %al,(%rax)
0xffffffff81009264 <hypercall_page+612>:	add    %al,(%rax)
0xffffffff81009266 <hypercall_page+614>:	add    %al,(%rax)
0xffffffff81009268 <hypercall_page+616>:	add    %al,(%rax)
0xffffffff8100926a <hypercall_page+618>:	add    %al,(%rax)
0xffffffff8100926c <hypercall_page+620>:	add    %al,(%rax)
0xffffffff8100926e <hypercall_page+622>:	add    %al,(%rax)
0xffffffff81009270 <hypercall_page+624>:	add    %al,(%rax)
0xffffffff81009272 <hypercall_page+626>:	add    %al,(%rax)
0xffffffff81009274 <hypercall_page+628>:	add    %al,(%rax)
0xffffffff81009276 <hypercall_page+630>:	add    %al,(%rax)
0xffffffff81009278 <hypercall_page+632>:	add    %al,(%rax)
0xffffffff8100927a <hypercall_page+634>:	add    %al,(%rax)
0xffffffff8100927c <hypercall_page+636>:	add    %al,(%rax)
0xffffffff8100927e <hypercall_page+638>:	add    %al,(%rax)
0xffffffff81009280 <hypercall_page+640>:	add    %al,(%rax)
0xffffffff81009282 <hypercall_page+642>:	add    %al,(%rax)
0xffffffff81009284 <hypercall_page+644>:	add    %al,(%rax)
0xffffffff81009286 <hypercall_page+646>:	add    %al,(%rax)
0xffffffff81009288 <hypercall_page+648>:	add    %al,(%rax)
0xffffffff8100928a <hypercall_page+650>:	add    %al,(%rax)
0xffffffff8100928c <hypercall_page+652>:	add    %al,(%rax)
0xffffffff8100928e <hypercall_page+654>:	add    %al,(%rax)
0xffffffff81009290 <hypercall_page+656>:	add    %al,(%rax)
0xffffffff81009292 <hypercall_page+658>:	add    %al,(%rax)
0xffffffff81009294 <hypercall_page+660>:	add    %al,(%rax)
0xffffffff81009296 <hypercall_page+662>:	add    %al,(%rax)
0xffffffff81009298 <hypercall_page+664>:	add    %al,(%rax)
0xffffffff8100929a <hypercall_page+666>:	add    %al,(%rax)
0xffffffff8100929c <hypercall_page+668>:	add    %al,(%rax)
0xffffffff8100929e <hypercall_page+670>:	add    %al,(%rax)
0xffffffff810092a0 <hypercall_page+672>:	add    %al,(%rax)
0xffffffff810092a2 <hypercall_page+674>:	add    %al,(%rax)
0xffffffff810092a4 <hypercall_page+676>:	add    %al,(%rax)
0xffffffff810092a6 <hypercall_page+678>:	add    %al,(%rax)
0xffffffff810092a8 <hypercall_page+680>:	add    %al,(%rax)
0xffffffff810092aa <hypercall_page+682>:	add    %al,(%rax)
0xffffffff810092ac <hypercall_page+684>:	add    %al,(%rax)
0xffffffff810092ae <hypercall_page+686>:	add    %al,(%rax)
0xffffffff810092b0 <hypercall_page+688>:	add    %al,(%rax)
0xffffffff810092b2 <hypercall_page+690>:	add    %al,(%rax)
0xffffffff810092b4 <hypercall_page+692>:	add    %al,(%rax)
0xffffffff810092b6 <hypercall_page+694>:	add    %al,(%rax)
0xffffffff810092b8 <hypercall_page+696>:	add    %al,(%rax)
0xffffffff810092ba <hypercall_page+698>:	add    %al,(%rax)
0xffffffff810092bc <hypercall_page+700>:	add    %al,(%rax)
0xffffffff810092be <hypercall_page+702>:	add    %al,(%rax)
0xffffffff810092c0 <hypercall_page+704>:	add    %al,(%rax)
0xffffffff810092c2 <hypercall_page+706>:	add    %al,(%rax)
0xffffffff810092c4 <hypercall_page+708>:	add    %al,(%rax)
0xffffffff810092c6 <hypercall_page+710>:	add    %al,(%rax)
0xffffffff810092c8 <hypercall_page+712>:	add    %al,(%rax)
0xffffffff810092ca <hypercall_page+714>:	add    %al,(%rax)
0xffffffff810092cc <hypercall_page+716>:	add    %al,(%rax)
0xffffffff810092ce <hypercall_page+718>:	add    %al,(%rax)
0xffffffff810092d0 <hypercall_page+720>:	add    %al,(%rax)
0xffffffff810092d2 <hypercall_page+722>:	add    %al,(%rax)
0xffffffff810092d4 <hypercall_page+724>:	add    %al,(%rax)
0xffffffff810092d6 <hypercall_page+726>:	add    %al,(%rax)
0xffffffff810092d8 <hypercall_page+728>:	add    %al,(%rax)
0xffffffff810092da <hypercall_page+730>:	add    %al,(%rax)
0xffffffff810092dc <hypercall_page+732>:	add    %al,(%rax)
0xffffffff810092de <hypercall_page+734>:	add    %al,(%rax)
0xffffffff810092e0 <hypercall_page+736>:	add    %al,(%rax)
0xffffffff810092e2 <hypercall_page+738>:	add    %al,(%rax)
0xffffffff810092e4 <hypercall_page+740>:	add    %al,(%rax)
0xffffffff810092e6 <hypercall_page+742>:	add    %al,(%rax)
0xffffffff810092e8 <hypercall_page+744>:	add    %al,(%rax)
0xffffffff810092ea <hypercall_page+746>:	add    %al,(%rax)
0xffffffff810092ec <hypercall_page+748>:	add    %al,(%rax)
0xffffffff810092ee <hypercall_page+750>:	add    %al,(%rax)
0xffffffff810092f0 <hypercall_page+752>:	add    %al,(%rax)
0xffffffff810092f2 <hypercall_page+754>:	add    %al,(%rax)
0xffffffff810092f4 <hypercall_page+756>:	add    %al,(%rax)
0xffffffff810092f6 <hypercall_page+758>:	add    %al,(%rax)
0xffffffff810092f8 <hypercall_page+760>:	add    %al,(%rax)
0xffffffff810092fa <hypercall_page+762>:	add    %al,(%rax)
0xffffffff810092fc <hypercall_page+764>:	add    %al,(%rax)
0xffffffff810092fe <hypercall_page+766>:	add    %al,(%rax)
0xffffffff81009300 <hypercall_page+768>:	add    %al,(%rax)
0xffffffff81009302 <hypercall_page+770>:	add    %al,(%rax)
0xffffffff81009304 <hypercall_page+772>:	add    %al,(%rax)
0xffffffff81009306 <hypercall_page+774>:	add    %al,(%rax)
0xffffffff81009308 <hypercall_page+776>:	add    %al,(%rax)
0xffffffff8100930a <hypercall_page+778>:	add    %al,(%rax)
0xffffffff8100930c <hypercall_page+780>:	add    %al,(%rax)
0xffffffff8100930e <hypercall_page+782>:	add    %al,(%rax)
0xffffffff81009310 <hypercall_page+784>:	add    %al,(%rax)
0xffffffff81009312 <hypercall_page+786>:	add    %al,(%rax)
0xffffffff81009314 <hypercall_page+788>:	add    %al,(%rax)
0xffffffff81009316 <hypercall_page+790>:	add    %al,(%rax)
0xffffffff81009318 <hypercall_page+792>:	add    %al,(%rax)
0xffffffff8100931a <hypercall_page+794>:	add    %al,(%rax)
0xffffffff8100931c <hypercall_page+796>:	add    %al,(%rax)
0xffffffff8100931e <hypercall_page+798>:	add    %al,(%rax)
0xffffffff81009320 <hypercall_page+800>:	add    %al,(%rax)
0xffffffff81009322 <hypercall_page+802>:	add    %al,(%rax)
0xffffffff81009324 <hypercall_page+804>:	add    %al,(%rax)
0xffffffff81009326 <hypercall_page+806>:	add    %al,(%rax)
0xffffffff81009328 <hypercall_page+808>:	add    %al,(%rax)
0xffffffff8100932a <hypercall_page+810>:	add    %al,(%rax)
0xffffffff8100932c <hypercall_page+812>:	add    %al,(%rax)
0xffffffff8100932e <hypercall_page+814>:	add    %al,(%rax)
0xffffffff81009330 <hypercall_page+816>:	add    %al,(%rax)
0xffffffff81009332 <hypercall_page+818>:	add    %al,(%rax)
0xffffffff81009334 <hypercall_page+820>:	add    %al,(%rax)
0xffffffff81009336 <hypercall_page+822>:	add    %al,(%rax)
0xffffffff81009338 <hypercall_page+824>:	add    %al,(%rax)
0xffffffff8100933a <hypercall_page+826>:	add    %al,(%rax)
0xffffffff8100933c <hypercall_page+828>:	add    %al,(%rax)
0xffffffff8100933e <hypercall_page+830>:	add    %al,(%rax)
0xffffffff81009340 <hypercall_page+832>:	add    %al,(%rax)
0xffffffff81009342 <hypercall_page+834>:	add    %al,(%rax)
0xffffffff81009344 <hypercall_page+836>:	add    %al,(%rax)
0xffffffff81009346 <hypercall_page+838>:	add    %al,(%rax)
0xffffffff81009348 <hypercall_page+840>:	add    %al,(%rax)
0xffffffff8100934a <hypercall_page+842>:	add    %al,(%rax)
0xffffffff8100934c <hypercall_page+844>:	add    %al,(%rax)
0xffffffff8100934e <hypercall_page+846>:	add    %al,(%rax)
0xffffffff81009350 <hypercall_page+848>:	add    %al,(%rax)
0xffffffff81009352 <hypercall_page+850>:	add    %al,(%rax)
0xffffffff81009354 <hypercall_page+852>:	add    %al,(%rax)
0xffffffff81009356 <hypercall_page+854>:	add    %al,(%rax)
0xffffffff81009358 <hypercall_page+856>:	add    %al,(%rax)
0xffffffff8100935a <hypercall_page+858>:	add    %al,(%rax)
0xffffffff8100935c <hypercall_page+860>:	add    %al,(%rax)
0xffffffff8100935e <hypercall_page+862>:	add    %al,(%rax)
0xffffffff81009360 <hypercall_page+864>:	add    %al,(%rax)
0xffffffff81009362 <hypercall_page+866>:	add    %al,(%rax)
0xffffffff81009364 <hypercall_page+868>:	add    %al,(%rax)
0xffffffff81009366 <hypercall_page+870>:	add    %al,(%rax)
0xffffffff81009368 <hypercall_page+872>:	add    %al,(%rax)
0xffffffff8100936a <hypercall_page+874>:	add    %al,(%rax)
0xffffffff8100936c <hypercall_page+876>:	add    %al,(%rax)
0xffffffff8100936e <hypercall_page+878>:	add    %al,(%rax)
0xffffffff81009370 <hypercall_page+880>:	add    %al,(%rax)
0xffffffff81009372 <hypercall_page+882>:	add    %al,(%rax)
0xffffffff81009374 <hypercall_page+884>:	add    %al,(%rax)
0xffffffff81009376 <hypercall_page+886>:	add    %al,(%rax)
0xffffffff81009378 <hypercall_page+888>:	add    %al,(%rax)
0xffffffff8100937a <hypercall_page+890>:	add    %al,(%rax)
0xffffffff8100937c <hypercall_page+892>:	add    %al,(%rax)
0xffffffff8100937e <hypercall_page+894>:	add    %al,(%rax)
0xffffffff81009380 <hypercall_page+896>:	add    %al,(%rax)
0xffffffff81009382 <hypercall_page+898>:	add    %al,(%rax)
0xffffffff81009384 <hypercall_page+900>:	add    %al,(%rax)
0xffffffff81009386 <hypercall_page+902>:	add    %al,(%rax)
0xffffffff81009388 <hypercall_page+904>:	add    %al,(%rax)
0xffffffff8100938a <hypercall_page+906>:	add    %al,(%rax)
0xffffffff8100938c <hypercall_page+908>:	add    %al,(%rax)
0xffffffff8100938e <hypercall_page+910>:	add    %al,(%rax)
0xffffffff81009390 <hypercall_page+912>:	add    %al,(%rax)
0xffffffff81009392 <hypercall_page+914>:	add    %al,(%rax)
0xffffffff81009394 <hypercall_page+916>:	add    %al,(%rax)
0xffffffff81009396 <hypercall_page+918>:	add    %al,(%rax)
0xffffffff81009398 <hypercall_page+920>:	add    %al,(%rax)
0xffffffff8100939a <hypercall_page+922>:	add    %al,(%rax)
0xffffffff8100939c <hypercall_page+924>:	add    %al,(%rax)
0xffffffff8100939e <hypercall_page+926>:	add    %al,(%rax)
0xffffffff810093a0 <hypercall_page+928>:	add    %al,(%rax)
0xffffffff810093a2 <hypercall_page+930>:	add    %al,(%rax)
0xffffffff810093a4 <hypercall_page+932>:	add    %al,(%rax)
0xffffffff810093a6 <hypercall_page+934>:	add    %al,(%rax)
0xffffffff810093a8 <hypercall_page+936>:	add    %al,(%rax)
0xffffffff810093aa <hypercall_page+938>:	add    %al,(%rax)
0xffffffff810093ac <hypercall_page+940>:	add    %al,(%rax)
0xffffffff810093ae <hypercall_page+942>:	add    %al,(%rax)
0xffffffff810093b0 <hypercall_page+944>:	add    %al,(%rax)
0xffffffff810093b2 <hypercall_page+946>:	add    %al,(%rax)
0xffffffff810093b4 <hypercall_page+948>:	add    %al,(%rax)
0xffffffff810093b6 <hypercall_page+950>:	add    %al,(%rax)
0xffffffff810093b8 <hypercall_page+952>:	add    %al,(%rax)
0xffffffff810093ba <hypercall_page+954>:	add    %al,(%rax)
0xffffffff810093bc <hypercall_page+956>:	add    %al,(%rax)
0xffffffff810093be <hypercall_page+958>:	add    %al,(%rax)
0xffffffff810093c0 <hypercall_page+960>:	add    %al,(%rax)
0xffffffff810093c2 <hypercall_page+962>:	add    %al,(%rax)
0xffffffff810093c4 <hypercall_page+964>:	add    %al,(%rax)
0xffffffff810093c6 <hypercall_page+966>:	add    %al,(%rax)
0xffffffff810093c8 <hypercall_page+968>:	add    %al,(%rax)
0xffffffff810093ca <hypercall_page+970>:	add    %al,(%rax)
0xffffffff810093cc <hypercall_page+972>:	add    %al,(%rax)
0xffffffff810093ce <hypercall_page+974>:	add    %al,(%rax)
0xffffffff810093d0 <hypercall_page+976>:	add    %al,(%rax)
0xffffffff810093d2 <hypercall_page+978>:	add    %al,(%rax)
0xffffffff810093d4 <hypercall_page+980>:	add    %al,(%rax)
0xffffffff810093d6 <hypercall_page+982>:	add    %al,(%rax)
0xffffffff810093d8 <hypercall_page+984>:	add    %al,(%rax)
0xffffffff810093da <hypercall_page+986>:	add    %al,(%rax)
0xffffffff810093dc <hypercall_page+988>:	add    %al,(%rax)
0xffffffff810093de <hypercall_page+990>:	add    %al,(%rax)
0xffffffff810093e0 <hypercall_page+992>:	add    %al,(%rax)
0xffffffff810093e2 <hypercall_page+994>:	add    %al,(%rax)
0xffffffff810093e4 <hypercall_page+996>:	add    %al,(%rax)
0xffffffff810093e6 <hypercall_page+998>:	add    %al,(%rax)
0xffffffff810093e8 <hypercall_page+1000>:	add    %al,(%rax)
0xffffffff810093ea <hypercall_page+1002>:	add    %al,(%rax)
0xffffffff810093ec <hypercall_page+1004>:	add    %al,(%rax)
0xffffffff810093ee <hypercall_page+1006>:	add    %al,(%rax)
0xffffffff810093f0 <hypercall_page+1008>:	add    %al,(%rax)
0xffffffff810093f2 <hypercall_page+1010>:	add    %al,(%rax)
0xffffffff810093f4 <hypercall_page+1012>:	add    %al,(%rax)
0xffffffff810093f6 <hypercall_page+1014>:	add    %al,(%rax)
0xffffffff810093f8 <hypercall_page+1016>:	add    %al,(%rax)
0xffffffff810093fa <hypercall_page+1018>:	add    %al,(%rax)
0xffffffff810093fc <hypercall_page+1020>:	add    %al,(%rax)
0xffffffff810093fe <hypercall_page+1022>:	add    %al,(%rax)
0xffffffff81009400 <hypercall_page+1024>:	add    %al,(%rax)
0xffffffff81009402 <hypercall_page+1026>:	add    %al,(%rax)
0xffffffff81009404 <hypercall_page+1028>:	add    %al,(%rax)
0xffffffff81009406 <hypercall_page+1030>:	add    %al,(%rax)
0xffffffff81009408 <hypercall_page+1032>:	add    %al,(%rax)
0xffffffff8100940a <hypercall_page+1034>:	add    %al,(%rax)
0xffffffff8100940c <hypercall_page+1036>:	add    %al,(%rax)
0xffffffff8100940e <hypercall_page+1038>:	add    %al,(%rax)
0xffffffff81009410 <hypercall_page+1040>:	add    %al,(%rax)
0xffffffff81009412 <hypercall_page+1042>:	add    %al,(%rax)
0xffffffff81009414 <hypercall_page+1044>:	add    %al,(%rax)
0xffffffff81009416 <hypercall_page+1046>:	add    %al,(%rax)
0xffffffff81009418 <hypercall_page+1048>:	add    %al,(%rax)
0xffffffff8100941a <hypercall_page+1050>:	add    %al,(%rax)
0xffffffff8100941c <hypercall_page+1052>:	add    %al,(%rax)
0xffffffff8100941e <hypercall_page+1054>:	add    %al,(%rax)
0xffffffff81009420 <hypercall_page+1056>:	add    %al,(%rax)
0xffffffff81009422 <hypercall_page+1058>:	add    %al,(%rax)
0xffffffff81009424 <hypercall_page+1060>:	add    %al,(%rax)
0xffffffff81009426 <hypercall_page+1062>:	add    %al,(%rax)
0xffffffff81009428 <hypercall_page+1064>:	add    %al,(%rax)
0xffffffff8100942a <hypercall_page+1066>:	add    %al,(%rax)
0xffffffff8100942c <hypercall_page+1068>:	add    %al,(%rax)
0xffffffff8100942e <hypercall_page+1070>:	add    %al,(%rax)
0xffffffff81009430 <hypercall_page+1072>:	add    %al,(%rax)
0xffffffff81009432 <hypercall_page+1074>:	add    %al,(%rax)
0xffffffff81009434 <hypercall_page+1076>:	add    %al,(%rax)
0xffffffff81009436 <hypercall_page+1078>:	add    %al,(%rax)
0xffffffff81009438 <hypercall_page+1080>:	add    %al,(%rax)
0xffffffff8100943a <hypercall_page+1082>:	add    %al,(%rax)
0xffffffff8100943c <hypercall_page+1084>:	add    %al,(%rax)
0xffffffff8100943e <hypercall_page+1086>:	add    %al,(%rax)
0xffffffff81009440 <hypercall_page+1088>:	add    %al,(%rax)
0xffffffff81009442 <hypercall_page+1090>:	add    %al,(%rax)
0xffffffff81009444 <hypercall_page+1092>:	add    %al,(%rax)
0xffffffff81009446 <hypercall_page+1094>:	add    %al,(%rax)
0xffffffff81009448 <hypercall_page+1096>:	add    %al,(%rax)
0xffffffff8100944a <hypercall_page+1098>:	add    %al,(%rax)
0xffffffff8100944c <hypercall_page+1100>:	add    %al,(%rax)
0xffffffff8100944e <hypercall_page+1102>:	add    %al,(%rax)
0xffffffff81009450 <hypercall_page+1104>:	add    %al,(%rax)
0xffffffff81009452 <hypercall_page+1106>:	add    %al,(%rax)
0xffffffff81009454 <hypercall_page+1108>:	add    %al,(%rax)
0xffffffff81009456 <hypercall_page+1110>:	add    %al,(%rax)
0xffffffff81009458 <hypercall_page+1112>:	add    %al,(%rax)
0xffffffff8100945a <hypercall_page+1114>:	add    %al,(%rax)
0xffffffff8100945c <hypercall_page+1116>:	add    %al,(%rax)
0xffffffff8100945e <hypercall_page+1118>:	add    %al,(%rax)
0xffffffff81009460 <hypercall_page+1120>:	add    %al,(%rax)
0xffffffff81009462 <hypercall_page+1122>:	add    %al,(%rax)
0xffffffff81009464 <hypercall_page+1124>:	add    %al,(%rax)
0xffffffff81009466 <hypercall_page+1126>:	add    %al,(%rax)
0xffffffff81009468 <hypercall_page+1128>:	add    %al,(%rax)
0xffffffff8100946a <hypercall_page+1130>:	add    %al,(%rax)
0xffffffff8100946c <hypercall_page+1132>:	add    %al,(%rax)
0xffffffff8100946e <hypercall_page+1134>:	add    %al,(%rax)
0xffffffff81009470 <hypercall_page+1136>:	add    %al,(%rax)
0xffffffff81009472 <hypercall_page+1138>:	add    %al,(%rax)
0xffffffff81009474 <hypercall_page+1140>:	add    %al,(%rax)
0xffffffff81009476 <hypercall_page+1142>:	add    %al,(%rax)
0xffffffff81009478 <hypercall_page+1144>:	add    %al,(%rax)
0xffffffff8100947a <hypercall_page+1146>:	add    %al,(%rax)
0xffffffff8100947c <hypercall_page+1148>:	add    %al,(%rax)
0xffffffff8100947e <hypercall_page+1150>:	add    %al,(%rax)
0xffffffff81009480 <hypercall_page+1152>:	add    %al,(%rax)
0xffffffff81009482 <hypercall_page+1154>:	add    %al,(%rax)
0xffffffff81009484 <hypercall_page+1156>:	add    %al,(%rax)
0xffffffff81009486 <hypercall_page+1158>:	add    %al,(%rax)
0xffffffff81009488 <hypercall_page+1160>:	add    %al,(%rax)
0xffffffff8100948a <hypercall_page+1162>:	add    %al,(%rax)
0xffffffff8100948c <hypercall_page+1164>:	add    %al,(%rax)
0xffffffff8100948e <hypercall_page+1166>:	add    %al,(%rax)
0xffffffff81009490 <hypercall_page+1168>:	add    %al,(%rax)
0xffffffff81009492 <hypercall_page+1170>:	add    %al,(%rax)
0xffffffff81009494 <hypercall_page+1172>:	add    %al,(%rax)
0xffffffff81009496 <hypercall_page+1174>:	add    %al,(%rax)
0xffffffff81009498 <hypercall_page+1176>:	add    %al,(%rax)
0xffffffff8100949a <hypercall_page+1178>:	add    %al,(%rax)
0xffffffff8100949c <hypercall_page+1180>:	add    %al,(%rax)
0xffffffff8100949e <hypercall_page+1182>:	add    %al,(%rax)
0xffffffff810094a0 <hypercall_page+1184>:	add    %al,(%rax)
0xffffffff810094a2 <hypercall_page+1186>:	add    %al,(%rax)
0xffffffff810094a4 <hypercall_page+1188>:	add    %al,(%rax)
0xffffffff810094a6 <hypercall_page+1190>:	add    %al,(%rax)
0xffffffff810094a8 <hypercall_page+1192>:	add    %al,(%rax)
0xffffffff810094aa <hypercall_page+1194>:	add    %al,(%rax)
0xffffffff810094ac <hypercall_page+1196>:	add    %al,(%rax)
0xffffffff810094ae <hypercall_page+1198>:	add    %al,(%rax)
0xffffffff810094b0 <hypercall_page+1200>:	add    %al,(%rax)
0xffffffff810094b2 <hypercall_page+1202>:	add    %al,(%rax)
0xffffffff810094b4 <hypercall_page+1204>:	add    %al,(%rax)
0xffffffff810094b6 <hypercall_page+1206>:	add    %al,(%rax)
0xffffffff810094b8 <hypercall_page+1208>:	add    %al,(%rax)
0xffffffff810094ba <hypercall_page+1210>:	add    %al,(%rax)
0xffffffff810094bc <hypercall_page+1212>:	add    %al,(%rax)
0xffffffff810094be <hypercall_page+1214>:	add    %al,(%rax)
0xffffffff810094c0 <hypercall_page+1216>:	add    %al,(%rax)
0xffffffff810094c2 <hypercall_page+1218>:	add    %al,(%rax)
0xffffffff810094c4 <hypercall_page+1220>:	add    %al,(%rax)
0xffffffff810094c6 <hypercall_page+1222>:	add    %al,(%rax)
0xffffffff810094c8 <hypercall_page+1224>:	add    %al,(%rax)
0xffffffff810094ca <hypercall_page+1226>:	add    %al,(%rax)
0xffffffff810094cc <hypercall_page+1228>:	add    %al,(%rax)
0xffffffff810094ce <hypercall_page+1230>:	add    %al,(%rax)
0xffffffff810094d0 <hypercall_page+1232>:	add    %al,(%rax)
0xffffffff810094d2 <hypercall_page+1234>:	add    %al,(%rax)
0xffffffff810094d4 <hypercall_page+1236>:	add    %al,(%rax)
0xffffffff810094d6 <hypercall_page+1238>:	add    %al,(%rax)
0xffffffff810094d8 <hypercall_page+1240>:	add    %al,(%rax)
0xffffffff810094da <hypercall_page+1242>:	add    %al,(%rax)
0xffffffff810094dc <hypercall_page+1244>:	add    %al,(%rax)
0xffffffff810094de <hypercall_page+1246>:	add    %al,(%rax)
0xffffffff810094e0 <hypercall_page+1248>:	add    %al,(%rax)
0xffffffff810094e2 <hypercall_page+1250>:	add    %al,(%rax)
0xffffffff810094e4 <hypercall_page+1252>:	add    %al,(%rax)
0xffffffff810094e6 <hypercall_page+1254>:	add    %al,(%rax)
0xffffffff810094e8 <hypercall_page+1256>:	add    %al,(%rax)
0xffffffff810094ea <hypercall_page+1258>:	add    %al,(%rax)
0xffffffff810094ec <hypercall_page+1260>:	add    %al,(%rax)
0xffffffff810094ee <hypercall_page+1262>:	add    %al,(%rax)
0xffffffff810094f0 <hypercall_page+1264>:	add    %al,(%rax)
0xffffffff810094f2 <hypercall_page+1266>:	add    %al,(%rax)
0xffffffff810094f4 <hypercall_page+1268>:	add    %al,(%rax)
0xffffffff810094f6 <hypercall_page+1270>:	add    %al,(%rax)
0xffffffff810094f8 <hypercall_page+1272>:	add    %al,(%rax)
0xffffffff810094fa <hypercall_page+1274>:	add    %al,(%rax)
0xffffffff810094fc <hypercall_page+1276>:	add    %al,(%rax)
0xffffffff810094fe <hypercall_page+1278>:	add    %al,(%rax)
0xffffffff81009500 <hypercall_page+1280>:	add    %al,(%rax)
0xffffffff81009502 <hypercall_page+1282>:	add    %al,(%rax)
0xffffffff81009504 <hypercall_page+1284>:	add    %al,(%rax)
0xffffffff81009506 <hypercall_page+1286>:	add    %al,(%rax)
0xffffffff81009508 <hypercall_page+1288>:	add    %al,(%rax)
0xffffffff8100950a <hypercall_page+1290>:	add    %al,(%rax)
0xffffffff8100950c <hypercall_page+1292>:	add    %al,(%rax)
0xffffffff8100950e <hypercall_page+1294>:	add    %al,(%rax)
0xffffffff81009510 <hypercall_page+1296>:	add    %al,(%rax)
0xffffffff81009512 <hypercall_page+1298>:	add    %al,(%rax)
0xffffffff81009514 <hypercall_page+1300>:	add    %al,(%rax)
0xffffffff81009516 <hypercall_page+1302>:	add    %al,(%rax)
0xffffffff81009518 <hypercall_page+1304>:	add    %al,(%rax)
0xffffffff8100951a <hypercall_page+1306>:	add    %al,(%rax)
0xffffffff8100951c <hypercall_page+1308>:	add    %al,(%rax)
0xffffffff8100951e <hypercall_page+1310>:	add    %al,(%rax)
0xffffffff81009520 <hypercall_page+1312>:	add    %al,(%rax)
0xffffffff81009522 <hypercall_page+1314>:	add    %al,(%rax)
0xffffffff81009524 <hypercall_page+1316>:	add    %al,(%rax)
0xffffffff81009526 <hypercall_page+1318>:	add    %al,(%rax)
0xffffffff81009528 <hypercall_page+1320>:	add    %al,(%rax)
0xffffffff8100952a <hypercall_page+1322>:	add    %al,(%rax)
0xffffffff8100952c <hypercall_page+1324>:	add    %al,(%rax)
0xffffffff8100952e <hypercall_page+1326>:	add    %al,(%rax)
0xffffffff81009530 <hypercall_page+1328>:	add    %al,(%rax)
0xffffffff81009532 <hypercall_page+1330>:	add    %al,(%rax)
0xffffffff81009534 <hypercall_page+1332>:	add    %al,(%rax)
0xffffffff81009536 <hypercall_page+1334>:	add    %al,(%rax)
0xffffffff81009538 <hypercall_page+1336>:	add    %al,(%rax)
0xffffffff8100953a <hypercall_page+1338>:	add    %al,(%rax)
0xffffffff8100953c <hypercall_page+1340>:	add    %al,(%rax)
0xffffffff8100953e <hypercall_page+1342>:	add    %al,(%rax)
0xffffffff81009540 <hypercall_page+1344>:	add    %al,(%rax)
0xffffffff81009542 <hypercall_page+1346>:	add    %al,(%rax)
0xffffffff81009544 <hypercall_page+1348>:	add    %al,(%rax)
0xffffffff81009546 <hypercall_page+1350>:	add    %al,(%rax)
0xffffffff81009548 <hypercall_page+1352>:	add    %al,(%rax)
0xffffffff8100954a <hypercall_page+1354>:	add    %al,(%rax)
0xffffffff8100954c <hypercall_page+1356>:	add    %al,(%rax)
0xffffffff8100954e <hypercall_page+1358>:	add    %al,(%rax)
0xffffffff81009550 <hypercall_page+1360>:	add    %al,(%rax)
0xffffffff81009552 <hypercall_page+1362>:	add    %al,(%rax)
0xffffffff81009554 <hypercall_page+1364>:	add    %al,(%rax)
0xffffffff81009556 <hypercall_page+1366>:	add    %al,(%rax)
0xffffffff81009558 <hypercall_page+1368>:	add    %al,(%rax)
0xffffffff8100955a <hypercall_page+1370>:	add    %al,(%rax)
0xffffffff8100955c <hypercall_page+1372>:	add    %al,(%rax)
0xffffffff8100955e <hypercall_page+1374>:	add    %al,(%rax)
0xffffffff81009560 <hypercall_page+1376>:	add    %al,(%rax)
0xffffffff81009562 <hypercall_page+1378>:	add    %al,(%rax)
0xffffffff81009564 <hypercall_page+1380>:	add    %al,(%rax)
0xffffffff81009566 <hypercall_page+1382>:	add    %al,(%rax)
0xffffffff81009568 <hypercall_page+1384>:	add    %al,(%rax)
0xffffffff8100956a <hypercall_page+1386>:	add    %al,(%rax)
0xffffffff8100956c <hypercall_page+1388>:	add    %al,(%rax)
0xffffffff8100956e <hypercall_page+1390>:	add    %al,(%rax)
0xffffffff81009570 <hypercall_page+1392>:	add    %al,(%rax)
0xffffffff81009572 <hypercall_page+1394>:	add    %al,(%rax)
0xffffffff81009574 <hypercall_page+1396>:	add    %al,(%rax)
0xffffffff81009576 <hypercall_page+1398>:	add    %al,(%rax)
0xffffffff81009578 <hypercall_page+1400>:	add    %al,(%rax)
0xffffffff8100957a <hypercall_page+1402>:	add    %al,(%rax)
0xffffffff8100957c <hypercall_page+1404>:	add    %al,(%rax)
0xffffffff8100957e <hypercall_page+1406>:	add    %al,(%rax)
0xffffffff81009580 <hypercall_page+1408>:	add    %al,(%rax)
0xffffffff81009582 <hypercall_page+1410>:	add    %al,(%rax)
0xffffffff81009584 <hypercall_page+1412>:	add    %al,(%rax)
0xffffffff81009586 <hypercall_page+1414>:	add    %al,(%rax)
0xffffffff81009588 <hypercall_page+1416>:	add    %al,(%rax)
0xffffffff8100958a <hypercall_page+1418>:	add    %al,(%rax)
0xffffffff8100958c <hypercall_page+1420>:	add    %al,(%rax)
0xffffffff8100958e <hypercall_page+1422>:	add    %al,(%rax)
0xffffffff81009590 <hypercall_page+1424>:	add    %al,(%rax)
0xffffffff81009592 <hypercall_page+1426>:	add    %al,(%rax)
0xffffffff81009594 <hypercall_page+1428>:	add    %al,(%rax)
0xffffffff81009596 <hypercall_page+1430>:	add    %al,(%rax)
0xffffffff81009598 <hypercall_page+1432>:	add    %al,(%rax)
0xffffffff8100959a <hypercall_page+1434>:	add    %al,(%rax)
0xffffffff8100959c <hypercall_page+1436>:	add    %al,(%rax)
0xffffffff8100959e <hypercall_page+1438>:	add    %al,(%rax)
0xffffffff810095a0 <hypercall_page+1440>:	add    %al,(%rax)
0xffffffff810095a2 <hypercall_page+1442>:	add    %al,(%rax)
0xffffffff810095a4 <hypercall_page+1444>:	add    %al,(%rax)
0xffffffff810095a6 <hypercall_page+1446>:	add    %al,(%rax)
0xffffffff810095a8 <hypercall_page+1448>:	add    %al,(%rax)
0xffffffff810095aa <hypercall_page+1450>:	add    %al,(%rax)
0xffffffff810095ac <hypercall_page+1452>:	add    %al,(%rax)
0xffffffff810095ae <hypercall_page+1454>:	add    %al,(%rax)
0xffffffff810095b0 <hypercall_page+1456>:	add    %al,(%rax)
0xffffffff810095b2 <hypercall_page+1458>:	add    %al,(%rax)
0xffffffff810095b4 <hypercall_page+1460>:	add    %al,(%rax)
0xffffffff810095b6 <hypercall_page+1462>:	add    %al,(%rax)
0xffffffff810095b8 <hypercall_page+1464>:	add    %al,(%rax)
0xffffffff810095ba <hypercall_page+1466>:	add    %al,(%rax)
0xffffffff810095bc <hypercall_page+1468>:	add    %al,(%rax)
0xffffffff810095be <hypercall_page+1470>:	add    %al,(%rax)
0xffffffff810095c0 <hypercall_page+1472>:	add    %al,(%rax)
0xffffffff810095c2 <hypercall_page+1474>:	add    %al,(%rax)
0xffffffff810095c4 <hypercall_page+1476>:	add    %al,(%rax)
0xffffffff810095c6 <hypercall_page+1478>:	add    %al,(%rax)
0xffffffff810095c8 <hypercall_page+1480>:	add    %al,(%rax)
0xffffffff810095ca <hypercall_page+1482>:	add    %al,(%rax)
0xffffffff810095cc <hypercall_page+1484>:	add    %al,(%rax)
0xffffffff810095ce <hypercall_page+1486>:	add    %al,(%rax)
0xffffffff810095d0 <hypercall_page+1488>:	add    %al,(%rax)
0xffffffff810095d2 <hypercall_page+1490>:	add    %al,(%rax)
0xffffffff810095d4 <hypercall_page+1492>:	add    %al,(%rax)
0xffffffff810095d6 <hypercall_page+1494>:	add    %al,(%rax)
0xffffffff810095d8 <hypercall_page+1496>:	add    %al,(%rax)
0xffffffff810095da <hypercall_page+1498>:	add    %al,(%rax)
0xffffffff810095dc <hypercall_page+1500>:	add    %al,(%rax)
0xffffffff810095de <hypercall_page+1502>:	add    %al,(%rax)
0xffffffff810095e0 <hypercall_page+1504>:	add    %al,(%rax)
0xffffffff810095e2 <hypercall_page+1506>:	add    %al,(%rax)
0xffffffff810095e4 <hypercall_page+1508>:	add    %al,(%rax)
0xffffffff810095e6 <hypercall_page+1510>:	add    %al,(%rax)
0xffffffff810095e8 <hypercall_page+1512>:	add    %al,(%rax)
0xffffffff810095ea <hypercall_page+1514>:	add    %al,(%rax)
0xffffffff810095ec <hypercall_page+1516>:	add    %al,(%rax)
0xffffffff810095ee <hypercall_page+1518>:	add    %al,(%rax)
0xffffffff810095f0 <hypercall_page+1520>:	add    %al,(%rax)
0xffffffff810095f2 <hypercall_page+1522>:	add    %al,(%rax)
0xffffffff810095f4 <hypercall_page+1524>:	add    %al,(%rax)
0xffffffff810095f6 <hypercall_page+1526>:	add    %al,(%rax)
0xffffffff810095f8 <hypercall_page+1528>:	add    %al,(%rax)
0xffffffff810095fa <hypercall_page+1530>:	add    %al,(%rax)
0xffffffff810095fc <hypercall_page+1532>:	add    %al,(%rax)
0xffffffff810095fe <hypercall_page+1534>:	add    %al,(%rax)
0xffffffff81009600 <hypercall_page+1536>:	add    %al,(%rax)
0xffffffff81009602 <hypercall_page+1538>:	add    %al,(%rax)
0xffffffff81009604 <hypercall_page+1540>:	add    %al,(%rax)
0xffffffff81009606 <hypercall_page+1542>:	add    %al,(%rax)
0xffffffff81009608 <hypercall_page+1544>:	add    %al,(%rax)
0xffffffff8100960a <hypercall_page+1546>:	add    %al,(%rax)
0xffffffff8100960c <hypercall_page+1548>:	add    %al,(%rax)
0xffffffff8100960e <hypercall_page+1550>:	add    %al,(%rax)
0xffffffff81009610 <hypercall_page+1552>:	add    %al,(%rax)
0xffffffff81009612 <hypercall_page+1554>:	add    %al,(%rax)
0xffffffff81009614 <hypercall_page+1556>:	add    %al,(%rax)
0xffffffff81009616 <hypercall_page+1558>:	add    %al,(%rax)
0xffffffff81009618 <hypercall_page+1560>:	add    %al,(%rax)
0xffffffff8100961a <hypercall_page+1562>:	add    %al,(%rax)
0xffffffff8100961c <hypercall_page+1564>:	add    %al,(%rax)
0xffffffff8100961e <hypercall_page+1566>:	add    %al,(%rax)
0xffffffff81009620 <hypercall_page+1568>:	add    %al,(%rax)
0xffffffff81009622 <hypercall_page+1570>:	add    %al,(%rax)
0xffffffff81009624 <hypercall_page+1572>:	add    %al,(%rax)
0xffffffff81009626 <hypercall_page+1574>:	add    %al,(%rax)
0xffffffff81009628 <hypercall_page+1576>:	add    %al,(%rax)
0xffffffff8100962a <hypercall_page+1578>:	add    %al,(%rax)
0xffffffff8100962c <hypercall_page+1580>:	add    %al,(%rax)
0xffffffff8100962e <hypercall_page+1582>:	add    %al,(%rax)
0xffffffff81009630 <hypercall_page+1584>:	add    %al,(%rax)
0xffffffff81009632 <hypercall_page+1586>:	add    %al,(%rax)
0xffffffff81009634 <hypercall_page+1588>:	add    %al,(%rax)
0xffffffff81009636 <hypercall_page+1590>:	add    %al,(%rax)
0xffffffff81009638 <hypercall_page+1592>:	add    %al,(%rax)
0xffffffff8100963a <hypercall_page+1594>:	add    %al,(%rax)
0xffffffff8100963c <hypercall_page+1596>:	add    %al,(%rax)
0xffffffff8100963e <hypercall_page+1598>:	add    %al,(%rax)
0xffffffff81009640 <hypercall_page+1600>:	add    %al,(%rax)
0xffffffff81009642 <hypercall_page+1602>:	add    %al,(%rax)
0xffffffff81009644 <hypercall_page+1604>:	add    %al,(%rax)
0xffffffff81009646 <hypercall_page+1606>:	add    %al,(%rax)
0xffffffff81009648 <hypercall_page+1608>:	add    %al,(%rax)
0xffffffff8100964a <hypercall_page+1610>:	add    %al,(%rax)
0xffffffff8100964c <hypercall_page+1612>:	add    %al,(%rax)
0xffffffff8100964e <hypercall_page+1614>:	add    %al,(%rax)
0xffffffff81009650 <hypercall_page+1616>:	add    %al,(%rax)
0xffffffff81009652 <hypercall_page+1618>:	add    %al,(%rax)
0xffffffff81009654 <hypercall_page+1620>:	add    %al,(%rax)
0xffffffff81009656 <hypercall_page+1622>:	add    %al,(%rax)
0xffffffff81009658 <hypercall_page+1624>:	add    %al,(%rax)
0xffffffff8100965a <hypercall_page+1626>:	add    %al,(%rax)
0xffffffff8100965c <hypercall_page+1628>:	add    %al,(%rax)
0xffffffff8100965e <hypercall_page+1630>:	add    %al,(%rax)
0xffffffff81009660 <hypercall_page+1632>:	add    %al,(%rax)
0xffffffff81009662 <hypercall_page+1634>:	add    %al,(%rax)
0xffffffff81009664 <hypercall_page+1636>:	add    %al,(%rax)
0xffffffff81009666 <hypercall_page+1638>:	add    %al,(%rax)
0xffffffff81009668 <hypercall_page+1640>:	add    %al,(%rax)
0xffffffff8100966a <hypercall_page+1642>:	add    %al,(%rax)
0xffffffff8100966c <hypercall_page+1644>:	add    %al,(%rax)
0xffffffff8100966e <hypercall_page+1646>:	add    %al,(%rax)
0xffffffff81009670 <hypercall_page+1648>:	add    %al,(%rax)
0xffffffff81009672 <hypercall_page+1650>:	add    %al,(%rax)
0xffffffff81009674 <hypercall_page+1652>:	add    %al,(%rax)
0xffffffff81009676 <hypercall_page+1654>:	add    %al,(%rax)
0xffffffff81009678 <hypercall_page+1656>:	add    %al,(%rax)
0xffffffff8100967a <hypercall_page+1658>:	add    %al,(%rax)
0xffffffff8100967c <hypercall_page+1660>:	add    %al,(%rax)
0xffffffff8100967e <hypercall_page+1662>:	add    %al,(%rax)
0xffffffff81009680 <hypercall_page+1664>:	add    %al,(%rax)
0xffffffff81009682 <hypercall_page+1666>:	add    %al,(%rax)
0xffffffff81009684 <hypercall_page+1668>:	add    %al,(%rax)
0xffffffff81009686 <hypercall_page+1670>:	add    %al,(%rax)
0xffffffff81009688 <hypercall_page+1672>:	add    %al,(%rax)
0xffffffff8100968a <hypercall_page+1674>:	add    %al,(%rax)
0xffffffff8100968c <hypercall_page+1676>:	add    %al,(%rax)
0xffffffff8100968e <hypercall_page+1678>:	add    %al,(%rax)
0xffffffff81009690 <hypercall_page+1680>:	add    %al,(%rax)
0xffffffff81009692 <hypercall_page+1682>:	add    %al,(%rax)
0xffffffff81009694 <hypercall_page+1684>:	add    %al,(%rax)
0xffffffff81009696 <hypercall_page+1686>:	add    %al,(%rax)
0xffffffff81009698 <hypercall_page+1688>:	add    %al,(%rax)
0xffffffff8100969a <hypercall_page+1690>:	add    %al,(%rax)
0xffffffff8100969c <hypercall_page+1692>:	add    %al,(%rax)
0xffffffff8100969e <hypercall_page+1694>:	add    %al,(%rax)
0xffffffff810096a0 <hypercall_page+1696>:	add    %al,(%rax)
0xffffffff810096a2 <hypercall_page+1698>:	add    %al,(%rax)
0xffffffff810096a4 <hypercall_page+1700>:	add    %al,(%rax)
0xffffffff810096a6 <hypercall_page+1702>:	add    %al,(%rax)
0xffffffff810096a8 <hypercall_page+1704>:	add    %al,(%rax)
0xffffffff810096aa <hypercall_page+1706>:	add    %al,(%rax)
0xffffffff810096ac <hypercall_page+1708>:	add    %al,(%rax)
0xffffffff810096ae <hypercall_page+1710>:	add    %al,(%rax)
0xffffffff810096b0 <hypercall_page+1712>:	add    %al,(%rax)
0xffffffff810096b2 <hypercall_page+1714>:	add    %al,(%rax)
0xffffffff810096b4 <hypercall_page+1716>:	add    %al,(%rax)
0xffffffff810096b6 <hypercall_page+1718>:	add    %al,(%rax)
0xffffffff810096b8 <hypercall_page+1720>:	add    %al,(%rax)
0xffffffff810096ba <hypercall_page+1722>:	add    %al,(%rax)
0xffffffff810096bc <hypercall_page+1724>:	add    %al,(%rax)
0xffffffff810096be <hypercall_page+1726>:	add    %al,(%rax)
0xffffffff810096c0 <hypercall_page+1728>:	add    %al,(%rax)
0xffffffff810096c2 <hypercall_page+1730>:	add    %al,(%rax)
0xffffffff810096c4 <hypercall_page+1732>:	add    %al,(%rax)
0xffffffff810096c6 <hypercall_page+1734>:	add    %al,(%rax)
0xffffffff810096c8 <hypercall_page+1736>:	add    %al,(%rax)
0xffffffff810096ca <hypercall_page+1738>:	add    %al,(%rax)
0xffffffff810096cc <hypercall_page+1740>:	add    %al,(%rax)
0xffffffff810096ce <hypercall_page+1742>:	add    %al,(%rax)
0xffffffff810096d0 <hypercall_page+1744>:	add    %al,(%rax)
0xffffffff810096d2 <hypercall_page+1746>:	add    %al,(%rax)
0xffffffff810096d4 <hypercall_page+1748>:	add    %al,(%rax)
0xffffffff810096d6 <hypercall_page+1750>:	add    %al,(%rax)
0xffffffff810096d8 <hypercall_page+1752>:	add    %al,(%rax)
0xffffffff810096da <hypercall_page+1754>:	add    %al,(%rax)
0xffffffff810096dc <hypercall_page+1756>:	add    %al,(%rax)
0xffffffff810096de <hypercall_page+1758>:	add    %al,(%rax)
0xffffffff810096e0 <hypercall_page+1760>:	add    %al,(%rax)
0xffffffff810096e2 <hypercall_page+1762>:	add    %al,(%rax)
0xffffffff810096e4 <hypercall_page+1764>:	add    %al,(%rax)
0xffffffff810096e6 <hypercall_page+1766>:	add    %al,(%rax)
0xffffffff810096e8 <hypercall_page+1768>:	add    %al,(%rax)
0xffffffff810096ea <hypercall_page+1770>:	add    %al,(%rax)
0xffffffff810096ec <hypercall_page+1772>:	add    %al,(%rax)
0xffffffff810096ee <hypercall_page+1774>:	add    %al,(%rax)
0xffffffff810096f0 <hypercall_page+1776>:	add    %al,(%rax)
0xffffffff810096f2 <hypercall_page+1778>:	add    %al,(%rax)
0xffffffff810096f4 <hypercall_page+1780>:	add    %al,(%rax)
0xffffffff810096f6 <hypercall_page+1782>:	add    %al,(%rax)
0xffffffff810096f8 <hypercall_page+1784>:	add    %al,(%rax)
0xffffffff810096fa <hypercall_page+1786>:	add    %al,(%rax)
0xffffffff810096fc <hypercall_page+1788>:	add    %al,(%rax)
0xffffffff810096fe <hypercall_page+1790>:	add    %al,(%rax)
0xffffffff81009700 <hypercall_page+1792>:	add    %al,(%rax)
0xffffffff81009702 <hypercall_page+1794>:	add    %al,(%rax)
0xffffffff81009704 <hypercall_page+1796>:	add    %al,(%rax)
0xffffffff81009706 <hypercall_page+1798>:	add    %al,(%rax)
0xffffffff81009708 <hypercall_page+1800>:	add    %al,(%rax)
0xffffffff8100970a <hypercall_page+1802>:	add    %al,(%rax)
0xffffffff8100970c <hypercall_page+1804>:	add    %al,(%rax)
0xffffffff8100970e <hypercall_page+1806>:	add    %al,(%rax)
0xffffffff81009710 <hypercall_page+1808>:	add    %al,(%rax)
0xffffffff81009712 <hypercall_page+1810>:	add    %al,(%rax)
0xffffffff81009714 <hypercall_page+1812>:	add    %al,(%rax)
0xffffffff81009716 <hypercall_page+1814>:	add    %al,(%rax)
0xffffffff81009718 <hypercall_page+1816>:	add    %al,(%rax)
0xffffffff8100971a <hypercall_page+1818>:	add    %al,(%rax)
0xffffffff8100971c <hypercall_page+1820>:	add    %al,(%rax)
0xffffffff8100971e <hypercall_page+1822>:	add    %al,(%rax)
0xffffffff81009720 <hypercall_page+1824>:	add    %al,(%rax)
0xffffffff81009722 <hypercall_page+1826>:	add    %al,(%rax)
0xffffffff81009724 <hypercall_page+1828>:	add    %al,(%rax)
0xffffffff81009726 <hypercall_page+1830>:	add    %al,(%rax)
0xffffffff81009728 <hypercall_page+1832>:	add    %al,(%rax)
0xffffffff8100972a <hypercall_page+1834>:	add    %al,(%rax)
0xffffffff8100972c <hypercall_page+1836>:	add    %al,(%rax)
0xffffffff8100972e <hypercall_page+1838>:	add    %al,(%rax)
0xffffffff81009730 <hypercall_page+1840>:	add    %al,(%rax)
0xffffffff81009732 <hypercall_page+1842>:	add    %al,(%rax)
0xffffffff81009734 <hypercall_page+1844>:	add    %al,(%rax)
0xffffffff81009736 <hypercall_page+1846>:	add    %al,(%rax)
0xffffffff81009738 <hypercall_page+1848>:	add    %al,(%rax)
0xffffffff8100973a <hypercall_page+1850>:	add    %al,(%rax)
0xffffffff8100973c <hypercall_page+1852>:	add    %al,(%rax)
0xffffffff8100973e <hypercall_page+1854>:	add    %al,(%rax)
0xffffffff81009740 <hypercall_page+1856>:	add    %al,(%rax)
0xffffffff81009742 <hypercall_page+1858>:	add    %al,(%rax)
0xffffffff81009744 <hypercall_page+1860>:	add    %al,(%rax)
0xffffffff81009746 <hypercall_page+1862>:	add    %al,(%rax)
0xffffffff81009748 <hypercall_page+1864>:	add    %al,(%rax)
0xffffffff8100974a <hypercall_page+1866>:	add    %al,(%rax)
0xffffffff8100974c <hypercall_page+1868>:	add    %al,(%rax)
0xffffffff8100974e <hypercall_page+1870>:	add    %al,(%rax)
0xffffffff81009750 <hypercall_page+1872>:	add    %al,(%rax)
0xffffffff81009752 <hypercall_page+1874>:	add    %al,(%rax)
0xffffffff81009754 <hypercall_page+1876>:	add    %al,(%rax)
0xffffffff81009756 <hypercall_page+1878>:	add    %al,(%rax)
0xffffffff81009758 <hypercall_page+1880>:	add    %al,(%rax)
0xffffffff8100975a <hypercall_page+1882>:	add    %al,(%rax)
0xffffffff8100975c <hypercall_page+1884>:	add    %al,(%rax)
0xffffffff8100975e <hypercall_page+1886>:	add    %al,(%rax)
0xffffffff81009760 <hypercall_page+1888>:	add    %al,(%rax)
0xffffffff81009762 <hypercall_page+1890>:	add    %al,(%rax)
0xffffffff81009764 <hypercall_page+1892>:	add    %al,(%rax)
0xffffffff81009766 <hypercall_page+1894>:	add    %al,(%rax)
0xffffffff81009768 <hypercall_page+1896>:	add    %al,(%rax)
0xffffffff8100976a <hypercall_page+1898>:	add    %al,(%rax)
0xffffffff8100976c <hypercall_page+1900>:	add    %al,(%rax)
0xffffffff8100976e <hypercall_page+1902>:	add    %al,(%rax)
0xffffffff81009770 <hypercall_page+1904>:	add    %al,(%rax)
0xffffffff81009772 <hypercall_page+1906>:	add    %al,(%rax)
0xffffffff81009774 <hypercall_page+1908>:	add    %al,(%rax)
0xffffffff81009776 <hypercall_page+1910>:	add    %al,(%rax)
0xffffffff81009778 <hypercall_page+1912>:	add    %al,(%rax)
0xffffffff8100977a <hypercall_page+1914>:	add    %al,(%rax)
0xffffffff8100977c <hypercall_page+1916>:	add    %al,(%rax)
0xffffffff8100977e <hypercall_page+1918>:	add    %al,(%rax)
0xffffffff81009780 <hypercall_page+1920>:	add    %al,(%rax)
0xffffffff81009782 <hypercall_page+1922>:	add    %al,(%rax)
0xffffffff81009784 <hypercall_page+1924>:	add    %al,(%rax)
0xffffffff81009786 <hypercall_page+1926>:	add    %al,(%rax)
0xffffffff81009788 <hypercall_page+1928>:	add    %al,(%rax)
0xffffffff8100978a <hypercall_page+1930>:	add    %al,(%rax)
0xffffffff8100978c <hypercall_page+1932>:	add    %al,(%rax)
0xffffffff8100978e <hypercall_page+1934>:	add    %al,(%rax)
0xffffffff81009790 <hypercall_page+1936>:	add    %al,(%rax)
0xffffffff81009792 <hypercall_page+1938>:	add    %al,(%rax)
0xffffffff81009794 <hypercall_page+1940>:	add    %al,(%rax)
0xffffffff81009796 <hypercall_page+1942>:	add    %al,(%rax)
0xffffffff81009798 <hypercall_page+1944>:	add    %al,(%rax)
0xffffffff8100979a <hypercall_page+1946>:	add    %al,(%rax)
0xffffffff8100979c <hypercall_page+1948>:	add    %al,(%rax)
0xffffffff8100979e <hypercall_page+1950>:	add    %al,(%rax)
0xffffffff810097a0 <hypercall_page+1952>:	add    %al,(%rax)
0xffffffff810097a2 <hypercall_page+1954>:	add    %al,(%rax)
0xffffffff810097a4 <hypercall_page+1956>:	add    %al,(%rax)
0xffffffff810097a6 <hypercall_page+1958>:	add    %al,(%rax)
0xffffffff810097a8 <hypercall_page+1960>:	add    %al,(%rax)
0xffffffff810097aa <hypercall_page+1962>:	add    %al,(%rax)
0xffffffff810097ac <hypercall_page+1964>:	add    %al,(%rax)
0xffffffff810097ae <hypercall_page+1966>:	add    %al,(%rax)
0xffffffff810097b0 <hypercall_page+1968>:	add    %al,(%rax)
0xffffffff810097b2 <hypercall_page+1970>:	add    %al,(%rax)
0xffffffff810097b4 <hypercall_page+1972>:	add    %al,(%rax)
0xffffffff810097b6 <hypercall_page+1974>:	add    %al,(%rax)
0xffffffff810097b8 <hypercall_page+1976>:	add    %al,(%rax)
0xffffffff810097ba <hypercall_page+1978>:	add    %al,(%rax)
0xffffffff810097bc <hypercall_page+1980>:	add    %al,(%rax)
0xffffffff810097be <hypercall_page+1982>:	add    %al,(%rax)
0xffffffff810097c0 <hypercall_page+1984>:	add    %al,(%rax)
0xffffffff810097c2 <hypercall_page+1986>:	add    %al,(%rax)
0xffffffff810097c4 <hypercall_page+1988>:	add    %al,(%rax)
0xffffffff810097c6 <hypercall_page+1990>:	add    %al,(%rax)
0xffffffff810097c8 <hypercall_page+1992>:	add    %al,(%rax)
0xffffffff810097ca <hypercall_page+1994>:	add    %al,(%rax)
0xffffffff810097cc <hypercall_page+1996>:	add    %al,(%rax)
0xffffffff810097ce <hypercall_page+1998>:	add    %al,(%rax)
0xffffffff810097d0 <hypercall_page+2000>:	add    %al,(%rax)
0xffffffff810097d2 <hypercall_page+2002>:	add    %al,(%rax)
0xffffffff810097d4 <hypercall_page+2004>:	add    %al,(%rax)
0xffffffff810097d6 <hypercall_page+2006>:	add    %al,(%rax)
0xffffffff810097d8 <hypercall_page+2008>:	add    %al,(%rax)
0xffffffff810097da <hypercall_page+2010>:	add    %al,(%rax)
0xffffffff810097dc <hypercall_page+2012>:	add    %al,(%rax)
0xffffffff810097de <hypercall_page+2014>:	add    %al,(%rax)
0xffffffff810097e0 <hypercall_page+2016>:	add    %al,(%rax)
0xffffffff810097e2 <hypercall_page+2018>:	add    %al,(%rax)
0xffffffff810097e4 <hypercall_page+2020>:	add    %al,(%rax)
0xffffffff810097e6 <hypercall_page+2022>:	add    %al,(%rax)
0xffffffff810097e8 <hypercall_page+2024>:	add    %al,(%rax)
0xffffffff810097ea <hypercall_page+2026>:	add    %al,(%rax)
0xffffffff810097ec <hypercall_page+2028>:	add    %al,(%rax)
0xffffffff810097ee <hypercall_page+2030>:	add    %al,(%rax)
0xffffffff810097f0 <hypercall_page+2032>:	add    %al,(%rax)
0xffffffff810097f2 <hypercall_page+2034>:	add    %al,(%rax)
0xffffffff810097f4 <hypercall_page+2036>:	add    %al,(%rax)
0xffffffff810097f6 <hypercall_page+2038>:	add    %al,(%rax)
0xffffffff810097f8 <hypercall_page+2040>:	add    %al,(%rax)
0xffffffff810097fa <hypercall_page+2042>:	add    %al,(%rax)
0xffffffff810097fc <hypercall_page+2044>:	add    %al,(%rax)
0xffffffff810097fe <hypercall_page+2046>:	add    %al,(%rax)
0xffffffff81009800 <hypercall_page+2048>:	add    %al,(%rax)
0xffffffff81009802 <hypercall_page+2050>:	add    %al,(%rax)
0xffffffff81009804 <hypercall_page+2052>:	add    %al,(%rax)
0xffffffff81009806 <hypercall_page+2054>:	add    %al,(%rax)
0xffffffff81009808 <hypercall_page+2056>:	add    %al,(%rax)
0xffffffff8100980a <hypercall_page+2058>:	add    %al,(%rax)
0xffffffff8100980c <hypercall_page+2060>:	add    %al,(%rax)
0xffffffff8100980e <hypercall_page+2062>:	add    %al,(%rax)
0xffffffff81009810 <hypercall_page+2064>:	add    %al,(%rax)
0xffffffff81009812 <hypercall_page+2066>:	add    %al,(%rax)
0xffffffff81009814 <hypercall_page+2068>:	add    %al,(%rax)
0xffffffff81009816 <hypercall_page+2070>:	add    %al,(%rax)
0xffffffff81009818 <hypercall_page+2072>:	add    %al,(%rax)
0xffffffff8100981a <hypercall_page+2074>:	add    %al,(%rax)
0xffffffff8100981c <hypercall_page+2076>:	add    %al,(%rax)
0xffffffff8100981e <hypercall_page+2078>:	add    %al,(%rax)
0xffffffff81009820 <hypercall_page+2080>:	add    %al,(%rax)
0xffffffff81009822 <hypercall_page+2082>:	add    %al,(%rax)
0xffffffff81009824 <hypercall_page+2084>:	add    %al,(%rax)
0xffffffff81009826 <hypercall_page+2086>:	add    %al,(%rax)
0xffffffff81009828 <hypercall_page+2088>:	add    %al,(%rax)
0xffffffff8100982a <hypercall_page+2090>:	add    %al,(%rax)
0xffffffff8100982c <hypercall_page+2092>:	add    %al,(%rax)
0xffffffff8100982e <hypercall_page+2094>:	add    %al,(%rax)
0xffffffff81009830 <hypercall_page+2096>:	add    %al,(%rax)
0xffffffff81009832 <hypercall_page+2098>:	add    %al,(%rax)
0xffffffff81009834 <hypercall_page+2100>:	add    %al,(%rax)
0xffffffff81009836 <hypercall_page+2102>:	add    %al,(%rax)
0xffffffff81009838 <hypercall_page+2104>:	add    %al,(%rax)
0xffffffff8100983a <hypercall_page+2106>:	add    %al,(%rax)
0xffffffff8100983c <hypercall_page+2108>:	add    %al,(%rax)
0xffffffff8100983e <hypercall_page+2110>:	add    %al,(%rax)
0xffffffff81009840 <hypercall_page+2112>:	add    %al,(%rax)
0xffffffff81009842 <hypercall_page+2114>:	add    %al,(%rax)
0xffffffff81009844 <hypercall_page+2116>:	add    %al,(%rax)
0xffffffff81009846 <hypercall_page+2118>:	add    %al,(%rax)
0xffffffff81009848 <hypercall_page+2120>:	add    %al,(%rax)
0xffffffff8100984a <hypercall_page+2122>:	add    %al,(%rax)
0xffffffff8100984c <hypercall_page+2124>:	add    %al,(%rax)
0xffffffff8100984e <hypercall_page+2126>:	add    %al,(%rax)
0xffffffff81009850 <hypercall_page+2128>:	add    %al,(%rax)
0xffffffff81009852 <hypercall_page+2130>:	add    %al,(%rax)
0xffffffff81009854 <hypercall_page+2132>:	add    %al,(%rax)
0xffffffff81009856 <hypercall_page+2134>:	add    %al,(%rax)
0xffffffff81009858 <hypercall_page+2136>:	add    %al,(%rax)
0xffffffff8100985a <hypercall_page+2138>:	add    %al,(%rax)
0xffffffff8100985c <hypercall_page+2140>:	add    %al,(%rax)
0xffffffff8100985e <hypercall_page+2142>:	add    %al,(%rax)
0xffffffff81009860 <hypercall_page+2144>:	add    %al,(%rax)
0xffffffff81009862 <hypercall_page+2146>:	add    %al,(%rax)
0xffffffff81009864 <hypercall_page+2148>:	add    %al,(%rax)
0xffffffff81009866 <hypercall_page+2150>:	add    %al,(%rax)
0xffffffff81009868 <hypercall_page+2152>:	add    %al,(%rax)
0xffffffff8100986a <hypercall_page+2154>:	add    %al,(%rax)
0xffffffff8100986c <hypercall_page+2156>:	add    %al,(%rax)
0xffffffff8100986e <hypercall_page+2158>:	add    %al,(%rax)
0xffffffff81009870 <hypercall_page+2160>:	add    %al,(%rax)
0xffffffff81009872 <hypercall_page+2162>:	add    %al,(%rax)
0xffffffff81009874 <hypercall_page+2164>:	add    %al,(%rax)
0xffffffff81009876 <hypercall_page+2166>:	add    %al,(%rax)
0xffffffff81009878 <hypercall_page+2168>:	add    %al,(%rax)
0xffffffff8100987a <hypercall_page+2170>:	add    %al,(%rax)
0xffffffff8100987c <hypercall_page+2172>:	add    %al,(%rax)
0xffffffff8100987e <hypercall_page+2174>:	add    %al,(%rax)
0xffffffff81009880 <hypercall_page+2176>:	add    %al,(%rax)
0xffffffff81009882 <hypercall_page+2178>:	add    %al,(%rax)
0xffffffff81009884 <hypercall_page+2180>:	add    %al,(%rax)
0xffffffff81009886 <hypercall_page+2182>:	add    %al,(%rax)
0xffffffff81009888 <hypercall_page+2184>:	add    %al,(%rax)
0xffffffff8100988a <hypercall_page+2186>:	add    %al,(%rax)
0xffffffff8100988c <hypercall_page+2188>:	add    %al,(%rax)
0xffffffff8100988e <hypercall_page+2190>:	add    %al,(%rax)
0xffffffff81009890 <hypercall_page+2192>:	add    %al,(%rax)
0xffffffff81009892 <hypercall_page+2194>:	add    %al,(%rax)
0xffffffff81009894 <hypercall_page+2196>:	add    %al,(%rax)
0xffffffff81009896 <hypercall_page+2198>:	add    %al,(%rax)
0xffffffff81009898 <hypercall_page+2200>:	add    %al,(%rax)
0xffffffff8100989a <hypercall_page+2202>:	add    %al,(%rax)
0xffffffff8100989c <hypercall_page+2204>:	add    %al,(%rax)
0xffffffff8100989e <hypercall_page+2206>:	add    %al,(%rax)
0xffffffff810098a0 <hypercall_page+2208>:	add    %al,(%rax)
0xffffffff810098a2 <hypercall_page+2210>:	add    %al,(%rax)
0xffffffff810098a4 <hypercall_page+2212>:	add    %al,(%rax)
0xffffffff810098a6 <hypercall_page+2214>:	add    %al,(%rax)
0xffffffff810098a8 <hypercall_page+2216>:	add    %al,(%rax)
0xffffffff810098aa <hypercall_page+2218>:	add    %al,(%rax)
0xffffffff810098ac <hypercall_page+2220>:	add    %al,(%rax)
0xffffffff810098ae <hypercall_page+2222>:	add    %al,(%rax)
0xffffffff810098b0 <hypercall_page+2224>:	add    %al,(%rax)
0xffffffff810098b2 <hypercall_page+2226>:	add    %al,(%rax)
0xffffffff810098b4 <hypercall_page+2228>:	add    %al,(%rax)
0xffffffff810098b6 <hypercall_page+2230>:	add    %al,(%rax)
0xffffffff810098b8 <hypercall_page+2232>:	add    %al,(%rax)
0xffffffff810098ba <hypercall_page+2234>:	add    %al,(%rax)
0xffffffff810098bc <hypercall_page+2236>:	add    %al,(%rax)
0xffffffff810098be <hypercall_page+2238>:	add    %al,(%rax)
0xffffffff810098c0 <hypercall_page+2240>:	add    %al,(%rax)
0xffffffff810098c2 <hypercall_page+2242>:	add    %al,(%rax)
0xffffffff810098c4 <hypercall_page+2244>:	add    %al,(%rax)
0xffffffff810098c6 <hypercall_page+2246>:	add    %al,(%rax)
0xffffffff810098c8 <hypercall_page+2248>:	add    %al,(%rax)
0xffffffff810098ca <hypercall_page+2250>:	add    %al,(%rax)
0xffffffff810098cc <hypercall_page+2252>:	add    %al,(%rax)
0xffffffff810098ce <hypercall_page+2254>:	add    %al,(%rax)
0xffffffff810098d0 <hypercall_page+2256>:	add    %al,(%rax)
0xffffffff810098d2 <hypercall_page+2258>:	add    %al,(%rax)
0xffffffff810098d4 <hypercall_page+2260>:	add    %al,(%rax)
0xffffffff810098d6 <hypercall_page+2262>:	add    %al,(%rax)
0xffffffff810098d8 <hypercall_page+2264>:	add    %al,(%rax)
0xffffffff810098da <hypercall_page+2266>:	add    %al,(%rax)
0xffffffff810098dc <hypercall_page+2268>:	add    %al,(%rax)
0xffffffff810098de <hypercall_page+2270>:	add    %al,(%rax)
0xffffffff810098e0 <hypercall_page+2272>:	add    %al,(%rax)
0xffffffff810098e2 <hypercall_page+2274>:	add    %al,(%rax)
0xffffffff810098e4 <hypercall_page+2276>:	add    %al,(%rax)
0xffffffff810098e6 <hypercall_page+2278>:	add    %al,(%rax)
0xffffffff810098e8 <hypercall_page+2280>:	add    %al,(%rax)
0xffffffff810098ea <hypercall_page+2282>:	add    %al,(%rax)
0xffffffff810098ec <hypercall_page+2284>:	add    %al,(%rax)
0xffffffff810098ee <hypercall_page+2286>:	add    %al,(%rax)
0xffffffff810098f0 <hypercall_page+2288>:	add    %al,(%rax)
0xffffffff810098f2 <hypercall_page+2290>:	add    %al,(%rax)
0xffffffff810098f4 <hypercall_page+2292>:	add    %al,(%rax)
0xffffffff810098f6 <hypercall_page+2294>:	add    %al,(%rax)
0xffffffff810098f8 <hypercall_page+2296>:	add    %al,(%rax)
0xffffffff810098fa <hypercall_page+2298>:	add    %al,(%rax)
0xffffffff810098fc <hypercall_page+2300>:	add    %al,(%rax)
0xffffffff810098fe <hypercall_page+2302>:	add    %al,(%rax)
0xffffffff81009900 <hypercall_page+2304>:	add    %al,(%rax)
0xffffffff81009902 <hypercall_page+2306>:	add    %al,(%rax)
0xffffffff81009904 <hypercall_page+2308>:	add    %al,(%rax)
0xffffffff81009906 <hypercall_page+2310>:	add    %al,(%rax)
0xffffffff81009908 <hypercall_page+2312>:	add    %al,(%rax)
0xffffffff8100990a <hypercall_page+2314>:	add    %al,(%rax)
0xffffffff8100990c <hypercall_page+2316>:	add    %al,(%rax)
0xffffffff8100990e <hypercall_page+2318>:	add    %al,(%rax)
0xffffffff81009910 <hypercall_page+2320>:	add    %al,(%rax)
0xffffffff81009912 <hypercall_page+2322>:	add    %al,(%rax)
0xffffffff81009914 <hypercall_page+2324>:	add    %al,(%rax)
0xffffffff81009916 <hypercall_page+2326>:	add    %al,(%rax)
0xffffffff81009918 <hypercall_page+2328>:	add    %al,(%rax)
0xffffffff8100991a <hypercall_page+2330>:	add    %al,(%rax)
0xffffffff8100991c <hypercall_page+2332>:	add    %al,(%rax)
0xffffffff8100991e <hypercall_page+2334>:	add    %al,(%rax)
0xffffffff81009920 <hypercall_page+2336>:	add    %al,(%rax)
0xffffffff81009922 <hypercall_page+2338>:	add    %al,(%rax)
0xffffffff81009924 <hypercall_page+2340>:	add    %al,(%rax)
0xffffffff81009926 <hypercall_page+2342>:	add    %al,(%rax)
0xffffffff81009928 <hypercall_page+2344>:	add    %al,(%rax)
0xffffffff8100992a <hypercall_page+2346>:	add    %al,(%rax)
0xffffffff8100992c <hypercall_page+2348>:	add    %al,(%rax)
0xffffffff8100992e <hypercall_page+2350>:	add    %al,(%rax)
0xffffffff81009930 <hypercall_page+2352>:	add    %al,(%rax)
0xffffffff81009932 <hypercall_page+2354>:	add    %al,(%rax)
0xffffffff81009934 <hypercall_page+2356>:	add    %al,(%rax)
0xffffffff81009936 <hypercall_page+2358>:	add    %al,(%rax)
0xffffffff81009938 <hypercall_page+2360>:	add    %al,(%rax)
0xffffffff8100993a <hypercall_page+2362>:	add    %al,(%rax)
0xffffffff8100993c <hypercall_page+2364>:	add    %al,(%rax)
0xffffffff8100993e <hypercall_page+2366>:	add    %al,(%rax)
0xffffffff81009940 <hypercall_page+2368>:	add    %al,(%rax)
0xffffffff81009942 <hypercall_page+2370>:	add    %al,(%rax)
0xffffffff81009944 <hypercall_page+2372>:	add    %al,(%rax)
0xffffffff81009946 <hypercall_page+2374>:	add    %al,(%rax)
0xffffffff81009948 <hypercall_page+2376>:	add    %al,(%rax)
0xffffffff8100994a <hypercall_page+2378>:	add    %al,(%rax)
0xffffffff8100994c <hypercall_page+2380>:	add    %al,(%rax)
0xffffffff8100994e <hypercall_page+2382>:	add    %al,(%rax)
0xffffffff81009950 <hypercall_page+2384>:	add    %al,(%rax)
0xffffffff81009952 <hypercall_page+2386>:	add    %al,(%rax)
0xffffffff81009954 <hypercall_page+2388>:	add    %al,(%rax)
0xffffffff81009956 <hypercall_page+2390>:	add    %al,(%rax)
0xffffffff81009958 <hypercall_page+2392>:	add    %al,(%rax)
0xffffffff8100995a <hypercall_page+2394>:	add    %al,(%rax)
0xffffffff8100995c <hypercall_page+2396>:	add    %al,(%rax)
0xffffffff8100995e <hypercall_page+2398>:	add    %al,(%rax)
0xffffffff81009960 <hypercall_page+2400>:	add    %al,(%rax)
0xffffffff81009962 <hypercall_page+2402>:	add    %al,(%rax)
0xffffffff81009964 <hypercall_page+2404>:	add    %al,(%rax)
0xffffffff81009966 <hypercall_page+2406>:	add    %al,(%rax)
0xffffffff81009968 <hypercall_page+2408>:	add    %al,(%rax)
0xffffffff8100996a <hypercall_page+2410>:	add    %al,(%rax)
0xffffffff8100996c <hypercall_page+2412>:	add    %al,(%rax)
0xffffffff8100996e <hypercall_page+2414>:	add    %al,(%rax)
0xffffffff81009970 <hypercall_page+2416>:	add    %al,(%rax)
0xffffffff81009972 <hypercall_page+2418>:	add    %al,(%rax)
0xffffffff81009974 <hypercall_page+2420>:	add    %al,(%rax)
0xffffffff81009976 <hypercall_page+2422>:	add    %al,(%rax)
0xffffffff81009978 <hypercall_page+2424>:	add    %al,(%rax)
0xffffffff8100997a <hypercall_page+2426>:	add    %al,(%rax)
0xffffffff8100997c <hypercall_page+2428>:	add    %al,(%rax)
0xffffffff8100997e <hypercall_page+2430>:	add    %al,(%rax)
0xffffffff81009980 <hypercall_page+2432>:	add    %al,(%rax)
0xffffffff81009982 <hypercall_page+2434>:	add    %al,(%rax)
0xffffffff81009984 <hypercall_page+2436>:	add    %al,(%rax)
0xffffffff81009986 <hypercall_page+2438>:	add    %al,(%rax)
0xffffffff81009988 <hypercall_page+2440>:	add    %al,(%rax)
0xffffffff8100998a <hypercall_page+2442>:	add    %al,(%rax)
0xffffffff8100998c <hypercall_page+2444>:	add    %al,(%rax)
0xffffffff8100998e <hypercall_page+2446>:	add    %al,(%rax)
0xffffffff81009990 <hypercall_page+2448>:	add    %al,(%rax)
0xffffffff81009992 <hypercall_page+2450>:	add    %al,(%rax)
0xffffffff81009994 <hypercall_page+2452>:	add    %al,(%rax)
0xffffffff81009996 <hypercall_page+2454>:	add    %al,(%rax)
0xffffffff81009998 <hypercall_page+2456>:	add    %al,(%rax)
0xffffffff8100999a <hypercall_page+2458>:	add    %al,(%rax)
0xffffffff8100999c <hypercall_page+2460>:	add    %al,(%rax)
0xffffffff8100999e <hypercall_page+2462>:	add    %al,(%rax)
0xffffffff810099a0 <hypercall_page+2464>:	add    %al,(%rax)
0xffffffff810099a2 <hypercall_page+2466>:	add    %al,(%rax)
0xffffffff810099a4 <hypercall_page+2468>:	add    %al,(%rax)
0xffffffff810099a6 <hypercall_page+2470>:	add    %al,(%rax)
0xffffffff810099a8 <hypercall_page+2472>:	add    %al,(%rax)
0xffffffff810099aa <hypercall_page+2474>:	add    %al,(%rax)
0xffffffff810099ac <hypercall_page+2476>:	add    %al,(%rax)
0xffffffff810099ae <hypercall_page+2478>:	add    %al,(%rax)
0xffffffff810099b0 <hypercall_page+2480>:	add    %al,(%rax)
0xffffffff810099b2 <hypercall_page+2482>:	add    %al,(%rax)
0xffffffff810099b4 <hypercall_page+2484>:	add    %al,(%rax)
0xffffffff810099b6 <hypercall_page+2486>:	add    %al,(%rax)
0xffffffff810099b8 <hypercall_page+2488>:	add    %al,(%rax)
0xffffffff810099ba <hypercall_page+2490>:	add    %al,(%rax)
0xffffffff810099bc <hypercall_page+2492>:	add    %al,(%rax)
0xffffffff810099be <hypercall_page+2494>:	add    %al,(%rax)
0xffffffff810099c0 <hypercall_page+2496>:	add    %al,(%rax)
0xffffffff810099c2 <hypercall_page+2498>:	add    %al,(%rax)
0xffffffff810099c4 <hypercall_page+2500>:	add    %al,(%rax)
0xffffffff810099c6 <hypercall_page+2502>:	add    %al,(%rax)
0xffffffff810099c8 <hypercall_page+2504>:	add    %al,(%rax)
0xffffffff810099ca <hypercall_page+2506>:	add    %al,(%rax)
0xffffffff810099cc <hypercall_page+2508>:	add    %al,(%rax)
0xffffffff810099ce <hypercall_page+2510>:	add    %al,(%rax)
0xffffffff810099d0 <hypercall_page+2512>:	add    %al,(%rax)
0xffffffff810099d2 <hypercall_page+2514>:	add    %al,(%rax)
0xffffffff810099d4 <hypercall_page+2516>:	add    %al,(%rax)
0xffffffff810099d6 <hypercall_page+2518>:	add    %al,(%rax)
0xffffffff810099d8 <hypercall_page+2520>:	add    %al,(%rax)
0xffffffff810099da <hypercall_page+2522>:	add    %al,(%rax)
0xffffffff810099dc <hypercall_page+2524>:	add    %al,(%rax)
0xffffffff810099de <hypercall_page+2526>:	add    %al,(%rax)
0xffffffff810099e0 <hypercall_page+2528>:	add    %al,(%rax)
0xffffffff810099e2 <hypercall_page+2530>:	add    %al,(%rax)
0xffffffff810099e4 <hypercall_page+2532>:	add    %al,(%rax)
0xffffffff810099e6 <hypercall_page+2534>:	add    %al,(%rax)
0xffffffff810099e8 <hypercall_page+2536>:	add    %al,(%rax)
0xffffffff810099ea <hypercall_page+2538>:	add    %al,(%rax)
0xffffffff810099ec <hypercall_page+2540>:	add    %al,(%rax)
0xffffffff810099ee <hypercall_page+2542>:	add    %al,(%rax)
0xffffffff810099f0 <hypercall_page+2544>:	add    %al,(%rax)
0xffffffff810099f2 <hypercall_page+2546>:	add    %al,(%rax)
0xffffffff810099f4 <hypercall_page+2548>:	add    %al,(%rax)
0xffffffff810099f6 <hypercall_page+2550>:	add    %al,(%rax)
0xffffffff810099f8 <hypercall_page+2552>:	add    %al,(%rax)
0xffffffff810099fa <hypercall_page+2554>:	add    %al,(%rax)
0xffffffff810099fc <hypercall_page+2556>:	add    %al,(%rax)
0xffffffff810099fe <hypercall_page+2558>:	add    %al,(%rax)
0xffffffff81009a00 <hypercall_page+2560>:	add    %al,(%rax)
0xffffffff81009a02 <hypercall_page+2562>:	add    %al,(%rax)
0xffffffff81009a04 <hypercall_page+2564>:	add    %al,(%rax)
0xffffffff81009a06 <hypercall_page+2566>:	add    %al,(%rax)
0xffffffff81009a08 <hypercall_page+2568>:	add    %al,(%rax)
0xffffffff81009a0a <hypercall_page+2570>:	add    %al,(%rax)
0xffffffff81009a0c <hypercall_page+2572>:	add    %al,(%rax)
0xffffffff81009a0e <hypercall_page+2574>:	add    %al,(%rax)
0xffffffff81009a10 <hypercall_page+2576>:	add    %al,(%rax)
0xffffffff81009a12 <hypercall_page+2578>:	add    %al,(%rax)
0xffffffff81009a14 <hypercall_page+2580>:	add    %al,(%rax)
0xffffffff81009a16 <hypercall_page+2582>:	add    %al,(%rax)
0xffffffff81009a18 <hypercall_page+2584>:	add    %al,(%rax)
0xffffffff81009a1a <hypercall_page+2586>:	add    %al,(%rax)
0xffffffff81009a1c <hypercall_page+2588>:	add    %al,(%rax)
0xffffffff81009a1e <hypercall_page+2590>:	add    %al,(%rax)
0xffffffff81009a20 <hypercall_page+2592>:	add    %al,(%rax)
0xffffffff81009a22 <hypercall_page+2594>:	add    %al,(%rax)
0xffffffff81009a24 <hypercall_page+2596>:	add    %al,(%rax)
0xffffffff81009a26 <hypercall_page+2598>:	add    %al,(%rax)
0xffffffff81009a28 <hypercall_page+2600>:	add    %al,(%rax)
0xffffffff81009a2a <hypercall_page+2602>:	add    %al,(%rax)
0xffffffff81009a2c <hypercall_page+2604>:	add    %al,(%rax)
0xffffffff81009a2e <hypercall_page+2606>:	add    %al,(%rax)
0xffffffff81009a30 <hypercall_page+2608>:	add    %al,(%rax)
0xffffffff81009a32 <hypercall_page+2610>:	add    %al,(%rax)
0xffffffff81009a34 <hypercall_page+2612>:	add    %al,(%rax)
0xffffffff81009a36 <hypercall_page+2614>:	add    %al,(%rax)
0xffffffff81009a38 <hypercall_page+2616>:	add    %al,(%rax)
0xffffffff81009a3a <hypercall_page+2618>:	add    %al,(%rax)
0xffffffff81009a3c <hypercall_page+2620>:	add    %al,(%rax)
0xffffffff81009a3e <hypercall_page+2622>:	add    %al,(%rax)
0xffffffff81009a40 <hypercall_page+2624>:	add    %al,(%rax)
0xffffffff81009a42 <hypercall_page+2626>:	add    %al,(%rax)
0xffffffff81009a44 <hypercall_page+2628>:	add    %al,(%rax)
0xffffffff81009a46 <hypercall_page+2630>:	add    %al,(%rax)
0xffffffff81009a48 <hypercall_page+2632>:	add    %al,(%rax)
0xffffffff81009a4a <hypercall_page+2634>:	add    %al,(%rax)
0xffffffff81009a4c <hypercall_page+2636>:	add    %al,(%rax)
0xffffffff81009a4e <hypercall_page+2638>:	add    %al,(%rax)
0xffffffff81009a50 <hypercall_page+2640>:	add    %al,(%rax)
0xffffffff81009a52 <hypercall_page+2642>:	add    %al,(%rax)
0xffffffff81009a54 <hypercall_page+2644>:	add    %al,(%rax)
0xffffffff81009a56 <hypercall_page+2646>:	add    %al,(%rax)
0xffffffff81009a58 <hypercall_page+2648>:	add    %al,(%rax)
0xffffffff81009a5a <hypercall_page+2650>:	add    %al,(%rax)
0xffffffff81009a5c <hypercall_page+2652>:	add    %al,(%rax)
0xffffffff81009a5e <hypercall_page+2654>:	add    %al,(%rax)
0xffffffff81009a60 <hypercall_page+2656>:	add    %al,(%rax)
0xffffffff81009a62 <hypercall_page+2658>:	add    %al,(%rax)
0xffffffff81009a64 <hypercall_page+2660>:	add    %al,(%rax)
0xffffffff81009a66 <hypercall_page+2662>:	add    %al,(%rax)
0xffffffff81009a68 <hypercall_page+2664>:	add    %al,(%rax)
0xffffffff81009a6a <hypercall_page+2666>:	add    %al,(%rax)
0xffffffff81009a6c <hypercall_page+2668>:	add    %al,(%rax)
0xffffffff81009a6e <hypercall_page+2670>:	add    %al,(%rax)
0xffffffff81009a70 <hypercall_page+2672>:	add    %al,(%rax)
0xffffffff81009a72 <hypercall_page+2674>:	add    %al,(%rax)
0xffffffff81009a74 <hypercall_page+2676>:	add    %al,(%rax)
0xffffffff81009a76 <hypercall_page+2678>:	add    %al,(%rax)
0xffffffff81009a78 <hypercall_page+2680>:	add    %al,(%rax)
0xffffffff81009a7a <hypercall_page+2682>:	add    %al,(%rax)
0xffffffff81009a7c <hypercall_page+2684>:	add    %al,(%rax)
0xffffffff81009a7e <hypercall_page+2686>:	add    %al,(%rax)
0xffffffff81009a80 <hypercall_page+2688>:	add    %al,(%rax)
0xffffffff81009a82 <hypercall_page+2690>:	add    %al,(%rax)
0xffffffff81009a84 <hypercall_page+2692>:	add    %al,(%rax)
0xffffffff81009a86 <hypercall_page+2694>:	add    %al,(%rax)
0xffffffff81009a88 <hypercall_page+2696>:	add    %al,(%rax)
0xffffffff81009a8a <hypercall_page+2698>:	add    %al,(%rax)
0xffffffff81009a8c <hypercall_page+2700>:	add    %al,(%rax)
0xffffffff81009a8e <hypercall_page+2702>:	add    %al,(%rax)
0xffffffff81009a90 <hypercall_page+2704>:	add    %al,(%rax)
0xffffffff81009a92 <hypercall_page+2706>:	add    %al,(%rax)
0xffffffff81009a94 <hypercall_page+2708>:	add    %al,(%rax)
0xffffffff81009a96 <hypercall_page+2710>:	add    %al,(%rax)
0xffffffff81009a98 <hypercall_page+2712>:	add    %al,(%rax)
0xffffffff81009a9a <hypercall_page+2714>:	add    %al,(%rax)
0xffffffff81009a9c <hypercall_page+2716>:	add    %al,(%rax)
0xffffffff81009a9e <hypercall_page+2718>:	add    %al,(%rax)
0xffffffff81009aa0 <hypercall_page+2720>:	add    %al,(%rax)
0xffffffff81009aa2 <hypercall_page+2722>:	add    %al,(%rax)
0xffffffff81009aa4 <hypercall_page+2724>:	add    %al,(%rax)
0xffffffff81009aa6 <hypercall_page+2726>:	add    %al,(%rax)
0xffffffff81009aa8 <hypercall_page+2728>:	add    %al,(%rax)
0xffffffff81009aaa <hypercall_page+2730>:	add    %al,(%rax)
0xffffffff81009aac <hypercall_page+2732>:	add    %al,(%rax)
0xffffffff81009aae <hypercall_page+2734>:	add    %al,(%rax)
0xffffffff81009ab0 <hypercall_page+2736>:	add    %al,(%rax)
0xffffffff81009ab2 <hypercall_page+2738>:	add    %al,(%rax)
0xffffffff81009ab4 <hypercall_page+2740>:	add    %al,(%rax)
0xffffffff81009ab6 <hypercall_page+2742>:	add    %al,(%rax)
0xffffffff81009ab8 <hypercall_page+2744>:	add    %al,(%rax)
0xffffffff81009aba <hypercall_page+2746>:	add    %al,(%rax)
0xffffffff81009abc <hypercall_page+2748>:	add    %al,(%rax)
0xffffffff81009abe <hypercall_page+2750>:	add    %al,(%rax)
0xffffffff81009ac0 <hypercall_page+2752>:	add    %al,(%rax)
0xffffffff81009ac2 <hypercall_page+2754>:	add    %al,(%rax)
0xffffffff81009ac4 <hypercall_page+2756>:	add    %al,(%rax)
0xffffffff81009ac6 <hypercall_page+2758>:	add    %al,(%rax)
0xffffffff81009ac8 <hypercall_page+2760>:	add    %al,(%rax)
0xffffffff81009aca <hypercall_page+2762>:	add    %al,(%rax)
0xffffffff81009acc <hypercall_page+2764>:	add    %al,(%rax)
0xffffffff81009ace <hypercall_page+2766>:	add    %al,(%rax)
0xffffffff81009ad0 <hypercall_page+2768>:	add    %al,(%rax)
0xffffffff81009ad2 <hypercall_page+2770>:	add    %al,(%rax)
0xffffffff81009ad4 <hypercall_page+2772>:	add    %al,(%rax)
0xffffffff81009ad6 <hypercall_page+2774>:	add    %al,(%rax)
0xffffffff81009ad8 <hypercall_page+2776>:	add    %al,(%rax)
0xffffffff81009ada <hypercall_page+2778>:	add    %al,(%rax)
0xffffffff81009adc <hypercall_page+2780>:	add    %al,(%rax)
0xffffffff81009ade <hypercall_page+2782>:	add    %al,(%rax)
0xffffffff81009ae0 <hypercall_page+2784>:	add    %al,(%rax)
0xffffffff81009ae2 <hypercall_page+2786>:	add    %al,(%rax)
0xffffffff81009ae4 <hypercall_page+2788>:	add    %al,(%rax)
0xffffffff81009ae6 <hypercall_page+2790>:	add    %al,(%rax)
0xffffffff81009ae8 <hypercall_page+2792>:	add    %al,(%rax)
0xffffffff81009aea <hypercall_page+2794>:	add    %al,(%rax)
0xffffffff81009aec <hypercall_page+2796>:	add    %al,(%rax)
0xffffffff81009aee <hypercall_page+2798>:	add    %al,(%rax)
0xffffffff81009af0 <hypercall_page+2800>:	add    %al,(%rax)
0xffffffff81009af2 <hypercall_page+2802>:	add    %al,(%rax)
0xffffffff81009af4 <hypercall_page+2804>:	add    %al,(%rax)
0xffffffff81009af6 <hypercall_page+2806>:	add    %al,(%rax)
0xffffffff81009af8 <hypercall_page+2808>:	add    %al,(%rax)
0xffffffff81009afa <hypercall_page+2810>:	add    %al,(%rax)
0xffffffff81009afc <hypercall_page+2812>:	add    %al,(%rax)
0xffffffff81009afe <hypercall_page+2814>:	add    %al,(%rax)
0xffffffff81009b00 <hypercall_page+2816>:	add    %al,(%rax)
0xffffffff81009b02 <hypercall_page+2818>:	add    %al,(%rax)
0xffffffff81009b04 <hypercall_page+2820>:	add    %al,(%rax)
0xffffffff81009b06 <hypercall_page+2822>:	add    %al,(%rax)
0xffffffff81009b08 <hypercall_page+2824>:	add    %al,(%rax)
0xffffffff81009b0a <hypercall_page+2826>:	add    %al,(%rax)
0xffffffff81009b0c <hypercall_page+2828>:	add    %al,(%rax)
0xffffffff81009b0e <hypercall_page+2830>:	add    %al,(%rax)
0xffffffff81009b10 <hypercall_page+2832>:	add    %al,(%rax)
0xffffffff81009b12 <hypercall_page+2834>:	add    %al,(%rax)
0xffffffff81009b14 <hypercall_page+2836>:	add    %al,(%rax)
0xffffffff81009b16 <hypercall_page+2838>:	add    %al,(%rax)
0xffffffff81009b18 <hypercall_page+2840>:	add    %al,(%rax)
0xffffffff81009b1a <hypercall_page+2842>:	add    %al,(%rax)
0xffffffff81009b1c <hypercall_page+2844>:	add    %al,(%rax)
0xffffffff81009b1e <hypercall_page+2846>:	add    %al,(%rax)
0xffffffff81009b20 <hypercall_page+2848>:	add    %al,(%rax)
0xffffffff81009b22 <hypercall_page+2850>:	add    %al,(%rax)
0xffffffff81009b24 <hypercall_page+2852>:	add    %al,(%rax)
0xffffffff81009b26 <hypercall_page+2854>:	add    %al,(%rax)
0xffffffff81009b28 <hypercall_page+2856>:	add    %al,(%rax)
0xffffffff81009b2a <hypercall_page+2858>:	add    %al,(%rax)
0xffffffff81009b2c <hypercall_page+2860>:	add    %al,(%rax)
0xffffffff81009b2e <hypercall_page+2862>:	add    %al,(%rax)
0xffffffff81009b30 <hypercall_page+2864>:	add    %al,(%rax)
0xffffffff81009b32 <hypercall_page+2866>:	add    %al,(%rax)
0xffffffff81009b34 <hypercall_page+2868>:	add    %al,(%rax)
0xffffffff81009b36 <hypercall_page+2870>:	add    %al,(%rax)
0xffffffff81009b38 <hypercall_page+2872>:	add    %al,(%rax)
0xffffffff81009b3a <hypercall_page+2874>:	add    %al,(%rax)
0xffffffff81009b3c <hypercall_page+2876>:	add    %al,(%rax)
0xffffffff81009b3e <hypercall_page+2878>:	add    %al,(%rax)
0xffffffff81009b40 <hypercall_page+2880>:	add    %al,(%rax)
0xffffffff81009b42 <hypercall_page+2882>:	add    %al,(%rax)
0xffffffff81009b44 <hypercall_page+2884>:	add    %al,(%rax)
0xffffffff81009b46 <hypercall_page+2886>:	add    %al,(%rax)
0xffffffff81009b48 <hypercall_page+2888>:	add    %al,(%rax)
0xffffffff81009b4a <hypercall_page+2890>:	add    %al,(%rax)
0xffffffff81009b4c <hypercall_page+2892>:	add    %al,(%rax)
0xffffffff81009b4e <hypercall_page+2894>:	add    %al,(%rax)
0xffffffff81009b50 <hypercall_page+2896>:	add    %al,(%rax)
0xffffffff81009b52 <hypercall_page+2898>:	add    %al,(%rax)
0xffffffff81009b54 <hypercall_page+2900>:	add    %al,(%rax)
0xffffffff81009b56 <hypercall_page+2902>:	add    %al,(%rax)
0xffffffff81009b58 <hypercall_page+2904>:	add    %al,(%rax)
0xffffffff81009b5a <hypercall_page+2906>:	add    %al,(%rax)
0xffffffff81009b5c <hypercall_page+2908>:	add    %al,(%rax)
0xffffffff81009b5e <hypercall_page+2910>:	add    %al,(%rax)
0xffffffff81009b60 <hypercall_page+2912>:	add    %al,(%rax)
0xffffffff81009b62 <hypercall_page+2914>:	add    %al,(%rax)
0xffffffff81009b64 <hypercall_page+2916>:	add    %al,(%rax)
0xffffffff81009b66 <hypercall_page+2918>:	add    %al,(%rax)
0xffffffff81009b68 <hypercall_page+2920>:	add    %al,(%rax)
0xffffffff81009b6a <hypercall_page+2922>:	add    %al,(%rax)
0xffffffff81009b6c <hypercall_page+2924>:	add    %al,(%rax)
0xffffffff81009b6e <hypercall_page+2926>:	add    %al,(%rax)
0xffffffff81009b70 <hypercall_page+2928>:	add    %al,(%rax)
0xffffffff81009b72 <hypercall_page+2930>:	add    %al,(%rax)
0xffffffff81009b74 <hypercall_page+2932>:	add    %al,(%rax)
0xffffffff81009b76 <hypercall_page+2934>:	add    %al,(%rax)
0xffffffff81009b78 <hypercall_page+2936>:	add    %al,(%rax)
0xffffffff81009b7a <hypercall_page+2938>:	add    %al,(%rax)
0xffffffff81009b7c <hypercall_page+2940>:	add    %al,(%rax)
0xffffffff81009b7e <hypercall_page+2942>:	add    %al,(%rax)
0xffffffff81009b80 <hypercall_page+2944>:	add    %al,(%rax)
0xffffffff81009b82 <hypercall_page+2946>:	add    %al,(%rax)
0xffffffff81009b84 <hypercall_page+2948>:	add    %al,(%rax)
0xffffffff81009b86 <hypercall_page+2950>:	add    %al,(%rax)
0xffffffff81009b88 <hypercall_page+2952>:	add    %al,(%rax)
0xffffffff81009b8a <hypercall_page+2954>:	add    %al,(%rax)
0xffffffff81009b8c <hypercall_page+2956>:	add    %al,(%rax)
0xffffffff81009b8e <hypercall_page+2958>:	add    %al,(%rax)
0xffffffff81009b90 <hypercall_page+2960>:	add    %al,(%rax)
0xffffffff81009b92 <hypercall_page+2962>:	add    %al,(%rax)
0xffffffff81009b94 <hypercall_page+2964>:	add    %al,(%rax)
0xffffffff81009b96 <hypercall_page+2966>:	add    %al,(%rax)
0xffffffff81009b98 <hypercall_page+2968>:	add    %al,(%rax)
0xffffffff81009b9a <hypercall_page+2970>:	add    %al,(%rax)
0xffffffff81009b9c <hypercall_page+2972>:	add    %al,(%rax)
0xffffffff81009b9e <hypercall_page+2974>:	add    %al,(%rax)
0xffffffff81009ba0 <hypercall_page+2976>:	add    %al,(%rax)
0xffffffff81009ba2 <hypercall_page+2978>:	add    %al,(%rax)
0xffffffff81009ba4 <hypercall_page+2980>:	add    %al,(%rax)
0xffffffff81009ba6 <hypercall_page+2982>:	add    %al,(%rax)
0xffffffff81009ba8 <hypercall_page+2984>:	add    %al,(%rax)
0xffffffff81009baa <hypercall_page+2986>:	add    %al,(%rax)
0xffffffff81009bac <hypercall_page+2988>:	add    %al,(%rax)
0xffffffff81009bae <hypercall_page+2990>:	add    %al,(%rax)
0xffffffff81009bb0 <hypercall_page+2992>:	add    %al,(%rax)
0xffffffff81009bb2 <hypercall_page+2994>:	add    %al,(%rax)
0xffffffff81009bb4 <hypercall_page+2996>:	add    %al,(%rax)
0xffffffff81009bb6 <hypercall_page+2998>:	add    %al,(%rax)
0xffffffff81009bb8 <hypercall_page+3000>:	add    %al,(%rax)
0xffffffff81009bba <hypercall_page+3002>:	add    %al,(%rax)
0xffffffff81009bbc <hypercall_page+3004>:	add    %al,(%rax)
0xffffffff81009bbe <hypercall_page+3006>:	add    %al,(%rax)
0xffffffff81009bc0 <hypercall_page+3008>:	add    %al,(%rax)
0xffffffff81009bc2 <hypercall_page+3010>:	add    %al,(%rax)
0xffffffff81009bc4 <hypercall_page+3012>:	add    %al,(%rax)
0xffffffff81009bc6 <hypercall_page+3014>:	add    %al,(%rax)
0xffffffff81009bc8 <hypercall_page+3016>:	add    %al,(%rax)
0xffffffff81009bca <hypercall_page+3018>:	add    %al,(%rax)
0xffffffff81009bcc <hypercall_page+3020>:	add    %al,(%rax)
0xffffffff81009bce <hypercall_page+3022>:	add    %al,(%rax)
0xffffffff81009bd0 <hypercall_page+3024>:	add    %al,(%rax)
0xffffffff81009bd2 <hypercall_page+3026>:	add    %al,(%rax)
0xffffffff81009bd4 <hypercall_page+3028>:	add    %al,(%rax)
0xffffffff81009bd6 <hypercall_page+3030>:	add    %al,(%rax)
0xffffffff81009bd8 <hypercall_page+3032>:	add    %al,(%rax)
0xffffffff81009bda <hypercall_page+3034>:	add    %al,(%rax)
0xffffffff81009bdc <hypercall_page+3036>:	add    %al,(%rax)
0xffffffff81009bde <hypercall_page+3038>:	add    %al,(%rax)
0xffffffff81009be0 <hypercall_page+3040>:	add    %al,(%rax)
0xffffffff81009be2 <hypercall_page+3042>:	add    %al,(%rax)
0xffffffff81009be4 <hypercall_page+3044>:	add    %al,(%rax)
0xffffffff81009be6 <hypercall_page+3046>:	add    %al,(%rax)
0xffffffff81009be8 <hypercall_page+3048>:	add    %al,(%rax)
0xffffffff81009bea <hypercall_page+3050>:	add    %al,(%rax)
0xffffffff81009bec <hypercall_page+3052>:	add    %al,(%rax)
0xffffffff81009bee <hypercall_page+3054>:	add    %al,(%rax)
0xffffffff81009bf0 <hypercall_page+3056>:	add    %al,(%rax)
0xffffffff81009bf2 <hypercall_page+3058>:	add    %al,(%rax)
0xffffffff81009bf4 <hypercall_page+3060>:	add    %al,(%rax)
0xffffffff81009bf6 <hypercall_page+3062>:	add    %al,(%rax)
0xffffffff81009bf8 <hypercall_page+3064>:	add    %al,(%rax)
0xffffffff81009bfa <hypercall_page+3066>:	add    %al,(%rax)
0xffffffff81009bfc <hypercall_page+3068>:	add    %al,(%rax)
0xffffffff81009bfe <hypercall_page+3070>:	add    %al,(%rax)
0xffffffff81009c00 <hypercall_page+3072>:	add    %al,(%rax)
0xffffffff81009c02 <hypercall_page+3074>:	add    %al,(%rax)
0xffffffff81009c04 <hypercall_page+3076>:	add    %al,(%rax)
0xffffffff81009c06 <hypercall_page+3078>:	add    %al,(%rax)
0xffffffff81009c08 <hypercall_page+3080>:	add    %al,(%rax)
0xffffffff81009c0a <hypercall_page+3082>:	add    %al,(%rax)
0xffffffff81009c0c <hypercall_page+3084>:	add    %al,(%rax)
0xffffffff81009c0e <hypercall_page+3086>:	add    %al,(%rax)
0xffffffff81009c10 <hypercall_page+3088>:	add    %al,(%rax)
0xffffffff81009c12 <hypercall_page+3090>:	add    %al,(%rax)
0xffffffff81009c14 <hypercall_page+3092>:	add    %al,(%rax)
0xffffffff81009c16 <hypercall_page+3094>:	add    %al,(%rax)
0xffffffff81009c18 <hypercall_page+3096>:	add    %al,(%rax)
0xffffffff81009c1a <hypercall_page+3098>:	add    %al,(%rax)
0xffffffff81009c1c <hypercall_page+3100>:	add    %al,(%rax)
0xffffffff81009c1e <hypercall_page+3102>:	add    %al,(%rax)
0xffffffff81009c20 <hypercall_page+3104>:	add    %al,(%rax)
0xffffffff81009c22 <hypercall_page+3106>:	add    %al,(%rax)
0xffffffff81009c24 <hypercall_page+3108>:	add    %al,(%rax)
0xffffffff81009c26 <hypercall_page+3110>:	add    %al,(%rax)
0xffffffff81009c28 <hypercall_page+3112>:	add    %al,(%rax)
0xffffffff81009c2a <hypercall_page+3114>:	add    %al,(%rax)
0xffffffff81009c2c <hypercall_page+3116>:	add    %al,(%rax)
0xffffffff81009c2e <hypercall_page+3118>:	add    %al,(%rax)
0xffffffff81009c30 <hypercall_page+3120>:	add    %al,(%rax)
0xffffffff81009c32 <hypercall_page+3122>:	add    %al,(%rax)
0xffffffff81009c34 <hypercall_page+3124>:	add    %al,(%rax)
0xffffffff81009c36 <hypercall_page+3126>:	add    %al,(%rax)
0xffffffff81009c38 <hypercall_page+3128>:	add    %al,(%rax)
0xffffffff81009c3a <hypercall_page+3130>:	add    %al,(%rax)
0xffffffff81009c3c <hypercall_page+3132>:	add    %al,(%rax)
0xffffffff81009c3e <hypercall_page+3134>:	add    %al,(%rax)
0xffffffff81009c40 <hypercall_page+3136>:	add    %al,(%rax)
0xffffffff81009c42 <hypercall_page+3138>:	add    %al,(%rax)
0xffffffff81009c44 <hypercall_page+3140>:	add    %al,(%rax)
0xffffffff81009c46 <hypercall_page+3142>:	add    %al,(%rax)
0xffffffff81009c48 <hypercall_page+3144>:	add    %al,(%rax)
0xffffffff81009c4a <hypercall_page+3146>:	add    %al,(%rax)
0xffffffff81009c4c <hypercall_page+3148>:	add    %al,(%rax)
0xffffffff81009c4e <hypercall_page+3150>:	add    %al,(%rax)
0xffffffff81009c50 <hypercall_page+3152>:	add    %al,(%rax)
0xffffffff81009c52 <hypercall_page+3154>:	add    %al,(%rax)
0xffffffff81009c54 <hypercall_page+3156>:	add    %al,(%rax)
0xffffffff81009c56 <hypercall_page+3158>:	add    %al,(%rax)
0xffffffff81009c58 <hypercall_page+3160>:	add    %al,(%rax)
0xffffffff81009c5a <hypercall_page+3162>:	add    %al,(%rax)
0xffffffff81009c5c <hypercall_page+3164>:	add    %al,(%rax)
0xffffffff81009c5e <hypercall_page+3166>:	add    %al,(%rax)
0xffffffff81009c60 <hypercall_page+3168>:	add    %al,(%rax)
0xffffffff81009c62 <hypercall_page+3170>:	add    %al,(%rax)
0xffffffff81009c64 <hypercall_page+3172>:	add    %al,(%rax)
0xffffffff81009c66 <hypercall_page+3174>:	add    %al,(%rax)
0xffffffff81009c68 <hypercall_page+3176>:	add    %al,(%rax)
0xffffffff81009c6a <hypercall_page+3178>:	add    %al,(%rax)
0xffffffff81009c6c <hypercall_page+3180>:	add    %al,(%rax)
0xffffffff81009c6e <hypercall_page+3182>:	add    %al,(%rax)
0xffffffff81009c70 <hypercall_page+3184>:	add    %al,(%rax)
0xffffffff81009c72 <hypercall_page+3186>:	add    %al,(%rax)
0xffffffff81009c74 <hypercall_page+3188>:	add    %al,(%rax)
0xffffffff81009c76 <hypercall_page+3190>:	add    %al,(%rax)
0xffffffff81009c78 <hypercall_page+3192>:	add    %al,(%rax)
0xffffffff81009c7a <hypercall_page+3194>:	add    %al,(%rax)
0xffffffff81009c7c <hypercall_page+3196>:	add    %al,(%rax)
0xffffffff81009c7e <hypercall_page+3198>:	add    %al,(%rax)
0xffffffff81009c80 <hypercall_page+3200>:	add    %al,(%rax)
0xffffffff81009c82 <hypercall_page+3202>:	add    %al,(%rax)
0xffffffff81009c84 <hypercall_page+3204>:	add    %al,(%rax)
0xffffffff81009c86 <hypercall_page+3206>:	add    %al,(%rax)
0xffffffff81009c88 <hypercall_page+3208>:	add    %al,(%rax)
0xffffffff81009c8a <hypercall_page+3210>:	add    %al,(%rax)
0xffffffff81009c8c <hypercall_page+3212>:	add    %al,(%rax)
0xffffffff81009c8e <hypercall_page+3214>:	add    %al,(%rax)
0xffffffff81009c90 <hypercall_page+3216>:	add    %al,(%rax)
0xffffffff81009c92 <hypercall_page+3218>:	add    %al,(%rax)
0xffffffff81009c94 <hypercall_page+3220>:	add    %al,(%rax)
0xffffffff81009c96 <hypercall_page+3222>:	add    %al,(%rax)
0xffffffff81009c98 <hypercall_page+3224>:	add    %al,(%rax)
0xffffffff81009c9a <hypercall_page+3226>:	add    %al,(%rax)
0xffffffff81009c9c <hypercall_page+3228>:	add    %al,(%rax)
0xffffffff81009c9e <hypercall_page+3230>:	add    %al,(%rax)
0xffffffff81009ca0 <hypercall_page+3232>:	add    %al,(%rax)
0xffffffff81009ca2 <hypercall_page+3234>:	add    %al,(%rax)
0xffffffff81009ca4 <hypercall_page+3236>:	add    %al,(%rax)
0xffffffff81009ca6 <hypercall_page+3238>:	add    %al,(%rax)
0xffffffff81009ca8 <hypercall_page+3240>:	add    %al,(%rax)
0xffffffff81009caa <hypercall_page+3242>:	add    %al,(%rax)
0xffffffff81009cac <hypercall_page+3244>:	add    %al,(%rax)
0xffffffff81009cae <hypercall_page+3246>:	add    %al,(%rax)
0xffffffff81009cb0 <hypercall_page+3248>:	add    %al,(%rax)
0xffffffff81009cb2 <hypercall_page+3250>:	add    %al,(%rax)
0xffffffff81009cb4 <hypercall_page+3252>:	add    %al,(%rax)
0xffffffff81009cb6 <hypercall_page+3254>:	add    %al,(%rax)
0xffffffff81009cb8 <hypercall_page+3256>:	add    %al,(%rax)
0xffffffff81009cba <hypercall_page+3258>:	add    %al,(%rax)
0xffffffff81009cbc <hypercall_page+3260>:	add    %al,(%rax)
0xffffffff81009cbe <hypercall_page+3262>:	add    %al,(%rax)
0xffffffff81009cc0 <hypercall_page+3264>:	add    %al,(%rax)
0xffffffff81009cc2 <hypercall_page+3266>:	add    %al,(%rax)
0xffffffff81009cc4 <hypercall_page+3268>:	add    %al,(%rax)
0xffffffff81009cc6 <hypercall_page+3270>:	add    %al,(%rax)
0xffffffff81009cc8 <hypercall_page+3272>:	add    %al,(%rax)
0xffffffff81009cca <hypercall_page+3274>:	add    %al,(%rax)
0xffffffff81009ccc <hypercall_page+3276>:	add    %al,(%rax)
0xffffffff81009cce <hypercall_page+3278>:	add    %al,(%rax)
0xffffffff81009cd0 <hypercall_page+3280>:	add    %al,(%rax)
0xffffffff81009cd2 <hypercall_page+3282>:	add    %al,(%rax)
0xffffffff81009cd4 <hypercall_page+3284>:	add    %al,(%rax)
0xffffffff81009cd6 <hypercall_page+3286>:	add    %al,(%rax)
0xffffffff81009cd8 <hypercall_page+3288>:	add    %al,(%rax)
0xffffffff81009cda <hypercall_page+3290>:	add    %al,(%rax)
0xffffffff81009cdc <hypercall_page+3292>:	add    %al,(%rax)
0xffffffff81009cde <hypercall_page+3294>:	add    %al,(%rax)
0xffffffff81009ce0 <hypercall_page+3296>:	add    %al,(%rax)
0xffffffff81009ce2 <hypercall_page+3298>:	add    %al,(%rax)
0xffffffff81009ce4 <hypercall_page+3300>:	add    %al,(%rax)
0xffffffff81009ce6 <hypercall_page+3302>:	add    %al,(%rax)
0xffffffff81009ce8 <hypercall_page+3304>:	add    %al,(%rax)
0xffffffff81009cea <hypercall_page+3306>:	add    %al,(%rax)
0xffffffff81009cec <hypercall_page+3308>:	add    %al,(%rax)
0xffffffff81009cee <hypercall_page+3310>:	add    %al,(%rax)
0xffffffff81009cf0 <hypercall_page+3312>:	add    %al,(%rax)
0xffffffff81009cf2 <hypercall_page+3314>:	add    %al,(%rax)
0xffffffff81009cf4 <hypercall_page+3316>:	add    %al,(%rax)
0xffffffff81009cf6 <hypercall_page+3318>:	add    %al,(%rax)
0xffffffff81009cf8 <hypercall_page+3320>:	add    %al,(%rax)
0xffffffff81009cfa <hypercall_page+3322>:	add    %al,(%rax)
0xffffffff81009cfc <hypercall_page+3324>:	add    %al,(%rax)
0xffffffff81009cfe <hypercall_page+3326>:	add    %al,(%rax)
0xffffffff81009d00 <hypercall_page+3328>:	add    %al,(%rax)
0xffffffff81009d02 <hypercall_page+3330>:	add    %al,(%rax)
0xffffffff81009d04 <hypercall_page+3332>:	add    %al,(%rax)
0xffffffff81009d06 <hypercall_page+3334>:	add    %al,(%rax)
0xffffffff81009d08 <hypercall_page+3336>:	add    %al,(%rax)
0xffffffff81009d0a <hypercall_page+3338>:	add    %al,(%rax)
0xffffffff81009d0c <hypercall_page+3340>:	add    %al,(%rax)
0xffffffff81009d0e <hypercall_page+3342>:	add    %al,(%rax)
0xffffffff81009d10 <hypercall_page+3344>:	add    %al,(%rax)
0xffffffff81009d12 <hypercall_page+3346>:	add    %al,(%rax)
0xffffffff81009d14 <hypercall_page+3348>:	add    %al,(%rax)
0xffffffff81009d16 <hypercall_page+3350>:	add    %al,(%rax)
0xffffffff81009d18 <hypercall_page+3352>:	add    %al,(%rax)
0xffffffff81009d1a <hypercall_page+3354>:	add    %al,(%rax)
0xffffffff81009d1c <hypercall_page+3356>:	add    %al,(%rax)
0xffffffff81009d1e <hypercall_page+3358>:	add    %al,(%rax)
0xffffffff81009d20 <hypercall_page+3360>:	add    %al,(%rax)
0xffffffff81009d22 <hypercall_page+3362>:	add    %al,(%rax)
0xffffffff81009d24 <hypercall_page+3364>:	add    %al,(%rax)
0xffffffff81009d26 <hypercall_page+3366>:	add    %al,(%rax)
0xffffffff81009d28 <hypercall_page+3368>:	add    %al,(%rax)
0xffffffff81009d2a <hypercall_page+3370>:	add    %al,(%rax)
0xffffffff81009d2c <hypercall_page+3372>:	add    %al,(%rax)
0xffffffff81009d2e <hypercall_page+3374>:	add    %al,(%rax)
0xffffffff81009d30 <hypercall_page+3376>:	add    %al,(%rax)
0xffffffff81009d32 <hypercall_page+3378>:	add    %al,(%rax)
0xffffffff81009d34 <hypercall_page+3380>:	add    %al,(%rax)
0xffffffff81009d36 <hypercall_page+3382>:	add    %al,(%rax)
0xffffffff81009d38 <hypercall_page+3384>:	add    %al,(%rax)
0xffffffff81009d3a <hypercall_page+3386>:	add    %al,(%rax)
0xffffffff81009d3c <hypercall_page+3388>:	add    %al,(%rax)
0xffffffff81009d3e <hypercall_page+3390>:	add    %al,(%rax)
0xffffffff81009d40 <hypercall_page+3392>:	add    %al,(%rax)
0xffffffff81009d42 <hypercall_page+3394>:	add    %al,(%rax)
0xffffffff81009d44 <hypercall_page+3396>:	add    %al,(%rax)
0xffffffff81009d46 <hypercall_page+3398>:	add    %al,(%rax)
0xffffffff81009d48 <hypercall_page+3400>:	add    %al,(%rax)
0xffffffff81009d4a <hypercall_page+3402>:	add    %al,(%rax)
0xffffffff81009d4c <hypercall_page+3404>:	add    %al,(%rax)
0xffffffff81009d4e <hypercall_page+3406>:	add    %al,(%rax)
0xffffffff81009d50 <hypercall_page+3408>:	add    %al,(%rax)
0xffffffff81009d52 <hypercall_page+3410>:	add    %al,(%rax)
0xffffffff81009d54 <hypercall_page+3412>:	add    %al,(%rax)
0xffffffff81009d56 <hypercall_page+3414>:	add    %al,(%rax)
0xffffffff81009d58 <hypercall_page+3416>:	add    %al,(%rax)
0xffffffff81009d5a <hypercall_page+3418>:	add    %al,(%rax)
0xffffffff81009d5c <hypercall_page+3420>:	add    %al,(%rax)
0xffffffff81009d5e <hypercall_page+3422>:	add    %al,(%rax)
0xffffffff81009d60 <hypercall_page+3424>:	add    %al,(%rax)
0xffffffff81009d62 <hypercall_page+3426>:	add    %al,(%rax)
0xffffffff81009d64 <hypercall_page+3428>:	add    %al,(%rax)
0xffffffff81009d66 <hypercall_page+3430>:	add    %al,(%rax)
0xffffffff81009d68 <hypercall_page+3432>:	add    %al,(%rax)
0xffffffff81009d6a <hypercall_page+3434>:	add    %al,(%rax)
0xffffffff81009d6c <hypercall_page+3436>:	add    %al,(%rax)
0xffffffff81009d6e <hypercall_page+3438>:	add    %al,(%rax)
0xffffffff81009d70 <hypercall_page+3440>:	add    %al,(%rax)
0xffffffff81009d72 <hypercall_page+3442>:	add    %al,(%rax)
0xffffffff81009d74 <hypercall_page+3444>:	add    %al,(%rax)
0xffffffff81009d76 <hypercall_page+3446>:	add    %al,(%rax)
0xffffffff81009d78 <hypercall_page+3448>:	add    %al,(%rax)
0xffffffff81009d7a <hypercall_page+3450>:	add    %al,(%rax)
0xffffffff81009d7c <hypercall_page+3452>:	add    %al,(%rax)
0xffffffff81009d7e <hypercall_page+3454>:	add    %al,(%rax)
0xffffffff81009d80 <hypercall_page+3456>:	add    %al,(%rax)
0xffffffff81009d82 <hypercall_page+3458>:	add    %al,(%rax)
0xffffffff81009d84 <hypercall_page+3460>:	add    %al,(%rax)
0xffffffff81009d86 <hypercall_page+3462>:	add    %al,(%rax)
0xffffffff81009d88 <hypercall_page+3464>:	add    %al,(%rax)
0xffffffff81009d8a <hypercall_page+3466>:	add    %al,(%rax)
0xffffffff81009d8c <hypercall_page+3468>:	add    %al,(%rax)
0xffffffff81009d8e <hypercall_page+3470>:	add    %al,(%rax)
0xffffffff81009d90 <hypercall_page+3472>:	add    %al,(%rax)
0xffffffff81009d92 <hypercall_page+3474>:	add    %al,(%rax)
0xffffffff81009d94 <hypercall_page+3476>:	add    %al,(%rax)
0xffffffff81009d96 <hypercall_page+3478>:	add    %al,(%rax)
0xffffffff81009d98 <hypercall_page+3480>:	add    %al,(%rax)
0xffffffff81009d9a <hypercall_page+3482>:	add    %al,(%rax)
0xffffffff81009d9c <hypercall_page+3484>:	add    %al,(%rax)
0xffffffff81009d9e <hypercall_page+3486>:	add    %al,(%rax)
0xffffffff81009da0 <hypercall_page+3488>:	add    %al,(%rax)
0xffffffff81009da2 <hypercall_page+3490>:	add    %al,(%rax)
0xffffffff81009da4 <hypercall_page+3492>:	add    %al,(%rax)
0xffffffff81009da6 <hypercall_page+3494>:	add    %al,(%rax)
0xffffffff81009da8 <hypercall_page+3496>:	add    %al,(%rax)
0xffffffff81009daa <hypercall_page+3498>:	add    %al,(%rax)
0xffffffff81009dac <hypercall_page+3500>:	add    %al,(%rax)
0xffffffff81009dae <hypercall_page+3502>:	add    %al,(%rax)
0xffffffff81009db0 <hypercall_page+3504>:	add    %al,(%rax)
0xffffffff81009db2 <hypercall_page+3506>:	add    %al,(%rax)
0xffffffff81009db4 <hypercall_page+3508>:	add    %al,(%rax)
0xffffffff81009db6 <hypercall_page+3510>:	add    %al,(%rax)
0xffffffff81009db8 <hypercall_page+3512>:	add    %al,(%rax)
0xffffffff81009dba <hypercall_page+3514>:	add    %al,(%rax)
0xffffffff81009dbc <hypercall_page+3516>:	add    %al,(%rax)
0xffffffff81009dbe <hypercall_page+3518>:	add    %al,(%rax)
0xffffffff81009dc0 <hypercall_page+3520>:	add    %al,(%rax)
0xffffffff81009dc2 <hypercall_page+3522>:	add    %al,(%rax)
0xffffffff81009dc4 <hypercall_page+3524>:	add    %al,(%rax)
0xffffffff81009dc6 <hypercall_page+3526>:	add    %al,(%rax)
0xffffffff81009dc8 <hypercall_page+3528>:	add    %al,(%rax)
0xffffffff81009dca <hypercall_page+3530>:	add    %al,(%rax)
0xffffffff81009dcc <hypercall_page+3532>:	add    %al,(%rax)
0xffffffff81009dce <hypercall_page+3534>:	add    %al,(%rax)
0xffffffff81009dd0 <hypercall_page+3536>:	add    %al,(%rax)
0xffffffff81009dd2 <hypercall_page+3538>:	add    %al,(%rax)
0xffffffff81009dd4 <hypercall_page+3540>:	add    %al,(%rax)
0xffffffff81009dd6 <hypercall_page+3542>:	add    %al,(%rax)
0xffffffff81009dd8 <hypercall_page+3544>:	add    %al,(%rax)
0xffffffff81009dda <hypercall_page+3546>:	add    %al,(%rax)
0xffffffff81009ddc <hypercall_page+3548>:	add    %al,(%rax)
0xffffffff81009dde <hypercall_page+3550>:	add    %al,(%rax)
0xffffffff81009de0 <hypercall_page+3552>:	add    %al,(%rax)
0xffffffff81009de2 <hypercall_page+3554>:	add    %al,(%rax)
0xffffffff81009de4 <hypercall_page+3556>:	add    %al,(%rax)
0xffffffff81009de6 <hypercall_page+3558>:	add    %al,(%rax)
0xffffffff81009de8 <hypercall_page+3560>:	add    %al,(%rax)
0xffffffff81009dea <hypercall_page+3562>:	add    %al,(%rax)
0xffffffff81009dec <hypercall_page+3564>:	add    %al,(%rax)
0xffffffff81009dee <hypercall_page+3566>:	add    %al,(%rax)
0xffffffff81009df0 <hypercall_page+3568>:	add    %al,(%rax)
0xffffffff81009df2 <hypercall_page+3570>:	add    %al,(%rax)
0xffffffff81009df4 <hypercall_page+3572>:	add    %al,(%rax)
0xffffffff81009df6 <hypercall_page+3574>:	add    %al,(%rax)
0xffffffff81009df8 <hypercall_page+3576>:	add    %al,(%rax)
0xffffffff81009dfa <hypercall_page+3578>:	add    %al,(%rax)
0xffffffff81009dfc <hypercall_page+3580>:	add    %al,(%rax)
0xffffffff81009dfe <hypercall_page+3582>:	add    %al,(%rax)
0xffffffff81009e00 <hypercall_page+3584>:	add    %al,(%rax)
0xffffffff81009e02 <hypercall_page+3586>:	add    %al,(%rax)
0xffffffff81009e04 <hypercall_page+3588>:	add    %al,(%rax)
0xffffffff81009e06 <hypercall_page+3590>:	add    %al,(%rax)
0xffffffff81009e08 <hypercall_page+3592>:	add    %al,(%rax)
0xffffffff81009e0a <hypercall_page+3594>:	add    %al,(%rax)
0xffffffff81009e0c <hypercall_page+3596>:	add    %al,(%rax)
0xffffffff81009e0e <hypercall_page+3598>:	add    %al,(%rax)
0xffffffff81009e10 <hypercall_page+3600>:	add    %al,(%rax)
0xffffffff81009e12 <hypercall_page+3602>:	add    %al,(%rax)
0xffffffff81009e14 <hypercall_page+3604>:	add    %al,(%rax)
0xffffffff81009e16 <hypercall_page+3606>:	add    %al,(%rax)
0xffffffff81009e18 <hypercall_page+3608>:	add    %al,(%rax)
0xffffffff81009e1a <hypercall_page+3610>:	add    %al,(%rax)
0xffffffff81009e1c <hypercall_page+3612>:	add    %al,(%rax)
0xffffffff81009e1e <hypercall_page+3614>:	add    %al,(%rax)
0xffffffff81009e20 <hypercall_page+3616>:	add    %al,(%rax)
0xffffffff81009e22 <hypercall_page+3618>:	add    %al,(%rax)
0xffffffff81009e24 <hypercall_page+3620>:	add    %al,(%rax)
0xffffffff81009e26 <hypercall_page+3622>:	add    %al,(%rax)
0xffffffff81009e28 <hypercall_page+3624>:	add    %al,(%rax)
0xffffffff81009e2a <hypercall_page+3626>:	add    %al,(%rax)
0xffffffff81009e2c <hypercall_page+3628>:	add    %al,(%rax)
0xffffffff81009e2e <hypercall_page+3630>:	add    %al,(%rax)
0xffffffff81009e30 <hypercall_page+3632>:	add    %al,(%rax)
0xffffffff81009e32 <hypercall_page+3634>:	add    %al,(%rax)
0xffffffff81009e34 <hypercall_page+3636>:	add    %al,(%rax)
0xffffffff81009e36 <hypercall_page+3638>:	add    %al,(%rax)
0xffffffff81009e38 <hypercall_page+3640>:	add    %al,(%rax)
0xffffffff81009e3a <hypercall_page+3642>:	add    %al,(%rax)
0xffffffff81009e3c <hypercall_page+3644>:	add    %al,(%rax)
0xffffffff81009e3e <hypercall_page+3646>:	add    %al,(%rax)
0xffffffff81009e40 <hypercall_page+3648>:	add    %al,(%rax)
0xffffffff81009e42 <hypercall_page+3650>:	add    %al,(%rax)
0xffffffff81009e44 <hypercall_page+3652>:	add    %al,(%rax)
0xffffffff81009e46 <hypercall_page+3654>:	add    %al,(%rax)
0xffffffff81009e48 <hypercall_page+3656>:	add    %al,(%rax)
0xffffffff81009e4a <hypercall_page+3658>:	add    %al,(%rax)
0xffffffff81009e4c <hypercall_page+3660>:	add    %al,(%rax)
0xffffffff81009e4e <hypercall_page+3662>:	add    %al,(%rax)
0xffffffff81009e50 <hypercall_page+3664>:	add    %al,(%rax)
0xffffffff81009e52 <hypercall_page+3666>:	add    %al,(%rax)
0xffffffff81009e54 <hypercall_page+3668>:	add    %al,(%rax)
0xffffffff81009e56 <hypercall_page+3670>:	add    %al,(%rax)
0xffffffff81009e58 <hypercall_page+3672>:	add    %al,(%rax)
0xffffffff81009e5a <hypercall_page+3674>:	add    %al,(%rax)
0xffffffff81009e5c <hypercall_page+3676>:	add    %al,(%rax)
0xffffffff81009e5e <hypercall_page+3678>:	add    %al,(%rax)
0xffffffff81009e60 <hypercall_page+3680>:	add    %al,(%rax)
0xffffffff81009e62 <hypercall_page+3682>:	add    %al,(%rax)
0xffffffff81009e64 <hypercall_page+3684>:	add    %al,(%rax)
0xffffffff81009e66 <hypercall_page+3686>:	add    %al,(%rax)
0xffffffff81009e68 <hypercall_page+3688>:	add    %al,(%rax)
0xffffffff81009e6a <hypercall_page+3690>:	add    %al,(%rax)
0xffffffff81009e6c <hypercall_page+3692>:	add    %al,(%rax)
0xffffffff81009e6e <hypercall_page+3694>:	add    %al,(%rax)
0xffffffff81009e70 <hypercall_page+3696>:	add    %al,(%rax)
0xffffffff81009e72 <hypercall_page+3698>:	add    %al,(%rax)
0xffffffff81009e74 <hypercall_page+3700>:	add    %al,(%rax)
0xffffffff81009e76 <hypercall_page+3702>:	add    %al,(%rax)
0xffffffff81009e78 <hypercall_page+3704>:	add    %al,(%rax)
0xffffffff81009e7a <hypercall_page+3706>:	add    %al,(%rax)
0xffffffff81009e7c <hypercall_page+3708>:	add    %al,(%rax)
0xffffffff81009e7e <hypercall_page+3710>:	add    %al,(%rax)
0xffffffff81009e80 <hypercall_page+3712>:	add    %al,(%rax)
0xffffffff81009e82 <hypercall_page+3714>:	add    %al,(%rax)
0xffffffff81009e84 <hypercall_page+3716>:	add    %al,(%rax)
0xffffffff81009e86 <hypercall_page+3718>:	add    %al,(%rax)
0xffffffff81009e88 <hypercall_page+3720>:	add    %al,(%rax)
0xffffffff81009e8a <hypercall_page+3722>:	add    %al,(%rax)
0xffffffff81009e8c <hypercall_page+3724>:	add    %al,(%rax)
0xffffffff81009e8e <hypercall_page+3726>:	add    %al,(%rax)
0xffffffff81009e90 <hypercall_page+3728>:	add    %al,(%rax)
0xffffffff81009e92 <hypercall_page+3730>:	add    %al,(%rax)
0xffffffff81009e94 <hypercall_page+3732>:	add    %al,(%rax)
0xffffffff81009e96 <hypercall_page+3734>:	add    %al,(%rax)
0xffffffff81009e98 <hypercall_page+3736>:	add    %al,(%rax)
0xffffffff81009e9a <hypercall_page+3738>:	add    %al,(%rax)
0xffffffff81009e9c <hypercall_page+3740>:	add    %al,(%rax)
0xffffffff81009e9e <hypercall_page+3742>:	add    %al,(%rax)
0xffffffff81009ea0 <hypercall_page+3744>:	add    %al,(%rax)
0xffffffff81009ea2 <hypercall_page+3746>:	add    %al,(%rax)
0xffffffff81009ea4 <hypercall_page+3748>:	add    %al,(%rax)
0xffffffff81009ea6 <hypercall_page+3750>:	add    %al,(%rax)
0xffffffff81009ea8 <hypercall_page+3752>:	add    %al,(%rax)
0xffffffff81009eaa <hypercall_page+3754>:	add    %al,(%rax)
0xffffffff81009eac <hypercall_page+3756>:	add    %al,(%rax)
0xffffffff81009eae <hypercall_page+3758>:	add    %al,(%rax)
0xffffffff81009eb0 <hypercall_page+3760>:	add    %al,(%rax)
0xffffffff81009eb2 <hypercall_page+3762>:	add    %al,(%rax)
0xffffffff81009eb4 <hypercall_page+3764>:	add    %al,(%rax)
0xffffffff81009eb6 <hypercall_page+3766>:	add    %al,(%rax)
0xffffffff81009eb8 <hypercall_page+3768>:	add    %al,(%rax)
0xffffffff81009eba <hypercall_page+3770>:	add    %al,(%rax)
0xffffffff81009ebc <hypercall_page+3772>:	add    %al,(%rax)
0xffffffff81009ebe <hypercall_page+3774>:	add    %al,(%rax)
0xffffffff81009ec0 <hypercall_page+3776>:	add    %al,(%rax)
0xffffffff81009ec2 <hypercall_page+3778>:	add    %al,(%rax)
0xffffffff81009ec4 <hypercall_page+3780>:	add    %al,(%rax)
0xffffffff81009ec6 <hypercall_page+3782>:	add    %al,(%rax)
0xffffffff81009ec8 <hypercall_page+3784>:	add    %al,(%rax)
0xffffffff81009eca <hypercall_page+3786>:	add    %al,(%rax)
0xffffffff81009ecc <hypercall_page+3788>:	add    %al,(%rax)
0xffffffff81009ece <hypercall_page+3790>:	add    %al,(%rax)
0xffffffff81009ed0 <hypercall_page+3792>:	add    %al,(%rax)
0xffffffff81009ed2 <hypercall_page+3794>:	add    %al,(%rax)
0xffffffff81009ed4 <hypercall_page+3796>:	add    %al,(%rax)
0xffffffff81009ed6 <hypercall_page+3798>:	add    %al,(%rax)
0xffffffff81009ed8 <hypercall_page+3800>:	add    %al,(%rax)
0xffffffff81009eda <hypercall_page+3802>:	add    %al,(%rax)
0xffffffff81009edc <hypercall_page+3804>:	add    %al,(%rax)
0xffffffff81009ede <hypercall_page+3806>:	add    %al,(%rax)
0xffffffff81009ee0 <hypercall_page+3808>:	add    %al,(%rax)
0xffffffff81009ee2 <hypercall_page+3810>:	add    %al,(%rax)
0xffffffff81009ee4 <hypercall_page+3812>:	add    %al,(%rax)
0xffffffff81009ee6 <hypercall_page+3814>:	add    %al,(%rax)
0xffffffff81009ee8 <hypercall_page+3816>:	add    %al,(%rax)
0xffffffff81009eea <hypercall_page+3818>:	add    %al,(%rax)
0xffffffff81009eec <hypercall_page+3820>:	add    %al,(%rax)
0xffffffff81009eee <hypercall_page+3822>:	add    %al,(%rax)
0xffffffff81009ef0 <hypercall_page+3824>:	add    %al,(%rax)
0xffffffff81009ef2 <hypercall_page+3826>:	add    %al,(%rax)
0xffffffff81009ef4 <hypercall_page+3828>:	add    %al,(%rax)
0xffffffff81009ef6 <hypercall_page+3830>:	add    %al,(%rax)
0xffffffff81009ef8 <hypercall_page+3832>:	add    %al,(%rax)
0xffffffff81009efa <hypercall_page+3834>:	add    %al,(%rax)
0xffffffff81009efc <hypercall_page+3836>:	add    %al,(%rax)
0xffffffff81009efe <hypercall_page+3838>:	add    %al,(%rax)
0xffffffff81009f00 <hypercall_page+3840>:	add    %al,(%rax)
0xffffffff81009f02 <hypercall_page+3842>:	add    %al,(%rax)
0xffffffff81009f04 <hypercall_page+3844>:	add    %al,(%rax)
0xffffffff81009f06 <hypercall_page+3846>:	add    %al,(%rax)
0xffffffff81009f08 <hypercall_page+3848>:	add    %al,(%rax)
0xffffffff81009f0a <hypercall_page+3850>:	add    %al,(%rax)
0xffffffff81009f0c <hypercall_page+3852>:	add    %al,(%rax)
0xffffffff81009f0e <hypercall_page+3854>:	add    %al,(%rax)
0xffffffff81009f10 <hypercall_page+3856>:	add    %al,(%rax)
0xffffffff81009f12 <hypercall_page+3858>:	add    %al,(%rax)
0xffffffff81009f14 <hypercall_page+3860>:	add    %al,(%rax)
0xffffffff81009f16 <hypercall_page+3862>:	add    %al,(%rax)
0xffffffff81009f18 <hypercall_page+3864>:	add    %al,(%rax)
0xffffffff81009f1a <hypercall_page+3866>:	add    %al,(%rax)
0xffffffff81009f1c <hypercall_page+3868>:	add    %al,(%rax)
0xffffffff81009f1e <hypercall_page+3870>:	add    %al,(%rax)
0xffffffff81009f20 <hypercall_page+3872>:	add    %al,(%rax)
0xffffffff81009f22 <hypercall_page+3874>:	add    %al,(%rax)
0xffffffff81009f24 <hypercall_page+3876>:	add    %al,(%rax)
0xffffffff81009f26 <hypercall_page+3878>:	add    %al,(%rax)
0xffffffff81009f28 <hypercall_page+3880>:	add    %al,(%rax)
0xffffffff81009f2a <hypercall_page+3882>:	add    %al,(%rax)
0xffffffff81009f2c <hypercall_page+3884>:	add    %al,(%rax)
0xffffffff81009f2e <hypercall_page+3886>:	add    %al,(%rax)
0xffffffff81009f30 <hypercall_page+3888>:	add    %al,(%rax)
0xffffffff81009f32 <hypercall_page+3890>:	add    %al,(%rax)
0xffffffff81009f34 <hypercall_page+3892>:	add    %al,(%rax)
0xffffffff81009f36 <hypercall_page+3894>:	add    %al,(%rax)
0xffffffff81009f38 <hypercall_page+3896>:	add    %al,(%rax)
0xffffffff81009f3a <hypercall_page+3898>:	add    %al,(%rax)
0xffffffff81009f3c <hypercall_page+3900>:	add    %al,(%rax)
0xffffffff81009f3e <hypercall_page+3902>:	add    %al,(%rax)
0xffffffff81009f40 <hypercall_page+3904>:	add    %al,(%rax)
0xffffffff81009f42 <hypercall_page+3906>:	add    %al,(%rax)
0xffffffff81009f44 <hypercall_page+3908>:	add    %al,(%rax)
0xffffffff81009f46 <hypercall_page+3910>:	add    %al,(%rax)
0xffffffff81009f48 <hypercall_page+3912>:	add    %al,(%rax)
0xffffffff81009f4a <hypercall_page+3914>:	add    %al,(%rax)
0xffffffff81009f4c <hypercall_page+3916>:	add    %al,(%rax)
0xffffffff81009f4e <hypercall_page+3918>:	add    %al,(%rax)
0xffffffff81009f50 <hypercall_page+3920>:	add    %al,(%rax)
0xffffffff81009f52 <hypercall_page+3922>:	add    %al,(%rax)
0xffffffff81009f54 <hypercall_page+3924>:	add    %al,(%rax)
0xffffffff81009f56 <hypercall_page+3926>:	add    %al,(%rax)
0xffffffff81009f58 <hypercall_page+3928>:	add    %al,(%rax)
0xffffffff81009f5a <hypercall_page+3930>:	add    %al,(%rax)
0xffffffff81009f5c <hypercall_page+3932>:	add    %al,(%rax)
0xffffffff81009f5e <hypercall_page+3934>:	add    %al,(%rax)
0xffffffff81009f60 <hypercall_page+3936>:	add    %al,(%rax)
0xffffffff81009f62 <hypercall_page+3938>:	add    %al,(%rax)
0xffffffff81009f64 <hypercall_page+3940>:	add    %al,(%rax)
0xffffffff81009f66 <hypercall_page+3942>:	add    %al,(%rax)
0xffffffff81009f68 <hypercall_page+3944>:	add    %al,(%rax)
0xffffffff81009f6a <hypercall_page+3946>:	add    %al,(%rax)
0xffffffff81009f6c <hypercall_page+3948>:	add    %al,(%rax)
0xffffffff81009f6e <hypercall_page+3950>:	add    %al,(%rax)
0xffffffff81009f70 <hypercall_page+3952>:	add    %al,(%rax)
0xffffffff81009f72 <hypercall_page+3954>:	add    %al,(%rax)
0xffffffff81009f74 <hypercall_page+3956>:	add    %al,(%rax)
0xffffffff81009f76 <hypercall_page+3958>:	add    %al,(%rax)
0xffffffff81009f78 <hypercall_page+3960>:	add    %al,(%rax)
0xffffffff81009f7a <hypercall_page+3962>:	add    %al,(%rax)
0xffffffff81009f7c <hypercall_page+3964>:	add    %al,(%rax)
0xffffffff81009f7e <hypercall_page+3966>:	add    %al,(%rax)
0xffffffff81009f80 <hypercall_page+3968>:	add    %al,(%rax)
0xffffffff81009f82 <hypercall_page+3970>:	add    %al,(%rax)
0xffffffff81009f84 <hypercall_page+3972>:	add    %al,(%rax)
0xffffffff81009f86 <hypercall_page+3974>:	add    %al,(%rax)
0xffffffff81009f88 <hypercall_page+3976>:	add    %al,(%rax)
0xffffffff81009f8a <hypercall_page+3978>:	add    %al,(%rax)
0xffffffff81009f8c <hypercall_page+3980>:	add    %al,(%rax)
0xffffffff81009f8e <hypercall_page+3982>:	add    %al,(%rax)
0xffffffff81009f90 <hypercall_page+3984>:	add    %al,(%rax)
0xffffffff81009f92 <hypercall_page+3986>:	add    %al,(%rax)
0xffffffff81009f94 <hypercall_page+3988>:	add    %al,(%rax)
0xffffffff81009f96 <hypercall_page+3990>:	add    %al,(%rax)
0xffffffff81009f98 <hypercall_page+3992>:	add    %al,(%rax)
0xffffffff81009f9a <hypercall_page+3994>:	add    %al,(%rax)
0xffffffff81009f9c <hypercall_page+3996>:	add    %al,(%rax)
0xffffffff81009f9e <hypercall_page+3998>:	add    %al,(%rax)
0xffffffff81009fa0 <hypercall_page+4000>:	add    %al,(%rax)
0xffffffff81009fa2 <hypercall_page+4002>:	add    %al,(%rax)
0xffffffff81009fa4 <hypercall_page+4004>:	add    %al,(%rax)
0xffffffff81009fa6 <hypercall_page+4006>:	add    %al,(%rax)
0xffffffff81009fa8 <hypercall_page+4008>:	add    %al,(%rax)
0xffffffff81009faa <hypercall_page+4010>:	add    %al,(%rax)
0xffffffff81009fac <hypercall_page+4012>:	add    %al,(%rax)
0xffffffff81009fae <hypercall_page+4014>:	add    %al,(%rax)
0xffffffff81009fb0 <hypercall_page+4016>:	add    %al,(%rax)
0xffffffff81009fb2 <hypercall_page+4018>:	add    %al,(%rax)
0xffffffff81009fb4 <hypercall_page+4020>:	add    %al,(%rax)
0xffffffff81009fb6 <hypercall_page+4022>:	add    %al,(%rax)
0xffffffff81009fb8 <hypercall_page+4024>:	add    %al,(%rax)
0xffffffff81009fba <hypercall_page+4026>:	add    %al,(%rax)
0xffffffff81009fbc <hypercall_page+4028>:	add    %al,(%rax)
0xffffffff81009fbe <hypercall_page+4030>:	add    %al,(%rax)
0xffffffff81009fc0 <hypercall_page+4032>:	add    %al,(%rax)
0xffffffff81009fc2 <hypercall_page+4034>:	add    %al,(%rax)
0xffffffff81009fc4 <hypercall_page+4036>:	add    %al,(%rax)
0xffffffff81009fc6 <hypercall_page+4038>:	add    %al,(%rax)
0xffffffff81009fc8 <hypercall_page+4040>:	add    %al,(%rax)
0xffffffff81009fca <hypercall_page+4042>:	add    %al,(%rax)
0xffffffff81009fcc <hypercall_page+4044>:	add    %al,(%rax)
0xffffffff81009fce <hypercall_page+4046>:	add    %al,(%rax)
0xffffffff81009fd0 <hypercall_page+4048>:	add    %al,(%rax)
0xffffffff81009fd2 <hypercall_page+4050>:	add    %al,(%rax)
0xffffffff81009fd4 <hypercall_page+4052>:	add    %al,(%rax)
0xffffffff81009fd6 <hypercall_page+4054>:	add    %al,(%rax)
0xffffffff81009fd8 <hypercall_page+4056>:	add    %al,(%rax)
0xffffffff81009fda <hypercall_page+4058>:	add    %al,(%rax)
0xffffffff81009fdc <hypercall_page+4060>:	add    %al,(%rax)
0xffffffff81009fde <hypercall_page+4062>:	add    %al,(%rax)
0xffffffff81009fe0 <hypercall_page+4064>:	add    %al,(%rax)
0xffffffff81009fe2 <hypercall_page+4066>:	add    %al,(%rax)
0xffffffff81009fe4 <hypercall_page+4068>:	add    %al,(%rax)
0xffffffff81009fe6 <hypercall_page+4070>:	add    %al,(%rax)
0xffffffff81009fe8 <hypercall_page+4072>:	add    %al,(%rax)
0xffffffff81009fea <hypercall_page+4074>:	add    %al,(%rax)
0xffffffff81009fec <hypercall_page+4076>:	add    %al,(%rax)
0xffffffff81009fee <hypercall_page+4078>:	add    %al,(%rax)
0xffffffff81009ff0 <hypercall_page+4080>:	add    %al,(%rax)
0xffffffff81009ff2 <hypercall_page+4082>:	add    %al,(%rax)
0xffffffff81009ff4 <hypercall_page+4084>:	add    %al,(%rax)
0xffffffff81009ff6 <hypercall_page+4086>:	add    %al,(%rax)
0xffffffff81009ff8 <hypercall_page+4088>:	add    %al,(%rax)
0xffffffff81009ffa <hypercall_page+4090>:	add    %al,(%rax)
0xffffffff81009ffc <hypercall_page+4092>:	add    %al,(%rax)
0xffffffff81009ffe <hypercall_page+4094>:	add    %al,(%rax)
0xffffffff8100a000 <arch_disable_smp_support+0>:	retq   
End of assembler dump.
(gdb) quit

Regards, 
Markus

_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

Pasi Kärkkäinen

2010-Jan-19 17:43 UTC

head link

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

On Tue, Jan 19, 2010 at 05:24:04PM +0100, Markus Schuster
wrote:> On Tuesday 19 January 2010 13:21:52 Pasi Kärkkäinen wrote:
> > so it would be good to check/verify those again for this exact kernel.
> > After you''ve rebuilt the kernel, run xenctx again to verify
the rip/eip
> > address and run the gdb commands for that address.
> 
> OK, I''ve completed the compile run and booted the new kernel (as
with Jeremy,
> I had to disable initramfs ''cause when compiled with
CONFIG_DEBUG_INFO it
> causes the domU to die badly when loaded with pvgrub - maybe a > 70MB 
> initramfs is just way too large ;)). 
> 
> So here we go:
> rip: ffffffff8100930a _stext+0x30a
> flags: 00001246 i z p
> rsp: ffff880001785e60
> rax: 0000000000000000   rcx: ffffffff8100930a   rdx: 0000000000000000
> rbx: 0000000000000000   rsi: 0000000000000000   rdi: 0000000000000002
> rbp: ffff8800017af1d0    r8: ffff88000178e590    r9: ffff880001785e90
> r10: 00026b01b6f1cb68   r11: 0000000000000246   r12: ffff880001785e88
> r13: 0000000000000004   r14: 0000000000000000   r15: 0000000000000000
>  cs: e033        ss: e02b        ds: 0000        es: 0000
>  fs: 0000 @ 0000000000000000
>  gs: 0000 @ ffff880001782000/0000000000000000
> Code (instr addr ffffffff8100930a)
> cc cc cc cc cc cc cc cc cc cc cc 51 41 53 b8 18 00 00 00 0f 05 <41>
5b 59 c3
> cc cc cc cc cc cc cc
> 
> 
> Stack:
>  ffffffff811e4a2e 0000000000000080 ffffffff8100e656 0000000000000001
>  ffffffff81074957 ffff880001785e88 ffff880001785e88 ffffffff81429740
>  ffff880017c14180 0000000000000004 ffffffff8100e834 000000006e6ac043
>  ffffffff8109372c ffff880001797f00 ffffffff81429740 ffffffff814297ac
> 
> Call Trace:
>   [<ffffffff8100930a>] _stext+0x30a  <--
>   [<ffffffff811e4a2e>] set_affinity_irq+0x5a
>   [<ffffffff8100e656>] stop_self+0x2e
>   [<ffffffff81074957>]
generic_smp_call_function_single_interrupt+0xc0
>   [<ffffffff8100e834>] xen_call_function_single_interrupt+0xe
>   [<ffffffff8109372c>] handle_IRQ_event+0x58
>   [<ffffffff810950b4>] handle_level_irq+0x6a
>   [<ffffffff81013917>] handle_irq+0x17
>   [<ffffffff811e45a0>] xen_evtchn_do_upcall+0x102
>   [<ffffffff81011cbe>] xen_do_hypervisor_callback+0x1e
> 
> 
> Same memory address as with Debians pre-built image (I think
that''s good for
> reproducibility :))
> And here''s gdb output (It''s very long - I hope
it''s okay to put inline):
> 
Yeah, that''s good :)
> GNU gdb 6.8-debian
> Copyright (C) 2008 Free Software Foundation, Inc.
> License GPLv3+: GNU GPL version 3 or later
<http://gnu.org/licenses/gpl.html>
> This is free software: you are free to change and redistribute it.
> There is NO WARRANTY, to the extent permitted by law.  Type "show
copying"
> and "show warranty" for details.
> This GDB was configured as "x86_64-linux-gnu"...
> (gdb) x/i 0xffffffff8100930a
> 0xffffffff8100930a <hypercall_page+778>:	add    %al,(%rax)
> (gdb) list *0xffffffff8100930a
> No source file for address 0xffffffff8100930a.
Try running gdb in the kernel source directory to get the lines from the source
file!

-- Pasi


_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

Markus Schuster

2010-Jan-19 19:27 UTC

head link

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

On Tuesday 19 January 2010 18:43:57 Pasi Kärkkäinen
wrote:> > GNU gdb 6.8-debian
> > Copyright (C) 2008 Free Software Foundation, Inc.
> > License GPLv3+: GNU GPL version 3 or later
> > <http://gnu.org/licenses/gpl.html> This is free software: you
are free to
> > change and redistribute it. There is NO WARRANTY, to the extent
permitted
> > by law.  Type "show copying" and "show warranty"
for details.
> > This GDB was configured as "x86_64-linux-gnu"...
> > (gdb) x/i 0xffffffff8100930a
> > 0xffffffff8100930a <hypercall_page+778>:	add    %al,(%rax)
> > (gdb) list *0xffffffff8100930a
> > No source file for address 0xffffffff8100930a.
> 
> Try running gdb in the kernel source directory to get the lines from the
>  source file!
I feared you would say that :)
The problem is: I''ve run gdb in the kernel build directory but it seems
gdb
really can''t find the source for this memory address. If I use the
memory
address below the problematic line in the xenctx call trace (ffffffff811e4a2e) 
I get code from gdb...
But maybe it''s just my fault - I''m really no expert in
debuggers in common or
gdb in special ;)

Regards,
Markus

_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

Jeremy Fitzhardinge

2010-Jan-19 22:15 UTC

head link

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

On 01/19/2010 09:43 AM, Pasi Kärkkäinen wrote:>> GNU gdb 6.8-debian
>> Copyright (C) 2008 Free Software Foundation, Inc.
>> License GPLv3+: GNU GPL version 3 or
later<http://gnu.org/licenses/gpl.html>
>> This is free software: you are free to change and redistribute it.
>> There is NO WARRANTY, to the extent permitted by law.  Type "show
copying"
>> and "show warranty" for details.
>> This GDB was configured as "x86_64-linux-gnu"...
>> (gdb) x/i 0xffffffff8100930a
>> 0xffffffff8100930a<hypercall_page+778>:	add    %al,(%rax)
>> (gdb) list *0xffffffff8100930a
>> No source file for address 0xffffffff8100930a.
>>      
> Try running gdb in the kernel source directory to get the lines from the
source file!
>    
Its the hypercall_page; there is no source, and no code either; the 
hypercall stubs are plugged in there at domain-build time.  The 
hypercall is 24 (778/32), which is vcpu_op; not sure what''s going on in
this path.

But this is completely different from Markus''s original bug report. 
How
many vcpus are there?  It may be getting the wrong cpu context (booting 
with a single vcpu would be simplest).

     J

> -- Pasi
>
>    

_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

Markus Schuster

2010-Jan-20 12:25 UTC

head link

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

On Tuesday 19 January 2010 23:15:42 Jeremy Fitzhardinge
wrote:> On 01/19/2010 09:43 AM, Pasi Kärkkäinen wrote:
> >> GNU gdb 6.8-debian
> >> Copyright (C) 2008 Free Software Foundation, Inc.
> >> License GPLv3+: GNU GPL version 3 or
> >> later<http://gnu.org/licenses/gpl.html> This is free
software: you are
> >> free to change and redistribute it. There is NO WARRANTY, to the
extent
> >> permitted by law.  Type "show copying" and "show
warranty" for details.
> >> This GDB was configured as "x86_64-linux-gnu"...
> >> (gdb) x/i 0xffffffff8100930a
> >> 0xffffffff8100930a<hypercall_page+778>:	add    %al,(%rax)
> >> (gdb) list *0xffffffff8100930a
> >> No source file for address 0xffffffff8100930a.
> >
> > Try running gdb in the kernel source directory to get the lines from
the
> > source file!
> 
> [..]
Jeremy - nice to hear from you!

> But this is completely different from Markus''s original bug
report.
Sorry for my naive thinking, but hasn''t the current memory address (and
trace
information in general) been gathered using a completely different way 
(xenctx). I didn''t know about this tool and just posted all messages
the
crashing kernel dumped to the console. 
btw: The kernel still crashes with rather the same message / trace information 
as before. But it seems xenctx is able to gather more (accurate) information?

> How
> many vcpus are there?  It may be getting the wrong cpu context (booting
> with a single vcpu would be simplest).
The domU had 2 VCUs.
Now the very very interesting part: I''ve reduced the VCPUs to 1 and now
the
amd64/64bit kernel boots fine! Looks like some SMP problem?

Regards,
Markus

_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

Markus Schuster

2010-Jan-20 22:08 UTC

head link

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

On Wednesday 20 January 2010 13:25:45 Markus Schuster
wrote:> > How
> > many vcpus are there?  It may be getting the wrong cpu context
(booting
> > with a single vcpu would be simplest).
> 
> The domU had 2 VCUs.
> Now the very very interesting part: I''ve reduced the VCPUs to 1
and now the
> amd64/64bit kernel boots fine! Looks like some SMP problem?
Sorry, forgot to mention that the 32bit PAE domU I spoke about earlier has 3 
VCPUs attached and is booting/working fine. So I suspect the bug somewhere in 
64bit SMP support?

Regards,
Markus

_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

Jeremy Fitzhardinge

2010-Jan-20 22:40 UTC

head link

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

On 01/20/2010 02:08 PM, Markus Schuster wrote:> Sorry, forgot to mention that the 32bit PAE domU I spoke about earlier has
3
> VCPUs attached and is booting/working fine. So I suspect the bug somewhere
in
> 64bit SMP support?
>    
Perhaps.  The backtrace appears to be completely in generic code, so the 
bug is likely the result of a side-effect of different initialization 
order, or perhaps something that the Xen SMP code isn''t setting up that
native does.  Unfortunately these kinds of implicit state dependency 
bugs can be tricky to track down, and the fact that you appear to be the 
only person seeing this suggests that it is also config dependent.

     J

_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

Markus Schuster

2010-Jan-22 17:20 UTC

head link

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

Am Mittwoch 20 Januar 2010 23:40:55 schrieben Sie:> On 01/20/2010 02:08 PM, Markus Schuster wrote:
> > Sorry, forgot to mention that the 32bit PAE domU I spoke about earlier
> > has 3 VCPUs attached and is booting/working fine. So I suspect the bug
> > somewhere in 64bit SMP support?
> 
> Perhaps.  The backtrace appears to be completely in generic code, so the
> bug is likely the result of a side-effect of different initialization
> order, or perhaps something that the Xen SMP code isn''t setting up
that
> native does.  Unfortunately these kinds of implicit state dependency
> bugs can be tricky to track down, and the fact that you appear to be the
> only person seeing this suggests that it is also config dependent.
OK, I try to get some devel hardware where I can reproduce the bug - on my 
single core single processor workstation I''m unable to reproduce it
(with same
binaries). 

Furthermore I''ll try the opensuse forward ported patches for 2.6.31 as
dom0 -
to rule out my pv_ops dom0 kernel as cause. 

If you think it''s config dependent, could you (or someone else) please
provide
a working-for-him/her pv_ops domU kernel config? Cause if the problem lays in 
the configuration, we should inform Debian people of the potential problem 
with their default kernel configuration - as far as I know they want to go 
stable with 2.6.32. 

Seems to be a hard to crack nut... :)

Regards,
Markus

_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

Markus Schuster

2010-Jan-26 19:58 UTC

head link

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

On Friday 22 January 2010 18:20:41 Markus Schuster
wrote:> OK, I try to get some devel hardware where I can reproduce the bug - on my
> single core single processor workstation I''m unable to reproduce
it (with
>  same binaries).
I was able to get my hands on a brand-new dual hexacore Opteron system this 
weekend and - too bad - I can''t reproduce the problem :(
I will look out for other test systems...

> Furthermore I''ll try the opensuse forward ported patches for
2.6.31 as dom0
>  - to rule out my pv_ops dom0 kernel as cause.
I''ve also verified this approach: The domU crashes the same way it does
with a
pv_ops dom0 kernel. So I think we can rule out dom0 kernel as cause. 

> If you think it''s config dependent, could you (or someone else)
please
>  provide a working-for-him/her pv_ops domU kernel config? Cause if the
>  problem lays in the configuration, we should inform Debian people of the
>  potential problem with their default kernel configuration - as far as I
>  know they want to go stable with 2.6.32.
Olivier Bonvalet has provided his kernel configuration files "for multi
vcpus
64bits pv_ops DomU" he uses in production - thx Olivier.
The domU crashes the same way it does with my config, so it really seems to be 
some sort of problem with my environment - but I have no clue what could cause 
such trouble. Could a faulty ACPI implementation at BIOS level cause such 
problems?

Regards,
Markus

_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

Jeremy Fitzhardinge

2010-Jan-26 20:53 UTC

head link

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

On 01/26/2010 11:58 AM, Markus Schuster wrote:> Olivier Bonvalet has provided his kernel configuration files "for
multi vcpus
> 64bits pv_ops DomU" he uses in production - thx Olivier.
> The domU crashes the same way it does with my config, so it really seems to
be
> some sort of problem with my environment
That''s pretty mysterious.
>   - but I have no clue what could cause
> such trouble. Could a faulty ACPI implementation at BIOS level cause such
> problems?
>    
domU has no access to ACPI or any other BIOS features.

     J

_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

Xen users - Dec 2009 - pv_ops domU crashes on pv_ops dom0 (directly at boot)

[Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)

Re: [Xen-users] pv_ops domU crashes on pv_ops dom0 (directly at boot)