Nathan March
2011-Feb-02 00:05 UTC
[Xen-devel] 4.1.0rc3 page fault on boot prior to kernel loading
I ran into this on 4.0.2 as well, posted it to xen-users a couple weeks
ago but didn''t get any useful responses.
Anyone have any idea what might be going on here? This is using the
latest dom0 kernel from jeremy. The kernel boots fine directly (without
xen). Full boot log is below.
Thanks,
Nathan
root (hd0,0)
Filesystem type is ext2fs, partition type 0xfd
kernel /boot/xen.gz console=com1,com2,vga com1=115200,8n1
com2=115200,8n1 dom0_
mem=1024M dom0_max_vcpus=1 dom0_vcpus_pin=true earlyprintk=xen
[Multiboot-elf, <0x100000:0x188518:0x4cae8>, shtab=0x2d5078,
entry=0x100000]
module /boot/vmlinuz root=/dev/md0 max_loop=128 console=tty0
console=ttyS0,1152
00 console=ttyS1,115200
[Multiboot-module @ 0x2d6000, 0x4a2440 bytes]
{ __ __ _ _ _ ___ _____
\ \/ /___ _ __ | || | / | / _ \ _ __ ___|___ / _ __ _ __ ___
\ // _ \ ''_ \ | || |_ | || | | |__| ''__/ __| |_ \ __|
''_ \| ''__/ _ \
/ \ __/ | | | |__ _|| || |_| |__| | | (__ ___) |__| |_) | | | __/
/_/\_\___|_| |_| |_|(_)_(_)___/ |_| \___|____/ | .__/|_| \___|
|_|
(XEN) Xen version 4.1.0-rc3-pre (root@nmsrv.com) (gcc version 4.3.4
(Gentoo 4.3.4 p1.1, pie-10.1.5) ) Tue Feb 1 15:59:16 PST 2011
(XEN) Latest ChangeSet: Tue Feb 01 19:26:36 2011 +0000 22858:9a6458e0c3f5
(XEN) Bootloader: GNU GRUB 0.97
(XEN) Command line: console=com1,com2,vga com1=115200,8n1
com2=115200,8n1 dom0_mem=1024M dom0_max_vcpus=1 dom0_vcpus_pin=true
earlyprintk=xen
(XEN) Video information:
(XEN) VGA is text mode 80x25, font 8x16
(XEN) VBE/DDC methods: none; EDID transfer time: 0 seconds
(XEN) EDID info not retrieved because no DDC retrieval method
detected 00AB
(XEN) Disc information:
(XEN) Found 3 MBR signatures
(XEN) Found 3 EDD information structures
(XEN) Xen-e820 RAM map:
(XEN) 0000000000000000 - 000000000009dc00 (usable)
(XEN) 000000000009dc00 - 00000000000a0000 (reserved)
(XEN) 00000000000e6000 - 0000000000100000 (reserved)
(XEN) 0000000000100000 - 00000000bf760000 (usable)
(XEN) 00000000bf76e000 - 00000000bf770000 type 9
(XEN) 00000000bf770000 - 00000000bf77e000 (ACPI data)
(XEN) 00000000bf77e000 - 00000000bf7d0000 (ACPI NVS)
(XEN) 00000000bf7d0000 - 00000000bf7e0000 (reserved)
(XEN) 00000000bf7ec000 - 00000000c0000000 (reserved)
(XEN) 00000000e0000000 - 00000000f0000000 (reserved)
(XEN) 00000000fee00000 - 00000000fee01000 (reserved)
(XEN) 00000000ffc00000 - 0000000100000000 (reserved)
(XEN) 0000000100000000 - 0000000a40000000 (usable)
(XEN) ACPI: RSDP 000F9FB0, 0024 (r2 ACPIAM)
(XEN) ACPI: XSDT BF770100, 008C (r1 SMCI 20101005 MSFT 97)
(XEN) ACPI: FACP BF770290, 00F4 (r3 100510 FACP1516 20101005 MSFT 97)
(XEN) ACPI: DSDT BF7706A0, 5A4A (r1 30007 30007000 0 INTL 20051117)
(XEN) ACPI: FACS BF77E000, 0040
(XEN) ACPI: APIC BF770390, 011E (r1 100510 APIC1516 20101005 MSFT 97)
(XEN) ACPI: MCFG BF7704B0, 003C (r1 100510 OEMMCFG 20101005 MSFT 97)
(XEN) ACPI: SLIT BF7704F0, 0030 (r1 100510 OEMSLIT 20101005 MSFT 97)
(XEN) ACPI: OEMB BF77E040, 0082 (r1 100510 OEMB1516 20101005 MSFT 97)
(XEN) ACPI: SRAT BF77A6A0, 0190 (r1 100510 OEMSRAT 1 INTL 1)
(XEN) ACPI: HPET BF77A830, 0038 (r1 100510 OEMHPET 20101005 MSFT 97)
(XEN) ACPI: DMAR BF77E0D0, 0130 (r1 AMI OEMDMAR 1 MSFT 97)
(XEN) ACPI: SSDT BF780AC0, 12C9 (r1 DpgPmm CpuPm 12 INTL 20051117)
(XEN) ACPI: EINJ BF77A870, 0130 (r1 AMIER AMI_EINJ 20101005 MSFT 97)
(XEN) ACPI: BERT BF77AA00, 0030 (r1 AMIER AMI_BERT 20101005 MSFT 97)
(XEN) ACPI: ERST BF77AA30, 01B0 (r1 AMIER AMI_ERST 20101005 MSFT 97)
(XEN) ACPI: HEST BF77ABE0, 00A8 (r1 AMIER ABC_HEST 20101005 MSFT 97)
(XEN) System RAM: 40950MB (41933812kB)
(XEN) SRAT: PXM 0
(XEN) SRAT: PXM 0 -> APIC 4 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 16 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 18 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 20 -> Node 0
(XEN) SRAT: PXM 1 -> APIC 32 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 34 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 36 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 48 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 50 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 52 -> Node 1
(XEN) SRAT: Node 0 PXM 0 0-a0000
(XEN) SRAT: Node 0 PXM 0 100000-c0000000
(XEN) SRAT: Node 0 PXM 0 100000000-640000000
(XEN) SRAT: Node 1 PXM 1 640000000-a40000000
(XEN) NUMA: Allocated memnodemap from a3eac5000 - a3ead0000
(XEN) NUMA: Using 8 for the hash shift.
(XEN) Domain heap initialised DMA width 32 bits
(XEN) found SMP MP-table at 000ff780
(XEN) DMI present.
(XEN) Using APIC driver default
(XEN) ACPI: PM-Timer IO Port: 0x808
(XEN) ACPI: ACPI SLEEP INFO: pm1x_cnt[804,0], pm1x_evt[800,0]
(XEN) ACPI: wakeup_vec[bf77e00c], vec_size[20]
(XEN) ACPI: Local APIC address 0xfee00000
(XEN) ACPI: LAPIC (acpi_id[0x01] lapic_id[0x00] enabled)
(XEN) Processor #0 6:12 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x02] lapic_id[0x02] enabled)
(XEN) Processor #2 6:12 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x03] lapic_id[0x04] enabled)
(XEN) Processor #4 6:12 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x04] lapic_id[0x10] enabled)
(XEN) Processor #16 6:12 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x05] lapic_id[0x12] enabled)
(XEN) Processor #18 6:12 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x06] lapic_id[0x14] enabled)
(XEN) Processor #20 6:12 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x07] lapic_id[0x20] enabled)
(XEN) Processor #32 6:12 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x08] lapic_id[0x22] enabled)
(XEN) Processor #34 6:12 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x09] lapic_id[0x24] enabled)
(XEN) Processor #36 6:12 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x30] enabled)
(XEN) Processor #48 6:12 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x32] enabled)
(XEN) Processor #50 6:12 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x34] enabled)
(XEN) Processor #52 6:12 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x8c] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x8d] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x8e] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x10] lapic_id[0x8f] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x11] lapic_id[0x90] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x12] lapic_id[0x91] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x13] lapic_id[0x92] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x14] lapic_id[0x93] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x15] lapic_id[0x94] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x16] lapic_id[0x95] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x17] lapic_id[0x96] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x18] lapic_id[0x97] disabled)
(XEN) ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])
(XEN) Overriding APIC driver with bigsmp
(XEN) ACPI: IOAPIC (id[0x01] address[0xfec00000] gsi_base[0])
(XEN) IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23
(XEN) ACPI: IOAPIC (id[0x03] address[0xfec8a000] gsi_base[24])
(XEN) IOAPIC[1]: apic_id 3, version 32, address 0xfec8a000, GSI 24-47
(XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
(XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
(XEN) ACPI: IRQ0 used by override.
(XEN) ACPI: IRQ2 used by override.
(XEN) ACPI: IRQ9 used by override.
(XEN) Enabling APIC mode: Phys. Using 2 I/O APICs
(XEN) ACPI: HPET id: 0x8086a301 base: 0xfed00000
(XEN) PCI: MCFG configuration 0: base e0000000 segment 0 buses 0 - 255
(XEN) PCI: MCFG area at e0000000 reserved in E820
(XEN) ERST table is invalid
(XEN) Using ACPI (MADT) for SMP configuration information
(XEN) IRQ limits: 48 GSI, 2272 MSI/MSI-X
(XEN) Using scheduler: SMP Credit Scheduler (credit)
(XEN) Detected 2266.813 MHz processor.
(XEN) Initing memory sharing.
(XEN) mce_intel.c:1162: MCA Capability: BCAST 1 SER 0 CMCI 1 firstbank 0
extended MCE MSR 0
(XEN) Intel machine check reporting enabled
(XEN) Intel VT-d Snoop Control enabled.
(XEN) Intel VT-d Dom0 DMA Passthrough not enabled.
(XEN) Intel VT-d Queued Invalidation enabled.
(XEN) Intel VT-d Interrupt Remapping not enabled.
(XEN) I/O virtualisation enabled
(XEN) - Dom0 mode: Relaxed
(XEN) Enabled directed EOI with ioapic_ack_old on!
(XEN) ENABLING IO-APIC IRQs
(XEN) -> Using old ACK method
(XEN) ..TIMER: vector=0xF0 apic1=0 pin1=2 apic2=-1 pin2=-1
(XEN) Platform timer is 14.318MHz HPET
N) Allocated console ring of 128 KiB.
(XEN) VMX: Supported advanced features:
(XEN) - APIC MMIO access virtualisation
(XEN) - APIC TPR shadow
(XEN) - Extended Page Tables (EPT)
(XEN) - Virtual-Processor Identifiers (VPID)
(XEN) - Virtual NMI
(XEN) - MSR direct-access bitmap
(XEN) - Unrestricted Guest
(XEN) EPT supports 1GB super page.
(XEN) EPT supports 2MB super page.
(XEN) HVM: ASIDs enabled.
(XEN) HVM: VMX enabled
(XEN) HVM: Hardware Assisted Paging detected.
(XEN) Brought up 12 CPUs
(XEN) ACPI sleep modes: S3
(XEN) mcheck_poll: Machine check polling timer started.
(XEN) *** LOADING DOMAIN 0 ***
(XEN) elf_parse_binary: phdr: paddr=0x1000000 memsz=0x90e000
(XEN) elf_parse_binary: phdr: paddr=0x190e000 memsz=0xd0228
(XEN) elf_parse_binary: phdr: paddr=0x19df000 memsz=0x888
(XEN) elf_parse_binary: phdr: paddr=0x19e0000 memsz=0x159d8
(XEN) elf_parse_binary: phdr: paddr=0x19f6000 memsz=0x289000
(XEN) elf_parse_binary: memory: 0x1000000 -> 0x1c7f000
(XEN) elf_xen_parse_note: GUEST_OS = "linux"
(XEN) elf_xen_parse_note: GUEST_VERSION = "2.6"
(XEN) elf_xen_parse_note: XEN_VERSION = "xen-3.0"
(XEN) elf_xen_parse_note: VIRT_BASE = 0xffffffff80000000
(XEN) elf_xen_parse_note: ENTRY = 0xffffffff819f6200
(XEN) elf_xen_parse_note: HYPERCALL_PAGE = 0xffffffff81009000
(XEN) elf_xen_parse_note: FEATURES =
"!writable_page_tables|pae_pgdir_above_4gb"
(XEN) elf_xen_parse_note: PAE_MODE = "yes"
(XEN) elf_xen_parse_note: LOADER = "generic"
(XEN) elf_xen_parse_note: unknown xen elf note (0xd)
(XEN) elf_xen_parse_note: SUSPEND_CANCEL = 0x1
(XEN) elf_xen_parse_note: HV_START_LOW = 0xffff800000000000
(XEN) elf_xen_parse_note: PADDR_OFFSET = 0x0
(XEN) elf_xen_addr_calc_check: addresses:
(XEN) virt_base = 0xffffffff80000000
(XEN) elf_paddr_offset = 0x0
(XEN) virt_offset = 0xffffffff80000000
(XEN) virt_kstart = 0xffffffff81000000
(XEN) virt_kend = 0xffffffff81c7f000
(XEN) virt_entry = 0xffffffff819f6200
(XEN) p2m_base = 0xffffffffffffffff
(XEN) Xen kernel: 64-bit, lsb, compat32
(XEN) Dom0 kernel: 64-bit, PAE, lsb, paddr 0x1000000 -> 0x1c7f000
(XEN) PHYSICAL MEMORY ARRANGEMENT:
(XEN) Dom0 alloc.: 0000000438000000->000000043a000000 (253952 pages
to be allocated)
(XEN) VIRTUAL MEMORY ARRANGEMENT:
(XEN) Loaded kernel: ffffffff81000000->ffffffff81c7f000
(XEN) Init. ramdisk: ffffffff81c7f000->ffffffff81c7f000
(XEN) Phys-Mach map: ffffffff81c7f000->ffffffff81e7f000
(XEN) Start info: ffffffff81e7f000->ffffffff81e7f4b4
(XEN) Page tables: ffffffff81e80000->ffffffff81e93000
(XEN) Boot stack: ffffffff81e93000->ffffffff81e94000
(XEN) TOTAL: ffffffff80000000->ffffffff82000000
(XEN) ENTRY ADDRESS: ffffffff819f6200
(XEN) Dom0 has maximum 1 VCPUs
(XEN) elf_load_binary: phdr 0 at 0xffffffff81000000 -> 0xffffffff8190e000
(XEN) elf_load_binary: phdr 1 at 0xffffffff8190e000 -> 0xffffffff819de228
(XEN) elf_load_binary: phdr 2 at 0xffffffff819df000 -> 0xffffffff819df888
(XEN) elf_load_binary: phdr 3 at 0xffffffff819e0000 -> 0xffffffff819f59d8
(XEN) elf_load_binary: phdr 4 at 0xffffffff819f6000 -> 0xffffffff81a7d000
(XEN) Scrubbing Free RAM:
........................................................................................................................................................................................................................................................................................................................................................................................................done.
(XEN) Xen trace buffers: disabled
(XEN) Std. Loglevel: All
(XEN) Guest Loglevel: All
(XEN) Xen is relinquishing VGA console.
(XEN) *** Serial input -> DOM0 (type ''CTRL-a'' three times
to switch
input to Xen)
(XEN) Freed 224kB init memory.
mapping kernel into physical memory
Xen: setup ISA identity maps
about to get started...
(XEN) d0:v0: unhandled page fault (ec=0000)
(XEN) Pagetable walk from ffffffff81c8e498:
(XEN) L4[0x1ff] = 0000000439003067 0000000000001003
(XEN) L3[0x1fe] = 0000000439007067 0000000000001007
(XEN) L2[0x00e] = 0000000000000000 ffffffffffffffff
(XEN) domain_crash_sync called from entry.S
(XEN) Domain 0 (vcpu#0) crashed on cpu#0:
(XEN) ----[ Xen-4.1.0-rc3-pre x86_64 debug=y Not tainted ]----
(XEN) CPU: 0
(XEN) RIP: e033:[<ffffffff81037544>]
(XEN) RFLAGS: 0000000000000206 EM: 1 CONTEXT: pv guest
(XEN) rax: ffffffff81c8e000 rbx: 8000000001e93063 rcx: 000000000000000f
(XEN) rdx: 0000000000000000 rsi: 0000000001e93000 rdi: 0000000000000093
(XEN) rbp: ffffffff8190fb78 rsp: ffffffff8190fb30 r8: 000000000000000e
(XEN) r9: 000000000000000f r10: 000000000000000f r11: 0000000001e93000
(XEN) r12: ffffffff81a80000 r13: 0000000000000000 r14: 0000000000000001
(XEN) r15: 0000000001e93000 cr0: 000000008005003b cr4: 00000000000026f0
(XEN) cr3: 0000000439001000 cr2: ffffffff81c8e498
(XEN) ds: 0000 es: 0000 fs: 0000 gs: 0000 ss: e02b cs: e033
(XEN) Guest stack trace from rsp=ffffffff8190fb30:
(XEN) 000000000000000f 0000000001e93000 0000000000000000 ffffffff81037544
(XEN) 000000010000e030 0000000000010006 ffffffff8190fb78 000000000000e02b
(XEN) ffffffff8190fbc0 ffffffff8190fb88 ffffffff8103755c ffffffff8190fba0
(XEN) ffffffff8103765e 8000000001e93063 ffffffff8190fbc0 ffffffff81037def
(XEN) 000000000000000f ffffffffff400000 ffffffff8190fc10 ffffffff810373cf
(XEN) 0000000001e93000 000000000000000f 000000000000000f 000000000000000e
(XEN) 8000000001e93063 0000000001e93000 8000000000000163 0000000340000000
(XEN) ffffffff8190fc48 ffffffff81a0b3af 0000000000000000 ffffffff8190fcd8
(XEN) ffffffff81079590 00000000000009ff 0000000001e93000 ffffffff8190fc88
(XEN) ffffffff81a0b595 8000000000000163 0000000001e93000 8000000000000163
(XEN) ffffffff8190fd28 0000000100000000 0000000340000000 ffffffff8190fc98
(XEN) ffffffff81a0b635 ffffffff8190fcc8 ffffffff815f9e68 0000000000000000
(XEN) 0000000340000000 8000000000000163 ffff880001002020 ffffffff8190fd58
(XEN) ffffffff81a32833 ffffffff8190fdb8 ffffffff8161c9f1 0000000000000000
(XEN) 0000000000000000 0000000340000000 ffff880001002000 0000000000000000
(XEN) 0000000000000004 0000000000000000 000000000000000f ffffffff8182a535
(XEN) 0000000340000000 0000000000000001 ffffffff81001880 ffff880100000000
(XEN) ffff880340000000 ffffffff8190fdb8 ffffffff81a329df ffffffff8190fd88
(XEN) 0000000000000000 ffff880340000000 ffff880001007078 ffffffff8190fdb8
(XEN) ffffffff8190fe20 0000000000000001 0000000000000000 ffffffff8186aff9
(XEN) Domain 0 crashed: rebooting machine in 5 seconds.
_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xensource.com
http://lists.xensource.com/xen-devel
Nathan March
2011-Feb-03 00:25 UTC
Re: [Xen-devel] 4.1.0rc3 page fault on boot prior to kernel loading
On 2/1/2011 4:05 PM, Nathan March wrote:> I ran into this on 4.0.2 as well, posted it to xen-users a couple > weeks ago but didn''t get any useful responses.Just an update here, switching from the 2.6.32 head to next/2.6.37 has solved this. Would be good to include a note about in the docs or release notices since the wiki XenParavirtOps page still says 2.6.32.x is the recommended branch. I do however lose all video during the switch from the hypervisor to the kernel, still digging into that =) - Nathan _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Ian Campbell
2011-Feb-03 07:35 UTC
Re: [Xen-devel] 4.1.0rc3 page fault on boot prior to kernel loading
On Thu, 2011-02-03 at 00:25 +0000, Nathan March wrote:> On 2/1/2011 4:05 PM, Nathan March wrote: > > I ran into this on 4.0.2 as well, posted it to xen-users a couple > > weeks ago but didn''t get any useful responses. > > Just an update here, switching from the 2.6.32 head to next/2.6.37 has > solved this. Would be good to include a note about in the docs or > release notices since the wiki XenParavirtOps page still says 2.6.32.x > is the recommended branch.2.6.32.x is still the recommended branch since it is the stable maintained branch. 2.6.37+ are currently development branches. So we really ought to try and get to the bottom of your issue. Which exact kernel version (git sha1) are you using? http://wiki.xen.org/xenwiki/XenParavirtOps contains (under "Are there more debugging options I could enable to troubleshoot problems with Xen and/or dom0 kernel?") further details of useful debugging options to use. Please can you try converting the various addresses from your stack trace into functions / line numbers. I usually use "$ gdb vmlinux" and then "(gdb) list *0xaddress", other people use addr2line, both options require that you have a kernel built with debug symbols (CONFIG_DEBUG_INFO IIRC). Ian. _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel