Boris Derzhavets
2010-Apr-22 16:56 UTC
RE: [Xen-devel] Failure to load the most recent kernel 2.6.32.10 ( xen/stable) under Xen 4.0 on F12 (serial log)
Disabling option <> processor allows to load 2.6.32.10 on ASUS P5Q-E :- [*] Power management and ACPI options ---> [*] ACPI (Advanced Configuration and Power Interface) Support ---> [*] Deprecated /proc/acpi files [*] Deprecated power /proc/acpi directories < > ACPI 4.0 power meter [*] Future power /sys interface [*] Deprecated /proc/acpi/event support <*> AC Adapter <*> Battery <*> Button <M> Video <*> Fan -*- Dock -> < > Processor -*- NUMA support [ ] Debug Statements <*> PCI slot detection driver <*> Container and Module Devices <M> Smart Battery System dmesg reports :- ACPI: RSDP 00000000000fb030 00024 (v02 ACPIAM) ACPI: XSDT 00000000cff70100 0005C (v01 A_M_I_ OEMXSDT 07000809 MSFT 00000097) ACPI: FACP 00000000cff70290 000F4 (v03 A_M_I_ OEMFACP 07000809 MSFT 00000097) ACPI: DSDT 00000000cff70440 0963E (v01 A0986 A0986000 00000000 INTL 20060113) ACPI: FACS 00000000cff7e000 00040 ACPI: APIC 00000000cff70390 0006C (v01 A_M_I_ OEMAPIC 07000809 MSFT 00000097) ACPI: MCFG 00000000cff70400 0003C (v01 A_M_I_ OEMMCFG 07000809 MSFT 00000097) ACPI: OEMB 00000000cff7e040 00081 (v01 A_M_I_ AMI_OEM 07000809 MSFT 00000097) ACPI: HPET 00000000cff79a80 00038 (v01 A_M_I_ OEMHPET 07000809 MSFT 00000097) ACPI: OSFR 00000000cff79ac0 000B0 (v01 A_M_I_ OEMOSFR 07000809 MSFT 00000097) ACPI: SSDT 00000000cff7e5d0 00A7C (v01 DpgPmm CpuPm 00000012 INTL 20060113) ACPI: Local APIC address 0xfee00000 No NUMA configuration found Faking a node at 0000000000000000-00000001f1f47000 Bootmem setup node 0 0000000000000000-00000001f1f47000 NODE_DATA [0000000000010000 - 0000000000025fff] bootmap [0000000000026000 - 00000000000643ef] pages 3f (9 early reservations) ==> bootmem [0000000000 - 01f1f47000] #0 [0000000000 - 0000001000] BIOS data page ==> [0000000000 - 0000001000] #1 [000e4c9000 - 000e540000] XEN PAGETABLES ==> [000e4c9000 - 000e540000] #2 [0000006000 - 0000008000] TRAMPOLINE ==> [0000006000 - 0000008000] #3 [0001000000 - 0001b34788] TEXT DATA BSS ==> [0001000000 - 0001b34788] #4 [0001b55000 - 000d537e00] RAMDISK ==> [0001b55000 - 000d537e00] #5 [000d538000 - 000e4c9000] XEN START INFO ==> [000d538000 - 000e4c9000] #6 [0001b35000 - 0001b35280] BRK ==> [0001b35000 - 0001b35280] #7 [0000100000 - 000070b000] PGTABLE ==> [0000100000 - 000070b000] #8 [000e540000 - 000ecd4000] PGTABLE ==> [000e540000 - 000ecd4000] Boris. --- On Thu, 4/22/10, Boris Derzhavets <bderzhavets@yahoo.com> wrote: From: Boris Derzhavets <bderzhavets@yahoo.com> Subject: RE: [Xen-devel] Failure to load the most recent kernel 2.6.32.10 ( xen/stable) under Xen 4.0 on F12 (serial log) To: "KeYu" <ke.yu@intel.com> Cc: "Jeremy Fitzhardinge" <jeremy@goop.org>, "xen-devel@lists.xensource.com" <xen-devel@lists.xensource.com>, "Konrad Rzeszutek Wilk" <konrad.wilk@oracle.com> Date: Thursday, April 22, 2010, 7:32 AM On ASIS P5Q3 :- [ 0.403515] ACPI: SSDT 00000000cfe7e0d0 00235 (v01 DpgPmm P001Ist 00000011 INTL 20051117) [ 0.405055] ACPI: SSDT 00000000cfe7e310 00235 (v01 DpgPmm P002Ist 00000012 INTL 20051117) [ 0.406589] ACPI: SSDT 00000000cfe7e550 00235 (v01 DpgPmm P003Ist 00000012 INTL 20051117) [ 0.409424] ACPI: SSDT 00000000cfe7e790 00235 (v01 DpgPmm P004Ist 00000012 INTL 20051117) [ 0.414290] Event-channel device installed. [ 0.414339] pciback: pcistub_init_devices_late On ASUS P5Q-E right after SSDT lines issue raises up. It happens on regular basis at Xen 4.0 Dom0 on top of F12 and Ubuntu 9.10 Server, located on different drives and dual booting on the same box. [ 14.275834] ACPI: SSDT 00000000cff7e0d0 00277 (v01 DpgPmm P001Ist 00000011 INTL 20060113) [ 14.375923] ACPI: SSDT 00000000cff7e350 00277 (v01 DpgPmm P002Ist 00000012 INTL 20060113) (XEN) mm.c:859:d0 Error getting mfn 80000 (pfn 5555555555555555) from L1 entry 8000000080000473 for l1e_owner=0, pg_owner=32753 [ 14.484819] BUG: unable to handle kernel paging request at ffffc9000003a000 Boris --- On Thu, 4/22/10, Boris Derzhavets <bderzhavets@yahoo.com> wrote: From: Boris Derzhavets <bderzhavets@yahoo.com> Subject: RE: [Xen-devel] Failure to load the most recent kernel 2.6.32.10 ( xen/stable) under Xen 4.0 on F12 (serial log) To: "KeYu" <ke.yu@intel.com> Cc: "Jeremy Fitzhardinge" <jeremy@goop.org>, "xen-devel@lists.xensource.com" <xen-devel@lists.xensource.com>, "Konrad Rzeszutek Wilk" <konrad.wilk@oracle.com> Date: Thursday, April 22, 2010, 5:58 AM Why it happens on ASUS P5Q-E ( 8 GB DDR2 Kingston) and doesn''t on ASUS P5Q3 ( 8 GB DDR3 Kingston) ? (XEN) mm.c:859:d0 Error getting mfn 80000 (pfn 5555555555555555) from L1 entry 8000000080000473 for l1e_owner=0, pg_owner=32753 [ 14.484819] BUG: unable to handle kernel paging request at ffffc9000003a000 [ 14.484819] IP: [<ffffffff812aba22>] acpi_ex_system_memory_space_handler+0x16d/0x1df [ 14.484819] PGD 3f86b067 PUD 3f86c067 PMD 3f86d067 PTE 0 [ 14.484819] Oops: 0000 [#1] SMP [ 14.484819] last sysfs file: [ 14.484819] CPU 0 [ 14.484819] Modules linked in: [ 14.484819] Pid: 1, comm: swapper Not tainted 2.6.32.11 #5 P5Q-E Boris. --- On Wed, 4/21/10, Boris Derzhavets <bderzhavets@yahoo.com> wrote: From: Boris Derzhavets <bderzhavets@yahoo.com> Subject: RE: [Xen-devel] Failure to load the most recent kernel 2.6.32.10 ( xen/stable) under Xen 4.0 on F12 (serial log) To: "KeYu" <ke.yu@intel.com> Cc: "Jeremy Fitzhardinge" <jeremy@goop.org>, "xen-devel@lists.xensource.com" <xen-devel@lists.xensource.com>, "Konrad Rzeszutek Wilk" <konrad.wilk@oracle.com> Date: Wednesday, April 21, 2010, 9:25 AM Serial log for 2.6.32.11 loading under Xen 4.0 on top of Fedora 12 (ASUS P5Q-E) Boris. --- On Wed, 4/21/10, Yu, Ke <ke.yu@intel.com> wrote: From: Yu, Ke <ke.yu@intel.com> Subject: RE: [Xen-devel] Failure to load the most recent kernel 2.6.32.10 ( xen/stable) under Xen 4.0 on Ubuntu 9.10 To: "Boris Derzhavets" <bderzhavets@yahoo.com> Cc: "Konrad Rzeszutek Wilk" <konrad.wilk@oracle.com>, "xen-devel@lists.xensource.com" <xen-devel@lists.xensource.com>, "Jeremy Fitzhardinge" <jeremy@goop.org> Date: Wednesday, April 21, 2010, 4:05 AM Yes, it would be helpful if you can provide more complete serial console log. From the below log, I can see acpi_processor_set_pdc-> acpi_evaluate_object(pr->handle, "_PDC", pdc_in, NULL) cause the system panic. However, it cannot tell why _PDC evaluation cause panic. It may be BIOS issue as you suggested, but we need more log to decide if this is true. And if true, ASUS should be the right place to get updated BIOS. Also, how is the 2.6.32.11 kernel working in bare mental environment? acpi_processor_set_pdc is not xen specific code, so this issue is likely also occurring in bare mental environment. And according to your test result, 2.6.32.9 works while 2.6.32.10 not. This remind me change we made recently made, i.e. "re-enable mwait for xen cpuidle", I am not sure if this cause the panic. So could you please try the grub kernel option "idle=nomwait"? This option will revert the effect of that patch. If "idle=nomwait" works, then we can dig more in this direction. Best Regards Ke ==============================From: Boris Derzhavets [mailto:bderzhavets@yahoo.com] Sent: Wednesday, April 21, 2010 5:26 AM To: Yu, Ke Cc: Konrad Rzeszutek Wilk; xen-devel@lists.xensource.com; Yu, Ke; Jeremy Fitzhardinge Subject: Re: [Xen-devel] Failure to load the most recent kernel 2.6.32.10 ( xen/stable) under Xen 4.0 on Ubuntu 9.10 If it would not help, i will set up serial console ( a bit painful for me to move boxes ) Tail of sreen output on ASUS P5Q-E +C2D E8400 for 2.6.32.11 kernel :- acpi_processor_set_pdc + 0x3c/0x3e xen_acpi_processor_add + 0x2ef/0x426 acpi_device_probe + 0x4b/0x11d driver_probe_device + 0x86/0x180 __diver_attach + 0x86/0x180 __diver_attach + 0x86/0xa0 bus_for_each_dev 0x64/0x90 driver_attach + 0x71/0x140 bus_add_driver + 0x3e/0x140 driver_register + 0x71/0x140 ?acpi_processor_init 0x3e/0x140 ?acpi_processor_init 0x71/0x140 acpi_bus_register_driver +0x3e/0x12 xen_acpi_processor_init 0xae/0x128 acpi_processor_init + 0x3e/0x12 ? acpi_pci_slot_init 0x0/0x20 ? acpi_pci_slot_init 0x0/0x20 do_one_init_call + 0x37/0x1xa0 kernel_init 0x148/0x196 child_rip + 0xa/0x20 ? init_ret_from_sys_call 0x7/0x16 ? retint_restore_args 0x5/0x5 ? child_rip 0x0/0x20 Screen output stopped. Thanks. Boris. P.S. Nothing similar happens on ASUS P5Q3 + Q9550 Dom0 loads smoothly. Tested on F12 and Ubuntu 9.10. Same picture. --- On Tue, 4/20/10, Jeremy Fitzhardinge <jeremy@goop.org> wrote: From: Jeremy Fitzhardinge <jeremy@goop.org> Subject: Re: [Xen-devel] Failure to load the most recent kernel 2.6.32.10 ( xen/stable) under Xen 4.0 on Ubuntu 9.10 To: "Boris Derzhavets" <bderzhavets@yahoo.com> Cc: "Konrad Rzeszutek Wilk" <konrad.wilk@oracle.com>, "xen-devel@lists.xensource.com" <xen-devel@lists.xensource.com>, "Yu, Ke" <ke.yu@intel.com> Date: Tuesday, April 20, 2010, 2:21 PM On 04/20/2010 03:44 AM, Boris Derzhavets wrote:> ASUS P5Q-E 2.6.31.13 under Xen 4.0 loads fine > ASUS P5Q-E 2.6.32.9 under Xen 4.0 loads fine > ASUS P5Q-E 2.6.32.10 under Xen 4.0 doesn''t load > > ASUS P5Q3 all kernels work fine > > I believe that the issue is connected with outdated ( ACPI 2 Enabled) BIOS > on first board. This question is mostly addressed to Yu Ke. What BIOS > upgrade is required (exact version) , if ever possible. >It would probably help him if you 1. address your mail to him, and 2. provide more specific information about what the failure is, beyond ``Before child_rip word "acpi" shows pretty often. In particular "acpi_xen_processor"''''. J -----Inline Attachment Follows----- _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel -----Inline Attachment Follows----- _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel -----Inline Attachment Follows----- _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Konrad Rzeszutek Wilk
2010-Apr-22 19:23 UTC
Re: [Xen-devel] Failure to load the most recent kernel 2.6.32.10 ( xen/stable) under Xen 4.0 on F12 (serial log)
On Thu, Apr 22, 2010 at 09:56:44AM -0700, Boris Derzhavets wrote:> Disabling option <> processor allows to load 2.6.32.10 on ASUS P5Q-E :- > > [*] Power management and ACPI options ---> > [*] ACPI (Advanced Configuration and Power Interface) Support ---> > [*] Deprecated /proc/acpi files > [*] Deprecated power /proc/acpi directories > < > ACPI 4.0 power meter > [*] Future power /sys interface > [*] Deprecated /proc/acpi/event support > <*> AC Adapter > <*> Battery > <*> Button > <M> Video > <*> Fan > -*- Dock > -> < > ProcessorCan you make that be a module instead? And when the machine has booted up, try to load the module (you might need to rename the modele to say processor.ko.old so that udev won''t automatically load it)? And also compile the kernel with CONFIG_ACPI_DEBUG=y and CONFIG_ACPI_DEBUG_FUNC_TRACE=y Lastly, when you boot your machine, please add these flags to your Linux kernel command line: acpi.debug_level=0xffffffff acpi.debug_layer=0x2 initcall_debug _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Boris Derzhavets
2010-Apr-22 20:32 UTC
Re: [Xen-devel] Failure to load the most recent kernel 2.6.32.10 ( xen/stable) under Xen 4.0 on F12 (serial log)
Not sure which one of those :- LD [M] drivers/acpi/processor.ko LD [M] drivers/xen/acpi_processor.ko I believe second one causes issue under Xen 4.0 Hypervisor Boris --- On Thu, 4/22/10, Konrad Rzeszutek Wilk <konrad.wilk@oracle.com> wrote: From: Konrad Rzeszutek Wilk <konrad.wilk@oracle.com> Subject: Re: [Xen-devel] Failure to load the most recent kernel 2.6.32.10 ( xen/stable) under Xen 4.0 on F12 (serial log) To: "Boris Derzhavets" <bderzhavets@yahoo.com> Cc: "Jeremy Fitzhardinge" <jeremy@goop.org>, "xen-devel@lists.xensource.com" <xen-devel@lists.xensource.com>, "KeYu" <ke.yu@intel.com> Date: Thursday, April 22, 2010, 3:23 PM On Thu, Apr 22, 2010 at 09:56:44AM -0700, Boris Derzhavets wrote:> Disabling option <> processor allows to load 2.6.32.10 on ASUS P5Q-E :- > > [*] Power management and ACPI options ---> > [*] ACPI (Advanced Configuration and Power Interface) Support ---> > [*] Deprecated /proc/acpi files > [*] Deprecated power /proc/acpi directories > < > ACPI 4.0 power meter > [*] Future power /sys interface > [*] Deprecated /proc/acpi/event support > <*> AC Adapter > <*> Battery > <*> Button > <M> Video > <*> Fan > -*- Dock > -> < > ProcessorCan you make that be a module instead? And when the machine has booted up, try to load the module (you might need to rename the modele to say processor.ko.old so that udev won''t automatically load it)? And also compile the kernel with CONFIG_ACPI_DEBUG=y and CONFIG_ACPI_DEBUG_FUNC_TRACE=y Lastly, when you boot your machine, please add these flags to your Linux kernel command line: acpi.debug_level=0xffffffff acpi.debug_layer=0x2 initcall_debug _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Konrad Rzeszutek Wilk
2010-Apr-22 21:09 UTC
Re: [Xen-devel] Failure to load the most recent kernel 2.6.32.10 ( xen/stable) under Xen 4.0 on F12 (serial log)
On Thu, Apr 22, 2010 at 01:32:02PM -0700, Boris Derzhavets wrote:> Not sure which one of those :- > > LD [M] drivers/acpi/processor.ko > LD [M] drivers/xen/acpi_processor.koDo both then. _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel