Markus Gebert
2010-Jul-09 15:41 UTC
8.1-RC2 - PCI fatal error or MCE triggered by USB/ehci on Sun X4100M2?
Hi Summary: With FreeBSD 8.1-RC2 we get an MCE (fatal trap 28) on a Sun X4100M2 when putting load on mpt and em. Initially thinking of a hardware problem, and after many tests, we're able to avoid the panic by not compiling the usb stack into the kernel. We cannot reproduce the problem on 6.x, 7.x or, as it seems right now, even CURRENT. long story: We're in the process of testing FreeBSD 8.1-RC2 for future deployment on our servers. When testing on a Sun X4100M2 we have encountered strange behavior: Under medium load, the test machine would reboot itself (hardware-triggered) without panic and spit out errors like "hypertransport sync flood error on last boot" during POST (or complain about fatal PCI errors). Thinking our test machine could have bad hardware, we replaced RAM, which didn't help. We've also put the same load on a second X4100M2, getting the same results. Both test machines had been in production before, happily running 6.4. We have at least 35 X4100M2 running on 6.4 in production, and another 15 running on 7.2, all of them not showing this problem at all. So we started thinking this problem could be software-related or at least triggered by software. After altering a BIOS setting to not reboot in case of a hypertransport flood, we finally managed to get an MCE reported by MCA and a fatal trap 28: -- MCA: Bank 4, Status 0xb400004000030c2b MCA: Global Cap 0x0000000000000105, Status 0x0000000000000007 MCA: Vendor "AuthenticAMD", ID 0x40f13, APIC ID 2 MCA: CPU 2 UNCOR BUSLG Observer WR I/O MCA: Address 0xfd00000000 Fatal trap 28: machine check trap while in kernel mode cpuid = 2; apic id = 02 instruction pointer = 0x20:0xffffffff80876506 stack pointer = 0x28:0xffffff800004ab50 frame pointer = 0x28:0xffffff800004ab60 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags = interrupt enabled, IOPL = 0 current process = 11 (idle: cpu2) trap number = 28 panic: machine check trap cpuid = 2 Uptime: 3m9s -- Still, this may suggest a hardware problem. A 8.1 kernel with debug options didn't bring any more information. When WITNESS kicked in, it seemed random and to be symptom rather than cause. The same goes for DDB backtraces, random and most probably worthless. I guess that's expected with this kind of panic. So we fell back on trial&error and ruling out stuff that is new in FreeBSD 8. What we've learned so far: - we cannot reproduce with 6.x, 7.x - upgrading system firmware and lsi logic raidcontroller firmware did not help - disabling superpages does not help - disabling MCA does not help - although zfs scrub is part of a good way to reproduce the panic, we can also reproduce it with UFS, so zfs seems to be off the hook - best way to reproduce: put load on em (wget a large file) AND mpt (cp a large file, or run zpool scrub), panic within less than a minute - only putting load on em OR mpt does not reliably reproduce the panic - putting load on nfe and mpt does not reliably reproduce the panic - buildkernel with -j8 always runs through just fine - em and mpt sit on the same pci bus - so far, we couldn't reproduce the panic on CURRENT At this point we thought of a bug in either em, mpt or pci code, but weren't able to find anything in the svn commit logs that could explain what we were seeing. It's hard though to find something so unspecific... Out of despair, we tried to rule out the new usb stack. We kicked everything usb-related out of our kernel config, and with this usb-less kernel, the MCEs disappered! So, although the way to reproduce is to put load on load em and mpt, the real trigger seems to be usb, which gets no load at all. The only devices there are the iLOM virtual mouse and keyboard and we did not use the graphical remote console during our tests (iLOM serial console only). We tried to break this down further and learned: - not 100% sure, but loading the necessary usb modules (ohci, ehci, ukbd, ums) after boot (manually with kldload) seems fine, no panic so far when trying to reproduce like this - a kernel with only ohci, ukbd and ums compiled-in is fine - a kernel with only ehci compiled-in makes us able to reproduce the panic - so ehci being there on kernel boot seems to have some kind of relevance - we see no changes to the ehci code from 8.1 to CURRENT that could make the problem go away, so the cause could be elsewhere (pci code?) and ehci is just a trigger At this point we're stuck and need help from someone with more insight. The test system will be available for a while, so if you need us to run more tests, we're happy to do that. We maybe could also provide remote access to such a system if necessary. Although we have workaround now, that works for us, it would still be great to see this fixed. I guess we're not the only ones out there using X4100M2s with FreeBSD. About the test setup: - Sun X4100M2 - tested with 4 and 16 GB RAM - two PCIe nfe interfaces - two PCI-X em interfaces - one PCI-X mpt controller, non-raid mode, two disks (da), gpt-partioned, zfs mirror, boot from zfs - one OHCI controller with iLOM virtual keyboard and virtual mouse attached - one EHCI controller with nothing attached More information about the system below. Any help appreciated. Markus # uname -a FreeBSD XX.hostpoint.ch 8.1-RC2 FreeBSD 8.1-RC2 #4: Fri Jul 9 16:53:56 CEST 2010 root@XX.hostpoint.ch:/usr/obj/usr/src/sys/YY amd64 # cpuinfo Machine class: amd64 CPU Model: Dual-Core AMD Opteron(tm) Processor 2220 Number of CPUs: 4 # usbconfig ugen0.1: <OHCI root HUB nVidia> at usbus0, cfg=0 md=HOST spd=FULL (12Mbps) pwr=ON ugen1.1: <EHCI root HUB nVidia> at usbus1, cfg=0 md=HOST spd=HIGH (480Mbps) pwr=ON ugen0.2: <Virtual Keyboard and Mouse American Megatrends Inc.> at usbus0, cfg=0 md=HOST spd=FULL (12Mbps) pwr=ON # pciconf -lv none0@pci0:0:0:0: class=0x058000 card=0x00000000 chip=0x005e10de rev=0xa3 hdr=0x00 vendor = 'NVIDIA Corporation' device = 'nForce4 Memory Controller' class = memory isab0@pci0:0:1:0: class=0x060100 card=0xcb8410de chip=0x005110de rev=0xf3 hdr=0x00 vendor = 'NVIDIA Corporation' device = 'nForce4 ISA Bridge' class = bridge subclass = PCI-ISA none1@pci0:0:1:1: class=0x0c0500 card=0xcb8410de chip=0x005210de rev=0xa2 hdr=0x00 vendor = 'NVIDIA Corporation' device = 'nForce4 SMBus' class = serial bus subclass = SMBus ohci0@pci0:0:2:0: class=0x0c0310 card=0xcb84108e chip=0x005a10de rev=0xa2 hdr=0x00 vendor = 'NVIDIA Corporation' device = 'nForce4 USB Controller' class = serial bus subclass = USB ehci0@pci0:0:2:1: class=0x0c0320 card=0xcb84108e chip=0x005b10de rev=0xa3 hdr=0x00 vendor = 'NVIDIA Corporation' device = 'nForce4 USB 2.0 Controller' class = serial bus subclass = USB atapci0@pci0:0:6:0: class=0x01018a card=0xcb8410de chip=0x005310de rev=0xf2 hdr=0x00 vendor = 'NVIDIA Corporation' device = 'nForce4 Parallel ATA Controller' class = mass storage subclass = ATA pcib1@pci0:0:9:0: class=0x060401 card=0x00000000 chip=0x005c10de rev=0xf2 hdr=0x01 vendor = 'NVIDIA Corporation' device = 'nForce4 PCI Bridge' class = bridge subclass = PCI-PCI nfe0@pci0:0:10:0: class=0x068000 card=0xcb8410de chip=0x005710de rev=0xf3 hdr=0x00 vendor = 'NVIDIA Corporation' device = 'NVIDIA Network Bus Enumerator (CK804)' class = bridge pcib2@pci0:0:11:0: class=0x060400 card=0x00000000 chip=0x005d10de rev=0xf3 hdr=0x01 vendor = 'NVIDIA Corporation' device = 'nForce4 PCIe Bridge' class = bridge subclass = PCI-PCI pcib3@pci0:0:12:0: class=0x060400 card=0x00000000 chip=0x005d10de rev=0xf3 hdr=0x01 vendor = 'NVIDIA Corporation' device = 'nForce4 PCIe Bridge' class = bridge subclass = PCI-PCI pcib4@pci0:0:13:0: class=0x060400 card=0x00000000 chip=0x005d10de rev=0xf3 hdr=0x01 vendor = 'NVIDIA Corporation' device = 'nForce4 PCIe Bridge' class = bridge subclass = PCI-PCI pcib5@pci0:0:14:0: class=0x060400 card=0x00000000 chip=0x005d10de rev=0xa3 hdr=0x01 vendor = 'NVIDIA Corporation' device = 'nForce4 PCIe Bridge' class = bridge subclass = PCI-PCI hostb0@pci0:0:24:0: class=0x060000 card=0x00000000 chip=0x11001022 rev=0x00 hdr=0x00 vendor = 'Advanced Micro Devices (AMD)' device = 'Athlon64/Opteron/Sempron (K8 Family) HyperTransport Technology Configuration' class = bridge subclass = HOST-PCI hostb1@pci0:0:24:1: class=0x060000 card=0x00000000 chip=0x11011022 rev=0x00 hdr=0x00 vendor = 'Advanced Micro Devices (AMD)' device = 'Athlon64/Opteron/Sempron (K8 Family) Address Map' class = bridge subclass = HOST-PCI hostb2@pci0:0:24:2: class=0x060000 card=0x00000000 chip=0x11021022 rev=0x00 hdr=0x00 vendor = 'Advanced Micro Devices (AMD)' device = 'Athlon64/Opteron/Sempron (K8 Family) DRAM Controller' class = bridge subclass = HOST-PCI hostb3@pci0:0:24:3: class=0x060000 card=0x00000000 chip=0x11031022 rev=0x00 hdr=0x00 vendor = 'Advanced Micro Devices (AMD)' device = 'Athlon64/Opteron/Sempron (K8 Family) Miscellaneous Control' class = bridge subclass = HOST-PCI hostb4@pci0:0:25:0: class=0x060000 card=0x00000000 chip=0x11001022 rev=0x00 hdr=0x00 vendor = 'Advanced Micro Devices (AMD)' device = 'Athlon64/Opteron/Sempron (K8 Family) HyperTransport Technology Configuration' class = bridge subclass = HOST-PCI hostb5@pci0:0:25:1: class=0x060000 card=0x00000000 chip=0x11011022 rev=0x00 hdr=0x00 vendor = 'Advanced Micro Devices (AMD)' device = 'Athlon64/Opteron/Sempron (K8 Family) Address Map' class = bridge subclass = HOST-PCI hostb6@pci0:0:25:2: class=0x060000 card=0x00000000 chip=0x11021022 rev=0x00 hdr=0x00 vendor = 'Advanced Micro Devices (AMD)' device = 'Athlon64/Opteron/Sempron (K8 Family) DRAM Controller' class = bridge subclass = HOST-PCI hostb7@pci0:0:25:3: class=0x060000 card=0x00000000 chip=0x11031022 rev=0x00 hdr=0x00 vendor = 'Advanced Micro Devices (AMD)' device = 'Athlon64/Opteron/Sempron (K8 Family) Miscellaneous Control' class = bridge subclass = HOST-PCI vgapci0@pci0:1:3:0: class=0x030000 card=0x80081002 chip=0x47521002 rev=0x27 hdr=0x00 vendor = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.' device = 'ATI On-Board VGA for HP Proliant 350 G3 (Rage XL PCI)' class = display subclass = VGA none2@pci0:128:0:0: class=0x058000 card=0x00000000 chip=0x005e10de rev=0xa3 hdr=0x00 vendor = 'NVIDIA Corporation' device = 'nForce4 Memory Controller' class = memory none3@pci0:128:1:0: class=0x058000 card=0xcb8410de chip=0x00d310de rev=0xf3 hdr=0x00 vendor = 'NVIDIA Corporation' device = 'nForce4 Memory Controller' class = memory nfe1@pci0:128:10:0: class=0x068000 card=0xcb8410de chip=0x005710de rev=0xf3 hdr=0x00 vendor = 'NVIDIA Corporation' device = 'NVIDIA Network Bus Enumerator (CK804)' class = bridge pcib7@pci0:128:11:0: class=0x060400 card=0x00000000 chip=0x005d10de rev=0xf3 hdr=0x01 vendor = 'NVIDIA Corporation' device = 'nForce4 PCIe Bridge' class = bridge subclass = PCI-PCI pcib8@pci0:128:12:0: class=0x060400 card=0x00000000 chip=0x005d10de rev=0xf3 hdr=0x01 vendor = 'NVIDIA Corporation' device = 'nForce4 PCIe Bridge' class = bridge subclass = PCI-PCI pcib9@pci0:128:13:0: class=0x060400 card=0x00000000 chip=0x005d10de rev=0xf3 hdr=0x01 vendor = 'NVIDIA Corporation' device = 'nForce4 PCIe Bridge' class = bridge subclass = PCI-PCI pcib10@pci0:128:14:0: class=0x060400 card=0x00000000 chip=0x005d10de rev=0xa3 hdr=0x01 vendor = 'NVIDIA Corporation' device = 'nForce4 PCIe Bridge' class = bridge subclass = PCI-PCI pcib11@pci0:128:16:0: class=0x060400 card=0x00000000 chip=0x74581022 rev=0x12 hdr=0x01 vendor = 'Advanced Micro Devices (AMD)' device = 'PCI-X Bridge (AMD-8132)' class = bridge subclass = PCI-PCI ioapic0@pci0:128:16:1: class=0x080010 card=0x74591022 chip=0x74591022 rev=0x12 hdr=0x00 vendor = 'Advanced Micro Devices (AMD)' device = 'PCI-X IOAPIC (AMD-8132)' class = base peripheral subclass = interrupt controller pcib12@pci0:128:17:0: class=0x060400 card=0x00000000 chip=0x74581022 rev=0x12 hdr=0x01 vendor = 'Advanced Micro Devices (AMD)' device = 'PCI-X Bridge (AMD-8132)' class = bridge subclass = PCI-PCI ioapic1@pci0:128:17:1: class=0x080010 card=0x74591022 chip=0x74591022 rev=0x12 hdr=0x00 vendor = 'Advanced Micro Devices (AMD)' device = 'PCI-X IOAPIC (AMD-8132)' class = base peripheral subclass = interrupt controller em0@pci0:134:1:0: class=0x020000 card=0x10118086 chip=0x10108086 rev=0x03 hdr=0x00 vendor = 'Intel Corporation' device = 'Dual Port Gigabit Ethernet Controller (Copper) (82546EB)' class = network subclass = ethernet em1@pci0:134:1:1: class=0x020000 card=0x10118086 chip=0x10108086 rev=0x03 hdr=0x00 vendor = 'Intel Corporation' device = 'Dual Port Gigabit Ethernet Controller (Copper) (82546EB)' class = network subclass = ethernet mpt0@pci0:134:2:0: class=0x010000 card=0x30601000 chip=0x00501000 rev=0x02 hdr=0x00 vendor = 'LSI Logic (Was: Symbios Logic, NCR)' device = 'SAS 3000 series, 4-port with 1064 -StorPort' class = mass storage subclass = SCSI # cat /usr/src/sys/amd64/conf/YY include GENERIC ident YY options IPFIREWALL options IPFIREWALL_VERBOSE options IPFIREWALL_VERBOSE_LIMIT=5 options IPFIREWALL_DEFAULT_TO_ACCEPT options IPDIVERT options KDB # Enable kernel debugger support. options DDB # Support DDB. options GDB # Support remote GDB. options DEADLKRES # Enable the deadlock resolver options INVARIANTS # Enable calls of extra sanity checking options INVARIANT_SUPPORT # Extra sanity checks of internal structures, required by INVARIANTS options WITNESS # Enable checks to detect deadlocks and cycles options WITNESS_SKIPSPIN # Don't run witness on spinlocks for speed (other version with no usb or no ehci could be provided if necessary) verbose boot: GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb SMAP type=01 base=0000000000000000 len=000000000009bc00 SMAP type=02 base=000000000009bc00 len=0000000000004400 SMAP type=02 base=00000000000e6000 len=000000000001a000 SMAP type=01 base=0000000000100000 len=00000000dbea0000 SMAP type=01 base=00000000dbfae000 len=0000000000002000 SMAP type=03 base=00000000dbfb0000 len=000000000000e000 SMAP type=04 base=00000000dbfbe000 len=0000000000032000 SMAP type=02 base=00000000dbff0000 len=0000000000010000 SMAP type=02 base=00000000e0000000 len=0000000010000000 SMAP type=02 base=00000000fec00000 len=0000000000001000 SMAP type=02 base=00000000fee00000 len=0000000000001000 SMAP type=02 base=00000000ff700000 len=0000000000900000 SMAP type=01 base=0000000100000000 len=0000000324000000 Copyright (c) 1992-2010 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 8.1-RC2 #4: Fri Jul 9 16:53:56 CEST 2010 root@XX.hostpoint.ch:/usr/obj/usr/src/sys/YY amd64 WARNING: WITNESS option enabled, expect reduced performance. Preloaded elf kernel "/boot/kernel/kernel" at 0xffffffff81204000. Preloaded elf obj module "/boot/kernel/zfs.ko" at 0xffffffff81204250. Preloaded elf obj module "/boot/kernel/opensolaris.ko" at 0xffffffff812048f8. Preloaded /boot/zfs/zpool.cache "/boot/zfs/zpool.cache" at 0xffffffff81204f28. Timecounter "i8254" frequency 1193182 Hz quality 0 Calibrating TSC clock ... TSC clock: 2792595272 Hz CPU: Dual-Core AMD Opteron(tm) Processor 2220 (2792.60-MHz K8-class CPU) Origin = "AuthenticAMD" Id = 0x40f13 Family = f Model = 41 Stepping = 3 Features=0x178bfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2,HTT> Features2=0x2001<SSE3,CX16> AMD Features=0xea500800<SYSCALL,NX,MMX+,FFXSR,RDTSCP,LM,3DNow!+,3DNow!> AMD Features2=0x1f<LAHF,CMP,SVM,ExtAPIC,CR8> L1 2MB data TLB: 8 entries, fully associative L1 2MB instruction TLB: 8 entries, fully associative L1 4KB data TLB: 32 entries, fully associative L1 4KB instruction TLB: 32 entries, fully associative L1 data cache: 64 kbytes, 64 bytes/line, 1 lines/tag, 2-way associative L1 instruction cache: 64 kbytes, 64 bytes/line, 1 lines/tag, 2-way associative L2 2MB unified TLB: 0 entries, disabled/not present L2 4KB data TLB: 512 entries, 4-way associative L2 4KB instruction TLB: 512 entries, 4-way associative L2 unified cache: 1024 kbytes, 64 bytes/line, 1 lines/tag, 16-way associative real memory = 17179869184 (16384 MB) Physical memory chunk(s): 0x0000000000001000 - 0x0000000000097fff, 618496 bytes (151 pages) 0x000000000123f000 - 0x00000000dbf9ffff, 3671461888 bytes (896353 pages) 0x00000000dbfae000 - 0x00000000dbfaffff, 8192 bytes (2 pages) 0x0000000100000000 - 0x0000000404dd5fff, 12966518784 bytes (3165654 pages) avail memory = 16551731200 (15784 MB) ACPI APIC Table: <SUN X4200 M2> INTR: Adding local APIC 1 as a target INTR: Adding local APIC 2 as a target INTR: Adding local APIC 3 as a target FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs FreeBSD/SMP: 2 package(s) x 2 core(s) cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 1 cpu2 (AP): APIC ID: 2 cpu3 (AP): APIC ID: 3 x86bios: IVT 0x000000-0x0004ff at 0xffffff0000000000 x86bios: SSEG 0x010000-0x01ffff at 0xffffff800004a000 x86bios: EBDA 0x09b000-0x09ffff at 0xffffff000009b000 x86bios: ROM 0x0a0000-0x0effff at 0xffffff00000a0000 APIC: CPU 0 has ACPI ID 1 APIC: CPU 1 has ACPI ID 2 APIC: CPU 2 has ACPI ID 3 APIC: CPU 3 has ACPI ID 4 ULE: setup cpu 0 ULE: setup cpu 1 ULE: setup cpu 2 ULE: setup cpu 3 ACPI: RSDP 0xfa040 00024 (v2 SUN ) ACPI: XSDT 0xdbfb0100 00094 (v1 SUN X4200 M2 00000104 MSFT 00000097) ACPI: FACP 0xdbfb0290 000F4 (v3 SUN X4200 M2 00000104 MSFT 00000097) ACPI: DSDT 0xdbfb0510 0702A (v1 SUN X4200 M2 00000104 INTL 20050624) ACPI: FACS 0xdbfbe000 00040 ACPI: APIC 0xdbfb0390 000B0 (v1 SUN X4200 M2 00000104 MSFT 00000097) ACPI: SPCR 0xdbfb0440 00050 (v1 SUN X4200 M2 00000104 MSFT 00000097) ACPI: SLIT 0xdbfb0490 00030 (v1 SUN X4200 M2 00000104 MSFT 00000097) ACPI: SPMI 0xdbfb04c0 00041 (v5 SUN OEMSPMI 00000104 MSFT 00000097) ACPI: OEMB 0xdbfbe040 00063 (v1 SUN X4200 M2 00000104 MSFT 00000097) ACPI: SRAT 0xdbfb7540 00110 (v1 AMD FAM_F_10 00000002 AMD 00000001) ACPI: HPET 0xdbfb7650 00038 (v1 SUN OEMHPET0 00000104 MSFT 00000097) ACPI: IPET 0xdbfb7690 00038 (v1 SUN OEMHPET1 00000104 MSFT 00000097) ACPI: EINJ 0xdbfb76d0 00130 (v1 AMIER AMI_EINJ 04000909 MSFT 00000097) ACPI: BERT 0xdbfb7860 00030 (v1 AMIER AMI_BERT 04000909 MSFT 00000097) ACPI: ERST 0xdbfb7890 001B0 (v1 AMIER AMI_ERST 04000909 MSFT 00000097) ACPI: HEST 0xdbfb7a40 000A8 (v1 AMIER AMI_HEST 04000909 MSFT 00000097) ACPI: SSDT 0xdbfb7af0 00574 (v1 A M I POWERNOW 00000001 AMD 00000001) MADT: Found IO APIC ID 15, Interrupt 0 at 0xfec00000 ioapic0: Routing external 8259A's -> intpin 0 MADT: Found IO APIC ID 16, Interrupt 48 at 0xfeafd000 ioapic1: Changing APIC ID to 16 ioapic1: WARNING: intbase 48 != expected base 24 MADT: Found IO APIC ID 17, Interrupt 56 at 0xfeafc000 ioapic2: Changing APIC ID to 17 ioapic2: WARNING: intbase 56 != expected base 55 MADT: Found IO APIC ID 14, Interrupt 24 at 0xfeaff000 ioapic3: WARNING: intbase 24 != expected base 63 MADT: Interrupt override: source 0, irq 2 ioapic0: Routing IRQ 0 -> intpin 2 MADT: Interrupt override: source 9, irq 9 ioapic0: intpin 9 trigger: level ioapic3 <Version 1.1> irqs 24-47 on motherboard ioapic0 <Version 1.1> irqs 0-23 on motherboard ioapic1 <Version 1.1> irqs 48-54 on motherboard ioapic2 <Version 1.1> irqs 56-62 on motherboard cpu0 BSP: ID: 0x00000000 VER: 0x80050010 LDR: 0x00000000 DFR: 0xffffffff lint0: 0x00010700 lint1: 0x00000400 TPR: 0x00000000 SVR: 0x000001ff timer: 0x000100ef therm: 0x00010000 err: 0x000000f0 pmc: 0x00010400 wlan: <802.11 Link Layer> kbd: new array size 4 kbd1 at kbdmux0 mem: <memory> nfslock: pseudo-device null: <null device, zero device> random: <entropy source, Software, Yarrow> io: <I/O> hptrr: RocketRAID 17xx/2xxx SATA controller driver v1.2 acpi0: <SUN X4200 M2> on motherboard ioapic0: routing intpin 9 (ISA IRQ 9) to lapic 0 vector 48 acpi0: [MPSAFE] acpi0: [ITHREAD] ACPI: Executed 1 blocks of module-level executable AML code acpi0: Power Button (fixed) acpi0: wakeup code va 0xffffff8000031000 pa 0x4000 AcpiOsDerivePciId: \_SB_.PCI0.MAP0.CFG_ -> bus 0 dev 24 func 1 unknown: I/O range not supported AcpiOsDerivePciId: \_SB_.PCI0.SBRG.BAR0 -> bus 0 dev 1 func 0 AcpiOsDerivePciId: \_SB_.PCIB.IO84.BAR1 -> bus 128 dev 1 func 0 AcpiOsDerivePciId: \_SB_.PCIC.IO42.BAR2 -> bus 255 dev 1 func 0 acpi0: reservation of 0, a0000 (3) failed acpi0: reservation of 100000, dbf00000 (3) failed ACPI timer: 1/1 1/1 1/1 1/1 1/1 1/1 1/1 1/1 1/1 1/1 -> 10 Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x2008-0x200b on acpi0 cpu0: <ACPI CPU> on acpi0 cpu0: switching to generic Cx mode cpu1: <ACPI CPU> on acpi0 cpu2: <ACPI CPU> on acpi0 cpu3: <ACPI CPU> on acpi0 pci_link0: Index IRQ Rtd Ref IRQs Initial Probe 0 10 N 0 16 17 18 19 Validation 0 255 N 0 16 17 18 19 After Disable 0 255 N 0 16 17 18 19 pci_link1: Index IRQ Rtd Ref IRQs Initial Probe 0 6 N 0 16 17 18 19 Validation 0 255 N 0 16 17 18 19 After Disable 0 255 N 0 16 17 18 19 pci_link2: Index IRQ Rtd Ref IRQs Initial Probe 0 7 N 0 16 17 18 19 Validation 0 255 N 0 16 17 18 19 After Disable 0 255 N 0 16 17 18 19 pci_link3: Index IRQ Rtd Ref IRQs Initial Probe 0 255 N 0 16 17 18 19 Validation 0 255 N 0 16 17 18 19 After Disable 0 255 N 0 16 17 18 19 pci_link4: Index IRQ Rtd Ref IRQs Initial Probe 0 255 N 0 16 17 18 19 Validation 0 255 N 0 16 17 18 19 After Disable 0 255 N 0 16 17 18 19 pci_link5: Index IRQ Rtd Ref IRQs Initial Probe 0 11 N 0 20 21 22 Validation 0 255 N 0 20 21 22 After Disable 0 255 N 0 20 21 22 pci_link6: Index IRQ Rtd Ref IRQs Initial Probe 0 255 N 0 20 21 22 Validation 0 255 N 0 20 21 22 After Disable 0 255 N 0 20 21 22 pci_link7: Index IRQ Rtd Ref IRQs Initial Probe 0 5 N 0 20 21 22 Validation 0 255 N 0 20 21 22 After Disable 0 255 N 0 20 21 22 pci_link8: Index IRQ Rtd Ref IRQs Initial Probe 0 15 N 0 20 21 22 Validation 0 255 N 0 20 21 22 After Disable 0 255 N 0 20 21 22 pci_link9: Index IRQ Rtd Ref IRQs Initial Probe 0 255 N 0 20 21 22 Validation 0 255 N 0 20 21 22 After Disable 0 255 N 0 20 21 22 pci_link10: Index IRQ Rtd Ref IRQs Initial Probe 0 255 N 0 20 21 22 Validation 0 255 N 0 20 21 22 After Disable 0 255 N 0 20 21 22 pci_link11: Index IRQ Rtd Ref IRQs Initial Probe 0 255 N 0 20 21 22 Validation 0 255 N 0 20 21 22 After Disable 0 255 N 0 20 21 22 pci_link12: Index IRQ Rtd Ref IRQs Initial Probe 0 255 N 0 20 21 22 Validation 0 255 N 0 20 21 22 After Disable 0 255 N 0 20 21 22 pci_link13: Index IRQ Rtd Ref IRQs Initial Probe 0 255 N 0 20 21 22 Validation 0 255 N 0 20 21 22 After Disable 0 255 N 0 20 21 22 pci_link14: Index IRQ Rtd Ref IRQs Initial Probe 0 14 N 0 20 21 22 Validation 0 255 N 0 20 21 22 After Disable 0 255 N 0 20 21 22 pci_link15: Index IRQ Rtd Ref IRQs Initial Probe 0 10 N 0 40 41 42 43 Validation 0 255 N 0 40 41 42 43 After Disable 0 255 N 0 40 41 42 43 pci_link16: Index IRQ Rtd Ref IRQs Initial Probe 0 6 N 0 40 41 42 43 Validation 0 255 N 0 40 41 42 43 After Disable 0 255 N 0 40 41 42 43 pci_link17: Index IRQ Rtd Ref IRQs Initial Probe 0 7 N 0 40 41 42 43 Validation 0 255 N 0 40 41 42 43 After Disable 0 255 N 0 40 41 42 43 pci_link18: Index IRQ Rtd Ref IRQs Initial Probe 0 255 N 0 40 41 42 43 Validation 0 255 N 0 40 41 42 43 After Disable 0 255 N 0 40 41 42 43 pci_link19: Index IRQ Rtd Ref IRQs Initial Probe 0 15 N 0 40 41 42 43 Validation 0 255 N 0 40 41 42 43 After Disable 0 255 N 0 40 41 42 43 pci_link20: Index IRQ Rtd Ref IRQs Initial Probe 0 15 N 0 40 41 42 43 Validation 0 255 N 0 40 41 42 43 After Disable 0 255 N 0 40 41 42 43 pci_link21: Index IRQ Rtd Ref IRQs Initial Probe 0 15 N 0 40 41 42 43 Validation 0 255 N 0 40 41 42 43 After Disable 0 255 N 0 40 41 42 43 pci_link22: Index IRQ Rtd Ref IRQs Initial Probe 0 15 N 0 40 41 42 43 Validation 0 255 N 0 40 41 42 43 After Disable 0 255 N 0 40 41 42 43 pci_link23: Index IRQ Rtd Ref IRQs Initial Probe 0 7 N 0 44 45 46 47 Validation 0 255 N 0 44 45 46 47 After Disable 0 255 N 0 44 45 46 47 pci_link24: Index IRQ Rtd Ref IRQs Initial Probe 0 15 N 0 44 45 46 47 Validation 0 255 N 0 44 45 46 47 After Disable 0 255 N 0 44 45 46 47 pci_link25: Index IRQ Rtd Ref IRQs Initial Probe 0 255 N 0 44 45 46 47 Validation 0 255 N 0 44 45 46 47 After Disable 0 255 N 0 44 45 46 47 pci_link26: Index IRQ Rtd Ref IRQs Initial Probe 0 255 N 0 44 45 46 47 Validation 0 255 N 0 44 45 46 47 After Disable 0 255 N 0 44 45 46 47 acpi_hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0 acpi_hpet0: vend: 0x10de rev: 0x1 num: 3 hz: 25000000 opts: legacy_route Timecounter "HPET" frequency 25000000 Hz quality 900 pcib0: <ACPI Host-PCI bridge> on acpi0 pci0: <ACPI PCI bus> on pcib0 pci0: domain=0, physical bus=0 found-> vendor=0x10de, dev=0x005e, revid=0xa3 domain=0, bus=0, slot=0, func=0 class=05-80-00, hdrtype=0x00, mfdev=0 cmdreg=0x0106, statreg=0x00b0, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) found-> vendor=0x10de, dev=0x0051, revid=0xf3 domain=0, bus=0, slot=1, func=0 class=06-01-00, hdrtype=0x00, mfdev=1 cmdreg=0x000f, statreg=0x00a0, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) found-> vendor=0x10de, dev=0x0052, revid=0xa2 domain=0, bus=0, slot=1, func=1 class=0c-05-00, hdrtype=0x00, mfdev=1 cmdreg=0x0001, statreg=0x00b0, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x03 (750 ns), maxlat=0x01 (250 ns) intpin=a, irq=255 powerspec 2 supports D0 D3 current D0 map[10]: type I/O Port, range 32, base 0x9200, size 5, enabled map[20]: type I/O Port, range 32, base 0x400, size 6, enabled map[24]: type I/O Port, range 32, base 0x440, size 6, enabled found-> vendor=0x10de, dev=0x005a, revid=0xa2 domain=0, bus=0, slot=2, func=0 class=0c-03-10, hdrtype=0x00, mfdev=1 cmdreg=0x0007, statreg=0x00b0, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x03 (750 ns), maxlat=0x01 (250 ns) intpin=a, irq=11 powerspec 2 supports D0 D1 D2 D3 current D0 map[10]: type Memory, range 32, base 0xfe3ff000, size 12, enabled pcib0: matched entry for 0.2.INTA (src \_SB_.LUS0:0) pci_link5: Picked IRQ 20 with weight 0 pcib0: slot 2 INTA routed to irq 20 via \_SB_.LUS0 found-> vendor=0x10de, dev=0x005b, revid=0xa3 domain=0, bus=0, slot=2, func=1 class=0c-03-20, hdrtype=0x00, mfdev=1 cmdreg=0x0006, statreg=0x00b0, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x03 (750 ns), maxlat=0x01 (250 ns) intpin=b, irq=5 powerspec 2 supports D0 D1 D2 D3 current D0 map[10]: type Memory, range 32, base 0xfe3fec00, size 8, enabled pcib0: matched entry for 0.2.INTB (src \_SB_.LUS2:0) pci_link7: Picked IRQ 21 with weight 0 pcib0: slot 2 INTB routed to irq 21 via \_SB_.LUS2 found-> vendor=0x10de, dev=0x0053, revid=0xf2 domain=0, bus=0, slot=6, func=0 class=01-01-8a, hdrtype=0x00, mfdev=0 cmdreg=0x0005, statreg=0x00b0, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x03 (750 ns), maxlat=0x01 (250 ns) powerspec 2 supports D0 D3 current D0 map[20]: type I/O Port, range 32, base 0x9100, size 4, enabled found-> vendor=0x10de, dev=0x005c, revid=0xf2 domain=0, bus=0, slot=9, func=0 class=06-04-01, hdrtype=0x01, mfdev=0 cmdreg=0x0107, statreg=0x00a0, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x0b (2750 ns), maxlat=0x02 (500 ns) found-> vendor=0x10de, dev=0x0057, revid=0xf3 domain=0, bus=0, slot=10, func=0 class=06-80-00, hdrtype=0x00, mfdev=0 cmdreg=0x0007, statreg=0x00b0, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x01 (250 ns), maxlat=0x14 (5000 ns) intpin=a, irq=15 powerspec 2 supports D0 D1 D2 D3 current D0 map[10]: type Memory, range 32, base 0xfe3fd000, size 12, enabled map[14]: type I/O Port, range 32, base 0xdc00, size 3, enabled pcib0: matched entry for 0.10.INTA (src \_SB_.LKLN:0) pci_link8: Picked IRQ 22 with weight 0 pcib0: slot 10 INTA routed to irq 22 via \_SB_.LKLN found-> vendor=0x10de, dev=0x005d, revid=0xf3 domain=0, bus=0, slot=11, func=0 class=06-04-00, hdrtype=0x01, mfdev=0 cmdreg=0x0046, statreg=0x0010, cachelnsz=16 (dwords) lattimer=0x00 (0 ns), mingnt=0x07 (1750 ns), maxlat=0x00 (0 ns) powerspec 2 supports D0 D3 current D0 MSI supports 2 messages, 64 bit found-> vendor=0x10de, dev=0x005d, revid=0xf3 domain=0, bus=0, slot=12, func=0 class=06-04-00, hdrtype=0x01, mfdev=0 cmdreg=0x0046, statreg=0x0010, cachelnsz=16 (dwords) lattimer=0x00 (0 ns), mingnt=0x07 (1750 ns), maxlat=0x00 (0 ns) powerspec 2 supports D0 D3 current D0 MSI supports 2 messages, 64 bit found-> vendor=0x10de, dev=0x005d, revid=0xf3 domain=0, bus=0, slot=13, func=0 class=06-04-00, hdrtype=0x01, mfdev=0 cmdreg=0x0046, statreg=0x0010, cachelnsz=16 (dwords) lattimer=0x00 (0 ns), mingnt=0x07 (1750 ns), maxlat=0x00 (0 ns) powerspec 2 supports D0 D3 current D0 MSI supports 2 messages, 64 bit found-> vendor=0x10de, dev=0x005d, revid=0xa3 domain=0, bus=0, slot=14, func=0 class=06-04-00, hdrtype=0x01, mfdev=0 cmdreg=0x0046, statreg=0x0010, cachelnsz=16 (dwords) lattimer=0x00 (0 ns), mingnt=0x07 (1750 ns), maxlat=0x00 (0 ns) powerspec 2 supports D0 D3 current D0 MSI supports 2 messages, 64 bit found-> vendor=0x1022, dev=0x1100, revid=0x00 domain=0, bus=0, slot=24, func=0 class=06-00-00, hdrtype=0x00, mfdev=1 cmdreg=0x0000, statreg=0x0010, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) found-> vendor=0x1022, dev=0x1101, revid=0x00 domain=0, bus=0, slot=24, func=1 class=06-00-00, hdrtype=0x00, mfdev=1 cmdreg=0x0000, statreg=0x0000, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) found-> vendor=0x1022, dev=0x1102, revid=0x00 domain=0, bus=0, slot=24, func=2 class=06-00-00, hdrtype=0x00, mfdev=1 cmdreg=0x0000, statreg=0x0000, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) found-> vendor=0x1022, dev=0x1103, revid=0x00 domain=0, bus=0, slot=24, func=3 class=06-00-00, hdrtype=0x00, mfdev=1 cmdreg=0x0000, statreg=0x0010, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) found-> vendor=0x1022, dev=0x1100, revid=0x00 domain=0, bus=0, slot=25, func=0 class=06-00-00, hdrtype=0x00, mfdev=1 cmdreg=0x0000, statreg=0x0010, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) found-> vendor=0x1022, dev=0x1101, revid=0x00 domain=0, bus=0, slot=25, func=1 class=06-00-00, hdrtype=0x00, mfdev=1 cmdreg=0x0000, statreg=0x0000, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) found-> vendor=0x1022, dev=0x1102, revid=0x00 domain=0, bus=0, slot=25, func=2 class=06-00-00, hdrtype=0x00, mfdev=1 cmdreg=0x0000, statreg=0x0000, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) found-> vendor=0x1022, dev=0x1103, revid=0x00 domain=0, bus=0, slot=25, func=3 class=06-00-00, hdrtype=0x00, mfdev=1 cmdreg=0x0000, statreg=0x0010, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) pci0: <memory> at device 0.0 (no driver attached) isab0: <PCI-ISA bridge> at device 1.0 on pci0 isa0: <ISA bus> on isab0 pci0: <serial bus, SMBus> at device 1.1 (no driver attached) ohci0: <OHCI (generic) USB controller> mem 0xfe3ff000-0xfe3fffff irq 20 at device 2.0 on pci0 ohci0: Reserved 0x1000 bytes for rid 0x10 type 3 at 0xfe3ff000 ioapic0: routing intpin 20 (PCI IRQ 20) to lapic 0 vector 49 ohci0: [MPSAFE] ohci0: [ITHREAD] usbus0: <OHCI (generic) USB controller> on ohci0 ehci0: <NVIDIA nForce4 USB 2.0 controller> mem 0xfe3fec00-0xfe3fecff irq 21 at device 2.1 on pci0 ehci0: Reserved 0x100 bytes for rid 0x10 type 3 at 0xfe3fec00 ioapic0: routing intpin 21 (PCI IRQ 21) to lapic 0 vector 50 ehci0: [MPSAFE] ehci0: [ITHREAD] ehci0: Doorbell workaround enabled usbus1: EHCI version 1.0 usbus1: <NVIDIA nForce4 USB 2.0 controller> on ehci0 atapci0: <nVidia nForce CK804 UDMA133 controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x9100-0x910f at device 6.0 on pci0 atapci0: Reserved 0x10 bytes for rid 0x20 type 4 at 0x9100 ata0: <ATA channel 0> on atapci0 atapci0: Reserved 0x8 bytes for rid 0x10 type 4 at 0x1f0 atapci0: Reserved 0x1 bytes for rid 0x14 type 4 at 0x3f6 ata0: reset tp1 mask=03 ostat0=50 ostat1=00 ata0: stat0=0x00 err=0x01 lsb=0x14 msb=0xeb ata0: stat1=0x00 err=0x00 lsb=0x00 msb=0x00 ata0: reset tp2 stat0=00 stat1=00 devices=0x10000 ioapic0: routing intpin 14 (ISA IRQ 14) to lapic 0 vector 51 ata0: [MPSAFE] ata0: [ITHREAD] ata1: <ATA channel 1> on atapci0 atapci0: Reserved 0x8 bytes for rid 0x18 type 4 at 0x170 atapci0: Reserved 0x1 bytes for rid 0x1c type 4 at 0x376 ata1: reset tp1 mask=00 ostat0=ff ostat1=ff ioapic0: routing intpin 15 (ISA IRQ 15) to lapic 0 vector 52 ata1: [MPSAFE] ata1: [ITHREAD] pcib1: <ACPI PCI-PCI bridge> at device 9.0 on pci0 pcib1: domain 0 pcib1: secondary bus 1 pcib1: subordinate bus 1 pcib1: I/O decode 0xc000-0xcfff pcib1: memory decode 0xfc200000-0xfe2fffff pcib1: no prefetched decode pcib1: Subtractively decoded bridge. pci1: <ACPI PCI bus> on pcib1 pci1: domain=0, physical bus=1 found-> vendor=0x1002, dev=0x4752, revid=0x27 domain=0, bus=1, slot=3, func=0 class=03-00-00, hdrtype=0x00, mfdev=0 cmdreg=0x0087, statreg=0x0290, cachelnsz=16 (dwords) lattimer=0x40 (1920 ns), mingnt=0x08 (2000 ns), maxlat=0x00 (0 ns) intpin=a, irq=10 powerspec 2 supports D0 D1 D2 D3 current D0 map[10]: type Memory, range 32, base 0xfd000000, size 24, enabled pcib1: requested memory range 0xfd000000-0xfdffffff: good map[14]: type I/O Port, range 32, base 0xc800, size 8, enabled pcib1: requested I/O range 0xc800-0xc8ff: in range map[18]: type Memory, range 32, base 0xfe2ff000, size 12, enabled pcib1: requested memory range 0xfe2ff000-0xfe2fffff: good pcib1: matched entry for 1.3.INTA (src \_SB_.LNKA:0) pci_link0: Picked IRQ 16 with weight 0 pcib1: slot 3 INTA routed to irq 16 via \_SB_.LNKA vgapci0: <VGA-compatible display> port 0xc800-0xc8ff mem 0xfd000000-0xfdffffff,0xfe2ff000-0xfe2fffff irq 16 at device 3.0 on pci1 nfe0: <NVIDIA nForce4 CK804 MCP9 Networking Adapter> port 0xdc00-0xdc07 mem 0xfe3fd000-0xfe3fdfff irq 22 at device 10.0 on pci0 nfe0: Reserved 0x1000 bytes for rid 0x10 type 3 at 0xfe3fd000 miibus0: <MII bus> on nfe0 e1000phy0: <Marvell 88E1111 Gigabit PHY> PHY 1 on miibus0 e1000phy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseSX, 1000baseSX-FDX, 1000baseT, 1000baseT-FDX, auto nfe0: bpf attached nfe0: Ethernet address: 00:14:4f:8d:fe:ea ioapic0: routing intpin 22 (PCI IRQ 22) to lapic 0 vector 53 nfe0: [MPSAFE] nfe0: [FILTER] pcib2: <ACPI PCI-PCI bridge> at device 11.0 on pci0 pcib2: domain 0 pcib2: secondary bus 2 pcib2: subordinate bus 2 pcib2: I/O decode 0x0-0x0 pcib2: no prefetched decode pcib2: could not get PCI interrupt routing table for \_SB_.PCI0.P0P2 - AE_NOT_FOUND pci2: <ACPI PCI bus> on pcib2 pci2: domain=0, physical bus=2 pcib3: <ACPI PCI-PCI bridge> at device 12.0 on pci0 pcib3: domain 0 pcib3: secondary bus 3 pcib3: subordinate bus 3 pcib3: I/O decode 0x0-0x0 pcib3: no prefetched decode pcib3: could not get PCI interrupt routing table for \_SB_.PCI0.P0P3 - AE_NOT_FOUND pci3: <ACPI PCI bus> on pcib3 pci3: domain=0, physical bus=3 pcib4: <ACPI PCI-PCI bridge> at device 13.0 on pci0 pcib4: domain 0 pcib4: secondary bus 4 pcib4: subordinate bus 4 pcib4: I/O decode 0x0-0x0 pcib4: no prefetched decode pci4: <ACPI PCI bus> on pcib4 pci4: domain=0, physical bus=4 pcib5: <ACPI PCI-PCI bridge> at device 14.0 on pci0 pcib5: domain 0 pcib5: secondary bus 5 pcib5: subordinate bus 5 pcib5: I/O decode 0x0-0x0 pcib5: no prefetched decode pci5: <ACPI PCI bus> on pcib5 pci5: domain=0, physical bus=5 pcib6: <ACPI Host-PCI bridge> on acpi0 pci128: <ACPI PCI bus> on pcib6 pci128: domain=0, physical bus=128 found-> vendor=0x10de, dev=0x005e, revid=0xa3 domain=0, bus=128, slot=0, func=0 class=05-80-00, hdrtype=0x00, mfdev=0 cmdreg=0x0106, statreg=0x00b0, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) found-> vendor=0x10de, dev=0x00d3, revid=0xf3 domain=0, bus=128, slot=1, func=0 class=05-80-00, hdrtype=0x00, mfdev=1 cmdreg=0x000f, statreg=0x00a0, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) map[14]: type Memory, range 32, base 0xfeaff000, size 12, enabled found-> vendor=0x10de, dev=0x0057, revid=0xf3 domain=0, bus=128, slot=10, func=0 class=06-80-00, hdrtype=0x00, mfdev=0 cmdreg=0x0007, statreg=0x00b0, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x01 (250 ns), maxlat=0x14 (5000 ns) intpin=a, irq=7 powerspec 2 supports D0 D1 D2 D3 current D0 map[10]: type Memory, range 32, base 0xfeafe000, size 12, enabled map[14]: type I/O Port, range 32, base 0xfc00, size 3, enabled pcib6: matched entry for 128.10.INTA (src \_SB_.LK2N:0) pci_link23: Picked IRQ 44 with weight 0 pcib6: slot 10 INTA routed to irq 44 via \_SB_.LK2N found-> vendor=0x10de, dev=0x005d, revid=0xf3 domain=0, bus=128, slot=11, func=0 class=06-04-00, hdrtype=0x01, mfdev=0 cmdreg=0x0046, statreg=0x0010, cachelnsz=16 (dwords) lattimer=0x00 (0 ns), mingnt=0x07 (1750 ns), maxlat=0x00 (0 ns) powerspec 2 supports D0 D3 current D0 MSI supports 2 messages, 64 bit found-> vendor=0x10de, dev=0x005d, revid=0xf3 domain=0, bus=128, slot=12, func=0 class=06-04-00, hdrtype=0x01, mfdev=0 cmdreg=0x0046, statreg=0x0010, cachelnsz=16 (dwords) lattimer=0x00 (0 ns), mingnt=0x07 (1750 ns), maxlat=0x00 (0 ns) powerspec 2 supports D0 D3 current D0 MSI supports 2 messages, 64 bit found-> vendor=0x10de, dev=0x005d, revid=0xf3 domain=0, bus=128, slot=13, func=0 class=06-04-00, hdrtype=0x01, mfdev=0 cmdreg=0x0046, statreg=0x0010, cachelnsz=16 (dwords) lattimer=0x00 (0 ns), mingnt=0x07 (1750 ns), maxlat=0x00 (0 ns) powerspec 2 supports D0 D3 current D0 MSI supports 2 messages, 64 bit found-> vendor=0x10de, dev=0x005d, revid=0xa3 domain=0, bus=128, slot=14, func=0 class=06-04-00, hdrtype=0x01, mfdev=0 cmdreg=0x0046, statreg=0x0010, cachelnsz=16 (dwords) lattimer=0x00 (0 ns), mingnt=0x07 (1750 ns), maxlat=0x00 (0 ns) powerspec 2 supports D0 D3 current D0 MSI supports 2 messages, 64 bit found-> vendor=0x1022, dev=0x7458, revid=0x12 domain=0, bus=128, slot=16, func=0 class=06-04-00, hdrtype=0x01, mfdev=1 cmdreg=0x0156, statreg=0x0010, cachelnsz=16 (dwords) lattimer=0x40 (1920 ns), mingnt=0x07 (1750 ns), maxlat=0x00 (0 ns) found-> vendor=0x1022, dev=0x7459, revid=0x12 domain=0, bus=128, slot=16, func=1 class=08-00-10, hdrtype=0x00, mfdev=0 cmdreg=0x0006, statreg=0x0200, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) map[10]: type Memory, range 64, base 0xfeafd000, size 12, enabled found-> vendor=0x1022, dev=0x7458, revid=0x12 domain=0, bus=128, slot=17, func=0 class=06-04-00, hdrtype=0x01, mfdev=1 cmdreg=0x0157, statreg=0x0010, cachelnsz=16 (dwords) lattimer=0x40 (1920 ns), mingnt=0x07 (1750 ns), maxlat=0x00 (0 ns) found-> vendor=0x1022, dev=0x7459, revid=0x12 domain=0, bus=128, slot=17, func=1 class=08-00-10, hdrtype=0x00, mfdev=0 cmdreg=0x0006, statreg=0x0200, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) map[10]: type Memory, range 64, base 0xfeafc000, size 12, enabled pci128: <memory> at device 0.0 (no driver attached) pci128: <memory> at device 1.0 (no driver attached) nfe1: <NVIDIA nForce4 CK804 MCP9 Networking Adapter> port 0xfc00-0xfc07 mem 0xfeafe000-0xfeafefff irq 44 at device 10.0 on pci128 nfe1: Reserved 0x1000 bytes for rid 0x10 type 3 at 0xfeafe000 miibus1: <MII bus> on nfe1 e1000phy1: <Marvell 88E1111 Gigabit PHY> PHY 1 on miibus1 e1000phy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseSX, 1000baseSX-FDX, 1000baseT, 1000baseT-FDX, auto nfe1: bpf attached nfe1: Ethernet address: 00:14:4f:8d:fe:eb ioapic3: routing intpin 20 (PCI IRQ 44) to lapic 0 vector 54 nfe1: [MPSAFE] nfe1: [FILTER] pcib7: <ACPI PCI-PCI bridge> at device 11.0 on pci128 pcib7: domain 0 pcib7: secondary bus 129 pcib7: subordinate bus 129 pcib7: I/O decode 0x0-0x0 pcib7: no prefetched decode pcib7: could not get PCI interrupt routing table for \_SB_.PCIB.BR5B - AE_NOT_FOUND pci129: <ACPI PCI bus> on pcib7 pci129: domain=0, physical bus=129 pcib8: <ACPI PCI-PCI bridge> at device 12.0 on pci128 pcib8: domain 0 pcib8: secondary bus 130 pcib8: subordinate bus 130 pcib8: I/O decode 0x0-0x0 pcib8: no prefetched decode pcib8: could not get PCI interrupt routing table for \_SB_.PCIB.BR5C - AE_NOT_FOUND pci130: <ACPI PCI bus> on pcib8 pci130: domain=0, physical bus=130 pcib9: <ACPI PCI-PCI bridge> at device 13.0 on pci128 pcib9: domain 0 pcib9: secondary bus 131 pcib9: subordinate bus 131 pcib9: I/O decode 0x0-0x0 pcib9: no prefetched decode pci131: <ACPI PCI bus> on pcib9 pci131: domain=0, physical bus=131 pcib10: <ACPI PCI-PCI bridge> at device 14.0 on pci128 pcib10: domain 0 pcib10: secondary bus 132 pcib10: subordinate bus 132 pcib10: I/O decode 0x0-0x0 pcib10: no prefetched decode pci132: <ACPI PCI bus> on pcib10 pci132: domain=0, physical bus=132 pcib11: <ACPI PCI-PCI bridge> at device 16.0 on pci128 pcib11: domain 0 pcib11: secondary bus 133 pcib11: subordinate bus 133 pcib11: I/O decode 0x0-0x0 pcib11: no prefetched decode pci133: <ACPI PCI bus> on pcib11 pci133: domain=0, physical bus=133 pcib12: <ACPI PCI-PCI bridge> at device 17.0 on pci128 pcib12: domain 0 pcib12: secondary bus 134 pcib12: subordinate bus 134 pcib12: I/O decode 0xe000-0xefff pcib12: memory decode 0xfe500000-0xfe9fffff pcib12: no prefetched decode pci134: <ACPI PCI bus> on pcib12 pci134: domain=0, physical bus=134 found-> vendor=0x8086, dev=0x1010, revid=0x03 domain=0, bus=134, slot=1, func=0 class=02-00-00, hdrtype=0x00, mfdev=1 cmdreg=0x0157, statreg=0x0230, cachelnsz=16 (dwords) lattimer=0x40 (1920 ns), mingnt=0xff (63750 ns), maxlat=0x00 (0 ns) intpin=a, irq=10 powerspec 2 supports D0 D3 current D0 MSI supports 1 message, 64 bit map[10]: type Memory, range 64, base 0xfe9e0000, size 17, enabled pcib12: requested memory range 0xfe9e0000-0xfe9fffff: good map[20]: type I/O Port, range 32, base 0xec00, size 6, enabled pcib12: requested I/O range 0xec00-0xec3f: in range pcib12: matched entry for 134.1.INTA pcib12: slot 1 INTA hardwired to IRQ 56 found-> vendor=0x8086, dev=0x1010, revid=0x03 domain=0, bus=134, slot=1, func=1 class=02-00-00, hdrtype=0x00, mfdev=1 cmdreg=0x0157, statreg=0x0230, cachelnsz=16 (dwords) lattimer=0x40 (1920 ns), mingnt=0xff (63750 ns), maxlat=0x00 (0 ns) intpin=b, irq=6 powerspec 2 supports D0 D3 current D0 MSI supports 1 message, 64 bit map[10]: type Memory, range 64, base 0xfe9c0000, size 17, enabled pcib12: requested memory range 0xfe9c0000-0xfe9dffff: good map[20]: type I/O Port, range 32, base 0xe800, size 6, enabled pcib12: requested I/O range 0xe800-0xe83f: in range pcib12: matched entry for 134.1.INTB pcib12: slot 1 INTB hardwired to IRQ 57 found-> vendor=0x1000, dev=0x0050, revid=0x02 domain=0, bus=134, slot=2, func=0 class=01-00-00, hdrtype=0x00, mfdev=0 cmdreg=0x0157, statreg=0x0230, cachelnsz=16 (dwords) lattimer=0x48 (2160 ns), mingnt=0x40 (16000 ns), maxlat=0x0a (2500 ns) intpin=a, irq=7 powerspec 2 supports D0 D1 D2 D3 current D0 MSI supports 1 message, 64 bit MSI-X supports 1 message in map 0x14 map[10]: type I/O Port, range 32, base 0xe400, size 8, enabled pcib12: requested I/O range 0xe400-0xe4ff: in range map[14]: type Memory, range 64, base 0xfe9bc000, size 14, enabled pcib12: requested memory range 0xfe9bc000-0xfe9bffff: good map[1c]: type Memory, range 64, base 0xfe9a0000, size 16, enabled pcib12: requested memory range 0xfe9a0000-0xfe9affff: good pcib12: matched entry for 134.2.INTA pcib12: slot 2 INTA hardwired to IRQ 58 em0: <Intel(R) PRO/1000 Legacy Network Connection 1.0.1> port 0xec00-0xec3f mem 0xfe9e0000-0xfe9fffff irq 56 at device 1.0 on pci134 em0: Reserved 0x20000 bytes for rid 0x10 type 3 at 0xfe9e0000 em0: Reserved 0x40 bytes for rid 0x20 type 4 at 0xec00 ioapic2: routing intpin 0 (PCI IRQ 56) to lapic 0 vector 55 em0: [FILTER] em0: bpf attached em0: Ethernet address: 00:14:4f:8d:fe:ec em1: <Intel(R) PRO/1000 Legacy Network Connection 1.0.1> port 0xe800-0xe83f mem 0xfe9c0000-0xfe9dffff irq 57 at device 1.1 on pci134 em1: Reserved 0x20000 bytes for rid 0x10 type 3 at 0xfe9c0000 em1: Reserved 0x40 bytes for rid 0x20 type 4 at 0xe800 ioapic2: routing intpin 1 (PCI IRQ 57) to lapic 0 vector 56 em1: [FILTER] em1: bpf attached em1: Ethernet address: 00:14:4f:8d:fe:ed mpt0: <LSILogic SAS/SATA Adapter> port 0xe400-0xe4ff mem 0xfe9bc000-0xfe9bffff,0xfe9a0000-0xfe9affff irq 58 at device 2.0 on pci134 mpt0: Reserved 0x100 bytes for rid 0x10 type 4 at 0xe400 mpt0: Reserved 0x4000 bytes for rid 0x14 type 3 at 0xfe9bc000 ioapic2: routing intpin 2 (PCI IRQ 58) to lapic 0 vector 57 mpt0: [MPSAFE] mpt0: [ITHREAD] mpt0: MPI Version=1.5.20.0 mpt0: No Handlers For Any Event Notify Frames. Event 0xa (ACK not required). mpt0: No Handlers For Any Event Notify Frames. Event 0x16 (ACK not required). mpt0: No Handlers For Any Event Notify Frames. Event 0x16 (ACK not required). mpt0: No Handlers For Any Event Notify Frames. Event 0x16 (ACK not required). mpt0: No Handlers For Any Event Notify Frames. Event 0x12 (ACK not required). mpt0: No Handlers For Any Event Notify Frames. Event 0x16 (ACK not required). mpt0: No Handlers For Any Event Notify Frames. Event 0x16 (ACK not required). mpt0: No Handlers For Any Event Notify Frames. Event 0x12 (ACK not required). mpt0: No Handlers For Any Event Notify Frames. Event 0x16 (ACK not required). mpt0: No Handlers For Any Event Notify Frames. Event 0xf (ACK not required). mpt0: No Handlers For Any Event Notify Frames. Event 0xf (ACK not required). mpt0: Capabilities: ( RAID-0 RAID-1E RAID-1 ) mpt0: 0 Active Volumes (2 Max) mpt0: 0 Hidden Drive Members (14 Max) mpt0: No Handlers For Any Event Notify Frames. Event 0xa (ACK not required). acpi_button0: <Power Button> on acpi0 atrtc0: <AT realtime clock> port 0x70-0x71 irq 8 on acpi0 atrtc0: registered as a time-of-day clock (resolution 1000000us) uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 ioapic0: routing intpin 4 (ISA IRQ 4) to lapic 0 vector 58 uart0: [FILTER] uart0: fast interrupt uart0: console (9600,n,8,1) ex_isa_identify() ahc_isa_probe 0: ioport 0xc00 alloc failed ahc_isa_probe 13: ioport 0xdc00 alloc failed ahc_isa_probe 14: ioport 0xec00 alloc failed isa_probe_children: disabling PnP devices atrtc: atrtc0 already exists; skipping it sc: sc0 already exists; skipping it uart: uart0 already exists; skipping it isa_probe_children: probing non-PnP devices orm0: <ISA Option ROMs> at iomem 0xc0000-0xc9fff,0xca000-0xcb7ff,0xcb800-0xcc7ff,0xcc800-0xcd7ff,0xd3800-0xd47ff on isa0 sc0: <System console> at flags 0x100 on isa0 sc0: VGA <16 virtual consoles, flags=0x300> sc0: fb0, kbd1, terminal emulator: scteken (teken terminal) vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0 atkbd0: <AT Keyboard> irq 1 on atkbdc0 kbd0 at atkbd0 kbd0: atkbd0, generic (0), config:0x0, flags:0x3f0000 ioapic0: routing intpin 1 (ISA IRQ 1) to lapic 0 vector 59 atkbd0: [GIANT-LOCKED] atkbd0: [ITHREAD] psm0: current command byte:0065 kbdc: TEST_AUX_PORT status:0000 kbdc: RESET_AUX return code:00fe kbdc: RESET_AUX return code:00fe kbdc: RESET_AUX return code:00fe kbdc: DIAGNOSE status:0055 kbdc: TEST_KBD_PORT status:0000 psm0: failed to reset the aux device. fdc0 failed to probe at port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on isa0 ppc0: cannot reserve I/O port range ppc0: <Parallel port> failed to probe at irq 7 on isa0 uart1: <ns8250> failed to probe at port 0x2f8-0x2ff irq 3 on isa0 isa_probe_children: probing PnP devices powernow0: <PowerNow! K8> on cpu0 powernow1: <PowerNow! K8> on cpu1 powernow2: <PowerNow! K8> on cpu2 powernow3: <PowerNow! K8> on cpu3 Device configuration finished. Reducing kern.maxvnodes 1031944 -> 100000 procfs registered ZFS filesystem version 3 ZFS storage pool version 14 lapic: Divisor 2, Frequency 99735545 Hz Timecounter "TSC" frequency 2792595272 Hz quality -100 Timecounters tick every 1.000 msec vlan: initialized, using hash tables with chaining ipfw2 (+ipv6) initialized, divert enabled, nat loadable, rule-based forwarding disabled, default to accept, logging disabled ipfw0: bpf attached lo0: bpf attached hptrr: no controller detected. ata0: Identifying devices: 00010000 ata0: New devices: 00010000 usbus0: 12Mbps Full Speed USB v1.0 usbus1: 480Mbps High Speed USB v2.0 ata0-master: pio=PIO4 wdma=WDMA2 udma=UDMA33 cable=40 wire acd0: setting UDMA33 ugen0.1: <nVidia> at usbus0 uhub0: <nVidia OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus0 ugen1.1: <nVidia> at usbus1 uhub1: <nVidia EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus1 acd0: <DW-224SL-R/1.0A> CDRW drive at ata0 as master acd0: read 4134KB/s (4134KB/s) write 4134KB/s (4134KB/s), 1654KB buffer, UDMA33 acd0: Reads: CDR, CDRW, CDDA stream, DVDROM, DVDR, DVDRAM, packet acd0: Writes: CDR, CDRW, test write acd0: Audio: play, 256 volume levels acd0: Mechanism: ejectable caddy, unlocked acd0: Medium: no/blank disc ata1: Identifying devices: 00000000 ata1: New devices: 00000000 uhub0: 7 ports with 7 removable, self powered uhub1: 7 ports with 7 removable, self powered (probe71:mpt0:1:8:0): Error 22, Unretryable error (probe72:mpt0:1:9:0): Error 22, Unretryable error (probe73:mpt0:1:10:0): Error 22, Unretryable error (probe74:mpt0:1:11:0): Error 22, Unretryable error (probe75:mpt0:1:12:0): Error 22, Unretryable error (probe76:mpt0:1:13:0): Error 22, Unretryable error (probe63:mpt0:1:0:0): Error 22, Unretryable error (probe64:mpt0:1:1:0): Error 22, Unretryable error (probe65:mpt0:1:2:0): Error 22, Unretryable error (probe66:mpt0:1:3:0): Error 22, Unretryable error (probe67:mpt0:1:4:0): Error 22, Unretryable error (probe68:mpt0:1:5:0): Error 22, Unretryable error (probe69:mpt0:1:6:0): Error 22, Unretryable error (probe70:mpt0:1:7:0): Error 22, Unretryable error pass0 at mpt0 bus 0 scbus0 target 2 lun 0 pass0: <SEAGATE ST973402SSUN72G 0400> Fixed Direct Access SCSI-5 device pass0: Serial Number 18216LAX 3NP16LAX pass0: 300.000MB/s transfers pass0: Command Queueing enabled da0 at mpt0 bus 0 scbus0 target 2 lun 0 da0: <SEAGATE ST973402SSUN72G 0400> Fixed Direct Access SCSI-5 device da0: Serial Number 18216LAX 3NP16LAX da0: 300.000MB/s transfers da0: Command Queueing enabled da0: 70007MB (143374738 512 byte sectors: 255H 63S/T 8924C) da1 at mpt0 bus 0 scbus0 target 3 lun 0 da1: <SEAGATE ST973402SSUN72G 0400> Fixed Direct Access SCSI-5 device da1: Serial Number 16216D68 3NP16D68 da1: 300.000MB/s transfers da1: Command Queueing enabled da1: 70007MB (143374738 512 byte sectors: 255H 63S/T 8924C) GEOM: new disk da0 GEOM: new disk da1 pass1 at mpt0 bus 0 scbus0 target 3 lun 0 pass1: <SEAGATE ST973402SSUN72G 0400> Fixed Direct Access SCSI-5 device pass1: Serial Number 16216D68 3NP16D68 pass1: 300.000MB/s transfers pass1: Command Queueing enabled ATA PseudoRAID loaded SMP: AP CPU #1 Launched! cpu1 AP: ID: 0x01000000 VER: 0x80050010 LDR: 0x00000000 DFR: 0xffffffff lint0: 0x00010700 lint1: 0x00000400 TPR: 0x00000000 SVR: 0x000001ff timer: 0x000200ef therm: 0x00010000 err: 0x000000f0 pmc: 0x00010400 SMP: AP CPU #3 Launched! cpu3 AP: ID: 0x03000000 VER: 0x80050010 LDR: 0x00000000 DFR: 0xffffffff lint0: 0x00010700 lint1: 0x00000400 TPR: 0x00000000 SVR: 0x000001ff timer: 0x000200ef therm: 0x00010000 err: 0x000000f0 pmc: 0x00010400 SMP: AP CPU #2 Launched! cpu2 AP: ID: 0x02000000 VER: 0x80050010 LDR: 0x00000000 DFR: 0xffffffff lint0: 0x00010700 lint1: 0x00000400 TPR: 0x00000000 SVR: 0x000001ff timer: 0x000200ef therm: 0x00010000 err: 0x000000f0 pmc: 0x00010400 (folaopwitca0b:l er oculteiannge ri nsttpairnt e4d ISA IRQ 4) to lapic 1 vector 48 ioapic0: routing intpin 9 (ISA IRQ 9) to lapic 2 vector 48 ioapic0: routing intpin 14 (ISA IRQ 14) to lapic 3 vector 48 ioapic0: routing intpin 20 (PCI IRQ 20) to lapic 1 vector 49 ioapic0: routing intpin 21 (PCI IRQ 21) to lapic 2 vector 49 ioapic0: routing intpin 22 (PCI IRQ 22) to lapic 3 vector 49 ioapic2: routing intpin 0 (PCI IRQ 56) to lapic 1 vector 50 ioapic2: routing intpin 1 (PCI IRQ 57) to lapic 2 vector 50 ioapic2: routing intpin 2 (PCI IRQ 58) to lapic 3 vector 50 WARNING: WITNESS option enabled, expect reduced performance. Trying to mount root from zfs:zroot
Jeremy Chadwick
2010-Jul-09 15:57 UTC
8.1-RC2 - PCI fatal error or MCE triggered by USB/ehci on Sun X4100M2?
On Fri, Jul 09, 2010 at 05:26:00PM +0200, Markus Gebert wrote:> # pciconf -lvCan you re-run this with "-lvc" instead? Thanks. Also "vmstat -i" would be useful. That's all I can think of off the top of my head. -- | Jeremy Chadwick jdc@parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, USA | | Making life hard for others since 1977. PGP: 4BD6C0CB |
John Baldwin
2010-Jul-09 20:03 UTC
8.1-RC2 - PCI fatal error or MCE triggered by USB/ehci on Sun X4100M2?
On Friday, July 09, 2010 11:26:00 am Markus Gebert wrote:> -- > MCA: Bank 4, Status 0xb400004000030c2b > MCA: Global Cap 0x0000000000000105, Status 0x0000000000000007 > MCA: Vendor "AuthenticAMD", ID 0x40f13, APIC ID 2 > MCA: CPU 2 UNCOR BUSLG Observer WR I/O > MCA: Address 0xfd00000000Using my local port of mcelog this is what I get for this check: CPU 2 4 northbridge ADDR fd00000000 Northbridge Master abort link number = 4 bit61 = error uncorrected bus error 'local node observed, request didn't time out generic write mem transaction i/o access, level generic' STATUS b400004000030c2b MCGSTATUS 7 MCGCAP 105 APICID 2 SOCKETID 0 CPUID Vendor AMD Family 15 Model 65 I don't know what to tell you off hand. Did you buy this hardware from Sun directly? If so, I would try bugging them about this, especially given the error that the BIOS is logging. It does sound like a hardware issue, but in the chipset, not in the RAM, so you might need to swap out the main board rather than the RAM. I'm curious if disabling USB legacy support in the BIOS causes it to still die even with ehci not loaded. If so, then the SMI# for the ehci controller must somehow prevent the issue, perhaps by triggering frequently enough to slow the rate of I/O requests down? -- John Baldwin
Adam McDougall
2010-Jul-12 15:43 UTC
8.1-RC2 - PCI fatal error or MCE triggered by USB/ehci on Sun X4100M2?
I also get MCE on x4100m2 when causing significant disk activity in mpt while also downloading through em0 or em1. I was not able to trigger it while using nfe, however nfe locked up on me during normal DNS server traffic so that was a wash. What seemed to work for me was to add an Intel PCIE nic to the server and use it instead of the onboard NICS. For whatever reason I never experienced this problem until using ZFS. I triggered it by downloading a 200m tgz file via http repeatedly over gigabit and it would reliably crash within a minute or two. I ordered a dozen nics for probably around $20 each and was satisfied with this workaround given the age of the servers. I'm pinched on time for work so I often don't get around to reporting issues where I've found a workaround, I'm glad you can get that started. On Fri, Jul 09, 2010 at 05:26:00PM +0200, Markus Gebert wrote: Hi Summary: With FreeBSD 8.1-RC2 we get an MCE (fatal trap 28) on a Sun X4100M2 when putting load on mpt and em. Initially thinking of a hardware problem, and after many tests, we're able to avoid the panic by not compiling the usb stack into the kernel. We cannot reproduce the problem on 6.x, 7.x or, as it seems right now, even CURRENT. long story: We're in the process of testing FreeBSD 8.1-RC2 for future deployment on our servers. When testing on a Sun X4100M2 we have encountered strange behavior: Under medium load, the test machine would reboot itself (hardware-triggered) without panic and spit out errors like "hypertransport sync flood error on last boot" during POST (or complain about fatal PCI errors). Thinking our test machine could have bad hardware, we replaced RAM, which didn't help. We've also put the same load on a second X4100M2, getting the same results. Both test machines had been in production before, happily running 6.4. We have at least 35 X4100M2 running on 6.4 in production, and another 15 running on 7.2, all of them not showing this problem at all. So we started thinking this problem could be software-related or at least triggered by software. After altering a BIOS setting to not reboot in case of a hypertransport flood, we finally managed to get an MCE reported by MCA and a fatal trap 28: -- MCA: Bank 4, Status 0xb400004000030c2b MCA: Global Cap 0x0000000000000105, Status 0x0000000000000007 MCA: Vendor "AuthenticAMD", ID 0x40f13, APIC ID 2 MCA: CPU 2 UNCOR BUSLG Observer WR I/O MCA: Address 0xfd00000000 Fatal trap 28: machine check trap while in kernel mode cpuid = 2; apic id = 02 instruction pointer = 0x20:0xffffffff80876506 stack pointer = 0x28:0xffffff800004ab50 frame pointer = 0x28:0xffffff800004ab60 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags = interrupt enabled, IOPL = 0 current process = 11 (idle: cpu2) trap number = 28 panic: machine check trap cpuid = 2 Uptime: 3m9s -- Still, this may suggest a hardware problem. A 8.1 kernel with debug options didn't bring any more information. When WITNESS kicked in, it seemed random and to be symptom rather than cause. The same goes for DDB backtraces, random and most probably worthless. I guess that's expected with this kind of panic. So we fell back on trial&error and ruling out stuff that is new in FreeBSD 8. What we've learned so far: - we cannot reproduce with 6.x, 7.x - upgrading system firmware and lsi logic raidcontroller firmware did not help - disabling superpages does not help - disabling MCA does not help - although zfs scrub is part of a good way to reproduce the panic, we can also reproduce it with UFS, so zfs seems to be off the hook - best way to reproduce: put load on em (wget a large file) AND mpt (cp a large file, or run zpool scrub), panic within less than a minute - only putting load on em OR mpt does not reliably reproduce the panic - putting load on nfe and mpt does not reliably reproduce the panic - buildkernel with -j8 always runs through just fine - em and mpt sit on the same pci bus - so far, we couldn't reproduce the panic on CURRENT At this point we thought of a bug in either em, mpt or pci code, but weren't able to find anything in the svn commit logs that could explain what we were seeing. It's hard though to find something so unspecific... Out of despair, we tried to rule out the new usb stack. We kicked everything usb-related out of our kernel config, and with this usb-less kernel, the MCEs disappered! So, although the way to reproduce is to put load on load em and mpt, the real trigger seems to be usb, which gets no load at all. The only devices there are the iLOM virtual mouse and keyboard and we did not use the graphical remote console during our tests (iLOM serial console only). We tried to break this down further and learned: - not 100% sure, but loading the necessary usb modules (ohci, ehci, ukbd, ums) after boot (manually with kldload) seems fine, no panic so far when trying to reproduce like this - a kernel with only ohci, ukbd and ums compiled-in is fine - a kernel with only ehci compiled-in makes us able to reproduce the panic - so ehci being there on kernel boot seems to have some kind of relevance - we see no changes to the ehci code from 8.1 to CURRENT that could make the problem go away, so the cause could be elsewhere (pci code?) and ehci is just a trigger At this point we're stuck and need help from someone with more insight. The test system will be available for a while, so if you need us to run more tests, we're happy to do that. We maybe could also provide remote access to such a system if necessary. Although we have workaround now, that works for us, it would still be great to see this fixed. I guess we're not the only ones out there using X4100M2s with FreeBSD. About the test setup: - Sun X4100M2 - tested with 4 and 16 GB RAM - two PCIe nfe interfaces - two PCI-X em interfaces - one PCI-X mpt controller, non-raid mode, two disks (da), gpt-partioned, zfs mirror, boot from zfs - one OHCI controller with iLOM virtual keyboard and virtual mouse attached - one EHCI controller with nothing attached More information about the system below. Any help appreciated. Markus # uname -a FreeBSD XX.hostpoint.ch 8.1-RC2 FreeBSD 8.1-RC2 #4: Fri Jul 9 16:53:56 CEST 2010 root@XX.hostpoint.ch:/usr/obj/usr/src/sys/YY amd64 # cpuinfo Machine class: amd64 CPU Model: Dual-Core AMD Opteron(tm) Processor 2220 Number of CPUs: 4 # usbconfig ugen0.1: <OHCI root HUB nVidia> at usbus0, cfg=0 md=HOST spd=FULL (12Mbps) pwr=ON ugen1.1: <EHCI root HUB nVidia> at usbus1, cfg=0 md=HOST spd=HIGH (480Mbps) pwr=ON ugen0.2: <Virtual Keyboard and Mouse American Megatrends Inc.> at usbus0, cfg=0 md=HOST spd=FULL (12Mbps) pwr=ON # pciconf -lv none0@pci0:0:0:0: class=0x058000 card=0x00000000 chip=0x005e10de rev=0xa3 hdr=0x00 vendor = 'NVIDIA Corporation' device = 'nForce4 Memory Controller' class = memory isab0@pci0:0:1:0: class=0x060100 card=0xcb8410de chip=0x005110de rev=0xf3 hdr=0x00 vendor = 'NVIDIA Corporation' device = 'nForce4 ISA Bridge' class = bridge subclass = PCI-ISA none1@pci0:0:1:1: class=0x0c0500 card=0xcb8410de chip=0x005210de rev=0xa2 hdr=0x00 vendor = 'NVIDIA Corporation' device = 'nForce4 SMBus' class = serial bus subclass = SMBus ohci0@pci0:0:2:0: class=0x0c0310 card=0xcb84108e chip=0x005a10de rev=0xa2 hdr=0x00 vendor = 'NVIDIA Corporation' device = 'nForce4 USB Controller' class = serial bus subclass = USB ehci0@pci0:0:2:1: class=0x0c0320 card=0xcb84108e chip=0x005b10de rev=0xa3 hdr=0x00 vendor = 'NVIDIA Corporation' device = 'nForce4 USB 2.0 Controller' class = serial bus subclass = USB atapci0@pci0:0:6:0: class=0x01018a card=0xcb8410de chip=0x005310de rev=0xf2 hdr=0x00 vendor = 'NVIDIA Corporation' device = 'nForce4 Parallel ATA Controller' class = mass storage subclass = ATA pcib1@pci0:0:9:0: class=0x060401 card=0x00000000 chip=0x005c10de rev=0xf2 hdr=0x01 vendor = 'NVIDIA Corporation' device = 'nForce4 PCI Bridge' class = bridge subclass = PCI-PCI nfe0@pci0:0:10:0: class=0x068000 card=0xcb8410de chip=0x005710de rev=0xf3 hdr=0x00 vendor = 'NVIDIA Corporation' device = 'NVIDIA Network Bus Enumerator (CK804)' class = bridge pcib2@pci0:0:11:0: class=0x060400 card=0x00000000 chip=0x005d10de rev=0xf3 hdr=0x01 vendor = 'NVIDIA Corporation' device = 'nForce4 PCIe Bridge' class = bridge subclass = PCI-PCI pcib3@pci0:0:12:0: class=0x060400 card=0x00000000 chip=0x005d10de rev=0xf3 hdr=0x01 vendor = 'NVIDIA Corporation' device = 'nForce4 PCIe Bridge' class = bridge subclass = PCI-PCI pcib4@pci0:0:13:0: class=0x060400 card=0x00000000 chip=0x005d10de rev=0xf3 hdr=0x01 vendor = 'NVIDIA Corporation' device = 'nForce4 PCIe Bridge' class = bridge subclass = PCI-PCI pcib5@pci0:0:14:0: class=0x060400 card=0x00000000 chip=0x005d10de rev=0xa3 hdr=0x01 vendor = 'NVIDIA Corporation' device = 'nForce4 PCIe Bridge' class = bridge subclass = PCI-PCI hostb0@pci0:0:24:0: class=0x060000 card=0x00000000 chip=0x11001022 rev=0x00 hdr=0x00 vendor = 'Advanced Micro Devices (AMD)' device = 'Athlon64/Opteron/Sempron (K8 Family) HyperTransport Technology Configuration' class = bridge subclass = HOST-PCI hostb1@pci0:0:24:1: class=0x060000 card=0x00000000 chip=0x11011022 rev=0x00 hdr=0x00 vendor = 'Advanced Micro Devices (AMD)' device = 'Athlon64/Opteron/Sempron (K8 Family) Address Map' class = bridge subclass = HOST-PCI hostb2@pci0:0:24:2: class=0x060000 card=0x00000000 chip=0x11021022 rev=0x00 hdr=0x00 vendor = 'Advanced Micro Devices (AMD)' device = 'Athlon64/Opteron/Sempron (K8 Family) DRAM Controller' class = bridge subclass = HOST-PCI hostb3@pci0:0:24:3: class=0x060000 card=0x00000000 chip=0x11031022 rev=0x00 hdr=0x00 vendor = 'Advanced Micro Devices (AMD)' device = 'Athlon64/Opteron/Sempron (K8 Family) Miscellaneous Control' class = bridge subclass = HOST-PCI hostb4@pci0:0:25:0: class=0x060000 card=0x00000000 chip=0x11001022 rev=0x00 hdr=0x00 vendor = 'Advanced Micro Devices (AMD)' device = 'Athlon64/Opteron/Sempron (K8 Family) HyperTransport Technology Configuration' class = bridge subclass = HOST-PCI hostb5@pci0:0:25:1: class=0x060000 card=0x00000000 chip=0x11011022 rev=0x00 hdr=0x00 vendor = 'Advanced Micro Devices (AMD)' device = 'Athlon64/Opteron/Sempron (K8 Family) Address Map' class = bridge subclass = HOST-PCI hostb6@pci0:0:25:2: class=0x060000 card=0x00000000 chip=0x11021022 rev=0x00 hdr=0x00 vendor = 'Advanced Micro Devices (AMD)' device = 'Athlon64/Opteron/Sempron (K8 Family) DRAM Controller' class = bridge subclass = HOST-PCI hostb7@pci0:0:25:3: class=0x060000 card=0x00000000 chip=0x11031022 rev=0x00 hdr=0x00 vendor = 'Advanced Micro Devices (AMD)' device = 'Athlon64/Opteron/Sempron (K8 Family) Miscellaneous Control' class = bridge subclass = HOST-PCI vgapci0@pci0:1:3:0: class=0x030000 card=0x80081002 chip=0x47521002 rev=0x27 hdr=0x00 vendor = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.' device = 'ATI On-Board VGA for HP Proliant 350 G3 (Rage XL PCI)' class = display subclass = VGA none2@pci0:128:0:0: class=0x058000 card=0x00000000 chip=0x005e10de rev=0xa3 hdr=0x00 vendor = 'NVIDIA Corporation' device = 'nForce4 Memory Controller' class = memory none3@pci0:128:1:0: class=0x058000 card=0xcb8410de chip=0x00d310de rev=0xf3 hdr=0x00 vendor = 'NVIDIA Corporation' device = 'nForce4 Memory Controller' class = memory nfe1@pci0:128:10:0: class=0x068000 card=0xcb8410de chip=0x005710de rev=0xf3 hdr=0x00 vendor = 'NVIDIA Corporation' device = 'NVIDIA Network Bus Enumerator (CK804)' class = bridge pcib7@pci0:128:11:0: class=0x060400 card=0x00000000 chip=0x005d10de rev=0xf3 hdr=0x01 vendor = 'NVIDIA Corporation' device = 'nForce4 PCIe Bridge' class = bridge subclass = PCI-PCI pcib8@pci0:128:12:0: class=0x060400 card=0x00000000 chip=0x005d10de rev=0xf3 hdr=0x01 vendor = 'NVIDIA Corporation' device = 'nForce4 PCIe Bridge' class = bridge subclass = PCI-PCI pcib9@pci0:128:13:0: class=0x060400 card=0x00000000 chip=0x005d10de rev=0xf3 hdr=0x01 vendor = 'NVIDIA Corporation' device = 'nForce4 PCIe Bridge' class = bridge subclass = PCI-PCI pcib10@pci0:128:14:0: class=0x060400 card=0x00000000 chip=0x005d10de rev=0xa3 hdr=0x01 vendor = 'NVIDIA Corporation' device = 'nForce4 PCIe Bridge' class = bridge subclass = PCI-PCI pcib11@pci0:128:16:0: class=0x060400 card=0x00000000 chip=0x74581022 rev=0x12 hdr=0x01 vendor = 'Advanced Micro Devices (AMD)' device = 'PCI-X Bridge (AMD-8132)' class = bridge subclass = PCI-PCI ioapic0@pci0:128:16:1: class=0x080010 card=0x74591022 chip=0x74591022 rev=0x12 hdr=0x00 vendor = 'Advanced Micro Devices (AMD)' device = 'PCI-X IOAPIC (AMD-8132)' class = base peripheral subclass = interrupt controller pcib12@pci0:128:17:0: class=0x060400 card=0x00000000 chip=0x74581022 rev=0x12 hdr=0x01 vendor = 'Advanced Micro Devices (AMD)' device = 'PCI-X Bridge (AMD-8132)' class = bridge subclass = PCI-PCI ioapic1@pci0:128:17:1: class=0x080010 card=0x74591022 chip=0x74591022 rev=0x12 hdr=0x00 vendor = 'Advanced Micro Devices (AMD)' device = 'PCI-X IOAPIC (AMD-8132)' class = base peripheral subclass = interrupt controller em0@pci0:134:1:0: class=0x020000 card=0x10118086 chip=0x10108086 rev=0x03 hdr=0x00 vendor = 'Intel Corporation' device = 'Dual Port Gigabit Ethernet Controller (Copper) (82546EB)' class = network subclass = ethernet em1@pci0:134:1:1: class=0x020000 card=0x10118086 chip=0x10108086 rev=0x03 hdr=0x00 vendor = 'Intel Corporation' device = 'Dual Port Gigabit Ethernet Controller (Copper) (82546EB)' class = network subclass = ethernet mpt0@pci0:134:2:0: class=0x010000 card=0x30601000 chip=0x00501000 rev=0x02 hdr=0x00 vendor = 'LSI Logic (Was: Symbios Logic, NCR)' device = 'SAS 3000 series, 4-port with 1064 -StorPort' class = mass storage subclass = SCSI # cat /usr/src/sys/amd64/conf/YY include GENERIC ident YY options IPFIREWALL options IPFIREWALL_VERBOSE options IPFIREWALL_VERBOSE_LIMIT=5 options IPFIREWALL_DEFAULT_TO_ACCEPT options IPDIVERT options KDB # Enable kernel debugger support. options DDB # Support DDB. options GDB # Support remote GDB. options DEADLKRES # Enable the deadlock resolver options INVARIANTS # Enable calls of extra sanity checking options INVARIANT_SUPPORT # Extra sanity checks of internal structures, required by INVARIANTS options WITNESS # Enable checks to detect deadlocks and cycles options WITNESS_SKIPSPIN # Don't run witness on spinlocks for speed (other version with no usb or no ehci could be provided if necessary) verbose boot: GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb SMAP type=01 base=0000000000000000 len=000000000009bc00 SMAP type=02 base=000000000009bc00 len=0000000000004400 SMAP type=02 base=00000000000e6000 len=000000000001a000 SMAP type=01 base=0000000000100000 len=00000000dbea0000 SMAP type=01 base=00000000dbfae000 len=0000000000002000 SMAP type=03 base=00000000dbfb0000 len=000000000000e000 SMAP type=04 base=00000000dbfbe000 len=0000000000032000 SMAP type=02 base=00000000dbff0000 len=0000000000010000 SMAP type=02 base=00000000e0000000 len=0000000010000000 SMAP type=02 base=00000000fec00000 len=0000000000001000 SMAP type=02 base=00000000fee00000 len=0000000000001000 SMAP type=02 base=00000000ff700000 len=0000000000900000 SMAP type=01 base=0000000100000000 len=0000000324000000 Copyright (c) 1992-2010 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 8.1-RC2 #4: Fri Jul 9 16:53:56 CEST 2010 root@XX.hostpoint.ch:/usr/obj/usr/src/sys/YY amd64 WARNING: WITNESS option enabled, expect reduced performance. Preloaded elf kernel "/boot/kernel/kernel" at 0xffffffff81204000. Preloaded elf obj module "/boot/kernel/zfs.ko" at 0xffffffff81204250. Preloaded elf obj module "/boot/kernel/opensolaris.ko" at 0xffffffff812048f8. Preloaded /boot/zfs/zpool.cache "/boot/zfs/zpool.cache" at 0xffffffff81204f28. Timecounter "i8254" frequency 1193182 Hz quality 0 Calibrating TSC clock ... TSC clock: 2792595272 Hz CPU: Dual-Core AMD Opteron(tm) Processor 2220 (2792.60-MHz K8-class CPU) Origin = "AuthenticAMD" Id = 0x40f13 Family = f Model = 41 Stepping = 3 Features=0x178bfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2,HTT> Features2=0x2001<SSE3,CX16> AMD Features=0xea500800<SYSCALL,NX,MMX+,FFXSR,RDTSCP,LM,3DNow!+,3DNow!> AMD Features2=0x1f<LAHF,CMP,SVM,ExtAPIC,CR8> L1 2MB data TLB: 8 entries, fully associative L1 2MB instruction TLB: 8 entries, fully associative L1 4KB data TLB: 32 entries, fully associative L1 4KB instruction TLB: 32 entries, fully associative L1 data cache: 64 kbytes, 64 bytes/line, 1 lines/tag, 2-way associative L1 instruction cache: 64 kbytes, 64 bytes/line, 1 lines/tag, 2-way associative L2 2MB unified TLB: 0 entries, disabled/not present L2 4KB data TLB: 512 entries, 4-way associative L2 4KB instruction TLB: 512 entries, 4-way associative L2 unified cache: 1024 kbytes, 64 bytes/line, 1 lines/tag, 16-way associative real memory = 17179869184 (16384 MB) Physical memory chunk(s): 0x0000000000001000 - 0x0000000000097fff, 618496 bytes (151 pages) 0x000000000123f000 - 0x00000000dbf9ffff, 3671461888 bytes (896353 pages) 0x00000000dbfae000 - 0x00000000dbfaffff, 8192 bytes (2 pages) 0x0000000100000000 - 0x0000000404dd5fff, 12966518784 bytes (3165654 pages) avail memory = 16551731200 (15784 MB) ACPI APIC Table: <SUN X4200 M2> INTR: Adding local APIC 1 as a target INTR: Adding local APIC 2 as a target INTR: Adding local APIC 3 as a target FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs FreeBSD/SMP: 2 package(s) x 2 core(s) cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 1 cpu2 (AP): APIC ID: 2 cpu3 (AP): APIC ID: 3 x86bios: IVT 0x000000-0x0004ff at 0xffffff0000000000 x86bios: SSEG 0x010000-0x01ffff at 0xffffff800004a000 x86bios: EBDA 0x09b000-0x09ffff at 0xffffff000009b000 x86bios: ROM 0x0a0000-0x0effff at 0xffffff00000a0000 APIC: CPU 0 has ACPI ID 1 APIC: CPU 1 has ACPI ID 2 APIC: CPU 2 has ACPI ID 3 APIC: CPU 3 has ACPI ID 4 ULE: setup cpu 0 ULE: setup cpu 1 ULE: setup cpu 2 ULE: setup cpu 3 ACPI: RSDP 0xfa040 00024 (v2 SUN ) ACPI: XSDT 0xdbfb0100 00094 (v1 SUN X4200 M2 00000104 MSFT 00000097) ACPI: FACP 0xdbfb0290 000F4 (v3 SUN X4200 M2 00000104 MSFT 00000097) ACPI: DSDT 0xdbfb0510 0702A (v1 SUN X4200 M2 00000104 INTL 20050624) ACPI: FACS 0xdbfbe000 00040 ACPI: APIC 0xdbfb0390 000B0 (v1 SUN X4200 M2 00000104 MSFT 00000097) ACPI: SPCR 0xdbfb0440 00050 (v1 SUN X4200 M2 00000104 MSFT 00000097) ACPI: SLIT 0xdbfb0490 00030 (v1 SUN X4200 M2 00000104 MSFT 00000097) ACPI: SPMI 0xdbfb04c0 00041 (v5 SUN OEMSPMI 00000104 MSFT 00000097) ACPI: OEMB 0xdbfbe040 00063 (v1 SUN X4200 M2 00000104 MSFT 00000097) ACPI: SRAT 0xdbfb7540 00110 (v1 AMD FAM_F_10 00000002 AMD 00000001) ACPI: HPET 0xdbfb7650 00038 (v1 SUN OEMHPET0 00000104 MSFT 00000097) ACPI: IPET 0xdbfb7690 00038 (v1 SUN OEMHPET1 00000104 MSFT 00000097) ACPI: EINJ 0xdbfb76d0 00130 (v1 AMIER AMI_EINJ 04000909 MSFT 00000097) ACPI: BERT 0xdbfb7860 00030 (v1 AMIER AMI_BERT 04000909 MSFT 00000097) ACPI: ERST 0xdbfb7890 001B0 (v1 AMIER AMI_ERST 04000909 MSFT 00000097) ACPI: HEST 0xdbfb7a40 000A8 (v1 AMIER AMI_HEST 04000909 MSFT 00000097) ACPI: SSDT 0xdbfb7af0 00574 (v1 A M I POWERNOW 00000001 AMD 00000001) MADT: Found IO APIC ID 15, Interrupt 0 at 0xfec00000 ioapic0: Routing external 8259A's -> intpin 0 MADT: Found IO APIC ID 16, Interrupt 48 at 0xfeafd000 ioapic1: Changing APIC ID to 16 ioapic1: WARNING: intbase 48 != expected base 24 MADT: Found IO APIC ID 17, Interrupt 56 at 0xfeafc000 ioapic2: Changing APIC ID to 17 ioapic2: WARNING: intbase 56 != expected base 55 MADT: Found IO APIC ID 14, Interrupt 24 at 0xfeaff000 ioapic3: WARNING: intbase 24 != expected base 63 MADT: Interrupt override: source 0, irq 2 ioapic0: Routing IRQ 0 -> intpin 2 MADT: Interrupt override: source 9, irq 9 ioapic0: intpin 9 trigger: level ioapic3 <Version 1.1> irqs 24-47 on motherboard ioapic0 <Version 1.1> irqs 0-23 on motherboard ioapic1 <Version 1.1> irqs 48-54 on motherboard ioapic2 <Version 1.1> irqs 56-62 on motherboard cpu0 BSP: ID: 0x00000000 VER: 0x80050010 LDR: 0x00000000 DFR: 0xffffffff lint0: 0x00010700 lint1: 0x00000400 TPR: 0x00000000 SVR: 0x000001ff timer: 0x000100ef therm: 0x00010000 err: 0x000000f0 pmc: 0x00010400 wlan: <802.11 Link Layer> kbd: new array size 4 kbd1 at kbdmux0 mem: <memory> nfslock: pseudo-device null: <null device, zero device> random: <entropy source, Software, Yarrow> io: <I/O> hptrr: RocketRAID 17xx/2xxx SATA controller driver v1.2 acpi0: <SUN X4200 M2> on motherboard ioapic0: routing intpin 9 (ISA IRQ 9) to lapic 0 vector 48 acpi0: [MPSAFE] acpi0: [ITHREAD] ACPI: Executed 1 blocks of module-level executable AML code acpi0: Power Button (fixed) acpi0: wakeup code va 0xffffff8000031000 pa 0x4000 AcpiOsDerivePciId: \_SB_.PCI0.MAP0.CFG_ -> bus 0 dev 24 func 1 unknown: I/O range not supported AcpiOsDerivePciId: \_SB_.PCI0.SBRG.BAR0 -> bus 0 dev 1 func 0 AcpiOsDerivePciId: \_SB_.PCIB.IO84.BAR1 -> bus 128 dev 1 func 0 AcpiOsDerivePciId: \_SB_.PCIC.IO42.BAR2 -> bus 255 dev 1 func 0 acpi0: reservation of 0, a0000 (3) failed acpi0: reservation of 100000, dbf00000 (3) failed ACPI timer: 1/1 1/1 1/1 1/1 1/1 1/1 1/1 1/1 1/1 1/1 -> 10 Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x2008-0x200b on acpi0 cpu0: <ACPI CPU> on acpi0 cpu0: switching to generic Cx mode cpu1: <ACPI CPU> on acpi0 cpu2: <ACPI CPU> on acpi0 cpu3: <ACPI CPU> on acpi0 pci_link0: Index IRQ Rtd Ref IRQs Initial Probe 0 10 N 0 16 17 18 19 Validation 0 255 N 0 16 17 18 19 After Disable 0 255 N 0 16 17 18 19 pci_link1: Index IRQ Rtd Ref IRQs Initial Probe 0 6 N 0 16 17 18 19 Validation 0 255 N 0 16 17 18 19 After Disable 0 255 N 0 16 17 18 19 pci_link2: Index IRQ Rtd Ref IRQs Initial Probe 0 7 N 0 16 17 18 19 Validation 0 255 N 0 16 17 18 19 After Disable 0 255 N 0 16 17 18 19 pci_link3: Index IRQ Rtd Ref IRQs Initial Probe 0 255 N 0 16 17 18 19 Validation 0 255 N 0 16 17 18 19 After Disable 0 255 N 0 16 17 18 19 pci_link4: Index IRQ Rtd Ref IRQs Initial Probe 0 255 N 0 16 17 18 19 Validation 0 255 N 0 16 17 18 19 After Disable 0 255 N 0 16 17 18 19 pci_link5: Index IRQ Rtd Ref IRQs Initial Probe 0 11 N 0 20 21 22 Validation 0 255 N 0 20 21 22 After Disable 0 255 N 0 20 21 22 pci_link6: Index IRQ Rtd Ref IRQs Initial Probe 0 255 N 0 20 21 22 Validation 0 255 N 0 20 21 22 After Disable 0 255 N 0 20 21 22 pci_link7: Index IRQ Rtd Ref IRQs Initial Probe 0 5 N 0 20 21 22 Validation 0 255 N 0 20 21 22 After Disable 0 255 N 0 20 21 22 pci_link8: Index IRQ Rtd Ref IRQs Initial Probe 0 15 N 0 20 21 22 Validation 0 255 N 0 20 21 22 After Disable 0 255 N 0 20 21 22 pci_link9: Index IRQ Rtd Ref IRQs Initial Probe 0 255 N 0 20 21 22 Validation 0 255 N 0 20 21 22 After Disable 0 255 N 0 20 21 22 pci_link10: Index IRQ Rtd Ref IRQs Initial Probe 0 255 N 0 20 21 22 Validation 0 255 N 0 20 21 22 After Disable 0 255 N 0 20 21 22 pci_link11: Index IRQ Rtd Ref IRQs Initial Probe 0 255 N 0 20 21 22 Validation 0 255 N 0 20 21 22 After Disable 0 255 N 0 20 21 22 pci_link12: Index IRQ Rtd Ref IRQs Initial Probe 0 255 N 0 20 21 22 Validation 0 255 N 0 20 21 22 After Disable 0 255 N 0 20 21 22 pci_link13: Index IRQ Rtd Ref IRQs Initial Probe 0 255 N 0 20 21 22 Validation 0 255 N 0 20 21 22 After Disable 0 255 N 0 20 21 22 pci_link14: Index IRQ Rtd Ref IRQs Initial Probe 0 14 N 0 20 21 22 Validation 0 255 N 0 20 21 22 After Disable 0 255 N 0 20 21 22 pci_link15: Index IRQ Rtd Ref IRQs Initial Probe 0 10 N 0 40 41 42 43 Validation 0 255 N 0 40 41 42 43 After Disable 0 255 N 0 40 41 42 43 pci_link16: Index IRQ Rtd Ref IRQs Initial Probe 0 6 N 0 40 41 42 43 Validation 0 255 N 0 40 41 42 43 After Disable 0 255 N 0 40 41 42 43 pci_link17: Index IRQ Rtd Ref IRQs Initial Probe 0 7 N 0 40 41 42 43 Validation 0 255 N 0 40 41 42 43 After Disable 0 255 N 0 40 41 42 43 pci_link18: Index IRQ Rtd Ref IRQs Initial Probe 0 255 N 0 40 41 42 43 Validation 0 255 N 0 40 41 42 43 After Disable 0 255 N 0 40 41 42 43 pci_link19: Index IRQ Rtd Ref IRQs Initial Probe 0 15 N 0 40 41 42 43 Validation 0 255 N 0 40 41 42 43 After Disable 0 255 N 0 40 41 42 43 pci_link20: Index IRQ Rtd Ref IRQs Initial Probe 0 15 N 0 40 41 42 43 Validation 0 255 N 0 40 41 42 43 After Disable 0 255 N 0 40 41 42 43 pci_link21: Index IRQ Rtd Ref IRQs Initial Probe 0 15 N 0 40 41 42 43 Validation 0 255 N 0 40 41 42 43 After Disable 0 255 N 0 40 41 42 43 pci_link22: Index IRQ Rtd Ref IRQs Initial Probe 0 15 N 0 40 41 42 43 Validation 0 255 N 0 40 41 42 43 After Disable 0 255 N 0 40 41 42 43 pci_link23: Index IRQ Rtd Ref IRQs Initial Probe 0 7 N 0 44 45 46 47 Validation 0 255 N 0 44 45 46 47 After Disable 0 255 N 0 44 45 46 47 pci_link24: Index IRQ Rtd Ref IRQs Initial Probe 0 15 N 0 44 45 46 47 Validation 0 255 N 0 44 45 46 47 After Disable 0 255 N 0 44 45 46 47 pci_link25: Index IRQ Rtd Ref IRQs Initial Probe 0 255 N 0 44 45 46 47 Validation 0 255 N 0 44 45 46 47 After Disable 0 255 N 0 44 45 46 47 pci_link26: Index IRQ Rtd Ref IRQs Initial Probe 0 255 N 0 44 45 46 47 Validation 0 255 N 0 44 45 46 47 After Disable 0 255 N 0 44 45 46 47 acpi_hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0 acpi_hpet0: vend: 0x10de rev: 0x1 num: 3 hz: 25000000 opts: legacy_route Timecounter "HPET" frequency 25000000 Hz quality 900 pcib0: <ACPI Host-PCI bridge> on acpi0 pci0: <ACPI PCI bus> on pcib0 pci0: domain=0, physical bus=0 found-> vendor=0x10de, dev=0x005e, revid=0xa3 domain=0, bus=0, slot=0, func=0 class=05-80-00, hdrtype=0x00, mfdev=0 cmdreg=0x0106, statreg=0x00b0, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) found-> vendor=0x10de, dev=0x0051, revid=0xf3 domain=0, bus=0, slot=1, func=0 class=06-01-00, hdrtype=0x00, mfdev=1 cmdreg=0x000f, statreg=0x00a0, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) found-> vendor=0x10de, dev=0x0052, revid=0xa2 domain=0, bus=0, slot=1, func=1 class=0c-05-00, hdrtype=0x00, mfdev=1 cmdreg=0x0001, statreg=0x00b0, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x03 (750 ns), maxlat=0x01 (250 ns) intpin=a, irq=255 powerspec 2 supports D0 D3 current D0 map[10]: type I/O Port, range 32, base 0x9200, size 5, enabled map[20]: type I/O Port, range 32, base 0x400, size 6, enabled map[24]: type I/O Port, range 32, base 0x440, size 6, enabled found-> vendor=0x10de, dev=0x005a, revid=0xa2 domain=0, bus=0, slot=2, func=0 class=0c-03-10, hdrtype=0x00, mfdev=1 cmdreg=0x0007, statreg=0x00b0, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x03 (750 ns), maxlat=0x01 (250 ns) intpin=a, irq=11 powerspec 2 supports D0 D1 D2 D3 current D0 map[10]: type Memory, range 32, base 0xfe3ff000, size 12, enabled pcib0: matched entry for 0.2.INTA (src \_SB_.LUS0:0) pci_link5: Picked IRQ 20 with weight 0 pcib0: slot 2 INTA routed to irq 20 via \_SB_.LUS0 found-> vendor=0x10de, dev=0x005b, revid=0xa3 domain=0, bus=0, slot=2, func=1 class=0c-03-20, hdrtype=0x00, mfdev=1 cmdreg=0x0006, statreg=0x00b0, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x03 (750 ns), maxlat=0x01 (250 ns) intpin=b, irq=5 powerspec 2 supports D0 D1 D2 D3 current D0 map[10]: type Memory, range 32, base 0xfe3fec00, size 8, enabled pcib0: matched entry for 0.2.INTB (src \_SB_.LUS2:0) pci_link7: Picked IRQ 21 with weight 0 pcib0: slot 2 INTB routed to irq 21 via \_SB_.LUS2 found-> vendor=0x10de, dev=0x0053, revid=0xf2 domain=0, bus=0, slot=6, func=0 class=01-01-8a, hdrtype=0x00, mfdev=0 cmdreg=0x0005, statreg=0x00b0, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x03 (750 ns), maxlat=0x01 (250 ns) powerspec 2 supports D0 D3 current D0 map[20]: type I/O Port, range 32, base 0x9100, size 4, enabled found-> vendor=0x10de, dev=0x005c, revid=0xf2 domain=0, bus=0, slot=9, func=0 class=06-04-01, hdrtype=0x01, mfdev=0 cmdreg=0x0107, statreg=0x00a0, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x0b (2750 ns), maxlat=0x02 (500 ns) found-> vendor=0x10de, dev=0x0057, revid=0xf3 domain=0, bus=0, slot=10, func=0 class=06-80-00, hdrtype=0x00, mfdev=0 cmdreg=0x0007, statreg=0x00b0, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x01 (250 ns), maxlat=0x14 (5000 ns) intpin=a, irq=15 powerspec 2 supports D0 D1 D2 D3 current D0 map[10]: type Memory, range 32, base 0xfe3fd000, size 12, enabled map[14]: type I/O Port, range 32, base 0xdc00, size 3, enabled pcib0: matched entry for 0.10.INTA (src \_SB_.LKLN:0) pci_link8: Picked IRQ 22 with weight 0 pcib0: slot 10 INTA routed to irq 22 via \_SB_.LKLN found-> vendor=0x10de, dev=0x005d, revid=0xf3 domain=0, bus=0, slot=11, func=0 class=06-04-00, hdrtype=0x01, mfdev=0 cmdreg=0x0046, statreg=0x0010, cachelnsz=16 (dwords) lattimer=0x00 (0 ns), mingnt=0x07 (1750 ns), maxlat=0x00 (0 ns) powerspec 2 supports D0 D3 current D0 MSI supports 2 messages, 64 bit found-> vendor=0x10de, dev=0x005d, revid=0xf3 domain=0, bus=0, slot=12, func=0 class=06-04-00, hdrtype=0x01, mfdev=0 cmdreg=0x0046, statreg=0x0010, cachelnsz=16 (dwords) lattimer=0x00 (0 ns), mingnt=0x07 (1750 ns), maxlat=0x00 (0 ns) powerspec 2 supports D0 D3 current D0 MSI supports 2 messages, 64 bit found-> vendor=0x10de, dev=0x005d, revid=0xf3 domain=0, bus=0, slot=13, func=0 class=06-04-00, hdrtype=0x01, mfdev=0 cmdreg=0x0046, statreg=0x0010, cachelnsz=16 (dwords) lattimer=0x00 (0 ns), mingnt=0x07 (1750 ns), maxlat=0x00 (0 ns) powerspec 2 supports D0 D3 current D0 MSI supports 2 messages, 64 bit found-> vendor=0x10de, dev=0x005d, revid=0xa3 domain=0, bus=0, slot=14, func=0 class=06-04-00, hdrtype=0x01, mfdev=0 cmdreg=0x0046, statreg=0x0010, cachelnsz=16 (dwords) lattimer=0x00 (0 ns), mingnt=0x07 (1750 ns), maxlat=0x00 (0 ns) powerspec 2 supports D0 D3 current D0 MSI supports 2 messages, 64 bit found-> vendor=0x1022, dev=0x1100, revid=0x00 domain=0, bus=0, slot=24, func=0 class=06-00-00, hdrtype=0x00, mfdev=1 cmdreg=0x0000, statreg=0x0010, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) found-> vendor=0x1022, dev=0x1101, revid=0x00 domain=0, bus=0, slot=24, func=1 class=06-00-00, hdrtype=0x00, mfdev=1 cmdreg=0x0000, statreg=0x0000, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) found-> vendor=0x1022, dev=0x1102, revid=0x00 domain=0, bus=0, slot=24, func=2 class=06-00-00, hdrtype=0x00, mfdev=1 cmdreg=0x0000, statreg=0x0000, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) found-> vendor=0x1022, dev=0x1103, revid=0x00 domain=0, bus=0, slot=24, func=3 class=06-00-00, hdrtype=0x00, mfdev=1 cmdreg=0x0000, statreg=0x0010, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) found-> vendor=0x1022, dev=0x1100, revid=0x00 domain=0, bus=0, slot=25, func=0 class=06-00-00, hdrtype=0x00, mfdev=1 cmdreg=0x0000, statreg=0x0010, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) found-> vendor=0x1022, dev=0x1101, revid=0x00 domain=0, bus=0, slot=25, func=1 class=06-00-00, hdrtype=0x00, mfdev=1 cmdreg=0x0000, statreg=0x0000, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) found-> vendor=0x1022, dev=0x1102, revid=0x00 domain=0, bus=0, slot=25, func=2 class=06-00-00, hdrtype=0x00, mfdev=1 cmdreg=0x0000, statreg=0x0000, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) found-> vendor=0x1022, dev=0x1103, revid=0x00 domain=0, bus=0, slot=25, func=3 class=06-00-00, hdrtype=0x00, mfdev=1 cmdreg=0x0000, statreg=0x0010, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) pci0: <memory> at device 0.0 (no driver attached) isab0: <PCI-ISA bridge> at device 1.0 on pci0 isa0: <ISA bus> on isab0 pci0: <serial bus, SMBus> at device 1.1 (no driver attached) ohci0: <OHCI (generic) USB controller> mem 0xfe3ff000-0xfe3fffff irq 20 at device 2.0 on pci0 ohci0: Reserved 0x1000 bytes for rid 0x10 type 3 at 0xfe3ff000 ioapic0: routing intpin 20 (PCI IRQ 20) to lapic 0 vector 49 ohci0: [MPSAFE] ohci0: [ITHREAD] usbus0: <OHCI (generic) USB controller> on ohci0 ehci0: <NVIDIA nForce4 USB 2.0 controller> mem 0xfe3fec00-0xfe3fecff irq 21 at device 2.1 on pci0 ehci0: Reserved 0x100 bytes for rid 0x10 type 3 at 0xfe3fec00 ioapic0: routing intpin 21 (PCI IRQ 21) to lapic 0 vector 50 ehci0: [MPSAFE] ehci0: [ITHREAD] ehci0: Doorbell workaround enabled usbus1: EHCI version 1.0 usbus1: <NVIDIA nForce4 USB 2.0 controller> on ehci0 atapci0: <nVidia nForce CK804 UDMA133 controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x9100-0x910f at device 6.0 on pci0 atapci0: Reserved 0x10 bytes for rid 0x20 type 4 at 0x9100 ata0: <ATA channel 0> on atapci0 atapci0: Reserved 0x8 bytes for rid 0x10 type 4 at 0x1f0 atapci0: Reserved 0x1 bytes for rid 0x14 type 4 at 0x3f6 ata0: reset tp1 mask=03 ostat0=50 ostat1=00 ata0: stat0=0x00 err=0x01 lsb=0x14 msb=0xeb ata0: stat1=0x00 err=0x00 lsb=0x00 msb=0x00 ata0: reset tp2 stat0=00 stat1=00 devices=0x10000 ioapic0: routing intpin 14 (ISA IRQ 14) to lapic 0 vector 51 ata0: [MPSAFE] ata0: [ITHREAD] ata1: <ATA channel 1> on atapci0 atapci0: Reserved 0x8 bytes for rid 0x18 type 4 at 0x170 atapci0: Reserved 0x1 bytes for rid 0x1c type 4 at 0x376 ata1: reset tp1 mask=00 ostat0=ff ostat1=ff ioapic0: routing intpin 15 (ISA IRQ 15) to lapic 0 vector 52 ata1: [MPSAFE] ata1: [ITHREAD] pcib1: <ACPI PCI-PCI bridge> at device 9.0 on pci0 pcib1: domain 0 pcib1: secondary bus 1 pcib1: subordinate bus 1 pcib1: I/O decode 0xc000-0xcfff pcib1: memory decode 0xfc200000-0xfe2fffff pcib1: no prefetched decode pcib1: Subtractively decoded bridge. pci1: <ACPI PCI bus> on pcib1 pci1: domain=0, physical bus=1 found-> vendor=0x1002, dev=0x4752, revid=0x27 domain=0, bus=1, slot=3, func=0 class=03-00-00, hdrtype=0x00, mfdev=0 cmdreg=0x0087, statreg=0x0290, cachelnsz=16 (dwords) lattimer=0x40 (1920 ns), mingnt=0x08 (2000 ns), maxlat=0x00 (0 ns) intpin=a, irq=10 powerspec 2 supports D0 D1 D2 D3 current D0 map[10]: type Memory, range 32, base 0xfd000000, size 24, enabled pcib1: requested memory range 0xfd000000-0xfdffffff: good map[14]: type I/O Port, range 32, base 0xc800, size 8, enabled pcib1: requested I/O range 0xc800-0xc8ff: in range map[18]: type Memory, range 32, base 0xfe2ff000, size 12, enabled pcib1: requested memory range 0xfe2ff000-0xfe2fffff: good pcib1: matched entry for 1.3.INTA (src \_SB_.LNKA:0) pci_link0: Picked IRQ 16 with weight 0 pcib1: slot 3 INTA routed to irq 16 via \_SB_.LNKA vgapci0: <VGA-compatible display> port 0xc800-0xc8ff mem 0xfd000000-0xfdffffff,0xfe2ff000-0xfe2fffff irq 16 at device 3.0 on pci1 nfe0: <NVIDIA nForce4 CK804 MCP9 Networking Adapter> port 0xdc00-0xdc07 mem 0xfe3fd000-0xfe3fdfff irq 22 at device 10.0 on pci0 nfe0: Reserved 0x1000 bytes for rid 0x10 type 3 at 0xfe3fd000 miibus0: <MII bus> on nfe0 e1000phy0: <Marvell 88E1111 Gigabit PHY> PHY 1 on miibus0 e1000phy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseSX, 1000baseSX-FDX, 1000baseT, 1000baseT-FDX, auto nfe0: bpf attached nfe0: Ethernet address: 00:14:4f:8d:fe:ea ioapic0: routing intpin 22 (PCI IRQ 22) to lapic 0 vector 53 nfe0: [MPSAFE] nfe0: [FILTER] pcib2: <ACPI PCI-PCI bridge> at device 11.0 on pci0 pcib2: domain 0 pcib2: secondary bus 2 pcib2: subordinate bus 2 pcib2: I/O decode 0x0-0x0 pcib2: no prefetched decode pcib2: could not get PCI interrupt routing table for \_SB_.PCI0.P0P2 - AE_NOT_FOUND pci2: <ACPI PCI bus> on pcib2 pci2: domain=0, physical bus=2 pcib3: <ACPI PCI-PCI bridge> at device 12.0 on pci0 pcib3: domain 0 pcib3: secondary bus 3 pcib3: subordinate bus 3 pcib3: I/O decode 0x0-0x0 pcib3: no prefetched decode pcib3: could not get PCI interrupt routing table for \_SB_.PCI0.P0P3 - AE_NOT_FOUND pci3: <ACPI PCI bus> on pcib3 pci3: domain=0, physical bus=3 pcib4: <ACPI PCI-PCI bridge> at device 13.0 on pci0 pcib4: domain 0 pcib4: secondary bus 4 pcib4: subordinate bus 4 pcib4: I/O decode 0x0-0x0 pcib4: no prefetched decode pci4: <ACPI PCI bus> on pcib4 pci4: domain=0, physical bus=4 pcib5: <ACPI PCI-PCI bridge> at device 14.0 on pci0 pcib5: domain 0 pcib5: secondary bus 5 pcib5: subordinate bus 5 pcib5: I/O decode 0x0-0x0 pcib5: no prefetched decode pci5: <ACPI PCI bus> on pcib5 pci5: domain=0, physical bus=5 pcib6: <ACPI Host-PCI bridge> on acpi0 pci128: <ACPI PCI bus> on pcib6 pci128: domain=0, physical bus=128 found-> vendor=0x10de, dev=0x005e, revid=0xa3 domain=0, bus=128, slot=0, func=0 class=05-80-00, hdrtype=0x00, mfdev=0 cmdreg=0x0106, statreg=0x00b0, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) found-> vendor=0x10de, dev=0x00d3, revid=0xf3 domain=0, bus=128, slot=1, func=0 class=05-80-00, hdrtype=0x00, mfdev=1 cmdreg=0x000f, statreg=0x00a0, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) map[14]: type Memory, range 32, base 0xfeaff000, size 12, enabled found-> vendor=0x10de, dev=0x0057, revid=0xf3 domain=0, bus=128, slot=10, func=0 class=06-80-00, hdrtype=0x00, mfdev=0 cmdreg=0x0007, statreg=0x00b0, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x01 (250 ns), maxlat=0x14 (5000 ns) intpin=a, irq=7 powerspec 2 supports D0 D1 D2 D3 current D0 map[10]: type Memory, range 32, base 0xfeafe000, size 12, enabled map[14]: type I/O Port, range 32, base 0xfc00, size 3, enabled pcib6: matched entry for 128.10.INTA (src \_SB_.LK2N:0) pci_link23: Picked IRQ 44 with weight 0 pcib6: slot 10 INTA routed to irq 44 via \_SB_.LK2N found-> vendor=0x10de, dev=0x005d, revid=0xf3 domain=0, bus=128, slot=11, func=0 class=06-04-00, hdrtype=0x01, mfdev=0 cmdreg=0x0046, statreg=0x0010, cachelnsz=16 (dwords) lattimer=0x00 (0 ns), mingnt=0x07 (1750 ns), maxlat=0x00 (0 ns) powerspec 2 supports D0 D3 current D0 MSI supports 2 messages, 64 bit found-> vendor=0x10de, dev=0x005d, revid=0xf3 domain=0, bus=128, slot=12, func=0 class=06-04-00, hdrtype=0x01, mfdev=0 cmdreg=0x0046, statreg=0x0010, cachelnsz=16 (dwords) lattimer=0x00 (0 ns), mingnt=0x07 (1750 ns), maxlat=0x00 (0 ns) powerspec 2 supports D0 D3 current D0 MSI supports 2 messages, 64 bit found-> vendor=0x10de, dev=0x005d, revid=0xf3 domain=0, bus=128, slot=13, func=0 class=06-04-00, hdrtype=0x01, mfdev=0 cmdreg=0x0046, statreg=0x0010, cachelnsz=16 (dwords) lattimer=0x00 (0 ns), mingnt=0x07 (1750 ns), maxlat=0x00 (0 ns) powerspec 2 supports D0 D3 current D0 MSI supports 2 messages, 64 bit found-> vendor=0x10de, dev=0x005d, revid=0xa3 domain=0, bus=128, slot=14, func=0 class=06-04-00, hdrtype=0x01, mfdev=0 cmdreg=0x0046, statreg=0x0010, cachelnsz=16 (dwords) lattimer=0x00 (0 ns), mingnt=0x07 (1750 ns), maxlat=0x00 (0 ns) powerspec 2 supports D0 D3 current D0 MSI supports 2 messages, 64 bit found-> vendor=0x1022, dev=0x7458, revid=0x12 domain=0, bus=128, slot=16, func=0 class=06-04-00, hdrtype=0x01, mfdev=1 cmdreg=0x0156, statreg=0x0010, cachelnsz=16 (dwords) lattimer=0x40 (1920 ns), mingnt=0x07 (1750 ns), maxlat=0x00 (0 ns) found-> vendor=0x1022, dev=0x7459, revid=0x12 domain=0, bus=128, slot=16, func=1 class=08-00-10, hdrtype=0x00, mfdev=0 cmdreg=0x0006, statreg=0x0200, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) map[10]: type Memory, range 64, base 0xfeafd000, size 12, enabled found-> vendor=0x1022, dev=0x7458, revid=0x12 domain=0, bus=128, slot=17, func=0 class=06-04-00, hdrtype=0x01, mfdev=1 cmdreg=0x0157, statreg=0x0010, cachelnsz=16 (dwords) lattimer=0x40 (1920 ns), mingnt=0x07 (1750 ns), maxlat=0x00 (0 ns) found-> vendor=0x1022, dev=0x7459, revid=0x12 domain=0, bus=128, slot=17, func=1 class=08-00-10, hdrtype=0x00, mfdev=0 cmdreg=0x0006, statreg=0x0200, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) map[10]: type Memory, range 64, base 0xfeafc000, size 12, enabled pci128: <memory> at device 0.0 (no driver attached) pci128: <memory> at device 1.0 (no driver attached) nfe1: <NVIDIA nForce4 CK804 MCP9 Networking Adapter> port 0xfc00-0xfc07 mem 0xfeafe000-0xfeafefff irq 44 at device 10.0 on pci128 nfe1: Reserved 0x1000 bytes for rid 0x10 type 3 at 0xfeafe000 miibus1: <MII bus> on nfe1 e1000phy1: <Marvell 88E1111 Gigabit PHY> PHY 1 on miibus1 e1000phy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseSX, 1000baseSX-FDX, 1000baseT, 1000baseT-FDX, auto nfe1: bpf attached nfe1: Ethernet address: 00:14:4f:8d:fe:eb ioapic3: routing intpin 20 (PCI IRQ 44) to lapic 0 vector 54 nfe1: [MPSAFE] nfe1: [FILTER] pcib7: <ACPI PCI-PCI bridge> at device 11.0 on pci128 pcib7: domain 0 pcib7: secondary bus 129 pcib7: subordinate bus 129 pcib7: I/O decode 0x0-0x0 pcib7: no prefetched decode pcib7: could not get PCI interrupt routing table for \_SB_.PCIB.BR5B - AE_NOT_FOUND pci129: <ACPI PCI bus> on pcib7 pci129: domain=0, physical bus=129 pcib8: <ACPI PCI-PCI bridge> at device 12.0 on pci128 pcib8: domain 0 pcib8: secondary bus 130 pcib8: subordinate bus 130 pcib8: I/O decode 0x0-0x0 pcib8: no prefetched decode pcib8: could not get PCI interrupt routing table for \_SB_.PCIB.BR5C - AE_NOT_FOUND pci130: <ACPI PCI bus> on pcib8 pci130: domain=0, physical bus=130 pcib9: <ACPI PCI-PCI bridge> at device 13.0 on pci128 pcib9: domain 0 pcib9: secondary bus 131 pcib9: subordinate bus 131 pcib9: I/O decode 0x0-0x0 pcib9: no prefetched decode pci131: <ACPI PCI bus> on pcib9 pci131: domain=0, physical bus=131 pcib10: <ACPI PCI-PCI bridge> at device 14.0 on pci128 pcib10: domain 0 pcib10: secondary bus 132 pcib10: subordinate bus 132 pcib10: I/O decode 0x0-0x0 pcib10: no prefetched decode pci132: <ACPI PCI bus> on pcib10 pci132: domain=0, physical bus=132 pcib11: <ACPI PCI-PCI bridge> at device 16.0 on pci128 pcib11: domain 0 pcib11: secondary bus 133 pcib11: subordinate bus 133 pcib11: I/O decode 0x0-0x0 pcib11: no prefetched decode pci133: <ACPI PCI bus> on pcib11 pci133: domain=0, physical bus=133 pcib12: <ACPI PCI-PCI bridge> at device 17.0 on pci128 pcib12: domain 0 pcib12: secondary bus 134 pcib12: subordinate bus 134 pcib12: I/O decode 0xe000-0xefff pcib12: memory decode 0xfe500000-0xfe9fffff pcib12: no prefetched decode pci134: <ACPI PCI bus> on pcib12 pci134: domain=0, physical bus=134 found-> vendor=0x8086, dev=0x1010, revid=0x03 domain=0, bus=134, slot=1, func=0 class=02-00-00, hdrtype=0x00, mfdev=1 cmdreg=0x0157, statreg=0x0230, cachelnsz=16 (dwords) lattimer=0x40 (1920 ns), mingnt=0xff (63750 ns), maxlat=0x00 (0 ns) intpin=a, irq=10 powerspec 2 supports D0 D3 current D0 MSI supports 1 message, 64 bit map[10]: type Memory, range 64, base 0xfe9e0000, size 17, enabled pcib12: requested memory range 0xfe9e0000-0xfe9fffff: good map[20]: type I/O Port, range 32, base 0xec00, size 6, enabled pcib12: requested I/O range 0xec00-0xec3f: in range pcib12: matched entry for 134.1.INTA pcib12: slot 1 INTA hardwired to IRQ 56 found-> vendor=0x8086, dev=0x1010, revid=0x03 domain=0, bus=134, slot=1, func=1 class=02-00-00, hdrtype=0x00, mfdev=1 cmdreg=0x0157, statreg=0x0230, cachelnsz=16 (dwords) lattimer=0x40 (1920 ns), mingnt=0xff (63750 ns), maxlat=0x00 (0 ns) intpin=b, irq=6 powerspec 2 supports D0 D3 current D0 MSI supports 1 message, 64 bit map[10]: type Memory, range 64, base 0xfe9c0000, size 17, enabled pcib12: requested memory range 0xfe9c0000-0xfe9dffff: good map[20]: type I/O Port, range 32, base 0xe800, size 6, enabled pcib12: requested I/O range 0xe800-0xe83f: in range pcib12: matched entry for 134.1.INTB pcib12: slot 1 INTB hardwired to IRQ 57 found-> vendor=0x1000, dev=0x0050, revid=0x02 domain=0, bus=134, slot=2, func=0 class=01-00-00, hdrtype=0x00, mfdev=0 cmdreg=0x0157, statreg=0x0230, cachelnsz=16 (dwords) lattimer=0x48 (2160 ns), mingnt=0x40 (16000 ns), maxlat=0x0a (2500 ns) intpin=a, irq=7 powerspec 2 supports D0 D1 D2 D3 current D0 MSI supports 1 message, 64 bit MSI-X supports 1 message in map 0x14 map[10]: type I/O Port, range 32, base 0xe400, size 8, enabled pcib12: requested I/O range 0xe400-0xe4ff: in range map[14]: type Memory, range 64, base 0xfe9bc000, size 14, enabled pcib12: requested memory range 0xfe9bc000-0xfe9bffff: good map[1c]: type Memory, range 64, base 0xfe9a0000, size 16, enabled pcib12: requested memory range 0xfe9a0000-0xfe9affff: good pcib12: matched entry for 134.2.INTA pcib12: slot 2 INTA hardwired to IRQ 58 em0: <Intel(R) PRO/1000 Legacy Network Connection 1.0.1> port 0xec00-0xec3f mem 0xfe9e0000-0xfe9fffff irq 56 at device 1.0 on pci134 em0: Reserved 0x20000 bytes for rid 0x10 type 3 at 0xfe9e0000 em0: Reserved 0x40 bytes for rid 0x20 type 4 at 0xec00 ioapic2: routing intpin 0 (PCI IRQ 56) to lapic 0 vector 55 em0: [FILTER] em0: bpf attached em0: Ethernet address: 00:14:4f:8d:fe:ec em1: <Intel(R) PRO/1000 Legacy Network Connection 1.0.1> port 0xe800-0xe83f mem 0xfe9c0000-0xfe9dffff irq 57 at device 1.1 on pci134 em1: Reserved 0x20000 bytes for rid 0x10 type 3 at 0xfe9c0000 em1: Reserved 0x40 bytes for rid 0x20 type 4 at 0xe800 ioapic2: routing intpin 1 (PCI IRQ 57) to lapic 0 vector 56 em1: [FILTER] em1: bpf attached em1: Ethernet address: 00:14:4f:8d:fe:ed mpt0: <LSILogic SAS/SATA Adapter> port 0xe400-0xe4ff mem 0xfe9bc000-0xfe9bffff,0xfe9a0000-0xfe9affff irq 58 at device 2.0 on pci134 mpt0: Reserved 0x100 bytes for rid 0x10 type 4 at 0xe400 mpt0: Reserved 0x4000 bytes for rid 0x14 type 3 at 0xfe9bc000 ioapic2: routing intpin 2 (PCI IRQ 58) to lapic 0 vector 57 mpt0: [MPSAFE] mpt0: [ITHREAD] mpt0: MPI Version=1.5.20.0 mpt0: No Handlers For Any Event Notify Frames. Event 0xa (ACK not required). mpt0: No Handlers For Any Event Notify Frames. Event 0x16 (ACK not required). mpt0: No Handlers For Any Event Notify Frames. Event 0x16 (ACK not required). mpt0: No Handlers For Any Event Notify Frames. Event 0x16 (ACK not required). mpt0: No Handlers For Any Event Notify Frames. Event 0x12 (ACK not required). mpt0: No Handlers For Any Event Notify Frames. Event 0x16 (ACK not required). mpt0: No Handlers For Any Event Notify Frames. Event 0x16 (ACK not required). mpt0: No Handlers For Any Event Notify Frames. Event 0x12 (ACK not required). mpt0: No Handlers For Any Event Notify Frames. Event 0x16 (ACK not required). mpt0: No Handlers For Any Event Notify Frames. Event 0xf (ACK not required). mpt0: No Handlers For Any Event Notify Frames. Event 0xf (ACK not required). mpt0: Capabilities: ( RAID-0 RAID-1E RAID-1 ) mpt0: 0 Active Volumes (2 Max) mpt0: 0 Hidden Drive Members (14 Max) mpt0: No Handlers For Any Event Notify Frames. Event 0xa (ACK not required). acpi_button0: <Power Button> on acpi0 atrtc0: <AT realtime clock> port 0x70-0x71 irq 8 on acpi0 atrtc0: registered as a time-of-day clock (resolution 1000000us) uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 ioapic0: routing intpin 4 (ISA IRQ 4) to lapic 0 vector 58 uart0: [FILTER] uart0: fast interrupt uart0: console (9600,n,8,1) ex_isa_identify() ahc_isa_probe 0: ioport 0xc00 alloc failed ahc_isa_probe 13: ioport 0xdc00 alloc failed ahc_isa_probe 14: ioport 0xec00 alloc failed isa_probe_children: disabling PnP devices atrtc: atrtc0 already exists; skipping it sc: sc0 already exists; skipping it uart: uart0 already exists; skipping it isa_probe_children: probing non-PnP devices orm0: <ISA Option ROMs> at iomem 0xc0000-0xc9fff,0xca000-0xcb7ff,0xcb800-0xcc7ff,0xcc800-0xcd7ff,0xd3800-0xd47ff on isa0 sc0: <System console> at flags 0x100 on isa0 sc0: VGA <16 virtual consoles, flags=0x300> sc0: fb0, kbd1, terminal emulator: scteken (teken terminal) vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0 atkbd0: <AT Keyboard> irq 1 on atkbdc0 kbd0 at atkbd0 kbd0: atkbd0, generic (0), config:0x0, flags:0x3f0000 ioapic0: routing intpin 1 (ISA IRQ 1) to lapic 0 vector 59 atkbd0: [GIANT-LOCKED] atkbd0: [ITHREAD] psm0: current command byte:0065 kbdc: TEST_AUX_PORT status:0000 kbdc: RESET_AUX return code:00fe kbdc: RESET_AUX return code:00fe kbdc: RESET_AUX return code:00fe kbdc: DIAGNOSE status:0055 kbdc: TEST_KBD_PORT status:0000 psm0: failed to reset the aux device. fdc0 failed to probe at port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on isa0 ppc0: cannot reserve I/O port range ppc0: <Parallel port> failed to probe at irq 7 on isa0 uart1: <ns8250> failed to probe at port 0x2f8-0x2ff irq 3 on isa0 isa_probe_children: probing PnP devices powernow0: <PowerNow! K8> on cpu0 powernow1: <PowerNow! K8> on cpu1 powernow2: <PowerNow! K8> on cpu2 powernow3: <PowerNow! K8> on cpu3 Device configuration finished. Reducing kern.maxvnodes 1031944 -> 100000 procfs registered ZFS filesystem version 3 ZFS storage pool version 14 lapic: Divisor 2, Frequency 99735545 Hz Timecounter "TSC" frequency 2792595272 Hz quality -100 Timecounters tick every 1.000 msec vlan: initialized, using hash tables with chaining ipfw2 (+ipv6) initialized, divert enabled, nat loadable, rule-based forwarding disabled, default to accept, logging disabled ipfw0: bpf attached lo0: bpf attached hptrr: no controller detected. ata0: Identifying devices: 00010000 ata0: New devices: 00010000 usbus0: 12Mbps Full Speed USB v1.0 usbus1: 480Mbps High Speed USB v2.0 ata0-master: pio=PIO4 wdma=WDMA2 udma=UDMA33 cable=40 wire acd0: setting UDMA33 ugen0.1: <nVidia> at usbus0 uhub0: <nVidia OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus0 ugen1.1: <nVidia> at usbus1 uhub1: <nVidia EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus1 acd0: <DW-224SL-R/1.0A> CDRW drive at ata0 as master acd0: read 4134KB/s (4134KB/s) write 4134KB/s (4134KB/s), 1654KB buffer, UDMA33 acd0: Reads: CDR, CDRW, CDDA stream, DVDROM, DVDR, DVDRAM, packet acd0: Writes: CDR, CDRW, test write acd0: Audio: play, 256 volume levels acd0: Mechanism: ejectable caddy, unlocked acd0: Medium: no/blank disc ata1: Identifying devices: 00000000 ata1: New devices: 00000000 uhub0: 7 ports with 7 removable, self powered uhub1: 7 ports with 7 removable, self powered (probe71:mpt0:1:8:0): Error 22, Unretryable error (probe72:mpt0:1:9:0): Error 22, Unretryable error (probe73:mpt0:1:10:0): Error 22, Unretryable error (probe74:mpt0:1:11:0): Error 22, Unretryable error (probe75:mpt0:1:12:0): Error 22, Unretryable error (probe76:mpt0:1:13:0): Error 22, Unretryable error (probe63:mpt0:1:0:0): Error 22, Unretryable error (probe64:mpt0:1:1:0): Error 22, Unretryable error (probe65:mpt0:1:2:0): Error 22, Unretryable error (probe66:mpt0:1:3:0): Error 22, Unretryable error (probe67:mpt0:1:4:0): Error 22, Unretryable error (probe68:mpt0:1:5:0): Error 22, Unretryable error (probe69:mpt0:1:6:0): Error 22, Unretryable error (probe70:mpt0:1:7:0): Error 22, Unretryable error pass0 at mpt0 bus 0 scbus0 target 2 lun 0 pass0: <SEAGATE ST973402SSUN72G 0400> Fixed Direct Access SCSI-5 device pass0: Serial Number 18216LAX 3NP16LAX pass0: 300.000MB/s transfers pass0: Command Queueing enabled da0 at mpt0 bus 0 scbus0 target 2 lun 0 da0: <SEAGATE ST973402SSUN72G 0400> Fixed Direct Access SCSI-5 device da0: Serial Number 18216LAX 3NP16LAX da0: 300.000MB/s transfers da0: Command Queueing enabled da0: 70007MB (143374738 512 byte sectors: 255H 63S/T 8924C) da1 at mpt0 bus 0 scbus0 target 3 lun 0 da1: <SEAGATE ST973402SSUN72G 0400> Fixed Direct Access SCSI-5 device da1: Serial Number 16216D68 3NP16D68 da1: 300.000MB/s transfers da1: Command Queueing enabled da1: 70007MB (143374738 512 byte sectors: 255H 63S/T 8924C) GEOM: new disk da0 GEOM: new disk da1 pass1 at mpt0 bus 0 scbus0 target 3 lun 0 pass1: <SEAGATE ST973402SSUN72G 0400> Fixed Direct Access SCSI-5 device pass1: Serial Number 16216D68 3NP16D68 pass1: 300.000MB/s transfers pass1: Command Queueing enabled ATA PseudoRAID loaded SMP: AP CPU #1 Launched! cpu1 AP: ID: 0x01000000 VER: 0x80050010 LDR: 0x00000000 DFR: 0xffffffff lint0: 0x00010700 lint1: 0x00000400 TPR: 0x00000000 SVR: 0x000001ff timer: 0x000200ef therm: 0x00010000 err: 0x000000f0 pmc: 0x00010400 SMP: AP CPU #3 Launched! cpu3 AP: ID: 0x03000000 VER: 0x80050010 LDR: 0x00000000 DFR: 0xffffffff lint0: 0x00010700 lint1: 0x00000400 TPR: 0x00000000 SVR: 0x000001ff timer: 0x000200ef therm: 0x00010000 err: 0x000000f0 pmc: 0x00010400 SMP: AP CPU #2 Launched! cpu2 AP: ID: 0x02000000 VER: 0x80050010 LDR: 0x00000000 DFR: 0xffffffff lint0: 0x00010700 lint1: 0x00000400 TPR: 0x00000000 SVR: 0x000001ff timer: 0x000200ef therm: 0x00010000 err: 0x000000f0 pmc: 0x00010400 (folaopwitca0b:l er oculteiannge ri nsttpairnt e4d ISA IRQ 4) to lapic 1 vector 48 ioapic0: routing intpin 9 (ISA IRQ 9) to lapic 2 vector 48 ioapic0: routing intpin 14 (ISA IRQ 14) to lapic 3 vector 48 ioapic0: routing intpin 20 (PCI IRQ 20) to lapic 1 vector 49 ioapic0: routing intpin 21 (PCI IRQ 21) to lapic 2 vector 49 ioapic0: routing intpin 22 (PCI IRQ 22) to lapic 3 vector 49 ioapic2: routing intpin 0 (PCI IRQ 56) to lapic 1 vector 50 ioapic2: routing intpin 1 (PCI IRQ 57) to lapic 2 vector 50 ioapic2: routing intpin 2 (PCI IRQ 58) to lapic 3 vector 50 WARNING: WITNESS option enabled, expect reduced performance. Trying to mount root from zfs:zroot_______________________________________________ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org"
On Wednesday, July 21, 2010 5:17:06 am Andriy Gapon wrote:> on 21/07/2010 11:33 Andriy Gapon said the following: > > Not sure how to interpret this properly. > > One possibility is a hardware problem where interrupt message routebetween> > ioapic2 and CPU to which lapic3 belongs is flaky. > > Or, I/O path between that CPU and the PCI slot where the device resides. Orthe> CPU. Or... > I think that lapic2 and lapic3 reside in a different physicalpackage/socket,> given that you have 2x2 CPU/core configuration. > > BTW, John, could there be any problem because of this: > ioapic1: WARNING: intbase 48 != expected base 24 > ioapic2: WARNING: intbase 56 != expected base 55 > ioapic3: WARNING: intbase 24 != expected base 63You can ignore this, this just means ACPI enumerated the I/O APICs out of order in the MADT. -- John Baldwin