Yuri Khotyaintsev
2005-Dec-22 07:44 UTC
Fatal trap 9: general protection fault while in kernel mode
I have updated kernel/world today on the system which was running without any
problems since I installed it (old kernel is from November 28) and i got this
panic 10 minutes after boot (dmesg is attached below). The system is running
FreeBSD/amd64 6-STABLE, SMP.
[root@xx][/usr/obj/usr/src/sys/DB]# kgdb kernel.debug /var/crash/vmcore.0
[GDB will not be able to debug user-mode threads: /usr/lib/libthread_db.so:
Undefined symbol "ps_pglobal_lookup"]
GNU gdb 6.1.1 [FreeBSD]
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB. Type "show warranty" for
details.
This GDB was configured as "amd64-marcel-freebsd".
Unread portion of the kernel message buffer:
kernel trap 9 with interrupts disabled
Fatal trap 9: general protection fault while in kernel mode
cpuid = 3; apic id = 07
instruction pointer = 0x8:0xffffffff803b9754
stack pointer = 0x10:0xffffffffb35e0ab0
frame pointer = 0x10:0xffffff000002b3c0
code segment = base 0x0, limit 0xfffff, type 0x1b
= DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags = resume, IOPL = 0
current process = 40 (irq34: mpt0)
trap number = 9
panic: general protection fault
cpuid = 3
Uptime: 2h2m14s
Dumping 4095 MB (3 chunks)
chunk 0: 1MB (156 pages) ... ok
chunk 1: 3583MB (917184 pages) 3567 3551 3535 3519 3503 3487 3471 3455 3439
3423 3407 3391 3375 3359 3343 3327 3311 3295 3279 3263 3247 3231 3215 3199
3183 3167 3151 3135 3119 3103 3087 3071 3055 3039 3023 3007 2991 2975 2959
2943 2927 2911 2895 2879 2863 2847 2831 2815 2799 2783 2767 2751 2735 2719
2703 2687 2671 2655 2639 2623 2607 2591 2575 2559 2543 2527 2511 2495 2479
2463 2447 2431 2415 2399 2383 2367 2351 2335 2319 2303 2287 2271 2255 2239
2223 2207 2191 2175 2159 2143 2127 2111 2095 2079 2063 2047 2031 2015 1999
1983 1967 1951 1935 1919 1903 1887 1871 1855 1839 1823 1807 1791 1775 1759
1743 1727 1711 1695 1679 1663 1647 1631 1615 1599 1583 1567 1551 1535 1519
1503 1487 1471 1455 1439 1423 1407 1391 1375 1359 1343 1327 1311 1295 1279
1263 1247 1231 1215 1199 1183 1167 1151 1135 1119 1103 1087 1071 1055 1039
1023 1007 991 975 959 943 927 911 895 879 863 847 831 815 799 783 767 751 735
719 703 687 671 655 639 623 607 591 575 559 543 527 511 495 479 463 447 431
415 399 383 367 351 335 319 303 287 271 255 239 223 207 191 175 159 143 127
111 95 79 63 47 31 15 ... ok
chunk 2: 512MB (131072 pages) 497 481 465 449 433 417 401 385 369 353 337
321 305 289 273 257 241 225 209 193 177 161 145 129 113 97 81 65 49 33 17 1
#0 doadump () at pcpu.h:172
172 __asm __volatile("movq %%gs:0,%0" : "=r"
(td));
(kgdb) where
#0 doadump () at pcpu.h:172
#1 0x0000000000000004 in ?? ()
#2 0xffffffff8025f637 in boot (howto=260)
at /usr/src/sys/kern/kern_shutdown.c:399
#3 0xffffffff8025fc95 in panic (fmt=0xffffff011f66f980 "@?\037\001")
at /usr/src/sys/kern/kern_shutdown.c:555
#4 0xffffffff803c918a in trap_fatal (frame=0xffffff011f66f980,
eva=18446742979019789120)
at /usr/src/sys/amd64/amd64/trap.c:660
#5 0xffffffff803c960e in trap (frame {tf_rdi = -1099511450688, tf_rsi = 0,
tf_rdx = -2143527384, tf_rcx = 0,
tf_r8 = -1099511451648, tf_r9 = 9223372036854775807, tf_rax = 18, tf_rbx =
-1099498667008, tf_rbp = -1099511450688, tf_r10 = 0, tf_r11 = -1094689762496,
tf_r12 = -1099511146240, tf_r13 = 18, tf_r14 = -1094689818240, tf_r15 =
-1285682416, tf_trapno = 9, tf_addr = 0, tf_flags = -2145094526, tf_err = 0,
tf_rip = -2143578284, tf_cs = 8, tf_rflags = 65606, tf_rsp = -1285682496,
tf_ss = 16}) at /usr/src/sys/amd64/amd64/trap.c:469
#6 0xffffffff803b71bb in calltrap ()
at /usr/src/sys/amd64/amd64/exception.S:168
#7 0xffffffff803b9754 in intr_execute_handlers (isrc=0xffffff000002b3c0,
iframe=0xffffffffb35e0b10) at /usr/src/sys/amd64/amd64/intr_machdep.c:213
#8 0xffffffff803bbdd1 in lapic_handle_intr (cookie=0xffffff000002b3c0, frame
{if_rdi = -1094689818240, if_rsi = -1094689818240, if_rdx = 582, if_rcx
= 0, if_r8 = -1285681904, if_r9 = 9223372036854775807, if_rax = 0, if_rbx =
-1094689818240, if_rbp = 0, if_r10 = 0, if_r11 = -1094689762496, if_r12 =
-1099511148288, if_r13 = -1094689818240, if_r14 = 0, if_r15 = -1094689762496,
if_rip = -2143566227, if_cs = 8, if_rflags = 582, if_rsp = -1285682224, if_ss
= 16}) at /usr/src/sys/amd64/amd64/local_apic.c:612
#9 0xffffffff803b76bd in Xapic_isr2 () at apic_vector.S:133
#10 0xffffffff803bc66d in spinlock_exit () at cpufunc.h:391
#11 0xffffffff80247952 in ithread_loop (arg=0xffffff0000075100)
at /usr/src/sys/kern/kern_intr.c:597
#12 0xffffffff802462d4 in fork_exit (callout=0xffffffff802475fe
<ithread_loop>,
arg=0xffffff0000075100, frame=0xffffffffb35e0c50)
at /usr/src/sys/kern/kern_fork.c:789
---Type <return> to continue, or q <return> to quit---
#13 0xffffffff803b751e in fork_trampoline ()
at /usr/src/sys/amd64/amd64/exception.S:394
#14 0x0000000000000000 in ?? ()
Previous frame identical to this frame (corrupt stack?)
Copyright (c) 1992-2005 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD 6.0-STABLE #4: Thu Dec 22 12:13:33 CET 2005
root@xx.irfu.se:/usr/obj/usr/src/sys/DB
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: Intel(R) Xeon(TM) CPU 3.00GHz (2992.71-MHz K8-class CPU)
Origin = "GenuineIntel" Id = 0xf43 Stepping = 3
Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
Features2=0x641d<SSE3,RSVD2,MON,DS_CPL,CNTX-ID,CX16,<b14>>
AMD Features=0x20100800<SYSCALL,NX,LM>
Hyperthreading: 2 logical CPUs
real memory = 4831838208 (4608 MB)
avail memory = 4134555648 (3943 MB)
ACPI APIC Table: <DELL PE BKC >
FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
cpu0 (BSP): APIC ID: 0
cpu1 (AP): APIC ID: 1
cpu2 (AP): APIC ID: 6
cpu3 (AP): APIC ID: 7
ioapic0: Changing APIC ID to 8
ioapic1: Changing APIC ID to 9
ioapic1: WARNING: intbase 32 != expected base 24
ioapic2: Changing APIC ID to 10
ioapic2: WARNING: intbase 64 != expected base 56
ioapic3: Changing APIC ID to 11
ioapic3: WARNING: intbase 96 != expected base 88
ioapic0 <Version 2.0> irqs 0-23 on motherboard
ioapic1 <Version 2.0> irqs 32-55 on motherboard
ioapic2 <Version 2.0> irqs 64-87 on motherboard
ioapic3 <Version 2.0> irqs 96-119 on motherboard
acpi0: <DELL PE BKC> on motherboard
acpi0: Power Button (fixed)
Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0
cpu0: <ACPI CPU> on acpi0
cpu1: <ACPI CPU> on acpi0
cpu2: <ACPI CPU> on acpi0
cpu3: <ACPI CPU> on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
pcib1: <ACPI PCI-PCI bridge> at device 2.0 on pci0
pci1: <ACPI PCI bus> on pcib1
pcib2: <ACPI PCI-PCI bridge> at device 0.0 on pci1
pci2: <ACPI PCI bus> on pcib2
mpt0: <LSILogic 1030 Ultra4 Adapter> port 0xec00-0xecff mem
0xfe9f0000-0xfe9fffff,0xfe9e0000-0xfe9effff irq 34 at device 5.0 on pci2
mpt0: [GIANT-LOCKED]
mpt0: MPI Version=1.2.12.0
mpt0: Unhandled Event Notify Frame. Event 0xa.
mpt1: <LSILogic 1030 Ultra4 Adapter> port 0xe800-0xe8ff mem
0xfe9d0000-0xfe9dffff,0xfe9c0000-0xfe9cffff irq 33 at device 5.1 on pci2
mpt1: [GIANT-LOCKED]
mpt1: MPI Version=1.2.12.0
mpt1: Unhandled Event Notify Frame. Event 0xa.
pcib3: <ACPI PCI-PCI bridge> at device 0.2 on pci1
pci3: <ACPI PCI bus> on pcib3
pcib4: <ACPI PCI-PCI bridge> at device 4.0 on pci0
pci4: <ACPI PCI bus> on pcib4
pcib5: <ACPI PCI-PCI bridge> at device 5.0 on pci0
pci5: <ACPI PCI bus> on pcib5
pcib6: <ACPI PCI-PCI bridge> at device 0.0 on pci5
pci6: <ACPI PCI bus> on pcib6
em0: <Intel(R) PRO/1000 Network Connection Version - 3.2.18> port
0xdcc0-0xdcff mem 0xfe6e0000-0xfe6fffff irq 64 at device 7.0 on pci6
em0: Ethernet address: 00:14:22:19:2c:56
pcib7: <ACPI PCI-PCI bridge> at device 0.2 on pci5
pci7: <ACPI PCI bus> on pcib7
em1: <Intel(R) PRO/1000 Network Connection Version - 3.2.18> port
0xccc0-0xccff mem 0xfe4e0000-0xfe4fffff irq 65 at device 8.0 on pci7
em1: Ethernet address: 00:14:22:19:2c:57
pcib8: <ACPI PCI-PCI bridge> at device 6.0 on pci0
pci8: <ACPI PCI bus> on pcib8
pcib9: <ACPI PCI-PCI bridge> at device 0.0 on pci8
pci9: <ACPI PCI bus> on pcib9
mpt2: <LSILogic 1030 Ultra4 Adapter> port 0xbc00-0xbcff mem
0xfe1e0000-0xfe1fffff,0xfe1c0000-0xfe1dffff irq 106 at device 4.0 on pci9
mpt2: [GIANT-LOCKED]
mpt2: MPI Version=1.2.9.0
mpt2: Unhandled Event Notify Frame. Event 0xa.
mpt2: Capabilities: ( RAID-1E RAID-1 SAFTE )
mpt2: 0 Active Volumes (1 Max)
mpt2: 0 Hidden Drive Members (6 Max)
mpt3: <LSILogic 1030 Ultra4 Adapter> port 0xb800-0xb8ff mem
0xfe1a0000-0xfe1bffff,0xfe180000-0xfe19ffff irq 107 at device 4.1 on pci9
mpt3: [GIANT-LOCKED]
mpt3: MPI Version=1.2.9.0
mpt3: Unhandled Event Notify Frame. Event 0xa.
mpt3: Capabilities: ( RAID-1E RAID-1 SAFTE )
mpt3: 0 Active Volumes (1 Max)
mpt3: 0 Hidden Drive Members (6 Max)
pcib10: <ACPI PCI-PCI bridge> at device 0.2 on pci8
pci10: <ACPI PCI bus> on pcib10
uhci0: <Intel 82801EB (ICH5) USB controller USB-A> port 0x9ce0-0x9cff irq
16
at device 29.0 on pci0
uhci0: [GIANT-LOCKED]
usb0: <Intel 82801EB (ICH5) USB controller USB-A> on uhci0
usb0: USB revision 1.0
uhub0: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub0: 2 ports with 2 removable, self powered
uhci1: <Intel 82801EB (ICH5) USB controller USB-B> port 0x9cc0-0x9cdf irq
19
at device 29.1 on pci0
uhci1: [GIANT-LOCKED]
usb1: <Intel 82801EB (ICH5) USB controller USB-B> on uhci1
usb1: USB revision 1.0
uhub1: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub1: 2 ports with 2 removable, self powered
uhci2: <Intel 82801EB (ICH5) USB controller USB-C> port 0x9ca0-0x9cbf irq
18
at device 29.2 on pci0
uhci2: [GIANT-LOCKED]
usb2: <Intel 82801EB (ICH5) USB controller USB-C> on uhci2
usb2: USB revision 1.0
uhub2: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub2: 2 ports with 2 removable, self powered
ehci0: <EHCI (generic) USB 2.0 controller> mem 0xfeb00000-0xfeb003ff irq
23 at
device 29.7 on pci0
ehci0: [GIANT-LOCKED]
usb3: EHCI version 1.0
usb3: companion controllers, 2 ports each: usb0 usb1 usb2
usb3: <EHCI (generic) USB 2.0 controller> on ehci0
usb3: USB revision 2.0
uhub3: Intel EHCI root hub, class 9/0, rev 2.00/1.00, addr 1
uhub3: 6 ports with 6 removable, self powered
uhub4: vendor 0x413c product 0xa001, class 9/0, rev 2.00/0.00, addr 2
uhub4: multiple transaction translators
uhub4: 2 ports with 2 removable, self powered
pcib11: <ACPI PCI-PCI bridge> at device 30.0 on pci0
pci11: <ACPI PCI bus> on pcib11
pci11: <display, VGA> at device 13.0 (no driver attached)
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
atapci0: <Intel ICH5 UDMA100 controller> port
0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xfc00-0xfc0f at device 31.1 on pci0
ata0: <ATA channel 0> on atapci0
ata1: <ATA channel 1> on atapci0
fdc0: <floppy drive controller> port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on
acpi0
fdc0: [FAST]
atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
atkbd0: <AT Keyboard> flags 0x1 irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
psm0: <PS/2 Mouse> irq 12 on atkbdc0
psm0: [GIANT-LOCKED]
psm0: model VersaPad, device ID 0
sio0: <16550A-compatible COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on
acpi0
sio0: type 16550A
orm0: <ISA Option ROMs> at iomem
0xc0000-0xcafff,0xcb000-0xcbfff,0xcc000-0xcffff,0xd0000-0xd0fff,0xec000-0xeffff
on isa0
ppc0: cannot reserve I/O port range
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
sio1: configured irq 3 not in bitmap of probed irqs 0
sio1: port may not be enabled
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
Timecounters tick every 1.000 msec
acd0: CDROM <HL-DT-ST GCR-8240N/1.06> at ata0-master UDMA33
Waiting 5 seconds for SCSI devices to settle
ses0 at mpt0 bus 0 target 6 lun 0
ses0: <PE/PV 1x6 SCSI BP 1.0> Fixed Processor SCSI-2 device
ses0: 3.300MB/s transfers
ses0: SAF-TE Compliant Device
da0 at mpt0 bus 0 target 0 lun 0
da0: <MAXTOR ATLAS10K5_73SCA JNZM> Fixed Direct Access SCSI-3 device
da0: 320.000MB/s transfers (160.000MHz, offset 127, 16bit), Tagged Queueing
Enabled
da0: 70007MB (143374650 512 byte sectors: 255H 63S/T 8924C)
da2 at mpt3 bus 0 target 1 lun 0
da2: <transtec T6100S16R1-E 342N> Fixed Direct Access SCSI-3 device
da2: 320.000MB/s transfers (160.000MHz, offset 127, 16bit), Tagged Queueing
Enabled
da2: 1667498MB (3415035904 512 byte sectors: 255H 63S/T 212576C)
da1 at mpt2 bus 0 target 0 lun 0
da1: <transtec T6100S16R1-E 342N> Fixed Direct Access SCSI-3 device
da1: 320.000MB/s transfers (160.000MHz, offset 127, 16bit), Tagged Queueing
Enabled
da1: 1667498MB (3415035904 512 byte sectors: 255H 63S/T 212576C)
SMP: AP CPU #3 Launched!
SMP: AP CPU #1 Launched!
SMP: AP CPU #2 Launched!
Trying to mount root from ufs:/dev/da0s1a
WARNING: / was not properly dismounted
WARNING: /tmp was not properly dismounted
WARNING: /usr was not properly dismounted
WARNING: /var was not properly dismounted
ipfw2 (+ipv6) initialized, divert loadable, rule-based forwarding disabled,
default to deny, logging disabled
reboot after panic: general protection fault
writing core to vmcore.0
em0: link state changed to UP
em1: link state changed to UP
--
Dr. Yuri Khotyaintsev
Institutet f?r rymdfysik (IRF), Uppsala