Hi everyone
Almost every day, some time around midnight, my FreeBSD 5-STABLE kernel
panics. I've attached the output of a kgdb session of the saved core
file - is there any further info that would be useful to debugging? I've
got no idea where to start looking for a solution to this problem, so
please help!!
Thanks,
Peter
leftside# kgdb kernel.debug /var/crash/vmcore.25
[GDB will not be able to debug user-mode threads:
/usr/lib/libthread_db.so: Undefined symbol "ps_pglobal_lookup"]
GNU gdb 6.1.1 [FreeBSD]
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain
conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB. Type "show warranty" for
details.
This GDB was configured as "i386-marcel-freebsd".
Ready to go. Enter 'tr' to connect to the remote target
with /dev/cuaa0, 'tr /dev/cuaa1' to connect to a different port
or 'trf portno' to connect to the remote target with the firewire
interface. portno defaults to 5556.
Type 'getsyms' after connection to load kld symbols.
If you're debugging a local system, you can use 'kldsyms' instead
to load the kld symbols. That's a less obnoxious interface.
Unread portion of the kernel message buffer:
kernel trap 12 with interrupts disabled
Fatal trap 12: page fault while in kernel mode
fault virtual address = 0x24
fault code = supervisor read, page not present
instruction pointer = 0x8:0xc066dfc3
stack pointer = 0x10:0xcbae8bfc
frame pointer = 0x10:0xcbae8c10
code segment = base 0x0, limit 0xfffff, type 0x1b
= DPL 0, pres 1, def32 1, gran 1
processor eflags = resume, IOPL = 0
current process = 16 (irq5: fxp0)
trap number = 12
panic: page fault
Uptime: 2d0h51m36s
Dumping 251 MB
16 32 48 64 80 96 112 128 144 160 176 192 208 224 240
#0 doadump () at pcpu.h:160
160 __asm __volatile("movl %%fs:0,%0" : "=r"
(td));
(kgdb) list 0xc066dfc3
Function "0xc066dfc3" not defined.
(kgdb) list *0xc066dfc3
0xc066dfc3 is in propagate_priority
(/usr/src/sys/kern/subr_turnstile.c:245).
240 /*
241 * Pick up the lock that td is blocked on.
242 */
243 ts = td->td_blocked;
244 MPASS(ts != NULL);
245 tc = TC_LOOKUP(ts->ts_lockobj);
246 mtx_lock_spin(&tc->tc_lock);
247
248 /*
249 * This thread may not be blocked on this
turnstile anymore
(kgdb) backtrace
#0 doadump () at pcpu.h:160
During symbol reading, Incomplete CFI data; unspecified registers at
0xc064fc41.
#1 0xc06501dc in boot (howto=0x104) at
/usr/src/sys/kern/kern_shutdown.c:412
#2 0xc0650470 in panic (fmt=0xc084b541 "%s") at
/usr/src/sys/kern/kern_shutdown.c:568
#3 0xc08015fc in trap_fatal (frame=0xcbae8bbc, eva=0x24) at
/usr/src/sys/i386/i386/trap.c:822
#4 0xc0800da1 in trap (frame {tf_fs = 0xc14e0018, tf_es = 0xc14f0010,
tf_ds = 0x10, tf_edi 0xc1e22c02, tf_esi = 0xc14edc00, tf_ebp = 0xcbae8c10,
tf_isp 0xcbae8be8, tf_ebx = 0xc1e22c00, tf_edx = 0xc14e4610, tf_ecx 0xc0936a00,
tf_eax = 0x0, tf_trapno = 0xc, tf_err = 0x0, tf_eip 0xc066dfc3, tf_cs = 0x8,
tf_eflags = 0x10093, tf_esp = 0x10, tf_ss = 0x0})
at /usr/src/sys/i386/i386/trap.c:257
#5 0xc07f0eea in calltrap () at /usr/src/sys/i386/i386/exception.s:140
#6 0xc14e0018 in ?? ()
#7 0xc14f0010 in ?? ()
#8 0x00000010 in ?? ()
#9 0xc1e22c02 in ?? ()
#10 0xc14edc00 in ?? ()
#11 0xcbae8c10 in ?? ()
#12 0xcbae8be8 in ?? ()
#13 0xc1e22c00 in ?? ()
#14 0xc14e4610 in ?? ()
#15 0xc0936a00 in uma_mtx ()
#16 0x00000000 in ?? ()
#17 0x0000000c in ?? ()
#18 0x00000000 in ?? ()
#19 0xc066dfc3 in propagate_priority (td=0xc1e22c00) at
/usr/src/sys/kern/subr_turnstile.c:243
#20 0xc066e63e in turnstile_wait (ts=0xc14e4600, lock=0xc0936a00,
owner=0xc1e22c00)
at /usr/src/sys/kern/subr_turnstile.c:556
#21 0xc0647af9 in _mtx_lock_sleep (m=0xc0936a00, td=0xc14edc00,
opts=0x0, file=0x0, line=0x0)
at /usr/src/sys/kern/kern_mutex.c:552
#22 0xc07b6a40 in uma_zalloc_arg (zone=0xc1045ba0, udata=0xcbae8c8c,
flags=0x1) at /usr/src/sys/vm/uma_core.c:1825
#23 0xc0544ed2 in fxp_add_rfabuf (sc=0xc1607000, rxp=0xc1607300) at
mbuf.h:401
#24 0xc0544150 in fxp_intr_body (sc=0xc1607000, ifp=0xc1607000,
statack=0x0, count=0xffffffff)
at /usr/src/sys/dev/fxp/if_fxp.c:1682
#25 0xc0543f38 in fxp_intr (xsc=0xc1607000) at
/usr/src/sys/dev/fxp/if_fxp.c:1554
#26 0xc063c849 in ithread_loop (arg=0xc14eaa80) at
/usr/src/sys/kern/kern_intr.c:547
#27 0xc063badc in fork_exit (callout=0xc063c6f8 <ithread_loop>,
arg=0xc14eaa80, frame=0xcbae8d38)
at /usr/src/sys/kern/kern_fork.c:791
#28 0xc07f0f4c in fork_trampoline () at
/usr/src/sys/i386/i386/exception.s:209
Hi everyone
Almost every day, some time around midnight, my FreeBSD 5-STABLE kernel
panics. I've attached the output of a kgdb session of the saved core
file - is there any further info that would be useful to debugging? I've
got no idea where to start looking for a solution to this problem, so
please help!!
Thanks,
Peter
leftside# kgdb kernel.debug /var/crash/vmcore.25
[GDB will not be able to debug user-mode threads:
/usr/lib/libthread_db.so: Undefined symbol "ps_pglobal_lookup"]
GNU gdb 6.1.1 [FreeBSD]
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain
conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB. Type "show warranty" for
details.
This GDB was configured as "i386-marcel-freebsd".
Ready to go. Enter 'tr' to connect to the remote target
with /dev/cuaa0, 'tr /dev/cuaa1' to connect to a different port
or 'trf portno' to connect to the remote target with the firewire
interface. portno defaults to 5556.
Type 'getsyms' after connection to load kld symbols.
If you're debugging a local system, you can use 'kldsyms' instead
to load the kld symbols. That's a less obnoxious interface.
Unread portion of the kernel message buffer:
kernel trap 12 with interrupts disabled
Fatal trap 12: page fault while in kernel mode
fault virtual address = 0x24
fault code = supervisor read, page not present
instruction pointer = 0x8:0xc066dfc3
stack pointer = 0x10:0xcbae8bfc
frame pointer = 0x10:0xcbae8c10
code segment = base 0x0, limit 0xfffff, type 0x1b
= DPL 0, pres 1, def32 1, gran 1
processor eflags = resume, IOPL = 0
current process = 16 (irq5: fxp0)
trap number = 12
panic: page fault
Uptime: 2d0h51m36s
Dumping 251 MB
16 32 48 64 80 96 112 128 144 160 176 192 208 224 240
#0 doadump () at pcpu.h:160
160 __asm __volatile("movl %%fs:0,%0" : "=r"
(td));
(kgdb) list 0xc066dfc3
Function "0xc066dfc3" not defined.
(kgdb) list *0xc066dfc3
0xc066dfc3 is in propagate_priority
(/usr/src/sys/kern/subr_turnstile.c:245).
240 /*
241 * Pick up the lock that td is blocked on.
242 */
243 ts = td->td_blocked;
244 MPASS(ts != NULL);
245 tc = TC_LOOKUP(ts->ts_lockobj);
246 mtx_lock_spin(&tc->tc_lock);
247
248 /*
249 * This thread may not be blocked on this
turnstile anymore
(kgdb) backtrace
#0 doadump () at pcpu.h:160
During symbol reading, Incomplete CFI data; unspecified registers at
0xc064fc41.
#1 0xc06501dc in boot (howto=0x104) at
/usr/src/sys/kern/kern_shutdown.c:412
#2 0xc0650470 in panic (fmt=0xc084b541 "%s") at
/usr/src/sys/kern/kern_shutdown.c:568
#3 0xc08015fc in trap_fatal (frame=0xcbae8bbc, eva=0x24) at
/usr/src/sys/i386/i386/trap.c:822
#4 0xc0800da1 in trap (frame {tf_fs = 0xc14e0018, tf_es = 0xc14f0010,
tf_ds = 0x10, tf_edi 0xc1e22c02, tf_esi = 0xc14edc00, tf_ebp = 0xcbae8c10,
tf_isp 0xcbae8be8, tf_ebx = 0xc1e22c00, tf_edx = 0xc14e4610, tf_ecx 0xc0936a00,
tf_eax = 0x0, tf_trapno = 0xc, tf_err = 0x0, tf_eip 0xc066dfc3, tf_cs = 0x8,
tf_eflags = 0x10093, tf_esp = 0x10, tf_ss = 0x0})
at /usr/src/sys/i386/i386/trap.c:257
#5 0xc07f0eea in calltrap () at /usr/src/sys/i386/i386/exception.s:140
#6 0xc14e0018 in ?? ()
#7 0xc14f0010 in ?? ()
#8 0x00000010 in ?? ()
#9 0xc1e22c02 in ?? ()
#10 0xc14edc00 in ?? ()
#11 0xcbae8c10 in ?? ()
#12 0xcbae8be8 in ?? ()
#13 0xc1e22c00 in ?? ()
#14 0xc14e4610 in ?? ()
#15 0xc0936a00 in uma_mtx ()
#16 0x00000000 in ?? ()
#17 0x0000000c in ?? ()
#18 0x00000000 in ?? ()
#19 0xc066dfc3 in propagate_priority (td=0xc1e22c00) at
/usr/src/sys/kern/subr_turnstile.c:243
#20 0xc066e63e in turnstile_wait (ts=0xc14e4600, lock=0xc0936a00,
owner=0xc1e22c00)
at /usr/src/sys/kern/subr_turnstile.c:556
#21 0xc0647af9 in _mtx_lock_sleep (m=0xc0936a00, td=0xc14edc00,
opts=0x0, file=0x0, line=0x0)
at /usr/src/sys/kern/kern_mutex.c:552
#22 0xc07b6a40 in uma_zalloc_arg (zone=0xc1045ba0, udata=0xcbae8c8c,
flags=0x1) at /usr/src/sys/vm/uma_core.c:1825
#23 0xc0544ed2 in fxp_add_rfabuf (sc=0xc1607000, rxp=0xc1607300) at
mbuf.h:401
#24 0xc0544150 in fxp_intr_body (sc=0xc1607000, ifp=0xc1607000,
statack=0x0, count=0xffffffff)
at /usr/src/sys/dev/fxp/if_fxp.c:1682
#25 0xc0543f38 in fxp_intr (xsc=0xc1607000) at
/usr/src/sys/dev/fxp/if_fxp.c:1554
#26 0xc063c849 in ithread_loop (arg=0xc14eaa80) at
/usr/src/sys/kern/kern_intr.c:547
#27 0xc063badc in fork_exit (callout=0xc063c6f8 <ithread_loop>,
arg=0xc14eaa80, frame=0xcbae8d38)
at /usr/src/sys/kern/kern_fork.c:791
#28 0xc07f0f4c in fork_trampoline () at
/usr/src/sys/i386/i386/exception.s:209
Hi everyone
Almost every day, some time around midnight, my FreeBSD 5-STABLE kernel
panics. I've attached the output of a kgdb session of the saved core
file - is there any further info that would be useful to debugging? I've
got no idea where to start looking for a solution to this problem, so
please help!!
Thanks,
Peter
leftside# kgdb kernel.debug /var/crash/vmcore.25
[GDB will not be able to debug user-mode threads:
/usr/lib/libthread_db.so: Undefined symbol "ps_pglobal_lookup"]
GNU gdb 6.1.1 [FreeBSD]
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain
conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB. Type "show warranty" for
details.
This GDB was configured as "i386-marcel-freebsd".
Ready to go. Enter 'tr' to connect to the remote target
with /dev/cuaa0, 'tr /dev/cuaa1' to connect to a different port
or 'trf portno' to connect to the remote target with the firewire
interface. portno defaults to 5556.
Type 'getsyms' after connection to load kld symbols.
If you're debugging a local system, you can use 'kldsyms' instead
to load the kld symbols. That's a less obnoxious interface.
Unread portion of the kernel message buffer:
kernel trap 12 with interrupts disabled
Fatal trap 12: page fault while in kernel mode
fault virtual address = 0x24
fault code = supervisor read, page not present
instruction pointer = 0x8:0xc066dfc3
stack pointer = 0x10:0xcbae8bfc
frame pointer = 0x10:0xcbae8c10
code segment = base 0x0, limit 0xfffff, type 0x1b
= DPL 0, pres 1, def32 1, gran 1
processor eflags = resume, IOPL = 0
current process = 16 (irq5: fxp0)
trap number = 12
panic: page fault
Uptime: 2d0h51m36s
Dumping 251 MB
16 32 48 64 80 96 112 128 144 160 176 192 208 224 240
#0 doadump () at pcpu.h:160
160 __asm __volatile("movl %%fs:0,%0" : "=r"
(td));
(kgdb) list 0xc066dfc3
Function "0xc066dfc3" not defined.
(kgdb) list *0xc066dfc3
0xc066dfc3 is in propagate_priority
(/usr/src/sys/kern/subr_turnstile.c:245).
240 /*
241 * Pick up the lock that td is blocked on.
242 */
243 ts = td->td_blocked;
244 MPASS(ts != NULL);
245 tc = TC_LOOKUP(ts->ts_lockobj);
246 mtx_lock_spin(&tc->tc_lock);
247
248 /*
249 * This thread may not be blocked on this
turnstile anymore
(kgdb) backtrace
#0 doadump () at pcpu.h:160
During symbol reading, Incomplete CFI data; unspecified registers at
0xc064fc41.
#1 0xc06501dc in boot (howto=0x104) at
/usr/src/sys/kern/kern_shutdown.c:412
#2 0xc0650470 in panic (fmt=0xc084b541 "%s") at
/usr/src/sys/kern/kern_shutdown.c:568
#3 0xc08015fc in trap_fatal (frame=0xcbae8bbc, eva=0x24) at
/usr/src/sys/i386/i386/trap.c:822
#4 0xc0800da1 in trap (frame {tf_fs = 0xc14e0018, tf_es = 0xc14f0010,
tf_ds = 0x10, tf_edi 0xc1e22c02, tf_esi = 0xc14edc00, tf_ebp = 0xcbae8c10,
tf_isp 0xcbae8be8, tf_ebx = 0xc1e22c00, tf_edx = 0xc14e4610, tf_ecx 0xc0936a00,
tf_eax = 0x0, tf_trapno = 0xc, tf_err = 0x0, tf_eip 0xc066dfc3, tf_cs = 0x8,
tf_eflags = 0x10093, tf_esp = 0x10, tf_ss = 0x0})
at /usr/src/sys/i386/i386/trap.c:257
#5 0xc07f0eea in calltrap () at /usr/src/sys/i386/i386/exception.s:140
#6 0xc14e0018 in ?? ()
#7 0xc14f0010 in ?? ()
#8 0x00000010 in ?? ()
#9 0xc1e22c02 in ?? ()
#10 0xc14edc00 in ?? ()
#11 0xcbae8c10 in ?? ()
#12 0xcbae8be8 in ?? ()
#13 0xc1e22c00 in ?? ()
#14 0xc14e4610 in ?? ()
#15 0xc0936a00 in uma_mtx ()
#16 0x00000000 in ?? ()
#17 0x0000000c in ?? ()
#18 0x00000000 in ?? ()
#19 0xc066dfc3 in propagate_priority (td=0xc1e22c00) at
/usr/src/sys/kern/subr_turnstile.c:243
#20 0xc066e63e in turnstile_wait (ts=0xc14e4600, lock=0xc0936a00,
owner=0xc1e22c00)
at /usr/src/sys/kern/subr_turnstile.c:556
#21 0xc0647af9 in _mtx_lock_sleep (m=0xc0936a00, td=0xc14edc00,
opts=0x0, file=0x0, line=0x0)
at /usr/src/sys/kern/kern_mutex.c:552
#22 0xc07b6a40 in uma_zalloc_arg (zone=0xc1045ba0, udata=0xcbae8c8c,
flags=0x1) at /usr/src/sys/vm/uma_core.c:1825
#23 0xc0544ed2 in fxp_add_rfabuf (sc=0xc1607000, rxp=0xc1607300) at
mbuf.h:401
#24 0xc0544150 in fxp_intr_body (sc=0xc1607000, ifp=0xc1607000,
statack=0x0, count=0xffffffff)
at /usr/src/sys/dev/fxp/if_fxp.c:1682
#25 0xc0543f38 in fxp_intr (xsc=0xc1607000) at
/usr/src/sys/dev/fxp/if_fxp.c:1554
#26 0xc063c849 in ithread_loop (arg=0xc14eaa80) at
/usr/src/sys/kern/kern_intr.c:547
#27 0xc063badc in fork_exit (callout=0xc063c6f8 <ithread_loop>,
arg=0xc14eaa80, frame=0xcbae8d38)
at /usr/src/sys/kern/kern_fork.c:791
#28 0xc07f0f4c in fork_trampoline () at
/usr/src/sys/i386/i386/exception.s:209