Hi,
I need some help to understand a backtrace.
The situation is as follows:
A diskless system acting as a kind of bandwithshaping firewall with both
ipfw2 and ipfilter active at the same time. Ipfilter is used for port
adress translation. The system panics about once every 6 hours. The
network load is very low, only one Windows XP machine is connected but
not actively used.
I added a disk to be able to get a core dump. The disk is only used to
save the core.
Here follows the backtrace from gdb. I used both the output of the
savecore command and the debug-version of the kernel in use.
# gdb -k kernel.0 vmcore.0
GNU gdb 4.18 (FreeBSD)
Copyright 1998 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain
conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB. Type "show warranty" for
details.
This GDB was configured as "i386-unknown-freebsd"...(no debugging
symbols found)...
IdlePTD at phsyical address 0x05332000
initial pcb at physical address 0x0029f980
panicstr: page fault
panic messages:
---
Fatal trap 9: general protection fault while in kernel mode
instruction pointer = 0x8:0xc023ceeb
stack pointer = 0x10:0xcf7d9ea4
frame pointer = 0x10:0xcf7d9ec0
code segment = base 0x0, limit 0xfffff, type 0x1b
= DPL 0, pres 1, def32 1, gran 1
processor eflags = resume, IOPL = 0
current process = Idle
interrupt mask = net tty bio cam
trap number = 9
panic: general protection fault
syncing disks...
Fatal trap 12: page fault while in kernel mode
fault virtual address = 0x10
fault code = supervisor read, page not present
instruction pointer = 0x8:0xc01fffde
stack pointer = 0x10:0xcf7d9b2c
frame pointer = 0x10:0xcf7d9b84
code segment = base 0x0, limit 0xfffff, type 0x1b
= DPL 0, pres 1, def32 1, gran 1
processor eflags = interrupt enabled, resume, IOPL = 0
current process = Idle
interrupt mask = net tty bio cam
trap number = 12
panic: page fault
Uptime: 2h44m51s
dumping to dev #ad/0x20001, offset 526336
dump ata0: resetting devices .. done
255 254 253 252 251 250 249 248 247 246 245 244 243 242 241 240 239 238
237 236 235 234 233 232 231 230 229 228 227 226 225 224 223 222 221 220
219 218 217 216 215 214 213 212 211 210 209 208 207 206 205 204 203 202
201 200 199 198 197 196 195 194 193 192 191 190 189 188 187 186 185 184
183 182 181 180 179 178 177 176 175 174 173 172 171 170 169 168 167 166
165 164 163 162 161 160 159 158 157 156 155 154 153 152 151 150 149 148
147 146 145 144 143 142 141 140 139 138 137 136 135 134 133 132 131 130
129 128 127 126 125 124 123 122 121 120 119 118 117 116 115 114 113 112
111 110 109 108 107 106 105 104 103 102 101 100 99 98 97 96 95 94 93 92
91 90 89 88 87 86 85 84 83 82 81 80 79 78 77 76 75 74 73 72 71 70 69 68
67 66 65 64 63 62 61 60 59 58 57 56 55 54 53 52 51 50 49 48 47 46 45 44
43 42 41 40 39 38 37 36 35 34 33 32 31 30 29 28 27 26 25 24 23 22 21 20
19 18 17 16 15 14 13 12 11 10 9 8 7 6 5 4 3 2 1
---
#0 0xc01720be in dumpsys ()
(kgdb) bt
#0 0xc01720be in dumpsys ()
#1 0xc0171e8f in boot ()
#2 0xc01722b4 in poweroff_wait ()
#3 0xc023dd1e in trap_fatal ()
#4 0xc023d9f1 in trap_pfault ()
#5 0xc023d5af in trap ()
#6 0xc01fffde in vnode_pager_generic_putpages ()
#7 0xc01eab72 in ffs_putpages ()
#8 0xc01ffe3a in vnode_pager_putpages ()
#9 0xc01fcdb8 in vm_pageout_flush ()
#10 0xc01fa38e in vm_object_page_collect_flush ()
#11 0xc01f9f91 in vm_object_page_clean ()
#12 0xc01a11f5 in vfs_msync ()
#13 0xc01a2194 in sync ()
#14 0xc0171c2a in boot ()
#15 0xc01722b4 in poweroff_wait ()
#16 0xc023dd1e in trap_fatal ()
#17 0xc023d6fb in trap ()
#18 0xc023ceeb in sw1a ()
#19 0xc0174ff1 in tsleep ()
#20 0xc016aa78 in wait1 ()
#21 0xc016a704 in wait4 ()
#22 0xc023dfcd in syscall2 ()
#23 0xc022f3f5 in Xint0x80_syscall ()
cannot read proc at 0
...the debug-kernel:
# gdb -k kernel.debug vmcore.0
GNU gdb 4.18 (FreeBSD)
Copyright 1998 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain
conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB. Type "show warranty" for
details.
This GDB was configured as "i386-unknown-freebsd"...Deprecated
bfd_read
called at
/usr/src/gnu/usr.bin/binutils/gdb/../../../../contrib/gdb/gdb/dbxread.c
line 2627 in elfstab_build_psymtabs
Deprecated bfd_read called at
/usr/src/gnu/usr.bin/binutils/gdb/../../../../contrib/gdb/gdb/dbxread.c
line 933 in fill_symbuf
IdlePTD at phsyical address 0x05332000
initial pcb at physical address 0x0029f980
panicstr: page fault
panic messages:
---
Syntax error: Unterminated quoted string
---
#0 dumpsys () at /usr/src/sys/kern/kern_shutdown.c:487
487 if (dumping++) {
(kgdb) bt
#0 dumpsys () at /usr/src/sys/kern/kern_shutdown.c:487
#1 0xc0171e8f in boot (howto=260) at /usr/src/sys/kern/kern_shutdown.c:316
#2 0xc01722b4 in poweroff_wait (junk=0xc0272a6c, howto=-1071176305) at
/usr/src/sys/kern/kern_shutdown.c:595
#3 0xc023dd1e in trap_fatal (frame=0xcf7d9aec, eva=16) at
/usr/src/sys/i386/i386/trap.c:974
#4 0xc023d9f1 in trap_pfault (frame=0xcf7d9aec, usermode=0, eva=16) at
/usr/src/sys/i386/i386/trap.c:867
#5 0xc023d5af in trap (frame={tf_fs = 16, tf_es = -972488688, tf_ds =
-813891568, tf_edi = 5, tf_esi = 0, tf_ebp = -813851772,
tf_isp = -813851880, tf_ebx = 0, tf_edx = 32, tf_ecx = 20480,
tf_eax = 0, tf_trapno = 12, tf_err = 0, tf_eip = -1071644706,
tf_cs = 8, tf_eflags = 66118, tf_esp = -813768384, tf_ss = 12})
at /usr/src/sys/i386/i386/trap.c:466
#6 0xc01fffde in vnode_pager_generic_putpages (vp=0xcf7ee140,
m=0xcf7d9c34, bytecount=20480, flags=12, rtvals=0xcf7d9bf4)
at /usr/src/sys/vm/vnode_pager.c:1034
#7 0xc01eab72 in ffs_putpages (ap=0xcf7d9bb8) at
/usr/src/sys/ufs/ufs/ufs_readwrite.c:741
#8 0xc01ffe3a in vnode_pager_putpages (object=0xcf824600, m=0xcf7d9c34,
count=5, sync=12, rtvals=0xcf7d9bf4) at vnode_if.h:1147
#9 0xc01fcdb8 in vm_pageout_flush (mc=0xcf7d9c34, count=5, flags=12) at
/usr/src/sys/vm/vm_pager.h:147
#10 0xc01fa38e in vm_object_page_collect_flush (object=0xcf824600,
p=0xc582f3fc, curgeneration=1209, pagerflags=12)
at /usr/src/sys/vm/vm_object.c:806
#11 0xc01f9f91 in vm_object_page_clean (object=0xcf824600, start=0,
end=0, flags=4) at /usr/src/sys/vm/vm_object.c:605
#12 0xc01a11f5 in vfs_msync (mp=0xc6016200, flags=2) at
/usr/src/sys/kern/vfs_subr.c:2710
#13 0xc01a2194 in sync (p=0xc02b73a0, uap=0x0) at
/usr/src/sys/kern/vfs_syscalls.c:575
#14 0xc0171c2a in boot (howto=256) at /usr/src/sys/kern/kern_shutdown.c:235
#15 0xc01722b4 in poweroff_wait (junk=0xc0272a6c, howto=-1071176283) at
/usr/src/sys/kern/kern_shutdown.c:595
#16 0xc023dd1e in trap_fatal (frame=0xcf7d9e64, eva=0) at
/usr/src/sys/i386/i386/trap.c:974
#17 0xc023d6fb in trap (frame={tf_fs = 16, tf_es = 134938640, tf_ds =
-982253552, tf_edi = -971835344, tf_esi = 32,
tf_ebp = -813850944, tf_isp = -813850992, tf_ebx = -1070885216,
tf_edx = -812732416, tf_ecx = -831483840,
tf_eax = 336283586, tf_trapno = 9, tf_err = 32, tf_eip =
-1071395093, tf_cs = 8, tf_eflags = 65670, tf_esp = -1072211888,
tf_ss = -831471360}) at /usr/src/sys/i386/i386/trap.c:636
#18 0xc023ceeb in sw1a ()
#19 0xc0174ff1 in tsleep (ident=0xce70c100, priority=288,
wmesg=0xc02530a5 "wait", timo=0) at /usr/src/sys/kern/kern_synch.c:479
#20 0xc016aa78 in wait1 (q=0xce70c100, uap=0xcf7d9f80, compat=0) at
/usr/src/sys/kern/kern_exit.c:572
#21 0xc016a704 in wait4 (p=0xce70c100, uap=0xcf7d9f80) at
/usr/src/sys/kern/kern_exit.c:414
#22 0xc023dfcd in syscall2 (frame={tf_fs = 47, tf_es = 47, tf_ds = 47,
tf_edi = 135016448, tf_esi = -1077937192,
tf_ebp = -1077937408, tf_isp = -813850668, tf_ebx = 1, tf_edx =
0, tf_ecx = 135016448, tf_eax = 7, tf_trapno = 12,
tf_err = 2, tf_eip = 134699240, tf_cs = 31, tf_eflags = 658,
tf_esp = -1077937436, tf_ss = 47})
at /usr/src/sys/i386/i386/trap.c:1175
#23 0xc022f3f5 in Xint0x80_syscall ()
cannot read proc at 0
Any hint on whats happening?
Regards,
Jonas