Rebooted the router in front of this server, and when all was said and
done, I found this panic.
VMCore available.
I *DID* do a svn up AFTER this to:
FreeBSD thebighonker.lerctr.org 10.1-PRERELEASE FreeBSD 10.1-PRERELEASE #6
r273918: Fri Oct 31 16:00:24 CDT 2014 root at
thebighonker.lerctr.org:/usr/obj/usr/src/sys/GENERIC amd64
thebighonker.lerctr.org dumped core - see /var/crash/vmcore.0
Fri Oct 31 15:41:41 CDT 2014
FreeBSD thebighonker.lerctr.org 10.1-PRERELEASE FreeBSD 10.1-PRERELEASE #5
r273589: Fri Oct 24 10:50:58 CDT 2014 root at
thebighonker.lerctr.org:/usr/obj/usr/src/sys/GENERIC amd64
panic: page fault
GNU gdb 6.1.1 [FreeBSD]
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB. Type "show warranty" for
details.
This GDB was configured as "amd64-marcel-freebsd"...
Unread portion of the kernel message buffer:
Reading symbols from /boot/kernel/zfs.ko.symbols...done.
Loaded symbols for /boot/kernel/zfs.ko.symbols
Reading symbols from /boot/kernel/opensolaris.ko.symbols...done.
Loaded symbols for /boot/kernel/opensolaris.ko.symbols
Reading symbols from /boot/kernel/if_lagg.ko.symbols...done.
Loaded symbols for /boot/kernel/if_lagg.ko.symbols
Reading symbols from /boot/kernel/ipmi.ko.symbols...done.
Loaded symbols for /boot/kernel/ipmi.ko.symbols
Reading symbols from /boot/kernel/smbus.ko.symbols...done.
Loaded symbols for /boot/kernel/smbus.ko.symbols
Reading symbols from /boot/kernel/crypto.ko.symbols...done.
Loaded symbols for /boot/kernel/crypto.ko.symbols
Reading symbols from /boot/kernel/cryptodev.ko.symbols...done.
Loaded symbols for /boot/kernel/cryptodev.ko.symbols
Reading symbols from /boot/kernel/hwpmc.ko.symbols...done.
Loaded symbols for /boot/kernel/hwpmc.ko.symbols
Reading symbols from /boot/kernel/dtraceall.ko.symbols...done.
Loaded symbols for /boot/kernel/dtraceall.ko.symbols
Reading symbols from /boot/kernel/profile.ko.symbols...done.
Loaded symbols for /boot/kernel/profile.ko.symbols
Reading symbols from /boot/kernel/cyclic.ko.symbols...done.
Loaded symbols for /boot/kernel/cyclic.ko.symbols
Reading symbols from /boot/kernel/dtrace.ko.symbols...done.
Loaded symbols for /boot/kernel/dtrace.ko.symbols
Reading symbols from /boot/kernel/systrace_freebsd32.ko.symbols...done.
Loaded symbols for /boot/kernel/systrace_freebsd32.ko.symbols
Reading symbols from /boot/kernel/systrace.ko.symbols...done.
Loaded symbols for /boot/kernel/systrace.ko.symbols
Reading symbols from /boot/kernel/sdt.ko.symbols...done.
Loaded symbols for /boot/kernel/sdt.ko.symbols
Reading symbols from /boot/kernel/lockstat.ko.symbols...done.
Loaded symbols for /boot/kernel/lockstat.ko.symbols
Reading symbols from /boot/kernel/fasttrap.ko.symbols...done.
Loaded symbols for /boot/kernel/fasttrap.ko.symbols
Reading symbols from /boot/kernel/fbt.ko.symbols...done.
Loaded symbols for /boot/kernel/fbt.ko.symbols
Reading symbols from /boot/kernel/dtnfscl.ko.symbols...done.
Loaded symbols for /boot/kernel/dtnfscl.ko.symbols
Reading symbols from /boot/kernel/dtmalloc.ko.symbols...done.
Loaded symbols for /boot/kernel/dtmalloc.ko.symbols
Reading symbols from /boot/kernel/fdescfs.ko.symbols...done.
Loaded symbols for /boot/kernel/fdescfs.ko.symbols
Reading symbols from /boot/kernel/ums.ko.symbols...done.
Loaded symbols for /boot/kernel/ums.ko.symbols
Reading symbols from /boot/kernel/uplcom.ko.symbols...done.
Loaded symbols for /boot/kernel/uplcom.ko.symbols
Reading symbols from /boot/kernel/ucom.ko.symbols...done.
Loaded symbols for /boot/kernel/ucom.ko.symbols
Reading symbols from /boot/kernel/linux.ko.symbols...done.
Loaded symbols for /boot/kernel/linux.ko.symbols
Reading symbols from /boot/kernel/cpuctl.ko.symbols...done.
Loaded symbols for /boot/kernel/cpuctl.ko.symbols
#0 doadump (textdump=<value optimized out>) at pcpu.h:219
219 pcpu.h: No such file or directory.
in pcpu.h
(kgdb) #0 doadump (textdump=<value optimized out>) at pcpu.h:219
#1 0xffffffff809282a2 in kern_reboot (howto=260)
at /usr/src/sys/kern/kern_shutdown.c:452
#2 0xffffffff80928664 in panic (fmt=<value optimized out>)
at /usr/src/sys/kern/kern_shutdown.c:759
#3 0xffffffff80d25f7f in trap_fatal (frame=<value optimized out>,
eva=<value optimized out>) at /usr/src/sys/amd64/amd64/trap.c:865
#4 0xffffffff80d26298 in trap_pfault (frame=0xfffffe0468f9c750,
usermode=<value optimized out>) at /usr/src/sys/amd64/amd64/trap.c:676
#5 0xffffffff80d258fa in trap (frame=0xfffffe0468f9c750)
at /usr/src/sys/amd64/amd64/trap.c:440
#6 0xffffffff80d0b6a2 in calltrap ()
at /usr/src/sys/amd64/amd64/exception.S:232
#7 0x0000000000001000 in ?? ()
#8 0xffffffff81975286 in arc_read_done (zio=0xfffff8034033b730)
at
/usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/arc.c:3191
#9 0xffffffff819f40de in zio_done (zio=0xfffff8034033b730)
at
/usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:3316
#10 0xffffffff819effd2 in zio_execute (zio=0xfffff8034033b730)
at
/usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:1414
#11 0xffffffff819f423f in zio_done (zio=0xfffff8021d2d3000)
at
/usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:3326
#12 0xffffffff819effd2 in zio_execute (zio=0xfffff8021d2d3000)
at
/usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:1414
#13 0xffffffff819f423f in zio_done (zio=0xfffff8030cf85ac8)
at
/usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:3326
#14 0xffffffff819effd2 in zio_execute (zio=0xfffff8030cf85ac8)
at
/usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:1414
#15 0xffffffff809719b5 in taskqueue_run_locked (queue=0xfffff8000f626b00)
at /usr/src/sys/kern/subr_taskqueue.c:342
#16 0xffffffff80972448 in taskqueue_thread_loop (arg=<value optimized
out>)
at /usr/src/sys/kern/subr_taskqueue.c:563
#17 0xffffffff808f906a in fork_exit (
callout=0xffffffff809723a0 <taskqueue_thread_loop>,
arg=0xfffff8000f0c3270, frame=0xfffffe0468f9cc00)
at /usr/src/sys/kern/kern_fork.c:996
#18 0xffffffff80d0bbde in fork_trampoline ()
at /usr/src/sys/amd64/amd64/exception.S:606
#19 0x0000000000000000 in ?? ()
Current language: auto; currently minimal
(kgdb)
Ideas?
--
Larry Rosenman http://www.lerctr.org/~ler
Phone: +1 214-642-9640 E-Mail: ler at lerctr.org
US Mail: 108 Turvey Cove, Hutto, TX 78634-5688