Hi, This is another reproducible panic. This seems to happen only when top(1) is running for a long time (a sysctl() call for CTL_KERN.KERN_PROC.KERN_PROC_PROC MIB triggered it). ---- pool.allbsd.org dumped core - see /var/crash/vmcore.0 Thu Feb 23 23:21:52 JST 2012 FreeBSD pool.allbsd.org 8.3-PRERELEASE FreeBSD 8.3-PRERELEASE #8: Thu Feb 23 04:40:54 JST 2012 hrs@pool.allbsd.org:/usr/obj/usr/src/sys/POOL amd64 panic: GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "amd64-marcel-freebsd"... Unread portion of the kernel message buffer: Fatal trap 12: page fault while in kernel mode cpuid = 4; apic id = 04 fault virtual address = 0x800e96000 fault code = supervisor write data, protection violation instruction pointer = 0x20:0xffffffff809440cb stack pointer = 0x28:0xffffff86c63890b0 frame pointer = 0x28:0xffffff86c6389100 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 47211 (top) lock order reversal: (Giant after non-sleepable) 1st 0xffffff0244b85568 process lock (process lock) @ /usr/src/sys/kern/kern_proc.c:1211 2nd 0xffffffff80d74c80 Giant (Giant) @ /usr/src/sys/dev/usb/input/ukbd.c:2018 KDB: stack backtrace: Dumping 23903 out of 24550 MB:..1%..11%..21%..31% (CTRL-C to abort) (CTRL-C to abort) ..41%..51%..61%..71%..81%..91% Reading symbols from /boot/kernel/geom_mirror.ko...Reading symbols from /boot/kernel/geom_mirror.ko.symbols...done. done. Loaded symbols for /boot/kernel/geom_mirror.ko Reading symbols from /boot/kernel/zfs.ko...Reading symbols from /boot/kernel/zfs.ko.symbols...done. done. Loaded symbols for /boot/kernel/zfs.ko Reading symbols from /boot/kernel/opensolaris.ko...Reading symbols from /boot/kernel/opensolaris.ko.symbols...done. done. Loaded symbols for /boot/kernel/opensolaris.ko Reading symbols from /boot/kernel/ipfw.ko...Reading symbols from /boot/kernel/ipfw.ko.symbols...done. done. Loaded symbols for /boot/kernel/ipfw.ko #0 doadump () at /usr/src/sys/kern/kern_shutdown.c:263 263 if (textdump_pending) (kgdb) #0 doadump () at /usr/src/sys/kern/kern_shutdown.c:263 #1 0xffffffff801f8cfc in db_fncall (dummy1=Variable "dummy1" is not available. ) at /usr/src/sys/ddb/db_command.c:548 #2 0xffffffff801f9031 in db_command (last_cmdp=0xffffffff80d37f40, cmd_table=Variable "cmd_table" is not available. ) at /usr/src/sys/ddb/db_command.c:445 #3 0xffffffff801f9280 in db_command_loop () at /usr/src/sys/ddb/db_command.c:498 #4 0xffffffff801fb369 in db_trap (type=Variable "type" is not available. ) at /usr/src/sys/ddb/db_main.c:229 #5 0xffffffff8069dff1 in kdb_trap (type=12, code=0, tf=0xffffff86c6389000) at /usr/src/sys/kern/subr_kdb.c:548 #6 0xffffffff809461ed in trap_fatal (frame=0xffffff86c6389000, eva=Variable "eva" is not available. ) at /usr/src/sys/amd64/amd64/trap.c:820 #7 0xffffffff809468b5 in trap (frame=0xffffff86c6389000) at /usr/src/sys/amd64/amd64/trap.c:326 #8 0xffffffff8092d2f4 in calltrap () at /usr/src/sys/amd64/amd64/exception.S:228 #9 0xffffffff809440cb in copyout () at /usr/src/sys/amd64/amd64/support.S:258 #10 0xffffffff80675f1f in sysctl_old_user (req=0xffffff86c63899c0, p=0xffffff86c6389470, l=1088) at /usr/src/sys/kern/kern_sysctl.c:1276 #11 0xffffffff8065f6a6 in sysctl_out_proc_copyout (ki=0xffffff86c6389470, req=0xffffff86c63899c0) at /usr/src/sys/kern/kern_proc.c:1085 #12 0xffffffff8065ff6c in sysctl_out_proc (p=0xffffff0244b85470, req=0xffffff86c63899c0, flags=Variable "flags" is not available. ) at /usr/src/sys/kern/kern_proc.c:1114 #13 0xffffffff8066245e in sysctl_kern_proc (oidp=Variable "oidp" is not available. ) at /usr/src/sys/kern/kern_proc.c:1302 #14 0xffffffff806756e8 in sysctl_root (oidp=Variable "oidp" is not available. ) at /usr/src/sys/kern/kern_sysctl.c:1455 #15 0xffffffff8067598e in userland_sysctl (td=0x0, name=0xffffff86c6389a80, namelen=3, old=0x800e96000, oldlenp=Variable "oldlenp" is not available. ) at /usr/src/sys/kern/kern_sysctl.c:1565 #16 0xffffffff80675e3a in __sysctl (td=0xffffff0396ec5460, uap=0xffffff86c6389bc0) at /usr/src/sys/kern/kern_sysctl.c:1491 #17 0xffffffff80945809 in amd64_syscall (td=0xffffff0396ec5460, traced=0) at subr_syscall.c:114 #18 0xffffffff8092d5ec in Xfast_syscall () at /usr/src/sys/amd64/amd64/exception.S:387 #19 0x0000000800abecfc in ?? () Previous frame inner to this frame (corrupt stack?) (kgdb) ---- db> show alllocks Process 1169 (sshd) thread 0xffffff0022cfa460 (100715) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xffffff0022d358f0) locked @ /usr/src/sys/kern/uipc_sockbuf.c:148 Process 865 (nfsd) thread 0xffffff00221b8000 (100611) exclusive lockmgr zfs (zfs) r = 0 (0xffffff02430e7d80) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700 Process 865 (nfsd) thread 0xffffff00221b28c0 (100595) shared lockmgr zfs (zfs) r = 0 (0xffffff053a49fd80) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700 Process 865 (nfsd) thread 0xffffff00221b3460 (100593) exclusive lockmgr zfs (zfs) r = 0 (0xffffff01e3aa87f8) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700 Process 865 (nfsd) thread 0xffffff002219a8c0 (100590) exclusive lockmgr zfs (zfs) r = 0 (0xffffff0570d1f620) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700 Process 865 (nfsd) thread 0xffffff00221a2460 (100579) shared lockmgr zfs (zfs) r = 0 (0xffffff0566a86d80) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700 Process 865 (nfsd) thread 0xffffff0022193460 (100574) exclusive lockmgr zfs (zfs) r = 0 (0xffffff05cbbc4ba8) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700 Process 865 (nfsd) thread 0xffffff0022194000 (100572) shared lockmgr zfs (zfs) r = 0 (0xffffff001d4137f8) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700 Process 865 (nfsd) thread 0xffffff0022195000 (100569) exclusive lockmgr zfs (zfs) r = 0 (0xffffff056d8cb620) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700 Process 865 (nfsd) thread 0xffffff002218f000 (100549) shared lockmgr zfs (zfs) r = 0 (0xffffff02a8fcbd80) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700 Process 865 (nfsd) thread 0xffffff002218f8c0 (100547) exclusive lockmgr zfs (zfs) r = 0 (0xffffff0482a7d7f8) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700 Process 865 (nfsd) thread 0xffffff0022188460 (100534) exclusive lockmgr zfs (zfs) r = 0 (0xffffff01d13d0ba8) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700 Process 865 (nfsd) thread 0xffffff002218a000 (100532) shared lockmgr zfs (zfs) r = 0 (0xffffff0071c7e620) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700 Process 865 (nfsd) thread 0xffffff002218a8c0 (100530) shared lockmgr zfs (zfs) r = 0 (0xffffff017cc947f8) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700 Process 865 (nfsd) thread 0xffffff00222fa8c0 (100525) exclusive lockmgr zfs (zfs) r = 0 (0xffffff014757aba8) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700 exclusive lockmgr zfs (zfs) r = 0 (0xffffff0366c7f9d0) locked @ /usr/src/sys/kern/vfs_lookup.c:504 Process 865 (nfsd) thread 0xffffff00222fb000 (100524) exclusive lockmgr zfs (zfs) r = 0 (0xffffff01b735b448) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700 Process 865 (nfsd) thread 0xffffff0022183000 (100515) shared lockmgr zfs (zfs) r = 0 (0xffffff058c41c098) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700 Process 865 (nfsd) thread 0xffffff0022183460 (100514) exclusive lockmgr zfs (zfs) r = 0 (0xffffff01dc0ebd80) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700 Process 865 (nfsd) thread 0xffffff00222f28c0 (100505) exclusive lockmgr zfs (zfs) r = 0 (0xffffff04b1503098) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700 Process 865 (nfsd) thread 0xffffff00222f5460 (100500) shared lockmgr zfs (zfs) r = 0 (0xffffff05d7345620) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700 Process 865 (nfsd) thread 0xffffff00222f6000 (100498) exclusive lockmgr zfs (zfs) r = 0 (0xffffff02db1fb448) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700 Process 865 (nfsd) thread 0xffffff00222e88c0 (100494) shared lockmgr zfs (zfs) r = 0 (0xffffff02f6ccf620) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700 Process 865 (nfsd) thread 0xffffff00222ea460 (100489) exclusive sleep mutex mbuf (UMA zone) r = 0 (0xffffff063ffdf010) locked @ /usr/src/sys/vm/uma_core.c:2549 Process 865 (nfsd) thread 0xffffff00222ec460 (100483) exclusive lockmgr zfs (zfs) r = 0 (0xffffff05f6827448) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700 Process 865 (nfsd) thread 0xffffff00222e28c0 (100477) exclusive sleep mutex nfs_cache_mutex (nfs_cache_mutex) r = 0 (0xffffffff80d6af00) locked @ /usr/src/sys/fs/nfsserver/nfs_nfsdcache.c:710 Process 865 (nfsd) thread 0xffffff00222e4460 (100472) exclusive lockmgr zfs (zfs) r = 0 (0xffffff06102dc9d0) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700 Process 865 (nfsd) thread 0xffffff00222e78c0 (100465) shared lockmgr zfs (zfs) r = 0 (0xffffff00314249d0) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700 Process 865 (nfsd) thread 0xffffff00222d88c0 (100460) shared lockmgr zfs (zfs) r = 0 (0xffffff05f94be448) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700 Process 865 (nfsd) thread 0xffffff00222d9460 (100458) exclusive lockmgr zfs (zfs) r = 0 (0xffffff03901d19d0) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700 Process 865 (nfsd) thread 0xffffff00222dc460 (100449) shared lockmgr zfs (zfs) r = 0 (0xffffff013b57d9d0) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700 Process 865 (nfsd) thread 0xffffff00222ce8c0 (100443) exclusive lockmgr zfs (zfs) r = 0 (0xffffff0392ed5270) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700 Process 865 (nfsd) thread 0xffffff00222d3000 (100433) exclusive lockmgr zfs (zfs) r = 0 (0xffffff0034744ba8) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700 Process 865 (nfsd) thread 0xffffff002203c000 (100425) shared lockmgr zfs (zfs) r = 0 (0xffffff05c3947620) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700 Process 865 (nfsd) thread 0xffffff00222c1000 (100416) exclusive lockmgr zfs (zfs) r = 0 (0xffffff05102cf620) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700 Process 865 (nfsd) thread 0xffffff00222728c0 (100412) shared lockmgr zfs (zfs) r = 0 (0xffffff025c88a620) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700 Process 865 (nfsd) thread 0xffffff000cfb0460 (100407) exclusive lockmgr zfs (zfs) r = 0 (0xffffff01b121f448) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700 Process 865 (nfsd) thread 0xffffff00222b78c0 (100386) shared lockmgr zfs (zfs) r = 0 (0xffffff0199eaad80) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700 Process 865 (nfsd) thread 0xffffff00222b3000 (100368) exclusive lockmgr zfs (zfs) r = 0 (0xffffff0493abad80) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700 Process 18 (syncer) thread 0xffffff000c81d000 (100108) exclusive lockmgr syncer (syncer) r = 0 (0xffffff000e0b1ba8) locked @ /usr/src/sys/kern/vfs_subr.c:1770 --- ------------------------------------------------------------------------ ps -axl UID PID PPID CPU PRI NI VSZ RSS MWCHAN STAT TT TIME COMMAND 0 0 0 0 -8 0 0 0 - DLs ?? 237844023158:14.90 [kernel] 0 1 0 0 52 0 3200 0 wait DLs ?? 2999235:54.00 [init] 0 2 0 0 -8 0 0 0 - DL ?? 2583291:48.00 [g_event] 0 3 0 0 -8 0 0 0 - RL ?? 8333529047:38.00 [g_up] 0 4 0 0 -8 0 0 0 - DL ?? 15508645836:58.00 [g_down] 0 5 0 0 -16 0 0 0 mps_sc DL ?? 6921236:34.00 [mps_scan0] 0 6 0 0 -16 0 0 0 waitin DL ?? 1851:28.00 [sctp_itera 0 7 0 0 -16 0 0 0 ccb_sc DL ?? 0:00.00 [xpt_thrd] 0 8 0 0 -16 0 0 0 psleep DL ?? 1117119713:56.00 [pagedaemon 0 9 0 0 -16 0 0 0 psleep DL ?? 398139:12.00 [vmdaemon] 0 10 0 0 -16 0 0 0 audit_ DL ?? 0:00.00 [audit] 0 11 0 0 171 0 0 0 - RL ?? 184151273702:09.87 [idle] 0 12 0 0 -60 0 0 0 - WL ?? 30539688189:18.00 [intr] 0 13 0 0 -16 0 0 0 - DL ?? 3943794171:44.00 [yarrow] 0 14 0 0 -40 0 0 0 - DL ?? 126924074:38.00 [usb] 0 15 0 0 76 0 0 0 pgzero DL ?? 24451:52.00 [pagezero] 0 16 0 0 -16 0 0 0 psleep DL ?? 8680471:14.00 [bufdaemon] 0 17 0 0 47 0 0 0 vlruwt DL ?? 1621276224:34.00 [vnlru] 0 18 0 0 20 0 0 0 syncer DL ?? 6868829552:00.00 [syncer] 0 19 0 0 -16 0 0 0 sdflus DL ?? 23321024:10.00 [softdepflu 0 20 0 0 -8 0 0 0 m:w1 DL ?? 46710556:18.00 [g_mirror g 0 60 0 0 -8 0 0 0 tx->tx DL ?? 59193927259:42.00 [zfskern] 0 113 0 0 -8 0 0 0 mdwait DL ?? 60546:18.00 [md0] 0 153 1 0 76 0 5832 508 pause DWs ?? 0:00.00 [adjkerntz] 0 732 1 0 44 0 6920 0 swread DLs ?? 4569221:32.00 [syslogd] 0 747 1 0 44 0 7976 0 select Ds ?? 5012299:26.00 [rpcbind] 0 782 1 0 76 0 6920 0 select Ds ?? 82364:00.00 [mountd] 0 800 1 0 76 0 5832 572 pause DWs ?? 0:00.00 [nfsuserd] 0 801 800 0 44 0 5832 0 select D ?? 1295896:48.00 [nfsuserd] 0 802 800 0 44 0 5832 0 select D ?? 1461188:16.00 [nfsuserd] 0 803 800 0 44 0 5832 0 select D ?? 1316882:20.00 [nfsuserd] 0 804 800 0 44 0 5832 0 select D ?? 1298376:06.00 [nfsuserd] 0 806 1 0 44 0 5828 0 select Ds ?? 1779972:34.00 [nfsd] 0 807 806 0 44 0 5828 0 rpcsvc D ?? 283962954521:04.24 [nfsd] 0 810 1 0 44 0 269036 0 select Ds ?? 1865349:46.00 [rpc.statd] 0 813 1 0 44 0 7976 0 rpcsvc Ds ?? 1741008680:34.00 [rpc.lockd] 0 852 1 0 44 0 11804 0 select Ds ?? 110532173:34.00 [ntpd] 1 860 1 0 44 0 5828 612 sbwait Ds ?? 29900093:08.00 [rwhod] 0 871 1 0 44 0 20908 0 select Ds ?? 110118584:36.00 [perl5.10.1 0 975 1 0 46 0 26172 0 select Ds ?? 1189785:06.00 [sshd] 0 1011 1 0 44 0 12024 0 select Ds ?? 33266547:42.00 [sendmail] 25 1029 1 0 44 0 12024 1040 pause DWs ?? 0:00.00 [sendmail] 0 1043 1 0 44 0 7976 732 nanslp Ds ?? 5102323:00.00 [cron] 0 1110 1 0 76 0 6916 0 ttyin Ds+ ?? 85587:56.00 [getty] 0 1111 1 0 76 0 6916 0 ttyin Ds+ ?? 84443:56.00 [getty] 0 1112 1 0 44 0 6916 0 ttyin Ds+ ?? 92258:54.00 [getty] 0 1113 975 0 50 0 29808 1988 sbwait DWs ?? 0:00.00 [sshd] 20001 1115 1113 0 44 0 29808 0 select D ?? 71721983:56.00 [sshd] 20001 1116 1115 0 44 0 10336 812 pause DWs ?? 0:00.00 [tcsh] 20001 3161 1116 0 46 0 8344 892 wait D ?? 76296945:54.00 [sh] 20001 11908 3161 0 46 0 2764 0 nanslp D ?? 42611:20.00 [sleep] 20001 47211 1116 0 44 0 9372 0 - R+ ?? 576339426:06.00 [top] ---- -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 196 bytes Desc: not available Url : http://lists.freebsd.org/pipermail/freebsd-stable/attachments/20120223/abede90a/attachment.pgp
On Thu, Feb 23, 2012 at 11:45:58PM +0900, Hiroki Sato wrote:> Hi, > > This is another reproducible panic. This seems to happen only when > top(1) is running for a long time (a sysctl() call for > CTL_KERN.KERN_PROC.KERN_PROC_PROC MIB triggered it). > > ---- > pool.allbsd.org dumped core - see /var/crash/vmcore.0 > > Thu Feb 23 23:21:52 JST 2012 > > FreeBSD pool.allbsd.org 8.3-PRERELEASE FreeBSD 8.3-PRERELEASE #8: Thu Feb 23 04:40:54 JST 2012 hrs@pool.allbsd.org:/usr/obj/usr/src/sys/POOL amd64 > > panic: > > GNU gdb 6.1.1 [FreeBSD] > Copyright 2004 Free Software Foundation, Inc. > GDB is free software, covered by the GNU General Public License, and you are > welcome to change it and/or distribute copies of it under certain conditions. > Type "show copying" to see the conditions. > There is absolutely no warranty for GDB. Type "show warranty" for details. > This GDB was configured as "amd64-marcel-freebsd"... > > Unread portion of the kernel message buffer: > > > Fatal trap 12: page fault while in kernel mode > cpuid = 4; apic id = 04 > fault virtual address = 0x800e96000 > fault code = supervisor write data, protection violation > instruction pointer = 0x20:0xffffffff809440cb > stack pointer = 0x28:0xffffff86c63890b0 > frame pointer = 0x28:0xffffff86c6389100 > code segment = base 0x0, limit 0xfffff, type 0x1b > = DPL 0, pres 1, long 1, def32 0, gran 1 > processor eflags = interrupt enabled, resume, IOPL = 0 > current process = 47211 (top) > lock order reversal: (Giant after non-sleepable) > 1st 0xffffff0244b85568 process lock (process lock) @ /usr/src/sys/kern/kern_proc.c:1211 > 2nd 0xffffffff80d74c80 Giant (Giant) @ /usr/src/sys/dev/usb/input/ukbd.c:2018 > KDB: stack backtrace: > Dumping 23903 out of 24550 MB:..1%..11%..21%..31% (CTRL-C to abort) (CTRL-C to abort) ..41%..51%..61%..71%..81%..91% > > Reading symbols from /boot/kernel/geom_mirror.ko...Reading symbols from /boot/kernel/geom_mirror.ko.symbols...done. > done. > Loaded symbols for /boot/kernel/geom_mirror.ko > Reading symbols from /boot/kernel/zfs.ko...Reading symbols from /boot/kernel/zfs.ko.symbols...done. > done. > Loaded symbols for /boot/kernel/zfs.ko > Reading symbols from /boot/kernel/opensolaris.ko...Reading symbols from /boot/kernel/opensolaris.ko.symbols...done. > done. > Loaded symbols for /boot/kernel/opensolaris.ko > Reading symbols from /boot/kernel/ipfw.ko...Reading symbols from /boot/kernel/ipfw.ko.symbols...done. > done. > Loaded symbols for /boot/kernel/ipfw.ko > #0 doadump () at /usr/src/sys/kern/kern_shutdown.c:263 > 263 if (textdump_pending) > (kgdb) #0 doadump () at /usr/src/sys/kern/kern_shutdown.c:263 > #1 0xffffffff801f8cfc in db_fncall (dummy1=Variable "dummy1" is not available. > ) > at /usr/src/sys/ddb/db_command.c:548 > #2 0xffffffff801f9031 in db_command (last_cmdp=0xffffffff80d37f40, cmd_table=Variable "cmd_table" is not available. > > ) at /usr/src/sys/ddb/db_command.c:445 > #3 0xffffffff801f9280 in db_command_loop () > at /usr/src/sys/ddb/db_command.c:498 > #4 0xffffffff801fb369 in db_trap (type=Variable "type" is not available. > ) at /usr/src/sys/ddb/db_main.c:229 > #5 0xffffffff8069dff1 in kdb_trap (type=12, code=0, tf=0xffffff86c6389000) > at /usr/src/sys/kern/subr_kdb.c:548 > #6 0xffffffff809461ed in trap_fatal (frame=0xffffff86c6389000, eva=Variable "eva" is not available. > ) > at /usr/src/sys/amd64/amd64/trap.c:820 > #7 0xffffffff809468b5 in trap (frame=0xffffff86c6389000) > at /usr/src/sys/amd64/amd64/trap.c:326 > #8 0xffffffff8092d2f4 in calltrap () > at /usr/src/sys/amd64/amd64/exception.S:228 > #9 0xffffffff809440cb in copyout () at /usr/src/sys/amd64/amd64/support.S:258 > #10 0xffffffff80675f1f in sysctl_old_user (req=0xffffff86c63899c0, > p=0xffffff86c6389470, l=1088) at /usr/src/sys/kern/kern_sysctl.c:1276 > #11 0xffffffff8065f6a6 in sysctl_out_proc_copyout (ki=0xffffff86c6389470, > req=0xffffff86c63899c0) at /usr/src/sys/kern/kern_proc.c:1085 > #12 0xffffffff8065ff6c in sysctl_out_proc (p=0xffffff0244b85470, > req=0xffffff86c63899c0, flags=Variable "flags" is not available. > ) at /usr/src/sys/kern/kern_proc.c:1114 > #13 0xffffffff8066245e in sysctl_kern_proc (oidp=Variable "oidp" is not available. > ) > at /usr/src/sys/kern/kern_proc.c:1302 > #14 0xffffffff806756e8 in sysctl_root (oidp=Variable "oidp" is not available. > ) > at /usr/src/sys/kern/kern_sysctl.c:1455 > #15 0xffffffff8067598e in userland_sysctl (td=0x0, name=0xffffff86c6389a80, > namelen=3, old=0x800e96000, oldlenp=Variable "oldlenp" is not available. > ) > at /usr/src/sys/kern/kern_sysctl.c:1565 > #16 0xffffffff80675e3a in __sysctl (td=0xffffff0396ec5460, > uap=0xffffff86c6389bc0) at /usr/src/sys/kern/kern_sysctl.c:1491 > #17 0xffffffff80945809 in amd64_syscall (td=0xffffff0396ec5460, traced=0) > at subr_syscall.c:114 > #18 0xffffffff8092d5ec in Xfast_syscall () > at /usr/src/sys/amd64/amd64/exception.S:387 > #19 0x0000000800abecfc in ?? () > Previous frame inner to this frame (corrupt stack?) > (kgdb)Can you, please, print out the content of *td, e.g. from the frame 16 ? -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 196 bytes Desc: not available Url : http://lists.freebsd.org/pipermail/freebsd-stable/attachments/20120224/7442467c/attachment.pgp
On Fri, Feb 24, 2012 at 04:33:36PM +0200, Konstantin Belousov wrote:> On Thu, Feb 23, 2012 at 11:45:58PM +0900, Hiroki Sato wrote: > > Hi, > > > > This is another reproducible panic. This seems to happen only when > > top(1) is running for a long time (a sysctl() call for > > CTL_KERN.KERN_PROC.KERN_PROC_PROC MIB triggered it). > > > > ---- > > pool.allbsd.org dumped core - see /var/crash/vmcore.0 > > > > Thu Feb 23 23:21:52 JST 2012 > > > > FreeBSD pool.allbsd.org 8.3-PRERELEASE FreeBSD 8.3-PRERELEASE #8: Thu Feb 23 04:40:54 JST 2012 hrs@pool.allbsd.org:/usr/obj/usr/src/sys/POOL amd64 > > > > panic: > > > > GNU gdb 6.1.1 [FreeBSD] > > Copyright 2004 Free Software Foundation, Inc. > > GDB is free software, covered by the GNU General Public License, and you are > > welcome to change it and/or distribute copies of it under certain conditions. > > Type "show copying" to see the conditions. > > There is absolutely no warranty for GDB. Type "show warranty" for details. > > This GDB was configured as "amd64-marcel-freebsd"... > > > > Unread portion of the kernel message buffer: > > > > > > Fatal trap 12: page fault while in kernel mode > > cpuid = 4; apic id = 04 > > fault virtual address = 0x800e96000 > > fault code = supervisor write data, protection violation > > instruction pointer = 0x20:0xffffffff809440cb > > stack pointer = 0x28:0xffffff86c63890b0 > > frame pointer = 0x28:0xffffff86c6389100 > > code segment = base 0x0, limit 0xfffff, type 0x1b > > = DPL 0, pres 1, long 1, def32 0, gran 1 > > processor eflags = interrupt enabled, resume, IOPL = 0 > > current process = 47211 (top) > > lock order reversal: (Giant after non-sleepable) > > 1st 0xffffff0244b85568 process lock (process lock) @ /usr/src/sys/kern/kern_proc.c:1211 > > 2nd 0xffffffff80d74c80 Giant (Giant) @ /usr/src/sys/dev/usb/input/ukbd.c:2018 > > KDB: stack backtrace: > > Dumping 23903 out of 24550 MB:..1%..11%..21%..31% (CTRL-C to abort) (CTRL-C to abort) ..41%..51%..61%..71%..81%..91% > > > > Reading symbols from /boot/kernel/geom_mirror.ko...Reading symbols from /boot/kernel/geom_mirror.ko.symbols...done. > > done. > > Loaded symbols for /boot/kernel/geom_mirror.ko > > Reading symbols from /boot/kernel/zfs.ko...Reading symbols from /boot/kernel/zfs.ko.symbols...done. > > done. > > Loaded symbols for /boot/kernel/zfs.ko > > Reading symbols from /boot/kernel/opensolaris.ko...Reading symbols from /boot/kernel/opensolaris.ko.symbols...done. > > done. > > Loaded symbols for /boot/kernel/opensolaris.ko > > Reading symbols from /boot/kernel/ipfw.ko...Reading symbols from /boot/kernel/ipfw.ko.symbols...done. > > done. > > Loaded symbols for /boot/kernel/ipfw.ko > > #0 doadump () at /usr/src/sys/kern/kern_shutdown.c:263 > > 263 if (textdump_pending) > > (kgdb) #0 doadump () at /usr/src/sys/kern/kern_shutdown.c:263 > > #1 0xffffffff801f8cfc in db_fncall (dummy1=Variable "dummy1" is not available. > > ) > > at /usr/src/sys/ddb/db_command.c:548 > > #2 0xffffffff801f9031 in db_command (last_cmdp=0xffffffff80d37f40, cmd_table=Variable "cmd_table" is not available. > > > > ) at /usr/src/sys/ddb/db_command.c:445 > > #3 0xffffffff801f9280 in db_command_loop () > > at /usr/src/sys/ddb/db_command.c:498 > > #4 0xffffffff801fb369 in db_trap (type=Variable "type" is not available. > > ) at /usr/src/sys/ddb/db_main.c:229 > > #5 0xffffffff8069dff1 in kdb_trap (type=12, code=0, tf=0xffffff86c6389000) > > at /usr/src/sys/kern/subr_kdb.c:548 > > #6 0xffffffff809461ed in trap_fatal (frame=0xffffff86c6389000, eva=Variable "eva" is not available. > > ) > > at /usr/src/sys/amd64/amd64/trap.c:820 > > #7 0xffffffff809468b5 in trap (frame=0xffffff86c6389000) > > at /usr/src/sys/amd64/amd64/trap.c:326 > > #8 0xffffffff8092d2f4 in calltrap () > > at /usr/src/sys/amd64/amd64/exception.S:228 > > #9 0xffffffff809440cb in copyout () at /usr/src/sys/amd64/amd64/support.S:258 > > #10 0xffffffff80675f1f in sysctl_old_user (req=0xffffff86c63899c0, > > p=0xffffff86c6389470, l=1088) at /usr/src/sys/kern/kern_sysctl.c:1276 > > #11 0xffffffff8065f6a6 in sysctl_out_proc_copyout (ki=0xffffff86c6389470, > > req=0xffffff86c63899c0) at /usr/src/sys/kern/kern_proc.c:1085 > > #12 0xffffffff8065ff6c in sysctl_out_proc (p=0xffffff0244b85470, > > req=0xffffff86c63899c0, flags=Variable "flags" is not available. > > ) at /usr/src/sys/kern/kern_proc.c:1114 > > #13 0xffffffff8066245e in sysctl_kern_proc (oidp=Variable "oidp" is not available. > > ) > > at /usr/src/sys/kern/kern_proc.c:1302 > > #14 0xffffffff806756e8 in sysctl_root (oidp=Variable "oidp" is not available. > > ) > > at /usr/src/sys/kern/kern_sysctl.c:1455 > > #15 0xffffffff8067598e in userland_sysctl (td=0x0, name=0xffffff86c6389a80, > > namelen=3, old=0x800e96000, oldlenp=Variable "oldlenp" is not available. > > ) > > at /usr/src/sys/kern/kern_sysctl.c:1565 > > #16 0xffffffff80675e3a in __sysctl (td=0xffffff0396ec5460, > > uap=0xffffff86c6389bc0) at /usr/src/sys/kern/kern_sysctl.c:1491 > > #17 0xffffffff80945809 in amd64_syscall (td=0xffffff0396ec5460, traced=0) > > at subr_syscall.c:114 > > #18 0xffffffff8092d5ec in Xfast_syscall () > > at /usr/src/sys/amd64/amd64/exception.S:387 > > #19 0x0000000800abecfc in ?? () > > Previous frame inner to this frame (corrupt stack?) > > (kgdb) > Can you, please, print out the content of *td, e.g. from the frame 16 ?And *req from the frame 11, please. -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 196 bytes Desc: not available Url : http://lists.freebsd.org/pipermail/freebsd-stable/attachments/20120224/d3a21f97/attachment.pgp