Jilles Tjoelker
2005-Feb-21 12:18 UTC
5.3-RELEASE-p5 panic bundirty: buffer 0xd63d85e0 still on queue 1
Running graphical web browsers remotely with NFS-mounted home directories caused a panic. There was no local X server running. It took about a week of uptime to get this crash and it is not really reproducible. I have a good core though and can get additional information from it if necessary. It looks similar to this (closed because of feedback timeout) PR http://www.freebsd.org/cgi/query-pr.cgi?pr=kern/63672 and has occured before on the mailing lists. These are in kernel config:> options INVARIANTS > options INVARIANT_SUPPORT > options WITNESS > options WITNESS_SKIPSPINGood dump found on device /dev/da0s1b Architecture: i386 Architecture version: 1 Dump length: 1073217536B (1023 MB) Blocksize: 512 Dumptime: Mon Feb 21 16:40:11 2005 Hostname: snail.stack.nl Versionstring: FreeBSD 5.3-RELEASE-p5 #0: Mon Feb 14 17:30:28 CET 2005 root@snail.stack.nl:/usr/obj/usr/src/sys/SNAIL+A Panicstring: bundirty: buffer 0xd63d85e0 still on queue 1 Bounds: 28 Script started on Mon Feb 21 16:46:55 2005 # kgdb kernel.debug.28 vmcore.28 [GDB will not be able to debug user-mode threads: /usr/lib/libthread_db.so: Undefined symbol "ps_pglobal_lookup"] GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "i386-marcel-freebsd". doadump () at pcpu.h:159 (kgdb) bt full #0 doadump () at pcpu.h:159 No locals. #1 0xc051fa88 in boot (howto=260) at /usr/src/sys/kern/kern_shutdown.c:397 first_buf_printf = 1 #2 0xc051fd9d in panic ( fmt=0xc06bf883 "bundirty: buffer %p still on queue %d") at /usr/src/sys/kern/kern_shutdown.c:553 td = (struct thread *) 0xc2a92960 bootopt = 260 newpanic = 1 ap = 0xec5559f0 "?\205=?\001" buf = "bundirty: buffer 0xd63d85e0 still on queue 1", '\0' <repeats 211 times> #3 0xc055f9ec in bundirty (bp=0xd63d85e0) at /usr/src/sys/kern/vfs_bio.c:1134 No locals. #4 0xc056039c in brelse (bp=0xd63d85e0) at /usr/src/sys/kern/vfs_bio.c:1448 No locals. #5 0xc055f3d6 in ibwrite (bp=0xd63d85e0) at /usr/src/sys/kern/vfs_bio.c:898 rtval = 69 oldflags = 536904320 newbp = (struct buf *) 0x45 #6 0xc055efea in bwrite (bp=0x0) at /usr/src/sys/kern/vfs_bio.c:771 No locals. #7 0xc0561eed in getblk (vp=0xc6163e70, blkno=99, size=18176, slpflag=256, ---Type <return> to continue, or q <return> to quit--- slptimeo=0, flags=0) at /usr/src/sys/kern/vfs_bio.c:2540 lockflags = 65570 bp = (struct buf *) 0xd63d85e0 #8 0xc05d2831 in nfs_getcacheblk (vp=0xc6163e70, bn=99, size=18176, td=0xc2a92960) at /usr/src/sys/nfsclient/nfs_bio.c:1073 bp = (struct buf *) 0x0 mp = (struct mount *) 0xc2616800 nmp = (struct nfsmount *) 0xc2874bd0 #9 0xc05d24a6 in nfs_write (ap=0x0) at /usr/src/sys/nfsclient/nfs_bio.c:886 biosize = 32768 uio = (struct uio *) 0xec555c88 td = (struct thread *) 0xc2a92960 vp = (struct vnode *) 0xc6163e70 np = (struct nfsnode *) 0xc8a261c4 cred = (struct ucred *) 0xc2e4cc00 ioflag = 1 bp = (struct buf *) 0x0 vattr = {va_type = 3226556158, va_mode = 53324, va_nlink = -16271, va_uid = 0, va_gid = 3228265128, va_fsid = 471, va_fileid = -1029101216, va_size = 562958543355904, va_blocksize = -971620752, va_atime = { tv_sec = -1029101216, tv_nsec = -329950284}, va_mtime = { tv_sec = -1068076241, tv_nsec = -971620580}, va_ctime = { tv_sec = 16973826, tv_nsec = -971620752}, va_birthtime = { tv_sec = -1029101216, tv_nsec = -329950272}, va_gen = 3226890719, ---Type <return> to continue, or q <return> to quit--- va_flags = 3965017036, va_rdev = 3965017064, va_bytes = 17029618500929819053, va_filerev = 14273664722983263552, va_vaflags = 16973826, va_spare = -1029101216} nmp = (struct nfsmount *) 0xc2874bd0 lbn = 99 bcount = 18176 n = 768 on = 17408 error = 0 haverslock = 1 p = (struct proc *) 0x4700 #10 0xc0578a9c in vn_write (fp=0xc2fe0c38, uio=0xec555c88, active_cred=0xc2e4cc00, flags=0, td=0xc2a92960) at vnode_if.h:432 vp = (struct vnode *) 0xc6163e70 mp = (struct mount *) 0x0 error = -1023538120 ioflag = 1 #11 0xc05403a0 in dofilewrite (td=0xc2a92960, fp=0xc2fe0c38, fd=19, buf=0x0, nbyte=768, offset=Unhandled dwarf expression opcode 0x93 ) at file.h:246 auio = {uio_iov = 0xec555c80, uio_iovcnt = 1, uio_offset = 3261440, uio_resid = 768, uio_segflg = UIO_USERSPACE, uio_rw = UIO_WRITE, uio_td = 0xc2a92960} aiov = {iov_base = 0x870b000, iov_len = 768} cnt = 768 ---Type <return> to continue, or q <return> to quit--- error = 768 ktruio = (struct uio *) 0x0 #12 0xc054024d in write (td=0xc2a92960, uap=0xec555d14) at /usr/src/sys/kern/sys_generic.c:282 fp = (struct file *) 0xc2fe0c38 error = 0 #13 0xc0677a37 in syscall (frame {tf_fs = 47, tf_es = 47, tf_ds = 47, tf_edi = 134656000, tf_esi = 768, tf_ebp = -1077945352, tf_isp = -329949836, tf_ebx = 681363868, tf_edx = 149816736, tf_ecx = 0, tf_eax = 4, tf_trapno = 22, tf_err = 2, tf_eip = 681349047, tf_cs = 31, tf_eflags = 642, tf_esp = -1077945396, tf_ss = 47}) at /usr/src/sys/i386/i386/trap.c:1001 params = 0xbfbfdbd0 <Address 0xbfbfdbd0 out of bounds> callp = (struct sysent *) 0xc06ee0a0 td = (struct thread *) 0xc2a92960 p = (struct proc *) 0xc37a1e20 orig_tf_eflags = 642 sticks = 0 error = 0 narg = 3 args = {19, 141602816, 768, 0, 0, 0, 0, -1015407072} code = 4 #14 0xc066652f in Xint0x80_syscall () at /usr/src/sys/i386/i386/exception.s:201 No locals. ---Type <return> to continue, or q <return> to quit--- #15 0x0000002f in ?? () No symbol table info available. #16 0x0000002f in ?? () No symbol table info available. #17 0x0000002f in ?? () No symbol table info available. #18 0x0806b000 in ?? () No symbol table info available. #19 0x00000300 in ?? () No symbol table info available. #20 0xbfbfdbf8 in ?? () No symbol table info available. #21 0xec555d74 in ?? () No symbol table info available. #22 0x289cc99c in ?? () No symbol table info available. #23 0x08ee05a0 in ?? () No symbol table info available. #24 0x00000000 in ?? () No symbol table info available. #25 0x00000004 in ?? () No symbol table info available. #26 0x00000016 in ?? () No symbol table info available. ---Type <return> to continue, or q <return> to quit--- #27 0x00000002 in ?? () No symbol table info available. #28 0x289c8fb7 in ?? () No symbol table info available. #29 0x0000001f in ?? () No symbol table info available. #30 0x00000282 in ?? () No symbol table info available. #31 0xbfbfdbcc in ?? () No symbol table info available. #32 0x0000002f in ?? () No symbol table info available. #33 0x00000000 in ?? () No symbol table info available. #34 0x00000000 in ?? () No symbol table info available. #35 0x00000000 in ?? () No symbol table info available. #36 0x00000000 in ?? () No symbol table info available. #37 0x05de5000 in ?? () No symbol table info available. #38 0xc37a1e20 in ?? () No symbol table info available. ---Type <return> to continue, or q <return> to quit--- #39 0xc2a92960 in ?? () No symbol table info available. #40 0xec555724 in ?? () No symbol table info available. #41 0xec55570c in ?? () No symbol table info available. #42 0xc47a27d0 in ?? () No symbol table info available. #43 0xc052e773 in sched_switch (td=0x300, newtd=0x289cc99c, flags=Cannot access memory at address 0xbfbfdc08 ) at /usr/src/sys/kern/sched_4bsd.c:865 kg = (struct ksegrp *) 0x0 p = (struct proc *) 0x806b000 Previous frame inner to this frame (corrupt stack?) (kgdb) frame 3 #3 0xc055f9ec in bundirty (bp=0xd63d85e0) at /usr/src/sys/kern/vfs_bio.c:1134 1134 KASSERT(bp->b_qindex == QUEUE_NONE, (kgdb) l 1129 1130 void 1131 bundirty(bp) 1132 struct buf *bp; 1133 { 1134 KASSERT(bp->b_qindex == QUEUE_NONE, 1135 ("bundirty: buffer %p still on queue %d", bp, bp->b_qindex)); 1136 1137 if (bp->b_flags & B_DELWRI) { 1138 bp->b_flags &= ~B_DELWRI; (kgdb) p *bp $1 = {b_io = {bio_cmd = 2 '\002', bio_flags = 0 '\0', bio_cflags = 0 '\0', bio_pflags = 0 '\0', bio_dev = 0x0, bio_disk = 0x0, bio_offset = 3244032, bio_bcount = 18176, bio_data = 0xdd588000 "", bio_error = 69, bio_resid = 768, bio_done = 0xc0562b64 <bufdonebio>, bio_driver1 = 0x0, bio_driver2 = 0x0, bio_caller1 = 0x0, bio_caller2 = 0xd63d85e0, bio_queue = {tqe_next = 0x0, tqe_prev = 0x0}, bio_attribute = 0x0, bio_from = 0x0, bio_to = 0x0, bio_length = 0, bio_completed = 0, bio_children = 217, bio_inbed = 0, bio_parent = 0x0, bio_t0 = {sec = 0, frac = 0}, bio_task = 0, bio_task_arg = 0x0, bio_pblkno = 0}, b_op = 0xc06f8aa8, b_magic = 280038160, b_iodone = 0, b_blkno = 6336, b_offset = 3244032, b_vnbufs = {tqe_next = 0x0, tqe_prev = 0xd6514de4}, b_left = 0xd6514d44, b_right = 0x0, b_vflags = 0, b_freelist = { tqe_next = 0xd65a24b8, tqe_prev = 0xc0748248}, b_qindex = 1, b_flags = 536912544, b_xflags = 1 '\001', b_lock = { lk_interlock = 0xc071d070, lk_flags = 1024, lk_sharecount = 0, lk_waitcount = 0, lk_exclusivecount = 1, lk_prio = 336, lk_wmesg = 0xc06bfbc3 "getblk", lk_timo = 0, lk_lockholder = 0xc2a92960, lk_newlock = 0x0}, b_bufsize = 18432, b_runningbufspace = 0, b_kvabase = 0xdd588000 "", b_kvasize = 32768, b_lblkno = 99, b_vp = 0xc6163e70, b_object = 0xc4161ce4, b_dirtyoff = 0, b_dirtyend = 0, b_rcred = 0x0, b_wcred = 0xc2e4cc00, b_saveaddr = 0xdd588000, b_pager = { pg_reqpage = 0}, b_cluster = {cluster_head = {tqh_first = 0xd6340aec, tqh_last = 0xd63c5474}, cluster_entry = {tqe_next = 0xd6340aec, tqe_prev = 0xd63c5474}}, b_pages = {0xc1669020, 0xc1209168, 0xc1438cb0, ---Type <return> to continue, or q <return> to quit--- 0xc15649f8, 0xc1140540, 0x0 <repeats 27 times>}, b_npages = 5, b_dep = { lh_first = 0x0}} (kgdb) p *(struct proc *) 0xc37a1e20 $2 = {p_list = {le_next = 0xc37a1000, le_prev = 0xc2a711c4}, p_ksegrps = { tqh_first = 0xc37a3540, tqh_last = 0xc2742704}, p_threads = { tqh_first = 0xc47a27d0, tqh_last = 0xc89f7c88}, p_suspended = { tqh_first = 0x0, tqh_last = 0xc37a1e38}, p_ucred = 0xc2e4cc00, p_fd = 0xc2d92a00, p_fdtol = 0x0, p_stats = 0xec31f000, p_limit = 0xc3e36e00, p_upages_obj = 0xc377abdc, p_sigacts = 0xc39e6000, p_flag = 49280, p_sflag = 1, p_state = PRS_NORMAL, p_pid = 11575, p_hash = { le_next = 0x0, le_prev = 0xc22854dc}, p_pglist = {le_next = 0x0, le_prev = 0xc37a1054}, p_pptr = 0xc37a1000, p_sibling = {le_next = 0x0, le_prev = 0xc37a1068}, p_children = {lh_first = 0x0}, p_mtx = { mtx_object = {lo_class = 0xc06f1ffc, lo_name = 0xc06b7da2 "process lock", lo_type = 0xc06b7da2 "process lock", lo_flags = 4390912, lo_list = { tqe_next = 0xc37a406c, tqe_prev = 0xc37a1cd8}, lo_witness = 0xc0725060}, mtx_lock = 4, mtx_recurse = 0}, p_oppid = 0, p_vmspace = 0xc8acb12c, p_swtime = 1355, p_realtimer = {it_interval = { tv_sec = 0, tv_usec = 0}, it_value = {tv_sec = 0, tv_usec = 0}}, p_runtime = {sec = 96, frac = 10252104327500669002}, p_uu = 2265820, p_su = 2082485, p_iu = 1, p_uticks = 7530, p_sticks = 5200, p_iticks = 0, p_profthreads = 0, p_maxthrwaits = 0, p_traceflag = 0, p_tracevp = 0x0, p_tracecred = 0x0, p_textvp = 0xc2fad738, p_siglist = {__bits = {0, 0, 0, 0}}, p_lock = 0 '\0', p_sigiolst = {slh_first = 0x0}, p_sigparent = 20, p_sig = 0, p_code = 0, p_stops = 0, p_stype = 0, p_step = 0 '\0', p_pfsflags = 0 '\0', p_nlminfo = 0x0, p_aioinfo = 0x0, p_singlethread = 0x0, p_suspcount = 0, p_xthread = 0x0, p_boundary_count = 0, ---Type <return> to continue, or q <return> to quit--- p_magic = 3203398350, p_comm = "firefox-bin\000\000\000\000\000\000\000\000", p_pgrp = 0xc85fa500, p_sysent = 0xc070b7e0, p_args = 0xc2c91bc0, p_cpulimit = 900, p_nice = 0 '\0', p_xstat = 0, p_klist = {kl_lock = 0xc37a1e8c, kl_list = { slh_first = 0x0}}, p_numthreads = 5, p_numksegrps = 2, p_md = { md_ldt = 0xc3e5db60}, p_itcallout = {c_links = {sle = {sle_next = 0x0}, tqe = {tqe_next = 0x0, tqe_prev = 0x0}}, c_time = 0, c_arg = 0x0, c_func = 0, c_flags = 8}, p_uarea = 0xec31f000, p_acflag = 0, p_ru = 0x0, p_peers = 0x0, p_leader = 0xc37a1e20, p_emuldata = 0x0, p_label = 0x0, p_sched = 0xc37a1fe4} (kgdb) p ((struct proc *) 0xc37a1e20)->p_uarea $3 = (struct user *) 0xec31f000 (kgdb) p *((struct proc *) 0xc37a1e20)->p_uarea $4 = {u_stats = {p_ru = {ru_utime = {tv_sec = 2, tv_usec = 265820}, ru_stime = {tv_sec = 2, tv_usec = 82485}, ru_maxrss = 49392, ru_ixrss = 1280256, ru_idrss = 221403216, ru_isrss = 1707008, ru_minflt = 19633, ru_majflt = 53, ru_nswap = 0, ru_inblock = 19, ru_oublock = 546, ru_msgsnd = 74574, ru_msgrcv = 91798, ru_nsignals = 0, ru_nvcsw = 273030, ru_nivcsw = 62343}, p_cru = {ru_utime = {tv_sec = 0, tv_usec = 7940}, ru_stime = {tv_sec = 0, tv_usec = 63522}, ru_maxrss = 32292, ru_ixrss = 824, ru_idrss = 37180, ru_isrss = 2512, ru_minflt = 102, ru_majflt = 0, ru_nswap = 0, ru_inblock = 0, ru_oublock = 0, ru_msgsnd = 0, ru_msgrcv = 0, ru_nsignals = 0, ru_nvcsw = 30, ru_nivcsw = 7}, p_timer = {{it_interval = {tv_sec = 0, tv_usec = 0}, it_value = {tv_sec = 0, tv_usec = 0}}, {it_interval = { tv_sec = 0, tv_usec = 0}, it_value = {tv_sec = 0, tv_usec = 0}}, { it_interval = {tv_sec = 0, tv_usec = 0}, it_value = {tv_sec = 0, tv_usec = 0}}}, p_prof = {pr_base = 0x0, pr_size = 0, pr_off = 0, pr_scale = 0}, p_start = {tv_sec = 598308, tv_usec = 479535}}, u_kproc = {ki_structsize = 0, ki_layout = 0, ki_args = 0x0, ki_paddr = 0x0, ki_addr = 0x0, ki_tracep = 0x0, ki_textvp = 0x0, ki_fd = 0x0, ki_vmspace = 0x0, ki_wchan = 0x0, ki_pid = 135271088, ki_ppid = 0, ki_pgid = 0, ki_tpgid = 135271104, ki_sid = 0, ki_tsid = 0, ki_jobc = 0, ki_spare_short1 = 0, ki_tdev = 0, ki_siglist = {__bits = {0, 0, 0, 0}}, ki_sigmask = {__bits = {0, 0, 0, 135201036}}, ki_sigignore = {__bits = {0, 135278785, 0, 0}}, ki_sigcatch = {__bits = {0, 0, 0, 0}}, ki_uid = 135278788, ki_ruid = 135278788, ki_svuid = 0, ki_rgid = 0, ---Type <return> to continue, or q <return> to quit--- ki_svgid = 0, ki_ngroups = 0, ki_spare_short2 = 0, ki_groups = {0, 0, 0, 0, 0, 0, 135282688, 4, 0, 0, 0, 0, 0, 0, 0, 0}, ki_size = 0, ki_rssize = 0, ki_swrss = 1, ki_tsize = 0, ki_dsize = 0, ki_ssize = 0, ki_xstat = 0, ki_acflag = 0, ki_pctcpu = 0, ki_estcpu = 0, ki_slptime = 0, ki_swtime = 0, ki_runtime = 0, ki_start = {tv_sec = 0, tv_usec = 0}, ki_childtime = {tv_sec = 0, tv_usec = 0}, ki_flag = 0, ki_kiflag = 0, ki_traceflag = 0, ki_stat = 0 '\0', ki_nice = 0 '\0', ki_lock = 0 '\0', ki_rqindex = 0 '\0', ki_oncpu = 0 '\0', ki_lastcpu = 0 '\0', ki_ocomm = '\0' <repeats 16 times>, ki_wmesg = "\000\000\000\000\000\000\000\000", ki_login = '\0' <repeats 17 times>, ki_lockname = "\000\000\000\000\000\000\000\000", ki_comm = '\0' <repeats 19 times>, ki_emul = '\0' <repeats 16 times>, ki_sparestrings = '\0' <repeats 67 times>, ki_rusage = {ru_utime = { tv_sec = 0, tv_usec = 0}, ru_stime = {tv_sec = 0, tv_usec = 0}, ru_maxrss = 0, ru_ixrss = 0, ru_idrss = 0, ru_isrss = 0, ru_minflt = 0, ru_majflt = 0, ru_nswap = 0, ru_inblock = 0, ru_oublock = 0, ru_msgsnd = 0, ru_msgrcv = 0, ru_nsignals = 0, ru_nvcsw = 0, ru_nivcsw = 0}, ki_sflag = 0, ki_pri = {pri_class = 0 '\0', pri_level = 0 '\0', pri_native = 0 '\0', pri_user = 0 '\0'}, ki_tdflags = 0, ki_pcb = 0x0, ki_kstack = 0x0, ki_childstime = { tv_sec = 0, tv_usec = 0}, ki_childutime = {tv_sec = 0, tv_usec = 0}, ki_tid = 0, ki_numthreads = 0, ki_udata = 0x0, ki_spare = { 0 <repeats 15 times>}}} (kgdb) up #4 0xc056039c in brelse (bp=0xd63d85e0) at /usr/src/sys/kern/vfs_bio.c:1448 1448 bundirty(bp); (kgdb) up #5 0xc055f3d6 in ibwrite (bp=0xd63d85e0) at /usr/src/sys/kern/vfs_bio.c:898 898 brelse(bp); (kgdb) l 893 VOP_STRATEGY(bp->b_vp, bp); 894 } 895 896 if ((oldflags & B_ASYNC) == 0) { 897 int rtval = bufwait(bp); 898 brelse(bp); 899 return (rtval); 900 } else { 901 /* 902 * don't allow the async write to saturate the I/O (kgdb) # # ### pid 11575 somewhere in the backtrace # ps -Hlp11575 -N kernel.debug.28 -M vmcore.28 UID PID PPID CPU PRI NI VSZ RSS MWCHAN STAT TT TIME COMMAND 1670 11575 11571 0 20 0 50140 0 kserel S ?? 1:36.56 [firefox-bin # ### Boring but all we have :( # vmstat -m -N kernel.debug.28 -M vmcore.28 Type InUse MemUse HighUse Requests Size(s) linux 10 1K 1K 10 32 FDESC mount 1 1K 1K 1 16 USBdev 2 1K 3K 6 64,128,512 USB 25 2K 2K 26 16,32,64,128,256 cache 1 1K 1K 1 16 lockf 226 8K 8K 5655 32,64 atkbddev 2 1K 1K 2 32 DEVFS 176 25K 25K 265 16,32,128,4096 entropy 1024 64K 64K 1024 64 linker 59 135K 141K 122 16,32,256,1024,2048,4096 nexusdev 2 1K 1K 2 16 MP Table 1 1K 1K 1 32 memdesc 1 4K 4K 1 4096 legacydrv 4 1K 1K 4 16 I/O APIC 1 1K 1K 1 1024 acpisem 1 1K 1K 15 64 KTRACE 1000 125K 125K 1000 128 UMAHash 5 41K 55K 21 256,512,1024,2048,4096 VM pgdata 2 65K 65K 2 64 ithread 56 6K 6K 57 64,128 zombie 1 1K 2K 1510993 128 proc-args 136 9K 17K 944695 16,32,64,128,256 UFS mount 12 29K 54K 24 64,256,512,2048,4096 UFS ihash 1 256K 256K 1 UFS dirhash 1319 255K 411K 37308 16,32,64,128,256,512 newdirblk 0 0K 1K 128 16 dirrem 0 0K 121K 57893 32 mkdir 0 0K 150K 10374 32 diradd 4 1K 128K 59309 32 freefile 1 1K 120K 39123 32 freeblks 1 1K 960K 42126 256 freefrag 0 0K 17K 26181 32 allocindir 0 0K 90K 42807 64 indirdep 0 0K 1046K 6348 32 allocdirect 5 1K 585K 96592 128 bmsafemap 2 1K 3K 8804 32 newblk 1 1K 1K 139400 64,256 inodedep 7 257K 994K 101946 128,256 pagedep 4 33K 107K 12253 64 p1003.1b 1 1K 1K 1 16 agp 3 69K 69K 3 32,4096 NFS daemon 71 8K 8K 71 64,256,512 NFSV3 srvdesc 0 0K 2K 6965690 16,256 NFS srvsock 2 1K 1K 2 128 NFS hash 1 256K 256K 1 NFSV3 diroff 205 103K 199K 4467 512 NFS req 0 0K 3K 22767528 64,128 ip6_moptions 1 1K 1K 1 16 Ip6Fw/Ip6Acct 6 1K 1K 6 16,256 in6_multi 18 1K 1K 18 16,64 syncache 1 8K 8K 1 hostcache 1 24K 24K 1 ip_moptions 1 1K 1K 1 128 IpFw/IpAcct 1 1K 1K 1 64 in_multi 4 1K 1K 4 32 igmp 1 1K 1K 1 16 routetbl 228 41K 42K 23065 16,32,64,128,256 kqueue 0 0K 15K 184464 128,1024 kenv 104 6K 6K 105 16,32,64,2048 sigio 2 1K 1K 67 32 lo 1 1K 1K 1 1024 clone 5 20K 20K 5 4096 ether_multi 77 4K 4K 77 16,32,64 ifaddr 50 12K 12K 53 16,32,64,256,512,2048 BPF 4 1K 1K 4 64 mount 43 22K 22K 49 16,32,128,512,1024 vnodes 42 8K 8K 359 16,32,64,128,256 Export Host 2 1K 1K 4 256 cluster_save buffer 0 0K 1K 3956 32,64 vfscache 1 512K 512K 1 BIO buffer 72 114K 5697K 130296 1024,2048 file desc 247 75K 107K 1518255 16,32,64,256,512,1024,2048,4096 pcb 118 6K 8K 346499 16,32,64,2048 soname 103 11K 45K 5116733 16,32,64,128 tag 0 0K 7K 2161374 32,64 mbextcnt 0 0K 2K 11818 16 ptys 31 4K 4K 31 128 ttys 3983 516K 595K 36848 128,512 shm 2 13K 15K 70 256 sem 4 7K 7K 4 512,1024,4096 msg 4 25K 25K 4 512,4096 iov 0 0K 1K 2041064 16,64,128,256,512 ioctlops 0 0K 4K 45 512,1024,2048,4096 cdev 92 23K 23K 92 256 acpica 0 0K 1K 15 16,32,64 turnstiles 651 41K 41K 671 64 taskqueue 6 1K 1K 6 64 ISOFS mount 1 256K 256K 1 sleep queues 651 21K 21K 671 32 sbuf 0 0K 37K 2129 16,32,64,128,256,512,1024,2048,4096 rman 118 8K 8K 520 16,64 isadev 42 3K 3K 42 64 GEOM 63 9K 14K 241 16,32,64,128,256,512,1024 kobj 101 202K 202K 121 2048 pfs_vncache 2 1K 52K 12858 32 eventhandler 27 2K 2K 27 32,128 devstat 6 13K 13K 6 16,4096 pfs_fileno 1 20K 20K 1 bus-sc 38 43K 48K 371 16,64,128,256,512,1024,2048,4096 bus 541 24K 82K 2056 16,32,64,128,1024 SWAP 2 345K 345K 2 64 sysctltmp 0 0K 1K 53047 16,32,64,128 sysctloid 1486 45K 45K 1486 16,32,64 sysctl 0 0K 1K 45958 16,32,64 uidinfo 18 2K 2K 4270 32,1024 plimit 39 10K 12K 1812147 256 pfs_nodes 20 3K 3K 20 128 cred 174 22K 30K 4610954 128 subproc 359 849K 1252K 3865370 32,4096 proc 2 8K 8K 2 4096 session 91 12K 14K 20158 128 pgrp 99 7K 8K 25399 64 mtx_pool 1 8K 8K 1 module 186 12K 12K 186 64,128 MSDOSFS mount 1 128K 128K 1 ip6ndp 9 1K 1K 13 64,128 ip6opt 0 0K 2K 136543 128 temp 3080 258K 288K 2236282 16,32,64,128,256,512,1024,2048,4096 devbuf 2292 4517K 4677K 28998409 16,32,64,128,256,512,1024,2048,4096 # ### netstat -m crashes after printing a (high) number of mbufs in use # netstat -m -N kernel.debug.28 -M vmcore.28 4045 mbufs in use Segmentation fault # vmstat -z -N kernel.debug.28 -M vmcore.28 vmstat: not implemented # ^D Script done on Mon Feb 21 17:21:35 2005 -- Jilles Tjoelker