search for: db_trace_self_wrapp

...t 0xfffffe01eebd07f8 bufwait (bufwait) @ /usr/src/sys/kern/vfs_bio.c:3059 messages-Sep 26 02:01:27 leader kernel: 2nd 0xfffff800122f8200 dirhash (dirhash) @ /usr/src/sys/ufs/ufs/ufs_dirhash.c:284 messages-Sep 26 02:01:27 leader kernel: KDB: stack backtrace: messages-Sep 26 02:01:27 leader kernel: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0238a8f270 messages-Sep 26 02:01:27 leader kernel: kdb_backtrace() at kdb_backtrace+0x39/frame 0xfffffe0238a8f320 messages-Sep 26 02:01:27 leader kernel: witness_checkorder() at witness_checkorder+0xd23/frame 0xfffffe0238a8f3b0 messages-Sep 26 02:0...

...= base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 0 (zio_write_issue_hig) trap number = 12 panic: page fault cpuid = 22 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2a/frame 0xffffffcf75bd5b30 kdb_backtrace() at kdb_backtrace+0x37/frame 0xffffffcf75bd5bf0 panic() at panic+0x1ce/frame 0xffffffcf75bd5cf0 trap_fatal() at trap_fatal+0x290/frame 0xffffffcf75bd5d50 trap_pfault() at trap_pfault+0x211/frame 0xffffffcf75bd5de0 trap() at t...

...uot; to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "amd64-marcel-freebsd"... Unread portion of the kernel message buffer: panic: vm_page_unwire: invalid wire count: 0 cpuid = 0 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2a panic() at panic+0x182 vm_page_unwire() at vm_page_unwire+0x84 sf_buf_mext() at sf_buf_mext+0x3c mb_free_ext() at mb_free_ext+0x99 sbdrop_internal() at sbdrop_internal+0x1e8 tcp_do_segment() at tcp_do_segment+0x1512 tcp_input() at tcp_input+0x7f7 ip_input() at ip_i...

...0 pcib7: secondary bus 7 pcib7: subordinate bus 7 pcib7: no prefetched decode device_attach: pcib7 attach returned 6 pcib7: <ACPI PCI-PCI bridge> irq 19 at device 28.7 on pci0 panic: Bad tailq NEXT(0xffffffff80e52660->tqh_last) != NULL cpuid = 0 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2a kdb_backtrace() at kdb_backtrace+0x37 panic() at panic+0x1d8 rman_init() at rman_init+0x17c pcib_alloc_window() at pcib_alloc_window+0x9f pcib_attach_common() at pcib_attach_common+0x457 acpi_pcib_pci_attach() at acpi_pcib_pci_attach+0x1c device_attach() at device_...

...1: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus1 uhub0: 2 ports with 2 removable, self powered uhub1: 2 ports with 2 removable, self powered panic: mtx_lock_spin: recursed on non-recursive mutex cnputs_mtx @ /usr/src/sys/kern/kern_cons.c:500 cpuid = 0 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2a/frame 0xffffff9185023940 kdb_backtrace() at kdb_backtrace+0x37/frame 0xffffff9185023a00 panic() at panic+0x1d8/frame 0xffffff9185023b00 _mtx_lock_spin_flags() at _mtx_lock_spin_flags+0x123/frame 0xffffff9185023b40 cnputs() at cnputs+0x7a/frame 0xffffff9185023b60 pu...

...= 0x28:0xdd4f6c40 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, def32 1, gran 1 processor eflags = resume, IOPL = 0 current process = 13 (swi4: clock) trap number = 12 panic: page fault KDB: stack backtrace: db_trace_self_wrapper(c074bb2f,dd4f6b14,c05514af,c0749d10,c07b85e0,...) at 0xc0478466 = db_trace_self_wrapper+0x26 kdb_backtrace(c0749d10,c07b85e0,c073b02b,dd4f6b20,dd4f6b20,...) at 0xc057a639 = kdb_backtrace+0x29 panic(c073b02b,c0761cb4,c36104dc,1,1,...) at 0xc05514af = panic+0xaf trap_fatal(c0761bb6,c,c3a89460,c3a89...

...ware SAS/SATA Storage Controller> port 0x4000-0x40ff mem 0xc2460000-0xc2463fff,0xc2400000-0xc243ffff irq 17 at device 0.0 on pci2 tws0: Using legacy INTx panic: _mtx_lock_sleep: recursed on non-recursive mutex tws_io_lock @ /usr/HEAD/src/sys/dev/tws/tws_hdm.c:287 cpuid = 0 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2a kdb_backtrace() at kdb_backtrace+0x37 panic() at panic+0x1d8 _mtx_lock_sleep() at _mtx_lock_sleep+0x27f _mtx_lock_flags() at _mtx_lock_flags+0xf1 tws_submit_command() at tws_submit_command+0x3f tws_dmamap_data_load_cbfn() at tws_dmamap_data_load_cbfn+0xb7 bus_dmama...

...g+0xb1 ipmi_wd_event() at ipmi_wd_event+0x8f kern_do_pat() at kern_do_pat+0x10f sched_sync() at sched_sync+0x1ea fork_exit() at fork_exit+0x135 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff869b172bb0, rbp = 0 --- panic: sleeping thread cpuid = 26 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2a kdb_backtrace() at kdb_backtrace+0x37 panic() at panic+0x1d8 propagate_priority() at propagate_priority+0x223 turnstile_wait() at turnstile_wait+0x252 _mtx_lock_sleep() at _mtx_lock_sleep+0x124 _mtx_lock_flags() at _mtx_lock_flags+0xae vn_syncer_add_to_worklist() a...

Two machines (NFS Server: running ZFS / Client: disk-less), both are running FreeBSD r253506. The NFS client starts to deadlock processes within a few hours. It usually gets worse from there on. The processes stay in "D" state. I haven't been able to reproduce it when I want it to happen. I only have to wait a few hours until the deadlocks occur when traffic to the client machine