sthaug at nethelp.no
2015-Jan-03 20:51 UTC
10.1-STABLE/i386 GENERIC + VIMAGE: Panic when going multiuser
> > I have a reproducible crash in 10.1-STABLE/i386, svn updated to r276174. > > The kernel is based on GENERIC with *one* line added: options VIMAGE. > > > > I can boot to single user with no problem. Going multiuser results in > > immediate crash with backtrace > > > > #0 0xc0b59be2 at kdb_backtrace+0x52 > > #1 0xc0b1b65f at panic+0x11f > > #2 0xc0dd1666 at vm_fault_hold+0x2076 > > #3 0xc0dcf5b1 at vm_fault+0x81 > > #4 0xc103008b at trap_pfault+0x1bb > > #5 0xc102f8e4 at trap+0x674 > > #6 0xc101ad0c at calltrap+0x6 > > #7 0xc0d0ca7a at sysctl_ip6_temppltime+0x3a > > #8 0xc0b28031 at sysctl_root+0x2b1 > > #9 0xc0b2862a at userland_sysctl+0x1fa > > #10 0xc0b283e8 at sys___sysctl+0x98 > > #11 0xc1030986 at syscall+0x4a6 > > #12 0xc101ada1 at Xint0x80_syscall+0x21 > > > > > That stack trace doesn't have enough info. Can you: > (1) boot into single mode on your system > (2) Add this to /etc/rc.conf: > ddb_enable="YES" > (3) Reboot the system and let it go to multi-userI found I had to also add "options DDB" to the kernel. So this is GENERIC + options VIMAGE + options DDB. I didn't get the panic when going to multiuser this time - but as soon as I did "sysctl -a" the expected panic came. Below is the result of the generated files in /var/crash (I unpacked the textdump.tar.4 file). Steinar Haug, Nethelp consulting, sthaug at nethelp.no ---------------------------------------------------------------------- info.4 Dump header from device /dev/ada0s1b Architecture: i386 Architecture Version: 1 Dump Length: 71168B (0 MB) Blocksize: 512 Dumptime: Sat Jan 3 21:26:03 2015 Hostname: verdi.nethelp.no Magic: FreeBSD Text Dump Version String: FreeBSD 10.1-STABLE #1 r276174: Sat Jan 3 20:50:10 CET 2015 root at verdi.nethelp.no:/usr/src/sys/i386/compile/GENERICV Panic String: vm_fault: fault on nofault entry, addr: cc0e5000 Dump Parity: 1182659946 Bounds: 4 Dump Status: good ---------------------------------------------------------------------- ddb.txt db:0:kdb.enter.panic> run lockinfo db:1:lockinfo> show locks No such command db:1:locks> show alllocks No such command db:1:alllocks> show lockedvnods Locked vnodes db:0:kdb.enter.panic> show pcpu cpuid = 0 dynamic pcpu = 0x3d3a00 curthread = 0xc769f310: pid 984 "sysctl" curpcb = 0xf0923d40 fpcurthread = none idlethread = 0xc6ac3000: tid 100003 "idle: cpu0" APIC ID = 0 currentldt = 0x50 curvnet = 0xc69713c0 db:0:kdb.enter.panic> bt Tracing pid 984 tid 100105 td 0xc769f310 kdb_enter(c11b2609,c11b2609,c11e064d,f09236ec,0,...) at kdb_enter+0x3d/frame 0xf09236a0 panic(c11e064d,cc0e5000,1,f0923804,f09237f4,...) at panic+0x13f/frame 0xf09236e0 vm_fault_hold(c1a6d000,cc0e5000,1,0,0,...) at vm_fault_hold+0x2076/frame 0xf0923840 vm_fault(c1a6d000,cc0e5000,1,0,c0b72331,...) at vm_fault+0x81/frame 0xf0923868 trap_pfault(cc0e5fb8,c1472000,f0923914,c6baf200,f09239a4,...) at trap_pfault+0x1bb/frame 0xf09238e8 trap(f0923a34) at trap+0x674/frame 0xf0923a28 calltrap() at calltrap+0x6/frame 0xf0923a28 --- trap 0xc, eip = 0xc1049023, esp = 0xf0923a74, ebp = 0xf0923a9c --- copyout(f0923b28,cc0e5fb8,4,f0923acc,c142c7a8,...) at copyout+0x37/frame 0xf0923a9c sysctl_ip6_temppltime(c142c7a8,c6a9e3a8,0,f0923b28,f0923b28,...) at sysctl_ip6_temppltime+0x3a/frame 0xf0923ac0 sysctl_root(f0923b28,8,2,c0a058a7,c7017850,...) at sysctl_root+0x2b1/frame 0xf0923b00 userland_sysctl(c769f310,f0923bac,4,28803030,bfbfdb70,...) at userland_sysctl+0x1fa/frame 0xf0923b70 sys___sysctl(c769f310,f0923ca8,2e,f0923c64,c0b329f2,...) at sys___sysctl+0x98/frame 0xf0923c18 syscall(f0923ce8) at syscall+0x4a6/frame 0xf0923cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf0923cdc --- syscall (202, FreeBSD ELF32, sys___sysctl), eip = 0x281a28b7, esp = 0xbfbfdb00, ebp = 0xbfbfdb28 --- db:0:kdb.enter.panic> ps pid ppid pgrp uid state wmesg wchan cmd 984 980 984 0 R+ CPU 0 sysctl 980 972 980 0 S+ pause 0xc6f66934 csh 979 1 979 0 Ss+ ttyin 0xc6d4a870 getty 978 1 978 0 Ss+ ttyin 0xc6d4aa70 getty 977 1 977 0 Ss+ ttyin 0xc6d4ac70 getty 976 1 976 0 Ss+ ttyin 0xc6d4ae70 getty 975 1 975 0 Ss+ ttyin 0xc6d4c070 getty 974 1 974 0 Ss+ ttyin 0xc6d4c270 getty 973 1 973 0 Ss+ ttyin 0xc6baf070 getty 972 1 972 0 Ss+ wait 0xc6f655e0 login 967 965 17 0 S+ nanslp 0xc1515641 sleep 966 1 17 0 S+ piperd 0xc70377f8 logger 965 1 17 0 S+ wait 0xc729c8d0 sh 928 1 928 0 Ss nanslp 0xc1515640 cron 924 1 924 25 Ss pause 0xc729bc24 sendmail 921 1 921 0 Ss select 0xc6fa0b24 sendmail 918 1 918 0 Ss select 0xc6fd23e4 sshd 725 1 725 0 Ss select 0xc6d57da4 syslogd 649 1 649 0 Ss select 0xc6fa1524 devd 16 0 0 0 DL vlruwt 0xc6f658d0 [vnlru] 9 0 0 0 DL syncer 0xc15349c4 [syncer] 8 0 0 0 DL (threaded) [bufdaemon] 100080 D sdflush 0xc6fb6a84 [/var worker] 100079 D sdflush 0xc6fb6884 [/usr worker] 100066 D psleep 0xc1534104 [bufdaemon] 7 0 0 0 DL pgzero 0xc1539320 [pagezero] 6 0 0 0 DL psleep 0xc1539044 [vmdaemon] 5 0 0 0 DL psleep 0xc1594604 [pagedaemon] 4 0 0 0 DL waiting_ 0xc1592874 [sctp_iterator] 3 0 0 0 DL - 0xc6baf83c [fdc0] 15 0 0 0 DL (threaded) [usb] 100053 D - 0xc6d09d34 [usbus4] 100052 D - 0xc6d09d04 [usbus4] 100051 D - 0xc6d09cd4 [usbus4] 100050 D - 0xc6d09ca4 [usbus4] 100049 D - 0xc6cf2dac [usbus3] 100048 D - 0xc6cf2d7c [usbus3] 100047 D - 0xc6cf2d4c [usbus3] 100046 D - 0xc6cf2d1c [usbus3] 100044 D - 0xc6cdbdac [usbus2] 100043 D - 0xc6cdbd7c [usbus2] 100042 D - 0xc6cdbd4c [usbus2] 100041 D - 0xc6cdbd1c [usbus2] 100039 D - 0xc6cc6dac [usbus1] 100038 D - 0xc6cc6d7c [usbus1] 100037 D - 0xc6cc6d4c [usbus1] 100036 D - 0xc6cc6d1c [usbus1] 100034 D - 0xc6ca9dac [usbus0] 100033 D - 0xc6ca9d7c [usbus0] 100032 D - 0xc6ca9d4c [usbus0] 100031 D - 0xc6ca9d1c [usbus0] 2 0 0 0 DL (threaded) [cam] 100062 D - 0xc1456928 [scanner] 100014 D - 0xc1456a80 [doneq0] 14 0 0 0 DL - 0xc14717e0 [rand_harvestq] 13 0 0 0 DL (threaded) [geom] 100011 D - 0xc158ec60 [g_down] 100010 D - 0xc158ec5c [g_up] 100009 D - 0xc158ec58 [g_event] 12 0 0 0 WL (threaded) [intr] 100058 I [irq1: atkbd0] 100057 I [swi0: uart] 100055 I [irq20: hpet0+] 100054 I [irq14: ata0] 100045 I [irq23: uhci3] 100040 I [irq18: uhci2] 100035 I [irq22: uhci1] 100030 I [irq21: uhci0 ehci0] 100029 I [irq17: bge1] 100028 I [irq16: bge0] 100018 I [swi5: fast taskq] 100016 I [swi6: Giant taskq] 100015 I [swi6: task queue] 100008 I [swi4: clock] 100007 I [swi4: clock] 100006 I [swi3: vm] 100005 I [swi1: netisr 0] 11 0 0 0 RL (threaded) [idle] 100004 Run CPU 1 [idle: cpu1] 100003 CanRun [idle: cpu0] 1 0 1 0 SLs wait 0xc6ac02f0 [init] 10 0 0 0 DL audit_wo 0xc1592f14 [audit] 0 0 0 0 DLs (threaded) [kernel] 100061 D - 0xc6ac5380 [CAM taskq] 100059 D - 0xc6d46200 [mca taskq] 100027 D - 0xc6c28e00 [em1 txq] 100026 D - 0xc6c28e80 [em1 que] 100025 D - 0xc6c29200 [em0 txq] 100024 D - 0xc6c29280 [em0 que] 100023 D - 0xc6ac4480 [acpi_task_2] 100022 D - 0xc6ac4480 [acpi_task_1] 100021 D - 0xc6ac4480 [acpi_task_0] 100020 D - 0xc6ac4500 [ffs_trim taskq] 100019 D - 0xc6ac4580 [kqueue taskq] 100017 D - 0xc6ac4700 [thread taskq] 100012 D - 0xc6ac5a80 [firmware taskq] 100000 D swapin 0xc158ece4 [swapper] db:0:kdb.enter.panic> alltrace Tracing command sysctl pid 984 tid 100105 td 0xc769f310 kdb_enter(c11b2609,c11b2609,c11e064d,f09236ec,0,...) at kdb_enter+0x3d/frame 0xf09236a0 panic(c11e064d,cc0e5000,1,f0923804,f09237f4,...) at panic+0x13f/frame 0xf09236e0 vm_fault_hold(c1a6d000,cc0e5000,1,0,0,...) at vm_fault_hold+0x2076/frame 0xf0923840 vm_fault(c1a6d000,cc0e5000,1,0,c0b72331,...) at vm_fault+0x81/frame 0xf0923868 trap_pfault(cc0e5fb8,c1472000,f0923914,c6baf200,f09239a4,...) at trap_pfault+0x1bb/frame 0xf09238e8 trap(f0923a34) at trap+0x674/frame 0xf0923a28 calltrap() at calltrap+0x6/frame 0xf0923a28 --- trap 0xc, eip = 0xc1049023, esp = 0xf0923a74, ebp = 0xf0923a9c --- copyout(f0923b28,cc0e5fb8,4,f0923acc,c142c7a8,...) at copyout+0x37/frame 0xf0923a9c sysctl_ip6_temppltime(c142c7a8,c6a9e3a8,0,f0923b28,f0923b28,...) at sysctl_ip6_temppltime+0x3a/frame 0xf0923ac0 sysctl_root(f0923b28,8,2,c0a058a7,c7017850,...) at sysctl_root+0x2b1/frame 0xf0923b00 userland_sysctl(c769f310,f0923bac,4,28803030,bfbfdb70,...) at userland_sysctl+0x1fa/frame 0xf0923b70 sys___sysctl(c769f310,f0923ca8,2e,f0923c64,c0b329f2,...) at sys___sysctl+0x98/frame 0xf0923c18 syscall(f0923ce8) at syscall+0x4a6/frame 0xf0923cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf0923cdc --- syscall (202, FreeBSD ELF32, sys___sysctl), eip = 0x281a28b7, esp = 0xbfbfdb00, ebp = 0xbfbfdb28 --- Tracing command csh pid 980 tid 100104 td 0xc6f69930 sched_switch(c6f69930,0,104,c0b0edad,0,...) at sched_switch+0x2d2/frame 0xf091fa7c mi_switch(104,0,c0b134a4,c0b0edad,c1a69000,c6f69930) at mi_switch+0x122/frame 0xf091fab4 sleepq_switch(c6f69930,0,c11b698a,1a8,0,...) at sleepq_switch+0x15b/frame 0xf091fadc sleepq_catch_signals(0,c11b698a,154,c6f69930,f091fba4,...) at sleepq_catch_signals+0x5be/frame 0xf091fb30 sleepq_wait_sig(c6f66934,74,c10a57b4,100,0,...) at sleepq_wait_sig+0x14/frame 0xf091fb5c _sleep(c6f66934,c6f66968,174,c10a57b4,0,...) at _sleep+0x29b/frame 0xf091fba4 kern_sigsuspend(c6f69930,0,0,0,0,...) at kern_sigsuspend+0x137/frame 0xf091fbe8 sys_sigsuspend(c6f69930,f091fca8,fffffed8,0,0,...) at sys_sigsuspend+0x58/frame 0xf091fc18 syscall(f091fce8) at syscall+0x4a6/frame 0xf091fcdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf091fcdc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x28176fbb, esp = 0xbfbfe374, ebp = 0xbfbfe3dc --- Tracing command getty pid 979 tid 100103 td 0xc6f69c40 sched_switch(c6f69c40,0,104,ac,98,...) at sched_switch+0x2d2/frame 0xf091b984 mi_switch(104,0,c0b134a4,0,f091ba0c,c6f69c40) at mi_switch+0x122/frame 0xf091b9bc sleepq_switch(c6f69c40,0,c11b698a,1a8,c6d48200,...) at sleepq_switch+0x15b/frame 0xf091b9e4 sleepq_catch_signals(0,c11b698a,154,c6d48200,c154e760,...) at sleepq_catch_signals+0x5be/frame 0xf091ba38 sleepq_wait_sig(c6d4a870,0,c11b907b,101,0,...) at sleepq_wait_sig+0x14/frame 0xf091ba64 _cv_wait_sig(c6d4a870,c158f610,1,1,f091baec,...) at _cv_wait_sig+0x17c/frame 0xf091ba94 tty_wait(c6d4a800,c6d4a870,f091bbe8,1,0,...) at tty_wait+0x1f/frame 0xf091baac ttydisc_read(c6d4a800,f091bbe8,0,c0be7ba0,c7017578,...) at ttydisc_read+0x31c/frame 0xf091baec ttydev_read(c6d19700,f091bbe8,0,f091bb40,c6f69c40,...) at ttydev_read+0x8f/frame 0xf091bb10 devfs_read_f(c7017578,f091bbe8,c6fa9580,0,c6f69c40,...) at devfs_read_f+0xb4/frame 0xf091bb48 dofileread(c7017578,f091bbe8,ffffffff,ffffffff,0,...) at dofileread+0x9e/frame 0xf091bb80 kern_readv(c6f69c40,0,f091bbe8,0,bfbfedf7,...) at kern_readv+0x96/frame 0xf091bbc8 sys_read(c6f69c40,f091bca8,c6f66bc0,f091bc64,c0b329f2,...) at sys_read+0x5c/frame 0xf091bc18 syscall(f091bce8) at syscall+0x4a6/frame 0xf091bcdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf091bcdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281b52b7, esp = 0xbfbfeddc, ebp = 0xbfbfee08 --- Tracing command getty pid 978 tid 100102 td 0xc71b8000 sched_switch(c71b8000,0,104,ac,98,...) at sched_switch+0x2d2/frame 0xf0917984 mi_switch(104,0,c0b134a4,0,f0917a0c,c71b8000) at mi_switch+0x122/frame 0xf09179bc sleepq_switch(c71b8000,0,c11b698a,1a8,c6d48400,...) at sleepq_switch+0x15b/frame 0xf09179e4 sleepq_catch_signals(0,c11b698a,154,c6d48400,c154e760,...) at sleepq_catch_signals+0x5be/frame 0xf0917a38 sleepq_wait_sig(c6d4aa70,0,c11b907b,101,0,...) at sleepq_wait_sig+0x14/frame 0xf0917a64 _cv_wait_sig(c6d4aa70,c158f610,1,1,f0917aec,...) at _cv_wait_sig+0x17c/frame 0xf0917a94 tty_wait(c6d4aa00,c6d4aa70,f0917be8,1,0,...) at tty_wait+0x1f/frame 0xf0917aac ttydisc_read(c6d4aa00,f0917be8,0,c0be7ba0,c7017508,...) at ttydisc_read+0x31c/frame 0xf0917aec ttydev_read(c6d19800,f0917be8,0,f0917b40,c71b8000,...) at ttydev_read+0x8f/frame 0xf0917b10 devfs_read_f(c7017508,f0917be8,c74b4380,0,c71b8000,...) at devfs_read_f+0xb4/frame 0xf0917b48 dofileread(c7017508,f0917be8,ffffffff,ffffffff,0,...) at dofileread+0x9e/frame 0xf0917b80 kern_readv(c71b8000,0,f0917be8,0,bfbfedf7,...) at kern_readv+0x96/frame 0xf0917bc8 sys_read(c71b8000,f0917ca8,c729b000,c71b8000,c71bac40,...) at sys_read+0x5c/frame 0xf0917c18 syscall(f0917ce8) at syscall+0x4a6/frame 0xf0917cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf0917cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281b52b7, esp = 0xbfbfeddc, ebp = 0xbfbfee08 --- Tracing command getty pid 977 tid 100101 td 0xc71b8310 sched_switch(c71b8310,0,104,ac,98,...) at sched_switch+0x2d2/frame 0xf0913984 mi_switch(104,0,c0b134a4,0,f0913a0c,c71b8310) at mi_switch+0x122/frame 0xf09139bc sleepq_switch(c71b8310,0,c11b698a,1a8,c6d48600,...) at sleepq_switch+0x15b/frame 0xf09139e4 sleepq_catch_signals(0,c11b698a,154,c6d48600,c154e760,...) at sleepq_catch_signals+0x5be/frame 0xf0913a38 sleepq_wait_sig(c6d4ac70,0,c11b907b,101,0,...) at sleepq_wait_sig+0x14/frame 0xf0913a64 _cv_wait_sig(c6d4ac70,c158f610,1,1,f0913aec,...) at _cv_wait_sig+0x17c/frame 0xf0913a94 tty_wait(c6d4ac00,c6d4ac70,f0913be8,1,0,...) at tty_wait+0x1f/frame 0xf0913aac ttydisc_read(c6d4ac00,f0913be8,0,0,0,...) at ttydisc_read+0x31c/frame 0xf0913aec ttydev_read(c6d19900,f0913be8,0,f0913b40,c71b8310,...) at ttydev_read+0x8f/frame 0xf0913b10 devfs_read_f(c7017690,f0913be8,c74b4400,0,c71b8310,...) at devfs_read_f+0xb4/frame 0xf0913b48 dofileread(c7017690,f0913be8,ffffffff,ffffffff,0,...) at dofileread+0x9e/frame 0xf0913b80 kern_readv(c71b8310,0,f0913be8,0,bfbfedf7,...) at kern_readv+0x96/frame 0xf0913bc8 sys_read(c71b8310,f0913ca8,c729b2f0,f0913c64,c0b329f2,...) at sys_read+0x5c/frame 0xf0913c18 syscall(f0913ce8) at syscall+0x4a6/frame 0xf0913cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf0913cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281b52b7, esp = 0xbfbfeddc, ebp = 0xbfbfee08 --- Tracing command getty pid 976 tid 100085 td 0xc72cc620 sched_switch(c72cc620,0,104,ac,98,...) at sched_switch+0x2d2/frame 0xf0895984 mi_switch(104,0,c0b134a4,0,f0895a0c,c72cc620) at mi_switch+0x122/frame 0xf08959bc sleepq_switch(c72cc620,0,c11b698a,1a8,c6d48800,...) at sleepq_switch+0x15b/frame 0xf08959e4 sleepq_catch_signals(0,c11b698a,154,c6d48800,c154e760,...) at sleepq_catch_signals+0x5be/frame 0xf0895a38 sleepq_wait_sig(c6d4ae70,0,c11b907b,101,0,...) at sleepq_wait_sig+0x14/frame 0xf0895a64 _cv_wait_sig(c6d4ae70,c158f610,1,1,f0895aec,...) at _cv_wait_sig+0x17c/frame 0xf0895a94 tty_wait(c6d4ae00,c6d4ae70,f0895be8,1,0,...) at tty_wait+0x1f/frame 0xf0895aac ttydisc_read(c6d4ae00,f0895be8,0,c0be7ba0,c702e038,...) at ttydisc_read+0x31c/frame 0xf0895aec ttydev_read(c6d19a00,f0895be8,0,f0895b40,c72cc620,...) at ttydev_read+0x8f/frame 0xf0895b10 devfs_read_f(c702e038,f0895be8,c74b4480,0,c72cc620,...) at devfs_read_f+0xb4/frame 0xf0895b48 dofileread(c702e038,f0895be8,ffffffff,ffffffff,0,...) at dofileread+0x9e/frame 0xf0895b80 kern_readv(c72cc620,0,f0895be8,0,bfbfedf7,...) at kern_readv+0x96/frame 0xf0895bc8 sys_read(c72cc620,f0895ca8,c72c2000,f0895c64,c0b329f2,...) at sys_read+0x5c/frame 0xf0895c18 syscall(f0895ce8) at syscall+0x4a6/frame 0xf0895cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf0895cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281b52b7, esp = 0xbfbfeddc, ebp = 0xbfbfee08 --- Tracing command getty pid 975 tid 100094 td 0xc71bac40 sched_switch(c71bac40,0,104,ac,98,...) at sched_switch+0x2d2/frame 0xf08c8984 mi_switch(104,0,c0b134a4,0,f08c8a0c,c71bac40) at mi_switch+0x122/frame 0xf08c89bc sleepq_switch(c71bac40,0,c11b698a,1a8,c6d48a00,...) at sleepq_switch+0x15b/frame 0xf08c89e4 sleepq_catch_signals(0,c11b698a,154,c6d48a00,c154e760,...) at sleepq_catch_signals+0x5be/frame 0xf08c8a38 sleepq_wait_sig(c6d4c070,0,c11b907b,101,0,...) at sleepq_wait_sig+0x14/frame 0xf08c8a64 _cv_wait_sig(c6d4c070,c158f610,1,1,f08c8aec,...) at _cv_wait_sig+0x17c/frame 0xf08c8a94 tty_wait(c6d4c000,c6d4c070,f08c8be8,1,0,...) at tty_wait+0x1f/frame 0xf08c8aac ttydisc_read(c6d4c000,f08c8be8,0,c0be7ba0,c70175b0,...) at ttydisc_read+0x31c/frame 0xf08c8aec ttydev_read(c6d19b00,f08c8be8,0,f08c8b40,c71bac40,...) at ttydev_read+0x8f/frame 0xf08c8b10 devfs_read_f(c70175b0,f08c8be8,c6fa9500,0,c71bac40,...) at devfs_read_f+0xb4/frame 0xf08c8b48 dofileread(c70175b0,f08c8be8,ffffffff,ffffffff,0,...) at dofileread+0x9e/frame 0xf08c8b80 kern_readv(c71bac40,0,f08c8be8,0,bfbfedf7,...) at kern_readv+0x96/frame 0xf08c8bc8 sys_read(c71bac40,f08c8ca8,c72c05e0,1,c6f67930,...) at sys_read+0x5c/frame 0xf08c8c18 syscall(f08c8ce8) at syscall+0x4a6/frame 0xf08c8cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf08c8cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281b52b7, esp = 0xbfbfeddc, ebp = 0xbfbfee08 --- Tracing command getty pid 974 tid 100075 td 0xc6f67930 sched_switch(c6f67930,0,104,ac,98,...) at sched_switch+0x2d2/frame 0xee3bf984 mi_switch(104,0,c0b134a4,0,ee3bfa0c,c6f67930) at mi_switch+0x122/frame 0xee3bf9bc sleepq_switch(c6f67930,0,c11b698a,1a8,c6d48c00,...) at sleepq_switch+0x15b/frame 0xee3bf9e4 sleepq_catch_signals(0,c11b698a,154,c6d48c00,c154e760,...) at sleepq_catch_signals+0x5be/frame 0xee3bfa38 sleepq_wait_sig(c6d4c270,0,c11b907b,101,0,...) at sleepq_wait_sig+0x14/frame 0xee3bfa64 _cv_wait_sig(c6d4c270,c158f610,1,1,ee3bfaec,...) at _cv_wait_sig+0x17c/frame 0xee3bfa94 tty_wait(c6d4c200,c6d4c270,ee3bfbe8,1,0,...) at tty_wait+0x1f/frame 0xee3bfaac ttydisc_read(c6d4c200,ee3bfbe8,0,c0be7ba0,c7017540,...) at ttydisc_read+0x31c/frame 0xee3bfaec ttydev_read(c6d19c00,ee3bfbe8,0,ee3bfb40,c6f67930,...) at ttydev_read+0x8f/frame 0xee3bfb10 devfs_read_f(c7017540,ee3bfbe8,c6fa9480,0,c6f67930,...) at devfs_read_f+0xb4/frame 0xee3bfb48 dofileread(c7017540,ee3bfbe8,ffffffff,ffffffff,0,...) at dofileread+0x9e/frame 0xee3bfb80 kern_readv(c6f67930,0,ee3bfbe8,0,bfbfedf7,...) at kern_readv+0x96/frame 0xee3bfbc8 sys_read(c6f67930,ee3bfca8,c6f642f0,1,c72cc620,...) at sys_read+0x5c/frame 0xee3bfc18 syscall(ee3bfce8) at syscall+0x4a6/frame 0xee3bfcdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xee3bfcdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281b52b7, esp = 0xbfbfeddc, ebp = 0xbfbfee08 --- Tracing command getty pid 973 tid 100076 td 0xc6f67620 sched_switch(c6f67620,0,104,ac,98,...) at sched_switch+0x2d2/frame 0xee3c2984 mi_switch(104,0,c0b134a4,0,ee3c2a0c,c6f67620) at mi_switch+0x122/frame 0xee3c29bc sleepq_switch(c6f67620,0,c11b698a,1a8,c6bafe00,...) at sleepq_switch+0x15b/frame 0xee3c29e4 sleepq_catch_signals(0,c11b698a,154,c6bafe00,c154e760,...) at sleepq_catch_signals+0x5be/frame 0xee3c2a38 sleepq_wait_sig(c6baf070,0,c11b907b,101,0,...) at sleepq_wait_sig+0x14/frame 0xee3c2a64 _cv_wait_sig(c6baf070,c158f610,1,1,ee3c2aec,...) at _cv_wait_sig+0x17c/frame 0xee3c2a94 tty_wait(c6baf000,c6baf070,ee3c2be8,1,0,...) at tty_wait+0x1f/frame 0xee3c2aac ttydisc_read(c6baf000,ee3c2be8,0,c0be7ba0,c70174d0,...) at ttydisc_read+0x31c/frame 0xee3c2aec ttydev_read(c6d19d00,ee3c2be8,0,ee3c2b40,c6f67620,...) at ttydev_read+0x8f/frame 0xee3c2b10 devfs_read_f(c70174d0,ee3c2be8,c6fa9400,0,c6f67620,...) at devfs_read_f+0xb4/frame 0xee3c2b48 dofileread(c70174d0,ee3c2be8,ffffffff,ffffffff,0,...) at dofileread+0x9e/frame 0xee3c2b80 kern_readv(c6f67620,0,ee3c2be8,0,bfbfedf7,...) at kern_readv+0x96/frame 0xee3c2bc8 sys_read(c6f67620,ee3c2ca8,c6f64000,1,c0b329f2,...) at sys_read+0x5c/frame 0xee3c2c18 syscall(ee3c2ce8) at syscall+0x4a6/frame 0xee3c2cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xee3c2cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281b52b7, esp = 0xbfbfeddc, ebp = 0xbfbfee08 --- Tracing command login pid 972 tid 100069 td 0xc6f68c40 sched_switch(c6f68c40,0,104,c0dea0cc,0,...) at sched_switch+0x2d2/frame 0xee3aa960 mi_switch(104,0,c315c7c4,3,2,c6f68c40) at mi_switch+0x122/frame 0xee3aa998 sleepq_switch(c6f68c40,0,c11b698a,1a8,0,...) at sleepq_switch+0x15b/frame 0xee3aa9c0 sleepq_catch_signals(0,c11b698a,154,c6f68c40,ee3aaa44,...) at sleepq_catch_signals+0x5be/frame 0xee3aaa14 sleepq_wait_sig(c6f655e0,6c,c11b77f6,100,0,...) at sleepq_wait_sig+0x14/frame 0xee3aaa40 _sleep(c6f655e0,c6f65678,16c,c11b77f6,0,...) at _sleep+0x29b/frame 0xee3aaa88 kern_wait6(c6f68c40,0,3d4,0,ee3aab24,...) at kern_wait6+0x725/frame 0xee3aaaf8 sys_wait4(c6f68c40,ee3aaca8,c6f655e0,4,c088707e,...) at sys_wait4+0x94/frame 0xee3aac18 syscall(ee3aace8) at syscall+0x4a6/frame 0xee3aacdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xee3aacdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2811c143, esp = 0xbfbfed20, ebp = 0xbfbfed38 --- Tracing command sleep pid 967 tid 100077 td 0xc6f67310 sched_switch(c6f67310,0,104,ac,98,...) at sched_switch+0x2d2/frame 0xee3caa4c mi_switch(104,0,c0b40637,1,c7293444,c6f67310) at mi_switch+0x122/frame 0xee3caa84 sleepq_switch(c6f67310,0,c11b698a,1a8,4a,...) at sleepq_switch+0x15b/frame 0xee3caaac sleepq_catch_signals(c0000000,3,c0b72670,c6f67310,1,...) at sleepq_catch_signals+0x5be/frame 0xee3cab00 sleepq_timedwait_sig(c1515641,6c,4a,c0000000,3,...) at sleepq_timedwait_sig+0x14/frame 0xee3cab30 _sleep(c1515641,0,16c,c11b32c4,a1dea2f,...) at _sleep+0x26b/frame 0xee3cab78 kern_nanosleep(bfbfee40,ee3cabf0,ee3cabf8,ee3cace8,3c,...) at kern_nanosleep+0x14b/frame 0xee3cabd8 sys_nanosleep(c6f67310,ee3caca8,c6ac0bc0,c6f67310,c71b9930,...) at sys_nanosleep+0x69/frame 0xee3cac18 syscall(ee3cace8) at syscall+0x4a6/frame 0xee3cacdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xee3cacdc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x2817b203, esp = 0xbfbfee0c, ebp = 0xbfbfee54 --- Tracing command logger pid 966 tid 100074 td 0xc6f67c40 sched_switch(c6f67c40,0,104,ac,98,...) at sched_switch+0x2d2/frame 0xee3bb9dc mi_switch(104,0,c0b134a4,0,0,c6f67c40) at mi_switch+0x122/frame 0xee3bba14 sleepq_switch(c6f67c40,0,c11b698a,1a8,ee3bbaa0,...) at sleepq_switch+0x15b/frame 0xee3bba3c sleepq_catch_signals(0,c11b698a,154,0,0,...) at sleepq_catch_signals+0x5be/frame 0xee3bba90 sleepq_wait_sig(c70377f8,5c,c11b7397,100,0,...) at sleepq_wait_sig+0x14/frame 0xee3bbabc _sleep(c70377f8,c7037978,15c,c11b7397,0,...) at _sleep+0x29b/frame 0xee3bbb04 pipe_read(c70175e8,ee3bbbe8,c6ff5c80,0,c6f67c40,...) at pipe_read+0x33a/frame 0xee3bbb48 dofileread(c70175e8,ee3bbbe8,ffffffff,ffffffff,0,...) at dofileread+0x9e/frame 0xee3bbb80 kern_readv(c6f67c40,0,ee3bbbe8,0,28808000,...) at kern_readv+0x96/frame 0xee3bbbc8 sys_read(c6f67c40,ee3bbca8,c6f645e0,1,c6f67310,...) at sys_read+0x5c/frame 0xee3bbc18 syscall(ee3bbce8) at syscall+0x4a6/frame 0xee3bbcdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xee3bbcdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a02b7, esp = 0xbfbfe958, ebp = 0xbfbfe96c --- Tracing command sh pid 965 tid 100081 td 0xc71b9930 sched_switch(c71b9930,0,104,ee3e19d0,0,...) at sched_switch+0x2d2/frame 0xee3e1960 mi_switch(104,0,c7294818,0,0,c71b9930) at mi_switch+0x122/frame 0xee3e1998 sleepq_switch(c71b9930,0,c11b698a,1a8,c71b9930,...) at sleepq_switch+0x15b/frame 0xee3e19c0 sleepq_catch_signals(0,c11b698a,154,c71b9930,ee3e1a44,...) at sleepq_catch_signals+0x5be/frame 0xee3e1a14 sleepq_wait_sig(c729c8d0,6c,c11b77f6,100,0,...) at sleepq_wait_sig+0x14/frame 0xee3e1a40 _sleep(c729c8d0,c729c968,16c,c11b77f6,0,...) at _sleep+0x29b/frame 0xee3e1a88 kern_wait6(c71b9930,7,0,0,ee3e1b24,...) at kern_wait6+0x725/frame 0xee3e1af8 sys_wait4(c71b9930,ee3e1ca8,fffffed8,0,0,...) at sys_wait4+0x94/frame 0xee3e1c18 syscall(ee3e1ce8) at syscall+0x4a6/frame 0xee3e1cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xee3e1cdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2815d143, esp = 0xbfbfdd48, ebp = 0xbfbfdd60 --- Tracing command cron pid 928 tid 100100 td 0xc71b8620 sched_switch(c71b8620,0,104,c0b4103a,f0908a70,...) at sched_switch+0x2d2/frame 0xf0908a4c mi_switch(104,0,c0b40637,0,0,c71b8620) at mi_switch+0x122/frame 0xf0908a84 sleepq_switch(c71b8620,0,c11b698a,1a8,6b,...) at sleepq_switch+0x15b/frame 0xf0908aac sleepq_catch_signals(bfd19a33,3,c0b72670,c71b8620,0,...) at sleepq_catch_signals+0x5be/frame 0xf0908b00 sleepq_timedwait_sig(c1515640,6c,6b,bfd19a33,3,...) at sleepq_timedwait_sig+0x14/frame 0xf0908b30 _sleep(c1515640,0,16c,c11b32c4,3380bb39,...) at _sleep+0x26b/frame 0xf0908b78 kern_nanosleep(bfbfee28,f0908bf0,f0908bf8,f0908ce8,3b,...) at kern_nanosleep+0x14b/frame 0xf0908bd8 sys_nanosleep(c71b8620,f0908ca8,c729b5e0,1,0,...) at sys_nanosleep+0x69/frame 0xf0908c18 syscall(f0908ce8) at syscall+0x4a6/frame 0xf0908cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf0908cdc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x2819f203, esp = 0xbfbfecb4, ebp = 0xbfbfee44 --- Tracing command sendmail pid 924 tid 100098 td 0xc71b8c40 sched_switch(c71b8c40,0,104,ac,98,...) at sched_switch+0x2d2/frame 0xf08e5a7c mi_switch(104,0,c0b134a4,0,0,c71b8c40) at mi_switch+0x122/frame 0xf08e5ab4 sleepq_switch(c71b8c40,0,c11b698a,1a8,0,...) at sleepq_switch+0x15b/frame 0xf08e5adc sleepq_catch_signals(0,c11b698a,154,c71b8c40,f08e5ba4,...) at sleepq_catch_signals+0x5be/frame 0xf08e5b30 sleepq_wait_sig(c729bc24,74,c10a57b4,100,0,...) at sleepq_wait_sig+0x14/frame 0xf08e5b5c _sleep(c729bc24,c729bc58,174,c10a57b4,0,...) at _sleep+0x29b/frame 0xf08e5ba4 kern_sigsuspend(c71b8c40,0,0,0,0,...) at kern_sigsuspend+0x137/frame 0xf08e5be8 sys_sigsuspend(c71b8c40,f08e5ca8,c729bbc0,c71b8c40,c72cc930,...) at sys_sigsuspend+0x58/frame 0xf08e5c18 syscall(f08e5ce8) at syscall+0x4a6/frame 0xf08e5cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf08e5cdc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x2836bfbb, esp = 0xbfbfd9cc, ebp = 0xbfbfd9f8 --- Tracing command sendmail pid 921 tid 100099 td 0xc71b8930 sched_switch(c71b8930,0,104,ac,0,...) at sched_switch+0x2d2/frame 0xf08e88d8 mi_switch(104,0,f08e898c,c0b134a4,2845a000,c71b8930) at mi_switch+0x122/frame 0xf08e8910 sleepq_switch(c71b8930,0,c11b698a,1a8,f11734f8,...) at sleepq_switch+0x15b/frame 0xf08e8938 sleepq_catch_signals(50000000,0,c0b72670,c71b8930,1,...) at sleepq_catch_signals+0x5be/frame 0xf08e898c sleepq_timedwait_sig(c6fa0b24,0,30,50000000,0,...) at sleepq_timedwait_sig+0x14/frame 0xf08e89bc _cv_timedwait_sig_sbt(c6fa0b24,c6fa0b10,f11734f8,30,50000000,...) at _cv_timedwait_sig_sbt+0x1a7/frame 0xf08e89f0 seltdwait(30,50000000,0,c71b8930,f08e8ba0,...) at seltdwait+0xc1/frame 0xf08e8a28 kern_select(c71b8930,4,bfbfcfb8,0,0,...) at kern_select+0x8c2/frame 0xf08e8bd0 sys_select(c71b8930,f08e8ca8,c729b8d0,4,c088707e,...) at sys_select+0x69/frame 0xf08e8c18 syscall(f08e8ce8) at syscall+0x4a6/frame 0xf08e8cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf08e8cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28444277, esp = 0xbfbfcf1c, ebp = 0xbfbfd9d8 --- Tracing command sshd pid 918 tid 100072 td 0xc6f68310 sched_switch(c6f68310,0,104,ac,98,...) at sched_switch+0x2d2/frame 0xee3b48e0 mi_switch(104,0,0,0,40a,c6f68310) at mi_switch+0x122/frame 0xee3b4918 sleepq_switch(c6f68310,0,c11b698a,1a8,0,...) at sleepq_switch+0x15b/frame 0xee3b4940 sleepq_catch_signals(0,c11b698a,154,ee3b4ba8,ee3b49d4,...) at sleepq_catch_signals+0x5be/frame 0xee3b4994 sleepq_wait_sig(c6fd23e4,0,c11ecb42,101,0,...) at sleepq_wait_sig+0x14/frame 0xee3b49c0 _cv_wait_sig(c6fd23e4,c6fd23d0,c702dcb0,c6f68310,ee3b4a28,...) at _cv_wait_sig+0x17c/frame 0xee3b49f0 seltdwait(ffffffff,0,0,c6f68310,ee3b4ba0,...) at seltdwait+0xcf/frame 0xee3b4a28 kern_select(c6f68310,5,28c0c158,0,0,...) at kern_select+0x8c2/frame 0xee3b4bd0 sys_select(c6f68310,ee3b4ca8,c6f64bc0,c6f68310,c72cc930,...) at sys_select+0x69/frame 0xee3b4c18 syscall(ee3b4ce8) at syscall+0x4a6/frame 0xee3b4cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xee3b4cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28636277, esp = 0xbfbfe43c, ebp = 0xbfbfe460 --- Tracing command syslogd pid 725 tid 100084 td 0xc72cc930 sched_switch(c72cc930,0,104,c152191c,0,...) at sched_switch+0x2d2/frame 0xee3fb8e0 mi_switch(104,0,ee3fb950,c0af7134,c6d23930,c72cc930) at mi_switch+0x122/frame 0xee3fb918 sleepq_switch(c72cc930,0,c11b698a,1a8,c6aa5e3c,...) at sleepq_switch+0x15b/frame 0xee3fb940 sleepq_catch_signals(0,c11b698a,154,ee3fba28,c1036475,...) at sleepq_catch_signals+0x5be/frame 0xee3fb994 sleepq_wait_sig(c6d57da4,0,c11ecb42,101,0,...) at sleepq_wait_sig+0x14/frame 0xee3fb9c0 _cv_wait_sig(c6d57da4,c6d57d90,c0a05c9b,c69a4000,0,...) at _cv_wait_sig+0x17c/frame 0xee3fb9f0 seltdwait(ffffffff,0,0,c72cc930,ee3fbba0,...) at seltdwait+0xcf/frame 0xee3fba28 kern_select(c72cc930,9,28834118,0,0,...) at kern_select+0x8c2/frame 0xee3fbbd0 sys_select(c72cc930,ee3fbca8,804c210,c74c5000,0,...) at sys_select+0x69/frame 0xee3fbc18 syscall(ee3fbce8) at syscall+0x4a6/frame 0xee3fbcdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xee3fbcdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281b8277, esp = 0xbfbfdea4, ebp = 0xbfbfee34 --- Tracing command devd pid 649 tid 100071 td 0xc6f68620 sched_switch(c6f68620,0,104,ac,98,...) at sched_switch+0x2d2/frame 0xee3b18d8 mi_switch(104,0,0,c0b134a4,0,c6f68620) at mi_switch+0x122/frame 0xee3b1910 sleepq_switch(c6f68620,0,c11b698a,1a8,4127f8c6,...) at sleepq_switch+0x15b/frame 0xee3b1938 sleepq_catch_signals(c0000000,3,c0b72670,c6f68620,0,...) at sleepq_catch_signals+0x5be/frame 0xee3b198c sleepq_timedwait_sig(c6fa1524,0,48,c0000000,3,...) at sleepq_timedwait_sig+0x14/frame 0xee3b19bc _cv_timedwait_sig_sbt(c6fa1524,c6fa1510,4127f8c6,48,c0000000,...) at _cv_timedwait_sig_sbt+0x1a7/frame 0xee3b19f0 seltdwait(48,c0000000,3,c6f68620,ee3b1ba0,...) at seltdwait+0xc1/frame 0xee3b1a28 kern_select(c6f68620,6,bfbfcda0,0,0,...) at kern_select+0x8c2/frame 0xee3b1bd0 sys_select(c6f68620,ee3b1ca8,c6f65000,4,c088707e,...) at sys_select+0x69/frame 0xee3b1c18 syscall(ee3b1ce8) at syscall+0x4a6/frame 0xee3b1cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xee3b1cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x8097703, esp = 0xbfbfcd3c, ebp = 0xbfbfee54 --- Tracing command vnlru pid 16 tid 100068 td 0xc6f69000 sched_switch(c6f69000,0,104,0,36254e5d,...) at sched_switch+0x2d2/frame 0xee3a6b5c mi_switch(104,0,101,c6f69000,ee3a6be8,c6f658d0) at mi_switch+0x122/frame 0xee3a6b94 sleepq_switch(c6f69000,0,c11b698a,28b,101,...) at sleepq_switch+0x15b/frame 0xee3a6bbc sleepq_timedwait(c6f658d0,60,0,0,0,...) at sleepq_timedwait+0x3f/frame 0xee3a6be8 _sleep(c6f658d0,c1534980,260,c11bd97c,fffffed8,...) at _sleep+0x282/frame 0xee3a6c30 vnlru_proc(0,ee3a6ce8,0,0,0,...) at vnlru_proc+0xcf/frame 0xee3a6ca4 fork_exit(c0bdb7e0,0,ee3a6ce8) at fork_exit+0xa3/frame 0xee3a6cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xee3a6cd4 --- trap 0, eip = 0, esp = 0xee3a6d20, ebp = 0 --- Tracing command syncer pid 9 tid 100067 td 0xc6f69310 sched_switch(c6f69310,0,104,36254e5d,0,...) at sched_switch+0x2d2/frame 0xee3a3b68 mi_switch(104,0,101,c6f69310,ee3a3bf4,c15349c4) at mi_switch+0x122/frame 0xee3a3ba0 sleepq_switch(c6f69310,0,c11b698a,28b,101,...) at sleepq_switch+0x15b/frame 0xee3a3bc8 sleepq_timedwait(c15349c4,0,0,0,0,...) at sleepq_timedwait+0x3f/frame 0xee3a3bf4 _cv_timedwait_sbt(c15349c4,c15349a4,fffffed8,0,0,...) at _cv_timedwait_sbt+0x1a7/frame 0xee3a3c28 sched_sync(0,ee3a3ce8,0,0,0,...) at sched_sync+0x7a1/frame 0xee3a3ca4 fork_exit(c0bdaea0,0,ee3a3ce8) at fork_exit+0xa3/frame 0xee3a3cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xee3a3cd4 --- trap 0, eip = 0, esp = 0xee3a3d20, ebp = 0 --- Tracing command bufdaemon pid 8 tid 100080 td 0xc71b9c40 sched_switch(c71b9c40,0,104,0,e9db9457,...) at sched_switch+0x2d2/frame 0xee3d3b8c mi_switch(104,0,101,c71b9c40,ee3d3c18,c6fb6a84) at mi_switch+0x122/frame 0xee3d3bc4 sleepq_switch(c71b9c40,0,c11b698a,28b,101,...) at sleepq_switch+0x15b/frame 0xee3d3bec sleepq_timedwait(c6fb6a84,54,0,0,0,...) at sleepq_timedwait+0x3f/frame 0xee3d3c18 _sleep(c6fb6a84,c6fb6a00,54,c11de1de,7fffff6c,...) at _sleep+0x282/frame 0xee3d3c60 softdep_flush(c70f7000,ee3d3ce8,c0da9070,0,ee3d3cd0,...) at softdep_flush+0x16a/frame 0xee3d3ca4 fork_exit(c0da9070,c70f7000,ee3d3ce8) at fork_exit+0xa3/frame 0xee3d3cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xee3d3cd4 --- trap 0, eip = 0, esp = 0xee3d3d20, ebp = 0 --- Tracing command bufdaemon pid 8 tid 100079 td 0xc71ba000 sched_switch(c71ba000,0,104,0,d041fadb,...) at sched_switch+0x2d2/frame 0xee3d0b8c mi_switch(104,0,101,c71ba000,ee3d0c18,c6fb6884) at mi_switch+0x122/frame 0xee3d0bc4 sleepq_switch(c71ba000,0,c11b698a,28b,101,...) at sleepq_switch+0x15b/frame 0xee3d0bec sleepq_timedwait(c6fb6884,54,0,0,0,...) at sleepq_timedwait+0x3f/frame 0xee3d0c18 _sleep(c6fb6884,c6fb6800,54,c11de1de,7fffff6c,...) at _sleep+0x282/frame 0xee3d0c60 softdep_flush(c70f72a0,ee3d0ce8,c0da9070,0,ee3d0cd0,...) at softdep_flush+0x16a/frame 0xee3d0ca4 fork_exit(c0da9070,c70f72a0,ee3d0ce8) at fork_exit+0xa3/frame 0xee3d0cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xee3d0cd4 --- trap 0, eip = 0, esp = 0xee3d0d20, ebp = 0 --- Tracing command bufdaemon pid 8 tid 100066 td 0xc6f69620 sched_switch(c6f69620,0,104,36254e5d,0,...) at sched_switch+0x2d2/frame 0xee3a0b98 mi_switch(104,0,101,c6f69620,ee3a0c24,c1534104) at mi_switch+0x122/frame 0xee3a0bd0 sleepq_switch(c6f69620,0,c11b698a,28b,101,...) at sleepq_switch+0x15b/frame 0xee3a0bf8 sleepq_timedwait(c1534104,54,0,0,0,...) at sleepq_timedwait+0x3f/frame 0xee3a0c24 _sleep(c1534104,c1534080,54,c11bb3e7,fffffed8,...) at _sleep+0x282/frame 0xee3a0c6c buf_daemon(0,ee3a0ce8,0,0,0,...) at buf_daemon+0xac/frame 0xee3a0ca4 fork_exit(c0bbeac0,0,ee3a0ce8) at fork_exit+0xa3/frame 0xee3a0cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xee3a0cd4 --- trap 0, eip = 0, esp = 0xee3a0d20, ebp = 0 --- Tracing command pagezero pid 7 tid 100065 td 0xc6cee620 sched_switch(c6cee620,0,104,79b9a83d,0,...) at sched_switch+0x2d2/frame 0xee39dba0 mi_switch(104,0,101,c6cee620,ee39dc2c,c1539320) at mi_switch+0x122/frame 0xee39dbd8 sleepq_switch(c6cee620,0,c11b698a,28b,101,...) at sleepq_switch+0x15b/frame 0xee39dc00 sleepq_timedwait(c1539320,0,12b,0,0,...) at sleepq_timedwait+0x3f/frame 0xee39dc2c _sleep(c1539320,c1594580,0,c11e2463,fffea520,...) at _sleep+0x282/frame 0xee39dc74 vm_pagezero(0,ee39dce8,0,0,0,...) at vm_pagezero+0xd2/frame 0xee39dca4 fork_exit(c0e09ef0,0,ee39dce8) at fork_exit+0xa3/frame 0xee39dcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xee39dcd4 --- trap 0, eip = 0, esp = 0xee39dd20, ebp = 0 --- Tracing command vmdaemon pid 6 tid 100064 td 0xc6cee930 sched_switch(c6cee930,0,104,0,c6cee930,...) at sched_switch+0x2d2/frame 0xee39ab64 mi_switch(104,0,0,0,c6cee930,c1539044) at mi_switch+0x122/frame 0xee39ab9c sleepq_switch(c6cee930,0,c11b698a,268,0,...) at sleepq_switch+0x15b/frame 0xee39abc4 sleepq_wait(c1539044,74,c11bb3e7,0,0,...) at sleepq_wait+0x3f/frame 0xee39abf0 _sleep(c1539044,c153902c,74,c11bb3e7,0,...) at _sleep+0x2ae/frame 0xee39ac38 vm_daemon(0,ee39ace8,0,0,0,...) at vm_daemon+0x116/frame 0xee39aca4 fork_exit(c0e029a0,0,ee39ace8) at fork_exit+0xa3/frame 0xee39acd4 fork_trampoline() at fork_trampoline+0x8/frame 0xee39acd4 --- trap 0, eip = 0, esp = 0xee39ad20, ebp = 0 --- Tracing command pagedaemon pid 5 tid 100063 td 0xc6ceec40 sched_switch(c6ceec40,0,104,0,36254e5d,...) at sched_switch+0x2d2/frame 0xee397b64 mi_switch(104,0,101,c6ceec40,ee397bf0,c1594604) at mi_switch+0x122/frame 0xee397b9c sleepq_switch(c6ceec40,0,c11b698a,28b,101,...) at sleepq_switch+0x15b/frame 0xee397bc4 sleepq_timedwait(c1594604,54,0,0,0,...) at sleepq_timedwait+0x3f/frame 0xee397bf0 _sleep(c1594604,c1594580,54,c11bb3e7,fffffed8,...) at _sleep+0x282/frame 0xee397c38 vm_pageout(0,ee397ce8,0,0,0,...) at vm_pageout+0x1fb/frame 0xee397ca4 fork_exit(c0e03410,0,ee397ce8) at fork_exit+0xa3/frame 0xee397cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xee397cd4 --- trap 0, eip = 0, esp = 0xee397d20, ebp = 0 --- Tracing command sctp_iterator pid 4 tid 100060 td 0xc6d22620 sched_switch(c6d22620,0,104,0,c6d22620,...) at sched_switch+0x2d2/frame 0xee38eba4 mi_switch(104,0,d6fa6fc8,c0b0eedf,c6d22620,c1592874) at mi_switch+0x122/frame 0xee38ebdc sleepq_switch(c6d22620,0,c11b698a,268,c6fa6fc8,...) at sleepq_switch+0x15b/frame 0xee38ec04 sleepq_wait(c1592874,0,c11ce22b,0,0,...) at sleepq_wait+0x3f/frame 0xee38ec30 _sleep(c1592874,c159283c,0,c11ce22b,0,...) at _sleep+0x2ae/frame 0xee38ec78 sctp_iterator_thread(0,ee38ece8,0,0,0,...) at sctp_iterator_thread+0x9c/frame 0xee38eca4 fork_exit(c0c83920,0,ee38ece8) at fork_exit+0xa3/frame 0xee38ecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xee38ecd4 --- trap 0, eip = 0, esp = 0xee38ed20, ebp = 0 --- Tracing command fdc0 pid 3 tid 100056 td 0xc6d23310 sched_switch(c6d23310,0,104,0,36254e5d,...) at sched_switch+0x2d2/frame 0xee381b34 mi_switch(104,0,101,c6d23310,ee381bc0,c6baf83c) at mi_switch+0x122/frame 0xee381b6c sleepq_switch(c6d23310,0,c11b698a,28b,101,...) at sleepq_switch+0x15b/frame 0xee381b94 sleepq_timedwait(c6baf83c,5c,0,0,0,...) at sleepq_timedwait+0x3f/frame 0xee381bc0 _sleep(c6baf83c,c6baf8f0,5c,c11a23c4,fffffed8,...) at _sleep+0x282/frame 0xee381c08 fdc_thread(c6baf800,ee381ce8,0,0,0,...) at fdc_thread+0x877/frame 0xee381ca4 fork_exit(c0fc2e20,c6baf800,ee381ce8) at fork_exit+0xa3/frame 0xee381cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xee381cd4 --- trap 0, eip = 0, esp = 0xee381d20, ebp = 0 --- Tracing command usb pid 15 tid 100053 td 0xc6d23c40 sched_switch(c6d23c40,0,104,0,0,...) at sched_switch+0x2d2/frame 0xee304bb8 mi_switch(104,0,0,80246,c6d23c40,c6d09d34) at mi_switch+0x122/frame 0xee304bf0 sleepq_switch(c6d23c40,0,c11b698a,268,0,...) at sleepq_switch+0x15b/frame 0xee304c18 sleepq_wait(c6d09d34,0,c11a23c4,1,0,...) at sleepq_wait+0x3f/frame 0xee304c44 _cv_wait(c6d09d34,c6d09e74,c118e08e,73,0,...) at _cv_wait+0x182/frame 0xee304c74 usb_process(c6d09d2c,ee304ce8,0,0,0,...) at usb_process+0xf6/frame 0xee304ca4 fork_exit(c09a4cc0,c6d09d2c,ee304ce8) at fork_exit+0xa3/frame 0xee304cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xee304cd4 --- trap 0, eip = 0, esp = 0xee304d20, ebp = 0 --- Tracing command usb pid 15 tid 100052 td 0xc6c85c40 sched_switch(c6c85c40,0,104,0,0,...) at sched_switch+0x2d2/frame 0xee301bb8 mi_switch(104,0,c6c99fc8,c0b3286d,c6c85c40,c6d09d04) at mi_switch+0x122/frame 0xee301bf0 sleepq_switch(c6c85c40,0,c11b698a,268,c6d57640,...) at sleepq_switch+0x15b/frame 0xee301c18 sleepq_wait(c6d09d04,0,c11a23c4,1,0,...) at sleepq_wait+0x3f/frame 0xee301c44 _cv_wait(c6d09d04,c6d09e74,c118e08e,73,0,...) at _cv_wait+0x182/frame 0xee301c74 usb_process(c6d09cfc,ee301ce8,0,0,0,...) at usb_process+0xf6/frame 0xee301ca4 fork_exit(c09a4cc0,c6d09cfc,ee301ce8) at fork_exit+0xa3/frame 0xee301cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xee301cd4 --- trap 0, eip = 0, esp = 0xee301d20, ebp = 0 --- Tracing command usb pid 15 tid 100051 td 0xc6cec000 sched_switch(c6cec000,0,104,0,0,...) at sched_switch+0x2d2/frame 0xee2febb8 mi_switch(104,0,0,80246,c6cec000,c6d09cd4) at mi_switch+0x122/frame 0xee2febf0 sleepq_switch(c6cec000,0,c11b698a,268,0,...) at sleepq_switch+0x15b/frame 0xee2fec18 sleepq_wait(c6d09cd4,0,c11a23c4,1,0,...) at sleepq_wait+0x3f/frame 0xee2fec44 _cv_wait(c6d09cd4,c6d09e74,c118e08e,73,0,...) at _cv_wait+0x182/frame 0xee2fec74 usb_process(c6d09ccc,ee2fece8,0,0,0,...) at usb_process+0xf6/frame 0xee2feca4 fork_exit(c09a4cc0,c6d09ccc,ee2fece8) at fork_exit+0xa3/frame 0xee2fecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xee2fecd4 --- trap 0, eip = 0, esp = 0xee2fed20, ebp = 0 --- Tracing command usb pid 15 tid 100050 td 0xc6cec310 sched_switch(c6cec310,0,104,0,0,...) at sched_switch+0x2d2/frame 0xee2fbbb8 mi_switch(104,0,0,80246,c6cec310,c6d09ca4) at mi_switch+0x122/frame 0xee2fbbf0 sleepq_switch(c6cec310,0,c11b698a,268,0,...) at sleepq_switch+0x15b/frame 0xee2fbc18 sleepq_wait(c6d09ca4,0,c11a23c4,1,0,...) at sleepq_wait+0x3f/frame 0xee2fbc44 _cv_wait(c6d09ca4,c6d09e74,c118e08e,73,0,...) at _cv_wait+0x182/frame 0xee2fbc74 usb_process(c6d09c9c,ee2fbce8,0,0,0,...) at usb_process+0xf6/frame 0xee2fbca4 fork_exit(c09a4cc0,c6d09c9c,ee2fbce8) at fork_exit+0xa3/frame 0xee2fbcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xee2fbcd4 --- trap 0, eip = 0, esp = 0xee2fbd20, ebp = 0 --- Tracing command usb pid 15 tid 100049 td 0xc6cec620 sched_switch(c6cec620,0,104,c09a52a9,0,...) at sched_switch+0x2d2/frame 0xee2f5bb8 mi_switch(104,0,0,80246,c6cec620,c6cf2dac) at mi_switch+0x122/frame 0xee2f5bf0 sleepq_switch(c6cec620,0,c11b698a,268,4,...) at sleepq_switch+0x15b/frame 0xee2f5c18 sleepq_wait(c6cf2dac,0,c11a23c4,1,0,...) at sleepq_wait+0x3f/frame 0xee2f5c44 _cv_wait(c6cf2dac,c6cf2eec,c118e08e,73,0,...) at _cv_wait+0x182/frame 0xee2f5c74 usb_process(c6cf2da4,ee2f5ce8,0,0,0,...) at usb_process+0xf6/frame 0xee2f5ca4 fork_exit(c09a4cc0,c6cf2da4,ee2f5ce8) at fork_exit+0xa3/frame 0xee2f5cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xee2f5cd4 --- trap 0, eip = 0, esp = 0xee2f5d20, ebp = 0 --- Tracing command usb pid 15 tid 100048 td 0xc6cec930 sched_switch(c6cec930,0,104,0,0,...) at sched_switch+0x2d2/frame 0xee2f2bb8 mi_switch(104,0,c0995672,c158f620,c6cec930,c6cf2d7c) at mi_switch+0x122/frame 0xee2f2bf0 sleepq_switch(c6cec930,0,c11b698a,268,c6d57380,...) at sleepq_switch+0x15b/frame 0xee2f2c18 sleepq_wait(c6cf2d7c,0,c11a23c4,1,0,...) at sleepq_wait+0x3f/frame 0xee2f2c44 _cv_wait(c6cf2d7c,c6cf2eec,c118e08e,73,0,...) at _cv_wait+0x182/frame 0xee2f2c74 usb_process(c6cf2d74,ee2f2ce8,0,0,0,...) at usb_process+0xf6/frame 0xee2f2ca4 fork_exit(c09a4cc0,c6cf2d74,ee2f2ce8) at fork_exit+0xa3/frame 0xee2f2cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xee2f2cd4 --- trap 0, eip = 0, esp = 0xee2f2d20, ebp = 0 --- Tracing command usb pid 15 tid 100047 td 0xc6cecc40 sched_switch(c6cecc40,0,104,0,0,...) at sched_switch+0x2d2/frame 0xee2efbb8 mi_switch(104,0,0,80246,c6cecc40,c6cf2d4c) at mi_switch+0x122/frame 0xee2efbf0 sleepq_switch(c6cecc40,0,c11b698a,268,0,...) at sleepq_switch+0x15b/frame 0xee2efc18 sleepq_wait(c6cf2d4c,0,c11a23c4,1,0,...) at sleepq_wait+0x3f/frame 0xee2efc44 _cv_wait(c6cf2d4c,c6cf2eec,c118e08e,73,0,...) at _cv_wait+0x182/frame 0xee2efc74 usb_process(c6cf2d44,ee2efce8,0,0,0,...) at usb_process+0xf6/frame 0xee2efca4 fork_exit(c09a4cc0,c6cf2d44,ee2efce8) at fork_exit+0xa3/frame 0xee2efcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xee2efcd4 --- trap 0, eip = 0, esp = 0xee2efd20, ebp = 0 --- Tracing command usb pid 15 tid 100046 td 0xc6ced000 sched_switch(c6ced000,0,104,8,0,...) at sched_switch+0x2d2/frame 0xee2ecbb8 mi_switch(104,0,3660,0,c6ced000,c6cf2d1c) at mi_switch+0x122/frame 0xee2ecbf0 sleepq_switch(c6ced000,0,c11b698a,268,4,...) at sleepq_switch+0x15b/frame 0xee2ecc18 sleepq_wait(c6cf2d1c,0,c11a23c4,1,0,...) at sleepq_wait+0x3f/frame 0xee2ecc44 _cv_wait(c6cf2d1c,c6cf2eec,c118e08e,73,0,...) at _cv_wait+0x182/frame 0xee2ecc74 usb_process(c6cf2d14,ee2ecce8,0,0,0,...) at usb_process+0xf6/frame 0xee2ecca4 fork_exit(c09a4cc0,c6cf2d14,ee2ecce8) at fork_exit+0xa3/frame 0xee2eccd4 fork_trampoline() at fork_trampoline+0x8/frame 0xee2eccd4 --- trap 0, eip = 0, esp = 0xee2ecd20, ebp = 0 --- Tracing command usb pid 15 tid 100044 td 0xc6ced620 sched_switch(c6ced620,0,104,0,0,...) at sched_switch+0x2d2/frame 0xee2e5bb8 mi_switch(104,0,0,80246,c6ced620,c6cdbdac) at mi_switch+0x122/frame 0xee2e5bf0 sleepq_switch(c6ced620,0,c11b698a,268,0,...) at sleepq_switch+0x15b/frame 0xee2e5c18 sleepq_wait(c6cdbdac,0,c11a23c4,1,0,...) at sleepq_wait+0x3f/frame 0xee2e5c44 _cv_wait(c6cdbdac,c6cdbeec,c118e08e,73,0,...) at _cv_wait+0x182/frame 0xee2e5c74 usb_process(c6cdbda4,ee2e5ce8,0,0,0,...) at usb_process+0xf6/frame 0xee2e5ca4 fork_exit(c09a4cc0,c6cdbda4,ee2e5ce8) at fork_exit+0xa3/frame 0xee2e5cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xee2e5cd4 --- trap 0, eip = 0, esp = 0xee2e5d20, ebp = 0 --- Tracing command usb pid 15 tid 100043 td 0xc6ced930 sched_switch(c6ced930,0,104,0,0,...) at sched_switch+0x2d2/frame 0xee2e2bb8 mi_switch(104,0,0,0,c6ced930,c6cdbd7c) at mi_switch+0x122/frame 0xee2e2bf0 sleepq_switch(c6ced930,0,c11b698a,268,c6d57140,...) at sleepq_switch+0x15b/frame 0xee2e2c18 sleepq_wait(c6cdbd7c,0,c11a23c4,1,0,...) at sleepq_wait+0x3f/frame 0xee2e2c44 _cv_wait(c6cdbd7c,c6cdbeec,c118e08e,73,0,...) at _cv_wait+0x182/frame 0xee2e2c74 usb_process(c6cdbd74,ee2e2ce8,0,0,0,...) at usb_process+0xf6/frame 0xee2e2ca4 fork_exit(c09a4cc0,c6cdbd74,ee2e2ce8) at fork_exit+0xa3/frame 0xee2e2cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xee2e2cd4 --- trap 0, eip = 0, esp = 0xee2e2d20, ebp = 0 --- Tracing command usb pid 15 tid 100042 td 0xc6cedc40 sched_switch(c6cedc40,0,104,0,0,...) at sched_switch+0x2d2/frame 0xee2dfbb8 mi_switch(104,0,0,80246,c6cedc40,c6cdbd4c) at mi_switch+0x122/frame 0xee2dfbf0 sleepq_switch(c6cedc40,0,c11b698a,268,0,...) at sleepq_switch+0x15b/frame 0xee2dfc18 sleepq_wait(c6cdbd4c,0,c11a23c4,1,0,...) at sleepq_wait+0x3f/frame 0xee2dfc44 _cv_wait(c6cdbd4c,c6cdbeec,c118e08e,73,0,...) at _cv_wait+0x182/frame 0xee2dfc74 usb_process(c6cdbd44,ee2dfce8,0,0,0,...) at usb_process+0xf6/frame 0xee2dfca4 fork_exit(c09a4cc0,c6cdbd44,ee2dfce8) at fork_exit+0xa3/frame 0xee2dfcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xee2dfcd4 --- trap 0, eip = 0, esp = 0xee2dfd20, ebp = 0 --- Tracing command usb pid 15 tid 100041 td 0xc6cee000 sched_switch(c6cee000,0,104,0,0,...) at sched_switch+0x2d2/frame 0xee2dcbb8 mi_switch(104,0,0,80246,c6cee000,c6cdbd1c) at mi_switch+0x122/frame 0xee2dcbf0 sleepq_switch(c6cee000,0,c11b698a,268,0,...) at sleepq_switch+0x15b/frame 0xee2dcc18 sleepq_wait(c6cdbd1c,0,c11a23c4,1,0,...) at sleepq_wait+0x3f/frame 0xee2dcc44 _cv_wait(c6cdbd1c,c6cdbeec,c118e08e,73,0,...) at _cv_wait+0x182/frame 0xee2dcc74 usb_process(c6cdbd14,ee2dcce8,0,0,0,...) at usb_process+0xf6/frame 0xee2dcca4 fork_exit(c09a4cc0,c6cdbd14,ee2dcce8) at fork_exit+0xa3/frame 0xee2dccd4 fork_trampoline() at fork_trampoline+0x8/frame 0xee2dccd4 --- trap 0, eip = 0, esp = 0xee2dcd20, ebp = 0 --- Tracing command usb pid 15 tid 100039 td 0xc6c0d310 sched_switch(c6c0d310,0,104,0,0,...) at sched_switch+0x2d2/frame 0xee2d5bb8 mi_switch(104,0,0,80246,c6c0d310,c6cc6dac) at mi_switch+0x122/frame 0xee2d5bf0 sleepq_switch(c6c0d310,0,c11b698a,268,0,...) at sleepq_switch+0x15b/frame 0xee2d5c18 sleepq_wait(c6cc6dac,0,c11a23c4,1,0,...) at sleepq_wait+0x3f/frame 0xee2d5c44 _cv_wait(c6cc6dac,c6cc6eec,c118e08e,73,0,...) at _cv_wait+0x182/frame 0xee2d5c74 usb_process(c6cc6da4,ee2d5ce8,0,0,0,...) at usb_process+0xf6/frame 0xee2d5ca4 fork_exit(c09a4cc0,c6cc6da4,ee2d5ce8) at fork_exit+0xa3/frame 0xee2d5cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xee2d5cd4 --- trap 0, eip = 0, esp = 0xee2d5d20, ebp = 0 --- Tracing command usb pid 15 tid 100038 td 0xc6c0d620 sched_switch(c6c0d620,0,104,c1a6c5d0,0,...) at sched_switch+0x2d2/frame 0xee2d2bb8 mi_switch(104,0,c6c99fc8,c0b3286d,c6c0d620,c6cc6d7c) at mi_switch+0x122/frame 0xee2d2bf0 sleepq_switch(c6c0d620,0,c11b698a,268,c6d57900,...) at sleepq_switch+0x15b/frame 0xee2d2c18 sleepq_wait(c6cc6d7c,0,c11a23c4,1,0,...) at sleepq_wait+0x3f/frame 0xee2d2c44 _cv_wait(c6cc6d7c,c6cc6eec,c118e08e,73,0,...) at _cv_wait+0x182/frame 0xee2d2c74 usb_process(c6cc6d74,ee2d2ce8,0,0,0,...) at usb_process+0xf6/frame 0xee2d2ca4 fork_exit(c09a4cc0,c6cc6d74,ee2d2ce8) at fork_exit+0xa3/frame 0xee2d2cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xee2d2cd4 --- trap 0, eip = 0, esp = 0xee2d2d20, ebp = 0 --- Tracing command usb pid 15 tid 100037 td 0xc6c0d930 sched_switch(c6c0d930,0,104,0,0,...) at sched_switch+0x2d2/frame 0xee2cfbb8 mi_switch(104,0,0,80246,c6c0d930,c6cc6d4c) at mi_switch+0x122/frame 0xee2cfbf0 sleepq_switch(c6c0d930,0,c11b698a,268,0,...) at sleepq_switch+0x15b/frame 0xee2cfc18 sleepq_wait(c6cc6d4c,0,c11a23c4,1,0,...) at sleepq_wait+0x3f/frame 0xee2cfc44 _cv_wait(c6cc6d4c,c6cc6eec,c118e08e,73,0,...) at _cv_wait+0x182/frame 0xee2cfc74 usb_process(c6cc6d44,ee2cfce8,0,0,0,...) at usb_process+0xf6/frame 0xee2cfca4 fork_exit(c09a4cc0,c6cc6d44,ee2cfce8) at fork_exit+0xa3/frame 0xee2cfcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xee2cfcd4 --- trap 0, eip = 0, esp = 0xee2cfd20, ebp = 0 --- Tracing command usb pid 15 tid 100036 td 0xc6c0dc40 sched_switch(c6c0dc40,0,104,0,0,...) at sched_switch+0x2d2/frame 0xee2ccbb8 mi_switch(104,0,0,80246,c6c0dc40,c6cc6d1c) at mi_switch+0x122/frame 0xee2ccbf0 sleepq_switch(c6c0dc40,0,c11b698a,268,0,...) at sleepq_switch+0x15b/frame 0xee2ccc18 sleepq_wait(c6cc6d1c,0,c11a23c4,1,0,...) at sleepq_wait+0x3f/frame 0xee2ccc44 _cv_wait(c6cc6d1c,c6cc6eec,c118e08e,73,0,...) at _cv_wait+0x182/frame 0xee2ccc74 us ---------------------------------------------------------------------- config.txt options CONFIG_AUTOGENERATED ident GENERIC machine i386 cpu I686_CPU cpu I586_CPU cpu I486_CPU makeoptions WITH_CTF=1 makeoptions DEBUG=-g options XENHVM options USB_DEBUG options ATH_ENABLE_11N options AH_AR5416_INTERRUPT_MITIGATION options AH_SUPPORT_AR5416 options IEEE80211_SUPPORT_MESH options IEEE80211_AMPDU_AGE options IEEE80211_DEBUG options SC_PIXEL_MODE options VESA options AHD_REG_PRETTY_PRINT options AHC_REG_PRETTY_PRINT options ATA_STATIC_ID options SMP options KDB_TRACE options KDB options DDB options VIMAGE options INCLUDE_CONFIG_FILE options DDB_CTF options KDTRACE_HOOKS options MAC options PROCDESC options CAPABILITIES options CAPABILITY_MODE options AUDIT options HWPMC_HOOKS options KBD_INSTALL_CDEV options PRINTF_BUFR_SIZE=128 options _KPOSIX_PRIORITY_SCHEDULING options SYSVSEM options SYSVMSG options SYSVSHM options STACK options KTRACE options SCSI_DELAY=5000 options COMPAT_FREEBSD7 options COMPAT_FREEBSD6 options COMPAT_FREEBSD5 options COMPAT_FREEBSD4 options GEOM_LABEL options GEOM_RAID options GEOM_PART_GPT options PSEUDOFS options PROCFS options CD9660 options MSDOSFS options NFS_ROOT options NFSLOCKD options NFSD options NFSCL options MD_ROOT options QUOTA options UFS_GJOURNAL options UFS_DIRHASH options UFS_ACL options SOFTUPDATES options FFS options SCTP options TCP_OFFLOAD options INET6 options INET options PREEMPTION options SCHED_ULE options NEW_PCIB options NATIVE options GEOM_PART_MBR options GEOM_PART_EBR_COMPAT options GEOM_PART_EBR options GEOM_PART_BSD options ISAPNP device isa device npx device mem device io device uart_ns8250 device atpic device apic device cpufreq device acpi device eisa device pci device fdc device ahci device ata device mvs device siis device ahb device ahc device ahd device esp device hptiop device isp device mpt device mps device mpr device sym device trm device adv device adw device aha device aic device bt device ncv device nsp device stg device isci device scbus device ch device da device sa device cd device pass device ses device amr device arcmsr device asr device ciss device dpt device hptmv device hptnr device hptrr device hpt27xx device iir device ips device mly device twa device tws device aac device aacp device aacraid device ida device mfi device mlx device mrsas device pst device twe device atkbdc device atkbd device psm device kbdmux device vga device splash device sc device vt device vt_vga device agp device pmtimer device cbb device pccard device cardbus device uart device ppc device ppbus device lpt device ppi device puc device bxe device de device em device igb device ixgb device le device ti device txp device vx device miibus device ae device age device alc device ale device bce device bfe device bge device cas device dc device et device fxp device gem device hme device jme device lge device msk device nfe device nge device pcn device re device rl device sf device sge device sis device sk device ste device stge device tl device tx device vge device vr device vte device wb device xl device cs device ed device ex device ep device fe device ie device sn device xe device wlan device wlan_wep device wlan_ccmp device wlan_tkip device wlan_amrr device an device ath device ath_pci device ath_hal device ath_rate_sample device ipw device iwi device iwn device malo device mwl device ral device wi device wpi device loop device random device padlock_rng device rdrand_rng device ether device vlan device tun device md device gif device faith device firmware device bpf device uhci device ohci device ehci device xhci device usb device ukbd device umass device sound device snd_cmi device snd_csa device snd_emu10kx device snd_es137x device snd_hda device snd_ich device snd_via8233 device mmc device mmcsd device sdhci device virtio device virtio_pci device vtnet device virtio_blk device virtio_scsi device virtio_balloon device hyperv device xenpci device vmx ---------------------------------------------------------------------- msgbuf.txt Copyright (c) 1992-2014 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 10.1-STABLE #1 r276174: Sat Jan 3 20:50:10 CET 2015 root at verdi.nethelp.no:/usr/src/sys/i386/compile/GENERICV i386 FreeBSD clang version 3.4.1 (tags/RELEASE_34/dot1-final 208032) 20140512 CPU: Intel(R) Pentium(R) D CPU 2.80GHz (2793.06-MHz 686-class CPU) Origin="GenuineIntel" Id=0xf47 Family=0xf Model=0x4 Stepping=7 Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE> Features2=0x641d<SSE3,DTES64,MON,DS_CPL,CNXT-ID,CX16,xTPR> AMD Features=0x20100000<NX,LM> AMD Features2=0x1<LAHF> TSC: P-state invariant real memory = 2147483648 (2048 MB) avail memory = 2083926016 (1987 MB) Event timer "LAPIC" quality 400 ACPI APIC Table: <DELL PESC430> FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs FreeBSD/SMP: 1 package(s) x 2 core(s) cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 1 WARNING: VIMAGE (virtualized network stack) is a highly experimental feature. ioapic0: Changing APIC ID to 8 ioapic0 <Version 2.0> irqs 0-23 on motherboard lapic0: Forcing LINT1 to edge trigger random: <Software, Yarrow> initialized kbd1 at kbdmux0 acpi0: <DELL PESC430> on motherboard acpi0: Power Button (fixed) acpi0: reservation of 0, a0000 (3) failed acpi0: reservation of 100000, f00000 (3) failed acpi0: reservation of 1000000, 7ee8cc00 (3) failed cpu0: <ACPI CPU> on acpi0 cpu1: <ACPI CPU> on acpi0 atrtc0: <AT realtime clock> port 0x70-0x7f irq 8 on acpi0 Event timer "RTC" frequency 32768 Hz quality 0 attimer0: <AT timer> port 0x40-0x5f irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0 hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 450 Event timer "HPET1" frequency 14318180 Hz quality 440 Event timer "HPET2" frequency 14318180 Hz quality 440 acpi_button0: <Power Button> on acpi0 pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0 pci0: <ACPI PCI bus> on pcib0 pcib1: <ACPI PCI-PCI bridge> irq 16 at device 1.0 on pci0 pci1: <ACPI PCI bus> on pcib1 pcib2: <ACPI PCI-PCI bridge> irq 16 at device 28.0 on pci0 pci2: <ACPI PCI bus> on pcib2 em0: <Intel(R) PRO/1000 Network Connection 7.4.2> port 0xdcc0-0xdcdf mem 0xfe880000-0xfe89ffff,0xfe8a0000-0xfe8bffff irq 16 at device 0.0 on pci2 em0: Using an MSI interrupt em0: Ethernet address: 00:15:17:36:bc:e8 em1: <Intel(R) PRO/1000 Network Connection 7.4.2> port 0xdce0-0xdcff mem 0xfe8c0000-0xfe8dffff,0xfe8e0000-0xfe8fffff irq 17 at device 0.1 on pci2 em1: Using an MSI interrupt em1: Ethernet address: 00:15:17:36:bc:e9 pcib3: <ACPI PCI-PCI bridge> irq 16 at device 28.4 on pci0 pci3: <ACPI PCI bus> on pcib3 bge0: <Broadcom NetXtreme PCIe Ethernet Adapter, ASIC rev. 0x004101> mem 0xfe7f0000-0xfe7fffff irq 16 at device 0.0 on pci3 bge0: CHIP ID 0x00004101; ASIC REV 0x04; CHIP REV 0x41; PCI-E miibus0: <MII bus> on bge0 brgphy0: <BCM5750 1000BASE-T media interface> PHY 1 on miibus0 brgphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto, auto-flow bge0: Ethernet address: 00:10:18:1c:60:ce pcib4: <ACPI PCI-PCI bridge> irq 17 at device 28.5 on pci0 pci4: <ACPI PCI bus> on pcib4 bge1: <Broadcom NetXtreme Gigabit Ethernet Controller, ASIC rev. 0x004001> mem 0xfe6f0000-0xfe6fffff irq 17 at device 0.0 on pci4 bge1: CHIP ID 0x00004001; ASIC REV 0x04; CHIP REV 0x40; PCI-E miibus1: <MII bus> on bge1 brgphy1: <BCM5750 1000BASE-T media interface> PHY 1 on miibus1 brgphy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto, auto-flow bge1: Ethernet address: 00:13:72:20:b4:6f uhci0: <Intel 82801G (ICH7) USB controller USB-A> port 0xff80-0xff9f irq 21 at device 29.0 on pci0 usbus0 on uhci0 uhci1: <Intel 82801G (ICH7) USB controller USB-B> port 0xff60-0xff7f irq 22 at device 29.1 on pci0 usbus1 on uhci1 uhci2: <Intel 82801G (ICH7) USB controller USB-C> port 0xff40-0xff5f irq 18 at device 29.2 on pci0 usbus2 on uhci2 uhci3: <Intel 82801G (ICH7) USB controller USB-D> port 0xff20-0xff3f irq 23 at device 29.3 on pci0 usbus3 on uhci3 ehci0: <Intel 82801GB/R (ICH7) USB 2.0 controller> mem 0xffa80800-0xffa80bff irq 21 at device 29.7 on pci0 usbus4: EHCI version 1.0 usbus4 on ehci0 pcib5: <ACPI PCI-PCI bridge> at device 30.0 on pci0 pci5: <ACPI PCI bus> on pcib5 vgapci0: <VGA-compatible display> port 0xcc80-0xccff mem 0xfc000000-0xfdffffff,0xfe4c0000-0xfe4fffff at device 7.0 on pci5 vgapci0: Boot video device isab0: <PCI-ISA bridge> at device 31.0 on pci0 isa0: <ISA bus> on isab0 atapci0: <Intel ICH7 UDMA100 controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xffa0-0xffaf irq 16 at device 31.1 on pci0 ata0: <ATA channel> at channel 0 on atapci0 atapci1: <Intel ICH7 SATA300 controller> port 0xfe00-0xfe07,0xfe10-0xfe13,0xfe20-0xfe27,0xfe30-0xfe33,0xfea0-0xfeaf irq 20 at device 31.2 on pci0 ata2: <ATA channel> at channel 0 on atapci1 ata3: <ATA channel> at channel 1 on atapci1 fdc0: <floppy drive controller> port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0 fd0: <1440-KB 3.5" drive> on fdc0 drive 0 uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 pmtimer0 on isa0 orm0: <ISA Option ROMs> at iomem 0xc0000-0xc7fff,0xc8000-0xc8fff,0xc9000-0xcafff,0xcb000-0xcbfff pnpid ORM0000 on isa0 sc0: <System console> at flags 0x100 on isa0 sc0: VGA <16 virtual consoles, flags=0x300> vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0 atkbd0: <AT Keyboard> irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] ppc0: parallel port not found. p4tcc0: <CPU Frequency Thermal Control> on cpu0 p4tcc1: <CPU Frequency Thermal Control> on cpu1 Timecounters tick every 1.000 msec random: unblocking device. usbus0: 12Mbps Full Speed USB v1.0 usbus1: 12Mbps Full Speed USB v1.0 usbus2: 12Mbps Full Speed USB v1.0 usbus3: 12Mbps Full Speed USB v1.0 usbus4: 480Mbps High Speed USB v2.0 ugen0.1: <Intel> at usbus0 uhub0: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus0 ugen2.1: <Intel> at usbus2 ugen1.1: <Intel> at usbus1 uhub1: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus1 ugen4.1: <Intel> at usbus4 uhub2: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus4 ugen3.1: <Intel> at usbus3 uhub3: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus3 uhub4: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus2 ada0 at ata2 bus 0 scbus1 target 0 lun 0 ada0: <ST3500320AS SD15> ATA-8 SATA 2.x device ada0: Serial Number 9QM098KE ada0: 300.000MB/s transfers (SATA 2.x, UDMA5, PIO 8192bytes) ada0: 476940MB (976773168 512 byte sectors: 16H 63S/T 16383C) ada0: Previously was known as ad4 ada1 at ata3 bus 0 scbus2 target 0 lun 0 ada1: <ST3500320AS SD15> ATA-8 SATA 2.x device ada1: Serial Number 9QM0D4DL ada1: 300.000MB/s transfers (SATA 2.x, UDMA5, PIO 8192bytes) ada1: 476940MB (976773168 512 byte sectors: 16H 63S/T 16383C) ada1: Previously was known as ad6 cd0 at ata0 bus 0 scbus0 target 0 lun 0 cd0: <HL-DT-ST CD-ROM GCR-8485B 1.06> Removable CD-ROM SCSI-0 device cd0: 33.300MB/s transfers (UDMA2, ATAPI 12bytes, PIO 65534bytes) cd0: Attempt to query device size failed: NOT READY, Medium not present uhub1: 2 ports with 2 removable, self powered uhub0: 2 ports with 2 removable, self powered uhub3: 2 ports with 2 removable, self powered uhub4: 2 ports with 2 removable, self powered lapic1: Forcing LINT1 to edge trigger SMP: AP CPU #1 Launched! Timecounter "TSC-low" frequency 1396531633 Hz quality 1000 Root mount waiting for: usbus4 Root mount waiting for: usbus4 uhub2: 8 ports with 8 removable, self powered Trying to mount root from ufs:/dev/ada0s1a [rw]... <118>Setting hostuuid: 44454c4c-4400-104a-8054-b8c04f43324a. <118>Setting hostid: 0xde1f5676. <118>Starting ddb. <118>Entropy harvesting: interrupts ethernet point_to_point swi. <118>Starting file system checks: <118>/dev/ada0s1a: FILE SYSTEM CLEAN; SKIPPING CHECKS <118>/dev/ada0s1a: clean, 4499260 free (1612 frags, 562206 blocks, 0.0% fragmentation) <118>/dev/ada0s1d: FILE SYSTEM CLEAN; SKIPPING CHECKS <118>/dev/ada0s1d: clean, 3269748 free (10100 frags, 407456 blocks, 0.2% fragmentation) <118>/dev/ada0s1e: FILE SYSTEM CLEAN; SKIPPING CHECKS <118>/dev/ada0s1e: clean, 2462027 free (147 frags, 307735 blocks, 0.0% fragmentation) <118>Mounting local file systems:. <118>Writing entropy file:. <118>Setting hostname: verdi.nethelp.no. ugen3.2: <DELL> at usbus3 ukbd0: <DELL DELL USB Keyboard, class 0/0, rev 1.10/1.05, addr 2> on usbus3 kbd2 at ukbd0 <118>Starting Network: lo0 em0 em1 bge0 bge1. <118>lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384 <118> options=600003<RXCSUM,TXCSUM,RXCSUM_IPV6,TXCSUM_IPV6> <118> inet6 ::1 prefixlen 128 <118> inet6 fe80::1%lo0 prefixlen 64 scopeid 0x5 <118> inet 127.0.0.1 netmask 0xff000000 <118> nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL> <118>em0: flags=8c02<BROADCAST,OACTIVE,SIMPLEX,MULTICAST> metric 0 mtu 1500 <118> options=4219b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,WOL_MAGIC,VLAN_HWTSO> <118> ether 00:15:17:36:bc:e8 <118> nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL> <118> media: Ethernet autoselect <118> status: no carrier <118>em1: flags=8c02<BROADCAST,OACTIVE,SIMPLEX,MULTICAST> metric 0 mtu 1500 <118> options=4019b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,VLAN_HWTSO> <118> ether 00:15:17:36:bc:e9 <118> nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL> <118> media: Ethernet autoselect <118> status: no carrier <118>bge0: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500 <118> options=8009b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,LINKSTATE> <118> ether 00:10:18:1c:60:ce <118> nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL> <118> media: Ethernet autoselect <118>bge1: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500 <118> options=8009b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,LINKSTATE> <118> ether 00:13:72:20:b4:6f <118> inet 10.0.0.2 netmask 0xfffffffc broadcast 10.0.0.3 <118> nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL> <118> media: Ethernet autoselect (none) <118> status: no carrier <118>Starting devd. <118>Starting Network: em0. <118>em0: flags=8c02<BROADCAST,OACTIVE,SIMPLEX,MULTICAST> metric 0 mtu 1500 <118> options=4219b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,WOL_MAGIC,VLAN_HWTSO> <118> ether 00:15:17:36:bc:e8 <118> nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL> <118> media: Ethernet autoselect <118> status: no carrier <118>Starting Network: em1. <118>em1: flags=8c02<BROADCAST,OACTIVE,SIMPLEX,MULTICAST> metric 0 mtu 1500 <118> options=4019b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,VLAN_HWTSO> <118> ether 00:15:17:36:bc:e9 <118> nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL> <118> media: Ethernet autoselect <118> status: no carrier <118>Starting Network: bge0. <118>bge0: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500 <118> options=8009b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,LINKSTATE> <118> ether 00:10:18:1c:60:ce <118> nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL> <118> media: Ethernet autoselect <118>Configuring syscons: keymap. <118>Starting pflogd: <118>add net fe80::: gateway ::1 <118>add net ff02::: gateway ::1 <118>add net ::ffff:0.0.0.0: gateway ::1 <118>add net ::0.0.0.0: gateway ::1 <118>Creating and/or trimming log files. <118>Starting syslogd. <118>No core dumps found. <118>ELF ldconfig path: /lib /usr/lib /usr/lib/compat <118>a.out ldconfig path: /usr/lib/aout /usr/lib/compat/aout <118>Clearing /tmp (X related). <118>Updating motd:. <118>Mounting late file systems:. <118>Configuring syscons: keymap blanktime. <118>Performing sanity check on sshd configuration. <118>Starting sshd. <118>Starting sendmail_submit. <118>Starting sendmail_msp_queue. <118>Starting cron. <118>Starting background file system checks in 60 seconds. <118> <118>Sat Jan 3 21:25:26 CET 2015 <118>Jan 3 21:25:31 verdi login: ROOT LOGIN (root) ON ttyv0 panic: vm_fault: fault on nofault entry, addr: cc0e5000 cpuid = 0 KDB: stack backtrace: db_trace_self_wrapper(c11b55f1,fc,0,10000000,1,...) at db_trace_self_wrapper+0x2d/frame 0xf0923638 kdb_backtrace(c1361c84,0,c11e064d,f09236ec,0,...) at kdb_backtrace+0x30/frame 0xf09236a0 panic(c11e064d,cc0e5000,1,f0923804,f09237f4,...) at panic+0x11f/frame 0xf09236e0 vm_fault_hold(c1a6d000,cc0e5000,1,0,0,...) at vm_fault_hold+0x2076/frame 0xf0923840 vm_fault(c1a6d000,cc0e5000,1,0,c0b72331,...) at vm_fault+0x81/frame 0xf0923868 trap_pfault(cc0e5fb8,c1472000,f0923914,c6baf200,f09239a4,...) at trap_pfault+0x1bb/frame 0xf09238e8 trap(f0923a34) at trap+0x674/frame 0xf0923a28 calltrap() at calltrap+0x6/frame 0xf0923a28 --- trap 0xc, eip = 0xc1049023, esp = 0xf0923a74, ebp = 0xf0923a9c --- copyout(f0923b28,cc0e5fb8,4,f0923acc,c142c7a8,...) at copyout+0x37/frame 0xf0923a9c sysctl_ip6_temppltime(c142c7a8,c6a9e3a8,0,f0923b28,f0923b28,...) at sysctl_ip6_temppltime+0x3a/frame 0xf0923ac0 sysctl_root(f0923b28,8,2,c0a058a7,c7017850,...) at sysctl_root+0x2b1/frame 0xf0923b00 userland_sysctl(c769f310,f0923bac,4,28803030,bfbfdb70,...) at userland_sysctl+0x1fa/frame 0xf0923b70 sys___sysctl(c769f310,f0923ca8,2e,f0923c64,c0b329f2,...) at sys___sysctl+0x98/frame 0xf0923c18 syscall(f0923ce8) at syscall+0x4a6/frame 0xf0923cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf0923cdc --- syscall (202, FreeBSD ELF32, sys___sysctl), eip = 0x281a28b7, esp = 0xbfbfdb00, ebp = 0xbfbfdb28 --- KDB: enter: panic ---------------------------------------------------------------------- panic.txt vm_fault: fault on nofault entry, addr: cc0e5000 ---------------------------------------------------------------------- version.txt FreeBSD 10.1-STABLE #1 r276174: Sat Jan 3 20:50:10 CET 2015 root at verdi.nethelp.no:/usr/src/sys/i386/compile/GENERICV
Nikos Vassiliadis
2015-Jan-04 14:16 UTC
10.1-STABLE/i386 GENERIC + VIMAGE: Panic when going multiuser
Hi, Can you update to a more recent revision? I am on 10-stable a few days later (1/1/15) than you and everything is ok. On 01/03/15 21:51, sthaug at nethelp.no wrote:>>> I have a reproducible crash in 10.1-STABLE/i386, svn updated to r276174. >>> The kernel is based on GENERIC with *one* line added: options VIMAGE. >>> >>> I can boot to single user with no problem. Going multiuser results in >>> immediate crash with backtrace >>> >>> #0 0xc0b59be2 at kdb_backtrace+0x52 >>> #1 0xc0b1b65f at panic+0x11f >>> #2 0xc0dd1666 at vm_fault_hold+0x2076 >>> #3 0xc0dcf5b1 at vm_fault+0x81 >>> #4 0xc103008b at trap_pfault+0x1bb >>> #5 0xc102f8e4 at trap+0x674 >>> #6 0xc101ad0c at calltrap+0x6 >>> #7 0xc0d0ca7a at sysctl_ip6_temppltime+0x3a >>> #8 0xc0b28031 at sysctl_root+0x2b1 >>> #9 0xc0b2862a at userland_sysctl+0x1fa >>> #10 0xc0b283e8 at sys___sysctl+0x98 >>> #11 0xc1030986 at syscall+0x4a6 >>> #12 0xc101ada1 at Xint0x80_syscall+0x21 >>> >> >> >> That stack trace doesn't have enough info. Can you: >> (1) boot into single mode on your system >> (2) Add this to /etc/rc.conf: >> ddb_enable="YES" >> (3) Reboot the system and let it go to multi-user > > I found I had to also add "options DDB" to the kernel. So this is > GENERIC + options VIMAGE + options DDB. I didn't get the panic when > going to multiuser this time - but as soon as I did "sysctl -a" the > expected panic came. Below is the result of the generated files in > /var/crash (I unpacked the textdump.tar.4 file). > > Steinar Haug, Nethelp consulting, sthaug at nethelp.no > > ---------------------------------------------------------------------- > > info.4 > > Dump header from device /dev/ada0s1b > Architecture: i386 > Architecture Version: 1 > Dump Length: 71168B (0 MB) > Blocksize: 512 > Dumptime: Sat Jan 3 21:26:03 2015 > Hostname: verdi.nethelp.no > Magic: FreeBSD Text Dump > Version String: FreeBSD 10.1-STABLE #1 r276174: Sat Jan 3 20:50:10 CET 2015 > root at verdi.nethelp.no:/usr/src/sys/i386/compile/GENERICV > Panic String: vm_fault: fault on nofault entry, addr: cc0e5000 > Dump Parity: 1182659946 > Bounds: 4 > Dump Status: good > > ---------------------------------------------------------------------- > > ddb.txt > > db:0:kdb.enter.panic> run lockinfo > db:1:lockinfo> show locks > No such command > db:1:locks> show alllocks > No such command > db:1:alllocks> show lockedvnods > Locked vnodes > db:0:kdb.enter.panic> show pcpu > cpuid = 0 > dynamic pcpu = 0x3d3a00 > curthread = 0xc769f310: pid 984 "sysctl" > curpcb = 0xf0923d40 > fpcurthread = none > idlethread = 0xc6ac3000: tid 100003 "idle: cpu0" > APIC ID = 0 > currentldt = 0x50 > curvnet = 0xc69713c0 > db:0:kdb.enter.panic> bt > Tracing pid 984 tid 100105 td 0xc769f310 > kdb_enter(c11b2609,c11b2609,c11e064d,f09236ec,0,...) at kdb_enter+0x3d/frame 0xf09236a0 > panic(c11e064d,cc0e5000,1,f0923804,f09237f4,...) at panic+0x13f/frame 0xf09236e0 > vm_fault_hold(c1a6d000,cc0e5000,1,0,0,...) at vm_fault_hold+0x2076/frame 0xf0923840 > vm_fault(c1a6d000,cc0e5000,1,0,c0b72331,...) at vm_fault+0x81/frame 0xf0923868 > trap_pfault(cc0e5fb8,c1472000,f0923914,c6baf200,f09239a4,...) at trap_pfault+0x1bb/frame 0xf09238e8 > trap(f0923a34) at trap+0x674/frame 0xf0923a28 > calltrap() at calltrap+0x6/frame 0xf0923a28 > --- trap 0xc, eip = 0xc1049023, esp = 0xf0923a74, ebp = 0xf0923a9c --- > copyout(f0923b28,cc0e5fb8,4,f0923acc,c142c7a8,...) at copyout+0x37/frame 0xf0923a9c > sysctl_ip6_temppltime(c142c7a8,c6a9e3a8,0,f0923b28,f0923b28,...) at sysctl_ip6_temppltime+0x3a/frame 0xf0923ac0 > sysctl_root(f0923b28,8,2,c0a058a7,c7017850,...) at sysctl_root+0x2b1/frame 0xf0923b00 > userland_sysctl(c769f310,f0923bac,4,28803030,bfbfdb70,...) at userland_sysctl+0x1fa/frame 0xf0923b70 > sys___sysctl(c769f310,f0923ca8,2e,f0923c64,c0b329f2,...) at sys___sysctl+0x98/frame 0xf0923c18 > syscall(f0923ce8) at syscall+0x4a6/frame 0xf0923cdc > Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf0923cdc > --- syscall (202, FreeBSD ELF32, sys___sysctl), eip = 0x281a28b7, esp = 0xbfbfdb00, ebp = 0xbfbfdb28 --- > db:0:kdb.enter.panic> ps > pid ppid pgrp uid state wmesg wchan cmd > 984 980 984 0 R+ CPU 0 sysctl > 980 972 980 0 S+ pause 0xc6f66934 csh > 979 1 979 0 Ss+ ttyin 0xc6d4a870 getty > 978 1 978 0 Ss+ ttyin 0xc6d4aa70 getty > 977 1 977 0 Ss+ ttyin 0xc6d4ac70 getty > 976 1 976 0 Ss+ ttyin 0xc6d4ae70 getty > 975 1 975 0 Ss+ ttyin 0xc6d4c070 getty > 974 1 974 0 Ss+ ttyin 0xc6d4c270 getty > 973 1 973 0 Ss+ ttyin 0xc6baf070 getty > 972 1 972 0 Ss+ wait 0xc6f655e0 login > 967 965 17 0 S+ nanslp 0xc1515641 sleep > 966 1 17 0 S+ piperd 0xc70377f8 logger > 965 1 17 0 S+ wait 0xc729c8d0 sh > 928 1 928 0 Ss nanslp 0xc1515640 cron > 924 1 924 25 Ss pause 0xc729bc24 sendmail > 921 1 921 0 Ss select 0xc6fa0b24 sendmail > 918 1 918 0 Ss select 0xc6fd23e4 sshd > 725 1 725 0 Ss select 0xc6d57da4 syslogd > 649 1 649 0 Ss select 0xc6fa1524 devd > 16 0 0 0 DL vlruwt 0xc6f658d0 [vnlru] > 9 0 0 0 DL syncer 0xc15349c4 [syncer] > 8 0 0 0 DL (threaded) [bufdaemon] > 100080 D sdflush 0xc6fb6a84 [/var worker] > 100079 D sdflush 0xc6fb6884 [/usr worker] > 100066 D psleep 0xc1534104 [bufdaemon] > 7 0 0 0 DL pgzero 0xc1539320 [pagezero] > 6 0 0 0 DL psleep 0xc1539044 [vmdaemon] > 5 0 0 0 DL psleep 0xc1594604 [pagedaemon] > 4 0 0 0 DL waiting_ 0xc1592874 [sctp_iterator] > 3 0 0 0 DL - 0xc6baf83c [fdc0] > 15 0 0 0 DL (threaded) [usb] > 100053 D - 0xc6d09d34 [usbus4] > 100052 D - 0xc6d09d04 [usbus4] > 100051 D - 0xc6d09cd4 [usbus4] > 100050 D - 0xc6d09ca4 [usbus4] > 100049 D - 0xc6cf2dac [usbus3] > 100048 D - 0xc6cf2d7c [usbus3] > 100047 D - 0xc6cf2d4c [usbus3] > 100046 D - 0xc6cf2d1c [usbus3] > 100044 D - 0xc6cdbdac [usbus2] > 100043 D - 0xc6cdbd7c [usbus2] > 100042 D - 0xc6cdbd4c [usbus2] > 100041 D - 0xc6cdbd1c [usbus2] > 100039 D - 0xc6cc6dac [usbus1] > 100038 D - 0xc6cc6d7c [usbus1] > 100037 D - 0xc6cc6d4c [usbus1] > 100036 D - 0xc6cc6d1c [usbus1] > 100034 D - 0xc6ca9dac [usbus0] > 100033 D - 0xc6ca9d7c [usbus0] > 100032 D - 0xc6ca9d4c [usbus0] > 100031 D - 0xc6ca9d1c [usbus0] > 2 0 0 0 DL (threaded) [cam] > 100062 D - 0xc1456928 [scanner] > 100014 D - 0xc1456a80 [doneq0] > 14 0 0 0 DL - 0xc14717e0 [rand_harvestq] > 13 0 0 0 DL (threaded) [geom] > 100011 D - 0xc158ec60 [g_down] > 100010 D - 0xc158ec5c [g_up] > 100009 D - 0xc158ec58 [g_event] > 12 0 0 0 WL (threaded) [intr] > 100058 I [irq1: atkbd0] > 100057 I [swi0: uart] > 100055 I [irq20: hpet0+] > 100054 I [irq14: ata0] > 100045 I [irq23: uhci3] > 100040 I [irq18: uhci2] > 100035 I [irq22: uhci1] > 100030 I [irq21: uhci0 ehci0] > 100029 I [irq17: bge1] > 100028 I [irq16: bge0] > 100018 I [swi5: fast taskq] > 100016 I [swi6: Giant taskq] > 100015 I [swi6: task queue] > 100008 I [swi4: clock] > 100007 I [swi4: clock] > 100006 I [swi3: vm] > 100005 I [swi1: netisr 0] > 11 0 0 0 RL (threaded) [idle] > 100004 Run CPU 1 [idle: cpu1] > 100003 CanRun [idle: cpu0] > 1 0 1 0 SLs wait 0xc6ac02f0 [init] > 10 0 0 0 DL audit_wo 0xc1592f14 [audit] > 0 0 0 0 DLs (threaded) [kernel] > 100061 D - 0xc6ac5380 [CAM taskq] > 100059 D - 0xc6d46200 [mca taskq] > 100027 D - 0xc6c28e00 [em1 txq] > 100026 D - 0xc6c28e80 [em1 que] > 100025 D - 0xc6c29200 [em0 txq] > 100024 D - 0xc6c29280 [em0 que] > 100023 D - 0xc6ac4480 [acpi_task_2] > 100022 D - 0xc6ac4480 [acpi_task_1] > 100021 D - 0xc6ac4480 [acpi_task_0] > 100020 D - 0xc6ac4500 [ffs_trim taskq] > 100019 D - 0xc6ac4580 [kqueue taskq] > 100017 D - 0xc6ac4700 [thread taskq] > 100012 D - 0xc6ac5a80 [firmware taskq] > 100000 D swapin 0xc158ece4 [swapper] > db:0:kdb.enter.panic> alltrace > > Tracing command sysctl pid 984 tid 100105 td 0xc769f310 > kdb_enter(c11b2609,c11b2609,c11e064d,f09236ec,0,...) at kdb_enter+0x3d/frame 0xf09236a0 > panic(c11e064d,cc0e5000,1,f0923804,f09237f4,...) at panic+0x13f/frame 0xf09236e0 > vm_fault_hold(c1a6d000,cc0e5000,1,0,0,...) at vm_fault_hold+0x2076/frame 0xf0923840 > vm_fault(c1a6d000,cc0e5000,1,0,c0b72331,...) at vm_fault+0x81/frame 0xf0923868 > trap_pfault(cc0e5fb8,c1472000,f0923914,c6baf200,f09239a4,...) at trap_pfault+0x1bb/frame 0xf09238e8 > trap(f0923a34) at trap+0x674/frame 0xf0923a28 > calltrap() at calltrap+0x6/frame 0xf0923a28 > --- trap 0xc, eip = 0xc1049023, esp = 0xf0923a74, ebp = 0xf0923a9c --- > copyout(f0923b28,cc0e5fb8,4,f0923acc,c142c7a8,...) at copyout+0x37/frame 0xf0923a9c > sysctl_ip6_temppltime(c142c7a8,c6a9e3a8,0,f0923b28,f0923b28,...) at sysctl_ip6_temppltime+0x3a/frame 0xf0923ac0 > sysctl_root(f0923b28,8,2,c0a058a7,c7017850,...) at sysctl_root+0x2b1/frame 0xf0923b00 > userland_sysctl(c769f310,f0923bac,4,28803030,bfbfdb70,...) at userland_sysctl+0x1fa/frame 0xf0923b70 > sys___sysctl(c769f310,f0923ca8,2e,f0923c64,c0b329f2,...) at sys___sysctl+0x98/frame 0xf0923c18 > syscall(f0923ce8) at syscall+0x4a6/frame 0xf0923cdc > Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf0923cdc > --- syscall (202, FreeBSD ELF32, sys___sysctl), eip = 0x281a28b7, esp = 0xbfbfdb00, ebp = 0xbfbfdb28 --- > > Tracing command csh pid 980 tid 100104 td 0xc6f69930 > sched_switch(c6f69930,0,104,c0b0edad,0,...) at sched_switch+0x2d2/frame 0xf091fa7c > mi_switch(104,0,c0b134a4,c0b0edad,c1a69000,c6f69930) at mi_switch+0x122/frame 0xf091fab4 > sleepq_switch(c6f69930,0,c11b698a,1a8,0,...) at sleepq_switch+0x15b/frame 0xf091fadc > sleepq_catch_signals(0,c11b698a,154,c6f69930,f091fba4,...) at sleepq_catch_signals+0x5be/frame 0xf091fb30 > sleepq_wait_sig(c6f66934,74,c10a57b4,100,0,...) at sleepq_wait_sig+0x14/frame 0xf091fb5c > _sleep(c6f66934,c6f66968,174,c10a57b4,0,...) at _sleep+0x29b/frame 0xf091fba4 > kern_sigsuspend(c6f69930,0,0,0,0,...) at kern_sigsuspend+0x137/frame 0xf091fbe8 > sys_sigsuspend(c6f69930,f091fca8,fffffed8,0,0,...) at sys_sigsuspend+0x58/frame 0xf091fc18 > syscall(f091fce8) at syscall+0x4a6/frame 0xf091fcdc > Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf091fcdc > --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x28176fbb, esp = 0xbfbfe374, ebp = 0xbfbfe3dc --- > > Tracing command getty pid 979 tid 100103 td 0xc6f69c40 > sched_switch(c6f69c40,0,104,ac,98,...) at sched_switch+0x2d2/frame 0xf091b984 > mi_switch(104,0,c0b134a4,0,f091ba0c,c6f69c40) at mi_switch+0x122/frame 0xf091b9bc > sleepq_switch(c6f69c40,0,c11b698a,1a8,c6d48200,...) at sleepq_switch+0x15b/frame 0xf091b9e4 > sleepq_catch_signals(0,c11b698a,154,c6d48200,c154e760,...) at sleepq_catch_signals+0x5be/frame 0xf091ba38 > sleepq_wait_sig(c6d4a870,0,c11b907b,101,0,...) at sleepq_wait_sig+0x14/frame 0xf091ba64 > _cv_wait_sig(c6d4a870,c158f610,1,1,f091baec,...) at _cv_wait_sig+0x17c/frame 0xf091ba94 > tty_wait(c6d4a800,c6d4a870,f091bbe8,1,0,...) at tty_wait+0x1f/frame 0xf091baac > ttydisc_read(c6d4a800,f091bbe8,0,c0be7ba0,c7017578,...) at ttydisc_read+0x31c/frame 0xf091baec > ttydev_read(c6d19700,f091bbe8,0,f091bb40,c6f69c40,...) at ttydev_read+0x8f/frame 0xf091bb10 > devfs_read_f(c7017578,f091bbe8,c6fa9580,0,c6f69c40,...) at devfs_read_f+0xb4/frame 0xf091bb48 > dofileread(c7017578,f091bbe8,ffffffff,ffffffff,0,...) at dofileread+0x9e/frame 0xf091bb80 > kern_readv(c6f69c40,0,f091bbe8,0,bfbfedf7,...) at kern_readv+0x96/frame 0xf091bbc8 > sys_read(c6f69c40,f091bca8,c6f66bc0,f091bc64,c0b329f2,...) at sys_read+0x5c/frame 0xf091bc18 > syscall(f091bce8) at syscall+0x4a6/frame 0xf091bcdc > Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf091bcdc > --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281b52b7, esp = 0xbfbfeddc, ebp = 0xbfbfee08 --- > > Tracing command getty pid 978 tid 100102 td 0xc71b8000 > sched_switch(c71b8000,0,104,ac,98,...) at sched_switch+0x2d2/frame 0xf0917984 > mi_switch(104,0,c0b134a4,0,f0917a0c,c71b8000) at mi_switch+0x122/frame 0xf09179bc > sleepq_switch(c71b8000,0,c11b698a,1a8,c6d48400,...) at sleepq_switch+0x15b/frame 0xf09179e4 > sleepq_catch_signals(0,c11b698a,154,c6d48400,c154e760,...) at sleepq_catch_signals+0x5be/frame 0xf0917a38 > sleepq_wait_sig(c6d4aa70,0,c11b907b,101,0,...) at sleepq_wait_sig+0x14/frame 0xf0917a64 > _cv_wait_sig(c6d4aa70,c158f610,1,1,f0917aec,...) at _cv_wait_sig+0x17c/frame 0xf0917a94 > tty_wait(c6d4aa00,c6d4aa70,f0917be8,1,0,...) at tty_wait+0x1f/frame 0xf0917aac > ttydisc_read(c6d4aa00,f0917be8,0,c0be7ba0,c7017508,...) at ttydisc_read+0x31c/frame 0xf0917aec > ttydev_read(c6d19800,f0917be8,0,f0917b40,c71b8000,...) at ttydev_read+0x8f/frame 0xf0917b10 > devfs_read_f(c7017508,f0917be8,c74b4380,0,c71b8000,...) at devfs_read_f+0xb4/frame 0xf0917b48 > dofileread(c7017508,f0917be8,ffffffff,ffffffff,0,...) at dofileread+0x9e/frame 0xf0917b80 > kern_readv(c71b8000,0,f0917be8,0,bfbfedf7,...) at kern_readv+0x96/frame 0xf0917bc8 > sys_read(c71b8000,f0917ca8,c729b000,c71b8000,c71bac40,...) at sys_read+0x5c/frame 0xf0917c18 > syscall(f0917ce8) at syscall+0x4a6/frame 0xf0917cdc > Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf0917cdc > --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281b52b7, esp = 0xbfbfeddc, ebp = 0xbfbfee08 --- > > Tracing command getty pid 977 tid 100101 td 0xc71b8310 > sched_switch(c71b8310,0,104,ac,98,...) at sched_switch+0x2d2/frame 0xf0913984 > mi_switch(104,0,c0b134a4,0,f0913a0c,c71b8310) at mi_switch+0x122/frame 0xf09139bc > sleepq_switch(c71b8310,0,c11b698a,1a8,c6d48600,...) at sleepq_switch+0x15b/frame 0xf09139e4 > sleepq_catch_signals(0,c11b698a,154,c6d48600,c154e760,...) at sleepq_catch_signals+0x5be/frame 0xf0913a38 > sleepq_wait_sig(c6d4ac70,0,c11b907b,101,0,...) at sleepq_wait_sig+0x14/frame 0xf0913a64 > _cv_wait_sig(c6d4ac70,c158f610,1,1,f0913aec,...) at _cv_wait_sig+0x17c/frame 0xf0913a94 > tty_wait(c6d4ac00,c6d4ac70,f0913be8,1,0,...) at tty_wait+0x1f/frame 0xf0913aac > ttydisc_read(c6d4ac00,f0913be8,0,0,0,...) at ttydisc_read+0x31c/frame 0xf0913aec > ttydev_read(c6d19900,f0913be8,0,f0913b40,c71b8310,...) at ttydev_read+0x8f/frame 0xf0913b10 > devfs_read_f(c7017690,f0913be8,c74b4400,0,c71b8310,...) at devfs_read_f+0xb4/frame 0xf0913b48 > dofileread(c7017690,f0913be8,ffffffff,ffffffff,0,...) at dofileread+0x9e/frame 0xf0913b80 > kern_readv(c71b8310,0,f0913be8,0,bfbfedf7,...) at kern_readv+0x96/frame 0xf0913bc8 > sys_read(c71b8310,f0913ca8,c729b2f0,f0913c64,c0b329f2,...) at sys_read+0x5c/frame 0xf0913c18 > syscall(f0913ce8) at syscall+0x4a6/frame 0xf0913cdc > Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf0913cdc > --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281b52b7, esp = 0xbfbfeddc, ebp = 0xbfbfee08 --- > > Tracing command getty pid 976 tid 100085 td 0xc72cc620 > sched_switch(c72cc620,0,104,ac,98,...) at sched_switch+0x2d2/frame 0xf0895984 > mi_switch(104,0,c0b134a4,0,f0895a0c,c72cc620) at mi_switch+0x122/frame 0xf08959bc > sleepq_switch(c72cc620,0,c11b698a,1a8,c6d48800,...) at sleepq_switch+0x15b/frame 0xf08959e4 > sleepq_catch_signals(0,c11b698a,154,c6d48800,c154e760,...) at sleepq_catch_signals+0x5be/frame 0xf0895a38 > sleepq_wait_sig(c6d4ae70,0,c11b907b,101,0,...) at sleepq_wait_sig+0x14/frame 0xf0895a64 > _cv_wait_sig(c6d4ae70,c158f610,1,1,f0895aec,...) at _cv_wait_sig+0x17c/frame 0xf0895a94 > tty_wait(c6d4ae00,c6d4ae70,f0895be8,1,0,...) at tty_wait+0x1f/frame 0xf0895aac > ttydisc_read(c6d4ae00,f0895be8,0,c0be7ba0,c702e038,...) at ttydisc_read+0x31c/frame 0xf0895aec > ttydev_read(c6d19a00,f0895be8,0,f0895b40,c72cc620,...) at ttydev_read+0x8f/frame 0xf0895b10 > devfs_read_f(c702e038,f0895be8,c74b4480,0,c72cc620,...) at devfs_read_f+0xb4/frame 0xf0895b48 > dofileread(c702e038,f0895be8,ffffffff,ffffffff,0,...) at dofileread+0x9e/frame 0xf0895b80 > kern_readv(c72cc620,0,f0895be8,0,bfbfedf7,...) at kern_readv+0x96/frame 0xf0895bc8 > sys_read(c72cc620,f0895ca8,c72c2000,f0895c64,c0b329f2,...) at sys_read+0x5c/frame 0xf0895c18 > syscall(f0895ce8) at syscall+0x4a6/frame 0xf0895cdc > Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf0895cdc > --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281b52b7, esp = 0xbfbfeddc, ebp = 0xbfbfee08 --- > > Tracing command getty pid 975 tid 100094 td 0xc71bac40 > sched_switch(c71bac40,0,104,ac,98,...) at sched_switch+0x2d2/frame 0xf08c8984 > mi_switch(104,0,c0b134a4,0,f08c8a0c,c71bac40) at mi_switch+0x122/frame 0xf08c89bc > sleepq_switch(c71bac40,0,c11b698a,1a8,c6d48a00,...) at sleepq_switch+0x15b/frame 0xf08c89e4 > sleepq_catch_signals(0,c11b698a,154,c6d48a00,c154e760,...) at sleepq_catch_signals+0x5be/frame 0xf08c8a38 > sleepq_wait_sig(c6d4c070,0,c11b907b,101,0,...) at sleepq_wait_sig+0x14/frame 0xf08c8a64 > _cv_wait_sig(c6d4c070,c158f610,1,1,f08c8aec,...) at _cv_wait_sig+0x17c/frame 0xf08c8a94 > tty_wait(c6d4c000,c6d4c070,f08c8be8,1,0,...) at tty_wait+0x1f/frame 0xf08c8aac > ttydisc_read(c6d4c000,f08c8be8,0,c0be7ba0,c70175b0,...) at ttydisc_read+0x31c/frame 0xf08c8aec > ttydev_read(c6d19b00,f08c8be8,0,f08c8b40,c71bac40,...) at ttydev_read+0x8f/frame 0xf08c8b10 > devfs_read_f(c70175b0,f08c8be8,c6fa9500,0,c71bac40,...) at devfs_read_f+0xb4/frame 0xf08c8b48 > dofileread(c70175b0,f08c8be8,ffffffff,ffffffff,0,...) at dofileread+0x9e/frame 0xf08c8b80 > kern_readv(c71bac40,0,f08c8be8,0,bfbfedf7,...) at kern_readv+0x96/frame 0xf08c8bc8 > sys_read(c71bac40,f08c8ca8,c72c05e0,1,c6f67930,...) at sys_read+0x5c/frame 0xf08c8c18 > syscall(f08c8ce8) at syscall+0x4a6/frame 0xf08c8cdc > Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf08c8cdc > --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281b52b7, esp = 0xbfbfeddc, ebp = 0xbfbfee08 --- > > Tracing command getty pid 974 tid 100075 td 0xc6f67930 > sched_switch(c6f67930,0,104,ac,98,...) at sched_switch+0x2d2/frame 0xee3bf984 > mi_switch(104,0,c0b134a4,0,ee3bfa0c,c6f67930) at mi_switch+0x122/frame 0xee3bf9bc > sleepq_switch(c6f67930,0,c11b698a,1a8,c6d48c00,...) at sleepq_switch+0x15b/frame 0xee3bf9e4 > sleepq_catch_signals(0,c11b698a,154,c6d48c00,c154e760,...) at sleepq_catch_signals+0x5be/frame 0xee3bfa38 > sleepq_wait_sig(c6d4c270,0,c11b907b,101,0,...) at sleepq_wait_sig+0x14/frame 0xee3bfa64 > _cv_wait_sig(c6d4c270,c158f610,1,1,ee3bfaec,...) at _cv_wait_sig+0x17c/frame 0xee3bfa94 > tty_wait(c6d4c200,c6d4c270,ee3bfbe8,1,0,...) at tty_wait+0x1f/frame 0xee3bfaac > ttydisc_read(c6d4c200,ee3bfbe8,0,c0be7ba0,c7017540,...) at ttydisc_read+0x31c/frame 0xee3bfaec > ttydev_read(c6d19c00,ee3bfbe8,0,ee3bfb40,c6f67930,...) at ttydev_read+0x8f/frame 0xee3bfb10 > devfs_read_f(c7017540,ee3bfbe8,c6fa9480,0,c6f67930,...) at devfs_read_f+0xb4/frame 0xee3bfb48 > dofileread(c7017540,ee3bfbe8,ffffffff,ffffffff,0,...) at dofileread+0x9e/frame 0xee3bfb80 > kern_readv(c6f67930,0,ee3bfbe8,0,bfbfedf7,...) at kern_readv+0x96/frame 0xee3bfbc8 > sys_read(c6f67930,ee3bfca8,c6f642f0,1,c72cc620,...) at sys_read+0x5c/frame 0xee3bfc18 > syscall(ee3bfce8) at syscall+0x4a6/frame 0xee3bfcdc > Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xee3bfcdc > --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281b52b7, esp = 0xbfbfeddc, ebp = 0xbfbfee08 --- > > Tracing command getty pid 973 tid 100076 td 0xc6f67620 > sched_switch(c6f67620,0,104,ac,98,...) at sched_switch+0x2d2/frame 0xee3c2984 > mi_switch(104,0,c0b134a4,0,ee3c2a0c,c6f67620) at mi_switch+0x122/frame 0xee3c29bc > sleepq_switch(c6f67620,0,c11b698a,1a8,c6bafe00,...) at sleepq_switch+0x15b/frame 0xee3c29e4 > sleepq_catch_signals(0,c11b698a,154,c6bafe00,c154e760,...) at sleepq_catch_signals+0x5be/frame 0xee3c2a38 > sleepq_wait_sig(c6baf070,0,c11b907b,101,0,...) at sleepq_wait_sig+0x14/frame 0xee3c2a64 > _cv_wait_sig(c6baf070,c158f610,1,1,ee3c2aec,...) at _cv_wait_sig+0x17c/frame 0xee3c2a94 > tty_wait(c6baf000,c6baf070,ee3c2be8,1,0,...) at tty_wait+0x1f/frame 0xee3c2aac > ttydisc_read(c6baf000,ee3c2be8,0,c0be7ba0,c70174d0,...) at ttydisc_read+0x31c/frame 0xee3c2aec > ttydev_read(c6d19d00,ee3c2be8,0,ee3c2b40,c6f67620,...) at ttydev_read+0x8f/frame 0xee3c2b10 > devfs_read_f(c70174d0,ee3c2be8,c6fa9400,0,c6f67620,...) at devfs_read_f+0xb4/frame 0xee3c2b48 > dofileread(c70174d0,ee3c2be8,ffffffff,ffffffff,0,...) at dofileread+0x9e/frame 0xee3c2b80 > kern_readv(c6f67620,0,ee3c2be8,0,bfbfedf7,...) at kern_readv+0x96/frame 0xee3c2bc8 > sys_read(c6f67620,ee3c2ca8,c6f64000,1,c0b329f2,...) at sys_read+0x5c/frame 0xee3c2c18 > syscall(ee3c2ce8) at syscall+0x4a6/frame 0xee3c2cdc > Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xee3c2cdc > --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281b52b7, esp = 0xbfbfeddc, ebp = 0xbfbfee08 --- > > Tracing command login pid 972 tid 100069 td 0xc6f68c40 > sched_switch(c6f68c40,0,104,c0dea0cc,0,...) at sched_switch+0x2d2/frame 0xee3aa960 > mi_switch(104,0,c315c7c4,3,2,c6f68c40) at mi_switch+0x122/frame 0xee3aa998 > sleepq_switch(c6f68c40,0,c11b698a,1a8,0,...) at sleepq_switch+0x15b/frame 0xee3aa9c0 > sleepq_catch_signals(0,c11b698a,154,c6f68c40,ee3aaa44,...) at sleepq_catch_signals+0x5be/frame 0xee3aaa14 > sleepq_wait_sig(c6f655e0,6c,c11b77f6,100,0,...) at sleepq_wait_sig+0x14/frame 0xee3aaa40 > _sleep(c6f655e0,c6f65678,16c,c11b77f6,0,...) at _sleep+0x29b/frame 0xee3aaa88 > kern_wait6(c6f68c40,0,3d4,0,ee3aab24,...) at kern_wait6+0x725/frame 0xee3aaaf8 > sys_wait4(c6f68c40,ee3aaca8,c6f655e0,4,c088707e,...) at sys_wait4+0x94/frame 0xee3aac18 > syscall(ee3aace8) at syscall+0x4a6/frame 0xee3aacdc > Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xee3aacdc > --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2811c143, esp = 0xbfbfed20, ebp = 0xbfbfed38 --- > > Tracing command sleep pid 967 tid 100077 td 0xc6f67310 > sched_switch(c6f67310,0,104,ac,98,...) at sched_switch+0x2d2/frame 0xee3caa4c > mi_switch(104,0,c0b40637,1,c7293444,c6f67310) at mi_switch+0x122/frame 0xee3caa84 > sleepq_switch(c6f67310,0,c11b698a,1a8,4a,...) at sleepq_switch+0x15b/frame 0xee3caaac > sleepq_catch_signals(c0000000,3,c0b72670,c6f67310,1,...) at sleepq_catch_signals+0x5be/frame 0xee3cab00 > sleepq_timedwait_sig(c1515641,6c,4a,c0000000,3,...) at sleepq_timedwait_sig+0x14/frame 0xee3cab30 > _sleep(c1515641,0,16c,c11b32c4,a1dea2f,...) at _sleep+0x26b/frame 0xee3cab78 > kern_nanosleep(bfbfee40,ee3cabf0,ee3cabf8,ee3cace8,3c,...) at kern_nanosleep+0x14b/frame 0xee3cabd8 > sys_nanosleep(c6f67310,ee3caca8,c6ac0bc0,c6f67310,c71b9930,...) at sys_nanosleep+0x69/frame 0xee3cac18 > syscall(ee3cace8) at syscall+0x4a6/frame 0xee3cacdc > Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xee3cacdc > --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x2817b203, esp = 0xbfbfee0c, ebp = 0xbfbfee54 --- > > Tracing command logger pid 966 tid 100074 td 0xc6f67c40 > sched_switch(c6f67c40,0,104,ac,98,...) at sched_switch+0x2d2/frame 0xee3bb9dc > mi_switch(104,0,c0b134a4,0,0,c6f67c40) at mi_switch+0x122/frame 0xee3bba14 > sleepq_switch(c6f67c40,0,c11b698a,1a8,ee3bbaa0,...) at sleepq_switch+0x15b/frame 0xee3bba3c > sleepq_catch_signals(0,c11b698a,154,0,0,...) at sleepq_catch_signals+0x5be/frame 0xee3bba90 > sleepq_wait_sig(c70377f8,5c,c11b7397,100,0,...) at sleepq_wait_sig+0x14/frame 0xee3bbabc > _sleep(c70377f8,c7037978,15c,c11b7397,0,...) at _sleep+0x29b/frame 0xee3bbb04 > pipe_read(c70175e8,ee3bbbe8,c6ff5c80,0,c6f67c40,...) at pipe_read+0x33a/frame 0xee3bbb48 > dofileread(c70175e8,ee3bbbe8,ffffffff,ffffffff,0,...) at dofileread+0x9e/frame 0xee3bbb80 > kern_readv(c6f67c40,0,ee3bbbe8,0,28808000,...) at kern_readv+0x96/frame 0xee3bbbc8 > sys_read(c6f67c40,ee3bbca8,c6f645e0,1,c6f67310,...) at sys_read+0x5c/frame 0xee3bbc18 > syscall(ee3bbce8) at syscall+0x4a6/frame 0xee3bbcdc > Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xee3bbcdc > --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a02b7, esp = 0xbfbfe958, ebp = 0xbfbfe96c --- > > Tracing command sh pid 965 tid 100081 td 0xc71b9930 > sched_switch(c71b9930,0,104,ee3e19d0,0,...) at sched_switch+0x2d2/frame 0xee3e1960 > mi_switch(104,0,c7294818,0,0,c71b9930) at mi_switch+0x122/frame 0xee3e1998 > sleepq_switch(c71b9930,0,c11b698a,1a8,c71b9930,...) at sleepq_switch+0x15b/frame 0xee3e19c0 > sleepq_catch_signals(0,c11b698a,154,c71b9930,ee3e1a44,...) at sleepq_catch_signals+0x5be/frame 0xee3e1a14 > sleepq_wait_sig(c729c8d0,6c,c11b77f6,100,0,...) at sleepq_wait_sig+0x14/frame 0xee3e1a40 > _sleep(c729c8d0,c729c968,16c,c11b77f6,0,...) at _sleep+0x29b/frame 0xee3e1a88 > kern_wait6(c71b9930,7,0,0,ee3e1b24,...) at kern_wait6+0x725/frame 0xee3e1af8 > sys_wait4(c71b9930,ee3e1ca8,fffffed8,0,0,...) at sys_wait4+0x94/frame 0xee3e1c18 > syscall(ee3e1ce8) at syscall+0x4a6/frame 0xee3e1cdc > Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xee3e1cdc > --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2815d143, esp = 0xbfbfdd48, ebp = 0xbfbfdd60 --- > > Tracing command cron pid 928 tid 100100 td 0xc71b8620 > sched_switch(c71b8620,0,104,c0b4103a,f0908a70,...) at sched_switch+0x2d2/frame 0xf0908a4c > mi_switch(104,0,c0b40637,0,0,c71b8620) at mi_switch+0x122/frame 0xf0908a84 > sleepq_switch(c71b8620,0,c11b698a,1a8,6b,...) at sleepq_switch+0x15b/frame 0xf0908aac > sleepq_catch_signals(bfd19a33,3,c0b72670,c71b8620,0,...) at sleepq_catch_signals+0x5be/frame 0xf0908b00 > sleepq_timedwait_sig(c1515640,6c,6b,bfd19a33,3,...) at sleepq_timedwait_sig+0x14/frame 0xf0908b30 > _sleep(c1515640,0,16c,c11b32c4,3380bb39,...) at _sleep+0x26b/frame 0xf0908b78 > kern_nanosleep(bfbfee28,f0908bf0,f0908bf8,f0908ce8,3b,...) at kern_nanosleep+0x14b/frame 0xf0908bd8 > sys_nanosleep(c71b8620,f0908ca8,c729b5e0,1,0,...) at sys_nanosleep+0x69/frame 0xf0908c18 > syscall(f0908ce8) at syscall+0x4a6/frame 0xf0908cdc > Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf0908cdc > --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x2819f203, esp = 0xbfbfecb4, ebp = 0xbfbfee44 --- > > Tracing command sendmail pid 924 tid 100098 td 0xc71b8c40 > sched_switch(c71b8c40,0,104,ac,98,...) at sched_switch+0x2d2/frame 0xf08e5a7c > mi_switch(104,0,c0b134a4,0,0,c71b8c40) at mi_switch+0x122/frame 0xf08e5ab4 > sleepq_switch(c71b8c40,0,c11b698a,1a8,0,...) at sleepq_switch+0x15b/frame 0xf08e5adc > sleepq_catch_signals(0,c11b698a,154,c71b8c40,f08e5ba4,...) at sleepq_catch_signals+0x5be/frame 0xf08e5b30 > sleepq_wait_sig(c729bc24,74,c10a57b4,100,0,...) at sleepq_wait_sig+0x14/frame 0xf08e5b5c > _sleep(c729bc24,c729bc58,174,c10a57b4,0,...) at _sleep+0x29b/frame 0xf08e5ba4 > kern_sigsuspend(c71b8c40,0,0,0,0,...) at kern_sigsuspend+0x137/frame 0xf08e5be8 > sys_sigsuspend(c71b8c40,f08e5ca8,c729bbc0,c71b8c40,c72cc930,...) at sys_sigsuspend+0x58/frame 0xf08e5c18 > syscall(f08e5ce8) at syscall+0x4a6/frame 0xf08e5cdc > Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf08e5cdc > --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x2836bfbb, esp = 0xbfbfd9cc, ebp = 0xbfbfd9f8 --- > > Tracing command sendmail pid 921 tid 100099 td 0xc71b8930 > sched_switch(c71b8930,0,104,ac,0,...) at sched_switch+0x2d2/frame 0xf08e88d8 > mi_switch(104,0,f08e898c,c0b134a4,2845a000,c71b8930) at mi_switch+0x122/frame 0xf08e8910 > sleepq_switch(c71b8930,0,c11b698a,1a8,f11734f8,...) at sleepq_switch+0x15b/frame 0xf08e8938 > sleepq_catch_signals(50000000,0,c0b72670,c71b8930,1,...) at sleepq_catch_signals+0x5be/frame 0xf08e898c > sleepq_timedwait_sig(c6fa0b24,0,30,50000000,0,...) at sleepq_timedwait_sig+0x14/frame 0xf08e89bc > _cv_timedwait_sig_sbt(c6fa0b24,c6fa0b10,f11734f8,30,50000000,...) at _cv_timedwait_sig_sbt+0x1a7/frame 0xf08e89f0 > seltdwait(30,50000000,0,c71b8930,f08e8ba0,...) at seltdwait+0xc1/frame 0xf08e8a28 > kern_select(c71b8930,4,bfbfcfb8,0,0,...) at kern_select+0x8c2/frame 0xf08e8bd0 > sys_select(c71b8930,f08e8ca8,c729b8d0,4,c088707e,...) at sys_select+0x69/frame 0xf08e8c18 > syscall(f08e8ce8) at syscall+0x4a6/frame 0xf08e8cdc > Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf08e8cdc > --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28444277, esp = 0xbfbfcf1c, ebp = 0xbfbfd9d8 --- > > Tracing command sshd pid 918 tid 100072 td 0xc6f68310 > sched_switch(c6f68310,0,104,ac,98,...) at sched_switch+0x2d2/frame 0xee3b48e0 > mi_switch(104,0,0,0,40a,c6f68310) at mi_switch+0x122/frame 0xee3b4918 > sleepq_switch(c6f68310,0,c11b698a,1a8,0,...) at sleepq_switch+0x15b/frame 0xee3b4940 > sleepq_catch_signals(0,c11b698a,154,ee3b4ba8,ee3b49d4,...) at sleepq_catch_signals+0x5be/frame 0xee3b4994 > sleepq_wait_sig(c6fd23e4,0,c11ecb42,101,0,...) at sleepq_wait_sig+0x14/frame 0xee3b49c0 > _cv_wait_sig(c6fd23e4,c6fd23d0,c702dcb0,c6f68310,ee3b4a28,...) at _cv_wait_sig+0x17c/frame 0xee3b49f0 > seltdwait(ffffffff,0,0,c6f68310,ee3b4ba0,...) at seltdwait+0xcf/frame 0xee3b4a28 > kern_select(c6f68310,5,28c0c158,0,0,...) at kern_select+0x8c2/frame 0xee3b4bd0 > sys_select(c6f68310,ee3b4ca8,c6f64bc0,c6f68310,c72cc930,...) at sys_select+0x69/frame 0xee3b4c18 > syscall(ee3b4ce8) at syscall+0x4a6/frame 0xee3b4cdc > Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xee3b4cdc > --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28636277, esp = 0xbfbfe43c, ebp = 0xbfbfe460 --- > > Tracing command syslogd pid 725 tid 100084 td 0xc72cc930 > sched_switch(c72cc930,0,104,c152191c,0,...) at sched_switch+0x2d2/frame 0xee3fb8e0 > mi_switch(104,0,ee3fb950,c0af7134,c6d23930,c72cc930) at mi_switch+0x122/frame 0xee3fb918 > sleepq_switch(c72cc930,0,c11b698a,1a8,c6aa5e3c,...) at sleepq_switch+0x15b/frame 0xee3fb940 > sleepq_catch_signals(0,c11b698a,154,ee3fba28,c1036475,...) at sleepq_catch_signals+0x5be/frame 0xee3fb994 > sleepq_wait_sig(c6d57da4,0,c11ecb42,101,0,...) at sleepq_wait_sig+0x14/frame 0xee3fb9c0 > _cv_wait_sig(c6d57da4,c6d57d90,c0a05c9b,c69a4000,0,...) at _cv_wait_sig+0x17c/frame 0xee3fb9f0 > seltdwait(ffffffff,0,0,c72cc930,ee3fbba0,...) at seltdwait+0xcf/frame 0xee3fba28 > kern_select(c72cc930,9,28834118,0,0,...) at kern_select+0x8c2/frame 0xee3fbbd0 > sys_select(c72cc930,ee3fbca8,804c210,c74c5000,0,...) at sys_select+0x69/frame 0xee3fbc18 > syscall(ee3fbce8) at syscall+0x4a6/frame 0xee3fbcdc > Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xee3fbcdc > --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281b8277, esp = 0xbfbfdea4, ebp = 0xbfbfee34 --- > > Tracing command devd pid 649 tid 100071 td 0xc6f68620 > sched_switch(c6f68620,0,104,ac,98,...) at sched_switch+0x2d2/frame 0xee3b18d8 > mi_switch(104,0,0,c0b134a4,0,c6f68620) at mi_switch+0x122/frame 0xee3b1910 > sleepq_switch(c6f68620,0,c11b698a,1a8,4127f8c6,...) at sleepq_switch+0x15b/frame 0xee3b1938 > sleepq_catch_signals(c0000000,3,c0b72670,c6f68620,0,...) at sleepq_catch_signals+0x5be/frame 0xee3b198c > sleepq_timedwait_sig(c6fa1524,0,48,c0000000,3,...) at sleepq_timedwait_sig+0x14/frame 0xee3b19bc > _cv_timedwait_sig_sbt(c6fa1524,c6fa1510,4127f8c6,48,c0000000,...) at _cv_timedwait_sig_sbt+0x1a7/frame 0xee3b19f0 > seltdwait(48,c0000000,3,c6f68620,ee3b1ba0,...) at seltdwait+0xc1/frame 0xee3b1a28 > kern_select(c6f68620,6,bfbfcda0,0,0,...) at kern_select+0x8c2/frame 0xee3b1bd0 > sys_select(c6f68620,ee3b1ca8,c6f65000,4,c088707e,...) at sys_select+0x69/frame 0xee3b1c18 > syscall(ee3b1ce8) at syscall+0x4a6/frame 0xee3b1cdc > Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xee3b1cdc > --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x8097703, esp = 0xbfbfcd3c, ebp = 0xbfbfee54 --- > > Tracing command vnlru pid 16 tid 100068 td 0xc6f69000 > sched_switch(c6f69000,0,104,0,36254e5d,...) at sched_switch+0x2d2/frame 0xee3a6b5c > mi_switch(104,0,101,c6f69000,ee3a6be8,c6f658d0) at mi_switch+0x122/frame 0xee3a6b94 > sleepq_switch(c6f69000,0,c11b698a,28b,101,...) at sleepq_switch+0x15b/frame 0xee3a6bbc > sleepq_timedwait(c6f658d0,60,0,0,0,...) at sleepq_timedwait+0x3f/frame 0xee3a6be8 > _sleep(c6f658d0,c1534980,260,c11bd97c,fffffed8,...) at _sleep+0x282/frame 0xee3a6c30 > vnlru_proc(0,ee3a6ce8,0,0,0,...) at vnlru_proc+0xcf/frame 0xee3a6ca4 > fork_exit(c0bdb7e0,0,ee3a6ce8) at fork_exit+0xa3/frame 0xee3a6cd4 > fork_trampoline() at fork_trampoline+0x8/frame 0xee3a6cd4 > --- trap 0, eip = 0, esp = 0xee3a6d20, ebp = 0 --- > > Tracing command syncer pid 9 tid 100067 td 0xc6f69310 > sched_switch(c6f69310,0,104,36254e5d,0,...) at sched_switch+0x2d2/frame 0xee3a3b68 > mi_switch(104,0,101,c6f69310,ee3a3bf4,c15349c4) at mi_switch+0x122/frame 0xee3a3ba0 > sleepq_switch(c6f69310,0,c11b698a,28b,101,...) at sleepq_switch+0x15b/frame 0xee3a3bc8 > sleepq_timedwait(c15349c4,0,0,0,0,...) at sleepq_timedwait+0x3f/frame 0xee3a3bf4 > _cv_timedwait_sbt(c15349c4,c15349a4,fffffed8,0,0,...) at _cv_timedwait_sbt+0x1a7/frame 0xee3a3c28 > sched_sync(0,ee3a3ce8,0,0,0,...) at sched_sync+0x7a1/frame 0xee3a3ca4 > fork_exit(c0bdaea0,0,ee3a3ce8) at fork_exit+0xa3/frame 0xee3a3cd4 > fork_trampoline() at fork_trampoline+0x8/frame 0xee3a3cd4 > --- trap 0, eip = 0, esp = 0xee3a3d20, ebp = 0 --- > > Tracing command bufdaemon pid 8 tid 100080 td 0xc71b9c40 > sched_switch(c71b9c40,0,104,0,e9db9457,...) at sched_switch+0x2d2/frame 0xee3d3b8c > mi_switch(104,0,101,c71b9c40,ee3d3c18,c6fb6a84) at mi_switch+0x122/frame 0xee3d3bc4 > sleepq_switch(c71b9c40,0,c11b698a,28b,101,...) at sleepq_switch+0x15b/frame 0xee3d3bec > sleepq_timedwait(c6fb6a84,54,0,0,0,...) at sleepq_timedwait+0x3f/frame 0xee3d3c18 > _sleep(c6fb6a84,c6fb6a00,54,c11de1de,7fffff6c,...) at _sleep+0x282/frame 0xee3d3c60 > softdep_flush(c70f7000,ee3d3ce8,c0da9070,0,ee3d3cd0,...) at softdep_flush+0x16a/frame 0xee3d3ca4 > fork_exit(c0da9070,c70f7000,ee3d3ce8) at fork_exit+0xa3/frame 0xee3d3cd4 > fork_trampoline() at fork_trampoline+0x8/frame 0xee3d3cd4 > --- trap 0, eip = 0, esp = 0xee3d3d20, ebp = 0 --- > > Tracing command bufdaemon pid 8 tid 100079 td 0xc71ba000 > sched_switch(c71ba000,0,104,0,d041fadb,...) at sched_switch+0x2d2/frame 0xee3d0b8c > mi_switch(104,0,101,c71ba000,ee3d0c18,c6fb6884) at mi_switch+0x122/frame 0xee3d0bc4 > sleepq_switch(c71ba000,0,c11b698a,28b,101,...) at sleepq_switch+0x15b/frame 0xee3d0bec > sleepq_timedwait(c6fb6884,54,0,0,0,...) at sleepq_timedwait+0x3f/frame 0xee3d0c18 > _sleep(c6fb6884,c6fb6800,54,c11de1de,7fffff6c,...) at _sleep+0x282/frame 0xee3d0c60 > softdep_flush(c70f72a0,ee3d0ce8,c0da9070,0,ee3d0cd0,...) at softdep_flush+0x16a/frame 0xee3d0ca4 > fork_exit(c0da9070,c70f72a0,ee3d0ce8) at fork_exit+0xa3/frame 0xee3d0cd4 > fork_trampoline() at fork_trampoline+0x8/frame 0xee3d0cd4 > --- trap 0, eip = 0, esp = 0xee3d0d20, ebp = 0 --- > > Tracing command bufdaemon pid 8 tid 100066 td 0xc6f69620 > sched_switch(c6f69620,0,104,36254e5d,0,...) at sched_switch+0x2d2/frame 0xee3a0b98 > mi_switch(104,0,101,c6f69620,ee3a0c24,c1534104) at mi_switch+0x122/frame 0xee3a0bd0 > sleepq_switch(c6f69620,0,c11b698a,28b,101,...) at sleepq_switch+0x15b/frame 0xee3a0bf8 > sleepq_timedwait(c1534104,54,0,0,0,...) at sleepq_timedwait+0x3f/frame 0xee3a0c24 > _sleep(c1534104,c1534080,54,c11bb3e7,fffffed8,...) at _sleep+0x282/frame 0xee3a0c6c > buf_daemon(0,ee3a0ce8,0,0,0,...) at buf_daemon+0xac/frame 0xee3a0ca4 > fork_exit(c0bbeac0,0,ee3a0ce8) at fork_exit+0xa3/frame 0xee3a0cd4 > fork_trampoline() at fork_trampoline+0x8/frame 0xee3a0cd4 > --- trap 0, eip = 0, esp = 0xee3a0d20, ebp = 0 --- > > Tracing command pagezero pid 7 tid 100065 td 0xc6cee620 > sched_switch(c6cee620,0,104,79b9a83d,0,...) at sched_switch+0x2d2/frame 0xee39dba0 > mi_switch(104,0,101,c6cee620,ee39dc2c,c1539320) at mi_switch+0x122/frame 0xee39dbd8 > sleepq_switch(c6cee620,0,c11b698a,28b,101,...) at sleepq_switch+0x15b/frame 0xee39dc00 > sleepq_timedwait(c1539320,0,12b,0,0,...) at sleepq_timedwait+0x3f/frame 0xee39dc2c > _sleep(c1539320,c1594580,0,c11e2463,fffea520,...) at _sleep+0x282/frame 0xee39dc74 > vm_pagezero(0,ee39dce8,0,0,0,...) at vm_pagezero+0xd2/frame 0xee39dca4 > fork_exit(c0e09ef0,0,ee39dce8) at fork_exit+0xa3/frame 0xee39dcd4 > fork_trampoline() at fork_trampoline+0x8/frame 0xee39dcd4 > --- trap 0, eip = 0, esp = 0xee39dd20, ebp = 0 --- > > Tracing command vmdaemon pid 6 tid 100064 td 0xc6cee930 > sched_switch(c6cee930,0,104,0,c6cee930,...) at sched_switch+0x2d2/frame 0xee39ab64 > mi_switch(104,0,0,0,c6cee930,c1539044) at mi_switch+0x122/frame 0xee39ab9c > sleepq_switch(c6cee930,0,c11b698a,268,0,...) at sleepq_switch+0x15b/frame 0xee39abc4 > sleepq_wait(c1539044,74,c11bb3e7,0,0,...) at sleepq_wait+0x3f/frame 0xee39abf0 > _sleep(c1539044,c153902c,74,c11bb3e7,0,...) at _sleep+0x2ae/frame 0xee39ac38 > vm_daemon(0,ee39ace8,0,0,0,...) at vm_daemon+0x116/frame 0xee39aca4 > fork_exit(c0e029a0,0,ee39ace8) at fork_exit+0xa3/frame 0xee39acd4 > fork_trampoline() at fork_trampoline+0x8/frame 0xee39acd4 > --- trap 0, eip = 0, esp = 0xee39ad20, ebp = 0 --- > > Tracing command pagedaemon pid 5 tid 100063 td 0xc6ceec40 > sched_switch(c6ceec40,0,104,0,36254e5d,...) at sched_switch+0x2d2/frame 0xee397b64 > mi_switch(104,0,101,c6ceec40,ee397bf0,c1594604) at mi_switch+0x122/frame 0xee397b9c > sleepq_switch(c6ceec40,0,c11b698a,28b,101,...) at sleepq_switch+0x15b/frame 0xee397bc4 > sleepq_timedwait(c1594604,54,0,0,0,...) at sleepq_timedwait+0x3f/frame 0xee397bf0 > _sleep(c1594604,c1594580,54,c11bb3e7,fffffed8,...) at _sleep+0x282/frame 0xee397c38 > vm_pageout(0,ee397ce8,0,0,0,...) at vm_pageout+0x1fb/frame 0xee397ca4 > fork_exit(c0e03410,0,ee397ce8) at fork_exit+0xa3/frame 0xee397cd4 > fork_trampoline() at fork_trampoline+0x8/frame 0xee397cd4 > --- trap 0, eip = 0, esp = 0xee397d20, ebp = 0 --- > > Tracing command sctp_iterator pid 4 tid 100060 td 0xc6d22620 > sched_switch(c6d22620,0,104,0,c6d22620,...) at sched_switch+0x2d2/frame 0xee38eba4 > mi_switch(104,0,d6fa6fc8,c0b0eedf,c6d22620,c1592874) at mi_switch+0x122/frame 0xee38ebdc > sleepq_switch(c6d22620,0,c11b698a,268,c6fa6fc8,...) at sleepq_switch+0x15b/frame 0xee38ec04 > sleepq_wait(c1592874,0,c11ce22b,0,0,...) at sleepq_wait+0x3f/frame 0xee38ec30 > _sleep(c1592874,c159283c,0,c11ce22b,0,...) at _sleep+0x2ae/frame 0xee38ec78 > sctp_iterator_thread(0,ee38ece8,0,0,0,...) at sctp_iterator_thread+0x9c/frame 0xee38eca4 > fork_exit(c0c83920,0,ee38ece8) at fork_exit+0xa3/frame 0xee38ecd4 > fork_trampoline() at fork_trampoline+0x8/frame 0xee38ecd4 > --- trap 0, eip = 0, esp = 0xee38ed20, ebp = 0 --- > > Tracing command fdc0 pid 3 tid 100056 td 0xc6d23310 > sched_switch(c6d23310,0,104,0,36254e5d,...) at sched_switch+0x2d2/frame 0xee381b34 > mi_switch(104,0,101,c6d23310,ee381bc0,c6baf83c) at mi_switch+0x122/frame 0xee381b6c > sleepq_switch(c6d23310,0,c11b698a,28b,101,...) at sleepq_switch+0x15b/frame 0xee381b94 > sleepq_timedwait(c6baf83c,5c,0,0,0,...) at sleepq_timedwait+0x3f/frame 0xee381bc0 > _sleep(c6baf83c,c6baf8f0,5c,c11a23c4,fffffed8,...) at _sleep+0x282/frame 0xee381c08 > fdc_thread(c6baf800,ee381ce8,0,0,0,...) at fdc_thread+0x877/frame 0xee381ca4 > fork_exit(c0fc2e20,c6baf800,ee381ce8) at fork_exit+0xa3/frame 0xee381cd4 > fork_trampoline() at fork_trampoline+0x8/frame 0xee381cd4 > --- trap 0, eip = 0, esp = 0xee381d20, ebp = 0 --- > > Tracing command usb pid 15 tid 100053 td 0xc6d23c40 > sched_switch(c6d23c40,0,104,0,0,...) at sched_switch+0x2d2/frame 0xee304bb8 > mi_switch(104,0,0,80246,c6d23c40,c6d09d34) at mi_switch+0x122/frame 0xee304bf0 > sleepq_switch(c6d23c40,0,c11b698a,268,0,...) at sleepq_switch+0x15b/frame 0xee304c18 > sleepq_wait(c6d09d34,0,c11a23c4,1,0,...) at sleepq_wait+0x3f/frame 0xee304c44 > _cv_wait(c6d09d34,c6d09e74,c118e08e,73,0,...) at _cv_wait+0x182/frame 0xee304c74 > usb_process(c6d09d2c,ee304ce8,0,0,0,...) at usb_process+0xf6/frame 0xee304ca4 > fork_exit(c09a4cc0,c6d09d2c,ee304ce8) at fork_exit+0xa3/frame 0xee304cd4 > fork_trampoline() at fork_trampoline+0x8/frame 0xee304cd4 > --- trap 0, eip = 0, esp = 0xee304d20, ebp = 0 --- > > Tracing command usb pid 15 tid 100052 td 0xc6c85c40 > sched_switch(c6c85c40,0,104,0,0,...) at sched_switch+0x2d2/frame 0xee301bb8 > mi_switch(104,0,c6c99fc8,c0b3286d,c6c85c40,c6d09d04) at mi_switch+0x122/frame 0xee301bf0 > sleepq_switch(c6c85c40,0,c11b698a,268,c6d57640,...) at sleepq_switch+0x15b/frame 0xee301c18 > sleepq_wait(c6d09d04,0,c11a23c4,1,0,...) at sleepq_wait+0x3f/frame 0xee301c44 > _cv_wait(c6d09d04,c6d09e74,c118e08e,73,0,...) at _cv_wait+0x182/frame 0xee301c74 > usb_process(c6d09cfc,ee301ce8,0,0,0,...) at usb_process+0xf6/frame 0xee301ca4 > fork_exit(c09a4cc0,c6d09cfc,ee301ce8) at fork_exit+0xa3/frame 0xee301cd4 > fork_trampoline() at fork_trampoline+0x8/frame 0xee301cd4 > --- trap 0, eip = 0, esp = 0xee301d20, ebp = 0 --- > > Tracing command usb pid 15 tid 100051 td 0xc6cec000 > sched_switch(c6cec000,0,104,0,0,...) at sched_switch+0x2d2/frame 0xee2febb8 > mi_switch(104,0,0,80246,c6cec000,c6d09cd4) at mi_switch+0x122/frame 0xee2febf0 > sleepq_switch(c6cec000,0,c11b698a,268,0,...) at sleepq_switch+0x15b/frame 0xee2fec18 > sleepq_wait(c6d09cd4,0,c11a23c4,1,0,...) at sleepq_wait+0x3f/frame 0xee2fec44 > _cv_wait(c6d09cd4,c6d09e74,c118e08e,73,0,...) at _cv_wait+0x182/frame 0xee2fec74 > usb_process(c6d09ccc,ee2fece8,0,0,0,...) at usb_process+0xf6/frame 0xee2feca4 > fork_exit(c09a4cc0,c6d09ccc,ee2fece8) at fork_exit+0xa3/frame 0xee2fecd4 > fork_trampoline() at fork_trampoline+0x8/frame 0xee2fecd4 > --- trap 0, eip = 0, esp = 0xee2fed20, ebp = 0 --- > > Tracing command usb pid 15 tid 100050 td 0xc6cec310 > sched_switch(c6cec310,0,104,0,0,...) at sched_switch+0x2d2/frame 0xee2fbbb8 > mi_switch(104,0,0,80246,c6cec310,c6d09ca4) at mi_switch+0x122/frame 0xee2fbbf0 > sleepq_switch(c6cec310,0,c11b698a,268,0,...) at sleepq_switch+0x15b/frame 0xee2fbc18 > sleepq_wait(c6d09ca4,0,c11a23c4,1,0,...) at sleepq_wait+0x3f/frame 0xee2fbc44 > _cv_wait(c6d09ca4,c6d09e74,c118e08e,73,0,...) at _cv_wait+0x182/frame 0xee2fbc74 > usb_process(c6d09c9c,ee2fbce8,0,0,0,...) at usb_process+0xf6/frame 0xee2fbca4 > fork_exit(c09a4cc0,c6d09c9c,ee2fbce8) at fork_exit+0xa3/frame 0xee2fbcd4 > fork_trampoline() at fork_trampoline+0x8/frame 0xee2fbcd4 > --- trap 0, eip = 0, esp = 0xee2fbd20, ebp = 0 --- > > Tracing command usb pid 15 tid 100049 td 0xc6cec620 > sched_switch(c6cec620,0,104,c09a52a9,0,...) at sched_switch+0x2d2/frame 0xee2f5bb8 > mi_switch(104,0,0,80246,c6cec620,c6cf2dac) at mi_switch+0x122/frame 0xee2f5bf0 > sleepq_switch(c6cec620,0,c11b698a,268,4,...) at sleepq_switch+0x15b/frame 0xee2f5c18 > sleepq_wait(c6cf2dac,0,c11a23c4,1,0,...) at sleepq_wait+0x3f/frame 0xee2f5c44 > _cv_wait(c6cf2dac,c6cf2eec,c118e08e,73,0,...) at _cv_wait+0x182/frame 0xee2f5c74 > usb_process(c6cf2da4,ee2f5ce8,0,0,0,...) at usb_process+0xf6/frame 0xee2f5ca4 > fork_exit(c09a4cc0,c6cf2da4,ee2f5ce8) at fork_exit+0xa3/frame 0xee2f5cd4 > fork_trampoline() at fork_trampoline+0x8/frame 0xee2f5cd4 > --- trap 0, eip = 0, esp = 0xee2f5d20, ebp = 0 --- > > Tracing command usb pid 15 tid 100048 td 0xc6cec930 > sched_switch(c6cec930,0,104,0,0,...) at sched_switch+0x2d2/frame 0xee2f2bb8 > mi_switch(104,0,c0995672,c158f620,c6cec930,c6cf2d7c) at mi_switch+0x122/frame 0xee2f2bf0 > sleepq_switch(c6cec930,0,c11b698a,268,c6d57380,...) at sleepq_switch+0x15b/frame 0xee2f2c18 > sleepq_wait(c6cf2d7c,0,c11a23c4,1,0,...) at sleepq_wait+0x3f/frame 0xee2f2c44 > _cv_wait(c6cf2d7c,c6cf2eec,c118e08e,73,0,...) at _cv_wait+0x182/frame 0xee2f2c74 > usb_process(c6cf2d74,ee2f2ce8,0,0,0,...) at usb_process+0xf6/frame 0xee2f2ca4 > fork_exit(c09a4cc0,c6cf2d74,ee2f2ce8) at fork_exit+0xa3/frame 0xee2f2cd4 > fork_trampoline() at fork_trampoline+0x8/frame 0xee2f2cd4 > --- trap 0, eip = 0, esp = 0xee2f2d20, ebp = 0 --- > > Tracing command usb pid 15 tid 100047 td 0xc6cecc40 > sched_switch(c6cecc40,0,104,0,0,...) at sched_switch+0x2d2/frame 0xee2efbb8 > mi_switch(104,0,0,80246,c6cecc40,c6cf2d4c) at mi_switch+0x122/frame 0xee2efbf0 > sleepq_switch(c6cecc40,0,c11b698a,268,0,...) at sleepq_switch+0x15b/frame 0xee2efc18 > sleepq_wait(c6cf2d4c,0,c11a23c4,1,0,...) at sleepq_wait+0x3f/frame 0xee2efc44 > _cv_wait(c6cf2d4c,c6cf2eec,c118e08e,73,0,...) at _cv_wait+0x182/frame 0xee2efc74 > usb_process(c6cf2d44,ee2efce8,0,0,0,...) at usb_process+0xf6/frame 0xee2efca4 > fork_exit(c09a4cc0,c6cf2d44,ee2efce8) at fork_exit+0xa3/frame 0xee2efcd4 > fork_trampoline() at fork_trampoline+0x8/frame 0xee2efcd4 > --- trap 0, eip = 0, esp = 0xee2efd20, ebp = 0 --- > > Tracing command usb pid 15 tid 100046 td 0xc6ced000 > sched_switch(c6ced000,0,104,8,0,...) at sched_switch+0x2d2/frame 0xee2ecbb8 > mi_switch(104,0,3660,0,c6ced000,c6cf2d1c) at mi_switch+0x122/frame 0xee2ecbf0 > sleepq_switch(c6ced000,0,c11b698a,268,4,...) at sleepq_switch+0x15b/frame 0xee2ecc18 > sleepq_wait(c6cf2d1c,0,c11a23c4,1,0,...) at sleepq_wait+0x3f/frame 0xee2ecc44 > _cv_wait(c6cf2d1c,c6cf2eec,c118e08e,73,0,...) at _cv_wait+0x182/frame 0xee2ecc74 > usb_process(c6cf2d14,ee2ecce8,0,0,0,...) at usb_process+0xf6/frame 0xee2ecca4 > fork_exit(c09a4cc0,c6cf2d14,ee2ecce8) at fork_exit+0xa3/frame 0xee2eccd4 > fork_trampoline() at fork_trampoline+0x8/frame 0xee2eccd4 > --- trap 0, eip = 0, esp = 0xee2ecd20, ebp = 0 --- > > Tracing command usb pid 15 tid 100044 td 0xc6ced620 > sched_switch(c6ced620,0,104,0,0,...) at sched_switch+0x2d2/frame 0xee2e5bb8 > mi_switch(104,0,0,80246,c6ced620,c6cdbdac) at mi_switch+0x122/frame 0xee2e5bf0 > sleepq_switch(c6ced620,0,c11b698a,268,0,...) at sleepq_switch+0x15b/frame 0xee2e5c18 > sleepq_wait(c6cdbdac,0,c11a23c4,1,0,...) at sleepq_wait+0x3f/frame 0xee2e5c44 > _cv_wait(c6cdbdac,c6cdbeec,c118e08e,73,0,...) at _cv_wait+0x182/frame 0xee2e5c74 > usb_process(c6cdbda4,ee2e5ce8,0,0,0,...) at usb_process+0xf6/frame 0xee2e5ca4 > fork_exit(c09a4cc0,c6cdbda4,ee2e5ce8) at fork_exit+0xa3/frame 0xee2e5cd4 > fork_trampoline() at fork_trampoline+0x8/frame 0xee2e5cd4 > --- trap 0, eip = 0, esp = 0xee2e5d20, ebp = 0 --- > > Tracing command usb pid 15 tid 100043 td 0xc6ced930 > sched_switch(c6ced930,0,104,0,0,...) at sched_switch+0x2d2/frame 0xee2e2bb8 > mi_switch(104,0,0,0,c6ced930,c6cdbd7c) at mi_switch+0x122/frame 0xee2e2bf0 > sleepq_switch(c6ced930,0,c11b698a,268,c6d57140,...) at sleepq_switch+0x15b/frame 0xee2e2c18 > sleepq_wait(c6cdbd7c,0,c11a23c4,1,0,...) at sleepq_wait+0x3f/frame 0xee2e2c44 > _cv_wait(c6cdbd7c,c6cdbeec,c118e08e,73,0,...) at _cv_wait+0x182/frame 0xee2e2c74 > usb_process(c6cdbd74,ee2e2ce8,0,0,0,...) at usb_process+0xf6/frame 0xee2e2ca4 > fork_exit(c09a4cc0,c6cdbd74,ee2e2ce8) at fork_exit+0xa3/frame 0xee2e2cd4 > fork_trampoline() at fork_trampoline+0x8/frame 0xee2e2cd4 > --- trap 0, eip = 0, esp = 0xee2e2d20, ebp = 0 --- > > Tracing command usb pid 15 tid 100042 td 0xc6cedc40 > sched_switch(c6cedc40,0,104,0,0,...) at sched_switch+0x2d2/frame 0xee2dfbb8 > mi_switch(104,0,0,80246,c6cedc40,c6cdbd4c) at mi_switch+0x122/frame 0xee2dfbf0 > sleepq_switch(c6cedc40,0,c11b698a,268,0,...) at sleepq_switch+0x15b/frame 0xee2dfc18 > sleepq_wait(c6cdbd4c,0,c11a23c4,1,0,...) at sleepq_wait+0x3f/frame 0xee2dfc44 > _cv_wait(c6cdbd4c,c6cdbeec,c118e08e,73,0,...) at _cv_wait+0x182/frame 0xee2dfc74 > usb_process(c6cdbd44,ee2dfce8,0,0,0,...) at usb_process+0xf6/frame 0xee2dfca4 > fork_exit(c09a4cc0,c6cdbd44,ee2dfce8) at fork_exit+0xa3/frame 0xee2dfcd4 > fork_trampoline() at fork_trampoline+0x8/frame 0xee2dfcd4 > --- trap 0, eip = 0, esp = 0xee2dfd20, ebp = 0 --- > > Tracing command usb pid 15 tid 100041 td 0xc6cee000 > sched_switch(c6cee000,0,104,0,0,...) at sched_switch+0x2d2/frame 0xee2dcbb8 > mi_switch(104,0,0,80246,c6cee000,c6cdbd1c) at mi_switch+0x122/frame 0xee2dcbf0 > sleepq_switch(c6cee000,0,c11b698a,268,0,...) at sleepq_switch+0x15b/frame 0xee2dcc18 > sleepq_wait(c6cdbd1c,0,c11a23c4,1,0,...) at sleepq_wait+0x3f/frame 0xee2dcc44 > _cv_wait(c6cdbd1c,c6cdbeec,c118e08e,73,0,...) at _cv_wait+0x182/frame 0xee2dcc74 > usb_process(c6cdbd14,ee2dcce8,0,0,0,...) at usb_process+0xf6/frame 0xee2dcca4 > fork_exit(c09a4cc0,c6cdbd14,ee2dcce8) at fork_exit+0xa3/frame 0xee2dccd4 > fork_trampoline() at fork_trampoline+0x8/frame 0xee2dccd4 > --- trap 0, eip = 0, esp = 0xee2dcd20, ebp = 0 --- > > Tracing command usb pid 15 tid 100039 td 0xc6c0d310 > sched_switch(c6c0d310,0,104,0,0,...) at sched_switch+0x2d2/frame 0xee2d5bb8 > mi_switch(104,0,0,80246,c6c0d310,c6cc6dac) at mi_switch+0x122/frame 0xee2d5bf0 > sleepq_switch(c6c0d310,0,c11b698a,268,0,...) at sleepq_switch+0x15b/frame 0xee2d5c18 > sleepq_wait(c6cc6dac,0,c11a23c4,1,0,...) at sleepq_wait+0x3f/frame 0xee2d5c44 > _cv_wait(c6cc6dac,c6cc6eec,c118e08e,73,0,...) at _cv_wait+0x182/frame 0xee2d5c74 > usb_process(c6cc6da4,ee2d5ce8,0,0,0,...) at usb_process+0xf6/frame 0xee2d5ca4 > fork_exit(c09a4cc0,c6cc6da4,ee2d5ce8) at fork_exit+0xa3/frame 0xee2d5cd4 > fork_trampoline() at fork_trampoline+0x8/frame 0xee2d5cd4 > --- trap 0, eip = 0, esp = 0xee2d5d20, ebp = 0 --- > > Tracing command usb pid 15 tid 100038 td 0xc6c0d620 > sched_switch(c6c0d620,0,104,c1a6c5d0,0,...) at sched_switch+0x2d2/frame 0xee2d2bb8 > mi_switch(104,0,c6c99fc8,c0b3286d,c6c0d620,c6cc6d7c) at mi_switch+0x122/frame 0xee2d2bf0 > sleepq_switch(c6c0d620,0,c11b698a,268,c6d57900,...) at sleepq_switch+0x15b/frame 0xee2d2c18 > sleepq_wait(c6cc6d7c,0,c11a23c4,1,0,...) at sleepq_wait+0x3f/frame 0xee2d2c44 > _cv_wait(c6cc6d7c,c6cc6eec,c118e08e,73,0,...) at _cv_wait+0x182/frame 0xee2d2c74 > usb_process(c6cc6d74,ee2d2ce8,0,0,0,...) at usb_process+0xf6/frame 0xee2d2ca4 > fork_exit(c09a4cc0,c6cc6d74,ee2d2ce8) at fork_exit+0xa3/frame 0xee2d2cd4 > fork_trampoline() at fork_trampoline+0x8/frame 0xee2d2cd4 > --- trap 0, eip = 0, esp = 0xee2d2d20, ebp = 0 --- > > Tracing command usb pid 15 tid 100037 td 0xc6c0d930 > sched_switch(c6c0d930,0,104,0,0,...) at sched_switch+0x2d2/frame 0xee2cfbb8 > mi_switch(104,0,0,80246,c6c0d930,c6cc6d4c) at mi_switch+0x122/frame 0xee2cfbf0 > sleepq_switch(c6c0d930,0,c11b698a,268,0,...) at sleepq_switch+0x15b/frame 0xee2cfc18 > sleepq_wait(c6cc6d4c,0,c11a23c4,1,0,...) at sleepq_wait+0x3f/frame 0xee2cfc44 > _cv_wait(c6cc6d4c,c6cc6eec,c118e08e,73,0,...) at _cv_wait+0x182/frame 0xee2cfc74 > usb_process(c6cc6d44,ee2cfce8,0,0,0,...) at usb_process+0xf6/frame 0xee2cfca4 > fork_exit(c09a4cc0,c6cc6d44,ee2cfce8) at fork_exit+0xa3/frame 0xee2cfcd4 > fork_trampoline() at fork_trampoline+0x8/frame 0xee2cfcd4 > --- trap 0, eip = 0, esp = 0xee2cfd20, ebp = 0 --- > > Tracing command usb pid 15 tid 100036 td 0xc6c0dc40 > sched_switch(c6c0dc40,0,104,0,0,...) at sched_switch+0x2d2/frame 0xee2ccbb8 > mi_switch(104,0,0,80246,c6c0dc40,c6cc6d1c) at mi_switch+0x122/frame 0xee2ccbf0 > sleepq_switch(c6c0dc40,0,c11b698a,268,0,...) at sleepq_switch+0x15b/frame 0xee2ccc18 > sleepq_wait(c6cc6d1c,0,c11a23c4,1,0,...) at sleepq_wait+0x3f/frame 0xee2ccc44 > _cv_wait(c6cc6d1c,c6cc6eec,c118e08e,73,0,...) at _cv_wait+0x182/frame 0xee2ccc74 > us > > ---------------------------------------------------------------------- > > config.txt > > options CONFIG_AUTOGENERATED > ident GENERIC > machine i386 > cpu I686_CPU > cpu I586_CPU > cpu I486_CPU > makeoptions WITH_CTF=1 > makeoptions DEBUG=-g > options XENHVM > options USB_DEBUG > options ATH_ENABLE_11N > options AH_AR5416_INTERRUPT_MITIGATION > options AH_SUPPORT_AR5416 > options IEEE80211_SUPPORT_MESH > options IEEE80211_AMPDU_AGE > options IEEE80211_DEBUG > options SC_PIXEL_MODE > options VESA > options AHD_REG_PRETTY_PRINT > options AHC_REG_PRETTY_PRINT > options ATA_STATIC_ID > options SMP > options KDB_TRACE > options KDB > options DDB > options VIMAGE > options INCLUDE_CONFIG_FILE > options DDB_CTF > options KDTRACE_HOOKS > options MAC > options PROCDESC > options CAPABILITIES > options CAPABILITY_MODE > options AUDIT > options HWPMC_HOOKS > options KBD_INSTALL_CDEV > options PRINTF_BUFR_SIZE=128 > options _KPOSIX_PRIORITY_SCHEDULING > options SYSVSEM > options SYSVMSG > options SYSVSHM > options STACK > options KTRACE > options SCSI_DELAY=5000 > options COMPAT_FREEBSD7 > options COMPAT_FREEBSD6 > options COMPAT_FREEBSD5 > options COMPAT_FREEBSD4 > options GEOM_LABEL > options GEOM_RAID > options GEOM_PART_GPT > options PSEUDOFS > options PROCFS > options CD9660 > options MSDOSFS > options NFS_ROOT > options NFSLOCKD > options NFSD > options NFSCL > options MD_ROOT > options QUOTA > options UFS_GJOURNAL > options UFS_DIRHASH > options UFS_ACL > options SOFTUPDATES > options FFS > options SCTP > options TCP_OFFLOAD > options INET6 > options INET > options PREEMPTION > options SCHED_ULE > options NEW_PCIB > options NATIVE > options GEOM_PART_MBR > options GEOM_PART_EBR_COMPAT > options GEOM_PART_EBR > options GEOM_PART_BSD > options ISAPNP > device isa > device npx > device mem > device io > device uart_ns8250 > device atpic > device apic > device cpufreq > device acpi > device eisa > device pci > device fdc > device ahci > device ata > device mvs > device siis > device ahb > device ahc > device ahd > device esp > device hptiop > device isp > device mpt > device mps > device mpr > device sym > device trm > device adv > device adw > device aha > device aic > device bt > device ncv > device nsp > device stg > device isci > device scbus > device ch > device da > device sa > device cd > device pass > device ses > device amr > device arcmsr > device asr > device ciss > device dpt > device hptmv > device hptnr > device hptrr > device hpt27xx > device iir > device ips > device mly > device twa > device tws > device aac > device aacp > device aacraid > device ida > device mfi > device mlx > device mrsas > device pst > device twe > device atkbdc > device atkbd > device psm > device kbdmux > device vga > device splash > device sc > device vt > device vt_vga > device agp > device pmtimer > device cbb > device pccard > device cardbus > device uart > device ppc > device ppbus > device lpt > device ppi > device puc > device bxe > device de > device em > device igb > device ixgb > device le > device ti > device txp > device vx > device miibus > device ae > device age > device alc > device ale > device bce > device bfe > device bge > device cas > device dc > device et > device fxp > device gem > device hme > device jme > device lge > device msk > device nfe > device nge > device pcn > device re > device rl > device sf > device sge > device sis > device sk > device ste > device stge > device tl > device tx > device vge > device vr > device vte > device wb > device xl > device cs > device ed > device ex > device ep > device fe > device ie > device sn > device xe > device wlan > device wlan_wep > device wlan_ccmp > device wlan_tkip > device wlan_amrr > device an > device ath > device ath_pci > device ath_hal > device ath_rate_sample > device ipw > device iwi > device iwn > device malo > device mwl > device ral > device wi > device wpi > device loop > device random > device padlock_rng > device rdrand_rng > device ether > device vlan > device tun > device md > device gif > device faith > device firmware > device bpf > device uhci > device ohci > device ehci > device xhci > device usb > device ukbd > device umass > device sound > device snd_cmi > device snd_csa > device snd_emu10kx > device snd_es137x > device snd_hda > device snd_ich > device snd_via8233 > device mmc > device mmcsd > device sdhci > device virtio > device virtio_pci > device vtnet > device virtio_blk > device virtio_scsi > device virtio_balloon > device hyperv > device xenpci > device vmx > > ---------------------------------------------------------------------- > > msgbuf.txt > > Copyright (c) 1992-2014 The FreeBSD Project. > Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 > The Regents of the University of California. All rights reserved. > FreeBSD is a registered trademark of The FreeBSD Foundation. > FreeBSD 10.1-STABLE #1 r276174: Sat Jan 3 20:50:10 CET 2015 > root at verdi.nethelp.no:/usr/src/sys/i386/compile/GENERICV i386 > FreeBSD clang version 3.4.1 (tags/RELEASE_34/dot1-final 208032) 20140512 > CPU: Intel(R) Pentium(R) D CPU 2.80GHz (2793.06-MHz 686-class CPU) > Origin="GenuineIntel" Id=0xf47 Family=0xf Model=0x4 Stepping=7 > Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE> > Features2=0x641d<SSE3,DTES64,MON,DS_CPL,CNXT-ID,CX16,xTPR> > AMD Features=0x20100000<NX,LM> > AMD Features2=0x1<LAHF> > TSC: P-state invariant > real memory = 2147483648 (2048 MB) > avail memory = 2083926016 (1987 MB) > Event timer "LAPIC" quality 400 > ACPI APIC Table: <DELL PESC430> > FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs > FreeBSD/SMP: 1 package(s) x 2 core(s) > cpu0 (BSP): APIC ID: 0 > cpu1 (AP): APIC ID: 1 > WARNING: VIMAGE (virtualized network stack) is a highly experimental feature. > ioapic0: Changing APIC ID to 8 > ioapic0 <Version 2.0> irqs 0-23 on motherboard > lapic0: Forcing LINT1 to edge trigger > random: <Software, Yarrow> initialized > kbd1 at kbdmux0 > acpi0: <DELL PESC430> on motherboard > acpi0: Power Button (fixed) > acpi0: reservation of 0, a0000 (3) failed > acpi0: reservation of 100000, f00000 (3) failed > acpi0: reservation of 1000000, 7ee8cc00 (3) failed > cpu0: <ACPI CPU> on acpi0 > cpu1: <ACPI CPU> on acpi0 > atrtc0: <AT realtime clock> port 0x70-0x7f irq 8 on acpi0 > Event timer "RTC" frequency 32768 Hz quality 0 > attimer0: <AT timer> port 0x40-0x5f irq 0 on acpi0 > Timecounter "i8254" frequency 1193182 Hz quality 0 > Event timer "i8254" frequency 1193182 Hz quality 100 > Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 > acpi_timer0: <24-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0 > hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0 > Timecounter "HPET" frequency 14318180 Hz quality 950 > Event timer "HPET" frequency 14318180 Hz quality 450 > Event timer "HPET1" frequency 14318180 Hz quality 440 > Event timer "HPET2" frequency 14318180 Hz quality 440 > acpi_button0: <Power Button> on acpi0 > pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0 > pci0: <ACPI PCI bus> on pcib0 > pcib1: <ACPI PCI-PCI bridge> irq 16 at device 1.0 on pci0 > pci1: <ACPI PCI bus> on pcib1 > pcib2: <ACPI PCI-PCI bridge> irq 16 at device 28.0 on pci0 > pci2: <ACPI PCI bus> on pcib2 > em0: <Intel(R) PRO/1000 Network Connection 7.4.2> port 0xdcc0-0xdcdf mem 0xfe880000-0xfe89ffff,0xfe8a0000-0xfe8bffff irq 16 at device 0.0 on pci2 > em0: Using an MSI interrupt > em0: Ethernet address: 00:15:17:36:bc:e8 > em1: <Intel(R) PRO/1000 Network Connection 7.4.2> port 0xdce0-0xdcff mem 0xfe8c0000-0xfe8dffff,0xfe8e0000-0xfe8fffff irq 17 at device 0.1 on pci2 > em1: Using an MSI interrupt > em1: Ethernet address: 00:15:17:36:bc:e9 > pcib3: <ACPI PCI-PCI bridge> irq 16 at device 28.4 on pci0 > pci3: <ACPI PCI bus> on pcib3 > bge0: <Broadcom NetXtreme PCIe Ethernet Adapter, ASIC rev. 0x004101> mem 0xfe7f0000-0xfe7fffff irq 16 at device 0.0 on pci3 > bge0: CHIP ID 0x00004101; ASIC REV 0x04; CHIP REV 0x41; PCI-E > miibus0: <MII bus> on bge0 > brgphy0: <BCM5750 1000BASE-T media interface> PHY 1 on miibus0 > brgphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto, auto-flow > bge0: Ethernet address: 00:10:18:1c:60:ce > pcib4: <ACPI PCI-PCI bridge> irq 17 at device 28.5 on pci0 > pci4: <ACPI PCI bus> on pcib4 > bge1: <Broadcom NetXtreme Gigabit Ethernet Controller, ASIC rev. 0x004001> mem 0xfe6f0000-0xfe6fffff irq 17 at device 0.0 on pci4 > bge1: CHIP ID 0x00004001; ASIC REV 0x04; CHIP REV 0x40; PCI-E > miibus1: <MII bus> on bge1 > brgphy1: <BCM5750 1000BASE-T media interface> PHY 1 on miibus1 > brgphy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto, auto-flow > bge1: Ethernet address: 00:13:72:20:b4:6f > uhci0: <Intel 82801G (ICH7) USB controller USB-A> port 0xff80-0xff9f irq 21 at device 29.0 on pci0 > usbus0 on uhci0 > uhci1: <Intel 82801G (ICH7) USB controller USB-B> port 0xff60-0xff7f irq 22 at device 29.1 on pci0 > usbus1 on uhci1 > uhci2: <Intel 82801G (ICH7) USB controller USB-C> port 0xff40-0xff5f irq 18 at device 29.2 on pci0 > usbus2 on uhci2 > uhci3: <Intel 82801G (ICH7) USB controller USB-D> port 0xff20-0xff3f irq 23 at device 29.3 on pci0 > usbus3 on uhci3 > ehci0: <Intel 82801GB/R (ICH7) USB 2.0 controller> mem 0xffa80800-0xffa80bff irq 21 at device 29.7 on pci0 > usbus4: EHCI version 1.0 > usbus4 on ehci0 > pcib5: <ACPI PCI-PCI bridge> at device 30.0 on pci0 > pci5: <ACPI PCI bus> on pcib5 > vgapci0: <VGA-compatible display> port 0xcc80-0xccff mem 0xfc000000-0xfdffffff,0xfe4c0000-0xfe4fffff at device 7.0 on pci5 > vgapci0: Boot video device > isab0: <PCI-ISA bridge> at device 31.0 on pci0 > isa0: <ISA bus> on isab0 > atapci0: <Intel ICH7 UDMA100 controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xffa0-0xffaf irq 16 at device 31.1 on pci0 > ata0: <ATA channel> at channel 0 on atapci0 > atapci1: <Intel ICH7 SATA300 controller> port 0xfe00-0xfe07,0xfe10-0xfe13,0xfe20-0xfe27,0xfe30-0xfe33,0xfea0-0xfeaf irq 20 at device 31.2 on pci0 > ata2: <ATA channel> at channel 0 on atapci1 > ata3: <ATA channel> at channel 1 on atapci1 > fdc0: <floppy drive controller> port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0 > fd0: <1440-KB 3.5" drive> on fdc0 drive 0 > uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 > pmtimer0 on isa0 > orm0: <ISA Option ROMs> at iomem 0xc0000-0xc7fff,0xc8000-0xc8fff,0xc9000-0xcafff,0xcb000-0xcbfff pnpid ORM0000 on isa0 > sc0: <System console> at flags 0x100 on isa0 > sc0: VGA <16 virtual consoles, flags=0x300> > vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 > atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0 > atkbd0: <AT Keyboard> irq 1 on atkbdc0 > kbd0 at atkbd0 > atkbd0: [GIANT-LOCKED] > ppc0: parallel port not found. > p4tcc0: <CPU Frequency Thermal Control> on cpu0 > p4tcc1: <CPU Frequency Thermal Control> on cpu1 > Timecounters tick every 1.000 msec > random: unblocking device. > usbus0: 12Mbps Full Speed USB v1.0 > usbus1: 12Mbps Full Speed USB v1.0 > usbus2: 12Mbps Full Speed USB v1.0 > usbus3: 12Mbps Full Speed USB v1.0 > usbus4: 480Mbps High Speed USB v2.0 > ugen0.1: <Intel> at usbus0 > uhub0: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus0 > ugen2.1: <Intel> at usbus2 > ugen1.1: <Intel> at usbus1 > uhub1: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus1 > ugen4.1: <Intel> at usbus4 > uhub2: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus4 > ugen3.1: <Intel> at usbus3 > uhub3: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus3 > uhub4: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus2 > ada0 at ata2 bus 0 scbus1 target 0 lun 0 > ada0: <ST3500320AS SD15> ATA-8 SATA 2.x device > ada0: Serial Number 9QM098KE > ada0: 300.000MB/s transfers (SATA 2.x, UDMA5, PIO 8192bytes) > ada0: 476940MB (976773168 512 byte sectors: 16H 63S/T 16383C) > ada0: Previously was known as ad4 > ada1 at ata3 bus 0 scbus2 target 0 lun 0 > ada1: <ST3500320AS SD15> ATA-8 SATA 2.x device > ada1: Serial Number 9QM0D4DL > ada1: 300.000MB/s transfers (SATA 2.x, UDMA5, PIO 8192bytes) > ada1: 476940MB (976773168 512 byte sectors: 16H 63S/T 16383C) > ada1: Previously was known as ad6 > cd0 at ata0 bus 0 scbus0 target 0 lun 0 > cd0: <HL-DT-ST CD-ROM GCR-8485B 1.06> Removable CD-ROM SCSI-0 device > cd0: 33.300MB/s transfers (UDMA2, ATAPI 12bytes, PIO 65534bytes) > cd0: Attempt to query device size failed: NOT READY, Medium not present > uhub1: 2 ports with 2 removable, self powered > uhub0: 2 ports with 2 removable, self powered > uhub3: 2 ports with 2 removable, self powered > uhub4: 2 ports with 2 removable, self powered > lapic1: Forcing LINT1 to edge trigger > SMP: AP CPU #1 Launched! > Timecounter "TSC-low" frequency 1396531633 Hz quality 1000 > Root mount waiting for: usbus4 > Root mount waiting for: usbus4 > uhub2: 8 ports with 8 removable, self powered > Trying to mount root from ufs:/dev/ada0s1a [rw]... > <118>Setting hostuuid: 44454c4c-4400-104a-8054-b8c04f43324a. > <118>Setting hostid: 0xde1f5676. > <118>Starting ddb. > <118>Entropy harvesting: interrupts ethernet point_to_point swi. > <118>Starting file system checks: > <118>/dev/ada0s1a: FILE SYSTEM CLEAN; SKIPPING CHECKS > <118>/dev/ada0s1a: clean, 4499260 free (1612 frags, 562206 blocks, 0.0% fragmentation) > <118>/dev/ada0s1d: FILE SYSTEM CLEAN; SKIPPING CHECKS > <118>/dev/ada0s1d: clean, 3269748 free (10100 frags, 407456 blocks, 0.2% fragmentation) > <118>/dev/ada0s1e: FILE SYSTEM CLEAN; SKIPPING CHECKS > <118>/dev/ada0s1e: clean, 2462027 free (147 frags, 307735 blocks, 0.0% fragmentation) > <118>Mounting local file systems:. > <118>Writing entropy file:. > <118>Setting hostname: verdi.nethelp.no. > ugen3.2: <DELL> at usbus3 > ukbd0: <DELL DELL USB Keyboard, class 0/0, rev 1.10/1.05, addr 2> on usbus3 > kbd2 at ukbd0 > <118>Starting Network: lo0 em0 em1 bge0 bge1. > <118>lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384 > <118> options=600003<RXCSUM,TXCSUM,RXCSUM_IPV6,TXCSUM_IPV6> > <118> inet6 ::1 prefixlen 128 > <118> inet6 fe80::1%lo0 prefixlen 64 scopeid 0x5 > <118> inet 127.0.0.1 netmask 0xff000000 > <118> nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL> > <118>em0: flags=8c02<BROADCAST,OACTIVE,SIMPLEX,MULTICAST> metric 0 mtu 1500 > <118> options=4219b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,WOL_MAGIC,VLAN_HWTSO> > <118> ether 00:15:17:36:bc:e8 > <118> nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL> > <118> media: Ethernet autoselect > <118> status: no carrier > <118>em1: flags=8c02<BROADCAST,OACTIVE,SIMPLEX,MULTICAST> metric 0 mtu 1500 > <118> options=4019b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,VLAN_HWTSO> > <118> ether 00:15:17:36:bc:e9 > <118> nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL> > <118> media: Ethernet autoselect > <118> status: no carrier > <118>bge0: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500 > <118> options=8009b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,LINKSTATE> > <118> ether 00:10:18:1c:60:ce > <118> nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL> > <118> media: Ethernet autoselect > <118>bge1: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500 > <118> options=8009b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,LINKSTATE> > <118> ether 00:13:72:20:b4:6f > <118> inet 10.0.0.2 netmask 0xfffffffc broadcast 10.0.0.3 > <118> nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL> > <118> media: Ethernet autoselect (none) > <118> status: no carrier > <118>Starting devd. > <118>Starting Network: em0. > <118>em0: flags=8c02<BROADCAST,OACTIVE,SIMPLEX,MULTICAST> metric 0 mtu 1500 > <118> options=4219b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,WOL_MAGIC,VLAN_HWTSO> > <118> ether 00:15:17:36:bc:e8 > <118> nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL> > <118> media: Ethernet autoselect > <118> status: no carrier > <118>Starting Network: em1. > <118>em1: flags=8c02<BROADCAST,OACTIVE,SIMPLEX,MULTICAST> metric 0 mtu 1500 > <118> options=4019b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,VLAN_HWTSO> > <118> ether 00:15:17:36:bc:e9 > <118> nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL> > <118> media: Ethernet autoselect > <118> status: no carrier > <118>Starting Network: bge0. > <118>bge0: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500 > <118> options=8009b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,LINKSTATE> > <118> ether 00:10:18:1c:60:ce > <118> nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL> > <118> media: Ethernet autoselect > <118>Configuring syscons: keymap. > <118>Starting pflogd: > <118>add net fe80::: gateway ::1 > <118>add net ff02::: gateway ::1 > <118>add net ::ffff:0.0.0.0: gateway ::1 > <118>add net ::0.0.0.0: gateway ::1 > <118>Creating and/or trimming log files. > <118>Starting syslogd. > <118>No core dumps found. > <118>ELF ldconfig path: /lib /usr/lib /usr/lib/compat > <118>a.out ldconfig path: /usr/lib/aout /usr/lib/compat/aout > <118>Clearing /tmp (X related). > <118>Updating motd:. > <118>Mounting late file systems:. > <118>Configuring syscons: keymap blanktime. > <118>Performing sanity check on sshd configuration. > <118>Starting sshd. > <118>Starting sendmail_submit. > <118>Starting sendmail_msp_queue. > <118>Starting cron. > <118>Starting background file system checks in 60 seconds. > <118> > <118>Sat Jan 3 21:25:26 CET 2015 > <118>Jan 3 21:25:31 verdi login: ROOT LOGIN (root) ON ttyv0 > panic: vm_fault: fault on nofault entry, addr: cc0e5000 > cpuid = 0 > KDB: stack backtrace: > db_trace_self_wrapper(c11b55f1,fc,0,10000000,1,...) at db_trace_self_wrapper+0x2d/frame 0xf0923638 > kdb_backtrace(c1361c84,0,c11e064d,f09236ec,0,...) at kdb_backtrace+0x30/frame 0xf09236a0 > panic(c11e064d,cc0e5000,1,f0923804,f09237f4,...) at panic+0x11f/frame 0xf09236e0 > vm_fault_hold(c1a6d000,cc0e5000,1,0,0,...) at vm_fault_hold+0x2076/frame 0xf0923840 > vm_fault(c1a6d000,cc0e5000,1,0,c0b72331,...) at vm_fault+0x81/frame 0xf0923868 > trap_pfault(cc0e5fb8,c1472000,f0923914,c6baf200,f09239a4,...) at trap_pfault+0x1bb/frame 0xf09238e8 > trap(f0923a34) at trap+0x674/frame 0xf0923a28 > calltrap() at calltrap+0x6/frame 0xf0923a28 > --- trap 0xc, eip = 0xc1049023, esp = 0xf0923a74, ebp = 0xf0923a9c --- > copyout(f0923b28,cc0e5fb8,4,f0923acc,c142c7a8,...) at copyout+0x37/frame 0xf0923a9c > sysctl_ip6_temppltime(c142c7a8,c6a9e3a8,0,f0923b28,f0923b28,...) at sysctl_ip6_temppltime+0x3a/frame 0xf0923ac0 > sysctl_root(f0923b28,8,2,c0a058a7,c7017850,...) at sysctl_root+0x2b1/frame 0xf0923b00 > userland_sysctl(c769f310,f0923bac,4,28803030,bfbfdb70,...) at userland_sysctl+0x1fa/frame 0xf0923b70 > sys___sysctl(c769f310,f0923ca8,2e,f0923c64,c0b329f2,...) at sys___sysctl+0x98/frame 0xf0923c18 > syscall(f0923ce8) at syscall+0x4a6/frame 0xf0923cdc > Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf0923cdc > --- syscall (202, FreeBSD ELF32, sys___sysctl), eip = 0x281a28b7, esp = 0xbfbfdb00, ebp = 0xbfbfdb28 --- > KDB: enter: panic > > ---------------------------------------------------------------------- > > panic.txt > > vm_fault: fault on nofault entry, addr: cc0e5000 > > ---------------------------------------------------------------------- > > version.txt > > FreeBSD 10.1-STABLE #1 r276174: Sat Jan 3 20:50:10 CET 2015 > root at verdi.nethelp.no:/usr/src/sys/i386/compile/GENERICV > _______________________________________________ > freebsd-stable at freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe at freebsd.org" >
Craig Rodrigues
2015-Jan-04 21:27 UTC
10.1-STABLE/i386 GENERIC + VIMAGE: Panic when going multiuser
Hi, Thanks for providing the detailed logs. It looks like there is something IPv6 related in your setup that is triggering this problem. I don't have IPv6 configured on any of my boxes. Can you provide your /etc/rc.conf, and any other relevant configs which trigger usage of IPv6? -- Craig