search for: thread_start

Now at 36 hours since zdb process start and: PID USERNAME SIZE RSS STATE PRI NICE TIME CPU PROCESS/NLWP 827 root 4936M 4931M sleep 59 0 0:50:47 0.2% zdb/209 Idling at 0.2% processor for nearly the past 24 hours... feels very stuck. Thoughts on how to determine where and why? -- This message posted from opensolaris.org

I''ve recently re-installed an X4500 running Nevada b109 and have been experiencing ZFS lock ups regularly (perhaps once every 2-3 days). The machine is a backup server and receives hourly ZFS snapshots from another thumper - as such, the amount of zfs activity tends to be reasonably high. After about 48 - 72 hours, the file system seems to lock up and I''m unable to do anything

...unix`xc_one+0x260 dtrace`dtrace_ioctl+0xe6c genunix`fop_ioctl+0x20 genunix`ioctl+0x184 unix`syscall_trap+0xac 57 genunix`fsflush_do_pages+0x1f4 genunix`fsflush+0x3e0 unix`thread_start+0x4 62 unix`utl0+0x4c 68 genunix`anon_map_getpages+0x28c genunix`segvn_fault_anonpages+0x310 genunix`segvn_fault+0x438 genunix`as_fault+0x4c8 unix`pagefault+0x68 unix`tr...

...x936fbd41] 14 _dispatch_worker_thread2 + 240 (in libSystem.B.dylib) [0x936fc2be] 14 _dispatch_queue_invoke + 163 (in libSystem.B.dylib) [0x936fc519] 14 kevent + 10 (in libSystem.B.dylib) [0x936fc942] Kernel stack: 14 kevent + 97 [0x4701de] Thread 6e017a8 User stack: 14 thread_start + 34 (in libSystem.B.dylib) [0x937036a2] 14 _pthread_start + 345 (in libSystem.B.dylib) [0x9370381d] 14 ??? (in AirPort Base Station Agent + 119896) [0x1e458] 14 ??? (in AirPort Base Station Agent + 102859) [0x1a1cb] 14 ??? (in AirPort Base Station Agent + 120665) [0x1e7...

Hi. System is snv_56 sun4u sparc SUNW,Sun-Fire-V440, zil_disable=1 We see many operation on nfs clients to that server really slow (like 90 seconds for unlink()). It''s not a problem with network, there''s also plenty oc CPU available. Storage isn''t saturated either. First strange thing - normally on that server nfsd has about 1500-2500 number of threads. I did

...h_remove+54 () fffffe80005c3b00 zfs:arc_change_state+1bd () fffffe80005c3b70 zfs:arc_evict_ghost+d1 () fffffe80005c3b90 zfs:arc_adjust+10f () fffffe80005c3bb0 zfs:arc_kmem_reclaim+d0 () fffffe80005c3bf0 zfs:arc_kmem_reap_now+30 () fffffe80005c3c60 zfs:arc_reclaim_thread+108 () fffffe80005c3c70 unix:thread_start+8 () syncing file systems... done dumping to /dev/md/dsk/swap, offset 644874240, content: kernel > $c buf_hash_remove+0x54(ffffffff89c3a040) arc_change_state+0x1bd(ffffffffc0099370, ffffffff89c3a040, ffffffffc0098f30) arc_evict_ghost+0xd1(ffffffffc0099470, 14b5c0c4) arc_adjust+0x10f() arc_km...

...d_wait$UNIX2003 () #3 0x000be2d2 in mvm::Cond::wait (this=0x20526a4, l=0x2052670) at ctlock.cpp:151 #4 0x00092275 in mvm::VirtualMachine::enqueueStart (th=0x20200000) at Object.cpp:109 #5 0x000bea10 in mvm::Thread::internalThreadStart (th=0x20200000) at ctthread.cpp:275 #6 0x950e8155 in _pthread_start () #7 0x950e8012 in thread_start () Thread 3 (process 14442 thread 0x1703): #0 0x950be44e in __semwait_signal () #1 0x950e93e6 in _pthread_cond_wait () #2 0x950e8dcd in pthread_cond_wait$UNIX2003 () #3 0x000be2d2 in mvm::Cond::wait (this=0x2052614, l=0x2052630) at ctlock.cpp:151 #4 0x00092...

...0x97473dcd pthread_cond_wait$UNIX2003 + 73 2 com.apple.JavaScriptCore 0x947e0842 WTF::TCMalloc_PageHeap::scavengerThread() + 578 3 com.apple.JavaScriptCore 0x947e086f WTF::TCMalloc_PageHeap::runScavengerThread(void*) + 15 4 libSystem.B.dylib 0x97473155 _pthread_start + 321 5 libSystem.B.dylib 0x97473012 thread_start + 34 Thread 2: 0 libSystem.B.dylib 0x97442286 mach_msg_trap + 10 1 libSystem.B.dylib 0x97449a7c mach_msg + 72 2 com.apple.CoreFoundation 0x96a37e7e CFRunLoopRunSpecific + 1790 3 com.apple.CoreF...

...i_dma_sync? dtrace -n ''ddi_dma_sync:entry/cpu==2/{@[stack()]=count();}'' -c "sleep 10" has following output: ixgbe`ixgbe_ring_rx+0x49 ixgbe`ixgbe_ring_rx_poll+0x3e mac`mac_rx_srs_poll_ring+0x143 unix`thread_start+0x8 3545313 ixgbe`ixgbe_ring_rx+0x200 ixgbe`ixgbe_ring_rx_poll+0x3e mac`mac_rx_srs_poll_ring+0x143 unix`thread_start+0x8 3545314 From that, we can say that the thread "mac_rx_srs_poll_ring"...

...ic.dylib 0x00000001063c2bea __tsan::BackgroundThread(void*) + 346 Thread 2: 0 libsystem_kernel.dylib 0x00007fff98f9648a __semwait_signal + 10 1 libclang_rt.tsan_osx_dynamic.dylib 0x0000000106395650 wrap_pthread_join + 224 2 libclang_rt.tsan_osx_dynamic.dylib 0x000000010639531a __tsan_thread_start_func + 122 3 libsystem_pthread.dylib 0x00007fff93b5bfd7 _pthread_start + 176 4 libsystem_pthread.dylib 0x00007fff93b593ed thread_start + 13 Thread 3: 0 libsystem_kernel.dylib 0x00007fff98f9648a __semwait_signal + 10 1 libclang_rt.tsan_osx_dynamic.dylib 0x0000000106395...

VMKit runs multiple threads (for example for GC, finalization, etc), so I need the back trace of other threads as well :) Thanks! Nicolas On Fri, Apr 9, 2010 at 9:28 AM, Konrad Hinsen <konrad.hinsen at fastmail.net>wrote: > On 7 Apr 2010, at 21:36, nicolas geoffray wrote: > > Hmm, I am not getting that error message on my MacOS 10.5 machine with >> that same gcc. Could you

On 7 Apr 2010, at 21:36, nicolas geoffray wrote: > Hmm, I am not getting that error message on my MacOS 10.5 machine > with that same gcc. Could you run j3 in gdb and get me a backtrace? Sure: (gdb) bt #0 0x950be44e in __semwait_signal () #1 0x950e93e6 in _pthread_cond_wait () #2 0x950e8dcd in pthread_cond_wait$UNIX2003 () #3 0x000be2d2 in mvm::Cond::wait (this=0x20527c4,

...x000be2d2 in mvm::Cond::wait (this=0x20526a4, l=0x2052670) at > ctlock.cpp:151 > #4 0x00092275 in mvm::VirtualMachine::enqueueStart (th=0x20200000) at > Object.cpp:109 > #5 0x000bea10 in mvm::Thread::internalThreadStart (th=0x20200000) at > ctthread.cpp:275 > #6 0x950e8155 in _pthread_start () > #7 0x950e8012 in thread_start () > > Thread 3 (process 14442 thread 0x1703): > > #0 0x950be44e in __semwait_signal () > #1 0x950e93e6 in _pthread_cond_wait () > #2 0x950e8dcd in pthread_cond_wait$UNIX2003 () > #3 0x000be2d2 in mvm::Cond::wait (this=0x2052614, l=0x2...

...ea __tsan::BackgroundThread(void*) + 346 > > Thread 2: > 0 libsystem_kernel.dylib 0x00007fff98f9648a __semwait_signal + 10 > 1 libclang_rt.tsan_osx_dynamic.dylib 0x0000000106395650 wrap_pthread_join + 224 > 2 libclang_rt.tsan_osx_dynamic.dylib 0x000000010639531a __tsan_thread_start_func + 122 > 3 libsystem_pthread.dylib 0x00007fff93b5bfd7 _pthread_start + 176 > 4 libsystem_pthread.dylib 0x00007fff93b593ed thread_start + 13 > > Thread 3: > 0 libsystem_kernel.dylib 0x00007fff98f9648a __semwait_signal + 10 > 1 libclang_rt.tsan_osx...

...x11(ffffff008f722790) dmu_objset_sync+0x196(ffffff008e4e5000, ffffff008f722a10, ffffff008f260a80) dsl_dataset_sync+0x5d(ffffff008df47e00, ffffff008f722a10, ffffff008f260a80) dsl_pool_sync+0xb5(ffffff00882fb800, 3fd0f1) spa_sync+0x1c5(ffffff008f2d1a80, 3fd0f1) txg_sync_thread+0x19a(ffffff00882fb800) thread_start+8() And here is the panic message buf: panic[cpu0]/thread=ffffff0001ba2c80: assertion failed: dmu_read(os, smo->smo_object, offset, size, entry_map) == 0 (0 x6 == 0x0), file: ../../common/fs/zfs/space_map.c, line: 339 ffffff0001ba24f0 genunix:assfail3+b9 () ffffff0001ba2590 zfs:space_map_lo...

...inner() + 155 frame #18: 0x000000010c33ff12 libjvm.dylib`JavaThread::run() + 448 frame #19: 0x000000010c26058a libjvm.dylib`java_start(Thread*) + 246 frame #20: 0x00007fff5b43c661 libsystem_pthread.dylib`_pthread_body + 340 frame #21: 0x00007fff5b43c50d libsystem_pthread.dylib`_pthread_start + 377 frame #22: 0x00007fff5b43bbf9 libsystem_pthread.dylib`thread_start + 13 I have installed Libvirt 5.2.0. Java bindings libvirt-java 0.5.1 JNA 4.0.0 Tested Java environments: Oracle Java 8 and OpenJDK 8 on MAC, OpenJDK 11 on Ubuntu 16 Thanks & Regards Sachin Soman

...zfs:zio_nowait+e (88e56dc0) 87a61c94 zfs:dmu_objset_sync+184 (85fe96c0, 88757ae0,) 87a61cbc zfs:dsl_dataset_sync+40 (813ad000, 88757ae0,) 87a61d0c zfs:dsl_pool_sync+a3 (8291c0c0, 286de2, 0) 87a61d6c zfs:spa_sync+1fc (82a7b900, 286de2, 0) 87a61dc8 zfs:txg_sync_thread+1df (8291c0c0, 0) 87a61dd8 unix:thread_start+8 () on second reboot it also Oct 11 18:17:56 nas ^Mpanic[cpu1]/thread=8f334de0: zfs: allocating allocated segment(offset=77984887808 size=66560) 8f33485c genunix:vcmn_err+16 (3, f4571654, 8f3348) 8f334874 zfs:zfs_panic_recover+28 (f4571654, 2842f400,) 8f3348e4 zfs:space_map_add+13f (916a2278,...

...============================================== RCS file: /home/joerg/wd/repository/dragonflybsd/src/crypto/openssh-4/auth-pam.c,v retrieving revision 1.1 diff -u -r1.1 auth-pam.c --- auth-pam.c 14 Jul 2005 13:10:21 -0000 1.1 +++ auth-pam.c 14 Jul 2005 13:25:58 -0000 @@ -150,6 +150,7 @@ void *(*thread_start)(void *), void *arg) { pid_t pid; + struct pam_ctxt *ctx = arg; sshpam_thread_status = -1; switch ((pid = fork())) { @@ -157,10 +158,14 @@ error("fork(): %s", strerror(errno)); return (-1); case 0: + close(ctx->pam_psock); + ctx->pam_psock = -1; thread_start(ar...

...f_sync+0x6b0 zfs`dnode_sync+0x300 zfs`dmu_objset_sync_dnodes+0x68 zfs`dmu_objset_sync+0x50 zfs`dsl_dataset_sync+0xc zfs`dsl_pool_sync+0x60 zfs`spa_sync+0xe0 zfs`txg_sync_thread+0x130 unix`thread_start+0x4 316769 genunix`avl_find+0x38 zfs`space_map_remove+0x98 zfs`space_map_load+0x214 zfs`metaslab_activate+0x3c zfs`metaslab_group_alloc+0x1b0 zfs`metaslab_alloc_dva+0x10c zfs`metaslab_alloc...

On Wed, Jan 20, 2016 at 1:31 PM, Chris Matthews <chris.matthews at apple.com> wrote: > I worded that poorly, the Jenkins check I added will explain to the user > that we know this fails sometimes. > > On Jan 20, 2016, at 1:30 PM, Chris Matthews <chris.matthews at apple.com> > wrote: > > I have added a Jenkins check for this test, which explains why it fails on