search for: dmu_objset_sync_dnodes

...oup_alloc+0x1e0 zfs`metaslab_alloc_dva+0x114 zfs`metaslab_alloc+0x2c zfs`zio_dva_allocate+0x4c zfs`zio_write_compress+0x1ec zfs`arc_write+0xe4 zfs`dbuf_sync+0x6c0 zfs`dnode_sync+0x35c zfs`dmu_objset_sync_dnodes+0x6c zfs`dmu_objset_sync+0x54 zfs`dsl_dataset_sync+0xc zfs`dsl_pool_sync+0x64 zfs`spa_sync+0x1b0 zfs`txg_sync_thread+0x134 unix`thread_start+0x4 82 genunix`avl_walk+0xa0 z...

Hi. System is snv_56 sun4u sparc SUNW,Sun-Fire-V440, zil_disable=1 We see many operation on nfs clients to that server really slow (like 90 seconds for unlink()). It''s not a problem with network, there''s also plenty oc CPU available. Storage isn''t saturated either. First strange thing - normally on that server nfsd has about 1500-2500 number of threads. I did

...oup_alloc+0x1b0 zfs`metaslab_alloc_dva+0x10c zfs`metaslab_alloc+0x2c zfs`zio_dva_allocate+0x50 zfs`zio_write_compress+0x1e4 zfs`arc_write+0xbc zfs`dbuf_sync+0x6b0 zfs`dnode_sync+0x300 zfs`dmu_objset_sync_dnodes+0x68 zfs`dmu_objset_sync+0x50 zfs`dsl_dataset_sync+0xc zfs`dsl_pool_sync+0x60 zfs`spa_sync+0xe0 zfs`txg_sync_thread+0x130 unix`thread_start+0x4 316769 genunix`avl_find+0x38 zf...

...einstein genunix: [ID 179002 kern.notice] %l0-3: 0000000000000000 00000600033cb9e8 0000000000000003 00000600033cba48 Jun 16 14:44:42 einstein %l4-7: 0000060002c66400 00000600033cb9eb 000000000000000c 00000600033cba40 Jun 16 14:44:42 einstein genunix: [ID 723222 kern.notice] 000002a101553620 zfs:dmu_objset_sync_dnodes+6c (60002e02800, 60002e02940, 60009dd4dc0, 600033cb9 90, 0, 0) Jun 16 14:44:42 einstein genunix: [ID 179002 kern.notice] %l0-3: 0000060000fb8500 00000000000a4653 0000060002ee00f8 0000000000000001 Jun 16 14:44:42 einstein %l4-7: 0000000000000000 0000000070190000 0000000000000007 0000060002d5c580...

...zfs:dbuf_sync_leaf+1ac () Sep 13 14:13:22 cypress genunix: [ID 655072 kern.notice] ffffff000840d950 zfs:dbuf_sync_list+51 () Sep 13 14:13:22 cypress genunix: [ID 655072 kern.notice] ffffff000840d9c0 zfs:dnode_sync+214 () Sep 13 14:13:22 cypress genunix: [ID 655072 kern.notice] ffffff000840da00 zfs:dmu_objset_sync_dnodes+55 () Sep 13 14:13:22 cypress genunix: [ID 655072 kern.notice] ffffff000840da80 zfs:dmu_objset_sync+13d () Sep 13 14:13:22 cypress genunix: [ID 655072 kern.notice] ffffff000840dad0 zfs:dsl_dataset_sync+5d () Sep 13 14:13:22 cypress genunix: [ID 655072 kern.notice] ffffff000840db40 zfs:dsl_pool_sync...

We are using MySQL, and love the idea of using zfs for this. We are used to using Direct I/O to bypass file system caching (let the DB do this). Does this exist for zfs? This message posted from opensolaris.org

...0 zfs:zio_wait_children_ready+18 (e3c0a580) d2c8ab04 zfs:zio_next_stage_async+ac (e3c0a580, 0, f8dbfe) d2c8ab1c zfs:zio_nowait+e (e3c0a580) d2c8ab3c zfs:arc_write+7b (e44c9780, d895e8c0,) d2c8abec zfs:dbuf_sync+5f3 (dbd6ef00, e44c9780,) d2c8ac4c zfs:dnode_sync+33a (d34fbb30, 1, e44c97) d2c8ac80 zfs:dmu_objset_sync_dnodes+7e (d2380240, d23802fc,) d2c8acd0 zfs:dmu_objset_sync+5d (d2380240, e96f1e80) d2c8ad1c zfs:dsl_pool_sync+121 (d244a180, 15e234, 0) d2c8ad6c zfs:spa_sync+10a (d895e8c0, 15e234, 0) d2c8adc8 zfs:txg_sync_thread+1df (d244a180, 0) d2c8add8 unix:thread_start+8 () I now have a chicken and egg problem, ne...

...s:zio_next_stage_async+bb () ffffff000fd0a560 zfs:zio_nowait+11 () ffffff000fd0a870 zfs:dbuf_sync_leaf+1ac () ffffff000fd0a8b0 zfs:dbuf_sync_list+51 () ffffff000fd0a900 zfs:dbuf_sync_indirect+cd () ffffff000fd0a940 zfs:dbuf_sync_list+5e () ffffff000fd0a9b0 zfs:dnode_sync+23b () ffffff000fd0a9f0 zfs:dmu_objset_sync_dnodes+55 () ffffff000fd0aa70 zfs:dmu_objset_sync+13d () ffffff000fd0aac0 zfs:dsl_dataset_sync+5d () ffffff000fd0ab30 zfs:dsl_pool_sync+b5 () ffffff000fd0abd0 zfs:spa_sync+208 () ffffff000fd0ac60 zfs:txg_sync_thread+19a () ffffff000fd0ac70 unix:thread_start+8 () syncing file systems... 1 1 done ereport.i...

I just had a quick play with gzip compression on a filesystem and the result was the machine grinding to a halt while copying some large (.wav) files to it from another filesystem in the same pool. The system became very unresponsive, taking several seconds to echo keystrokes. The box is a maxed out AMD QuadFX, so it should have plenty of grunt for this. Comments? Ian