search for: dsl_dataset_sync

..._alloc+0x2c zfs`zio_dva_allocate+0x4c zfs`zio_write_compress+0x1ec zfs`arc_write+0xe4 zfs`dbuf_sync+0x6c0 zfs`dnode_sync+0x35c zfs`dmu_objset_sync_dnodes+0x6c zfs`dmu_objset_sync+0x54 zfs`dsl_dataset_sync+0xc zfs`dsl_pool_sync+0x64 zfs`spa_sync+0x1b0 zfs`txg_sync_thread+0x134 unix`thread_start+0x4 82 genunix`avl_walk+0xa0 zfs`metaslab_ff_alloc+0x9c zfs`space_map_alloc+0x10...

Hi. System is snv_56 sun4u sparc SUNW,Sun-Fire-V440, zil_disable=1 We see many operation on nfs clients to that server really slow (like 90 seconds for unlink()). It''s not a problem with network, there''s also plenty oc CPU available. Storage isn''t saturated either. First strange thing - normally on that server nfsd has about 1500-2500 number of threads. I did

...ext_stage+0xb3(ffffff008f722790) zio_wait_for_children+0x5d(ffffff008f722790, 1, ffffff008f7229e0) zio_wait_children_ready+0x20(ffffff008f722790) zio_next_stage_async+0xbb(ffffff008f722790) zio_nowait+0x11(ffffff008f722790) dmu_objset_sync+0x196(ffffff008e4e5000, ffffff008f722a10, ffffff008f260a80) dsl_dataset_sync+0x5d(ffffff008df47e00, ffffff008f722a10, ffffff008f260a80) dsl_pool_sync+0xb5(ffffff00882fb800, 3fd0f1) spa_sync+0x1c5(ffffff008f2d1a80, 3fd0f1) txg_sync_thread+0x19a(ffffff00882fb800) thread_start+8() And here is the panic message buf: panic[cpu0]/thread=ffffff0001ba2c80: assertion failed: dmu_...

...ec zfs:zio_next_stage+aa (88e56dc0) 87a61c0c zfs:zio_wait_for_children+46 (88e56dc0, 1, 88e56f) 87a61c20 zfs:zio_wait_children_ready+18 (88e56dc0) 87a61c34 zfs:zio_next_stage_async+ac (88e56dc0) 87a61c48 zfs:zio_nowait+e (88e56dc0) 87a61c94 zfs:dmu_objset_sync+184 (85fe96c0, 88757ae0,) 87a61cbc zfs:dsl_dataset_sync+40 (813ad000, 88757ae0,) 87a61d0c zfs:dsl_pool_sync+a3 (8291c0c0, 286de2, 0) 87a61d6c zfs:spa_sync+1fc (82a7b900, 286de2, 0) 87a61dc8 zfs:txg_sync_thread+1df (8291c0c0, 0) 87a61dd8 unix:thread_start+8 () on second reboot it also Oct 11 18:17:56 nas ^Mpanic[cpu1]/thread=8f334de0: zfs: allocatin...

..._alloc+0x2c zfs`zio_dva_allocate+0x50 zfs`zio_write_compress+0x1e4 zfs`arc_write+0xbc zfs`dbuf_sync+0x6b0 zfs`dnode_sync+0x300 zfs`dmu_objset_sync_dnodes+0x68 zfs`dmu_objset_sync+0x50 zfs`dsl_dataset_sync+0xc zfs`dsl_pool_sync+0x60 zfs`spa_sync+0xe0 zfs`txg_sync_thread+0x130 unix`thread_start+0x4 316769 genunix`avl_find+0x38 zfs`space_map_remove+0x98 zfs`space_map_load+0x214 zf...

...c+0x51() zio_dva_allocate+0x3f() zio_next_stage+0x72() zio_checksum_generate+0x5f() zio_next_stage+0x72() zio_write_compress+0x136() zio_next_stage+0x72() zio_wait_for_children+0x49() zio_wait_children_ready+0x15() zio_next_stage_async+0xae() zio_wait+0x2d() arc_write+0xcc() dmu_objset_sync+0x141() dsl_dataset_sync+0x23() dsl_pool_sync+0x7b() spa_sync+0x116() txg_sync_thread+0x115() thread_start+8() It appears ZFS is still able to read the labels from the drive: $ zdb -lv /dev/rdsk/c3t50002AC00039040Bd0p0 -------------------------------------------- LABEL 0 --------------------------------------------...

...einstein genunix: [ID 179002 kern.notice] %l0-3: 0000000000000003 000000000000000f 0000000000000001 000000000000719a Jun 16 14:44:43 einstein %l4-7: 0000060002e02940 0000000000000060 0000060002e028e0 0000060002e02960 Jun 16 14:44:43 einstein genunix: [ID 723222 kern.notice] 000002a1015537e0 zfs:dsl_dataset_sync+c (60007884f40, 60009dd4dc0, 60007884fd0, 60000f505f8, 600 00f505f8, 60007884f40) Jun 16 14:44:43 einstein genunix: [ID 179002 kern.notice] %l0-3: 0000000000000001 0000000000000007 0000060000f50678 0000000000000003 Jun 16 14:44:43 einstein %l4-7: 0000060007884fc8 0000000000000000 00000000000000...

...e_sync+214 () Sep 13 14:13:22 cypress genunix: [ID 655072 kern.notice] ffffff000840da00 zfs:dmu_objset_sync_dnodes+55 () Sep 13 14:13:22 cypress genunix: [ID 655072 kern.notice] ffffff000840da80 zfs:dmu_objset_sync+13d () Sep 13 14:13:22 cypress genunix: [ID 655072 kern.notice] ffffff000840dad0 zfs:dsl_dataset_sync+5d () Sep 13 14:13:22 cypress genunix: [ID 655072 kern.notice] ffffff000840db40 zfs:dsl_pool_sync+b5 () Sep 13 14:13:22 cypress genunix: [ID 655072 kern.notice] ffffff000840dbd0 zfs:spa_sync+1c5 () Sep 13 14:13:22 cypress genunix: [ID 655072 kern.notice] ffffff000840dc60 zfs:txg_sync_thread+19a ()...

We are using MySQL, and love the idea of using zfs for this. We are used to using Direct I/O to bypass file system caching (let the DB do this). Does this exist for zfs? This message posted from opensolaris.org

...ync_leaf+1ac () ffffff000fd0a8b0 zfs:dbuf_sync_list+51 () ffffff000fd0a900 zfs:dbuf_sync_indirect+cd () ffffff000fd0a940 zfs:dbuf_sync_list+5e () ffffff000fd0a9b0 zfs:dnode_sync+23b () ffffff000fd0a9f0 zfs:dmu_objset_sync_dnodes+55 () ffffff000fd0aa70 zfs:dmu_objset_sync+13d () ffffff000fd0aac0 zfs:dsl_dataset_sync+5d () ffffff000fd0ab30 zfs:dsl_pool_sync+b5 () ffffff000fd0abd0 zfs:spa_sync+208 () ffffff000fd0ac60 zfs:txg_sync_thread+19a () ffffff000fd0ac70 unix:thread_start+8 () syncing file systems... 1 1 done ereport.io.pciex.rc.fe-msg ena=5344b8176c00c01 detector=[ version=0 scheme= "dev" devi...

I just had a quick play with gzip compression on a filesystem and the result was the machine grinding to a halt while copying some large (.wav) files to it from another filesystem in the same pool. The system became very unresponsive, taking several seconds to echo keystrokes. The box is a maxed out AMD QuadFX, so it should have plenty of grunt for this. Comments? Ian