known issue? I''ve seen this 5 times over the past few days. I think these were, for the most part BFUs on top of B107. x86. # pstack fmd.733 core ''fmd.733'' of 733: /usr/lib/fm/fmd/fmd ----------------- lwp# 1 / thread# 1 -------------------- fe8c3347 libzfs_fini (0, fed9e000, 8047d08, fed74964) + 17 fed74979 zfs_fini (84701d0, fed9e000, 8047d38, fed7ac40) + 21 fed75adb bltin_fini (84701d0, 4, fed8a340, fed7a9f0) + 1b fed7aa0f topo_mod_stop (84701d0, fed9e000, 8047d78, fed7b17e) + 2b fed7b1ba topo_modhash_unload_all (84abe88, 84939a8, 8047dc8, fed803d2) + 4a fed804b6 topo_close (84abe88, 84fdd70) + f2 0807c75f fmd_topo_fini (807305c, feef12d5, 0, 0, 8047e60, 8047e30) + 37 0806003d fmd_destroy (809a6d8, 4, 8047e78, 8072f67) + 281 08073075 main (1, 8047ea4, 8047eac, 805f2ef) + 365 0805f34d _start (1, 8047f30, 0, 8047f44, 8047f5c, 8047f7d) + 7d # mdb fmd.733 Loading modules: [ fmd libumem.so.1 libnvpair.so.1 libtopo.so.1 libuutil.so.1 libavl.so.1 libsysevent.so.1 ld.so.1 ] > $c libzfs.so.1`libzfs_fini+0x17(0, fed9e000, 8047d08, fed74964) libtopo.so.1`zfs_fini+0x21(84701d0, fed9e000, 8047d38, fed7ac40) libtopo.so.1`bltin_fini+0x1b(84701d0, 4, fed8a340, fed7a9f0) libtopo.so.1`topo_mod_stop+0x2b(84701d0, fed9e000, 8047d78, fed7b17e) libtopo.so.1`topo_modhash_unload_all+0x4a(84abe88, 84939a8, 8047dc8, fed803d2) libtopo.so.1`topo_close+0xf2(84abe88, 84fdd70) fmd_topo_fini+0x37(807305c, feef12d5, 0, 0, 8047e60, 8047e30) fmd_destroy+0x281(809a6d8, 4, 8047e78, 8072f67) main+0x365(1, 8047ea4, 8047eac, 805f2ef) _start+0x7d(1, 8047f30, 0, 8047f44, 8047f5c, 8047f7d) > libzfs.so.1`libzfs_fini+0x17/i libzfs.so.1`libzfs_fini+0x17: pushl 0x4(%esi) > $r %cs = 0x0043 %eax = 0xfed74958 libtopo.so.1`zfs_fini %ds = 0x004b %ebx = 0xfe934000 %ss = 0x004b %ecx = 0x084701d0 %es = 0x004b %edx = 0xfee12a00 %fs = 0x0000 %esi = 0x00000000 %gs = 0x01c3 %edi = 0x084701d0 %eip = 0xfe8c3347 libzfs.so.1`libzfs_fini+0x17 %ebp = 0x08047cd8 %kesp = 0x00000000 %eflags = 0x00010212 id=0 vip=0 vif=0 ac=0 vm=0 rf=1 nt=0 iopl=0x0 status=<of,df,IF,tf,sf,zf,AF,pf,cf> %esp = 0x08047cc4 %trapno = 0xe %err = 0x4
Hi, James Litchfield wrote:> known issue? I''ve seen this 5 times over the past few days. I think > these were, for the most part BFUs on top of B107. x86.Yes, Dan Price reported this happening post the fix to 6802281. Not sure there is a CR number as yet; Steve has a proposed fix which you could try testing with since his test box was unable to reproduce the problem. Gavin> # pstack fmd.733 > core ''fmd.733'' of 733: /usr/lib/fm/fmd/fmd > ----------------- lwp# 1 / thread# 1 -------------------- > fe8c3347 libzfs_fini (0, fed9e000, 8047d08, fed74964) + 17 > fed74979 zfs_fini (84701d0, fed9e000, 8047d38, fed7ac40) + 21 > fed75adb bltin_fini (84701d0, 4, fed8a340, fed7a9f0) + 1b > fed7aa0f topo_mod_stop (84701d0, fed9e000, 8047d78, fed7b17e) + 2b > fed7b1ba topo_modhash_unload_all (84abe88, 84939a8, 8047dc8, fed803d2) + 4a > fed804b6 topo_close (84abe88, 84fdd70) + f2 > 0807c75f fmd_topo_fini (807305c, feef12d5, 0, 0, 8047e60, 8047e30) + 37 > 0806003d fmd_destroy (809a6d8, 4, 8047e78, 8072f67) + 281 > 08073075 main (1, 8047ea4, 8047eac, 805f2ef) + 365 > 0805f34d _start (1, 8047f30, 0, 8047f44, 8047f5c, 8047f7d) + 7d > > # mdb fmd.733 > Loading modules: [ fmd libumem.so.1 libnvpair.so.1 libtopo.so.1 > libuutil.so.1 libavl.so.1 libsysevent.so.1 ld.so.1 ] > > $c > libzfs.so.1`libzfs_fini+0x17(0, fed9e000, 8047d08, fed74964) > libtopo.so.1`zfs_fini+0x21(84701d0, fed9e000, 8047d38, fed7ac40) > libtopo.so.1`bltin_fini+0x1b(84701d0, 4, fed8a340, fed7a9f0) > libtopo.so.1`topo_mod_stop+0x2b(84701d0, fed9e000, 8047d78, fed7b17e) > libtopo.so.1`topo_modhash_unload_all+0x4a(84abe88, 84939a8, 8047dc8, > fed803d2) > libtopo.so.1`topo_close+0xf2(84abe88, 84fdd70) > fmd_topo_fini+0x37(807305c, feef12d5, 0, 0, 8047e60, 8047e30) > fmd_destroy+0x281(809a6d8, 4, 8047e78, 8072f67) > main+0x365(1, 8047ea4, 8047eac, 805f2ef) > _start+0x7d(1, 8047f30, 0, 8047f44, 8047f5c, 8047f7d) > > libzfs.so.1`libzfs_fini+0x17/i > libzfs.so.1`libzfs_fini+0x17: pushl 0x4(%esi) > > $r > %cs = 0x0043 %eax = 0xfed74958 libtopo.so.1`zfs_fini > %ds = 0x004b %ebx = 0xfe934000 > %ss = 0x004b %ecx = 0x084701d0 > %es = 0x004b %edx = 0xfee12a00 > %fs = 0x0000 %esi = 0x00000000 > %gs = 0x01c3 %edi = 0x084701d0 > > %eip = 0xfe8c3347 libzfs.so.1`libzfs_fini+0x17 > %ebp = 0x08047cd8 > %kesp = 0x00000000 > > %eflags = 0x00010212 > id=0 vip=0 vif=0 ac=0 vm=0 rf=1 nt=0 iopl=0x0 > status=<of,df,IF,tf,sf,zf,AF,pf,cf> > > %esp = 0x08047cc4 > %trapno = 0xe > %err = 0x4 > > _______________________________________________ > zfs-discuss mailing list > zfs-discuss at opensolaris.org > http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Hi, I''ve raised bug 6806344 for this problem. I have been able to test the fix by patching fmd using mdb, but if you wish to test it, there''s an x86 binary in /home/stephh/libtopo.so.1 Steve> Hi, > > James Litchfield wrote: > >> known issue? I''ve seen this 5 times over the past few days. I think >> these were, for the most part BFUs on top of B107. x86. > > > Yes, Dan Price reported this happening post the fix to 6802281. > Not sure there is a CR number as yet; Steve has a proposed > fix which you could try testing with since his test box > was unable to reproduce the problem. > > Gavin > >> # pstack fmd.733 >> core ''fmd.733'' of 733: /usr/lib/fm/fmd/fmd >> ----------------- lwp# 1 / thread# 1 -------------------- >> fe8c3347 libzfs_fini (0, fed9e000, 8047d08, fed74964) + 17 >> fed74979 zfs_fini (84701d0, fed9e000, 8047d38, fed7ac40) + 21 >> fed75adb bltin_fini (84701d0, 4, fed8a340, fed7a9f0) + 1b >> fed7aa0f topo_mod_stop (84701d0, fed9e000, 8047d78, fed7b17e) + 2b >> fed7b1ba topo_modhash_unload_all (84abe88, 84939a8, 8047dc8, >> fed803d2) + 4a >> fed804b6 topo_close (84abe88, 84fdd70) + f2 >> 0807c75f fmd_topo_fini (807305c, feef12d5, 0, 0, 8047e60, 8047e30) + 37 >> 0806003d fmd_destroy (809a6d8, 4, 8047e78, 8072f67) + 281 >> 08073075 main (1, 8047ea4, 8047eac, 805f2ef) + 365 >> 0805f34d _start (1, 8047f30, 0, 8047f44, 8047f5c, 8047f7d) + 7d >> >> # mdb fmd.733 >> Loading modules: [ fmd libumem.so.1 libnvpair.so.1 libtopo.so.1 >> libuutil.so.1 libavl.so.1 libsysevent.so.1 ld.so.1 ] >> > $c >> libzfs.so.1`libzfs_fini+0x17(0, fed9e000, 8047d08, fed74964) >> libtopo.so.1`zfs_fini+0x21(84701d0, fed9e000, 8047d38, fed7ac40) >> libtopo.so.1`bltin_fini+0x1b(84701d0, 4, fed8a340, fed7a9f0) >> libtopo.so.1`topo_mod_stop+0x2b(84701d0, fed9e000, 8047d78, fed7b17e) >> libtopo.so.1`topo_modhash_unload_all+0x4a(84abe88, 84939a8, 8047dc8, >> fed803d2) >> libtopo.so.1`topo_close+0xf2(84abe88, 84fdd70) >> fmd_topo_fini+0x37(807305c, feef12d5, 0, 0, 8047e60, 8047e30) >> fmd_destroy+0x281(809a6d8, 4, 8047e78, 8072f67) >> main+0x365(1, 8047ea4, 8047eac, 805f2ef) >> _start+0x7d(1, 8047f30, 0, 8047f44, 8047f5c, 8047f7d) >> > libzfs.so.1`libzfs_fini+0x17/i >> libzfs.so.1`libzfs_fini+0x17: pushl 0x4(%esi) >> > $r >> %cs = 0x0043 %eax = 0xfed74958 libtopo.so.1`zfs_fini >> %ds = 0x004b %ebx = 0xfe934000 >> %ss = 0x004b %ecx = 0x084701d0 >> %es = 0x004b %edx = 0xfee12a00 >> %fs = 0x0000 %esi = 0x00000000 >> %gs = 0x01c3 %edi = 0x084701d0 >> >> %eip = 0xfe8c3347 libzfs.so.1`libzfs_fini+0x17 >> %ebp = 0x08047cd8 >> %kesp = 0x00000000 >> >> %eflags = 0x00010212 >> id=0 vip=0 vif=0 ac=0 vm=0 rf=1 nt=0 iopl=0x0 >> status=<of,df,IF,tf,sf,zf,AF,pf,cf> >> >> %esp = 0x08047cc4 >> %trapno = 0xe >> %err = 0x4 >> >> _______________________________________________ >> zfs-discuss mailing list >> zfs-discuss at opensolaris.org >> http://mail.opensolaris.org/mailman/listinfo/zfs-discuss >