Stephan Budach
2013-Jan-19 11:40 UTC
[zfs-discuss] zpool errors without fmdump or dmesg errors
Hi all, I am running S11 on a Dell PE650. It has 5 zpools attached that are made out of 240 drives, connected via fibre. On thursday all of the sudden two out of three zpools on one FC channel showed numerous errors and one of them showed this: root at solaris11a:~# zpool status vsmPool01 pool: vsmPool01 state: SUSPENDED status: One or more devices is currently being resilvered. The pool will continue to function, possibly in a degraded state. action: Wait for the resilver to complete. scan: resilver in progress since Sat Jan 19 08:53:28 2013 344G scanned out of 24,7T at 128M/s, 55h18m to go 45,9G resilvered, 1,36% done config: NAME STATE READ WRITE CKSUM vsmPool01 UNAVAIL 0 0 0 experienced I/O failures mirror-0 UNAVAIL 0 0 0 experienced I/O failures c0t201A001378E06A18d0 UNAVAIL 0 0 0 experienced I/O failures c0t2006001378E0E198d0 UNAVAIL 0 0 0 experienced I/O failures c0t2005001378E0DE98d0 UNAVAIL 0 0 0 experienced I/O failures mirror-1 UNAVAIL 0 0 0 experienced I/O failures c0t2006001378E0DE98d0 UNAVAIL 0 0 0 experienced I/O failures c0t201B001378E06A18d0 UNAVAIL 0 0 0 experienced I/O failures c0t2007001378E0E198d0 UNAVAIL 0 0 0 experienced I/O failures mirror-2 UNAVAIL 0 0 0 experienced I/O failures c0t2007001378E0DE98d0 UNAVAIL 0 0 0 experienced I/O failures c0t201C001378E06A18d0 UNAVAIL 0 0 0 experienced I/O failures c0t2008001378E0E198d0 UNAVAIL 0 0 0 experienced I/O failures mirror-3 UNAVAIL 0 0 0 experienced I/O failures c0t2008001378E0DE98d0 UNAVAIL 0 0 0 experienced I/O failures c0t2009001378E0E198d0 UNAVAIL 0 0 0 experienced I/O failures c0t201D001378E06A18d0 UNAVAIL 0 0 0 experienced I/O failures mirror-4 UNAVAIL 0 0 0 experienced I/O failures c0t2009001378E0DE98d0 UNAVAIL 0 0 0 experienced I/O failures c0t201E001378E06A18d0 UNAVAIL 0 0 0 experienced I/O failures c0t200A001378E0E198d0 UNAVAIL 0 0 0 experienced I/O failures mirror-5 UNAVAIL 0 0 0 experienced I/O failures c0t200A001378E0DE98d0 UNAVAIL 0 0 0 experienced I/O failures spare-1 UNAVAIL 0 0 0 experienced I/O failures c0t201F001378E06A18d0 UNAVAIL 0 0 0 experienced I/O failures c0t2015001378E0E198d0 UNAVAIL 0 0 0 experienced I/O failures (resilvering) c0t200B001378E0E198d0 UNAVAIL 0 0 0 experienced I/O failures mirror-6 UNAVAIL 0 0 0 experienced I/O failures c0t200B001378E0DE98d0 UNAVAIL 0 0 0 experienced I/O failures c0t2020001378E06A18d0 UNAVAIL 0 0 0 experienced I/O failures c0t200C001378E0E198d0 UNAVAIL 0 0 0 experienced I/O failures mirror-7 UNAVAIL 0 0 0 experienced I/O failures spare-0 UNAVAIL 0 0 0 experienced I/O failures c0t2021001378E06A18d0 UNAVAIL 0 0 0 experienced I/O failures c0t2014001378E0DE98d0 UNAVAIL 0 0 0 experienced I/O failures (resilvering) c0t200D001378E0E198d0 UNAVAIL 0 0 0 experienced I/O failures c0t200C001378E0DE98d0 UNAVAIL 0 0 0 experienced I/O failures mirror-8 UNAVAIL 0 0 0 experienced I/O failures c0t200D001378E0DE98d0 UNAVAIL 0 0 0 experienced I/O failures c0t2022001378E06A18d0 UNAVAIL 0 0 0 experienced I/O failures c0t200E001378E0E198d0 UNAVAIL 0 0 0 experienced I/O failures mirror-9 UNAVAIL 0 0 0 experienced I/O failures c0t200E001378E0DE98d0 UNAVAIL 0 0 0 experienced I/O failures c0t2023001378E06A18d0 UNAVAIL 0 0 0 experienced I/O failures c0t200F001378E0E198d0 UNAVAIL 0 0 0 experienced I/O failures mirror-10 UNAVAIL 0 0 0 experienced I/O failures c0t200F001378E0DE98d0 UNAVAIL 0 0 0 experienced I/O failures c0t2024001378E06A18d0 UNAVAIL 0 0 0 experienced I/O failures c0t2010001378E0E198d0 UNAVAIL 0 0 0 experienced I/O failures mirror-11 UNAVAIL 0 0 0 experienced I/O failures c0t2010001378E0DE98d0 UNAVAIL 0 0 0 experienced I/O failures c0t202C001378E06A18d0 UNAVAIL 0 0 0 experienced I/O failures c0t2011001378E0E198d0 UNAVAIL 0 0 0 experienced I/O failures mirror-12 UNAVAIL 0 0 0 experienced I/O failures c0t2026001378E06A18d0 UNAVAIL 0 0 0 experienced I/O failures c0t2012001378E0E198d0 UNAVAIL 0 0 0 experienced I/O failures c0t2011001378E0DE98d0 UNAVAIL 0 0 0 experienced I/O failures mirror-13 UNAVAIL 0 0 0 experienced I/O failures c0t2012001378E0DE98d0 UNAVAIL 0 0 0 experienced I/O failures c0t2013001378E0E198d0 UNAVAIL 0 0 0 experienced I/O failures c0t2027001378E06A18d0 UNAVAIL 0 0 0 experienced I/O failures mirror-14 UNAVAIL 0 0 0 experienced I/O failures c0t2013001378E0DE98d0 UNAVAIL 0 0 0 experienced I/O failures c0t2028001378E06A18d0 UNAVAIL 0 0 0 experienced I/O failures c0t2014001378E0E198d0 UNAVAIL 0 0 0 experienced I/O failures spares c0t2015001378E0E198d0 INUSE currently in use c0t2014001378E0DE98d0 INUSE currently in use I would imagine that, if such an error happens, there must be something in dmesg or fmdump, but there is nothing at all showed by fmdump and dmesg did also show nothing, which I''d regard as a reason. Has anybody seen something like this before? Thanks -- Stephan Budach Jung von Matt/it-services GmbH Glash?ttenstra?e 79 20357 Hamburg Tel: +49 40-4321-1353 Fax: +49 40-4321-1114 E-Mail: stephan.budach at jvm.de Internet: http://www.jvm.com Gesch?ftsf?hrer: Frank Wilhelm, Stephan Budach (stellv.) AG HH HRB 98380 -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20130119/3ca42eb1/attachment-0001.html>