Good Day! I'v got a problem with nfs share on zfs volume. Everything worked fine for a few month and now it hang. This share stores logs from 9 servers at night, about 1-2Gb from each server. ZFS is filled to 26% and it is v28 last pid: 46573;? load averages: 195.82, 199.86, 200.12?????????????????????????????????????????????????????????????????????????????? up 108+21:56:50 10:05:06 432 processes: 208 running, 224 sleeping CPU:? 0.0% user,? 0.0% nice,? 100% system,? 0.0% interrupt,? 0.0% idle Mem: 280M Active, 1469M Inact, 9584M Wired, 161M Cache, 1232M Buf, 311M Free Swap: 16G Total, 16G Free ? PID USERNAME????? THR PRI NICE?? SIZE??? RES STATE?? C?? TIME?? WCPU COMMAND ?1666 root????????? 256? 76??? 0? 5788K? 5120K RUN??? 14 476.8H 1508.64% nfsd # zpool list NAME?? SIZE? ALLOC?? FREE??? CAP? DEDUP? HEALTH? ALTROOT data? 3.62T?? 954G? 2.69T??? 25%? 1.00x? ONLINE? - # zfs list NAME?? USED? AVAIL? REFER? MOUNTPOINT data?? 954G? 2.64T?? 954G? /data # zfs mount data??????????????????????????? /data What should i look for to resolve it? Regards, Kirill
On Sun, Sep 25, 2011 at 11:14:30PM -0700, Kirill Yelizarov wrote:> Good Day! > I'v got a problem with nfs share on zfs volume. Everything worked fine for a few month and now it hang. This share stores logs from 9 servers at night, about 1-2Gb from each server. ZFS is filled to 26% and it is v28 > > last pid: 46573;? load averages: 195.82, 199.86, 200.12?????????????????????????????????????????????????????????????????????????????? up 108+21:56:50 10:05:06 > 432 processes: 208 running, 224 sleeping > CPU:? 0.0% user,? 0.0% nice,? 100% system,? 0.0% interrupt,? 0.0% idle > Mem: 280M Active, 1469M Inact, 9584M Wired, 161M Cache, 1232M Buf, 311M Free > Swap: 16G Total, 16G Free > > ? PID USERNAME????? THR PRI NICE?? SIZE??? RES STATE?? C?? TIME?? WCPU COMMAND > ?1666 root????????? 256? 76??? 0? 5788K? 5120K RUN??? 14 476.8H 1508.64% nfsd > > # zpool list > NAME?? SIZE? ALLOC?? FREE??? CAP? DEDUP? HEALTH? ALTROOT > data? 3.62T?? 954G? 2.69T??? 25%? 1.00x? ONLINE? - > > # zfs list > NAME?? USED? AVAIL? REFER? MOUNTPOINT > data?? 954G? 2.64T?? 954G? /data > > # zfs mount > data??????????????????????????? /data > > What should i look for to resolve it?What version of FreeBSD exactly, and what build date? Please provide output from "procstat -k -k 1666" (yes, two -k's). -- | Jeremy Chadwick jdc at parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, US | | Making life hard for others since 1977. PGP 4BD6C0CB |
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256 On 09/25/11 23:14, Kirill Yelizarov wrote:> Good Day! I'v got a problem with nfs share on zfs volume. > Everything worked fine for a few month and now it hang. This share > stores logs from 9 servers at night, about 1-2Gb from each server. > ZFS is filled to 26% and it is v28 > > last pid: 46573; load averages: 195.82, 199.86, 200.12 > up 108+21:56:50 10:05:06 432 processes: 208 running, 224 sleeping > CPU: 0.0% user, 0.0% nice, 100% system, 0.0% interrupt, 0.0% > idle Mem: 280M Active, 1469M Inact, 9584M Wired, 161M Cache, 1232M > Buf, 311M Free Swap: 16G Total, 16G Free > > PID USERNAME THR PRI NICE SIZE RES STATE C TIME > WCPU COMMAND 1666 root 256 76 0 5788K 5120K RUN > 14 476.8H 1508.64% nfsd > > # zpool list NAME SIZE ALLOC FREE CAP DEDUP HEALTH > ALTROOT data 3.62T 954G 2.69T 25% 1.00x ONLINE - > > # zfs list NAME USED AVAIL REFER MOUNTPOINT data 954G 2.64T > 954G /data > > # zfs mount data /data > > What should i look for to resolve it?For starters maybe: procstat -kk 1666 By the way what exact svn revision of FreeBSD are you running (and what branch?) Cheers, - -- Xin LI <delphij@delphij.net> https://www.delphij.net/ FreeBSD - The Power to Serve! Live free or die -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.18 (FreeBSD) iQEcBAEBCAAGBQJOgBzOAAoJEATO+BI/yjfBgJYIAIawKFqt2bD0o7L4JZxLS4Lu pOfe9OQGWJT+GIFFTBjEQq8CsNOEN4PMjGifj318ZbqPrpNQUxsy5j01SZJCtUzS WLXiBUMah6zkiquqE0WJEop88FC7CK4zop/nt64dNWbrF0MOM8uVVcMLyRNe7lK7 QhPKAhDa21vK1VxRDPWEucvJuSaUo84XHIAQbKRbzQTMSOI6Bjs/im2q1vYqM8oA Ixh+r9SocJfgky0cU5/yFteseLTVGoUZcak7ygVQ4bHeEPvOGZVrWHD1UiKHUCSF XKrFjtDzZmN7XMQLoGfiY9wyv/PnOTsgJKamaMpuZlFkysqxgO6Td7QxbB86/h0=k1bU -----END PGP SIGNATURE-----