Lustre discuss - Oct 2011 - lustre client unstable.

Hi ,

 

We have lustre 2.0 at our setup with 2 mds servers and 6 oss servers.

 

Facing an issue where "lfs check servers" output varies from node to
node.

Please find below the outputs of two different clients took at the same
time.

Request your help in solving this issue.

Also find attached var log messags of the node having this error.

 

 

 

[root at cn367 ~]# lfs check servers

scratch-MDT0000-mdc-ffff810c01a9c000 active.

scratch-OST0000-osc-ffff810c01a9c000 active.

scratch-OST0001-osc-ffff810c01a9c000 active.

scratch-OST0002-osc-ffff810c01a9c000 active.

scratch-OST0003-osc-ffff810c01a9c000 active.

scratch-OST0004-osc-ffff810c01a9c000 active.

scratch-OST0005-osc-ffff810c01a9c000 active.

scratch-OST0006-osc-ffff810c01a9c000 active.

scratch-OST0007-osc-ffff810c01a9c000 active.

scratch-OST0008-osc-ffff810c01a9c000 active.

scratch-OST0009-osc-ffff810c01a9c000 active.

scratch-OST000a-osc-ffff810c01a9c000 active.

scratch-OST000b-osc-ffff810c01a9c000 active.

scratch-OST000c-osc-ffff810c01a9c000 active.

scratch-OST000d-osc-ffff810c01a9c000 active.

scratch-OST000e-osc-ffff810c01a9c000 active.

scratch-OST000f-osc-ffff810c01a9c000 active.

scratch-OST0010-osc-ffff810c01a9c000 active.

scratch-OST0011-osc-ffff810c01a9c000 active.

home-MDT0000-mdc-ffff810616b86400 active.

home-OST0000-osc-ffff810616b86400 active.

home-OST0001-osc-ffff810616b86400 active.

home-OST0002-osc-ffff810616b86400 active.

home-OST0003-osc-ffff810616b86400 active.

home-OST0004-osc-ffff810616b86400 active.

home-OST0005-osc-ffff810616b86400 active.

home-OST0006-osc-ffff810616b86400 active.

home-OST0007-osc-ffff810616b86400 active.

home-OST0008-osc-ffff810616b86400 active.

home-OST0009-osc-ffff810616b86400 active.

home-OST000a-osc-ffff810616b86400 active.

home-OST000b-osc-ffff810616b86400 active.

home-OST000c-osc-ffff810616b86400 active.

home-OST000d-osc-ffff810616b86400 active.

home-OST000e-osc-ffff810616b86400 active.

home-OST000f-osc-ffff810616b86400 active.

home-OST0010-osc-ffff810616b86400 active.

home-OST0011-osc-ffff810616b86400 active.

home-OST0012-osc-ffff810616b86400 active.

home-OST0013-osc-ffff810616b86400 active.

home-OST0014-osc-ffff810616b86400 active.

home-OST0015-osc-ffff810616b86400 active.

home-OST0016-osc-ffff810616b86400 active.

home-OST0017-osc-ffff810616b86400 active.

 

[root at cn367 ~]# lctl ping 10.2.2.126 at o2ib0

12345-0 at lo

12345-10.2.2.126 at o2ib

12345-10.1.2.126 at tcp

[root at cn367 ~]#

 

 

[root at mgmt00 ~]# lfs check servers

scratch-MDT0000-mdc-ffff810c056c4000 active.

scratch-OST0000-osc-ffff810c056c4000 active.

scratch-OST0001-osc-ffff810c056c4000 active.

scratch-OST0002-osc-ffff810c056c4000 active.

scratch-OST0003-osc-ffff810c056c4000 active.

scratch-OST0004-osc-ffff810c056c4000 active.

scratch-OST0005-osc-ffff810c056c4000 active.

scratch-OST0006-osc-ffff810c056c4000 active.

scratch-OST0007-osc-ffff810c056c4000 active.

scratch-OST0008-osc-ffff810c056c4000 active.

scratch-OST0009-osc-ffff810c056c4000 active.

scratch-OST000a-osc-ffff810c056c4000 active.

scratch-OST000b-osc-ffff810c056c4000 active.

scratch-OST000c-osc-ffff810c056c4000 active.

scratch-OST000d-osc-ffff810c056c4000 active.

scratch-OST000e-osc-ffff810c056c4000 active.

scratch-OST000f-osc-ffff810c056c4000 active.

scratch-OST0010-osc-ffff810c056c4000 active.

error: check ''scratch-OST0011-osc-ffff810c056c4000'' Resource
temporarily
unavailable

home-MDT0000-mdc-ffff81181f767400 active.

home-OST0000-osc-ffff81181f767400 active.

home-OST0001-osc-ffff81181f767400 active.

home-OST0002-osc-ffff81181f767400 active.

home-OST0003-osc-ffff81181f767400 active.

home-OST0004-osc-ffff81181f767400 active.

home-OST0005-osc-ffff81181f767400 active.

home-OST0006-osc-ffff81181f767400 active.

home-OST0007-osc-ffff81181f767400 active.

home-OST0008-osc-ffff81181f767400 active.

home-OST0009-osc-ffff81181f767400 active.

home-OST000a-osc-ffff81181f767400 active.

home-OST000b-osc-ffff81181f767400 active.

home-OST000c-osc-ffff81181f767400 active.

home-OST000d-osc-ffff81181f767400 active.

home-OST000e-osc-ffff81181f767400 active.

home-OST000f-osc-ffff81181f767400 active.

home-OST0010-osc-ffff81181f767400 active.

home-OST0011-osc-ffff81181f767400 active.

home-OST0012-osc-ffff81181f767400 active.

home-OST0013-osc-ffff81181f767400 active.

home-OST0014-osc-ffff81181f767400 active.

home-OST0015-osc-ffff81181f767400 active.

home-OST0016-osc-ffff81181f767400 active.

home-OST0017-osc-ffff81181f767400 active.

 

Thanks and regards

Vinoth Sivakumar


Please do not print this email unless it is absolutely necessary. 

The information contained in this electronic message and any attachments to this
message are intended for the exclusive use of the addressee(s) and may contain
proprietary, confidential or privileged information. If you are not the intended
recipient, you should not disseminate, distribute or copy this e-mail. Please
notify the sender immediately and destroy all copies of this message and any
attachments.

WARNING: Computer viruses can be transmitted via email. The recipient should
check this email and any attachments for the presence of viruses. The company
accepts no liability for any damage caused by any virus transmitted by this
email.

www.wipro.com
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
http://lists.lustre.org/pipermail/lustre-discuss/attachments/20111020/448c81b2/attachment-0001.html
-------------- next part --------------
A non-text attachment was scrubbed...
Name: messages-mgmt00.zip
Type: application/x-zip-compressed
Size: 2294435 bytes
Desc: messages-mgmt00.zip
Url :
http://lists.lustre.org/pipermail/lustre-discuss/attachments/20111020/448c81b2/attachment-0001.bin