I have mounted two new ost to an existing lustre fs of 10 ost in total. It seams that everything was o.k. because the size increases on one client. I want to use this new disk space but I recognized that on the new ost the disk space was not used. I looked for recovery_status and there was written INACTIVE. lctl dl on mds shows no new osts. I unmount the new ost but than the fs on the client freezes. Then I mount again and got status: COMPLETE recovered_clients: 13 Thats strange because I would expect 14 clients + mdt and indeed lctl dl on one client gives only 10 ost instead of 12 the same was on mds. It seems that on one client and on the mds the new osts are not recognized. Can anybody explain what happens, and give me a hint how I can use the new disk space? I use version 1.6.0.1 on servers and version 1.6.1 on clients Thanks in advance Harald -- Harald van Pee Helmholtz-Institut fuer Strahlen- und Kernphysik der Universitaet Bonn
I just have recognized, that our lustre filesystem was not used on the client which was not aware about the new disk space. After umount followed by mount, all compute clients but the mds are aware of all 12 osts. Should I just unmount the mdt and maybe all clients before or is there another possibility to recognize the new ost on mds? Harald On Monday 28 April 2008 01:01, Harald van Pee wrote:> I have mounted two new ost to an existing lustre fs of 10 ost in total. > It seams that everything was o.k. because the size increases on one client. > I want to use this new disk space but I recognized that on the new ost the > disk space was not used. > I looked for > recovery_status > and there was written INACTIVE. > lctl dl > on mds shows no new osts. > I unmount the new ost but than the fs on the client freezes. Then I mount > again and got > status: COMPLETE > recovered_clients: 13 > > Thats strange because I would expect 14 clients + mdt > and indeed > lctl dl > on one client gives only 10 ost instead of 12 > the same was on mds. > > It seems that on one client and on the mds the new osts are not recognized. > Can anybody explain what happens, and give me a hint how I can use the new > disk space? > > I use version 1.6.0.1 on servers and version 1.6.1 on clients > Thanks in advance > Harald-- Harald van Pee Helmholtz-Institut fuer Strahlen- und Kernphysik der Universitaet Bonn Nussallee 14-16 - 53115 Bonn - Tel +49-228-732213 - Fax +49-228-732505 mail: pee at hiskp.uni-bonn.de
Hi, I just unmount all clients (mdt included) and mount again and now everything works as expected. The strange thing is that just some clients do not recognize the new osts. Of course I will try to update everything to most recent lustre version as soon as possible, but would prefer if I would have a couple of days for doing this, but don''t have. Harald On Monday 28 April 2008 10:04, Harald van Pee wrote:> I just have recognized, that our lustre filesystem was not used on the > client which was not aware about the new disk space. > After umount followed by mount, all compute clients but the mds are aware > of all 12 osts. > Should I just unmount the mdt and maybe all clients before or is there > another possibility to recognize the new ost on mds? > > Harald > > On Monday 28 April 2008 01:01, Harald van Pee wrote: > > I have mounted two new ost to an existing lustre fs of 10 ost in total. > > It seams that everything was o.k. because the size increases on one > > client. I want to use this new disk space but I recognized that on the > > new ost the disk space was not used. > > I looked for > > recovery_status > > and there was written INACTIVE. > > lctl dl > > on mds shows no new osts. > > I unmount the new ost but than the fs on the client freezes. Then I mount > > again and got > > status: COMPLETE > > recovered_clients: 13 > > > > Thats strange because I would expect 14 clients + mdt > > and indeed > > lctl dl > > on one client gives only 10 ost instead of 12 > > the same was on mds. > > > > It seems that on one client and on the mds the new osts are not > > recognized. Can anybody explain what happens, and give me a hint how I > > can use the new disk space? > > > > I use version 1.6.0.1 on servers and version 1.6.1 on clients > > Thanks in advance > > Harald-- Harald van Pee Helmholtz-Institut fuer Strahlen- und Kernphysik der Universitaet Bonn