Hi.
I''m trying to use mountconf instead of distributed config files on our
lustre
1.4.6.4 setup, but run into an odd problem: We have two mount points
configured, but using mountconf only one of them gets mounted. When using
lconf to mount everything is ok.
In the config generator script we have the following:
lmc -m $CONFIG --add mtpt --node client --path /global/work --mds
work-mds --lov work-lov
lmc -m $CONFIG --add mtpt --node client --path /global/home --mds
home-mds --lov home-lov
and when I do
lconf --node client /etc/lustre/lustre.xml
both /global/home and /global/work is mounted correctly:
# mount | grep lustre
lustre on /global/home type lustre_lite
(rw,osc=home-lov,mdc=MDC_compute-0-10.local_home-mds_MNT_client_2)
lustre on /global/work type lustre_lite
(rw,osc=work-lov,mdc=MDC_compute-0-10.local_work-mds_MNT_client)
but if I do
mount -t lustre lustre-11-0@tcp0:/work-mds/client /global/work
mount -t lustre lustre-11-1@tcp0:/home-mds/client /global/home
then /global/home gets mounted on the mountpoint intended for /global/work. I
tried to mimick the mount options that get listed using lconf, but the mount
fails stating it does not accept the osc and mdc options.
Any help is greatly appreciated,
r.
--
The Computer Center, University of Troms?, N-9037 TROMS? Norway.
phone:+47 77 64 41 07, fax:+47 77 64 41 00
Roy Dragseth, High Performance Computing System Administrator
Direct call: +47 77 64 62 56. email: royd@cc.uit.no
On Feb 23, 2007 12:26 +0100, Roy Dragseth wrote:> I''m trying to use mountconf instead of distributed config files on our lustre > 1.4.6.4 setup, but run into an odd problem: We have two mount points > configured, but using mountconf only one of them gets mounted. When using > lconf to mount everything is ok. > > but if I do > > mount -t lustre lustre-11-0@tcp0:/work-mds/client /global/work > mount -t lustre lustre-11-1@tcp0:/home-mds/client /global/home > > then /global/home gets mounted on the mountpoint intended for /global/work. I > tried to mimick the mount options that get listed using lconf, but the mount > fails stating it does not accept the osc and mdc options.This reminds me of a bug that was fixed in a more recent version of Lustre. I think the problem is that the "client" name is the same for both MDS instances and lconf was incorrectly writing all client configs to each OST. This means that the "client" config from the second filesystem is overwriting the "client" config from the first filesystem. I don''t recall the exact fix, but the workaround is to name your clients differently in the two filesystems. That way, even though they are both written to each filesystem the right one is used when mounting (assuming you change your mount command to use e.g. "/home-mds/client-home". Cheers, Andreas -- Andreas Dilger Principal Software Engineer Cluster File Systems, Inc.
Thanks for the info.
If this is fixed in later version of lustre I will postpone this move until we
have upgraded lustre to 1.4.9. Eagerly awaiting 1.6...
Have a nice weekend,
r.
--
The Computer Center, University of Troms?, N-9037 TROMS? Norway.
phone:+47 77 64 41 07, fax:+47 77 64 41 00
Roy Dragseth, High Performance Computing System Administrator
Direct call: +47 77 64 62 56. email: royd@cc.uit.no