On Mon, 2005-03-28 at 22:49 -0800, Ressa wrote:> dear all...
>
> i would like to ask everybody that already configure
> lustre, could you give me clear step by step that i
> should do, i already reading the manual i''m little bit
> confused. thanks for your attention :)
The online materials are very confusing, so we can understand your
plight. It''s like installing Slackware in 1993: if you''ve
already done
it, it''s obvious, but if you haven''t, it''s a mystery.
So I''ll try to
give you the ultra-short equivalent of a comp.os.unix.help post.
Basics:
You need exactly one metadata server* (MDS) and one or more object
storage servers (OSS). The MDS needs exactly one backing store, called
an MDT. The OSS needs one or more backing stores, called OSTs.
You also need one or more clients. All systems involved (MDS, OSS, and
Client) need to have the Lustre kernel and lustre-lite-utils installed.
The latter require python.
/etc/hosts:
Make absolutely certain your /etc/hosts file is correct. The hostname
must resolve to the ethernet IP, like this:
127.0.0.1 localhost.localdomain localhost
10.0.0.8 mds-1.domain.net mds-1
Configuration:
Ignore LDAP for now. You want to build an XML file using lmc(1) and
distribute this XML file to all the hosts involved. The directions in
the Wiki are a good starting place if you are using 2.4 kernels. If
using 2.6, you need some changes. Here''s what I used for a trivial
installation of 1.4:
# Add network names for the hosts. The hostnames here
# are mds-1, oss-1, and the clients have various hostname.
# The node names are the same as the hostnames in my config.
# Note the difference between lmc -o and lmc -m
lmc -o config.xml --add net --node mds-1 --nid mds-1 --nettype tcp
lmc -m config.xml --add net --node oss-1 --nid oss-1 --nettype tcp
lmc -m config.xml --add net --node client --nid ''*'' --nettype
tcp
# Add a definition for the MDS and its LOV (logical object volume?)
# Note the "ldiskfs". If you are using 1.4.x and/or 2.6 kernels
# you must say "ldiskfs". If using 1.2.x and/or 2.4 kernels you
# must say "ext3".
#
# The effect here is to add an mds called "mds-1" on the node
# previously designated "mds-1", using the backing store
# /dev/test_vg/test_lv. This is an LVM2 logical volume. You
# can specify any other backing store like /dev/sda, /dev/md0,
# or a loopback device.
lmc -m config.xml --add mds --node mds-1 --mds mds-1 --dev /dev/test_vg/test_lv
--fstype ldiskfs
lmc -m config.xml --add lov --lov lov-1 --mds mds-1 --stripe_sz 1048576
# Define the OSS and two OSTs. I use two OSTs for future planning.
# The backing stores are again LVM2 volumes, so I can move them
# around when I expand the cluster.
#
# The effect of this command is to define two OSTs, "ost-1" and
"ost-2"
# on the node "oss-1" as members of the LOV "lov-1", all
defined above.
lmc -m config.xml --add ost --node oss-1 --lov lov-1 --ost ost-1 --dev
/dev/ost1_vg/ost1_lv --fstype ldiskfs
lmc -m config.xml --add ost --node oss-1 --lov lov-1 --ost ost-2 --dev
/dev/ost2_vg/ost2_lv --fstype ldiskfs
# Finally, add a definition for the mountpoint, or client.
# My clients mount the filesystem on /global.
lmc -m config.xml --add mtpt --node client --path /global --mds mds-1 --lov
lov-1
Starting the system, the first time:
root@oss-1# lconf --reformat --node oss-1 config.xml
root@mds-1# lconf --reformat --node mds-1 config.xml
root@client# lconf --node client config.xml
Starting the system, subsequently:
root@oss-1# lconf --node oss-1 config.xml
root@mds-1# lconf --node mds-1 config.xml
root@client1# lconf --node client config.xml
root@client2# lconf --node client config.xml
root@clientn# lconf --node client config.xml
Shutting the system down:
root@clientn# lconf -d --node client config.xml
root@client2# lconf -d --node client config.xml
root@client1# lconf -d --node client config.xml
root@mds-1# lconf -d --node mds-1 config.xml
root@oss-1# lconf -d --node oss-1 config.xml
That''s about the limit of my knowledge. I''m sorry that I
can''t test
this, it''s from my notes when I was evaluating the 1.4 release. Now
I''m
using 1.2 and can''t be sure it''s exactly the same.
-jwb
[1] You can have more MDSs, but that''s an advanced topic, and I
don''t
know how to do that yet.