Hi all
I am using lustre-1.4.7.3.I am using the pre build kernel , pre build lustre
kernel modules and lustre rpms
I am installing from
here is my script for generating configuration file:
#! /usr/bin/env sh
set -x
#MDS device
MDSDEV="/usr/lustre-storage-space/lustre-mdsdev"
#OST Device
OSTDEV="/dev/sda7"
#Config file - XML
config="/usr/local/lustre/conf_dir/amd-luster-conf.xml"
LMC="lmc --merge $config"
#Clean up config
rm -f $config
#Add nodes(MDS, OST''s and Clients)
echo "Adding nodes\n"
${LMC} --add node --node amdpfs00
${LMC} --add node --node amdpfs01
${LMC} --add node --node amdpfs05
${LMC} --add node --node amdpfs06
${LMC} --add node --node amdpfs07
${LMC} --add node --node amdpfs08
${LMC} --add node --node client
#Network Configuration
echo "Adding Network\n"
#MDS/Client
${LMC} --add net --node amdpfs00 --nid amdpfs00 --nettype tcp
${LMC} --add net --node amdpfs01 --nid amdpfs01 --nettype tcp
${LMC} --add net --node client --nid client --nettype tcp
${LMC} --add net --node amdpfs05 --nid amdpfs05 --nettype tcp
${LMC} --add net --node amdpfs06 --nid amdpfs06 --nettype tcp
${LMC} --add net --node amdpfs07 --nid amdpfs07 --nettype tcp
${LMC} --add net --node amdpfs08 --nid amdpfs08 --nettype tcp
#MDS configuration
echo "MDS Configuration"
${LMC} --add mds --node amdpfs00 --mds amd-lustre-mds --fstype ext3 --dev
$MDSDEV --size 400000
#LOV configuration
echo "LOV Configuration"
${LMC} --add lov --lov amd-lov-1 --mds amd-lustre-mds --stripe_sz 4194304
--stripe_cnt -1 --stripe_pattern 0
#OST''s configuration
echo "OST''s Configuration"
${LMC} --add ost --node amdpfs05 --lov amd-lov-1 --ost amdpfs00-ost
--failout --fstype ext3 --dev $OSTDEV
${LMC} --add ost --node amdpfs06 --lov amd-lov-1 --ost amdpfs00-ost
--failout --fstype ext3 --dev $OSTDEV
${LMC} --add ost --node amdpfs07 --lov amd-lov-1 --ost amdpfs00-ost
--failout --fstype ext3 --dev $OSTDEV
${LMC} --add ost --node amdpfs08 --lov amd-lov-1 --ost amdpfs00-ost
--failout --fstype ext3 --dev $OSTDEV
#Client Configuration
echo "Client configuration"
${LMC} --add mtpt --node amdpfs01 --path /mnt/lustre --mds amd-lustre-mds
--lov amd-lov-1
${LMC} --add mtpt --node client --path /mnt/lustre --mds amd-lustre-mds
--lov amd-lov-1
I started ost by giving command
lconf --reformat --node amdpfs05 /usr/local/lustre/conf_dir/amd-
lustre-conf.xml
lconf --reformat --node amdpfs06 /usr/local/lustre/conf_dir/amd-
lustre-conf.xml
lconf --reformat --node amdpfs07 /usr/local/lustre/conf_dir/amd-
lustre-conf.xml
lconf --reformat --node amdpfs08 /usr/local/lustre/conf_dir/amd-
lustre-conf.xml
(Manual does''nt say where to run these commands i.e. either on mds or
on
individually on ost nodes.I assumed the latter is true)
I then started the mds(amdpfs00):
lconf --reformat --node amdpfs00 /usr/local/lustre/conf_dir/amd-
lustre-conf.xml
In case of ost''s , I am using /dev/sda7 block device(30GB)
and in mds it''s a file
when I try to mount it gives me the following errors:
mount -t lustre amdpfs00:/amd-lustre-mds/client /mnt/lustre/
mount.lustre: mount(amdpfs00:/amd-lustre-mds/client, /mnt/lustre/) failed:
Input/output error
mds nid 0: 13.1.0.158@tcp
mds name: amd-lustre-mds
profile: client
options: rw
retry: 0
I have also tried the following one:
mount -t lustre amdpfs00:/amd-lustre-mds/amdpfs01 /mnt/lustre/
mount.lustre: mount(amdpfs00:/amd-lustre-mds/client, /mnt/lustre/) failed:
Input/output error
mds nid 0: 13.1.0.158@tcp
mds name: amd-lustre-mds
profile: client
options: rw
retry: 0
What am I doing wrong
P.S. The manual should be more clear:It does''nt talk about the daemons
that
should get started (like the meta data daemons, client daemons and object
storage server daemons)
Is my configuration script wrong.
One more thing is that the scripts provided(local.sh and llmount.sh) to test
lustre works well.
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
http://mail.clusterfs.com/pipermail/lustre-discuss/attachments/20070109/ac1f1f83/attachment.html
Hi all
I am using lustre-1.4.7.3.I am using the pre build kernel , pre build lustre
kernel modules and lustre rpms
I am installing from
here is my script for generating configuration file:
#! /usr/bin/env sh
set -x
#MDS device
MDSDEV="/usr/lustre-storage-space/lustre-mdsdev"
#OST Device
OSTDEV="/dev/sda7"
#Config file - XML
config="/usr/local/lustre/conf_dir/amd-luster-conf.xml"
LMC="lmc --merge $config"
#Clean up config
rm -f $config
#Add nodes(MDS, OST''s and Clients)
echo "Adding nodes\n"
${LMC} --add node --node amdpfs00
${LMC} --add node --node amdpfs01
${LMC} --add node --node amdpfs05
${LMC} --add node --node amdpfs06
${LMC} --add node --node amdpfs07
${LMC} --add node --node amdpfs08
${LMC} --add node --node client
#Network Configuration
echo "Adding Network\n"
#MDS/Client
${LMC} --add net --node amdpfs00 --nid amdpfs00 --nettype tcp
${LMC} --add net --node amdpfs01 --nid amdpfs01 --nettype tcp
${LMC} --add net --node client --nid client --nettype tcp
${LMC} --add net --node amdpfs05 --nid amdpfs05 --nettype tcp
${LMC} --add net --node amdpfs06 --nid amdpfs06 --nettype tcp
${LMC} --add net --node amdpfs07 --nid amdpfs07 --nettype tcp
${LMC} --add net --node amdpfs08 --nid amdpfs08 --nettype tcp
#MDS configuration
echo "MDS Configuration"
${LMC} --add mds --node amdpfs00 --mds amd-lustre-mds --fstype ext3 --dev
$MDSDEV --size 400000
#LOV configuration
echo "LOV Configuration"
${LMC} --add lov --lov amd-lov-1 --mds amd-lustre-mds --stripe_sz 4194304
--stripe_cnt -1 --stripe_pattern 0
#OST''s configuration
echo "OST''s Configuration"
${LMC} --add ost --node amdpfs05 --lov amd-lov-1 --ost amdpfs00-ost
--failout --fstype ext3 --dev $OSTDEV
${LMC} --add ost --node amdpfs06 --lov amd-lov-1 --ost amdpfs00-ost
--failout --fstype ext3 --dev $OSTDEV
${LMC} --add ost --node amdpfs07 --lov amd-lov-1 --ost amdpfs00-ost
--failout --fstype ext3 --dev $OSTDEV
${LMC} --add ost --node amdpfs08 --lov amd-lov-1 --ost amdpfs00-ost
--failout --fstype ext3 --dev $OSTDEV
#Client Configuration
echo "Client configuration"
${LMC} --add mtpt --node amdpfs01 --path /mnt/lustre --mds amd-lustre-mds
--lov amd-lov-1
${LMC} --add mtpt --node client --path /mnt/lustre --mds amd-lustre-mds
--lov amd-lov-1
I started ost by giving command
lconf --reformat --node amdpfs05 /usr/local/lustre/conf_dir/amd-
lustre-conf.xml
lconf --reformat --node amdpfs06 /usr/local/lustre/conf_dir/amd-
lustre-conf.xml
lconf --reformat --node amdpfs07 /usr/local/lustre/conf_dir/amd-
lustre-conf.xml
lconf --reformat --node amdpfs08 /usr/local/lustre/conf_dir/amd-
lustre-conf.xml
(Manual does''nt say where to run these commands i.e. either on mds or
on
individually on ost nodes.I assumed the latter is true)
I then started the mds(amdpfs00):
lconf --reformat --node amdpfs00 /usr/local/lustre/conf_dir/amd-
lustre-conf.xml
In case of ost''s , I am using /dev/sda7 block device(30GB)
and in mds it''s a file
when I try to mount it gives me the following errors:
mount -t lustre amdpfs00:/amd-lustre-mds/client /mnt/lustre/
mount.lustre: mount(amdpfs00:/amd-lustre-mds/client, /mnt/lustre/) failed:
Input/output error
mds nid 0: 13.1.0.158@tcp
mds name: amd-lustre-mds
profile: client
options: rw
retry: 0
I have also tried the following one:
mount -t lustre amdpfs00:/amd-lustre-mds/amdpfs01 /mnt/lustre/
mount.lustre: mount(amdpfs00:/amd-lustre-mds/client, /mnt/lustre/) failed:
Input/output error
mds nid 0: 13.1.0.158@tcp
mds name: amd-lustre-mds
profile: client
options: rw
retry: 0
What am I doing wrong
P.S. The manual should be more clear:It does''nt talk about the daemons
that
should get started (like the meta data daemons, client daemons and object
storage server daemons)
Is my configuration script wrong.
One more thing is that the scripts provided(local.sh and llmount.sh) to test
lustre works well.
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
http://mail.clusterfs.com/pipermail/lustre-discuss/attachments/20070109/b0ad4a7d/attachment.html
> ${LMC} --add net --node amdpfs00 --nid amdpfs00 --nettype tcp > ${LMC} --add net --node amdpfs01 --nid amdpfs01 --nettype tcp > ${LMC} --add net --node client --nid client --nettype tcpNID for client should be generic %{LMC} --add net --node client --nid ''*'' --nettype tcp> #OST''s configuration > echo "OST''s Configuration" > ${LMC} --add ost --node amdpfs05 --lov amd-lov-1 --ost amdpfs00-ost > --failout --fstype ext3 --dev $OSTDEV > ${LMC} --add ost --node amdpfs06 --lov amd-lov-1 --ost amdpfs00-ost > --failout --fstype ext3 --dev $OSTDEV > ${LMC} --add ost --node amdpfs07 --lov amd-lov-1 --ost amdpfs00-ost > --failout --fstype ext3 --dev $OSTDEV > ${LMC} --add ost --node amdpfs08 --lov amd-lov-1 --ost amdpfs00-ost > --failout --fstype ext3 --dev $OSTDEVYour OSTs need unique names. They are all called ''amdfs00-ost'' To verify that each node is properly up, on each node run ''lctl dl'' - you should see a list of items (osts or mdts, depending on which node) Hope this helps, thanks for the input on the manual. cliffw