--On May 7, 2005 3:43:06 PM +0900 "anApple.Orange" <anapple.orange@gmail.com> wrote:> > > We installed lustre 1.4.0 and it consist of one MSD, three OSTs and four > clients. >First rule of performance benchmarking is assume nothing, test everything. Go back and do disk IO tests on your backends, on your network itself, on the nodes themselves, and then build up from there. It could be a RAID controller just sucks, it could be that you''ve a heat issue or memory issue. Lots of problems, but get your baseline numbers first always...there are quite a few times in which that will show up some other problem before you get into the full end to end benchmarks.
On Sat, 2005-05-07 at 15:43 +0900, anApple.Orange wrote:> We installed lustre 1.4.0 and it consist of one MSD, three OSTs and > four clients.I have only 1 OSS and the performance is much better than this. Normally any given client will get 60-80MB/sec reads and writes. Perhaps there''s some problem with your storage subsystem or your network configuration. -jwb
With regard to failover, I''m not sure if you realise that you are
responsible for starting up the Lustre services on the alternate server. The
RECOVERY_OVER upcall is intended to signify that a failed over service has
completed recovering client connections and completing pending operations. But
it won''t happened until you (or some automatic failover management
mechanism such as Cluster Manager) starts the service up on the alternate node.
Fergal.
--
Fergal.McCarthy@HP.com
(The contents of this message and any attachments to it are confidential and may
be legally privileged. If you have received this message in error you should
delete it from your system immediately and advise the sender. To any recipient
of this message within HP, unless otherwise stated, you should consider this
message and attachments as "HP CONFIDENTIAL".)
-----Original Message-----
From: lustre-discuss-admin@lists.clusterfs.com
[mailto:lustre-discuss-admin@lists.clusterfs.com] On Behalf Of anApple.Orange
Sent: 07 May 2005 07:43
To: lustre-discuss@lists.clusterfs.com
Subject: [Lustre-discuss] Performance too bad....
We installed lustre 1.4.0 and it consist of one MSD, three OSTs and four
clients.
Spec of each node likes below.=20
CPU: Pentium4 zeon 2.8G
RAM: 1024MB
Ethernet: Gigabit
Switch: Brocade Silk Worm 3200
Storage: SBOD
OST and Client mount NFS''s root. (ex. msd:/export/path)
We mesured performance of this configuration using Bonnie++.
Result of perfomance test likes below.
1 ost
Version=A0 1.03=A0=A0=A0=A0=A0 ------Sequential Output------ --Sequential Input-
--Random-
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 =A0=A0=A0=A0=A0=A0=A0-Per Chr- --Block--
-Rewrite- -Per Chr- --Block-- --Seeks--
Machine=A0=A0=A0=A0=A0=A0=A0 Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec
%CP=A0 /sec %CP
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
client_1=A0=A0=A0=A0=A0=A0=A0=A0 1G=A0=A0=A0=A0=A0=A0=A0 =A0=A0=A011929=A0=A0 8
11112=A0 22=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 11514=A0 13=A0 75.2=A0=A0 5
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
client_1=A0=A0=A0=A0=A0=A0=A0=A0 1G=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 5961=A0=A0
4=A0 4995=A0=A0 9=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 5748=A0=A0 6=A0 37.4=A0=A0 2
client_2=A0=A0=A0=A0=A0=A0=A0=A0 1G=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 5971=A0=A0
4=A0 4985=A0=A0 8=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 5751=A0=A0 6=A0 15.1=A0=A0 4
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0
---------------------------------------------------
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0
11932=A0=A0 8=A0 9980=A0 17=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 11499=A0 12=A0
52.5=A0=A0 6
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
client_1=A0=A0=A0=A0=A0=A0=A0=A0 1G=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 3618=A0=A0
2=A0 2830=A0=A0 4=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 3919=A0=A0 4=A0 27.7=A0=A0 1
client_2=A0=A0=A0=A0=A0=A0=A0=A0 1G=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 4008=A0=A0
2=A0 2824=A0=A0 4=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 3871=A0=A0 4=A0 13.0=A0=A0 3
client_3=A0=A0=A0=A0=A0=A0=A0=A0 1G=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 4266=A0=A0
2=A0 2887=A0=A0 4=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 4020=A0=A0 4=A0 28.9=A0=A0 1
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0
---------------------------------------------------
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0
11892=A0=A0 6=A0 8541=A0 12=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 11810=A0 12=A0
69.4=A0=A0 5
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
client_1=A0=A0=A0=A0=A0=A0=A0=A0 1G=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 2773=A0=A0
1=A0 2240=A0=A0 3=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 2928=A0=A0 3=A0 21.1=A0=A0 1
client_2=A0=A0=A0=A0=A0=A0=A0=A0 1G=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 3134=A0=A0
2=A0 2232=A0=A0 3=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 2893=A0=A0 3=A0 11.1=A0=A0 3
client_3=A0=A0=A0=A0=A0=A0=A0=A0 1G=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 3025=A0=A0
2=A0 2314=A0=A0 3=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 2914=A0=A0 3=A0 21.3=A0=A0 1
client_4=A0=A0=A0=A0=A0=A0=A0 =A01G=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 3031=A0=A0
2=A0 2251=A0=A0 3=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 2896=A0=A0 3=A0 22.0=A0=A0 1
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0
---------------------------------------------------
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0
11963=A0=A0 7=A0 9037=A0 12=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 11631=A0 12=A0
75.5=A0=A0 6
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
2 ost (no stripe)
Version=A0 1.03=A0=A0=A0=A0=A0 ------Sequential Output------ --Sequential Input-
--Random-
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 -Per Chr- --Block--
-Rewrite- -Per Chr- --Block-- --Seeks--
Machine=A0=A0=A0=A0=A0=A0=A0 Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec
%CP=A0 /sec %CP
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
client_1=A0=A0=A0=A0=A0=A0=A0=A0 1G=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 11930=A0=A0 8
11038=A0 23=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 11511=A0 13=A0 70.9=A0=A0 5
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
client_1=A0=A0=A0=A0=A0=A0=A0=A0 1G=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 5983=A0=A0
4=A0 4257=A0=A0 7=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 5729=A0=A0 6=A0 36.5=A0=A0 2
client_2=A0=A0=A0=A0=A0=A0=A0=A0 1G=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 5946=A0=A0
4=A0 4279=A0=A0 7=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 5740=A0=A0 6=A0 15.1=A0=A0 4
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0
---------------------------------------------------
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0
11929=A0=A0 8=A0 9536=A0 14=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 11469=A0 12=A0
51.6=A0=A0 6
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
client_1=A0=A0=A0=A0=A0=A0=A0=A0 1G=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 5948=A0=A0
4=A0 4351=A0=A0 7=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 5801=A0=A0 6=A0 37.0=A0=A0 2
client_2=A0=A0=A0=A0=A0=A0=A0=A0 1G=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 5982=A0=A0
4=A0 4385=A0=A0 7=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 5754=A0=A0 6=A0 15.1=A0=A0 4
client_3=A0=A0=A0=A0=A0=A0=A0=A0 1G=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 11932=A0=A0 8
11116=A0 23=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 11509=A0 13=A0 86.2=A0=A0 5
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0
---------------------------------------------------
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0
23862=A0 16 19822=A0 37=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 23064=A0 25=A0 138.3 11
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
client_1=A0=A0=A0=A0=A0=A0=A0=A0 1G=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 5795=A0=A0
4=A0 4322=A0=A0 7=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 5939=A0=A0 6=A0 40.8=A0=A0 3
client_2=A0=A0=A0=A0=A0=A0=A0=A0 1G=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 5945=A0=A0
4=A0 4568=A0=A0 8=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 5756=A0=A0 6=A0 15.4=A0=A0 4
client_3=A0=A0=A0=A0=A0=A0=A0=A0 1G=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 6074=A0=A0
4=A0 4407=A0=A0 7=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 5774=A0=A0 6=A0 44.9=A0=A0 2
client_4=A0=A0=A0=A0=A0=A0=A0=A0 1G=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 5961=A0=A0
4=A0 4587=A0=A0 8=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 5749=A0=A0 6=A0 40.9=A0=A0 2
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0---------------------------------------------------
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0
23775=A0 16 17884=A0 30=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 23218=A0 24=A0 142=A0=A0
11
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
3 ost (no stripe)
Version=A0 1.03=A0=A0=A0=A0=A0 ------Sequential Output------ --Sequential Input-
--Random-
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 -Per Chr- --Block--
-Rewrite- -Per Chr- --Block-- --Seeks--
Machine=A0=A0=A0=A0=A0=A0=A0 Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec
%CP=A0 /sec %CP
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
client_1=A0=A0=A0=A0=A0=A0=A0=A0 1G=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 11931=A0=A0 8
11100=A0 23=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 11508=A0 14=A0 72.0=A0=A0 5
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
client_1=A0=A0=A0=A0=A0=A0=A0=A0 1G=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 11933=A0=A0 8
11103=A0 23=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 11507=A0 13=A0 72.4=A0=A0 6
client_2=A0=A0=A0=A0=A0=A0=A0=A0 1G=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 11932=A0=A0 9
11139=A0 23=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 11500=A0 14=A0 18.8=A0=A0 5
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0
---------------------------------------------------
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0
23865=A0 17 22242=A0 46=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 23007=A0 27=A0 91.2=A0 11
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
client_1=A0=A0=A0=A0=A0=A0=A0=A0 1G=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 5945=A0=A0
4=A0 4269=A0=A0 7=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 5778=A0=A0 6=A0 35.0=A0=A0 2
client_2=A0=A0=A0=A0=A0=A0=A0=A0 1G=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 5989=A0=A0
4=A0 4279=A0=A0 7=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 5770=A0=A0 6=A0 15.0=A0=A0 4
client_3=A0=A0=A0=A0=A0=A0=A0=A0 1G=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 11932=A0=A0 8
11120=A0 23=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 11511=A0 13=A0 81.6=A0=A0 5
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0
---------------------------------------------------
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0
23866=A0 16 19668=A0 37=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 23059=A0 25 131.6=A0 11
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
client_1=A0=A0=A0=A0=A0=A0=A0=A0 1G=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 11930=A0=A0 8
11093=A0 23=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 11504=A0 13=A0 73.2=A0=A0 5
client_2=A0=A0=A0=A0=A0 =A0=A0=A01G=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 11930=A0=A0 8
11067=A0 23=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 11498=A0 14=A0 19.0=A0=A0 5
client_3=A0=A0=A0=A0=A0=A0=A0=A0 1G=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 5830=A0=A0
3=A0 4279=A0=A0 7=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 5924=A0=A0 6=A0 42.6=A0=A0 3
client_4=A0=A0=A0=A0=A0=A0=A0=A0 1G=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 6087=A0=A0
4=A0 4304=A0=A0 7=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 5778=A0=A0 6=A0 44.4=A0=A0 2
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0
---------------------------------------------------
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0
35777=A0 23 30743=A0 60=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 34704=A0 39 179.2=A0 15
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
2 ost (stripe , 8MB)
Version=A0 1.03=A0 =A0=A0=A0=A0------Sequential Output------ --Sequential Input-
--Random-
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 -Per Chr- --Block--
-Rewrite- -Per Chr- --Block-- --Seeks--
Machine=A0=A0=A0=A0=A0=A0=A0 Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec
%CP=A0 /sec %CP
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
client_1=A0=A0=A0=A0=A0=A0=A0=A0 1G=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 13103=A0=A0 9
10357=A0 22=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 12226=A0 15=A0 86.6=A0=A0 6
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
client_1=A0=A0=A0=A0=A0=A0=A0=A0 1G=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 13438=A0 10=A0
9604=A0 21=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 11910=A0 15=A0 78.1=A0=A0 5
client_2=A0=A0=A0=A0=A0=A0=A0=A0 1G=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 13149=A0 10=A0
9675=A0 21=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 11405=A0 15=A0 18.3=A0=A0 5
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0
---------------------------------------------------
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0
26587=A0 20 19279=A0 42=A0=A0=A0=A0=A0=A0=A0=A0 =A0=A023315=A0 30=A0 96.4=A0 10
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
client_1=A0=A0=A0=A0=A0=A0=A0=A0 1G=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 11466=A0=A0
8=A0 5395=A0 10=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 8094=A0 10=A0 54.1=A0=A0 3
client_2=A0=A0=A0=A0=A0=A0=A0=A0 1G=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 11469=A0=A0
8=A0 5389=A0 11=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 8068=A0 10=A0 16.6=A0=A0 4
client_3=A0=A0=A0=A0=A0=A0=A0=A0 1G=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 6628=A0=A0
4=A0 5910=A0 12=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 8429=A0 10=A0 59.2=A0=A0 3
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0
---------------------------------------------------
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A029563=A0 20 16694=A0
33=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 24591=A0 30 129.9=A0 10
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
client_1=A0=A0=A0=A0=A0=A0=A0=A0 1G=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 9217=A0=A0
6=A0 4114=A0=A0 8=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 6002=A0=A0 7=A0 40.8=A0=A0 2
client_2=A0=A0=A0=A0=A0=A0=A0=A0 1G=A0=A0=A0=A0=A0=A0=A0=A0 =A0=A0=A07642=A0=A0
5=A0 4244=A0=A0 8=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 6059=A0=A0 7=A0 15.3=A0=A0 4
client_3=A0=A0=A0=A0=A0=A0=A0=A0 1G=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 9450=A0=A0
6=A0 3874=A0=A0 7=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 6017=A0=A0 7=A0 41.6=A0=A0 2
client_4=A0=A0=A0=A0=A0=A0=A0=A0 1G=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 4410=A0=A0
3=A0 4487=A0=A0 8=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 6096=A0=A0 7=A0 53.5=A0=A0 3
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0
---------------------------------------------------
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0
30719=A0 20 16719=A0 31=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 24174=A0 28 151.2=A0 11
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
3 ost (stripe , 8MB)
Version=A0 1.03=A0=A0=A0=A0=A0 ------Sequential Output------ --Sequential Input-
--Random-
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 -Per Chr- --Block--
-Rewrite- -Per Chr- --Block-- --Seeks--
Machine=A0=A0=A0=A0=A0=A0=A0 Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec
%CP=A0 /sec %CP
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
client_1=A0=A0=A0=A0=A0=A0=A0=A0 1G=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 14598=A0 11=A0
8025=A0 17=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 12239=A0 16=A0 88.2=A0=A0 6
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
client_1=A0=A0=A0=A0=A0=A0=A0=A0 1G=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 14791=A0 11=A0
7813=A0 17=A0=A0=A0=A0=A0=A0=A0=A0=A0 =A012195=A0 16=A0 81.8=A0=A0 6
client_2=A0=A0=A0=A0=A0=A0=A0=A0 1G=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 14606=A0 12=A0
7610=A0 17=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 11352=A0 16=A0 18.8=A0=A0 5
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0
---------------------------------------------------
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0
29397=A0 23 15423=A0 34=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 23547=A0 32=A0 99.8=A0 11
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
client_1=A0=A0=A0=A0=A0=A0=A0=A0 1G=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 14971=A0 11=A0
7361=A0 16=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 11959=A0 15=A0 78.4=A0=A0 5
client_2=A0=A0=A0=A0=A0 =A0=A0=A01G=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 14169=A0 11=A0
7617=A0 17=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 10960=A0 15=A0 18.0=A0=A0 5
client_3=A0=A0=A0=A0=A0=A0=A0=A0 1G=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 7413=A0=A0
5=A0 7757=A0 17=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 11768=A0 15=A0 84.4=A0=A0 6
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0
---------------------------------------------------
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0
=A0=A036553=A0 27 22735=A0 50=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 34687=A0 45 177.8=A0
16
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
client_1=A0=A0=A0=A0=A0=A0=A0=A0 1G=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 14139=A0 11=A0
5309=A0 11=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 9272=A0 12=A0 60.7=A0=A0 4
client_2=A0=A0=A0=A0=A0=A0=A0=A0 1G=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 14170=A0 11=A0
5493=A0 12=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 8693=A0 12=A0 17.0=A0=A0 4
client_3=A0=A0=A0=A0=A0=A0=A0=A0 1G=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 9899=A0=A0
7=A0 5904=A0 12=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 8963=A0 11=A0 66.0=A0=A0 4
client_4=A0=A0=A0=A0=A0=A0=A0=A0 1G=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 7073=A0=A0
5=A0 6355=A0 13=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 9294=A0 12=A0 64.5=A0=A0 4
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0
---------------------------------------------------
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0
45281=A0 34 23061=A0 48=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 36222=A0 47 208.2=A0 16
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
We can''t understand this result.
why is lustre''s performance too bad?
And we want use Failover.
We coufigure Failover of lustre like below.
configuration file
lmc -m $CONFIG --add ost --failover --node node1 --lov lov1 --ost ost1
--fstype ext3 --dev /dev/ost1/vol1
lmc -m $CONFIG --add ost --failover --node node4 --lov lov1 --ost ost1
--fstype ext3 --dev /dev/ost1/vol1
upcall script
#!/bin/bash
CONF=3D/root/lustre/lustre.xml
UPCALL_TYPE=3D"${1}"
shift
case "${UPCALL_TYPE}" in
FAILED_IMPORT)
=A0=A0=A0=A0=A0=A0=A0 lconf
--recover=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 =A0=A0=A0=A0 \
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 --select ost1=3Dnode4=A0=A0=A0=A0
=A0=A0 \
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 --tgt_uuid
${1}=A0=A0=A0=A0=A0=A0=A0=A0 =A0=A0=A0=A0 \
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 --client_uuid ${2}=A0=A0=A0=A0=A0
=A0=A0=A0=A0 \
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 --conn_uuid
${3}=A0=A0=A0=A0=A0=A0=A0 =A0 \
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 $CONF
=A0=A0=A0=A0=A0=A0=A0 ;;
RECOVERY_OVER)
=A0=A0=A0=A0=A0=A0=A0 lconf --select
ost1=3Dnode4=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 \
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 --tgt_uuid
${1}=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0
\
=A0=A0=A0=A0 =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0$CONF
=A0=A0=A0=A0=A0=A0=A0 ;;
esac
In this counfiguration,if one node failed another node did not invoke.
We don''t know what''s the problem.
Any help is appreciated!
Thanks.
We installed lustre 1.4.0 and it consist of one MSD, three OSTs and four
clients.
Spec of each node likes below.
CPU: Pentium4 zeon 2.8G
RAM: 1024MB
Ethernet: Gigabit
Switch: Brocade Silk Worm 3200
Storage: SBOD
OST and Client mount NFS''s root. (ex. msd:/export/path)
We mesured performance of this configuration using Bonnie++.
Result of perfomance test likes below.
1 ost
Version 1.03 ------Sequential Output------ --Sequential Input-
--Random-
-Per Chr- --Block-- -Rewrite- -Per Chr- --Block--
--Seeks--
Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec
%CP
===============================================================================
client_1 1G 11929 8 11112 22 11514 13 75.2
5
===============================================================================
client_1 1G 5961 4 4995 9 5748 6 37.4
2
client_2 1G 5971 4 4985 8 5751 6 15.1
4
---------------------------------------------------
11932 8 9980 17 11499 12 52.5
6
===============================================================================
client_1 1G 3618 2 2830 4 3919 4 27.7
1
client_2 1G 4008 2 2824 4 3871 4 13.0
3
client_3 1G 4266 2 2887 4 4020 4 28.9
1
---------------------------------------------------
11892 6 8541 12 11810 12 69.4
5
===============================================================================
client_1 1G 2773 1 2240 3 2928 3 21.1
1
client_2 1G 3134 2 2232 3 2893 3 11.1
3
client_3 1G 3025 2 2314 3 2914 3 21.3
1
client_4 1G 3031 2 2251 3 2896 3 22.0
1
---------------------------------------------------
11963 7 9037 12 11631 12 75.5
6
===============================================================================
2 ost (no stripe)
Version 1.03 ------Sequential Output------ --Sequential Input-
--Random-
-Per Chr- --Block-- -Rewrite- -Per Chr- --Block--
--Seeks--
Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec
%CP
===============================================================================
client_1 1G 11930 8 11038 23 11511 13 70.9
5
===============================================================================
client_1 1G 5983 4 4257 7 5729 6 36.5
2
client_2 1G 5946 4 4279 7 5740 6 15.1
4
---------------------------------------------------
11929 8 9536 14 11469 12 51.6
6
===============================================================================
client_1 1G 5948 4 4351 7 5801 6 37.0
2
client_2 1G 5982 4 4385 7 5754 6 15.1
4
client_3 1G 11932 8 11116 23 11509 13 86.2
5
---------------------------------------------------
23862 16 19822 37 23064 25 138.3
11
===============================================================================
client_1 1G 5795 4 4322 7 5939 6 40.8
3
client_2 1G 5945 4 4568 8 5756 6 15.4
4
client_3 1G 6074 4 4407 7 5774 6 44.9
2
client_4 1G 5961 4 4587 8 5749 6 40.9
2
---------------------------------------------------
23775 16 17884 30 23218 24 142
11
===============================================================================
3 ost (no stripe)
Version 1.03 ------Sequential Output------ --Sequential Input-
--Random-
-Per Chr- --Block-- -Rewrite- -Per Chr- --Block--
--Seeks--
Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec
%CP
===============================================================================
client_1 1G 11931 8 11100 23 11508 14 72.0
5
===============================================================================
client_1 1G 11933 8 11103 23 11507 13 72.4
6
client_2 1G 11932 9 11139 23 11500 14 18.8
5
---------------------------------------------------
23865 17 22242 46 23007 27 91.2
11
===============================================================================
client_1 1G 5945 4 4269 7 5778 6 35.0
2
client_2 1G 5989 4 4279 7 5770 6 15.0
4
client_3 1G 11932 8 11120 23 11511 13 81.6
5
---------------------------------------------------
23866 16 19668 37 23059 25 131.6
11
===============================================================================
client_1 1G 11930 8 11093 23 11504 13 73.2
5
client_2 1G 11930 8 11067 23 11498 14 19.0
5
client_3 1G 5830 3 4279 7 5924 6 42.6
3
client_4 1G 6087 4 4304 7 5778 6 44.4
2
---------------------------------------------------
35777 23 30743 60 34704 39 179.2
15
===============================================================================
2 ost (stripe , 8MB)
Version 1.03 ------Sequential Output------ --Sequential Input-
--Random-
-Per Chr- --Block-- -Rewrite- -Per Chr- --Block--
--Seeks--
Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec
%CP
===============================================================================
client_1 1G 13103 9 10357 22 12226 15 86.6
6
===============================================================================
client_1 1G 13438 10 9604 21 11910 15 78.1
5
client_2 1G 13149 10 9675 21 11405 15 18.3
5
---------------------------------------------------
26587 20 19279 42 23315 30 96.4
10
===============================================================================
client_1 1G 11466 8 5395 10 8094 10 54.1
3
client_2 1G 11469 8 5389 11 8068 10 16.6
4
client_3 1G 6628 4 5910 12 8429 10 59.2
3
---------------------------------------------------
29563 20 16694 33 24591 30 129.9
10
===============================================================================
client_1 1G 9217 6 4114 8 6002 7 40.8
2
client_2 1G 7642 5 4244 8 6059 7 15.3
4
client_3 1G 9450 6 3874 7 6017 7 41.6
2
client_4 1G 4410 3 4487 8 6096 7 53.5
3
---------------------------------------------------
30719 20 16719 31 24174 28 151.2
11
===============================================================================
3 ost (stripe , 8MB)
Version 1.03 ------Sequential Output------ --Sequential Input-
--Random-
-Per Chr- --Block-- -Rewrite- -Per Chr- --Block--
--Seeks--
Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec
%CP
===============================================================================
client_1 1G 14598 11 8025 17 12239 16 88.2
6
===============================================================================
client_1 1G 14791 11 7813 17 12195 16 81.8
6
client_2 1G 14606 12 7610 17 11352 16 18.8
5
---------------------------------------------------
29397 23 15423 34 23547 32 99.8
11
===============================================================================
client_1 1G 14971 11 7361 16 11959 15 78.4
5
client_2 1G 14169 11 7617 17 10960 15 18.0
5
client_3 1G 7413 5 7757 17 11768 15 84.4
6
---------------------------------------------------
36553 27 22735 50 34687 45 177.8
16
===============================================================================
client_1 1G 14139 11 5309 11 9272 12 60.7
4
client_2 1G 14170 11 5493 12 8693 12 17.0
4
client_3 1G 9899 7 5904 12 8963 11 66.0
4
client_4 1G 7073 5 6355 13 9294 12 64.5
4
---------------------------------------------------
45281 34 23061 48 36222 47 208.2
16
===============================================================================
We can''t understand this result.
why is lustre''s performance too bad?
And we want use Failover.
We coufigure Failover of lustre like below.
configuration file
lmc -m $CONFIG --add ost --failover --node node1 --lov lov1 --ost ost1
--fstype ext3 --dev /dev/ost1/vol1
lmc -m $CONFIG --add ost --failover --node node4 --lov lov1 --ost ost1
--fstype ext3 --dev /dev/ost1/vol1
upcall script
#!/bin/bash
CONF=/root/lustre/lustre.xml
UPCALL_TYPE="${1}"
shift
case "${UPCALL_TYPE}" in
FAILED_IMPORT)
lconf --recover \
--select ost1=node4 \
--tgt_uuid ${1} \
--client_uuid ${2} \
--conn_uuid ${3} \
$CONF
;;
RECOVERY_OVER)
lconf --select ost1=node4 \
--tgt_uuid ${1} \
$CONF
;;
esac
In this counfiguration,if one node failed another node did not invoke.
We don''t know what''s the problem.
Any help is appreciated!
Thanks.