Hi, I want to test Lustre works correctly or not in the situation that multi client machines access the servers simultaneously. What is the best way to do this? Best regards, Kazuki Ohara
On Tue, 2007-10-30 at 16:10 +0900, Kazuki Ohara wrote:> Hi, > > I want to test Lustre works correctly or not in the situation > that multi client machines access the servers simultaneously. > What is the best way to do this?IOR is a good multi-client benchmark. b.
Or one could use Iozone :-) Enjoy, capps at iozone.org -----Original Message----- From: lustre-discuss-bounces at clusterfs.com [mailto:lustre-discuss-bounces at clusterfs.com]On Behalf Of Brian J. Murrell Sent: Tuesday, October 30, 2007 11:53 AM To: lustre-discuss Subject: Re: [Lustre-discuss] How to multi client test On Tue, 2007-10-30 at 16:10 +0900, Kazuki Ohara wrote:> Hi, > > I want to test Lustre works correctly or not in the situation > that multi client machines access the servers simultaneously. > What is the best way to do this?IOR is a good multi-client benchmark. b. _______________________________________________ Lustre-discuss mailing list Lustre-discuss at clusterfs.com https://mail.clusterfs.com/mailman/listinfo/lustre-discuss
Both the IOzone and IOR benchmarks are described in the Lustre manual: http://manual.lustre.org/manual/LustreManual16_HTML/DynamicHTML-17-1.html Sheila ----- Original Message ----- From: Iozone <capps at iozone.org> Date: Tuesday, October 30, 2007 11:06 am Subject: Re: [Lustre-discuss] How to multi client test To: "Brian J. Murrell" <Brian.Murrell at Sun.COM>, lustre-discuss <lustre-discuss at clusterfs.com>> Or one could use Iozone :-) > > Enjoy, > capps at iozone.org > > > -----Original Message----- > From: lustre-discuss-bounces at clusterfs.com > [mailto:lustre-discuss-bounces at clusterfs.com]On Behalf Of Brian J. > Murrell > Sent: Tuesday, October 30, 2007 11:53 AM > To: lustre-discuss > Subject: Re: [Lustre-discuss] How to multi client test > > > On Tue, 2007-10-30 at 16:10 +0900, Kazuki Ohara wrote: > > Hi, > > > > I want to test Lustre works correctly or not in the situation > > that multi client machines access the servers simultaneously. > > What is the best way to do this? > > IOR is a good multi-client benchmark. > > b. > > > _______________________________________________ > Lustre-discuss mailing list > Lustre-discuss at clusterfs.com > https://mail.clusterfs.com/mailman/listinfo/lustre-discuss > > > > _______________________________________________ > Lustre-discuss mailing list > Lustre-discuss at clusterfs.com > https://mail.clusterfs.com/mailman/listinfo/lustre-discuss
Hi, Thank you all. I want to use Lustre with the combination of x86_64 servers and PowerPC clients and noticed that it still have some bugs concerned with endian. So I am anxious about the stability of Lustre in the cross-endian environment and want to do some function tests like acceptance-small.sh or sanity.sh included in Lustre but not only for single client environment before performance tests. If you know some useful ways for such purpose, please tell me. Best regards, Kazuki Ohara
On Oct 30, 2007 16:10 +0900, Kazuki Ohara wrote:> I want to test Lustre works correctly or not in the situation > that multi client machines access the servers simultaneously. > What is the best way to do this?A common HPC test load is the "IOR" program from LLNL. This is an MPI application that does IO from multiple clients at the same time. Cheers, Andreas -- Andreas Dilger Sr. Software Engineer, Lustre Group Sun Microsystems of Canada, Inc.
Ohara, And Iozone does multi-client without MPI :-) Try Google "filesystem benchmark" to see which benchmarks are more popular :-) Enjoy, Don Capps capps at iozone.org -----Original Message----- From: lustre-discuss-bounces at clusterfs.com [mailto:lustre-discuss-bounces at clusterfs.com]On Behalf Of Andreas Dilger Sent: Wednesday, October 31, 2007 9:12 PM To: Kazuki Ohara Cc: lustre-discuss Subject: Re: [Lustre-discuss] How to multi client test On Oct 30, 2007 16:10 +0900, Kazuki Ohara wrote:> I want to test Lustre works correctly or not in the situation > that multi client machines access the servers simultaneously. > What is the best way to do this?A common HPC test load is the "IOR" program from LLNL. This is an MPI application that does IO from multiple clients at the same time. Cheers, Andreas -- Andreas Dilger Sr. Software Engineer, Lustre Group Sun Microsystems of Canada, Inc. _______________________________________________ Lustre-discuss mailing list Lustre-discuss at clusterfs.com https://mail.clusterfs.com/mailman/listinfo/lustre-discuss
On Oct 31, 2007 11:04 +0900, Kazuki Ohara wrote:> I want to use Lustre with the combination of x86_64 servers and PowerPC > clients and noticed that it still have some bugs concerned with endian. > So I am anxious about the stability of Lustre in the cross-endian environment > and want to do some function tests like acceptance-small.sh or sanity.sh > included in Lustre but not only for single client environment before > performance tests. If you know some useful ways for such purpose, please tell.If you encounter any bugs related to client endianness, please file a report in bugzilla. We do not currently test big-endian servers, but having reports of the known problems would still be useful. Cheers, Andreas -- Andreas Dilger Sr. Software Engineer, Lustre Group Sun Microsystems of Canada, Inc.
Andreas Dilger wrote:> On Oct 31, 2007 11:04 +0900, Kazuki Ohara wrote: >> I want to use Lustre with the combination of x86_64 servers and PowerPC >> clients and noticed that it still have some bugs concerned with endian. >> So I am anxious about the stability of Lustre in the cross-endian environment >> and want to do some function tests like acceptance-small.sh or sanity.sh >> included in Lustre but not only for single client environment before >> performance tests. If you know some useful ways for such purpose, please tell. > > If you encounter any bugs related to client endianness, please file a report > in bugzilla. We do not currently test big-endian servers, but having reports > of the known problems would still be useful. >I have just filed it as #14042 and #14044. Best regards, Kazuki Ohara
Kazuki Ohara wrote:> Hi, > Thank you all. > > I want to use Lustre with the combination of x86_64 servers and PowerPC clients > and noticed that it still have some bugs concerned with endian. > So I am anxious about the stability of Lustre in the cross-endian environment > and want to do some function tests like acceptance-small.sh or sanity.sh included > in Lustre but not only for single client environment before performance tests. > If you know some useful ways for such purpose, please tell me.Iozone has been mentioned, it''s a good test. The lustre-iokit (available on our download site under Tools) may be useful. It includes a script for running IOR (ior-survey) and our obdfilter-survey script which will drive IO without a full Lustre filesystem. cliffw> > Best regards, > Kazuki Ohara > > _______________________________________________ > Lustre-discuss mailing list > Lustre-discuss at clusterfs.com > https://mail.clusterfs.com/mailman/listinfo/lustre-discuss
Hi, thank you all, but.. The test I want to do is function tests for stability evaluation but not for performance test. I know stress tests such as benchmark programs are also useful for stability evaluation purpose, but, I am searching more specialized tools that evaluate the stability under multi client, simultaneous accesses. For example, sanity.sh, provided by Lustre, only evaluates single client environment but I would like to have similar programs do the same for multi client, simultaneous accesses. If someone knows such tool, please let me know. Regards, Kazuki Ohara