hi everyone,
I am a student at Georgia Tech university, and as a
part of a project i need to benchmark lustre file system. I did a lot of
searching regarding
the possible benchmark, but i need some advice on which benchmarks would be
more suitable... if any one can post a sugesstion that would be really
helpful.......................
thanks in advance ............
Mayur
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
http://lists.lustre.org/pipermail/lustre-discuss/attachments/20080211/cc0b55f7/attachment-0002.html
What kind of benchmarks are you looking for? Throughput? IOPS? What kind of hardware do you have to benchmark a filesystem on? I could probably help you run some tests on my setup if you were interested. The tools I use are bonnie and iozone and theres another too but I can''t think of the name. I think it''s xdd or something like that. -Aaron On Feb 11, 2008, at 11:21 AM, mayur bhosle wrote:> hi everyone, > > I am a student at Georgia Tech university, > and as a part of a project i need to benchmark lustre file system. I > did a lot of searching regarding > the possible benchmark, but i need some advice on which benchmarks > would be more suitable... if any one can post a sugesstion that > would be really helpful....................... > > thanks in advance ............ > > Mayur > _______________________________________________ > Lustre-discuss mailing list > Lustre-discuss at lists.lustre.org > http://lists.lustre.org/mailman/listinfo/lustre-discussAaron Knister Associate Systems Analyst Center for Ocean-Land-Atmosphere Studies (301) 595-7000 aaron at iges.org
On Mon, 2008-02-11 at 11:21 -0500, mayur bhosle wrote:> hi everyone, > > I am a student at Georgia Tech university, and > as a part of a project i need to benchmark lustre file system. I did a > lot of searching regarding > the possible benchmark, but i need some advice on which benchmarks > would be more suitable... if any one can post a sugesstion that would > be really helpful.......................In our environment, I used iozone to benchmark our bonded gigE OSTs. iozone -t1 -i0 -il -r4m -s2g You can change -s2g to -s1g or -s512m to benchmark reads and writes to different sizes of files. We tuned our system for large files since we place the NCBI databases in /lustre and access them directly within /lustre. -- Jeremy Mann jeremy at biochem.uthscsa.edu University of Texas Health Science Center Bioinformatics Core Facility http://www.bioinformatics.uthscsa.edu Phone: 210-567-2672
We tend to use IOR from http://sourceforge.net/projects/ior-sio/ Some tests, how we used it, and data available at http://www.cs.sandia.gov/rsiopa/ --Lee On Mon, 2008-02-11 at 09:30 -0700, Jeremy Mann wrote:> On Mon, 2008-02-11 at 11:21 -0500, mayur bhosle wrote: > > hi everyone, > > > > I am a student at Georgia Tech university, and > > as a part of a project i need to benchmark lustre file system. I did a > > lot of searching regarding > > the possible benchmark, but i need some advice on which benchmarks > > would be more suitable... if any one can post a sugesstion that would > > be really helpful....................... > > In our environment, I used iozone to benchmark our bonded gigE OSTs. > > iozone -t1 -i0 -il -r4m -s2g > > You can change -s2g to -s1g or -s512m to benchmark reads and writes to > different sizes of files. We tuned our system for large files since we > place the NCBI databases in /lustre and access them directly > within /lustre. > > -- > Jeremy Mann > jeremy at biochem.uthscsa.edu > > University of Texas Health Science Center > Bioinformatics Core Facility > http://www.bioinformatics.uthscsa.edu > Phone: 210-567-2672 > > _______________________________________________ > Lustre-discuss mailing list > Lustre-discuss at lists.lustre.org > http://lists.lustre.org/mailman/listinfo/lustre-discuss >
Do you have any special interests, like: writing from a true MPI job; collective vs. independent; one-file-per-processor vs. a single, share file; or writing via MPI-IO vs. posix? Marty Barnaby mayur bhosle wrote:> hi everyone, > > I am a student at Georgia Tech university, and > as a part of a project i need to benchmark lustre file system. I did a > lot of searching regarding > the possible benchmark, but i need some advice on which benchmarks > would be more suitable... if any one can post a sugesstion that would > be really helpful....................... > > thanks in advance ............ > > Mayur
The compilebench is a good compile test tool using by lustre testing, download from http://oss.oracle.com/~mason/compilebench/ -- Jack Chen mayur bhosle wrote:> hi everyone, > > I am a student at Georgia Tech university, and > as a part of a project i need to benchmark lustre file system. I did a > lot of searching regarding > the possible benchmark, but i need some advice on which benchmarks > would be more suitable... if any one can post a sugesstion that would > be really helpful....................... > > thanks in advance ............ > > Mayur > ------------------------------------------------------------------------ > > _______________________________________________ > Lustre-discuss mailing list > Lustre-discuss at lists.lustre.org > http://lists.lustre.org/mailman/listinfo/lustre-discuss >