Lustre discuss - Jul 2008 - Which benchmark do you use for lustre?

Hi,

I wanted to know Lustre users choice of benchmarks? Which tool do you 
often use to evaluate performance of Lustre?

Cheers,
-Atul

I have used IOR and sg_dd.

IOR gives more flexibility and options

On Jul 2, 11:42 am, Atul Vidwansa <Atul.Vidwa... at Sun.COM>
wrote:
> Hi,
>
> I wanted to know Lustre users choice of benchmarks? Which tool do you
> often use to evaluate performance of Lustre?
>
> Cheers,
> -Atul
>
> _______________________________________________
> Lustre-discuss mailing list
> Lustre-disc... at
lists.lustre.orghttp://lists.lustre.org/mailman/listinfo/lustre-discuss

Depends on what you are testing, actually.


For metadata testing, we use the "mdtest" tool. Also, the small tests
scripts delivered under the Lustre test collection (e.g. creatmany) or
kernel source tree tar/untar operations or simply building a kernel come
handy as benchmarks when stressing the MDS.

For large block I/O testing we use "xdd," "IOR," or
"sgp_dd" tools.


Sarp




On 7/2/08 2:42 AM, "Atul Vidwansa" <Atul.Vidwansa at Sun.COM>
wrote:
> Hi,
> 
> I wanted to know Lustre users choice of benchmarks? Which tool do you
> often use to evaluate performance of Lustre?
> 
> Cheers,
> -Atul
> 
> _______________________________________________
> Lustre-discuss mailing list
> Lustre-discuss at lists.lustre.org
> http://lists.lustre.org/mailman/listinfo/lustre-discuss

and of course you run collect (see - http://collectl.sourceforge.net/) 
at the same time in another window, right?  also see 
http://collectl.sourceforge.net/Tutorial-Lustre.html and if you use an 
infiniband interconnect you can monitor that at the same time as well.

I think the biggest problem with most benchmark tools when run by 
themselves is they tend to report a summary of MB/sec, IOs/sec or 
whatever else they''re measuring but isn''t it just as important
to look
at what''s happening in between?  that''s what collectl is all
about.  It
doesn''t exercise the system but rather tells you what it''s
doing at any
point in time, which can be as often as once a second (or even less!) if 
you so choose.

-mark

Oral, H. Sarp (oad) wrote:
> Depends on what you are testing, actually.
>
>
> For metadata testing, we use the "mdtest" tool. Also, the small
tests
> scripts delivered under the Lustre test collection (e.g. creatmany) or
> kernel source tree tar/untar operations or simply building a kernel come
> handy as benchmarks when stressing the MDS.
>
> For large block I/O testing we use "xdd," "IOR," or
"sgp_dd" tools.
>
>
> Sarp
>
>
>
>
> On 7/2/08 2:42 AM, "Atul Vidwansa" <Atul.Vidwansa at
Sun.COM> wrote:
>
>   
>> Hi,
>>
>> I wanted to know Lustre users choice of benchmarks? Which tool do you
>> often use to evaluate performance of Lustre?
>>
>> Cheers,
>> -Atul
>>
>> _______________________________________________
>> Lustre-discuss mailing list
>> Lustre-discuss at lists.lustre.org
>> http://lists.lustre.org/mailman/listinfo/lustre-discuss
>>     
>
> _______________________________________________
> Lustre-discuss mailing list
> Lustre-discuss at lists.lustre.org
> http://lists.lustre.org/mailman/listinfo/lustre-discuss
>

I have migrated to IOR for maximal and special case byte-rate 
performance in writing from an MPI job.

In the benchmarking discussion, some people are interested in file 
opens, accesses and other types of operations metrics, for which they 
have other utilities.

Marty Barnaby


Dhruv wrote:
> I have used IOR and sg_dd.
>
> IOR gives more flexibility and options
>
> On Jul 2, 11:42 am, Atul Vidwansa <Atul.Vidwa... at Sun.COM> wrote:
>   
>> Hi,
>>
>> I wanted to know Lustre users choice of benchmarks? Which tool do you
>> often use to evaluate performance of Lustre?
>>
>> Cheers,
>> -Atul
>>
>> _______________________________________________
>> Lustre-discuss mailing list
>> Lustre-disc... at
lists.lustre.orghttp://lists.lustre.org/mailman/listinfo/lustre-discuss
>>     
> _______________________________________________
> Lustre-discuss mailing list
> Lustre-discuss at lists.lustre.org
> http://lists.lustre.org/mailman/listinfo/lustre-discuss
>
>   
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
http://lists.lustre.org/pipermail/lustre-discuss/attachments/20080702/246d8761/attachment.html