Hi Guys, I would like to monitor the performance and usage of my Lustre filesystem and was wondering what are the commonly used monitoring tools for this? Cacti? Nagios? Any input would be greatly appreciated. Regards, -Simran -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.lustre.org/pipermail/lustre-discuss/attachments/20100106/c45e5a90/attachment.html
Jagga Soorma wrote:> Hi Guys, > > I would like to monitor the performance and usage of my Lustre > filesystem and was wondering what are the commonly used monitoring tools > for this? Cacti? Nagios? Any input would be greatly appreciated. > > Regards, > -Simran >LLNL''s LMT tool is very good. It''s available on Sourceforge, afaik. cliffw> > ------------------------------------------------------------------------ > > _______________________________________________ > Lustre-discuss mailing list > Lustre-discuss at lists.lustre.org > http://lists.lustre.org/mailman/listinfo/lustre-discuss
Last time I checked, LMT was designed for Lustre 1.4. LLNL stopped development of LMT some time ago. Not sure if LMT will work with Lustre 1.8. If somebody has tried, please let everyone know. jab -----Original Message----- From: lustre-discuss-bounces at lists.lustre.org [mailto:lustre-discuss-bounces at lists.lustre.org] On Behalf Of Cliff White Sent: Wednesday, January 06, 2010 11:12 AM To: Jagga Soorma Cc: lustre-discuss at lists.lustre.org Subject: Re: [Lustre-discuss] Lustre Monitoring Tools Jagga Soorma wrote:> Hi Guys, > > I would like to monitor the performance and usage of my Lustre > filesystem and was wondering what are the commonly used monitoring tools > for this? Cacti? Nagios? Any input would be greatly appreciated. > > Regards, > -Simran >LLNL''s LMT tool is very good. It''s available on Sourceforge, afaik. cliffw> > ------------------------------------------------------------------------ > > _______________________________________________ > Lustre-discuss mailing list > Lustre-discuss at lists.lustre.org > http://lists.lustre.org/mailman/listinfo/lustre-discuss_______________________________________________ Lustre-discuss mailing list Lustre-discuss at lists.lustre.org http://lists.lustre.org/mailman/listinfo/lustre-discuss
Jeffrey Bennett wrote:> Last time I checked, LMT was designed for Lustre 1.4. LLNL stopped development of LMT some time ago. Not sure if LMT will work with Lustre 1.8. If somebody has tried, please let everyone know. >Ah, it has moved to Google: http://code.google.com/p/lmt/ "The current release has been tested with Lustre 1.6.6." So, yup, seems a bit old. But might be worth looking into. cliffw> jab > > > -----Original Message----- > From: lustre-discuss-bounces at lists.lustre.org [mailto:lustre-discuss-bounces at lists.lustre.org] On Behalf Of Cliff White > Sent: Wednesday, January 06, 2010 11:12 AM > To: Jagga Soorma > Cc: lustre-discuss at lists.lustre.org > Subject: Re: [Lustre-discuss] Lustre Monitoring Tools > > Jagga Soorma wrote: >> Hi Guys, >> >> I would like to monitor the performance and usage of my Lustre >> filesystem and was wondering what are the commonly used monitoring tools >> for this? Cacti? Nagios? Any input would be greatly appreciated. >> >> Regards, >> -Simran >> > > LLNL''s LMT tool is very good. It''s available on Sourceforge, afaik. > cliffw > >> ------------------------------------------------------------------------ >> >> _______________________________________________ >> Lustre-discuss mailing list >> Lustre-discuss at lists.lustre.org >> http://lists.lustre.org/mailman/listinfo/lustre-discuss > > _______________________________________________ > Lustre-discuss mailing list > Lustre-discuss at lists.lustre.org > http://lists.lustre.org/mailman/listinfo/lustre-discuss
I''m using LMT with 1.8 on our test system and it seems to be OK. We''re still 1.6.6 in production so it hasn''t been extensively tested with 1.8. Jim On Wed, Jan 06, 2010 at 11:23:54AM -0800, Cliff White wrote:> Jeffrey Bennett wrote: > > Last time I checked, LMT was designed for Lustre 1.4. LLNL stopped development of LMT some time ago. Not sure if LMT will work with Lustre 1.8. If somebody has tried, please let everyone know. > > > > Ah, it has moved to Google: > http://code.google.com/p/lmt/ > > "The current release has been tested with Lustre 1.6.6." > So, yup, seems a bit old. But might be worth looking into. > cliffw > > > jab > > > > > > -----Original Message----- > > From: lustre-discuss-bounces at lists.lustre.org [mailto:lustre-discuss-bounces at lists.lustre.org] On Behalf Of Cliff White > > Sent: Wednesday, January 06, 2010 11:12 AM > > To: Jagga Soorma > > Cc: lustre-discuss at lists.lustre.org > > Subject: Re: [Lustre-discuss] Lustre Monitoring Tools > > > > Jagga Soorma wrote: > >> Hi Guys, > >> > >> I would like to monitor the performance and usage of my Lustre > >> filesystem and was wondering what are the commonly used monitoring tools > >> for this? Cacti? Nagios? Any input would be greatly appreciated. > >> > >> Regards, > >> -Simran > >> > > > > LLNL''s LMT tool is very good. It''s available on Sourceforge, afaik. > > cliffw > > > >> ------------------------------------------------------------------------ > >> > >> _______________________________________________ > >> Lustre-discuss mailing list > >> Lustre-discuss at lists.lustre.org > >> http://*lists.lustre.org/mailman/listinfo/lustre-discuss > > > > _______________________________________________ > > Lustre-discuss mailing list > > Lustre-discuss at lists.lustre.org > > http://*lists.lustre.org/mailman/listinfo/lustre-discuss > > _______________________________________________ > Lustre-discuss mailing list > Lustre-discuss at lists.lustre.org > http://*lists.lustre.org/mailman/listinfo/lustre-discuss
I have it running on 1.8. 1.1. It works well. I had to edit the SQL it generated though. Erik On Wed, Jan 6, 2010 at 2:37 PM, Jim Garlick <garlick at llnl.gov> wrote:> I''m using LMT with 1.8 on our test system and it seems to be OK. > We''re still 1.6.6 in production so it hasn''t been extensively tested with > 1.8. > > Jim > > On Wed, Jan 06, 2010 at 11:23:54AM -0800, Cliff White wrote: > > Jeffrey Bennett wrote: > > > Last time I checked, LMT was designed for Lustre 1.4. LLNL stopped > development of LMT some time ago. Not sure if LMT will work with Lustre 1.8. > If somebody has tried, please let everyone know. > > > > > > > Ah, it has moved to Google: > > http://code.google.com/p/lmt/ > > > > "The current release has been tested with Lustre 1.6.6." > > So, yup, seems a bit old. But might be worth looking into. > > cliffw > > > > > jab > > > > > > > > > -----Original Message----- > > > From: lustre-discuss-bounces at lists.lustre.org [mailto: > lustre-discuss-bounces at lists.lustre.org] On Behalf Of Cliff White > > > Sent: Wednesday, January 06, 2010 11:12 AM > > > To: Jagga Soorma > > > Cc: lustre-discuss at lists.lustre.org > > > Subject: Re: [Lustre-discuss] Lustre Monitoring Tools > > > > > > Jagga Soorma wrote: > > >> Hi Guys, > > >> > > >> I would like to monitor the performance and usage of my Lustre > > >> filesystem and was wondering what are the commonly used monitoring > tools > > >> for this? Cacti? Nagios? Any input would be greatly appreciated. > > >> > > >> Regards, > > >> -Simran > > >> > > > > > > LLNL''s LMT tool is very good. It''s available on Sourceforge, afaik. > > > cliffw > > > > > >> > ------------------------------------------------------------------------ > > >> > > >> _______________________________________________ > > >> Lustre-discuss mailing list > > >> Lustre-discuss at lists.lustre.org > > >> http://*lists.lustre.org/mailman/listinfo/lustre-discuss > > > > > > _______________________________________________ > > > Lustre-discuss mailing list > > > Lustre-discuss at lists.lustre.org > > > http://*lists.lustre.org/mailman/listinfo/lustre-discuss > > > > _______________________________________________ > > Lustre-discuss mailing list > > Lustre-discuss at lists.lustre.org > > http://*lists.lustre.org/mailman/listinfo/lustre-discuss > _______________________________________________ > Lustre-discuss mailing list > Lustre-discuss at lists.lustre.org > http://lists.lustre.org/mailman/listinfo/lustre-discuss >-------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.lustre.org/pipermail/lustre-discuss/attachments/20100107/3063dece/attachment.html
Hi Erik, Can you post your changes so that other members on the alias can use it as well? Cheers, _Atul Erik Froese wrote:> I have it running on 1.8. 1.1. It works well. I had to edit the SQL it > generated though. > Erik > > On Wed, Jan 6, 2010 at 2:37 PM, Jim Garlick <garlick at llnl.gov > <mailto:garlick at llnl.gov>> wrote: > > I''m using LMT with 1.8 on our test system and it seems to be OK. > We''re still 1.6.6 in production so it hasn''t been extensively > tested with 1.8. > > Jim > > On Wed, Jan 06, 2010 at 11:23:54AM -0800, Cliff White wrote: > > Jeffrey Bennett wrote: > > > Last time I checked, LMT was designed for Lustre 1.4. LLNL > stopped development of LMT some time ago. Not sure if LMT will > work with Lustre 1.8. If somebody has tried, please let everyone know. > > > > > > > Ah, it has moved to Google: > > http://code.google.com/p/lmt/ > > > > "The current release has been tested with Lustre 1.6.6." > > So, yup, seems a bit old. But might be worth looking into. > > cliffw > > > > > jab > > > > > > > > > -----Original Message----- > > > From: lustre-discuss-bounces at lists.lustre.org > <mailto:lustre-discuss-bounces at lists.lustre.org> > [mailto:lustre-discuss-bounces at lists.lustre.org > <mailto:lustre-discuss-bounces at lists.lustre.org>] On Behalf Of > Cliff White > > > Sent: Wednesday, January 06, 2010 11:12 AM > > > To: Jagga Soorma > > > Cc: lustre-discuss at lists.lustre.org > <mailto:lustre-discuss at lists.lustre.org> > > > Subject: Re: [Lustre-discuss] Lustre Monitoring Tools > > > > > > Jagga Soorma wrote: > > >> Hi Guys, > > >> > > >> I would like to monitor the performance and usage of my Lustre > > >> filesystem and was wondering what are the commonly used > monitoring tools > > >> for this? Cacti? Nagios? Any input would be greatly > appreciated. > > >> > > >> Regards, > > >> -Simran > > >> > > > > > > LLNL''s LMT tool is very good. It''s available on Sourceforge, > afaik. > > > cliffw > > > > > >> > ------------------------------------------------------------------------ > > >> > > >> _______________________________________________ > > >> Lustre-discuss mailing list > > >> Lustre-discuss at lists.lustre.org > <mailto:Lustre-discuss at lists.lustre.org> > > >> http://*lists.lustre.org/mailman/listinfo/lustre-discuss > <http://lists.lustre.org/mailman/listinfo/lustre-discuss> > > > > > > _______________________________________________ > > > Lustre-discuss mailing list > > > Lustre-discuss at lists.lustre.org > <mailto:Lustre-discuss at lists.lustre.org> > > > http://*lists.lustre.org/mailman/listinfo/lustre-discuss > <http://lists.lustre.org/mailman/listinfo/lustre-discuss> > > > > _______________________________________________ > > Lustre-discuss mailing list > > Lustre-discuss at lists.lustre.org > <mailto:Lustre-discuss at lists.lustre.org> > > http://*lists.lustre.org/mailman/listinfo/lustre-discuss > <http://lists.lustre.org/mailman/listinfo/lustre-discuss> > _______________________________________________ > Lustre-discuss mailing list > Lustre-discuss at lists.lustre.org > <mailto:Lustre-discuss at lists.lustre.org> > http://lists.lustre.org/mailman/listinfo/lustre-discuss > > > ------------------------------------------------------------------------ > > _______________________________________________ > Lustre-discuss mailing list > Lustre-discuss at lists.lustre.org > http://lists.lustre.org/mailman/listinfo/lustre-discuss >
Hey Atul, I just edited the generated SQL according to what the create_lmtconfig script generated for a smaller Lustre system. It''s fairly straightforward. Just keep checking against cererbro-stat for what it reports for hsotname and OST names. Also turning on mysql query logging was a big help as it showed what cerebro was trying to insert. I''ve attached my lmt config with the generated and edited sql files. On Thu, Jan 7, 2010 at 9:36 PM, Atul Vidwansa <Atul.Vidwansa at sun.com> wrote:> Hi Erik, > > Can you post your changes so that other members on the alias can use it as > well? > > Cheers, > _Atul > > Erik Froese wrote: > >> I have it running on 1.8. 1.1. It works well. I had to edit the SQL it >> generated though. >> Erik >> >> On Wed, Jan 6, 2010 at 2:37 PM, Jim Garlick <garlick at llnl.gov <mailto: >> garlick at llnl.gov>> wrote: >> >> I''m using LMT with 1.8 on our test system and it seems to be OK. >> We''re still 1.6.6 in production so it hasn''t been extensively >> tested with 1.8. >> >> Jim >> >> On Wed, Jan 06, 2010 at 11:23:54AM -0800, Cliff White wrote: >> > Jeffrey Bennett wrote: >> > > Last time I checked, LMT was designed for Lustre 1.4. LLNL >> stopped development of LMT some time ago. Not sure if LMT will >> work with Lustre 1.8. If somebody has tried, please let everyone know. >> > > >> > >> > Ah, it has moved to Google: >> > http://code.google.com/p/lmt/ >> > >> > "The current release has been tested with Lustre 1.6.6." >> > So, yup, seems a bit old. But might be worth looking into. >> > cliffw >> > >> > > jab >> > > >> > > >> > > -----Original Message----- >> > > From: lustre-discuss-bounces at lists.lustre.org >> <mailto:lustre-discuss-bounces at lists.lustre.org> >> [mailto:lustre-discuss-bounces at lists.lustre.org >> <mailto:lustre-discuss-bounces at lists.lustre.org>] On Behalf Of >> Cliff White >> > > Sent: Wednesday, January 06, 2010 11:12 AM >> > > To: Jagga Soorma >> > > Cc: lustre-discuss at lists.lustre.org >> <mailto:lustre-discuss at lists.lustre.org> >> > > Subject: Re: [Lustre-discuss] Lustre Monitoring Tools >> > > >> > > Jagga Soorma wrote: >> > >> Hi Guys, >> > >> >> > >> I would like to monitor the performance and usage of my Lustre >> > >> filesystem and was wondering what are the commonly used >> monitoring tools >> > >> for this? Cacti? Nagios? Any input would be greatly >> appreciated. >> > >> >> > >> Regards, >> > >> -Simran >> > >> >> > > >> > > LLNL''s LMT tool is very good. It''s available on Sourceforge, >> afaik. >> > > cliffw >> > > >> > >> >> >> ------------------------------------------------------------------------ >> > >> >> > >> _______________________________________________ >> > >> Lustre-discuss mailing list >> > >> Lustre-discuss at lists.lustre.org >> <mailto:Lustre-discuss at lists.lustre.org> >> >> > >> http://*lists.lustre.org/mailman/listinfo/lustre-discuss >> <http://lists.lustre.org/mailman/listinfo/lustre-discuss> >> > > >> > > _______________________________________________ >> > > Lustre-discuss mailing list >> > > Lustre-discuss at lists.lustre.org >> <mailto:Lustre-discuss at lists.lustre.org> >> >> > > http://*lists.lustre.org/mailman/listinfo/lustre-discuss >> <http://lists.lustre.org/mailman/listinfo/lustre-discuss> >> > >> > _______________________________________________ >> > Lustre-discuss mailing list >> > Lustre-discuss at lists.lustre.org >> <mailto:Lustre-discuss at lists.lustre.org> >> >> > http://*lists.lustre.org/mailman/listinfo/lustre-discuss >> <http://lists.lustre.org/mailman/listinfo/lustre-discuss> >> _______________________________________________ >> Lustre-discuss mailing list >> Lustre-discuss at lists.lustre.org >> <mailto:Lustre-discuss at lists.lustre.org> >> >> http://lists.lustre.org/mailman/listinfo/lustre-discuss >> >> >> ------------------------------------------------------------------------ >> >> _______________________________________________ >> Lustre-discuss mailing list >> Lustre-discuss at lists.lustre.org >> http://lists.lustre.org/mailman/listinfo/lustre-discuss >> >> > >-------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.lustre.org/pipermail/lustre-discuss/attachments/20100114/523d9c0e/attachment-0001.html -------------- next part -------------- A non-text attachment was scrubbed... Name: lmt-setup.tgz Type: application/x-gzip Size: 6245 bytes Desc: not available Url : http://lists.lustre.org/pipermail/lustre-discuss/attachments/20100114/523d9c0e/attachment-0001.tgz