Brock Palen
2010-Oct-26 19:10 UTC
[Lustre-discuss] finding clients that is opening/closing files
I have wat I think is a badly behaving user, look at /proc/fs/lustre/mds/nobackup-MDT0000/stats The open/close counters are running about 1000/s, I would like to track down what clients this is coming from and knock the users about fixing there code that are doing this. how does does look at ''stats by node'' do I need to look at all clients? Or can I get this information from the mds? Thanks! Brock Palen www.umich.edu/~brockp Center for Advanced Computing brockp at umich.edu (734)936-1985
Wojciech Turek
2010-Oct-26 19:42 UTC
[Lustre-discuss] finding clients that is opening/closing files
One way is to check the "/proc/fs/lustre/mds/*/exports/*/stats" files, which contains per-client statistics. They can be cleared by writing "0" to the file, and then check for files with lots of operations. On 26 October 2010 20:10, Brock Palen <brockp at umich.edu> wrote:> I have wat I think is a badly behaving user, look at > /proc/fs/lustre/mds/nobackup-MDT0000/stats > > The open/close counters are running about 1000/s, > > I would like to track down what clients this is coming from and knock the > users about fixing there code that are doing this. > > how does does look at ''stats by node'' do I need to look at all clients? > Or can I get this information from the mds? > Thanks! > > Brock Palen > www.umich.edu/~brockp <http://www.umich.edu/%7Ebrockp> > Center for Advanced Computing > brockp at umich.edu > (734)936-1985 > > > > _______________________________________________ > Lustre-discuss mailing list > Lustre-discuss at lists.lustre.org > http://lists.lustre.org/mailman/listinfo/lustre-discuss >-- Wojciech Turek Senior System Architect High Performance Computing Service University of Cambridge Email: wjt27 at cam.ac.uk Tel: (+)44 1223 763517 -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.lustre.org/pipermail/lustre-discuss/attachments/20101026/02ead1fe/attachment.html
Brock Palen
2010-Oct-26 19:56 UTC
[Lustre-discuss] finding clients that is opening/closing files
This was very helpful, I found the culprit. Brock Palen www.umich.edu/~brockp Center for Advanced Computing brockp at umich.edu (734)936-1985 On Oct 26, 2010, at 3:42 PM, Wojciech Turek wrote:> One way is to check the "/proc/fs/lustre/mds/*/exports/*/stats" files, which contains per-client statistics. They can be cleared by writing "0" to the file, and then check for files with lots of operations. > > > On 26 October 2010 20:10, Brock Palen <brockp at umich.edu> wrote: > I have wat I think is a badly behaving user, look at > /proc/fs/lustre/mds/nobackup-MDT0000/stats > > The open/close counters are running about 1000/s, > > I would like to track down what clients this is coming from and knock the users about fixing there code that are doing this. > > how does does look at ''stats by node'' do I need to look at all clients? Or can I get this information from the mds? > Thanks! > > Brock Palen > www.umich.edu/~brockp > Center for Advanced Computing > brockp at umich.edu > (734)936-1985 > > > > _______________________________________________ > Lustre-discuss mailing list > Lustre-discuss at lists.lustre.org > http://lists.lustre.org/mailman/listinfo/lustre-discuss > > > > -- > Wojciech Turek > > Senior System Architect > > High Performance Computing Service > University of Cambridge > Email: wjt27 at cam.ac.uk > Tel: (+)44 1223 763517
Joshua Walgenbach
2010-Oct-26 20:07 UTC
[Lustre-discuss] finding clients that is opening/closing files
You could check /proc/fs/lustre/mds/client-<MDT>/exports/<NID>/stats on your MDS. That contains per client stats for the MDS. -Josh On 10/26/10 3:10 PM, Brock Palen wrote:> I have wat I think is a badly behaving user, look at > /proc/fs/lustre/mds/nobackup-MDT0000/stats > > The open/close counters are running about 1000/s, > > I would like to track down what clients this is coming from and knock the users about fixing there code that are doing this. > > how does does look at ''stats by node'' do I need to look at all clients? Or can I get this information from the mds? > Thanks! > > Brock Palen > www.umich.edu/~brockp > Center for Advanced Computing > brockp at umich.edu > (734)936-1985 > > > > _______________________________________________ > Lustre-discuss mailing list > Lustre-discuss at lists.lustre.org > http://lists.lustre.org/mailman/listinfo/lustre-discuss