Andreas Dilger
2011-Feb-24 01:37 UTC
[Lustre-discuss] Update of PDSI filesystem stats data
When looking at how to implement features for Lustre (which I''m doing a lot of recently :-) I somtimes consult the PDSI filesystem statistics data at http://www.pdsi-scidac.org/fsstats/ in order to see how these large filesystems are used in real life. Information like the length of filenames, how many files have hard links, the age of files in the filesystem, etc are useful in deciding where to optimize the implementation. Unfortunately, the filesystem surveys there are starting to get a bit dated (the most recent one is almost 3 years old, and the largest filesystems are only ~300TB in size). I want to solicit the Lustre user community to contribute some updated statistics, and have confirmed with Garth Gibson (leader of the PDSI workshops and maintainer of that site) that it is still worthwhile to send updated statistics using the http://www.pdsi-scidac.org/fsstats/questionnaire.html form. Garth will look at getting some grad students to compile the submitted data, and is particularly interested if anyone has updated data for any filesystem they previously submitted (PNNL, PSC). In the meantime, I would also appreciate an email with the results as well. Thanks in advance for any contributions. Cheers, Andreas -- Andreas Dilger Principal Engineer Whamcloud, Inc.
i hope one of the new features you are going to implement is SNS :-) On Wed, Feb 23, 2011 at 8:37 PM, Andreas Dilger <adilger at whamcloud.com> wrote:> When looking at how to implement features for Lustre (which I''m doing a lot of recently :-) I somtimes consult the PDSI filesystem statistics data at http://www.pdsi-scidac.org/fsstats/ in order to see how these large filesystems are used in real life. ?Information like the length of filenames, how many files have hard links, the age of files in the filesystem, etc are useful in deciding where to optimize the implementation. > > Unfortunately, the filesystem surveys there are starting to get a bit dated (the most recent one is almost 3 years old, and the largest filesystems are only ~300TB in size). > > I want to solicit the Lustre user community to contribute some updated statistics, and have confirmed with Garth Gibson (leader of the PDSI workshops and maintainer of that site) that it is still worthwhile to send updated statistics using the http://www.pdsi-scidac.org/fsstats/questionnaire.html form. > > Garth will look at getting some grad students to compile the submitted data, and is particularly interested if anyone has updated data for any filesystem they previously submitted (PNNL, PSC). ?In the meantime, I would also appreciate an email with the results as well. > > Thanks in advance for any contributions. > > Cheers, Andreas > -- > Andreas Dilger > Principal Engineer > Whamcloud, Inc. > > > > _______________________________________________ > Lustre-discuss mailing list > Lustre-discuss at lists.lustre.org > http://lists.lustre.org/mailman/listinfo/lustre-discuss >