Hi all, we''re planning to enable quota on our Lustre file systems running with version 1.8.4. We like to estimate the downtime needed to run quotacheck. Does anyone can give an estimation how long the ''quotacheck'' will execute for the following configuration: -1- 1 x FS with 800 TB (approximately 43,000,000 i-nodes) -2- 14 x FS with 29 TB (approximately 5,000,000 i-nodes) Many thanks in advance Cheers -Frank Heckes ------------------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------------------ Forschungszentrum Juelich GmbH 52425 Juelich Sitz der Gesellschaft: Juelich Eingetragen im Handelsregister des Amtsgerichts Dueren Nr. HR B 3498 Vorsitzender des Aufsichtsrats: MinDirig Dr. Karl Eugen Huthmacher Geschaeftsfuehrung: Prof. Dr. Achim Bachem (Vorsitzender), Dr. Ulrich Krafft (stellv. Vorsitzender), Prof. Dr.-Ing. Harald Bolt, Prof. Dr. Sebastian M. Schmidt ------------------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------------------ Besuchen Sie uns auf unserem neuen Webauftritt unter www.fz-juelich.de
On 15/06/11 13:14, Frank Heckes wrote:> Hi all, > > we''re planning to enable quota on our Lustre file systems running with > version 1.8.4. We like to estimate the downtime needed to run > quotacheck. >Hi, We recently did a quotacheck on a 40M inodes used / 160 TB used filesystem. It took ~20 mins. (DDN 9900 backend storage). Cheers, Guy -- Dr. Guy Coates, Informatics Systems Group The Wellcome Trust Sanger Institute, Hinxton, Cambridge, CB10 1HH, UK Tel: +44 (0)1223 834244 x 6925 Fax: +44 (0)1223 496802 -- The Wellcome Trust Sanger Institute is operated by Genome Research Limited, a charity registered in England with number 1021457 and a company registered in England with number 2742969, whose registered office is 215 Euston Road, London, NW1 2BE.
On Wed, Jun 15, 2011 at 01:30:08PM +0100, Guy Coates wrote:> On 15/06/11 13:14, Frank Heckes wrote: > > Hi all, > > > > we''re planning to enable quota on our Lustre file systems running with > > version 1.8.4. We like to estimate the downtime needed to run > > quotacheck. > > > > > Hi, > > We recently did a quotacheck on a 40M inodes used / 160 TB used > filesystem. It took ~20 mins. (DDN 9900 backend storage).Hi, I can report similar values: With 20M inodes used / 100 TB used lfs quotacheck on a Lustre 1.8.4 filesystem took ~10 mins. Backend storage of this filesystem is HP MSA2000. Regards, Roland -- Karlsruhe Institute of Technology (KIT) Steinbuch Centre for Computing (SCC) Roland Laifer Scientific Computing Services (SCS) Zirkel 2, Building 20.21, Room 209 76131 Karlsruhe, Germany Phone: +49 721 608 44861 Fax: +49 721 32550 Email: roland.laifer at kit.edu Web: http://www.scc.kit.edu KIT ? University of the State of Baden-Wuerttemberg and National Laboratory of the Helmholtz Association
On 16.Jun.11 10:15 +0200, Roland Laifer wrote:> > We recently did a quotacheck on a 40M inodes used / 160 TB used > > filesystem. It took ~20 mins. (DDN 9900 backend storage). > > I can report similar values: With 20M inodes used / 100 TB used > lfs quotacheck on a Lustre 1.8.4 filesystem took ~10 mins. > Backend storage of this filesystem is HP MSA2000. >Thanks for your input. Yesterday we quotachecked two file systems and were really surprised by these timings: A: ~8TB, ~2M inodes, 30 sec B: ~29TB, ~6M inodes, 160 sec lustre 1.8.4 storage: OSTs: JBODs with software raid6, MDT: EMC^2 CX-240 Cheers, ------------------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------------------ Forschungszentrum Juelich GmbH 52425 Juelich Sitz der Gesellschaft: Juelich Eingetragen im Handelsregister des Amtsgerichts Dueren Nr. HR B 3498 Vorsitzender des Aufsichtsrats: MinDirig Dr. Karl Eugen Huthmacher Geschaeftsfuehrung: Prof. Dr. Achim Bachem (Vorsitzender), Dr. Ulrich Krafft (stellv. Vorsitzender), Prof. Dr.-Ing. Harald Bolt, Prof. Dr. Sebastian M. Schmidt ------------------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------------------ Besuchen Sie uns auf unserem neuen Webauftritt unter www.fz-juelich.de