I think the problem here is with the ext3 format of your mds. Try setting mkfsoptions via lmc for your metadata device. I usually use -T news for the mds which creates 1 inode for every 4kbytes. You can also use -N XX to specify a fixed number of inodes. paul Jeffrey W. Baker wrote:>On Fri, 2005-03-11 at 11:18 -0500, Phil Schwan wrote: > > >>On 3/10/2005 13:55, Tim Cullen wrote: >> >> >> >>>Is there a recommended forumla for determining how >>>much disk space is needed for metadata for a given >>>amount of user data? >>> >>> >>Hi Tim-- >> >>Please see http://clusterfs.com/faq.html#install-3 and let us know if you >>have further questions. >> >> > >That FAQ doesn''t seem to answer the question, and it never really >answered any of my sizing questions either. I started with 2TiB worth >of object storage and one 34GiB MDS. Problem was I ran out of inodes. >You need to size the MDS with enough storage for as many inodes as >you''ll need x 8192 bytes. Or at least that''s what I saw (34.18GiB on >the MDS yields 4,480,448 inodes in the filesystem). > >-jwb >_______________________________________________ >Lustre-discuss mailing list >Lustre-discuss@lists.clusterfs.com >https://lists.clusterfs.com/mailman/listinfo/lustre-discuss > >
On 3/10/2005 13:55, Tim Cullen wrote:> Is there a recommended forumla for determining how > much disk space is needed for metadata for a given > amount of user data?Hi Tim-- Please see http://clusterfs.com/faq.html#install-3 and let us know if you have further questions. -p
On Fri, 2005-03-11 at 11:18 -0500, Phil Schwan wrote:> On 3/10/2005 13:55, Tim Cullen wrote: > > > Is there a recommended forumla for determining how > > much disk space is needed for metadata for a given > > amount of user data? > > Hi Tim-- > > Please see http://clusterfs.com/faq.html#install-3 and let us know if you > have further questions.That FAQ doesn''t seem to answer the question, and it never really answered any of my sizing questions either. I started with 2TiB worth of object storage and one 34GiB MDS. Problem was I ran out of inodes. You need to size the MDS with enough storage for as many inodes as you''ll need x 8192 bytes. Or at least that''s what I saw (34.18GiB on the MDS yields 4,480,448 inodes in the filesystem). -jwb
On 3/11/2005 11:45, Jeffrey W. Baker wrote:> > That FAQ doesn''t seem to answer the question, and it never really > answered any of my sizing questions either. I started with 2TiB worth > of object storage and one 34GiB MDS. Problem was I ran out of inodes. > You need to size the MDS with enough storage for as many inodes as > you''ll need x 8192 bytes. Or at least that''s what I saw (34.18GiB on > the MDS yields 4,480,448 inodes in the filesystem).Good point: it tells you that you need up to 4k per file, but doesn''t tell you that you may have to override ext3''s default inode-to-size-ratio calculations. Sorry about that. You can add mkfs options as part of your lmc --add mds command, with --mkfsoptions <foo>. So to add to what Paul said, try: lmc ... --add mds --mkfsoptions "-T news" ... or lmc ... --add mds --mkfsoptions "-N xxxxx" ... I''ll have someone update the FAQ, and perhaps we''ll make this the default on the MDS. Thanks for keeping me honest. -Phil
On Fri, 2005-03-11 at 12:14 -0500, PAulN wrote:> I think the problem here is with the ext3 format of your mds. > Try setting mkfsoptions via lmc for your metadata device. > I usually use -T news for the mds which creates 1 inode for > every 4kbytes. You can also use -N XX to specify a fixed number > of inodes. > paulExample command line? -jwb
Is there a recommended forumla for determining how much disk space is needed for metadata for a given amount of user data? thanks tim __________________________________ Do you Yahoo!? Yahoo! Small Business - Try our new resources site! http://smallbusiness.yahoo.com/resources/