David Spisla
2017-Apr-12 14:41 UTC
[Gluster-users] GlusterFS Shard Feature: Max number of files in .shard-Folder
Dear Gluster-Community, If I use the shard feature it may happen that I will have a huge number of shard-chunks in the hidden folder .shard Does anybody has some experience what is the maximum number of files in one .shard-Folder? If I have 1 Million files in such a folder, some operations like self-healing or another internal operations would need a lot of time, I guess. Sincerely David Spisla Software Developer david.spisla at iTernity.com<mailto:david.spisla at iTernity.com> www.iTernity.com<http://www.iternity.com/> Tel: +49 761-590 34 841 [cid:image001.png at 01D239C7.FDF7B430] iTernity GmbH Heinrich-von-Stephan-Str. 21 79100 Freiburg - Germany --- unseren technischen Support erreichen Sie unter +49 761-387 36 66 --- Gesch?ftsf?hrer: Ralf Steinemann Eingetragen beim Amtsgericht Freiburg: HRB-Nr. 701332 USt.Id de-24266431 -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.gluster.org/pipermail/gluster-users/attachments/20170412/231ecc30/attachment.html> -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 6259 bytes Desc: image001.png URL: <http://lists.gluster.org/pipermail/gluster-users/attachments/20170412/231ecc30/attachment.png>
Pranith Kumar Karampuri
2017-Apr-22 06:51 UTC
[Gluster-users] GlusterFS Shard Feature: Max number of files in .shard-Folder
Sorry for the delay. The only internal process that we know would take more time is self-heal and we implemented a feature called granular entry self-heal which should be enabled with sharded volumes to get the benefits. So when a brick goes down and say only 1 in those million entries is created/deleted. Self-heal would be done for only that file it won't crawl the entire directory. On Wed, Apr 12, 2017 at 8:11 PM, David Spisla <david.spisla at iternity.com> wrote:> Dear Gluster-Community, > > > > If I use the shard feature it may happen that I will have a huge number of > shard-chunks in the hidden folder .shard > > Does anybody has some experience what is the maximum number of files in > one .shard-Folder? > > > > If I have 1 Million files in such a folder, some operations like > self-healing or another internal operations would need > > a lot of time, I guess. > > > > Sincerely > > > > > > *David Spisla* > > Software Developer > > david.spisla at iTernity.com > > www.iTernity.com <http://www.iternity.com/> > > Tel: +49 761-590 34 841 > > > > [image: cid:image001.png at 01D239C7.FDF7B430] > > > > iTernity GmbH > Heinrich-von-Stephan-Str. 21 > 79100 Freiburg ? Germany > --- > unseren technischen Support erreichen Sie unter +49 761-387 36 66 > --- > > Gesch?ftsf?hrer: Ralf Steinemann > Eingetragen beim Amtsgericht Freiburg: HRB-Nr. 701332 > USt.Id de-24266431 > > > > > > _______________________________________________ > Gluster-users mailing list > Gluster-users at gluster.org > http://lists.gluster.org/mailman/listinfo/gluster-users >-- Pranith -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.gluster.org/pipermail/gluster-users/attachments/20170422/b2efba62/attachment.html> -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 6259 bytes Desc: not available URL: <http://lists.gluster.org/pipermail/gluster-users/attachments/20170422/b2efba62/attachment.png>