gjprabu
2015-Apr-29 12:22 UTC
[Gluster-users] client is terrible with large amount of small files
Hi Team, If anybody know the solution please share us. Regards Prabu ---- On Tue, 28 Apr 2015 19:32:40 +0530 gjprabu <gjprabu at zohocorp.com> wrote ---- Hi Team, We are using glusterfs newly and testing data transfer part in client using fuse.glusterfs file system but it is terrible with large amount of small files (Large amount of small file 150MB of size it's writing around 18min). I can able copy small files and syncing between the server brick are working fine but it is terrible with large amount of small files. if anybody please share the solution for the above issue. Regards Prabu _______________________________________________ Gluster-users mailing list Gluster-users at gluster.org http://www.gluster.org/mailman/listinfo/gluster-users -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://www.gluster.org/pipermail/gluster-users/attachments/20150429/4160e81e/attachment.html>
A Ghoshal
2015-Apr-29 12:28 UTC
[Gluster-users] client is terrible with large amount of small files
Performance would largely depend upon setup. While I cannot think of any setup that would cause write to be this slow, if would help if you share the following details: A) Glusterfs version B) volume configuration (gluster v <volname> info) C) host linux version D) details about the kind of network you use to connect your servers making up your storage pool. Thanks, Anirban From: gjprabu <gjprabu at zohocorp.com> To: <gluster-users at gluster.org> Date: 04/29/2015 05:52 PM Subject: Re: [Gluster-users] client is terrible with large amount of small files Sent by: gluster-users-bounces at gluster.org Hi Team, If anybody know the solution please share us. Regards Prabu ---- On Tue, 28 Apr 2015 19:32:40 +0530 gjprabu <gjprabu at zohocorp.com> wrote ---- Hi Team, We are using glusterfs newly and testing data transfer part in client using fuse.glusterfs file system but it is terrible with large amount of small files (Large amount of small file 150MB of size it's writing around 18min). I can able copy small files and syncing between the server brick are working fine but it is terrible with large amount of small files. if anybody please share the solution for the above issue. Regards Prabu _______________________________________________ Gluster-users mailing list Gluster-users at gluster.org http://www.gluster.org/mailman/listinfo/gluster-users _______________________________________________ Gluster-users mailing list Gluster-users at gluster.org http://www.gluster.org/mailman/listinfo/gluster-users =====-----=====-----====Notice: The information contained in this e-mail message and/or attachments to it may contain confidential or privileged information. If you are not the intended recipient, any dissemination, use, review, distribution, printing or copying of the information contained in this e-mail message and/or attachments to it are strictly prohibited. If you have received this communication in error, please notify us by reply e-mail or telephone and immediately and permanently delete the message and any attachments. Thank you -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://www.gluster.org/pipermail/gluster-users/attachments/20150429/02b6d332/attachment.html>