A Ghoshal
2015-Apr-29 12:28 UTC
[Gluster-users] client is terrible with large amount of small files
Performance would largely depend upon setup. While I cannot think of any
setup that would cause write to be this slow, if would help if you share
the following details:
A) Glusterfs version
B) volume configuration (gluster v <volname> info)
C) host linux version
D) details about the kind of network you use to connect your servers
making up your storage pool.
Thanks,
Anirban
From: gjprabu <gjprabu at zohocorp.com>
To: <gluster-users at gluster.org>
Date: 04/29/2015 05:52 PM
Subject: Re: [Gluster-users] client is terrible with large amount
of small files
Sent by: gluster-users-bounces at gluster.org
Hi Team,
If anybody know the solution please share us.
Regards
Prabu
---- On Tue, 28 Apr 2015 19:32:40 +0530 gjprabu <gjprabu at zohocorp.com>
wrote ----
Hi Team,
We are using glusterfs newly and testing data transfer part in
client using fuse.glusterfs file system but it is terrible with large
amount of small files (Large amount of small file 150MB of size it's
writing around 18min). I can able copy small files and syncing between the
server brick are working fine but it is terrible with large amount of
small files.
if anybody please share the solution for the above issue.
Regards
Prabu
_______________________________________________
Gluster-users mailing list
Gluster-users at gluster.org
http://www.gluster.org/mailman/listinfo/gluster-users
_______________________________________________
Gluster-users mailing list
Gluster-users at gluster.org
http://www.gluster.org/mailman/listinfo/gluster-users
=====-----=====-----====Notice: The information contained in this e-mail
message and/or attachments to it may contain
confidential or privileged information. If you are
not the intended recipient, any dissemination, use,
review, distribution, printing or copying of the
information contained in this e-mail message
and/or attachments to it are strictly prohibited. If
you have received this communication in error,
please notify us by reply e-mail or telephone and
immediately and permanently delete the message
and any attachments. Thank you
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://www.gluster.org/pipermail/gluster-users/attachments/20150429/02b6d332/attachment.html>
gjprabu
2015-Apr-29 13:07 UTC
[Gluster-users] client is terrible with large amount of small files
Hi Ghoshal,
Please find the details below.
A) Glusterfs version
glusterfs 3.6.2
B) volume configuration (gluster v <volname> info)
gluster volume info
Volume Name: integvol
Type: Replicate
Volume ID: b8f3a19e-59bc-41dc-a55a-6423ec834492
Status: Started
Number of Bricks: 1 x 3 = 3
Transport-type: tcp
Bricks:
Brick1: integ-gluster2:/srv/sdb1/brick
Brick2: integ-gluster1:/srv/sdb1/brick
Brick3: integ-gluster3:/srv/sdb1/brick
C) host linux version
CentOS release 6.5 (Final)
D) details about the kind of network you use to connect your servers making up
your storage pool.
We are connecting LAN to LAN there is no special network configuration done
Frome client we use to mount like below
mount -t glusterfs gluster1:/integvol /mnt/gluster/
Regards
Prabu
---- On Wed, 29 Apr 2015 17:58:16 +0530 A Ghoshal<a.ghoshal at
tcs.com> wrote ----
Performance would largely depend upon setup. While I cannot think of any setup
that would cause write to be this slow, if would help if you share the following
details:
A) Glusterfs version
B) volume configuration (gluster v <volname> info)
C) host linux version
D) details about the kind of network you use to connect your servers making up
your storage pool.
Thanks,
Anirban
From: gjprabu <gjprabu at zohocorp.com>
To: <gluster-users at gluster.org>
Date: 04/29/2015 05:52 PM
Subject: Re: [Gluster-users] client is terrible with large amount of
small files
Sent by: gluster-users-bounces at gluster.org
Hi Team,
If anybody know the solution please share us.
Regards
Prabu
---- On Tue, 28 Apr 2015 19:32:40 +0530 gjprabu <gjprabu at
zohocorp.com> wrote ----
Hi Team,
We are using glusterfs newly and testing data transfer part in client
using fuse.glusterfs file system but it is terrible with large amount of small
files (Large amount of small file 150MB of size it's writing around 18min).
I can able copy small files and syncing between the server brick are working
fine but it is terrible with large amount of small files.
if anybody please share the solution for the above issue.
Regards
Prabu
_______________________________________________
Gluster-users mailing list
Gluster-users at gluster.org
http://www.gluster.org/mailman/listinfo/gluster-users
_______________________________________________
Gluster-users mailing list
Gluster-users at gluster.org
http://www.gluster.org/mailman/listinfo/gluster-users
=====-----=====-----==== Notice: The information contained in this e-mail
message and/or attachments to it may contain
confidential or privileged information. If you are
not the intended recipient, any dissemination, use,
review, distribution, printing or copying of the
information contained in this e-mail message
and/or attachments to it are strictly prohibited. If
you have received this communication in error,
please notify us by reply e-mail or telephone and
immediately and permanently delete the message
and any attachments. Thank you
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://www.gluster.org/pipermail/gluster-users/attachments/20150429/d3f80998/attachment.html>