thr3ads.net - Gluster users - [Gluster-users] client is terrible with large amount of small files [Apr 2015]

If this information is useful, please help other people find it:
Share via:

gjprabu

2015-Apr-29 13:07 UTC

[Gluster-users] client is terrible with large amount of small files

Hi Ghoshal,
 
         Please find the details below.

A) Glusterfs version 
glusterfs 3.6.2 

B) volume configuration (gluster v &lt;volname&gt; info)
gluster volume info
 

Volume Name: integvol
Type: Replicate
Volume ID: b8f3a19e-59bc-41dc-a55a-6423ec834492
Status: Started
Number of Bricks: 1 x 3 = 3
Transport-type: tcp
Bricks:
Brick1: integ-gluster2:/srv/sdb1/brick
Brick2: integ-gluster1:/srv/sdb1/brick
Brick3: integ-gluster3:/srv/sdb1/brick

C) host linux version 
CentOS release 6.5 (Final)

D) details about the kind of network you use to connect your servers making up
your storage pool.
   We are connecting LAN to LAN there is no special network configuration done

Frome client we use to mount like below
mount -t glusterfs gluster1:/integvol /mnt/gluster/


Regards
Prabu





---- On Wed, 29 Apr 2015 17:58:16 +0530 A Ghoshal&lt;a.ghoshal at
tcs.com&gt; wrote ----

Performance would largely depend upon setup. While I cannot think of any setup
that would cause write to be this slow, if would help if you share the following
details:
 
A) Glusterfs version 
B) volume configuration (gluster v &lt;volname&gt; info) 
C) host linux version 
D) details about the kind of network you use to connect your servers making up
your storage pool.
 
Thanks, 
Anirban 
 
 
 
From:        gjprabu &lt;gjprabu at zohocorp.com&gt; 
To:        &lt;gluster-users at gluster.org&gt; 
Date:        04/29/2015 05:52 PM 
Subject:        Re: [Gluster-users] client is terrible with large amount of
small files
Sent by:        gluster-users-bounces at gluster.org 
  
 
 
Hi Team,
 
      If anybody know the solution please share us.
  
Regards 
Prabu 
 
 

 ---- On Tue, 28 Apr 2015 19:32:40 +0530 gjprabu &lt;gjprabu at
zohocorp.com&gt; wrote ----
Hi Team,
 
          We are using glusterfs newly and testing data transfer part in client
using fuse.glusterfs file system but it is terrible with large amount of small
files (Large amount of small file 150MB of size it's writing around 18min).
I can able copy small files and syncing between the server brick are working
fine but it is terrible with large amount of small files.
 
          if anybody please share the solution for the above issue.
           
Regards 
Prabu 
 
_______________________________________________ 
 Gluster-users mailing list 
 Gluster-users at gluster.org 
 http://www.gluster.org/mailman/listinfo/gluster-users 
 
_______________________________________________
 Gluster-users mailing list
 Gluster-users at gluster.org
 http://www.gluster.org/mailman/listinfo/gluster-users 
=====-----=====-----==== Notice: The information contained in this e-mail
 message and/or attachments to it may contain 
 confidential or privileged information. If you are 
 not the intended recipient, any dissemination, use, 
 review, distribution, printing or copying of the 
 information contained in this e-mail message 
 and/or attachments to it are strictly prohibited. If 
 you have received this communication in error, 
 please notify us by reply e-mail or telephone and 
 immediately and permanently delete the message 
 and any attachments. Thank you
 




-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://www.gluster.org/pipermail/gluster-users/attachments/20150429/d3f80998/attachment.html>

Ben Turner

2015-Apr-29 19:07 UTC

head link

[Gluster-users] client is terrible with large amount of small files

----- Original Message -----> From: "gjprabu" <gjprabu at zohocorp.com>
> To: "A Ghoshal" <a.ghoshal at tcs.com>
> Cc: gluster-users at gluster.org, gluster-users-bounces at gluster.org
> Sent: Wednesday, April 29, 2015 9:07:07 AM
> Subject: Re: [Gluster-users] client is terrible with large amount of small
files
> 
> Hi Ghoshal,
> 
> Please find the details below.
> 
> A) Glusterfs version
> glusterfs 3.6.2
Upgrade to 3.6.3 and set client.event-threads and server.event-threads to at
least 4.  Here is a guide on tuning MT epoll:

https://access.redhat.com/documentation/en-US/Red_Hat_Storage/3/html/Administration_Guide/Small_File_Performance_Enhancements.html
> 
> B) volume configuration (gluster v <volname> info)
> gluster volume info
> 
> 
> Volume Name: integvol
> Type: Replicate
> Volume ID: b8f3a19e-59bc-41dc-a55a-6423ec834492
> Status: Started
> Number of Bricks: 1 x 3 = 3
> Transport-type: tcp
> Bricks:
> Brick1: integ-gluster2:/srv/sdb1/brick
> Brick2: integ-gluster1:/srv/sdb1/brick
> Brick3: integ-gluster3:/srv/sdb1/brick
>
> 
> C) host linux version
> CentOS release 6.5 (Final)
Are your bricks on LVM?  Are you using thinp?  If so update to the latest kernel
as thinp perf was really bad in 6.5 and early 6.6 kernels.
> 
> D) details about the kind of network you use to connect your servers making
> up your storage pool.
> We are connecting LAN to LAN there is no special network configuration done
> 
> Frome client we use to mount like below
> mount -t glusterfs gluster1:/integvol /mnt/gluster/
> 
> 
> Regards
> Prabu
> 
> 
> 
> ---- On Wed, 29 Apr 2015 17:58:16 +0530 A Ghoshal<a.ghoshal at
tcs.com> wrote
> ----
> 
> 
> 
> Performance would largely depend upon setup. While I cannot think of any
> setup that would cause write to be this slow, if would help if you share
the
> following details:
> 
> A) Glusterfs version
> B) volume configuration (gluster v <volname> info)
> C) host linux version
> D) details about the kind of network you use to connect your servers making
> up your storage pool.
> 
> Thanks,
> Anirban
> 
> 
> 
> From: gjprabu < gjprabu at zohocorp.com >
> To: < gluster-users at gluster.org >
> Date: 04/29/2015 05:52 PM
> Subject: Re: [Gluster-users] client is terrible with large amount of small
> files
> Sent by: gluster-users-bounces at gluster.org
> 
> 
> 
> 
> Hi Team,
> 
> If anybody know the solution please share us.
> 
> Regards
> Prabu
> 
> 
> 
> ---- On Tue, 28 Apr 2015 19:32:40 +0530 gjprabu < gjprabu at
zohocorp.com >
> wrote ----
> Hi Team,
> 
> We are using glusterfs newly and testing data transfer part in client using
> fuse.glusterfs file system but it is terrible with large amount of small
> files (Large amount of small file 150MB of size it's writing around
18min).
> I can able copy small files and syncing between the server brick are
working
> fine but it is terrible with large amount of small files.
> 
> if anybody please share the solution for the above issue.
> 
> Regards
> Prabu
> 
> _______________________________________________
> Gluster-users mailing list
> Gluster-users at gluster.org
> http://www.gluster.org/mailman/listinfo/gluster-users
> 
> _______________________________________________
> Gluster-users mailing list
> Gluster-users at gluster.org
> http://www.gluster.org/mailman/listinfo/gluster-users
> 
> 
> =====-----=====-----====> Notice: The information contained in this
e-mail
> message and/or attachments to it may contain
> confidential or privileged information. If you are
> not the intended recipient, any dissemination, use,
> review, distribution, printing or copying of the
> information contained in this e-mail message
> and/or attachments to it are strictly prohibited. If
> you have received this communication in error,
> please notify us by reply e-mail or telephone and
> immediately and permanently delete the message
> and any attachments. Thank you
> 
> 
> 
> _______________________________________________
> Gluster-users mailing list
> Gluster-users at gluster.org
> http://www.gluster.org/mailman/listinfo/gluster-users

Gluster users - Apr 2015 - client is terrible with large amount of small files

[Gluster-users] client is terrible with large amount of small files

[Gluster-users] client is terrible with large amount of small files