Gluster users - Feb 2017 - Slow performance on samba with small files

Hi

I am currently testing gluster 3.9 replicated/distrbuted on centos 7.3 with
samba/ctdb.
I have been able to get it all up and running, but writing small files is
really slow.

If I copy large files from gluster backed samba I get almost wire speed (We
only have 1Gb at the moment). I get around half that speed if I copy large
files to the gluster backed samba system, which I am guessing is due to it
being replicated (This is acceptable).

Small file write performance seems really poor for us though:
As an example I have an eclipse IDE workspace folder that is 6MB in size
that has around 6000 files in it. A lot of these files are <1k in size.

If I copy this up to gluster backed samba it takes almost one hour to get
there.
With our basic samba deployment it only takes about 5 minutes.

Both systems reside on the same disks/SAN.


I was hoping that we would be able to move away from using a proprietary
SAN to house our network shares and use gluster instead.

Does anyone have any suggestions of anything I could tweak to make it
better ?

Many Thanks


*Gary Lloyd*
________________________________________________
I.T. Systems:Keele University
Finance & IT Directorate
Keele:Staffs:IC1 Building:ST5 5NB:UK
________________________________________________
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://lists.gluster.org/pipermail/gluster-users/attachments/20170208/c1f91748/attachment.html>

Hi,

There is a number of tweaks/hacks to make it better, but IMHO overall
performance with small files is still unacceptable for such folders with
thousands of entries.

If your shares are not too large to be placed on single filesystem and you still
want to use Gluster - it is possible to run VM on top of Gluster. Inside that VM
you can create ZFS/NTFS to be shared.
> 8 ????. 2017 ?., ? 12:10, Gary Lloyd <g.lloyd at keele.ac.uk>
???????(?):
> 
> Hi
> 
> I am currently testing gluster 3.9 replicated/distrbuted on centos 7.3 with
samba/ctdb.
> I have been able to get it all up and running, but writing small files is
really slow.
> 
> If I copy large files from gluster backed samba I get almost wire speed (We
only have 1Gb at the moment). I get around half that speed if I copy large files
to the gluster backed samba system, which I am guessing is due to it being
replicated (This is acceptable).
> 
> Small file write performance seems really poor for us though:
> As an example I have an eclipse IDE workspace folder that is 6MB in size
that has around 6000 files in it. A lot of these files are <1k in size.
> 
> If I copy this up to gluster backed samba it takes almost one hour to get
there.
> With our basic samba deployment it only takes about 5 minutes.
> 
> Both systems reside on the same disks/SAN.
> 
> 
> I was hoping that we would be able to move away from using a proprietary
SAN to house our network shares and use gluster instead.
> 
> Does anyone have any suggestions of anything I could tweak to make it
better ?
> 
> Many Thanks
> 
> 
> Gary Lloyd
> ________________________________________________
> I.T. Systems:Keele University
> Finance & IT Directorate
> Keele:Staffs:IC1 Building:ST5 5NB:UK
> ________________________________________________
> _______________________________________________
> Gluster-users mailing list
> Gluster-users at gluster.org
> http://lists.gluster.org/mailman/listinfo/gluster-users
--
Dmitry Glushenok
Jet Infosystems

-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://lists.gluster.org/pipermail/gluster-users/attachments/20170208/3674592b/attachment.html>