Gluster users - May 2016 - Self Heal Sync Speed after 3.7.11 and small file performance

Hello there,

We've had serious CPU utilization issues with pre 3.7.9 GlusterFS, due to
huge number of small files. CPU load was going up to 40-50 (on 32 core
system) with nothing else running on it.
We've observed multiple other Gluster users reporting similar issues, and
waited for bug fix to be released. It seems like SHD freeze issue is
resolved with 3.7.10 and now we're upgrading 3.7.11 however now we're
observing very slow heal speed between nodes.

I see people are mostly using Gluster for storage backend to OpenStack to
house large VM images. I've used Gluster back in 2010, before RH purchase,
but my use case had smaller number of files back then.
Has anyone else have experience with hosting large number of small files on
GlusterFS cluster ?

Thank you


-- 
Kayra Otaner
BilgiO A.?. -  SecOps Experts
PGP KeyID : A945251E | Manager, Enterprise Linux Solutions
www.bilgio.com |  TR +90 (532) 111-7240 x 1001 | US +1 (201) 206-2592
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://www.gluster.org/pipermail/gluster-users/attachments/20160506/a073ba36/attachment.html>

Hi,

Yes, it works mostly fine but ofcourse it's quite slow.
We have PHP applications on it, as long as you enable APCu and OPCache,
it's pretty good.
As for the CPU usage I didn't notice anything of the sort, but maybe we
aren't talking about the same kind of usage.

On Fri, May 06, 2016 at 05:59:30PM +0300, Kayra Otaner | BilgiO
wrote:
> Hello there,
> 
> We've had serious CPU utilization issues with pre 3.7.9 GlusterFS, due
to
> huge number of small files. CPU load was going up to 40-50 (on 32 core
> system) with nothing else running on it.
> We've observed multiple other Gluster users reporting similar issues,
and
> waited for bug fix to be released. It seems like SHD freeze issue is
> resolved with 3.7.10 and now we're upgrading 3.7.11 however now
we're
> observing very slow heal speed between nodes.
> 
> I see people are mostly using Gluster for storage backend to OpenStack to
> house large VM images. I've used Gluster back in 2010, before RH
purchase,
> but my use case had smaller number of files back then.
> Has anyone else have experience with hosting large number of small files on
> GlusterFS cluster ?
> 
> Thank you
> 
> 
> -- 
> Kayra Otaner
> BilgiO A.?. -  SecOps Experts
> PGP KeyID : A945251E | Manager, Enterprise Linux Solutions
> www.bilgio.com |  TR +90 (532) 111-7240 x 1001 | US +1 (201) 206-2592
> _______________________________________________
> Gluster-users mailing list
> Gluster-users at gluster.org
> http://www.gluster.org/mailman/listinfo/gluster-users

-- 
Kevin Lemonnier
PGP Fingerprint : 89A5 2283 04A0 E6E9 0111
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 819 bytes
Desc: Digital signature
URL:
<http://www.gluster.org/pipermail/gluster-users/attachments/20160506/919f4480/attachment.sig>

Hi,
I am also observing bad performance with small files on a GlusterFS 3.7.11
cluster. For example if I unpack the latest Linux kernel tar file it takes
roughly 9 minutes whereas on my laptop it takes 30 seconds.
Maybe there are a some paramters on the GlusterFS side which could help to fine
tune the hosting of a lof of (mostly small) files? Does anyone have any
recommendations here?
RegardsML
 

    On Friday, May 6, 2016 4:59 PM, Kayra Otaner | BilgiO <kayra.otaner at
bilgio.com> wrote:
 

 Hello there,
We've had serious CPU utilization issues with pre 3.7.9 GlusterFS, due to
huge number of small files. CPU load was going up to 40-50 (on 32 core system)
with nothing else running on it.We've observed multiple other Gluster users
reporting similar issues, and waited for bug fix to be released. It seems like
SHD freeze issue is resolved with 3.7.10 and now we're upgrading 3.7.11
however now we're observing very slow heal speed between nodes.
I see people are mostly using Gluster for storage backend to OpenStack to house
large VM images. I've used Gluster back in 2010, before RH purchase, but my
use case had smaller number of files back then.Has anyone else have experience
with hosting large number of small files on GlusterFS cluster ?
Thank you??

-- 
Kayra OtanerBilgiO A.?. - ?SecOps ExpertsPGP KeyID : A945251E?| Manager,
Enterprise Linux Solutionswww.bilgio.com |? TR +90 (532) 111-7240 x 1001 | US +1
(201) 206-2592
_______________________________________________
Gluster-users mailing list
Gluster-users at gluster.org
http://www.gluster.org/mailman/listinfo/gluster-users

  
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://www.gluster.org/pipermail/gluster-users/attachments/20160506/1ebd454c/attachment.html>