Gluster users - Oct 2015 - Speed up heal performance

-Atin
Sent from one plus one
On Oct 13, 2015 3:16 AM, "Ben Turner" <bturner at redhat.com>
wrote:
>
> ----- Original Message -----
> > From: "Lindsay Mathieson" <lindsay.mathieson at
gmail.com>
> > To: "gluster-users" <gluster-users at gluster.org>
> > Sent: Friday, October 9, 2015 9:18:11 AM
> > Subject: [Gluster-users] Speed up heal performance
> >
> > Is there any way to max out heal performance? My cluster is unused
overnight,
> > and lightly used at lunchtimes, it would be handy to speed up a heal.
> >
> > The only tuneable I found was cluster.self-heal-window-size, which
doesn't
> > seem to make much difference.
>
> I don't know of any way to speed this up, maybe someone else could
chime
in here that knows the heal daemon better than me.  Maybe you could open an
RFE on this?  In my testing I only see 2 files getting healed at a time per
replica pair.  I would like to see this be multi threaded(if its not
already) with the ability to tune it to control resource usage(similar to
what we did in the rebalance refactoring done recently).  If you let me
know the BZ # I'll add my data + suggestions, I have been testing this
pretty extensively in recent weeks and good data + some ideas on how to
speed things up.
Good news is we already have a WIP patch review.glusterd.org/10851 to
introduce multi threaded shd. Credits to Richard/Shreyas from facebook for
this. IIRC, we also have a BZ for the same but the patch is in rfc as of
now. AFAIK, this is a candidate to land in 3.8 as well, Vijay can correct
me otherwise.
>
> -b
>
> > thanks,
> > --
> > Lindsay
> >
> > _______________________________________________
> > Gluster-users mailing list
> > Gluster-users at gluster.org
> > http://www.gluster.org/mailman/listinfo/gluster-users
> _______________________________________________
> Gluster-users mailing list
> Gluster-users at gluster.org
> http://www.gluster.org/mailman/listinfo/gluster-users
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://www.gluster.org/pipermail/gluster-users/attachments/20151013/3dfbebe9/attachment.html>

On 13 October 2015 at 11:56, Atin Mukherjee <atin.mukherjee83 at
gmail.com>
wrote:
> Good news is we already have a WIP patch review.glusterd.org/10851 to
> introduce multi threaded shd.
>
Thanks Atin, no need for the RFE then?

I notice the patch mainly discusses improvingthe performanceof healing many
small files, will it help with large VM files as well?


-- 
Lindsay
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://www.gluster.org/pipermail/gluster-users/attachments/20151013/6fff22f0/attachment.html>

>Good news is we already have a WIP patch review.glusterd.org/10851 to
introduce multi threaded shd. Credits to Richard/Shreyas from facebook for
this. IIRC, we also have a BZ for the same
>
Isnt it the same bugzilla (
https://bugzilla.redhat.com/show_bug.cgi?id=1221737) mentioned in the
commit log?

--Humble


On Tue, Oct 13, 2015 at 7:26 AM, Atin Mukherjee <atin.mukherjee83 at
gmail.com>
wrote:
> -Atin
> Sent from one plus one
> On Oct 13, 2015 3:16 AM, "Ben Turner" <bturner at
redhat.com> wrote:
> >
> > ----- Original Message -----
> > > From: "Lindsay Mathieson" <lindsay.mathieson at
gmail.com>
> > > To: "gluster-users" <gluster-users at
gluster.org>
> > > Sent: Friday, October 9, 2015 9:18:11 AM
> > > Subject: [Gluster-users] Speed up heal performance
> > >
> > > Is there any way to max out heal performance? My cluster is
unused
> overnight,
> > > and lightly used at lunchtimes, it would be handy to speed up a
heal.
> > >
> > > The only tuneable I found was cluster.self-heal-window-size,
which
> doesn't
> > > seem to make much difference.
> >
> > I don't know of any way to speed this up, maybe someone else could
chime
> in here that knows the heal daemon better than me.  Maybe you could open an
> RFE on this?  In my testing I only see 2 files getting healed at a time per
> replica pair.  I would like to see this be multi threaded(if its not
> already) with the ability to tune it to control resource usage(similar to
> what we did in the rebalance refactoring done recently).  If you let me
> know the BZ # I'll add my data + suggestions, I have been testing this
> pretty extensively in recent weeks and good data + some ideas on how to
> speed things up.
> Good news is we already have a WIP patch review.glusterd.org/10851 to
> introduce multi threaded shd. Credits to Richard/Shreyas from facebook for
> this. IIRC, we also have a BZ for the same but the patch is in rfc as of
> now. AFAIK, this is a candidate to land in 3.8 as well, Vijay can correct
> me otherwise.
> >
> > -b
> >
> > > thanks,
> > > --
> > > Lindsay
> > >
> > > _______________________________________________
> > > Gluster-users mailing list
> > > Gluster-users at gluster.org
> > > http://www.gluster.org/mailman/listinfo/gluster-users
> > _______________________________________________
> > Gluster-users mailing list
> > Gluster-users at gluster.org
> > http://www.gluster.org/mailman/listinfo/gluster-users
>
> _______________________________________________
> Gluster-users mailing list
> Gluster-users at gluster.org
> http://www.gluster.org/mailman/listinfo/gluster-users
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://www.gluster.org/pipermail/gluster-users/attachments/20151013/964fd88b/attachment.html>