search for: rightkicktech

----- Original Message ----- > From: "Abi Askushi" <rightkicktech at gmail.com> > To: "Ben Turner" <bturner at redhat.com> > Cc: "Krutika Dhananjay" <kdhananj at redhat.com>, "gluster-user" <gluster-users at gluster.org> > Sent: Monday, September 11, 2017 1:40:42 AM > Subject: Re: [Gluster-users] Slow...

Great to hear! ----- Original Message ----- > From: "Abi Askushi" <rightkicktech at gmail.com> > To: "Krutika Dhananjay" <kdhananj at redhat.com> > Cc: "gluster-user" <gluster-users at gluster.org> > Sent: Friday, September 8, 2017 7:01:00 PM > Subject: Re: [Gluster-users] Slow performance of gluster volume > > Following cha...

Hi, I am wondering why the other brick is not showing any entry in split brain in the heal info split-brain output. Can you give the output of stat & getfattr -d -m . -e hex <file-path-on-brick> from both the bricks. Regards, Karthik On Mon, Feb 5, 2018 at 5:03 PM, Alex K <rightkicktech at gmail.com> wrote: > After stoping/starting the volume I have: > > gluster volume heal engine info split-brain > Brick gluster0:/gluster/engine/brick > <gfid:bb675ea6-0622-4852-9e59-27a4c93ac0f8> > Status: Connected > Number of entries in split-brain: 1 > > B...

Hi Abi Can you please share your current transfer speeds after you made the change? Thank you. On Mon, Sep 11, 2017 at 9:55 AM, Ben Turner <bturner at redhat.com> wrote: > ----- Original Message ----- > > From: "Abi Askushi" <rightkicktech at gmail.com> > > To: "Ben Turner" <bturner at redhat.com> > > Cc: "Krutika Dhananjay" <kdhananj at redhat.com>, "gluster-user" < > gluster-users at gluster.org> > > Sent: Monday, September 11, 2017 1:40:42 AM > > Subject...

...t. >From which version to which version did you see such performance boost? I will try to upgrade and check difference also. On Sep 11, 2017 2:45 AM, "Ben Turner" <bturner at redhat.com> wrote: Great to hear! ----- Original Message ----- > From: "Abi Askushi" <rightkicktech at gmail.com> > To: "Krutika Dhananjay" <kdhananj at redhat.com> > Cc: "gluster-user" <gluster-users at gluster.org> > Sent: Friday, September 8, 2017 7:01:00 PM > Subject: Re: [Gluster-users] Slow performance of gluster volume > > Following chan...

...rovement with 3.11.1 as that has a patch that improves > perf for this kind of a workload > > Also, could you disable eager-lock and check if that helps? I see that max > time is being spent in acquiring locks. > > -Krutika > > On Wed, Sep 6, 2017 at 1:38 PM, Abi Askushi <rightkicktech at gmail.com> > wrote: > >> Hi Krutika, >> >> Is it anything in the profile indicating what is causing this bottleneck? >> In case i can collect any other info let me know. >> >> Thanx >> >> On Sep 5, 2017 13:27, "Abi Askushi" <r...

...aching now the max network bandwidth and performance of VMs is quite good. Did not upgrade the glusterd. As a next try I am thinking to upgrade gluster to 3.12 + test libgfapi integration of qemu by upgrading to ovirt 4.1.5 and check vm perf. On Sep 6, 2017 1:20 PM, "Abi Askushi" <rightkicktech at gmail.com> wrote: I tried to follow step from https://wiki.centos.org/ SpecialInterestGroup/Storage to install latest gluster on the first node. It installed 3.10 and not 3.11. I am not sure how to install 3.11 without compiling it. Then when tried to start the gluster on the node the bricks...

...other brick is not showing any entry in split brain > in the heal info split-brain output. > Can you give the output of stat & getfattr -d -m . -e hex > <file-path-on-brick> from both the bricks. > > Regards, > Karthik > > On Mon, Feb 5, 2018 at 5:03 PM, Alex K <rightkicktech at gmail.com> wrote: > >> After stoping/starting the volume I have: >> >> gluster volume heal engine info split-brain >> Brick gluster0:/gluster/engine/brick >> <gfid:bb675ea6-0622-4852-9e59-27a4c93ac0f8> >> Status: Connected >> Number of entri...

Hi Krutika, Is it anything in the profile indicating what is causing this bottleneck? In case i can collect any other info let me know. Thanx On Sep 5, 2017 13:27, "Abi Askushi" <rightkicktech at gmail.com> wrote: Hi Krutika, Attached the profile stats. I enabled profiling then ran some dd tests. Also 3 Windows VMs are running on top this volume but did not do any stress testing on the VMs. I have left the profiling enabled in case more time is needed for useful stats. Thanx On Tu...

Do you see any improvement with 3.11.1 as that has a patch that improves perf for this kind of a workload Also, could you disable eager-lock and check if that helps? I see that max time is being spent in acquiring locks. -Krutika On Wed, Sep 6, 2017 at 1:38 PM, Abi Askushi <rightkicktech at gmail.com> wrote: > Hi Krutika, > > Is it anything in the profile indicating what is causing this bottleneck? > In case i can collect any other info let me know. > > Thanx > > On Sep 5, 2017 13:27, "Abi Askushi" <rightkicktech at gmail.com> wrote: >...

I am using gluster 3.8.12, the default on Centos 7.3 (I will update to 3.10 at some moment) On Sun, Sep 17, 2017 at 11:30 AM, Alex K <rightkicktech at gmail.com> wrote: > Hi all, > > I have a replica 3 with 1 arbiter. > > I see the last days that one file at a volume is always showing as needing > healing: > > gluster volume heal vms info > Brick gluster0:/gluster/vms/brick > Status: Connected > Number of e...

...in split-brain: 0 gluster volume heal engine split-brain latest-mtime gfid:bb675ea6-0622-4852-9e59-27a4c93ac0f8 Healing gfid:bb675ea6-0622-4852-9e59-27a4c93ac0f8 failed:Operation not permitted. Volume heal failed. I will appreciate any help. thanx, Alex On Mon, Feb 5, 2018 at 1:11 PM, Alex K <rightkicktech at gmail.com> wrote: > Hi all, > > I have a split brain issue and have the following situation: > > gluster volume heal engine info split-brain > > Brick gluster0:/gluster/engine/brick > /ad1f38d7-36df-4cee-a092-ab0ce1f98ce9/ha_agent > Status: Connected > Number o...

Hi all, I have a replica 3 with 1 arbiter. I see the last days that one file at a volume is always showing as needing healing: gluster volume heal vms info Brick gluster0:/gluster/vms/brick Status: Connected Number of entries: 0 Brick gluster1:/gluster/vms/brick Status: Connected Number of entries: 0 Brick gluster2:/gluster/vms/brick *<gfid:66d3468e-00cf-44dc-a835-7624da0c5370>* Status:

Hi all, I have a split brain issue and have the following situation: gluster volume heal engine info split-brain Brick gluster0:/gluster/engine/brick /ad1f38d7-36df-4cee-a092-ab0ce1f98ce9/ha_agent Status: Connected Number of entries in split-brain: 1 Brick gluster1:/gluster/engine/brick Status: Connected Number of entries in split-brain: 0 cd ha_agent/ [root at v0 ha_agent]# ls -al ls:

...from the (md)cache to improve performance. > So enable that. > > Also, could you also enable client-io-threads and see if that improves > performance? > > Which version of gluster are you using BTW? > > -Krutika > > > On Tue, Sep 5, 2017 at 4:32 AM, Abi Askushi <rightkicktech at gmail.com> > wrote: > >> Hi all, >> >> I have a gluster volume used to host several VMs (managed through oVirt). >> The volume is a replica 3 with arbiter and the 3 servers use 1 Gbit >> network for the storage. >> >> When testing with dd (dd if...

...e same. In any case, please attach the volume profile[1], so we can see what else is slowing things down. -Krutika [1] - https://gluster.readthedocs.io/en/latest/Administrator%20Guide/Monitoring%20Workload/#running-glusterfs-volume-profile-command On Tue, Sep 5, 2017 at 2:32 PM, Abi Askushi <rightkicktech at gmail.com> wrote: > Hi Krutika, > > I already have a preallocated disk on VM. > Now I am checking performance with dd on the hypervisors which have the > gluster volume configured. > > I tried also several values of shard-block-size and I keep getting the > same low v...

...sends quite a lot of [f]stats which can be served from the (md)cache to improve performance. So enable that. Also, could you also enable client-io-threads and see if that improves performance? Which version of gluster are you using BTW? -Krutika On Tue, Sep 5, 2017 at 4:32 AM, Abi Askushi <rightkicktech at gmail.com> wrote: > Hi all, > > I have a gluster volume used to host several VMs (managed through oVirt). > The volume is a replica 3 with arbiter and the 3 servers use 1 Gbit > network for the storage. > > When testing with dd (dd if=/dev/zero of=testfile bs=1G count=1...

All volumes are configured as replica 3. I have no arbiter volumes. Storage hosts are for storage only and Virt hosts are dedicated Virt hosts. I've checked throughput from the Virt hosts to all 3 gluster hosts and am getting ~9Gb/s. On Tue, Feb 27, 2018 at 1:33 AM, Alex K <rightkicktech at gmail.com> wrote: > What is your gluster setup? Please share volume details where vms ate > stored. It could be that the slow host is having arbiter volume. > > Alex > > On Feb 26, 2018 13:46, "Ryan Wilkinson" <ryanwilk at gmail.com> wrote: > >> Her...

Hi all, I have a gluster volume used to host several VMs (managed through oVirt). The volume is a replica 3 with arbiter and the 3 servers use 1 Gbit network for the storage. When testing with dd (dd if=/dev/zero of=testfile bs=1G count=1 oflag=direct) out of the volume (e.g. writing at /root/) the performance of the dd is reported to be ~ 700MB/s, which is quite decent. When testing the dd on

What is your gluster setup? Please share volume details where vms ate stored. It could be that the slow host is having arbiter volume. Alex On Feb 26, 2018 13:46, "Ryan Wilkinson" <ryanwilk at gmail.com> wrote: > Here is info. about the Raid controllers. Doesn't seem to be the culprit. > > Slow host: > Name PERC H710 Mini (Embedded) > Firmware Version