search for: gencgiyen

...stop? Note: I deleted all files again and reformat then re-create volume with shard then mount it. Tried with 16MB, 32MB and 512MB shard sizes. Results are equal. Thanks, Gencer. From: Krutika Dhananjay [mailto:kdhananj at redhat.com] Sent: Thursday, July 6, 2017 3:30 AM To: gencer at gencgiyen.com Cc: gluster-user <gluster-users at gluster.org> Subject: Re: [Gluster-users] Very slow performance on Sharded GlusterFS What if you disabled eager lock and run your test again on the sharded configuration along with the profile output? # gluster volume set <VOL> cluster.eager-l...

...Note: I also noticed that you said ?order?. Do you mean when we create via volume set we have to make an order for bricks? I thought gluster handles (and do the math) itself. Gencer From: Krutika Dhananjay [mailto:kdhananj at redhat.com] Sent: Friday, June 30, 2017 3:50 PM To: gencer at gencgiyen.com Cc: gluster-user <gluster-users at gluster.org> Subject: Re: [Gluster-users] Very slow performance on Sharded GlusterFS Just noticed that the way you have configured your brick order during volume-create makes both replicas of every set reside on the same machine. That apart, do you...

Krutika, I?m sorry I forgot to add logs. I attached them now. Thanks, Gencer. From: gluster-users-bounces at gluster.org [mailto:gluster-users-bounces at gluster.org] On Behalf Of gencer at gencgiyen.com Sent: Thursday, July 6, 2017 10:27 AM To: 'Krutika Dhananjay' <kdhananj at redhat.com> Cc: 'gluster-user' <gluster-users at gluster.org> Subject: Re: [Gluster-users] Very slow performance on Sharded GlusterFS Ki Krutika, After that setting: $ dd if=/dev/z...

...family: inet nfs.disable: on See attached results and sorry for the multiple e-mails. I just want to make sure that I provided correct results for the tests. Thanks, Gencer. From: gluster-users-bounces at gluster.org [mailto:gluster-users-bounces at gluster.org] On Behalf Of gencer at gencgiyen.com Sent: Thursday, July 6, 2017 10:34 AM To: 'Krutika Dhananjay' <kdhananj at redhat.com> Cc: 'gluster-user' <gluster-users at gluster.org> Subject: Re: [Gluster-users] Very slow performance on Sharded GlusterFS Krutika, I?m sorry I forgot to add logs. I attached th...

...g because the optimizations eager-locking and delayed post-op will now only be applicable on a per-shard basis. Larger the shard size, the better, to work around this issue. Meanwhile, let me think about how we can get this fixed in code. -Krutika On Mon, Jul 10, 2017 at 7:59 PM, <gencer at gencgiyen.com> wrote: > Hi Krutika, > > > > May I kindly ping to you and ask that If you have any idea yet or figured > out whats the issue may? > > > > I am awaiting your reply with four eyes :) > > > > Apologies for the ping :) > > > > -Gencer. >...

...kindly ping to you and ask that If you have any idea yet or figured out whats the issue may? I am awaiting your reply with four eyes :) Apologies for the ping :) -Gencer. From: gluster-users-bounces at gluster.org [mailto:gluster-users-bounces at gluster.org] On Behalf Of gencer at gencgiyen.com Sent: Thursday, July 6, 2017 11:06 AM To: 'Krutika Dhananjay' <kdhananj at redhat.com> Cc: 'gluster-user' <gluster-users at gluster.org> Subject: Re: [Gluster-users] Very slow performance on Sharded GlusterFS Hi Krutika, I also did one more test. I re-created...

...reusing the same volume was the cause of lack of IO > distribution. > The latest profile output looks much more realistic and in line with i > would expect. > > Let me analyse the numbers a bit and get back. > > -Krutika > > On Tue, Jul 4, 2017 at 12:55 PM, <gencer at gencgiyen.com> wrote: > >> Hi Krutika, >> >> >> >> Thank you so much for myour reply. Let me answer all: >> >> >> >> 1. I have no idea why it did not get distributed over all bricks. >> 2. Hm.. This is really weird. >> >> &gt...

Thanks. I think reusing the same volume was the cause of lack of IO distribution. The latest profile output looks much more realistic and in line with i would expect. Let me analyse the numbers a bit and get back. -Krutika On Tue, Jul 4, 2017 at 12:55 PM, <gencer at gencgiyen.com> wrote: > Hi Krutika, > > > > Thank you so much for myour reply. Let me answer all: > > > > 1. I have no idea why it did not get distributed over all bricks. > 2. Hm.. This is really weird. > > > > And others; > > > > No. I use onl...

...rick9 Brick20: sr-10-loc-50-14-18:/bricks/brick10 Options Reconfigured: features.shard-block-size: 32MB features.shard: on transport.address-family: inet nfs.disable: on -Gencer. From: Krutika Dhananjay [mailto:kdhananj at redhat.com] Sent: Friday, June 30, 2017 2:50 PM To: gencer at gencgiyen.com Cc: gluster-user <gluster-users at gluster.org> Subject: Re: [Gluster-users] Very slow performance on Sharded GlusterFS Could you please provide the volume-info output? -Krutika On Fri, Jun 30, 2017 at 4:23 PM, <gencer at gencgiyen.com <mailto:gencer at gencgiyen.com> &g...

...re's just one volume, are you taking care to remove all data from the mount point of this volume before converting it? * What is the size the test file grew to? * These attached profiles are against dd runs? Or the file download test? -Krutika On Mon, Jul 3, 2017 at 8:42 PM, <gencer at gencgiyen.com> wrote: > Hi Krutika, > > > > Have you be able to look out my profiles? Do you have any clue, idea or > suggestion? > > > > Thanks, > > -Gencer > > > > *From:* Krutika Dhananjay [mailto:kdhananj at redhat.com] > *Sent:* Friday, June 30, 201...

...sed) And this example have generated a profile which I also attached to this e-mail. Is there anything that I can try? I am open to all kind of suggestions. Thanks, Gencer. From: Krutika Dhananjay [mailto:kdhananj at redhat.com] Sent: Tuesday, July 4, 2017 9:39 AM To: gencer at gencgiyen.com Cc: gluster-user <gluster-users at gluster.org> Subject: Re: [Gluster-users] Very slow performance on Sharded GlusterFS Hi Gencer, I just checked the volume-profile attachments. Things that seem really odd to me as far as the sharded volume is concerned: 1. Only the replica pair ha...

.... What I get is 5-10x slower. I play with Gluster?s threads count, performance tweaks, caches and etc. Nothing helped. In fact, the performance tweaks that I apply for stripe makes sharded volume much much more worse. Default values are better on sharded volume. -Gencer. From: gencer at gencgiyen.com [mailto:gencer at gencgiyen.com] Sent: Saturday, July 1, 2017 9:49 AM To: 'Gandalf Corvotempesta' <gandalf.corvotempesta at gmail.com> Cc: 'Krutika Dhananjay' <kdhananj at redhat.com>; 'gluster-user' <gluster-users at gluster.org> Subject: RE: [Gluster...

Hi Krutika, Have you be able to look out my profiles? Do you have any clue, idea or suggestion? Thanks, -Gencer From: Krutika Dhananjay [mailto:kdhananj at redhat.com] Sent: Friday, June 30, 2017 3:50 PM To: gencer at gencgiyen.com Cc: gluster-user <gluster-users at gluster.org> Subject: Re: [Gluster-users] Very slow performance on Sharded GlusterFS Just noticed that the way you have configured your brick order during volume-create makes both replicas of every set reside on the same machine. That apart, do you...

...ed, run `gluster volume profile <VOL> info` and redirect its output to a tmp file. 4. Stop profile # gluster volume profile <VOL> stop And attach the volume-profile output file that you saved at a temporary location in step 3. -Krutika On Fri, Jun 30, 2017 at 5:33 PM, <gencer at gencgiyen.com> wrote: > Hi Krutika, > > > > Sure, here is volume info: > > > > root at sr-09-loc-50-14-18:/# gluster volume info testvol > > > > Volume Name: testvol > > Type: Distributed-Replicate > > Volume ID: 30426017-59d5-4091-b6bc-279a905b704a >...

Could you please provide the volume-info output? -Krutika On Fri, Jun 30, 2017 at 4:23 PM, <gencer at gencgiyen.com> wrote: > Hi, > > > > I have an 2 nodes with 20 bricks in total (10+10). > > > > First test: > > > > 2 Nodes with Distributed ? Striped ? Replicated (2 x 2) > > 10GbE Speed between nodes > > > > ?dd? performance: 400mb/s and higher &g...

...es (one brick from 09th server and one replica from 10th server and continued with this order) and re-test. Nothing changed. Still slow. (exactly same result.) -Gencer. From: Gandalf Corvotempesta [mailto:gandalf.corvotempesta at gmail.com] Sent: Friday, June 30, 2017 8:19 PM To: gencer at gencgiyen.com Cc: Krutika Dhananjay <kdhananj at redhat.com>; gluster-user <gluster-users at gluster.org> Subject: Re: [Gluster-users] Very slow performance on Sharded GlusterFS Il 30 giu 2017 3:51 PM, <gencer at gencgiyen.com <mailto:gencer at gencgiyen.com> > ha scritto: Note:...

Hi, I have an 2 nodes with 20 bricks in total (10+10). First test: 2 Nodes with Distributed - Striped - Replicated (2 x 2) 10GbE Speed between nodes "dd" performance: 400mb/s and higher Downloading a large file from internet and directly to the gluster: 250-300mb/s Now same test without Stripe but with sharding. This results are same when I set shard size 4MB or

Il 30 giu 2017 3:51 PM, <gencer at gencgiyen.com> ha scritto: Note: I also noticed that you said ?order?. Do you mean when we create via volume set we have to make an order for bricks? I thought gluster handles (and do the math) itself. Yes, you have to specify the exact order Gluster is not flexible in this way and doesn't help you...

The current sharding has very limited use cases like vmstore where the clients accessing the sharded file will always be one. Krutuka will be the right person to answer your questions . Regards Rafi KC On 06/30/2017 04:28 PM, gencer at gencgiyen.com wrote: > > Hi, > > > > I have an 2 nodes with 20 bricks in total (10+10). > > > > First test: > > > > 2 Nodes with Distributed ? Striped ? Replicated (2 x 2) > > 10GbE Speed between nodes > > > > ?dd? performance: 400mb/s and h...

Hi, I have an 2 nodes with 20 bricks in total (10+10). First test: 2 Nodes with Distributed - Striped - Replicated (2 x 2) 10GbE Speed between nodes "dd" performance: 400mb/s and higher Downloading a large file from internet and directly to the gluster: 250-300mb/s Now same test without Stripe but with sharding. This results are same when I set shard size 4MB or