Kandalf ®
2015-Oct-16 20:42 UTC
[Gluster-users] gluster 3.7.5 low speed on write and heavy load
If I write with DD in linux locally to the same cluster node... or via network I have 120MB/s. the full speed of te 1 Gbps.But if I write to an RAW Image File... like vmdk in vmware... I have average of 20-40MB/s only. On Friday, October 16, 2015 11:31 PM, Alastair Neil <ajneil.tech at gmail.com> wrote: I'm getting confused, 120 mb/s is less that 20 MB/s ?unless you mean 120MB/s? On 16 October 2015 at 16:26, Kandalf ? <tinuro at yahoo.com> wrote: No, is real speed. From any computer linux or esxi if I write via NFS with dd utility I have this speed. But if I try to write to one raw file like esxi does in vmdk, than the speed drops to 20-40mb/s. So my issue is low speed when I write into raw image file (using losetup and DD on linux , or esxi vmdk - vm guest) On Friday, October 16, 2015 8:31 PM, Alastair Neil <ajneil.tech at gmail.com> wrote: is that a typo 120mb/s?? Is this volume replica 2 or distributed or both? On 16 October 2015 at 08:05, Kandalf ? <tinuro at yahoo.com> wrote: Hi, I have 2 server with centos 7 and I want to make a replicate storage cluster for the esxi.In both server I have 4 disk in raid 5 mdadm. The write speed on that device is ~250-300MB/s all the time.I create xfs file system on the mdadm and I exported that gluster volume via native fuse nfs v3 to the esxi.Read seed is great but when I try to write to the guest vms I see 20-40MB/s only. I try the test also with gluster distributed with only one brick to one server. If I take one dd write from esxi to the cluster I receive 120mb/s the full ethernet link speed. I also try to mount to linux that volumes and try dd write and the write speed is 120mb/s.But if I try to mount an raw file image with losetup, or use vmdk files, and if I write to them, the speed is 20-40MB/s and I see 12 load on linux.Can someone help me? Thanks! _______________________________________________ Gluster-users mailing list Gluster-users at gluster.org http://www.gluster.org/mailman/listinfo/gluster-users -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://www.gluster.org/pipermail/gluster-users/attachments/20151016/3f2688d9/attachment.html>
Kandalf ®
2015-Oct-16 20:43 UTC
[Gluster-users] gluster 3.7.5 low speed on write and heavy load
I also tried more gluster version but the same situation.If I use iscsi for example to export a raw image... I have 120MB/s write speed. On Friday, October 16, 2015 11:42 PM, Kandalf ? <tinuro at yahoo.com> wrote: If I write with DD in linux locally to the same cluster node... or via network I have 120MB/s. the full speed of te 1 Gbps.But if I write to an RAW Image File... like vmdk in vmware... I have average of 20-40MB/s only. On Friday, October 16, 2015 11:31 PM, Alastair Neil <ajneil.tech at gmail.com> wrote: I'm getting confused, 120 mb/s is less that 20 MB/s ?unless you mean 120MB/s? On 16 October 2015 at 16:26, Kandalf ? <tinuro at yahoo.com> wrote: No, is real speed. From any computer linux or esxi if I write via NFS with dd utility I have this speed. But if I try to write to one raw file like esxi does in vmdk, than the speed drops to 20-40mb/s. So my issue is low speed when I write into raw image file (using losetup and DD on linux , or esxi vmdk - vm guest) On Friday, October 16, 2015 8:31 PM, Alastair Neil <ajneil.tech at gmail.com> wrote: is that a typo 120mb/s?? Is this volume replica 2 or distributed or both? On 16 October 2015 at 08:05, Kandalf ? <tinuro at yahoo.com> wrote: Hi, I have 2 server with centos 7 and I want to make a replicate storage cluster for the esxi.In both server I have 4 disk in raid 5 mdadm. The write speed on that device is ~250-300MB/s all the time.I create xfs file system on the mdadm and I exported that gluster volume via native fuse nfs v3 to the esxi.Read seed is great but when I try to write to the guest vms I see 20-40MB/s only. I try the test also with gluster distributed with only one brick to one server. If I take one dd write from esxi to the cluster I receive 120mb/s the full ethernet link speed. I also try to mount to linux that volumes and try dd write and the write speed is 120mb/s.But if I try to mount an raw file image with losetup, or use vmdk files, and if I write to them, the speed is 20-40MB/s and I see 12 load on linux.Can someone help me? Thanks! _______________________________________________ Gluster-users mailing list Gluster-users at gluster.org http://www.gluster.org/mailman/listinfo/gluster-users -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://www.gluster.org/pipermail/gluster-users/attachments/20151016/0413f8b0/attachment.html>