Kandalf ®
2015-Oct-16 12:05 UTC
[Gluster-users] gluster 3.7.5 low speed on write and heavy load
Hi, I have 2 server with centos 7 and I want to make a replicate storage cluster for the esxi.In both server I have 4 disk in raid 5 mdadm. The write speed on that device is ~250-300MB/s all the time.I create xfs file system on the mdadm and I exported that gluster volume via native fuse nfs v3 to the esxi.Read seed is great but when I try to write to the guest vms I see 20-40MB/s only. I try the test also with gluster distributed with only one brick to one server. If I take one dd write from esxi to the cluster I receive 120mb/s the full ethernet link speed. I also try to mount to linux that volumes and try dd write and the write speed is 120mb/s.But if I try to mount an raw file image with losetup, or use vmdk files, and if I write to them, the speed is 20-40MB/s and I see 12 load on linux.Can someone help me? Thanks! -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://www.gluster.org/pipermail/gluster-users/attachments/20151016/deb71354/attachment.html>
Alastair Neil
2015-Oct-16 17:31 UTC
[Gluster-users] gluster 3.7.5 low speed on write and heavy load
is that a typo 120mb/s? Is this volume replica 2 or distributed or both? On 16 October 2015 at 08:05, Kandalf ? <tinuro at yahoo.com> wrote:> Hi, > > I have 2 server with centos 7 and I want to make a replicate storage > cluster for the esxi. > In both server I have 4 disk in raid 5 mdadm. The write speed on that > device is ~250-300MB/s all the time. > I create xfs file system on the mdadm and I exported that gluster volume > via native fuse nfs v3 to the esxi. > Read seed is great but when I try to write to the guest vms I see > 20-40MB/s only. I try the test also with gluster distributed with only one > brick to one server. If I take one dd write from esxi to the cluster I > receive 120mb/s the full ethernet link speed. I also try to mount to linux > that volumes and try dd write and the write speed is 120mb/s. > But if I try to mount an raw file image with losetup, or use vmdk files, > and if I write to them, the speed is 20-40MB/s and I see 12 load on linux. > Can someone help me? > > Thanks! > > > > _______________________________________________ > Gluster-users mailing list > Gluster-users at gluster.org > http://www.gluster.org/mailman/listinfo/gluster-users >-------------- next part -------------- An HTML attachment was scrubbed... URL: <http://www.gluster.org/pipermail/gluster-users/attachments/20151016/d2d5b15a/attachment.html>
Lindsay Mathieson
2015-Oct-16 22:12 UTC
[Gluster-users] gluster 3.7.5 low speed on write and heavy load
On 16 October 2015 at 22:05, Kandalf ? <tinuro at yahoo.com> wrote:> But if I try to mount an raw file image with losetup, or use vmdk files, > and if I write to them, the speed is 20-40MB/s and I see 12 load on linux.What VM hosting are you using? KVM/Qemu? vSphere? How is the image shared out? gfapi? nfs? -- Lindsay -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://www.gluster.org/pipermail/gluster-users/attachments/20151017/c1febb8c/attachment.html>