Gluster users - Oct 2016 - Performance

What version of Gluster?  Are you using glusterfs or nfs mount?  Any other
traffic on the network, is the cluster quiescent apart from your dd test?

It does seem slow.  I have a three server cluster, using straight xfs over
10G with Gluster 3.8 and glusterfs mounts and I see:

[root at sb-c 192.168.10.49:VM]# sync; dd if=/dev/zero of=nfsp2 bs=1M
count=1024; sync
1024+0 records in
1024+0 records out
1073741824 bytes (1.1 GB) copied, 11.3322 s, 94.8 MB/s
[root at sb-c 192.168.10.49:VM]# sync; dd if=/dev/zero of=nfsp2 bs=1M
count=10240; sync
10240+0 records in
10240+0 records out
10737418240 bytes (11 GB) copied, 117.854 s, 91.1 MB/s

this is on a cluster serving 5 ovirt nodes and about 60 running VMs.



On 25 October 2016 at 12:50, Service Mail <ciclopeblu at gmail.com> wrote:
> Hello,
>
> I have the following setup:
>
> 3x zfs raidz2 servers with a single gluster 3.8 replicated volume across a
> 10G network
>
> Everything is working fine however performance looks very poor to me:
>
>
> root at Client:/test_mount# sync; dd if=/dev/zero of=nfsp2 bs=1M
count=1024;
> sync
> 1024+0 records in
> 1024+0 records out
> 1073741824 bytes (1.1 GB, 1.0 GiB) copied, 32.1786 s, 33.4 MB/s
>
> root at Client:/test_mount# sync; dd if=/dev/zero of=nfsp2 bs=1M
> count=10240; sync
> 10240+0 records in
> 10240+0 records out
> 10737418240 bytes (11 GB, 10 GiB) copied, 301.563 s, 35.6 MB/s
>
> Are those reading normal? Where should I look to increase performance?
>
> Thanks,
>
> Ciclope
>
>
>
>
> _______________________________________________
> Gluster-users mailing list
> Gluster-users at gluster.org
> http://www.gluster.org/mailman/listinfo/gluster-users
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://www.gluster.org/pipermail/gluster-users/attachments/20161031/6ef13d67/attachment.html>

On 10/31/2016 08:29 AM, Alastair Neil wrote:
> What version of Gluster?  Are you using glusterfs or nfs mount?  Any 
> other traffic on the network, is the cluster quiescent apart from your 
> dd test?
>
What type of volume?
> It does seem slow.  I have a three server cluster, using straight xfs 
> over 10G with Gluster 3.8 and glusterfs mounts and I see:
>
> [root at sb-c 192.168.10.49:VM]# sync; dd if=/dev/zero of=nfsp2 bs=1M 
> count=1024; sync
> 1024+0 records in
> 1024+0 records out
> 1073741824 bytes (1.1 GB) copied, 11.3322 s, 94.8 MB/s
> [root at sb-c 192.168.10.49:VM]# sync; dd if=/dev/zero of=nfsp2 bs=1M 
> count=10240; sync
> 10240+0 records in
> 10240+0 records out
> 10737418240 bytes (11 GB) copied, 117.854 s, 91.1 MB/s
>
> this is on a cluster serving 5 ovirt nodes and about 60 running VMs.
>
>
>
> On 25 October 2016 at 12:50, Service Mail <ciclopeblu at gmail.com 
> <mailto:ciclopeblu at gmail.com>> wrote:
>
>     Hello,
>
>     I have the following setup:
>
>     3x zfs raidz2 servers with a single gluster 3.8 replicated volume
>     across a 10G network
>
>     Everything is working fine however performance looks very poor to me:
>
>
>     root at Client:/test_mount# sync; dd if=/dev/zero of=nfsp2 bs=1M
>     count=1024; sync
>     1024+0 records in
>     1024+0 records out
>     1073741824 bytes (1.1 GB, 1.0 GiB) copied, 32.1786 s, 33.4 MB/s
>
>     root at Client:/test_mount# sync; dd if=/dev/zero of=nfsp2 bs=1M
>     count=10240; sync
>     10240+0 records in
>     10240+0 records out
>     10737418240 bytes (11 GB, 10 GiB) copied, 301.563 s, 35.6 MB/s
>
>     Are those reading normal? Where should I look to increase performance?
>
>     Thanks,
>
>     Ciclope
>
>
>
>
>     _______________________________________________
>     Gluster-users mailing list
>     Gluster-users at gluster.org <mailto:Gluster-users at
gluster.org>
>     http://www.gluster.org/mailman/listinfo/gluster-users
>     <http://www.gluster.org/mailman/listinfo/gluster-users>
>
>
>
>
> _______________________________________________
> Gluster-users mailing list
> Gluster-users at gluster.org
> http://www.gluster.org/mailman/listinfo/gluster-users
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://www.gluster.org/pipermail/gluster-users/attachments/20161031/f4e8ea8b/attachment.html>