Gluster users - Jul 2016 - New cluster - first experience

2016-07-09 7:05 GMT+02:00 Alastair Neil <ajneil.tech at
gmail.com>:
> did you test both nics in the bond separately on all the servers and
client?
Just to keep things simple, i've removed the bonding and I'm using a
single gigabit connection on each server.

These are some iperf results, made from the only client connecting to
this gluster cluster (via fuse/gluster):

# for i in 1.2.3.112 1.2.3.113 1.2.3.114; do iperf -c $i; done
------------------------------------------------------------
Client connecting to 1.2.3.112, TCP port 5001
TCP window size: 85.0 KByte (default)
------------------------------------------------------------
[  3] local 1.2.3.121 port 34405 connected with 1.2.3.112 port 5001
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-10.0 sec  1.10 GBytes   943 Mbits/sec
------------------------------------------------------------
Client connecting to 1.2.3.113, TCP port 5001
TCP window size: 85.0 KByte (default)
------------------------------------------------------------
[  3] local 1.2.3.121 port 51302 connected with 1.2.3.113 port 5001
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-10.0 sec  1.10 GBytes   943 Mbits/sec
------------------------------------------------------------
Client connecting to 1.2.3.114, TCP port 5001
TCP window size: 85.0 KByte (default)
------------------------------------------------------------
[  3] local 1.2.3.121 port 35503 connected with 1.2.3.114 port 5001
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-10.0 sec  1.10 GBytes   942 Mbits/sec


Network seems to be fine but i'm still having low performances when
trying to extract the kernel sources or "dd" a huge file.

On 11/07/2016 10:33 PM, Gandalf Corvotempesta wrote:
> Just to keep things simple, i've removed the bonding and I'm using
a
> single gigabit connection on each server.
With Replica 3, your client will be writing to 3 servers simultaneously 
over a single 1Gb connection, resulting in a maximum write bandwidth of 
33Mbs.


In your earlier testing, if bonding wasn't enabled on the switch - which 
I believe only supports LACP, then I think you would again be limited to 
a single 1Gb connection shared over 3 servers. But I'm not an expert on 
bonding interfaces.

-- 
Lindsay Mathieson