Gandalf Corvotempesta
2016-Jul-13 11:17 UTC
[Gluster-users] New cluster - first experience
2016-07-13 10:24 GMT+02:00 Pranith Kumar Karampuri <pkarampu at redhat.com>:> We are in the process of making shard available for general purpose > usecases.Any ETA? Anyway, i did another test. This time the "client" has 4 bonded gigabit nic (balance-rr) and each server has 2 bonded gigabit nic (balance-rr). (previously i had an issue with bonding on our switch) With sharding (64MB): # echo 3 > /proc/sys/vm/drop_caches; dd if=/dev/zero of=test bs=1M count=1000 conv=fsync 1000+0 record dentro 1000+0 record fuori 1048576000 byte (1,0 GB) copiati, 89,2066 s, 11,8 MB/s Without sharding: # echo 3 > /proc/sys/vm/drop_caches; dd if=/dev/zero of=test bs=1M count=1000 conv=fsync 1000+0 record dentro 1000+0 record fuori 1048576000 byte (1,0 GB) copiati, 17,759 s, 59,0 MB/s WOW! But still far away from HDD speed (about 120MB/s) With 4 bonded nic, I have 4000gbit of bandwidth. 4000/8 = 500MB/s With this configuration gluster should be able to write at full speed on 3 nodes at once. Each node has 2000/8 = 250MB/s of bandwidth, twice the hdd speed.
Pranith Kumar Karampuri
2016-Jul-13 12:16 UTC
[Gluster-users] New cluster - first experience
On Wed, Jul 13, 2016 at 4:47 PM, Gandalf Corvotempesta < gandalf.corvotempesta at gmail.com> wrote:> 2016-07-13 10:24 GMT+02:00 Pranith Kumar Karampuri <pkarampu at redhat.com>: > > We are in the process of making shard available for general purpose > > usecases. > > Any ETA? >Design hasn't finalized so hard to tell.> > Anyway, i did another test. This time the "client" has 4 bonded > gigabit nic (balance-rr) and each server has 2 bonded gigabit nic > (balance-rr). (previously i had an issue with bonding on our switch) > > With sharding (64MB): > # echo 3 > /proc/sys/vm/drop_caches; dd if=/dev/zero of=test bs=1M > count=1000 conv=fsync > 1000+0 record dentro > 1000+0 record fuori > 1048576000 byte (1,0 GB) copiati, 89,2066 s, 11,8 MB/s > > > Without sharding: > # echo 3 > /proc/sys/vm/drop_caches; dd if=/dev/zero of=test bs=1M > count=1000 conv=fsync > 1000+0 record dentro > 1000+0 record fuori > 1048576000 byte (1,0 GB) copiati, 17,759 s, 59,0 MB/s > > WOW! But still far away from HDD speed (about 120MB/s) > > > With 4 bonded nic, I have 4000gbit of bandwidth. > 4000/8 = 500MB/s > With this configuration gluster should be able to write at full speed > on 3 nodes at once. > Each node has 2000/8 = 250MB/s of bandwidth, twice the hdd speed. >If you do a plain nfs mount of the brick without any gluster in picture what is the speed you get? -- Pranith -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://www.gluster.org/pipermail/gluster-users/attachments/20160713/d1b70433/attachment.html>