Gluster users - Jul 2016 - New cluster - first experience

We are in the process of making shard available for general purpose
usecases.

On Wed, Jul 13, 2016 at 12:14 PM, Gandalf Corvotempesta <
gandalf.corvotempesta at gmail.com> wrote:
> Il 13 lug 2016 05:39, "Pranith Kumar Karampuri" <pkarampu at
redhat.com>:
> > May be you gave very small shard size(default is 4MB) which makes the
> workload small-file workload? Can you try with 512MB or something and see?
> >
>
> volume configuration was posted previously
> I'm trying with 64MB but i didn't see any appreciable speed gain
moving
> from 4mb to 64mb
>


-- 
Pranith
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://www.gluster.org/pipermail/gluster-users/attachments/20160713/1cb8870b/attachment.html>

2016-07-13 10:24 GMT+02:00 Pranith Kumar Karampuri <pkarampu at
redhat.com>:
> We are in the process of making shard available for general purpose
> usecases.
Any ETA?

Anyway, i did another test. This time the "client" has 4 bonded
gigabit nic (balance-rr) and each server has 2 bonded gigabit nic
(balance-rr). (previously i had an issue with bonding on our switch)

With sharding (64MB):
# echo 3 > /proc/sys/vm/drop_caches; dd if=/dev/zero of=test bs=1M
count=1000 conv=fsync
1000+0 record dentro
1000+0 record fuori
1048576000 byte (1,0 GB) copiati, 89,2066 s, 11,8 MB/s


Without sharding:
# echo 3 > /proc/sys/vm/drop_caches; dd if=/dev/zero of=test bs=1M
count=1000 conv=fsync
1000+0 record dentro
1000+0 record fuori
1048576000 byte (1,0 GB) copiati, 17,759 s, 59,0 MB/s

WOW! But still far away from HDD speed (about 120MB/s)


With 4 bonded nic, I have 4000gbit of bandwidth.
4000/8 = 500MB/s
With this configuration gluster should be able to write at full speed
on 3 nodes at once.
Each node has 2000/8 = 250MB/s of bandwidth, twice the hdd speed.