Gluster users - Mar 2017 - Sharding?

> I've seen the term sharding pop up on the list a number of times but I
> haven't found any documentation or explanation of what it is. Would
someone
> please enlighten me?
It's a way to split the files you put on the volume. With a shard size of 64
MB
for example, the biggest file on the volume will be 64 MB. It's transparent
when accessing the files though, you can still of course write your 2 TB file
and access it as usual.

It's usefull for things like healing (only the shard being headed is locked,
and you have a lot less data to transfert) and for things like hosting a single
huge file that would be bigger than one of your replicas.

We use it for VM disks, as it decreases heal times a lot.

-- 
Kevin Lemonnier
PGP Fingerprint : 89A5 2283 04A0 E6E9 0111
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 801 bytes
Desc: Digital signature
URL:
<http://lists.gluster.org/pipermail/gluster-users/attachments/20170309/c9e184f5/attachment.sig>

On Thu, Mar 9, 2017 at 11:10 AM, Kevin Lemonnier <lemonnierk at ulrar.net>
wrote:
> > I've seen the term sharding pop up on the list a number of times
but I
> > haven't found any documentation or explanation of what it is.
Would
> someone
> > please enlighten me?
>
> It's a way to split the files you put on the volume. With a shard size
of
> 64 MB
> for example, the biggest file on the volume will be 64 MB. It's
transparent
> when accessing the files though, you can still of course write your 2 TB
> file
> and access it as usual.
>
> It's usefull for things like healing (only the shard being headed is
> locked,
> and you have a lot less data to transfert) and for things like hosting a
> single
> huge file that would be bigger than one of your replicas.
>
> We use it for VM disks, as it decreases heal times a lot.
>
>
Some more details on sharding can be found at [1].

Regards,
Vijay

[1] http://blog.gluster.org/2015/12/introducing-shard-translator/
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://lists.gluster.org/pipermail/gluster-users/attachments/20170309/677c7249/attachment.html>