Gluster users - Nov 2016 - Looking for use cases / opinions

Everyone, thanks in advance.

We are looking to add a large filesystem to our compute facility at GMU.  We are
investigating if Gluster can work in a University setting for some HPC work, and
general research computing.  Does anyone have use cases where Gluster has been
used in a university setting?

The idea we have is to build a 2-3PB GlusterFS system.   We would probably use
commodity 1u servers with 60 drive JBODS attached, from a reputable vendor
(Dell, HP, etc).  Is 60 the maximum number of drives that?s recommended per
server, or could we use 2 jbods per server?  Everything will be connected to a
10GB network.  Clients are mostly linux.

Are there ways to minimize the latency for stat commands like ls and du?  We
have some previous experience with Gluster and found the stat performance to be
sluggish frequently.

Thanks,

Thomas

On 11/04/2016 11:05 AM, Thomas Wakefield wrote:
> Are there ways to minimize the latency for stat commands like ls and du? 
We have some previous experience with Gluster and found the stat performance to
be sluggish frequently.
You could build your GlusterFS out of low-latency disks like SSDs :)

Regards,
-- 
Alex Chekholko chekh at stanford.edu

Still looking for use cases and opinions for Gluster in an education / HPC
environment.  Thanks.

> On Nov 4, 2016, at 2:05 PM, Thomas Wakefield <dwakefi2 at gmu.edu>
wrote:
> 
> Everyone, thanks in advance.
> 
> We are looking to add a large filesystem to our compute facility at GMU. 
We are investigating if Gluster can work in a University setting for some HPC
work, and general research computing.  Does anyone have use cases where Gluster
has been used in a university setting?
> 
> The idea we have is to build a 2-3PB GlusterFS system.   We would probably
use commodity 1u servers with 60 drive JBODS attached, from a reputable vendor
(Dell, HP, etc).  Is 60 the maximum number of drives that?s recommended per
server, or could we use 2 jbods per server?  Everything will be connected to a
10GB network.  Clients are mostly linux.
> 
> Are there ways to minimize the latency for stat commands like ls and du? 
We have some previous experience with Gluster and found the stat performance to
be sluggish frequently.
> 
> Thanks,
> 
> Thomas
> _______________________________________________
> Gluster-users mailing list
> Gluster-users at gluster.org
> http://www.gluster.org/mailman/listinfo/gluster-users