Gluster users - Dec 2013 - Ubuntu GlusterFS in Production

Hi,

Is anyone using GlusterFS on Ubuntu in production?  Specifically, I'm
looking at using the NFS portion of it over a bonded interface.  I believe
I'll get better speed than user the gluster client across a single
interface.

Setup:

3 servers running KVM (about 24 VM's)
2 NAS boxes running Ubuntu (13.04 and 13.10)

Since Gluster NFS does server side replication, I'll put replication data
over a different nic than user data.

Gerald

ps: I had this setup with 3.2, but it proved unstable under load.

Hi Gerald,

Yes, we are using GlusterFS 3.3.2 with Ubuntu 12.04, KVM and bonding 802.3ad on
2 x 1Gbps nic. This way every tcp session can go over a different nic.

For vmWare vSphere we use the NFS of GlusterFS and for KVM the native glusterfs
client.

This setup is working nice.

Grtz, Jiri
 
On 05 Dec 2013, at 14:49, Gerald Brandt <gbr at majentis.com> wrote:
> Hi,
> 
> Is anyone using GlusterFS on Ubuntu in production?  Specifically, I'm
looking at using the NFS portion of it over a bonded interface.  I believe
I'll get better speed than user the gluster client across a single
interface.
> 
> Setup:
> 
> 3 servers running KVM (about 24 VM's)
> 2 NAS boxes running Ubuntu (13.04 and 13.10)
> 
> Since Gluster NFS does server side replication, I'll put replication
data over a different nic than user data.
> 
> Gerald
> 
> ps: I had this setup with 3.2, but it proved unstable under load.
> _______________________________________________
> Gluster-users mailing list
> Gluster-users at gluster.org
> http://supercolony.gluster.org/mailman/listinfo/gluster-users

We're using it in production too. We're on KVM 1.6, gluster 3.4.1
running on Ubuntu 13.04.  No problems but do be aware that you'll want fast
links if you actually want to saturate your disk bandwidth. We've bonded
10gbps links and we still saturate those before we fully utilize our IO.
I've not tested NFS specifically but performance is something you're
looking for I'd strongly suggest gfapi which gets us near 400MBps writes in
a replica 2 config across the above mentioned interfaces.  You'll have to do
some work on the KVM sources for gfapi though as it's not even made it into
the debian unstable packages.


Best,
Josh
----- Original Message -----
From: "Jiri Hoogeveen" <j.hoogeveen at bluebillywig.com>
To: "Gerald Brandt" <gbr at majentis.com>
Cc: "gluster-users at gluster.org List" <gluster-users at
gluster.org>
Sent: Thursday, December 5, 2013 11:31:34 AM
Subject: Re: [Gluster-users] Ubuntu GlusterFS in Production

Hi Gerald,

Yes, we are using GlusterFS 3.3.2 with Ubuntu 12.04, KVM and bonding 802.3ad on
2 x 1Gbps nic. This way every tcp session can go over a different nic.

For vmWare vSphere we use the NFS of GlusterFS and for KVM the native glusterfs
client.

This setup is working nice.

Grtz, Jiri
 
On 05 Dec 2013, at 14:49, Gerald Brandt <gbr at majentis.com> wrote:
> Hi,
> 
> Is anyone using GlusterFS on Ubuntu in production?  Specifically, I'm
looking at using the NFS portion of it over a bonded interface.  I believe
I'll get better speed than user the gluster client across a single
interface.
> 
> Setup:
> 
> 3 servers running KVM (about 24 VM's)
> 2 NAS boxes running Ubuntu (13.04 and 13.10)
> 
> Since Gluster NFS does server side replication, I'll put replication
data over a different nic than user data.
> 
> Gerald
> 
> ps: I had this setup with 3.2, but it proved unstable under load.
> _______________________________________________
> Gluster-users mailing list
> Gluster-users at gluster.org
> http://supercolony.gluster.org/mailman/listinfo/gluster-users
_______________________________________________
Gluster-users mailing list
Gluster-users at gluster.org
http://supercolony.gluster.org/mailman/listinfo/gluster-users