Gluster users - Feb 2015 - [Gluster-devel] Looking for volunteer to write up official "How to do GlusterFS in the Cloud: The Right Way" for Rackspace...

Yeah, that'd be pretty optimal.  How full on do you want to go?

Should we look into arranging some OnMetal stuff, in addition to the
VM offerings?

Jesse, Ben is our *very best* GlusterFS and RHS performance tuning
expert, so capturing his interest is a *very* good thing. ;)

+ Justin

On 17 Feb 2015, at 23:10, Benjamin Turner <bennyturns at gmail.com>
wrote:
> This is interesting to me, I'd like the chance to run my performance
tests on a cloud provider's systems.  We could put together some
recommendations for configuration, tuning, and performance numbers?  Also it
would be cool to enhance my setup scripts to work with cloud instances.  Sound
like what you are looking for ish?
> 
> -b
> 
> On Tue, Feb 17, 2015 at 5:06 PM, Justin Clift <justin at gluster.org>
wrote:
> On 17 Feb 2015, at 21:49, Josh Boon <gluster at joshboon.com> wrote:
> > Do we have use cases to focus on? Gluster is part of the answer to
many different questions so if it's things like simple replication and
distribution and basic performance tuning I could help. I also have a heavy
Ubuntu tilt so if it's Red Hat oriented I'm not much help :)
> 
> Jesse, thoughts on this?
> 
> I kinda think it would be useful to have instructions which give
> correct steps for Ubuntu + Red Hat (and anything else suitable).
> 
> Josh, if Jesse agrees, then your Ubuntu knowledge will probably
> be useful for this. ;)
> 
> + Justin
> 
> 
> >
> > ----- Original Message -----
> > From: "Justin Clift" <justin at gluster.org>
> > To: "Gluster Users" <gluster-users at gluster.org>,
"Gluster Devel" <gluster-devel at gluster.org>
> > Cc: "Jesse Noller" <jesse.noller at rackspace.com>
> > Sent: Tuesday, February 17, 2015 9:37:05 PM
> > Subject: [Gluster-devel] Looking for volunteer to write up official
"How to   do GlusterFS in the Cloud: The Right Way" for Rackspace...
> >
> > Yeah, huge subject line.  :)
> >
> > But it gets the message across... Rackspace provide us a *bunch* of
online VM's
> > which we have our infrastructure in + run the majority of our
regression tests
> > with.
> >
> > They've asked us if we could write up a "How to do GlusterFS
in the Cloud: The
> > Right Way" (technical) doc, for them to add to their doc
collection.
> > They get asked for this a lot by customers. :D
> >
> > Sooo... looking for volunteers to write this up.  And yep, you're
welcome to
> > have your name all over it (eg this is good promo/CV material :>)
> >
> > VM's (in Rackspace obviously) will be provided of course.
> >
> > Anyone interested?
> >
> > (Note - not suitable for a GlusterFS newbie. ;))
> >
> > Regards and best wishes,
> >
> > Justin Clift
> >
> > --
> > GlusterFS - http://www.gluster.org
> >
> > An open source, distributed file system scaling to several
> > petabytes, and handling thousands of clients.
> >
> > My personal twitter: twitter.com/realjustinclift
> >
> > _______________________________________________
> > Gluster-devel mailing list
> > Gluster-devel at gluster.org
> > http://www.gluster.org/mailman/listinfo/gluster-devel
> 
> --
> GlusterFS - http://www.gluster.org
> 
> An open source, distributed file system scaling to several
> petabytes, and handling thousands of clients.
> 
> My personal twitter: twitter.com/realjustinclift
> 
> _______________________________________________
> Gluster-devel mailing list
> Gluster-devel at gluster.org
> http://www.gluster.org/mailman/listinfo/gluster-devel
> 
--
GlusterFS - http://www.gluster.org

An open source, distributed file system scaling to several
petabytes, and handling thousands of clients.

My personal twitter: twitter.com/realjustinclift

----- Original Message -----
> From: "Justin Clift" <justin at gluster.org>
> To: "Benjamin Turner" <bennyturns at gmail.com>
> Cc: "Gluster Users" <gluster-users at gluster.org>,
"Gluster Devel" <gluster-devel at gluster.org>, "Jesse
Noller"
> <jesse.noller at rackspace.com>
> Sent: Tuesday, February 17, 2015 6:52:48 PM
> Subject: Re: [Gluster-users] [Gluster-devel] Looking for volunteer to write
up official "How to do GlusterFS in the
> Cloud: The Right Way"	for Rackspace...
> 
> Yeah, that'd be pretty optimal.  How full on do you want to go?
I have some benchmark kits that can easily be enhanced to work with ubuntu, it
should just be a matter of checking /etc/redaht-release and the ubuntu
equivalent and running apt instead of yum.  I was thinking I could do the
testing on the RPM based systems and the other contributor could run on deb?  We
can share scripts / tuning / recommendations and at the end of this could have
nice setup / benchmark kits that work on a variety of OSs + the DOC we are
looking for.  The tool uses IOZone, smallfile, and fio, runs the tool N # of
times to get sample set, and does some statistical analysis on the samples(avg,
std dev, delta between samples) before moving on to the next test.
> Should we look into arranging some OnMetal stuff, in addition to the
> VM offerings?
I have all the BM numbers we can handle, happy to provide them.  1G, 10G, RDMA,
spinning and SSDs.  I will be rerunning everything with the mt epoll + RDMA
changes also.
> 
> Jesse, Ben is our *very best* GlusterFS and RHS performance tuning
> expert, so capturing his interest is a *very* good thing. ;)
A little overstated but the sentiment is appreciated :)
> 
> + Justin
> 
> On 17 Feb 2015, at 23:10, Benjamin Turner <bennyturns at gmail.com>
wrote:
> > This is interesting to me, I'd like the chance to run my
performance tests
> > on a cloud provider's systems.  We could put together some
recommendations
> > for configuration, tuning, and performance numbers?  Also it would be
cool
> > to enhance my setup scripts to work with cloud instances.  Sound like
what
> > you are looking for ish?
> > 
> > -b
> > 
> > On Tue, Feb 17, 2015 at 5:06 PM, Justin Clift <justin at
gluster.org> wrote:
> > On 17 Feb 2015, at 21:49, Josh Boon <gluster at joshboon.com>
wrote:
> > > Do we have use cases to focus on? Gluster is part of the answer
to many
> > > different questions so if it's things like simple replication
and
> > > distribution and basic performance tuning I could help. I also
have a
> > > heavy Ubuntu tilt so if it's Red Hat oriented I'm not
much help :)
> > 
> > Jesse, thoughts on this?
> > 
> > I kinda think it would be useful to have instructions which give
> > correct steps for Ubuntu + Red Hat (and anything else suitable).
> > 
> > Josh, if Jesse agrees, then your Ubuntu knowledge will probably
> > be useful for this. ;)
> > 
> > + Justin
> > 
> > 
> > >
> > > ----- Original Message -----
> > > From: "Justin Clift" <justin at gluster.org>
> > > To: "Gluster Users" <gluster-users at
gluster.org>, "Gluster Devel"
> > > <gluster-devel at gluster.org>
> > > Cc: "Jesse Noller" <jesse.noller at
rackspace.com>
> > > Sent: Tuesday, February 17, 2015 9:37:05 PM
> > > Subject: [Gluster-devel] Looking for volunteer to write up
official "How
> > > to   do GlusterFS in the Cloud: The Right Way" for
Rackspace...
> > >
> > > Yeah, huge subject line.  :)
> > >
> > > But it gets the message across... Rackspace provide us a *bunch*
of
> > > online VM's
> > > which we have our infrastructure in + run the majority of our
regression
> > > tests
> > > with.
> > >
> > > They've asked us if we could write up a "How to do
GlusterFS in the
> > > Cloud: The
> > > Right Way" (technical) doc, for them to add to their doc
collection.
> > > They get asked for this a lot by customers. :D
> > >
> > > Sooo... looking for volunteers to write this up.  And yep,
you're welcome
> > > to
> > > have your name all over it (eg this is good promo/CV material
:>)
> > >
> > > VM's (in Rackspace obviously) will be provided of course.
> > >
> > > Anyone interested?
> > >
> > > (Note - not suitable for a GlusterFS newbie. ;))
> > >
> > > Regards and best wishes,
> > >
> > > Justin Clift
> > >
> > > --
> > > GlusterFS - http://www.gluster.org
> > >
> > > An open source, distributed file system scaling to several
> > > petabytes, and handling thousands of clients.
> > >
> > > My personal twitter: twitter.com/realjustinclift
> > >
> > > _______________________________________________
> > > Gluster-devel mailing list
> > > Gluster-devel at gluster.org
> > > http://www.gluster.org/mailman/listinfo/gluster-devel
> > 
> > --
> > GlusterFS - http://www.gluster.org
> > 
> > An open source, distributed file system scaling to several
> > petabytes, and handling thousands of clients.
> > 
> > My personal twitter: twitter.com/realjustinclift
> > 
> > _______________________________________________
> > Gluster-devel mailing list
> > Gluster-devel at gluster.org
> > http://www.gluster.org/mailman/listinfo/gluster-devel
> > 
> 
> --
> GlusterFS - http://www.gluster.org
> 
> An open source, distributed file system scaling to several
> petabytes, and handling thousands of clients.
> 
> My personal twitter: twitter.com/realjustinclift
> 
> _______________________________________________
> Gluster-users mailing list
> Gluster-users at gluster.org
> http://www.gluster.org/mailman/listinfo/gluster-users
>

Sorry, this is what I get for logging off for the night: short answer is YES. At
the end of the day I want to showcase gluster' awesomeness and also be able
to show users how to do it right in the cloud for shared, fault tolerant file
systems

Jesse
> On Feb 17, 2015, at 5:53 PM, Justin Clift <justin at gluster.org>
wrote:
> 
> Yeah, that'd be pretty optimal.  How full on do you want to go?
> 
> Should we look into arranging some OnMetal stuff, in addition to the
> VM offerings?
> 
> Jesse, Ben is our *very best* GlusterFS and RHS performance tuning
> expert, so capturing his interest is a *very* good thing. ;)
> 
> + Justin
> 
>> On 17 Feb 2015, at 23:10, Benjamin Turner <bennyturns at
gmail.com> wrote:
>> This is interesting to me, I'd like the chance to run my
performance tests on a cloud provider's systems.  We could put together some
recommendations for configuration, tuning, and performance numbers?  Also it
would be cool to enhance my setup scripts to work with cloud instances.  Sound
like what you are looking for ish?
>> 
>> -b
>> 
>> On Tue, Feb 17, 2015 at 5:06 PM, Justin Clift <justin at
gluster.org> wrote:
>>> On 17 Feb 2015, at 21:49, Josh Boon <gluster at joshboon.com>
wrote:
>>> Do we have use cases to focus on? Gluster is part of the answer to
many different questions so if it's things like simple replication and
distribution and basic performance tuning I could help. I also have a heavy
Ubuntu tilt so if it's Red Hat oriented I'm not much help :)
>> 
>> Jesse, thoughts on this?
>> 
>> I kinda think it would be useful to have instructions which give
>> correct steps for Ubuntu + Red Hat (and anything else suitable).
>> 
>> Josh, if Jesse agrees, then your Ubuntu knowledge will probably
>> be useful for this. ;)
>> 
>> + Justin
>> 
>> 
>>> 
>>> ----- Original Message -----
>>> From: "Justin Clift" <justin at gluster.org>
>>> To: "Gluster Users" <gluster-users at gluster.org>,
"Gluster Devel" <gluster-devel at gluster.org>
>>> Cc: "Jesse Noller" <jesse.noller at rackspace.com>
>>> Sent: Tuesday, February 17, 2015 9:37:05 PM
>>> Subject: [Gluster-devel] Looking for volunteer to write up official
"How to   do GlusterFS in the Cloud: The Right Way" for Rackspace...
>>> 
>>> Yeah, huge subject line.  :)
>>> 
>>> But it gets the message across... Rackspace provide us a *bunch* of
online VM's
>>> which we have our infrastructure in + run the majority of our
regression tests
>>> with.
>>> 
>>> They've asked us if we could write up a "How to do
GlusterFS in the Cloud: The
>>> Right Way" (technical) doc, for them to add to their doc
collection.
>>> They get asked for this a lot by customers. :D
>>> 
>>> Sooo... looking for volunteers to write this up.  And yep,
you're welcome to
>>> have your name all over it (eg this is good promo/CV material
:>)
>>> 
>>> VM's (in Rackspace obviously) will be provided of course.
>>> 
>>> Anyone interested?
>>> 
>>> (Note - not suitable for a GlusterFS newbie. ;))
>>> 
>>> Regards and best wishes,
>>> 
>>> Justin Clift
>>> 
>>> --
>>> GlusterFS - http://www.gluster.org
>>> 
>>> An open source, distributed file system scaling to several
>>> petabytes, and handling thousands of clients.
>>> 
>>> My personal twitter: twitter.com/realjustinclift
>>> 
>>> _______________________________________________
>>> Gluster-devel mailing list
>>> Gluster-devel at gluster.org
>>> http://www.gluster.org/mailman/listinfo/gluster-devel
>> 
>> --
>> GlusterFS - http://www.gluster.org
>> 
>> An open source, distributed file system scaling to several
>> petabytes, and handling thousands of clients.
>> 
>> My personal twitter: twitter.com/realjustinclift
>> 
>> _______________________________________________
>> Gluster-devel mailing list
>> Gluster-devel at gluster.org
>> http://www.gluster.org/mailman/listinfo/gluster-devel
> 
> --
> GlusterFS - http://www.gluster.org
> 
> An open source, distributed file system scaling to several
> petabytes, and handling thousands of clients.
> 
> My personal twitter: twitter.com/realjustinclift
>

On 18 Feb 2015, at 13:50, Jesse Noller <jesse.noller at rackspace.com>
wrote:
> Sorry, this is what I get for logging off for the night: short answer is
YES. At the end of the day I want to showcase gluster' awesomeness and also
be able to show users how to do it right in the cloud for shared, fault tolerant
file systems
Looks like we have four volunteers:

* Ben Turner (primary GlusterFS perf tuning guy)
* Jeff Darcy (greybeard GlusterFS developer and scalability expert)
* Josh Boon (experienced GlusterFS guy - Ubuntu focused)
* Nico Schottelius (newer GlusterFS guy - familiar with Ubuntu/CentOS)

This sounds like a fairly good mix, so lets go with that.

Ben and Jeff, does it make sense for you two to do the leading, with
Josh and Nico involved and learning/assisting/idea-generation/stuff as
needed?

In our initial discussion, Jesse mentioned the required output is
Markdown + diagrams, and he'll get the Rackspace design people to
make things *look awesome*.  Guessing they'll redo the diagrams for
prettiness then, so any we output just need to be functional to
convey info?

Jesse, we're pretty maxxed out in our VM's atm (over the sponsorship
monthly budget).  Are you able to setup something just for this
effort, or is there a better way, or ? :)

+ Justin

--
GlusterFS - http://www.gluster.org

An open source, distributed file system scaling to several
petabytes, and handling thousands of clients.

My personal twitter: twitter.com/realjustinclift