Gluster users - Jun 2013 - Separate replication/self-healing and access traffic

Hi,

just read the official documentation and googled for separation of storage
replication /self-healing networking & storage-access network via
NFS/GlusterFS-client,
but I couldn't find a clear answer.

Is it possible to separate replication & access network with the options

option transport.socket.bind-address

option auth.addr.brick.allow

?

If so, is it possible to run native glusterFS or do I have to use NFS for
storage access and  first option to allow server-side replication?

Is there any issues I may run into or I didn't pay attention at this point?

We have two storage Servers with 8 GBit NICs, so my plan was to bond 4 NICs via
balance-rr (better for 1:1)  for bind address,
and bond 4 NICs via LACP (better for 1-n) .
Usage: RHEV Storage Server

I really appreciate your feedback here!

Thanks in advance.

Best, Sven.



Sven Knohsalla | System Administration

Office +49 631 68036 433 | Fax +49 631 68036 111  |E-Mail s.knohsalla at
netbiscuits.com | Skype: netbiscuits.admin
Netbiscuits GmbH | Europaallee 10 | 67657 | GERMANY

[https://my.netbiscuits.com/image/image_gallery?uuid=3a1a9d19-c305-4032-8cef-00b03c3d4c79&groupId=10211&t=1361534926402]<http://www.netbiscuits.com/>

 [https://my.netbiscuits.com/image/image_gallery?uuid=9e553e7b-3e7d-4784-b274-15aa1dfb48e2&groupId=10211&t=1361533377340]
<https://www.netbiscuits.com/news> 
[https://my.netbiscuits.com/image/image_gallery?uuid=1d1a5e29-ceda-4ab1-9353-67a1e838364d&groupId=10211&t=1347281040591]
<https://twitter.com/netbiscuits> 
[https://my.netbiscuits.com/image/image_gallery?uuid=c99bf866-be25-4236-a0ee-dca68ec828a5&groupId=10211&t=1347280983848]
<http://www.linkedin.com/company/netbiscuits> 
[https://my.netbiscuits.com/image/image_gallery?uuid=d62ba951-14dc-450d-b5f1-be33884225e3&groupId=10211&t=1347280983872]
<http://www.xing.com/companies/netbiscuitsgmbh> 
[https://my.netbiscuits.com/image/image_gallery?uuid=7b28f500-f415-40bb-851f-0cd55beeaf45&groupId=10211&t=1347280983791]
<https://www.facebook.com/Netbiscuits> 
[https://my.netbiscuits.com/image/image_gallery?uuid=cc8764d0-a5ac-4623-bb63-da3ca7c97f94&groupId=10211&t=1347280983836]
<https://plus.google.com/u/0/112410769451962733032> 
[https://my.netbiscuits.com/image/image_gallery?uuid=a15e871c-a11b-419c-acca-da5a0ebd5856&groupId=10211&t=1347281040599]
<http://www.youtube.com/user/netbiscuits>

Register Court: Local Court Kaiserslautern | Commercial Register ID: HR B 3604
Management Board: Guido Moggert, Michael Neidh?fer, Christian Reitz, Martin S??

This message and any files transmitted with it are confidential and intended
solely for the use of the individual or entity to whom they are addressed. It
may also be privileged or otherwise protected by work product immunity or other
legal rules. Please notify the sender immediately by e-mail if you have received
this e-mail by mistake and delete this e-mail from your system. If you are not
the intended recipient you are notified that disclosing, copying, distributing
or taking any action in reliance on the contents of this information is strictly
prohibited.
Warning: Although Netbiscuits has taken reasonable precautions to ensure no
viruses are present in this email, the company cannot accept responsibility for
any loss or damage arising from the use of this email or attachments.

[http://www.netbiscuits.com/image/image_gallery?uuid=0ba7711a-a277-4ea0-acb0-17fe13c3089d&groupId=10211&t=1348560850164]Please
consider the environment before printing

-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://supercolony.gluster.org/pipermail/gluster-users/attachments/20130607/9bc2b8df/attachment.html>

On 06/07/2013 02:08 PM, Sven Knohsalla wrote:
 > just read the official documentation and googled for separation of storage
 > replication /self-healing networking & storage-access network via
 > NFS/GlusterFS-client,
 >
 > but I couldn?t find a clear answer.
 >
 > Is it possible to separate replication & access network

There's no official support for it, but it is possible.  I describe some of
the
relevant techniques here:

http://hekafs.org/index.php/2013/01/split-and-secure-networks-for-glusterfs/

Those instructions are probably not complete by themselves, but those plus a
bit of experimentation will probably get you going.  We do have a (vague) plan
to add better multiple-network at some point, but it's not clear when that
will
actually happen.

Hi Sven,
>
> just read the official documentation and googled for separation of 
> storage replication /self-healing networking & storage-access network 
> via NFS/GlusterFS-client,
>
> but I couldn't find a clear answer.
>
>  
>
> Is it possible to separate replication & access network with the
options
>
> option transport.socket.bind-address
>
> option auth.addr.brick.allow
>
>  
>
> ?
>
>
> If so, is it possible to run native glusterFS or do I have to use NFS 
> for storage access and  first option to allow server-side replication?
>
>  
>
> Is there any issues I may run into or I didn't pay attention at this 
> point?
>
>  
>
I have implemented a kind of split dns solution whereby the managment 
layer resolves to a different network then the storage interface. I'm 
using oVirt with gluster in this way and thing work rather smoothly. 
Solution of Jeff  works too but as he says in his blog, using iptables 
is less transparant and using splitdns had the advantage that is will 
work or not if you forget to add a node to the storage dns zone.
oVirt engine sees stor_srv01 as 192.168.1.1 but the storage layer sees 
it as 10.1.1.1 for example.

Still got question? go ahead.

Regards,

Joop

-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://supercolony.gluster.org/pipermail/gluster-users/attachments/20130609/1f75dbe1/attachment.html>