Gluster users - Dec 2008 - GlusterFS Infiniband options in the Specification File

Hello people,


I am trying to use GlusterFS over Infiniband using ib-verbs. Now so far
I know about these options:

option transport-type ib-verbs/client # For Infiniband Verbs client
option transport-type ib-verbs/server # For Infiniband Verbs server

and of course these ones:
option ib-verbs-work-request-recv-size   1048576
option ib-verbs-work-request-recv-count  16
option ib-verbs-work-request-send-size   1048576
option ib-verbs-work-request-send-count  16


Now what I don't understand is how do you specify a Infiniband host?

What I mean is when using IP you would do this on the server:

option auth.ip.brick1.allow 192.168.* # Allow access to "brick1"
volume

and this on the client:

option remote-host 192.168.1.10


That I understand, but Infiniband doesn't work off IP, unless of course
you enable IP over Infiniband (IPoIB). So my questions really are:

1. Is there a way to specify a Infiniband host other then by IP?
2. If you have to use IP is that IPoIB you use?

Thanks people,

John Simmonds
Computer Officer - Linux & Real-time Systems
University of the West of England
United Kingdom


This email was independently scanned for viruses by McAfee anti-virus software
and none were found

Hi John,
please find inlined comments.

On Wed, Dec 10, 2008 at 12:14 AM, John Simmonds <John2.Simmonds at
uwe.ac.uk>wrote:
> Hello people,
>
>
> I am trying to use GlusterFS over Infiniband using ib-verbs. Now so far
> I know about these options:
>
> option transport-type ib-verbs/client # For Infiniband Verbs client
> option transport-type ib-verbs/server # For Infiniband Verbs server
>
> and of course these ones:
> option ib-verbs-work-request-recv-size   1048576
> option ib-verbs-work-request-recv-count  16
> option ib-verbs-work-request-send-size   1048576
> option ib-verbs-work-request-send-count  16
>
>
> Now what I don't understand is how do you specify a Infiniband host?
>
> What I mean is when using IP you would do this on the server:
>
> option auth.ip.brick1.allow 192.168.* # Allow access to "brick1"
volume
>
> and this on the client:
>
> option remote-host 192.168.1.10
>
>
> That I understand, but Infiniband doesn't work off IP, unless of course
> you enable IP over Infiniband (IPoIB).

each server which is using infiniband transport would be listening on a
socket (which is identified by ip:port). Client has to connect to that
address (Ip:port) and once initial handshake (which is related to ib-verbs)
is done, all further communication happens through ib-verbs.

> So my questions really are:
>
> 1. Is there a way to specify a Infiniband host other then by IP?

No.

>
> 2. If you have to use IP is that IPoIB you use?

Not necessarily. TCP/IP would also be fine. Since this communication channel
is used only for initial handshake. And since handshake data is small (when
compared to actual data flowing between client and server) this has no
effect on performance.

>
>
> Thanks people,
>
> John Simmonds
> Computer Officer - Linux & Real-time Systems
> University of the West of England
> United Kingdom
>
>
> This email was independently scanned for viruses by McAfee anti-virus
> software and none were found
> _______________________________________________
> Gluster-users mailing list
> Gluster-users at gluster.org
> http://zresearch.com/cgi-bin/mailman/listinfo/gluster-users
>

regards,
-- 
Raghavendra G
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://supercolony.gluster.org/pipermail/gluster-users/attachments/20081210/8d4bbe11/attachment.html>