Lustre discuss - Sep 2009 - o2ib and tcp(IPoIB) on the same IB interface.

Hi,

I am designing lustre file system that will be serving two separate
clusters. One of the clusters is old and uses Ethernet data network. Second
of the clusters is new and uses QDR IB data network. I would like to equip
each Lustre server (OSS, MDS) with single port ConnectX IB card. Is it
possible to configure lustre network to use the same Infiniband interface
(ib0) for serving both o2ib nodes and tcp/ip nodes?

Will this work?

/etc/modprobe.conf
options lnet networks=o2ib(ib0),tcp(ib0)

or this with alias on IB interface?

/etc/modprobe.conf
options lnet networks=o2ib(ib0),tcp(ib0:1)

Many thanks for all answers.

Best regards,

Wojciech

-- 
Wojciech Turek
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
http://lists.lustre.org/pipermail/lustre-discuss/attachments/20090907/94bea247/attachment.html

On Mon, Sep 07, 2009 at 06:58:39PM +0100, Wojciech Turek
wrote:
>    Hi,
>    I am designing lustre file system that will be serving two separate
>    clusters. One of the clusters is old and uses Ethernet data network.
>    Second of the clusters is new and uses QDR IB data network. I would
>    like to equip each Lustre server (OSS, MDS) with single port ConnectX
>    IB card. Is it possible to configure lustre network to use the same
>    Infiniband interface (ib0) for serving both o2ib nodes and tcp/ip
>    nodes?
>    Will this work?
>    /etc/modprobe.conf
>    options lnet networks=o2ib(ib0),tcp(ib0)
Yes, and you''d need an IP router that forwards packets between
client Ethernet and the server IPoIB network. Alternatively, you might
set up an LNET router that forwards data between @tcp0 and @o2ib0, in
which case the servers need not to have a tcp(ib0) interface.

Isaac