Lustre discuss - Jan 2011 - split OSTs from single OSS in 2 networks

I have a storage server that has two QPI contolllers,
each controller contols half of the I/O slots. In the first half is
a raid controller and 10GbE card, in the second half is a raid controller
and a 10GbE card.

4 raid arrays for 4 OSTs of single Lustre filesystem.

2 10GbE, each configured with their own IP and switches,
IPSUBNET1 and IPSUBNET2.

I want to register OSTs on this OSS with different addresses.
That is, OST1 & OST2 in IPSUBNET1, OST3 & OST4 in IPSUBNET2,
and using "policy-based" routing directing traffic.

The idea is to not do the bonding and get as much of bandwidth
out of 10GbE NICs as possible.

Is it possible?

-- 
thanks,
Haisong

Hello

If you want to register different interfaces for different OST on the 
same OSS, you should use --network options, introduced in patch 
https://bugzilla.lustre.org/show_bug.cgi?id=22078

Regards,

Aur?lien

Haisong Cai a ?crit :
> I have a storage server that has two QPI contolllers,
> each controller contols half of the I/O slots. In the first half is
> a raid controller and 10GbE card, in the second half is a raid controller
> and a 10GbE card.
>
> 4 raid arrays for 4 OSTs of single Lustre filesystem.
>
> 2 10GbE, each configured with their own IP and switches,
> IPSUBNET1 and IPSUBNET2.
>
> I want to register OSTs on this OSS with different addresses.
> That is, OST1 & OST2 in IPSUBNET1, OST3 & OST4 in IPSUBNET2,
> and using "policy-based" routing directing traffic.
>
> The idea is to not do the bonding and get as much of bandwidth
> out of 10GbE NICs as possible.
>
> Is it possible?
>
>

It does look exactly what I need. Thanks Aurllien.

From bugzilla, the patch has been checked in to 1.8.  Could someone please
point me to the source location? Is it in 1.8.5 - don''t believe so,
but I thought I would check. If not, would it be in later release of 1.8?

thanks all,
Haisong

On Thu, 20 Jan 2011, DEGREMONT Aurelien wrote:
> Hello
>
> If you want to register different interfaces for different OST on the
> same OSS, you should use --network options, introduced in patch
> https://bugzilla.lustre.org/show_bug.cgi?id=22078
>
> Regards,
>
> Aur?lien
>
> Haisong Cai a ?crit :
> > I have a storage server that has two QPI contolllers,
> > each controller contols half of the I/O slots. In the first half is
> > a raid controller and 10GbE card, in the second half is a raid
controller
> > and a 10GbE card.
> >
> > 4 raid arrays for 4 OSTs of single Lustre filesystem.
> >
> > 2 10GbE, each configured with their own IP and switches,
> > IPSUBNET1 and IPSUBNET2.
> >
> > I want to register OSTs on this OSS with different addresses.
> > That is, OST1 & OST2 in IPSUBNET1, OST3 & OST4 in IPSUBNET2,
> > and using "policy-based" routing directing traffic.
> >
> > The idea is to not do the bonding and get as much of bandwidth
> > out of 10GbE NICs as possible.
> >
> > Is it possible?
> >
> >
>
--

From Bugzilla, the patch has been introduced in Lustre 2.0 and bugfixed 
in 2.1.
There is a backport for 1.8 but this was never landed in official source 
code.
So it is not available in any 1.8 official releases.
Either you have to use Lustre 2.0 or patch 1.8.5

Regards,

Aur?lien

Le 21/01/2011 18:32, Haisong Cai a ?crit :
> It does look exactly what I need. Thanks Aurllien.
>
>  From bugzilla, the patch has been checked in to 1.8.  Could someone please
> point me to the source location? Is it in 1.8.5 - don''t believe
so,
> but I thought I would check. If not, would it be in later release of 1.8?
>
> thanks all,
> Haisong
>
> On Thu, 20 Jan 2011, DEGREMONT Aurelien wrote:
>
>> Hello
>>
>> If you want to register different interfaces for different OST on the
>> same OSS, you should use --network options, introduced in patch
>> https://bugzilla.lustre.org/show_bug.cgi?id=22078
>>
>> Regards,
>>
>> Aur?lien
>>
>> Haisong Cai a ?crit :
>>> I have a storage server that has two QPI contolllers,
>>> each controller contols half of the I/O slots. In the first half is
>>> a raid controller and 10GbE card, in the second half is a raid
controller
>>> and a 10GbE card.
>>>
>>> 4 raid arrays for 4 OSTs of single Lustre filesystem.
>>>
>>> 2 10GbE, each configured with their own IP and switches,
>>> IPSUBNET1 and IPSUBNET2.
>>>
>>> I want to register OSTs on this OSS with different addresses.
>>> That is, OST1&  OST2 in IPSUBNET1, OST3&  OST4 in
IPSUBNET2,
>>> and using "policy-based" routing directing traffic.
>>>
>>> The idea is to not do the bonding and get as much of bandwidth
>>> out of 10GbE NICs as possible.
>>>
>>> Is it possible?
>>>
>>>