Lustre discuss - Jun 2011 - speed differences in lustre/infiniband ipoib & "native" ib

hey folks,

we''re struggling mightily to get ubuntu clients working in native IB
mode against centos lustre/IB servers.

since we''ve never had a working native IB client, we have no basis in
our assumption that the speed increase should be tremendous & thus
justify our struggle.

what has your experience been?

>we''re struggling mightily to get ubuntu clients working in native
IB
>mode against centos lustre/IB servers.
>
>since we''ve never had a working native IB client, we have no basis
in
>our assumption that the speed increase should be tremendous & thus
>justify our struggle.
It really depends on a ton of factors that are impractical to list
here.  I guess I would summarize it as "significant, most of the
time".  I wouldn''t call it "tremendous", compared to
just using
TCP/IP over the iboib interface.

But seriously, though ... "struggling mightily"?  Once we got the
Lustre
IB module loaded, everything Just Worked.  If you want to give some
details on what''s going wrong here we might be able to help you.

(If by some random chance your problem is you can''t get the Lustre IB
module loaded because of symbol version issues, then you should check
the archives because that has been discussed plenty of times).

--Ken