On Thu, Aug 16, 2007 at 06:16:40PM +0200, Martin Gasthuber
wrote:> Hi,
>
> being a totally new to Lustre we started with a simple (2x OST + 1
> MDT + 3 clients) configuration completely build on tcp (GigE) using
> RHEL 4 and Lustre 1.6.0.1. This all works as expected ! We than
> started to look at the performance figures and equipped each machine
> with a Mellanox 23108 (sdr) HCA and connected all to a single
> ''MT47396 Infiniscale-III'' switch. We installed OFED 1.2
(and also
> Lustre 1.6.1) checked the IB (according to OFED docs) - but no data
> flow through the IB network ! We found no clear (at least for us)
> hints how to ''convince'' Lustre to make use of the new IB
network. Any
> stupid, simple switch we might have forgotten ???
>
What''s the lnet module parameters in your modprobe.conf? If you
haven''t specified any, please read a bit on lnet first:
http://manual.lustre.org/manual/LustreManual16_HTML/DynamicHTML-02-1.html
http://manual.lustre.org/manual/LustreManual16_HTML/DynamicHTML-05-1.html
The Lustre Networking White Paper is also a good read:
http://www.clusterfs.com/images/Docs/lustrenetworking_whitepaper_v4.pdf
Hope this helps,
Isaac