We''re trying to set up a Lustre configuration using infiniband ipoib
with 1.5.95. openib 1.1 (was formally openib gen 2) is installed. We can
successfully ping between the mdt/mgs nad ost servers using the ipoib
address. Lustre fs creation is "apparently" successfull. Mounting the
lustre device fails.
1. Does 1.5.95 work properly with ipoib?
2. What is the proper form of mgsnode specification, should o2ib or
openiib be used?
2.a Should we specify the ipoib address or the adapter/port #?
The ost command line we''re trying is:
mkfs.lustre --fsname=testfs --mgsnode=192.168.3.3@o2ib /dev/sdb1
Thanks,
Timothy Snider
Storage Architect
Strategic Planning, Technology and Architecture
LSI Logic Corporation
3718 North Rock Road
Wichita, KS 67226
(316) 636-8736
tim.snider@lsi.com <mailto:tim.snider@lsi.com>
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
http://mail.clusterfs.com/pipermail/lustre-devel/attachments/20070202/e49b5b2f/attachment.html
Snider, Tim wrote:> We''re trying to set up a Lustre configuration using infiniband ipoib > with 1.5.95. openib 1.1 (was formally openib gen 2) is installed. We > can successfully ping between the mdt/mgs nad ost servers using the > ipoib address. Lustre fs creation is "apparently" successfull. > Mounting the lustre device fails. > 1. Does 1.5.95 work properly with ipoib? > 2. What is the proper form of mgsnode specification, should o2ib or > openiib be used? > 2.a Should we specify the ipoib address or the adapter/port #? > > The ost command line we''re trying is: > mkfs.lustre --fsname=testfs --mgsnode=192.168.3.3@o2ib > <mailto:--mgsnode=192.168.3.3@o2ib> /dev/sdb1 >Can you send the results of the following commands on the OST? (with LNET up on both the MGS and OST -- ''lctl network up'' if needed) # the mgs nids mgs_nids=`ssh the_mgs_ipaddr lctl list_nids` echo $mgs_nids # the ost''s preferred nid for the mgs lctl which_nid $mgs_nids # make sure it works lctl ping <the results of the above command> lctl ping 192.168.3.3@o2ib # the ost nids lctl list_nids