hi all, i am trying to install lustre for the first time, and i am using 1.6.6 and OFED 1.3.1. my OS is centos 5.3 x86_64 (installed from a 5.2 DVD and updated). i installed the 1.6.6 packages, including the kernel source, kernel-ib and kernel-ib-devel, rebooted into my new kernel, and was trying to build OFED, but i keep getting errors and the OFED build dies. i haven''t been able to find anything in any of the docs i''ve looked at that explains any tricks to building OFED with lustre, so i was assuming it was straight forward. is there anything special i should be doing? --Joe -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.lustre.org/pipermail/lustre-discuss/attachments/20090415/836775cc/attachment.html
On Wed, 2009-04-15 at 09:32 -0500, Greenseid, Joseph M (IS) wrote:> i am trying to install lustre for the first time, and i am using 1.6.6 > and OFED 1.3.1. my OS is centos 5.3 x86_64 (installed from a 5.2 DVD > and updated).OFED 1.3.1 doesn''t support RHEL5U3 (which == centos 5.3 IIUC). For RHEL5U3 support, you will need to use OFED 1.4.1 (which is not released yet, so you can use one of the RCs or a post RC3 nightly snapshot). Lustre 1.6.6 (or .7 for that matter) doesn''t support OFED 1.4 either though as that''s still a work in process. We expect to have support for OFED 1.4.1 soon after it releases GA. b. -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 197 bytes Desc: This is a digitally signed message part Url : http://lists.lustre.org/pipermail/lustre-discuss/attachments/20090415/8486e786/attachment.bin
ah, my bad. i''ll go with an older version of my OS for the time being then. what version of RH (i can back down to RHEL 5, 5u1, or 5u2) is known to work well with lustre/OFED? thanks, --Joe ________________________________ From: lustre-discuss-bounces at lists.lustre.org on behalf of Brian J. Murrell Sent: Wed 4/15/2009 11:45 AM To: lustre-discuss at lists.lustre.org Subject: Re: [Lustre-discuss] building lustre with OFED On Wed, 2009-04-15 at 09:32 -0500, Greenseid, Joseph M (IS) wrote:> i am trying to install lustre for the first time, and i am using 1.6.6 > and OFED 1.3.1. my OS is centos 5.3 x86_64 (installed from a 5.2 DVD > and updated).OFED 1.3.1 doesn''t support RHEL5U3 (which == centos 5.3 IIUC). For RHEL5U3 support, you will need to use OFED 1.4.1 (which is not released yet, so you can use one of the RCs or a post RC3 nightly snapshot). Lustre 1.6.6 (or .7 for that matter) doesn''t support OFED 1.4 either though as that''s still a work in process. We expect to have support for OFED 1.4.1 soon after it releases GA. b. -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.lustre.org/pipermail/lustre-discuss/attachments/20090415/6efd9e43/attachment.html
On Wed, 2009-04-15 at 12:47 -0500, Greenseid, Joseph M (IS) wrote:> ah, my bad. i''ll go with an older version of my OS for the time being > then. what version of RH (i can back down to RHEL 5, 5u1, or 5u2) is > known to work well with lustre/OFED?Why not just use the kernel and kernel-ib packages that we built, tested and distributed with the version of Lustre you want to use? b. -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 197 bytes Desc: This is a digitally signed message part Url : http://lists.lustre.org/pipermail/lustre-discuss/attachments/20090415/158bda35/attachment-0001.bin
> Why not just use the kernel and kernel-ib packages that we built, tested > and distributed with the version of Lustre you want to use?I was under the mistaken impression i needed to use those *and* the OFED stack. Sorry for the confusion. --Joe -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.lustre.org/pipermail/lustre-discuss/attachments/20090415/434a3e61/attachment.html
On Wed, 2009-04-15 at 13:02 -0500, Greenseid, Joseph M (IS) wrote:> > I was under the mistaken impression i needed to use those *and* the > OFED stack.To be clear, if you go to the sun download centre, for rhel5 you will find rpms that provide you everything you need to run lustre on inifinband including the lustre-modules rpm as well as kernel (for servers) and kernel-ib rpms. For clients you will find a lustre-modules rpm that was built against the stock rhel5 kernel. Our goal is that unless your requirements are outside of the mainstream, we provide you with binaries/packages to get yourself up and going quickly and easily. b. -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 197 bytes Desc: This is a digitally signed message part Url : http://lists.lustre.org/pipermail/lustre-discuss/attachments/20090415/b68de1fb/attachment.bin
Do note that rhel5.3 comes with ofed 1.3.2, which is basically 1.3.1 modified to run on the rhel5.3 kernel. So using that version should work, or you can use the pre-built rpms (which are for a 5.2 update kernel). On the servers, save yourself hassle and use the binary kernel provided. Kevin On Apr 16, 2009, at 3:47 AM, "Greenseid, Joseph M (IS)" <Joseph.Greenseid at ngc.com > wrote:> ah, my bad. i''ll go with an older version of my OS for the time > being then. what version of RH (i can back down to RHEL 5, 5u1, or > 5u2) is known to work well with lustre/OFED? > > thanks, > --Joe > > From: lustre-discuss-bounces at lists.lustre.org on behalf of Brian J. > Murrell > Sent: Wed 4/15/2009 11:45 AM > To: lustre-discuss at lists.lustre.org > Subject: Re: [Lustre-discuss] building lustre with OFED > > On Wed, 2009-04-15 at 09:32 -0500, Greenseid, Joseph M (IS) wrote: > > > i am trying to install lustre for the first time, and i am using > 1.6.6 > > and OFED 1.3.1. my OS is centos 5.3 x86_64 (installed from a 5.2 > DVD > > and updated). > > OFED 1.3.1 doesn''t support RHEL5U3 (which == centos 5.3 IIUC). For > RHEL5U3 support, you will need to use OFED 1.4.1 (which is not > released > yet, so you can use one of the RCs or a post RC3 nightly snapshot). > > Lustre 1.6.6 (or .7 for that matter) doesn''t support OFED 1.4 either > though as that''s still a work in process. We expect to have support > for > OFED 1.4.1 soon after it releases GA. > > b. > > > > _______________________________________________ > Lustre-discuss mailing list > Lustre-discuss at lists.lustre.org > http://lists.lustre.org/mailman/listinfo/lustre-discuss-------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.lustre.org/pipermail/lustre-discuss/attachments/20090416/a09aa3c7/attachment.html