Did anyone managed to build packages of the OFED 1.2.X on any of these kernels: I believe that 1.1 and 1.2 should supported as mentioned by the release notes. 2.6.16-27-0.9_lustre-1.6.0.1smp 2.6.16-46-0.14_lustre.1.6.2smp Best Regards H. N. Harake
Hello, at the moment I''m trying to get a system running with 2.6.16-46-0.14_lustre.1.6.2smp and OFED1.2 but experience a lot of problems. The first is described in bugzilla 13639. To build the OFED stack you have to do some fixes in OFED scripts or do a recompile of the Lustre kernel with a new naming like 2.6.16.46-0.14-lustre.1.6.2smp. After that you will be able to build the OFED packages but you also have to recompile the lustre-modules and lustre "tools" which doesn''t work well at the moment because it seems that some modules are missing and are not integrated into the new rpms. Best regards Thomas H. N. HARAKE schrieb:> Did anyone managed to build packages of the OFED 1.2.X on any of > these kernels: > I believe that 1.1 and 1.2 should supported as mentioned by the > release notes. > > > 2.6.16-27-0.9_lustre-1.6.0.1smp > 2.6.16-46-0.14_lustre.1.6.2smp > > Best Regards > H. N. Harake > > _______________________________________________ > Lustre-discuss mailing list > Lustre-discuss at clusterfs.com > https://mail.clusterfs.com/mailman/listinfo/lustre-discuss >-- Thomas Blum HPC Engineer Tel.: +49 3722 528 41 Fax: +49 3722 528 15 E-Mail: thomas.blum at megware.com MEGWARE Computer GmbH Vertrieb und Service Nordstra?e 19 09247 Chemnitz/R?hrsdorf http://www.megware.com Headquarters: MEGWARE Computer GmbH Vertrieb und Service, Adelsbergstra?e 2, 09126 Chemnitz Board of Directors: Dr. Gerd Maudrich, J?rgen Gretzschel, Steffen Eckerscham, Dirk Viertel County Court: Chemnitz (Germany) HRB 584
Hi, I had problems with missing modules errors, but the problem I had was that the Lustre compilation process was picking up the symbol versions of the original OFED stack, and not the new symbols. What I finally had to do was edit /usr/src/linux/Modules.symvers and delete every line containing the word infiniband. After that I ran configure --with-o2ib=/usr/src/openib, and it worked fine. You can tell if you are running into the same problem by looking at /var/log/messages. There will be a bunch of messages saying something to the effect of version mismatch with various functions. I''m not sure if anyone else is running into that, but it took me forever to figure out. - Kit Thomas Blum wrote:> Hello, > > at the moment I''m trying to get a system running with > 2.6.16-46-0.14_lustre.1.6.2smp and OFED1.2 but experience a lot of > problems. The first is described in bugzilla 13639. To build the OFED > stack you have to do some fixes in OFED scripts or do a recompile of the > Lustre kernel with a new naming like 2.6.16.46-0.14-lustre.1.6.2smp. > After that you will be able to build the OFED packages but you also have > to recompile the lustre-modules and lustre "tools" which doesn''t work > well at the moment because it seems that some modules are missing and > are not integrated into the new rpms. > > Best regards > > Thomas > > H. N. HARAKE schrieb: > >> Did anyone managed to build packages of the OFED 1.2.X on any of >> these kernels: >> I believe that 1.1 and 1.2 should supported as mentioned by the >> release notes. >> >> >> 2.6.16-27-0.9_lustre-1.6.0.1smp >> 2.6.16-46-0.14_lustre.1.6.2smp >> >> Best Regards >> H. N. Harake >> >> _______________________________________________ >> Lustre-discuss mailing list >> Lustre-discuss at clusterfs.com >> https://mail.clusterfs.com/mailman/listinfo/lustre-discuss >> >> > > >
Hi Kit, Yes we have met this problem for kernel doesn''t support extra Module.symvers file, there are some discussing on this: https://bugzilla.lustre.org/show_bug.cgi?id=12316 Openfabric has discussing on this too: http://lists.openfabrics.org/pipermail/ewg/2007-February/002701.html the resolution is somehow hacking, so we haven''t put it in release. Regards Liang Kit Westneat wrote:> Hi, > > I had problems with missing modules errors, but the problem I had was > that the Lustre compilation process was picking up the symbol versions > of the original OFED stack, and not the new symbols. What I finally had > to do was edit /usr/src/linux/Modules.symvers and delete every line > containing the word infiniband. After that I ran configure > --with-o2ib=/usr/src/openib, and it worked fine. You can tell if you are > running into the same problem by looking at /var/log/messages. There > will be a bunch of messages saying something to the effect of version > mismatch with various functions. > > I''m not sure if anyone else is running into that, but it took me forever > to figure out. > > - Kit > > Thomas Blum wrote: > >> Hello, >> >> at the moment I''m trying to get a system running with >> 2.6.16-46-0.14_lustre.1.6.2smp and OFED1.2 but experience a lot of >> problems. The first is described in bugzilla 13639. To build the OFED >> stack you have to do some fixes in OFED scripts or do a recompile of the >> Lustre kernel with a new naming like 2.6.16.46-0.14-lustre.1.6.2smp. >> After that you will be able to build the OFED packages but you also have >> to recompile the lustre-modules and lustre "tools" which doesn''t work >> well at the moment because it seems that some modules are missing and >> are not integrated into the new rpms. >> >> Best regards >> >> Thomas >> >> H. N. HARAKE schrieb: >> >> >>> Did anyone managed to build packages of the OFED 1.2.X on any of >>> these kernels: >>> I believe that 1.1 and 1.2 should supported as mentioned by the >>> release notes. >>> >>> >>> 2.6.16-27-0.9_lustre-1.6.0.1smp >>> 2.6.16-46-0.14_lustre.1.6.2smp >>> >>> Best Regards >>> H. N. Harake >>> >>> _______________________________________________ >>> Lustre-discuss mailing list >>> Lustre-discuss at clusterfs.com >>> https://mail.clusterfs.com/mailman/listinfo/lustre-discuss >>> >>> >>> >> >> > > _______________________________________________ > Lustre-discuss mailing list > Lustre-discuss at clusterfs.com > https://mail.clusterfs.com/mailman/listinfo/lustre-discuss > >
Hi Liang, Are there any plans to release something like the ibvers.sh script with Lustre? I think that having an easy automated workaround, even if it is a hack, is better then having none. Even just some documentation about the problem would be helpful I think. From what I can tell, the extra Module.symvers functionality was added in kernel 2.6.17, so this bug not only affects RHEL4 but also SLES10. I''m glad to know it is a known issue though, and I am not just crazy :-) Thanks, Kit Liang Zhen gmail wrote:> Hi Kit, > Yes we have met this problem for kernel doesn''t support extra > Module.symvers file, there are some discussing on this: > https://bugzilla.lustre.org/show_bug.cgi?id=12316 > Openfabric has discussing on this too: > http://lists.openfabrics.org/pipermail/ewg/2007-February/002701.html > the resolution is somehow hacking, so we haven''t put it in release. > > Regards > Liang > > > Kit Westneat wrote: >> Hi, >> >> I had problems with missing modules errors, but the problem I had was >> that the Lustre compilation process was picking up the symbol >> versions of the original OFED stack, and not the new symbols. What I >> finally had to do was edit /usr/src/linux/Modules.symvers and delete >> every line containing the word infiniband. After that I ran configure >> --with-o2ib=/usr/src/openib, and it worked fine. You can tell if you >> are running into the same problem by looking at /var/log/messages. >> There will be a bunch of messages saying something to the effect of >> version mismatch with various functions. >> >> I''m not sure if anyone else is running into that, but it took me >> forever to figure out. >> >> - Kit >> >> Thomas Blum wrote: >> >>> Hello, >>> >>> at the moment I''m trying to get a system running with >>> 2.6.16-46-0.14_lustre.1.6.2smp and OFED1.2 but experience a lot of >>> problems. The first is described in bugzilla 13639. To build the >>> OFED stack you have to do some fixes in OFED scripts or do a >>> recompile of the Lustre kernel with a new naming like >>> 2.6.16.46-0.14-lustre.1.6.2smp. After that you will be able to build >>> the OFED packages but you also have to recompile the lustre-modules >>> and lustre "tools" which doesn''t work well at the moment because it >>> seems that some modules are missing and are not integrated into the >>> new rpms. >>> >>> Best regards >>> >>> Thomas >>> >>> H. N. HARAKE schrieb: >>> >>>> Did anyone managed to build packages of the OFED 1.2.X on any of >>>> these kernels: >>>> I believe that 1.1 and 1.2 should supported as mentioned by the >>>> release notes. >>>> >>>> >>>> 2.6.16-27-0.9_lustre-1.6.0.1smp >>>> 2.6.16-46-0.14_lustre.1.6.2smp >>>> >>>> Best Regards >>>> H. N. Harake >>>> >>>> _______________________________________________ >>>> Lustre-discuss mailing list >>>> Lustre-discuss at clusterfs.com >>>> https://mail.clusterfs.com/mailman/listinfo/lustre-discuss >>>> >>>> >>> >> >> _______________________________________________ >> Lustre-discuss mailing list >> Lustre-discuss at clusterfs.com >> https://mail.clusterfs.com/mailman/listinfo/lustre-discuss >> >> >
Hi Kit, On Tue, Oct 23, 2007 at 11:24:52AM -0400, Kit Westneat wrote:> Are there any plans to release something like the ibvers.sh script with > Lustre? I think that having an easy automated workaround, even if it is > a hack, is better then having none. Even just some documentation about > the problem would be helpful I think. From what I can tell, the extra > Module.symvers functionality was added in kernel 2.6.17, so this bug not > only affects RHEL4 but also SLES10. I''m glad to know it is a known issue > though, and I am not just crazy :-)It''s in SLES 10 - must have been backported by Novell. I ran into this issue when working on bug 12842. That bug contains patches to backport the fix to RHEL 4 and SLES 9, which may help with the OFED issue as well, but likely something else needs to be done to actually _use_ the new modpost features as well. Cheers, Jody> Thanks, > Kit > > Liang Zhen gmail wrote: > > Hi Kit, > > Yes we have met this problem for kernel doesn''t support extra > > Module.symvers file, there are some discussing on this: > > https://bugzilla.lustre.org/show_bug.cgi?id=12316 > > Openfabric has discussing on this too: > > http://lists.openfabrics.org/pipermail/ewg/2007-February/002701.html > > the resolution is somehow hacking, so we haven''t put it in release. > > > > Regards > > Liang > > > > > > Kit Westneat wrote: > >> Hi, > >> > >> I had problems with missing modules errors, but the problem I had was > >> that the Lustre compilation process was picking up the symbol > >> versions of the original OFED stack, and not the new symbols. What I > >> finally had to do was edit /usr/src/linux/Modules.symvers and delete > >> every line containing the word infiniband. After that I ran configure > >> --with-o2ib=/usr/src/openib, and it worked fine. You can tell if you > >> are running into the same problem by looking at /var/log/messages. > >> There will be a bunch of messages saying something to the effect of > >> version mismatch with various functions. > >> > >> I''m not sure if anyone else is running into that, but it took me > >> forever to figure out. > >> > >> - Kit > >> > >> Thomas Blum wrote: > >> > >>> Hello, > >>> > >>> at the moment I''m trying to get a system running with > >>> 2.6.16-46-0.14_lustre.1.6.2smp and OFED1.2 but experience a lot of > >>> problems. The first is described in bugzilla 13639. To build the > >>> OFED stack you have to do some fixes in OFED scripts or do a > >>> recompile of the Lustre kernel with a new naming like > >>> 2.6.16.46-0.14-lustre.1.6.2smp. After that you will be able to build > >>> the OFED packages but you also have to recompile the lustre-modules > >>> and lustre "tools" which doesn''t work well at the moment because it > >>> seems that some modules are missing and are not integrated into the > >>> new rpms. > >>> > >>> Best regards > >>> > >>> Thomas > >>> > >>> H. N. HARAKE schrieb: > >>> > >>>> Did anyone managed to build packages of the OFED 1.2.X on any of > >>>> these kernels: > >>>> I believe that 1.1 and 1.2 should supported as mentioned by the > >>>> release notes. > >>>> > >>>> > >>>> 2.6.16-27-0.9_lustre-1.6.0.1smp > >>>> 2.6.16-46-0.14_lustre.1.6.2smp > >>>> > >>>> Best Regards > >>>> H. N. Harake > >>>> > >>>> _______________________________________________ > >>>> Lustre-discuss mailing list > >>>> Lustre-discuss at clusterfs.com > >>>> https://mail.clusterfs.com/mailman/listinfo/lustre-discuss > >>>> > >>>> > >>> > >> > >> _______________________________________________ > >> Lustre-discuss mailing list > >> Lustre-discuss at clusterfs.com > >> https://mail.clusterfs.com/mailman/listinfo/lustre-discuss > >> > >> > > > > _______________________________________________ > Lustre-discuss mailing list > Lustre-discuss at clusterfs.com > https://mail.clusterfs.com/mailman/listinfo/lustre-discuss--