Lustre discuss - Apr 2008 - Building modules against 1.6.4.3 kernel source

I''m trying to do 2 things and failing miserably at both. I had it  
working in the past but for some reason now its broken.

I just downloaded 1.6.4.3 for rhel5 x86_64. I installed all the  
required packages. My network is o2ib and modprobe.conf is set  
accordingly. When I modprobe lustre it gives me an error about the  
ko2iblnd module. I''m pretty sure that this is because the 1.6.4.3  
kernel on the website was built using a different version of OFED than  
the one provided in the kernel tree. Fair enough. So I went to  
recompile the lustre modules and ran a ./configure --with-linux=/path/ 
to/kernel/source --with-linux-obj=/path/to/kernel-obj/source and it  
bombed. So I ran these steps on the lustre kernel source tree which  
worked in the past but only half work now-

cd /usr/src/<linux-lustre-kernel-source>/
make mrproper
cp /usr/src/<linux-kernel-source-obj>/x86_64/smp/.config .

#Edit Makefile
EXTRAVERSION = -55.0.9.EL_lustre.1.6.3smp
make menuconfig
make include/asm
make include/linux/version.h
make SUBDIRS=scripts
It runs correctly and I''m able to compile my kernel modules against  
this tree without the --with-linux-obj ./configure option however when  
I load the modules generated from this build I get an error about  
"struct_module" not found and it taints my kernel. Odd thing is when I
do a modinfo on the module it shows the right version magic. I''m truly
lost here.

My questions are -

1. How do I build kernel modules against the lustre kernel source rpm  
for RHEL5 that get versioning information

and

2. What version of the OFED was the linux kernel built against?

Thanks in advance.

-Aaron

Aaron Knister
Associate Systems Analyst
Center for Ocean-Land-Atmosphere Studies

(301) 595-7000
aaron at iges.org




-------------- next part --------------
An HTML attachment was scrubbed...
URL:
http://lists.lustre.org/pipermail/lustre-discuss/attachments/20080426/4e372f26/attachment.html

On Sat, 2008-04-26 at 16:37 -0400, Aaron Knister wrote:
> When I modprobe lustre it gives me an error about the ko2iblnd module.
Can you paste the error(s) here?
> I''m pretty sure that this is because the 1.6.4.3 kernel on the
website
> was built using a different version of OFED than the one provided in
> the kernel tree.
In fact, given that we try to make minimal alterations for our kernel
builds relative to the vendor''s kernel, you are getting the OFED that
RH
is shipping in RHEL5.
> Fair enough. So I went to recompile the lustre modules and ran
> a ./configure --with-linux=/path/to/kernel/source
> --with-linux-obj=/path/to/kernel-obj/source and it bombed.
Again, can you paste errors?

If you want to use the OFED that RH includes in the RHEL5 kernel with
Lustre, you can apply the patch in 14816, rebuild configure and run
configure with "--with-linux=/path/to/kernel/source
--with-linux-obj=/path/to/kernel-obj/source" and configure will figure
out that the kernel source has OFED in it and use it.
> So I ran these steps on the lustre kernel source tree which worked in
> the past but only half work now-
> 
> 
> cd /usr/src/<linux-lustre-kernel-source>/
> make mrproper
> cp /usr/src/<linux-kernel-source-obj>/x86_64/smp/.config .
You should not need to do any of this.  You should be able to simply
point configure at /usr/src/<linux-lustre-kernel-source>/
and /usr/src/<linux-kernel-source-obj>/x86_64/smp/.config as you did and
it should work.  No need for "make <anything>" in any kernel
tree at
all.  That''s the whole point of the
/usr/src/<linux-kernel-source-obj>
tree.
> #Edit Makefile 
> EXTRAVERSION = -55.0.9.EL_lustre.1.6.3smp
> make menuconfig
> make include/asm
> make include/linux/version.h
> make SUBDIRS=scripts
Yeah, all of this should be unnecessary too if you just use the
--with-linux and --with-linux-obj parameters to configure and point them
to the paths that you do.
> I load the modules generated from this build I get an error about
> "struct_module" not found and it taints my kernel. Odd thing is
when I
> do a modinfo on the module it shows the right version magic. I''m
truly
> lost here. 
Again, can you post exact error output?

But before you do, perhaps applying the patch above and following the
steps above might yield better results.
> My questions are -
> 
> 
> 1. How do I build kernel modules against the lustre kernel source rpm
> for RHEL5 that get versioning information
As above.
> 2. What version of the OFED was the linux kernel built against?
Whatever RH shipped with RHEL5.  I''ve never been able to determine
exactly what that was either.  :-(

b.

-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 189 bytes
Desc: This is a digitally signed message part
Url :
http://lists.lustre.org/pipermail/lustre-discuss/attachments/20080428/b5f19231/attachment.bin