Lustre discuss - Nov 2009 - Compiling lustre 1.8.1.1 against latest CentOS5 kernel fails.

Hi.

I''m trying to install kernel 2.6.18-164.6.1.el5 on the clients to get
the
latest security fixes, but it fails in the compile with an error 
"FIEMAP_FLAGS_COMPAT redefined" when compiling lloop.c:

  CC [M]  /home/royd2/src/lustre-1.8.1.1/lustre/llite/lloop.o
In file included from 
/home/royd2/src/lustre-1.8.1.1/lustre/include/lustre/lustre_user.h:44,
                 from 
/home/royd2/src/lustre-1.8.1.1/lustre/include/lustre/lustre_idl.h:97,
                 from 
/home/royd2/src/lustre-1.8.1.1/lustre/include/lustre_lib.h:45,
                 from /home/royd2/src/lustre-1.8.1.1/lustre/llite/lloop.c:111:
/home/royd2/src/lustre-1.8.1.1/lustre/include/lustre/ll_fiemap.h:82:1: error: 
"FIEMAP_FLAGS_COMPAT" redefined
In file included from /usr/src/kernels/2.6.18-164.6.1.el5-
x86_64//include/linux/fs.h:299,
                 from /home/royd2/src/lustre-1.8.1.1/lustre/llite/lloop.c:88:
/usr/src/kernels/2.6.18-164.6.1.el5-x86_64//include/linux/fiemap.h:42:1: error: 
this is the location of the previous definition
make[6]: *** [/home/royd2/src/lustre-1.8.1.1/lustre/llite/lloop.o] Error 1

Any suggestions on how to fix this?


Regards,
r.

-- 

  The Computer Center, University of Troms?, N-9037 TROMS? Norway.
	      phone:+47 77 64 41 07, fax:+47 77 64 41 00
        Roy Dragseth, Team Leader, High Performance Computing
	 Direct call: +47 77 64 62 56. email: roy.dragseth at uit.no

On Fri, 2009-11-06 at 09:49 +0100, Roy Dragseth wrote: 
> Hi.
> 
> I''m trying to install kernel 2.6.18-164.6.1.el5
Work to support this kernel is underway but not finished yet.  There is
a bug in our bugzilla, quite clearly described in the Summary (so
finding it should be no problem), but I don''t recall the number
off-hand.

b.

-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 197 bytes
Desc: This is a digitally signed message part
Url :
http://lists.lustre.org/pipermail/lustre-discuss/attachments/20091106/69d7cce5/attachment.bin

On Friday 06 November 2009 15:58:26 Brian J. Murrell
wrote:
> On Fri, 2009-11-06 at 09:49 +0100, Roy Dragseth wrote:
> > Hi.
> >
> > I''m trying to install kernel 2.6.18-164.6.1.el5
> 
> Work to support this kernel is underway but not finished yet.  There is
> a bug in our bugzilla, quite clearly described in the Summary (so
> finding it should be no problem), but I don''t recall the number
> off-hand.
Thanks, should have thought of searching bugzilla first.

https://bugzilla.lustre.org/show_bug.cgi?id=20773

Hmm, ofed support will be an issue since the 1.4.X line does not compile on 
RHEL 5.4 kernels...

Have a nice weekend,
r.

-- 
  The Computer Center, University of Troms?, N-9037 TROMS? Norway.
              phone:+47 77 64 41 07, fax:+47 77 64 41 00
     Roy Dragseth, Team Leader, High Performance Computing
         Direct call: +47 77 64 62 56. email: roy.dragseth at uit.no

The RHEL 5.4 kernel comes with OFED 1.4.1, so you should be able to  
just use that instead of replacing OFED (just don''t point Lustre at a  
different OFED dir when building and it will build against the in- 
kernel OFED).

Kevin


On Nov 6, 2009, at 2:53 PM, Roy Dragseth <roy.dragseth at uit.no> wrote:
> On Friday 06 November 2009 15:58:26 Brian J. Murrell wrote:
>> On Fri, 2009-11-06 at 09:49 +0100, Roy Dragseth wrote:
>>> Hi.
>>>
>>> I''m trying to install kernel 2.6.18-164.6.1.el5
>>
>> Work to support this kernel is underway but not finished yet.   
>> There is
>> a bug in our bugzilla, quite clearly described in the Summary (so
>> finding it should be no problem), but I don''t recall the
number
>> off-hand.
>
> Thanks, should have thought of searching bugzilla first.
>
> https://bugzilla.lustre.org/show_bug.cgi?id=20773
>
> Hmm, ofed support will be an issue since the 1.4.X line does not  
> compile on
> RHEL 5.4 kernels...
>
> Have a nice weekend,
> r.
>
> -- 
>  The Computer Center, University of Troms?, N-9037 TROMS? Norway.
>              phone:+47 77 64 41 07, fax:+47 77 64 41 00
>     Roy Dragseth, Team Leader, High Performance Computing
>         Direct call: +47 77 64 62 56. email: roy.dragseth at uit.no
> _______________________________________________
> Lustre-discuss mailing list
> Lustre-discuss at lists.lustre.org
> http://lists.lustre.org/mailman/listinfo/lustre-discuss

On Fri, 2009-11-06 at 22:53 +0100, Roy Dragseth wrote: 
> 
> Hmm, ofed support will be an issue since the 1.4.X line does not compile on
> RHEL 5.4 kernels...
If you use the OFA distribution of OFED, yes, this is correct.  I
believe that the OFED that''s in RHEL5.4 is 1.4.1ish though, and in
absence of being told otherwise, Lustre will use the OFED shipped in the
kernel if it''s enabled in the kernel configuration.

b.

-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 197 bytes
Desc: This is a digitally signed message part
Url :
http://lists.lustre.org/pipermail/lustre-discuss/attachments/20091109/81076cdb/attachment.bin

I''ve been following this thread the past few days because I''m
in the
process of trying to upgrade to a fully patched RHEL5 kernel and have  
been having problems getting Lustre modules compiled. Our Lustre  
servers are currently running 1.6.7.2 and I''m hoping to not have to  
upgrade those just yet, but will if we need to. Our clients are  
managed by Rocks 5.1 so we have the option of using the Mellanox OFED  
roll which includes OFED 1.4.1 I believe. Of course we can also use  
the in kernel OFED with a little more work. Is there a current  
solution that will allow us to build and use Lustre patchless clients  
with the most current RHEL5.2 kernel (2.6.18-164.6.1)?

Thanks,
Mike Robbert, CSM HPC & Network Engineer

On Nov 9, 2009, at 8:57 AM, Brian J. Murrell wrote:
> On Fri, 2009-11-06 at 22:53 +0100, Roy Dragseth wrote:
>>
>> Hmm, ofed support will be an issue since the 1.4.X line does not  
>> compile on
>> RHEL 5.4 kernels...
>
> If you use the OFA distribution of OFED, yes, this is correct.  I
> believe that the OFED that''s in RHEL5.4 is 1.4.1ish though, and in
> absence of being told otherwise, Lustre will use the OFED shipped in  
> the
> kernel if it''s enabled in the kernel configuration.
>
> b.
>
> <signature.asc>_______________________________________________
> Lustre-discuss mailing list
> Lustre-discuss at lists.lustre.org
> http://lists.lustre.org/mailman/listinfo/lustre-discuss

On Mon, 2009-11-09 at 13:49 -0700, Michael Robbert wrote:
> Is there a current  
> solution that will allow us to build and use Lustre patchless clients  
> with the most current RHEL5.2 kernel (2.6.18-164.6.1)?
Maybe I am getting different threads and bugs mixed up but isn''t this
the question that started this thread?  The short answer is that it''s a
WIP still.

b.

-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 197 bytes
Desc: This is a digitally signed message part
Url :
http://lists.lustre.org/pipermail/lustre-discuss/attachments/20091109/56e51965/attachment.bin

It does appear to be a WIP, but I was hoping somebody on the list had  
a current work around. As far as the work in progress, I thought I saw  
something in the bug report about it being targeted for Lustre 2.0.  
Did I read that wrong? Should I expect a patch in the near future for  
either the 1.6 or 1.8 series?

Thanks,
Mike

On Nov 9, 2009, at 2:05 PM, Brian J. Murrell wrote:
> On Mon, 2009-11-09 at 13:49 -0700, Michael Robbert wrote:
>> Is there a current
>> solution that will allow us to build and use Lustre patchless clients
>> with the most current RHEL5.2 kernel (2.6.18-164.6.1)?
>
> Maybe I am getting different threads and bugs mixed up but isn''t
this
> the question that started this thread?  The short answer is that  
> it''s a
> WIP still.
>
> b.
>
> <signature.asc>_______________________________________________
> Lustre-discuss mailing list
> Lustre-discuss at lists.lustre.org
> http://lists.lustre.org/mailman/listinfo/lustre-discuss

On Monday 09 November 2009, Michael Robbert wrote:
> I''ve been following this thread the past few days because
I''m in the
> process of trying to upgrade to a fully patched RHEL5 kernel and have
> been having problems getting Lustre modules compiled. Our Lustre
> servers are currently running 1.6.7.2 and I''m hoping to not have
to
> upgrade those just yet, but will if we need to.
Sorry for jumping in, but what exactly is the problem with 1.6.7.2 on latest 
rhel5? We''re currently running 1.6.7.1+2.6.18-164.6.1 patchless on
quite a
few x86_64 clients. AFAIK this went through our semi-automatic rebuild just 
fine.

Is the problem infiniband related? (we run only tcp)

/Peter
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 189 bytes
Desc: This is a digitally signed message part.
Url :
http://lists.lustre.org/pipermail/lustre-discuss/attachments/20091110/7d57284e/attachment-0001.bin