thr3ads.net - Lustre discuss - [Lustre-discuss] Regarding RHEL, Lustre and OFED combinatin [Apr 2009]

If this information is useful, please help other people find it:
Share via:

Gnanasekar Loganathan

2009-Apr-24 08:33 UTC

[Lustre-discuss] Regarding RHEL, Lustre and OFED combinatin

Hi,
I''m new to Lustre and InfiniBand.
May i know which is the best combination for build and use theLustre File
system.
The best combination in the sense,
Which RHEL, OFED and Lustre version and release.


Thanks,
Gnana
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
http://lists.lustre.org/pipermail/lustre-discuss/attachments/20090424/cd2e7b63/attachment.html

Brian J. Murrell

2009-Apr-24 11:47 UTC

head link

[Lustre-discuss] Regarding RHEL, Lustre and OFED combinatin

On Fri, 2009-04-24 at 14:03 +0530, Gnanasekar Loganathan
wrote:> Hi,
> 
> 
> I''m new to Lustre and InfiniBand.
> May i know which is the best combination for build and use theLustre
> File system.
> The best combination in the sense,
> Which RHEL, OFED and Lustre version and release.
Why wouldn''t you just download the packages we have ready built for all
of this on Lustre 1.6.7.1?  Why build them when you can just download
already built and tested packages?

b.


-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 197 bytes
Desc: This is a digitally signed message part
Url :
http://lists.lustre.org/pipermail/lustre-discuss/attachments/20090424/25f85ce4/attachment.bin

Gnanasekar Loganathan

2009-Apr-24 12:29 UTC

head link

[Lustre-discuss] Regarding RHEL, Lustre and OFED combinatin

Hi Brain,

Here my server details,

[root at SF_02 ~]# cat /etc/issue
Red Hat Enterprise Linux AS release 4 (Nahant Update 7)
Kernel \r on an \m

[root at SF_02 ~]# uname -a
Linux SF_02 2.6.9-78.ELsmp #1 SMP Wed Jul 9 15:46:26 EDT 2008 x86_64 x86_64
x86_64 GNU/Linux

And the Lustre kernel version is this

 kernel-lustre-smp-2.6.9-67.0.22.EL_lustre.1.6.7.1.x86_64.rpm<http://cds.sun.com/is-bin/INTERSHOP.enfinity/WFS/CDS-CDS_SMI-Site/en_US/-/USD/VerifyItem-Start/kernel-lustre-smp-2.6.9-67.0.22.EL_lustre.1.6.7.1.x86_64.rpm?BundledLineItemUUID=lWlIBe.nb.IAAAEgmzVuTtgT&OrderID=t4NIBe.nGqoAAAEgKjVuTtgT&ProductID=CIdIBe.oiBUAAAEgYfIzLqvL&FileName=/kernel-lustre-smp-2.6.9-67.0.22.EL_lustre.1.6.7.1.x86_64.rpm>

can you please guide me on this one....?

Thanks,
Gnana




On Fri, Apr 24, 2009 at 5:17 PM, Brian J. Murrell <Brian.Murrell at
sun.com>wrote:
> On Fri, 2009-04-24 at 14:03 +0530, Gnanasekar Loganathan wrote:
> > Hi,
> >
> >
> > I''m new to Lustre and InfiniBand.
> > May i know which is the best combination for build and use theLustre
> > File system.
> > The best combination in the sense,
> > Which RHEL, OFED and Lustre version and release.
>
> Why wouldn''t you just download the packages we have ready built
for all
> of this on Lustre 1.6.7.1?  Why build them when you can just download
> already built and tested packages?
>
> b.
>
>
>
> _______________________________________________
> Lustre-discuss mailing list
> Lustre-discuss at lists.lustre.org
> http://lists.lustre.org/mailman/listinfo/lustre-discuss
>
>-------------- next part --------------
An HTML attachment was scrubbed...
URL:
http://lists.lustre.org/pipermail/lustre-discuss/attachments/20090424/c4cba3cb/attachment.html

Brian J. Murrell

2009-Apr-24 12:38 UTC

head link

[Lustre-discuss] Regarding RHEL, Lustre and OFED combinatin

On Fri, 2009-04-24 at 17:59 +0530, Gnanasekar Loganathan
wrote:> Hi Brain,
Hi,
> And the Lustre kernel version is this
Yes.
> can you please guide me on this one....?
Simply download the packages listed and install them per the operations
manual at manual.lustre.org.

b.

-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 197 bytes
Desc: This is a digitally signed message part
Url :
http://lists.lustre.org/pipermail/lustre-discuss/attachments/20090424/93dcc433/attachment.bin

Gnanasekar Loganathan

2009-Apr-24 13:33 UTC

head link

[Lustre-discuss] Regarding RHEL, Lustre and OFED combinatin

Hi Brain,
Can you please clarify my confusion?

I downloaded the kernel-ib-*.rpm along with Lustre-1.6.7.1.

Whether i need to install OFED also ?

Thanks
Gnana


On Fri, Apr 24, 2009 at 6:13 PM, Gnanasekar Loganathan <
l.gnanasekar at gmail.com> wrote:
> Thanks, Brain!
>
> /Gnana
>
>
>
>
> On Fri, Apr 24, 2009 at 6:08 PM, Brian J. Murrell <Brian.Murrell at
sun.com>wrote:
>
>> On Fri, 2009-04-24 at 17:59 +0530, Gnanasekar Loganathan wrote:
>> > Hi Brain,
>>
>> Hi,
>>
>> > And the Lustre kernel version is this
>>
>> Yes.
>>
>> > can you please guide me on this one....?
>>
>> Simply download the packages listed and install them per the operations
>> manual at manual.lustre.org.
>>
>> b.
>>
>>
>> _______________________________________________
>> Lustre-discuss mailing list
>> Lustre-discuss at lists.lustre.org
>> http://lists.lustre.org/mailman/listinfo/lustre-discuss
>>
>>
>-------------- next part --------------
An HTML attachment was scrubbed...
URL:
http://lists.lustre.org/pipermail/lustre-discuss/attachments/20090424/7b20379a/attachment.html

Brian J. Murrell

2009-Apr-24 13:37 UTC

head link

[Lustre-discuss] Regarding RHEL, Lustre and OFED combinatin

On Fri, 2009-04-24 at 19:03 +0530, Gnanasekar Loganathan
wrote:> Hi Brain,
Hi,
> I downloaded the kernel-ib-*.rpm along with Lustre-1.6.7.1.
> 
> 
> Whether i need to install OFED also ?
The kernel-ib RPM is OFED (the kernel drivers).  That''s all you need to
use OFED with Lustre.

b.

-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 197 bytes
Desc: This is a digitally signed message part
Url :
http://lists.lustre.org/pipermail/lustre-discuss/attachments/20090424/4a7dc9f2/attachment-0001.bin

Gnanasekar Loganathan

2009-Apr-24 13:55 UTC

head link

[Lustre-discuss] Regarding RHEL, Lustre and OFED combinatin

Hi Brain,

While installing i got the below warning messages, whether this is known one
or there need some configurations ?
[root at SF_01 Lustre-1.6.7.1]# rpm -ihv
kernel-lustre-smp-2.6.9-67.0.22.EL_lustre.1.6.7.1.x86_64.rpm
kernel-ib-devel-1.3
 -2.6.9_67.0.22.EL_lustre.1.6.7.1smp.x86_64.rpm
lustre-modules-1.6.7.1-2.6.9_67.0.22.EL_lustre.1.6.7.1smp.x86_64.rpm  l

 ustre-ldiskfs-3.0.7.1-2.6.9_67.0.22.EL_lustre.1.6.7.1smp.x86_64.rpm
Preparing...                ###########################################
[100%]
   1:lustre-ldiskfs         ########################################### [
25%]
   2:kernel-lustre-smp      ########################################### [
50%]
   3:kernel-ib-devel        ########################################### [
75%]
   4:lustre-modules         warning: user lbuild does not exist - using root
warning: user lbuild does not exist - using root
warning: user lbuild does not exist - using root%)
warning: user lbuild does not exist - using root%)
warning: user lbuild does not exist - using root%)
warning: user lbuild does not exist - using root%)
warning: user lbuild does not exist - using root%)
warning: user lbuild does not exist - using root%)
warning: user lbuild does not exist - using root%)
warning: user lbuild does not exist - using root%)
warning: user lbuild does not exist - using root%)
warning: user lbuild does not exist - using root%)
warning: user lbuild does not exist - using root%)
warning: user lbuild does not exist - using root%)
warning: user lbuild does not exist - using root%)
warning: user lbuild does not exist - using root%)
warning: user lbuild does not exist - using root%)
warning: user lbuild does not exist - using root%)
warning: user lbuild does not exist - using root%)
warning: user lbuild does not exist - using root%)
warning: user lbuild does not exist - using root%)
########################################### [100%]
WARNING:
/lib/modules/2.6.9-67.0.22.EL_lustre.1.6.7.1smp/kernel/net/lustre/ko2iblnd.ko
needs unknown symbol ib_create_                                    cq
WARNING:
/lib/modules/2.6.9-67.0.22.EL_lustre.1.6.7.1smp/kernel/net/lustre/ko2iblnd.ko
needs unknown symbol rdma_resol                                    ve_addr
WARNING:
/lib/modules/2.6.9-67.0.22.EL_lustre.1.6.7.1smp/kernel/net/lustre/ko2iblnd.ko
needs unknown symbol ib_dereg_m                                    r
WARNING:
/lib/modules/2.6.9-67.0.22.EL_lustre.1.6.7.1smp/kernel/net/lustre/ko2iblnd.ko
needs unknown symbol rdma_rejec                                    t
WARNING:
/lib/modules/2.6.9-67.0.22.EL_lustre.1.6.7.1smp/kernel/net/lustre/ko2iblnd.ko
needs unknown symbol rdma_disco                                    nnect
WARNING:
/lib/modules/2.6.9-67.0.22.EL_lustre.1.6.7.1smp/kernel/net/lustre/ko2iblnd.ko
needs unknown symbol rdma_resol                                    ve_route
WARNING:
/lib/modules/2.6.9-67.0.22.EL_lustre.1.6.7.1smp/kernel/net/lustre/ko2iblnd.ko
needs unknown symbol rdma_bind_                                    addr
WARNING:
/lib/modules/2.6.9-67.0.22.EL_lustre.1.6.7.1smp/kernel/net/lustre/ko2iblnd.ko
needs unknown symbol rdma_creat                                    e_qp
WARNING:
/lib/modules/2.6.9-67.0.22.EL_lustre.1.6.7.1smp/kernel/net/lustre/ko2iblnd.ko
needs unknown symbol ib_destroy                                    _cq
WARNING:
/lib/modules/2.6.9-67.0.22.EL_lustre.1.6.7.1smp/kernel/net/lustre/ko2iblnd.ko
needs unknown symbol rdma_creat                                    e_id
WARNING:
/lib/modules/2.6.9-67.0.22.EL_lustre.1.6.7.1smp/kernel/net/lustre/ko2iblnd.ko
needs unknown symbol rdma_liste                                    n
WARNING:
/lib/modules/2.6.9-67.0.22.EL_lustre.1.6.7.1smp/kernel/net/lustre/ko2iblnd.ko
needs unknown symbol rdma_destr                                    oy_qp
WARNING:
/lib/modules/2.6.9-67.0.22.EL_lustre.1.6.7.1smp/kernel/net/lustre/ko2iblnd.ko
needs unknown symbol ib_get_dma                                    _mr
WARNING:
/lib/modules/2.6.9-67.0.22.EL_lustre.1.6.7.1smp/kernel/net/lustre/ko2iblnd.ko
needs unknown symbol ib_alloc_p                                    d
WARNING:
/lib/modules/2.6.9-67.0.22.EL_lustre.1.6.7.1smp/kernel/net/lustre/ko2iblnd.ko
needs unknown symbol rdma_conne                                    ct
WARNING:
/lib/modules/2.6.9-67.0.22.EL_lustre.1.6.7.1smp/kernel/net/lustre/ko2iblnd.ko
needs unknown symbol ib_modify_                                    qp
WARNING:
/lib/modules/2.6.9-67.0.22.EL_lustre.1.6.7.1smp/kernel/net/lustre/ko2iblnd.ko
needs unknown symbol rdma_destr                                    oy_id
WARNING:
/lib/modules/2.6.9-67.0.22.EL_lustre.1.6.7.1smp/kernel/net/lustre/ko2iblnd.ko
needs unknown symbol rdma_accep                                    t
WARNING:
/lib/modules/2.6.9-67.0.22.EL_lustre.1.6.7.1smp/kernel/net/lustre/ko2iblnd.ko
needs unknown symbol ib_dealloc                                    _pd
Congratulations on finishing your Lustre installation!  To register
your copy of Lustre and find out more about Lustre Support, Service,
and Training offerings please visit

http://www.sun.com/software/products/lustre/lustre_reg.jsp

Thanks,
Gnana

On Fri, Apr 24, 2009 at 7:07 PM, Brian J. Murrell <Brian.Murrell at
sun.com>wrote:
> On Fri, 2009-04-24 at 19:03 +0530, Gnanasekar Loganathan wrote:
> > Hi Brain,
>
> Hi,
>
> > I downloaded the kernel-ib-*.rpm along with Lustre-1.6.7.1.
> >
> >
> > Whether i need to install OFED also ?
>
> The kernel-ib RPM is OFED (the kernel drivers).  That''s all you
need to
> use OFED with Lustre.
>
> b.
>
>
> _______________________________________________
> Lustre-discuss mailing list
> Lustre-discuss at lists.lustre.org
> http://lists.lustre.org/mailman/listinfo/lustre-discuss
>
>-------------- next part --------------
An HTML attachment was scrubbed...
URL:
http://lists.lustre.org/pipermail/lustre-discuss/attachments/20090424/ef45be45/attachment.html

Brian J. Murrell

2009-Apr-24 14:12 UTC

head link

[Lustre-discuss] Regarding RHEL, Lustre and OFED combinatin

On Fri, 2009-04-24 at 19:25 +0530, Gnanasekar Loganathan
wrote:> Hi Brain,
Hi,


> [root at SF_01 Lustre-1.6.7.1]# rpm -ihv
> kernel-lustre-smp-2.6.9-67.0.22.EL_lustre.1.6.7.1.x86_64.rpm
> kernel-ib-devel-1.3                     
No.  -devel packages on RH platforms are for development.  You should
install the kernel-ib package.
> warning: user lbuild does not exist - using root
> warning: user lbuild does not exist - using root
This is bug 15836 and harmless beyond the output noise.
> WARNING:
/lib/modules/2.6.9-67.0.22.EL_lustre.1.6.7.1smp/kernel/net/lustre/ko2iblnd.ko
needs unknown symbol rdma_resol                                    ve_addr
These are because you installed kernel-ib-devel and not kernel-ib.

Can I ask what installation instructions you are using?  Obviously
something needs clarifying and I want to make sure it happens.

b.

-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 197 bytes
Desc: This is a digitally signed message part
Url :
http://lists.lustre.org/pipermail/lustre-discuss/attachments/20090424/97a5f532/attachment.bin

Gnanasekar Loganathan

2009-Apr-24 14:17 UTC

head link

[Lustre-discuss] Regarding RHEL, Lustre and OFED combinatin

Sorry!Its my mistakenly chosen the kernel-ib-devel instead of kerne-ib
package.
i''m following the installation instruction from the below link.
http://manual.lustre.org/manual/LustreManual16_HTML/LustreInstallation.html#50548845_74070

Thanks,
Gnana



On Fri, Apr 24, 2009 at 7:42 PM, Brian J. Murrell <Brian.Murrell at
sun.com>wrote:
> On Fri, 2009-04-24 at 19:25 +0530, Gnanasekar Loganathan wrote:
> > Hi Brain,
>
> Hi,
>
>
>
> > [root at SF_01 Lustre-1.6.7.1]# rpm -ihv
> > kernel-lustre-smp-2.6.9-67.0.22.EL_lustre.1.6.7.1.x86_64.rpm
> > kernel-ib-devel-1.3
>
> No.  -devel packages on RH platforms are for development.  You should
> install the kernel-ib package.
>
> > warning: user lbuild does not exist - using root
> > warning: user lbuild does not exist - using root
>
> This is bug 15836 and harmless beyond the output noise.
>
> > WARNING:
>
/lib/modules/2.6.9-67.0.22.EL_lustre.1.6.7.1smp/kernel/net/lustre/ko2iblnd.ko
> needs unknown symbol rdma_resol                                    ve_addr
>
> These are because you installed kernel-ib-devel and not kernel-ib.
>
> Can I ask what installation instructions you are using?  Obviously
> something needs clarifying and I want to make sure it happens.
>
> b.
>
>
> _______________________________________________
> Lustre-discuss mailing list
> Lustre-discuss at lists.lustre.org
> http://lists.lustre.org/mailman/listinfo/lustre-discuss
>
>-------------- next part --------------
An HTML attachment was scrubbed...
URL:
http://lists.lustre.org/pipermail/lustre-discuss/attachments/20090424/a36124ce/attachment-0001.html

Lustre discuss - Apr 2009 - Regarding RHEL, Lustre and OFED combinatin

[Lustre-discuss] Regarding RHEL, Lustre and OFED combinatin

[Lustre-discuss] Regarding RHEL, Lustre and OFED combinatin

[Lustre-discuss] Regarding RHEL, Lustre and OFED combinatin

[Lustre-discuss] Regarding RHEL, Lustre and OFED combinatin

[Lustre-discuss] Regarding RHEL, Lustre and OFED combinatin

[Lustre-discuss] Regarding RHEL, Lustre and OFED combinatin

[Lustre-discuss] Regarding RHEL, Lustre and OFED combinatin

[Lustre-discuss] Regarding RHEL, Lustre and OFED combinatin

[Lustre-discuss] Regarding RHEL, Lustre and OFED combinatin