Lustre discuss - Dec 2011 - Packates for Ubuntu-10.04 LTS accting as a Lustre server

Hi all,

I''ve made available an Ubuntu repository:

In /etc/apt/sources.list:

deb http://www.cttc.upc.edu/ubuntu lucid main

Repository key is at:

http://www.cttc.upc.edu/ubuntu/keys/cttc-public.gpg

To install key:

apt-key add <file>
apt-get update
apt-get install lustre

With this procedure you will install lustre-2.1.0, but there are also
available 1.8.5 an 1.8.7.wc1 versions with the corresponding kernels
that you can install with dpkg.

This implies using SLES11SP1 (1.8.5 version) and RHEL6.1 kernels
compiled and patched (when needed) in Ubuntu 10.04.
There are also available at the repository, packages for OFED 1.5.3.1
and collectl for monitoring (very handy for Lustre)

I am currently using Lustre 1.8.5 (with SLES11SP1) with 128 nodes on
Infiniband 1.4.2 and 2 OSSs with 8 OSTs of 8 TB. It is very stable. I am
adding 40 additional nodes in the next month (I hope) using IB QDR and
lustre 1.8.7.wc1 on them (test have made seems to be stable), but
keeping lustre 1.8.5 on servers. People in UPC (http://www.upc.edu) are
starting to use lustre 2.1.0 packages on Ethernet and it seems to be
stable.

I hope myself to be migrating to lustre 2.X next year with Ubuntu 12.04
LTS, but this time I prefer to stay on 1.8.X

Use all that packages
(sources are at http://www.cttc.upc.edu/ubuntu/dists/lucid/main/source) 
at your own risk, but I will be happy to receive some feedback about the
matter.

Thanks to ''Bernd Schubert'' that sent to me how to make these
lustre
packages in a non very Debian policy aware, but effective to use.


Regards 

-- 
Ramiro Alba

Centre Tecnol??gic de Tranfer??ncia de Calor
http://www.cttc.upc.edu


Escola T??cnica Superior d''Enginyeries
Industrial i Aeron??utica de Terrassa
Colom 11, E-08222, Terrassa, Barcelona, Spain
Tel: (+34) 93 739 86 46



-- 
Aquest missatge ha estat analitzat per MailScanner
a la cerca de virus i d''altres continguts perillosos,
i es considera que est? net.

On 15/12/11 13:32, Ramiro Alba wrote:
> Hi all,
> 
> I''ve made available an Ubuntu repository:
> 
On a related note; attached is a dkms config file for lustre *client*
kernel modules.

It will give you a deb containing the kernel modules, and will
auto-magically rebuild modules when new kernels are installed. (You will
still need to build the userspace deb as normal.)

Tested on ubuntu 10.04 / 2.6.32 kernel stream, but it should work on any
distro that supports dkms and runs a kernel that is compatible with the
lustre client.


Instructions:

Stick the dkms.conf file in the top of your lustre source directory and
copy it to /usr/src.

# register the source
dkms add -m lustre -v 1.8.7wc1

# build module for currently installed kernel.
dkms build -m lustre -v 1.8.7wc1

# optionally build for other kernel versions
dkms build -m lustre -v 1.8.7wc1 -k <other kernel versions>

# build a kernel-module deb
dkms mkdeb -m lustre -v 1.8.7wc1 --all
dkms mkdsc -m lustre -v 1.8.7wc1 --all

#rpm systems (not tested)
dkms mkrpm -m lustre -v 1.8.7wc1 --all

Cheers,

Guy

-- 
Dr. Guy Coates, Informatics Systems Group
The Wellcome Trust Sanger Institute, Hinxton, Cambridge, CB10 1HH, UK
Tel: +44 (0)1223 834244 x 6925
Fax: +44 (0)1223 496802



-- 
 The Wellcome Trust Sanger Institute is operated by Genome Research 
 Limited, a charity registered in England with number 1021457 and a 
 company registered in England with number 2742969, whose registered 
 office is 215 Euston Road, London, NW1 2BE. 
-------------- next part --------------
An embedded and charset-unspecified text was scrubbed...
Name: dkms.conf
Url:
http://lists.lustre.org/pipermail/lustre-discuss/attachments/20111215/7a85b907/attachment.pl

On 2011-12-15, at 7:09 AM, Guy Coates wrote:
> On 15/12/11 13:32, Ramiro Alba wrote:
>> Hi all,
>> 
>> I''ve made available an Ubuntu repository:
> 
> On a related note; attached is a dkms config file for lustre *client*
> kernel modules.
> 
> It will give you a deb containing the kernel modules, and will
> auto-magically rebuild modules when new kernels are installed. (You will
> still need to build the userspace deb as normal.)
> 
> Tested on ubuntu 10.04 / 2.6.32 kernel stream, but it should work on any
> distro that supports dkms and runs a kernel that is compatible with the
> lustre client.
It would be useful to others if you submitted a patch with this in it.  There
are already debian build targets (we build Ubuntu 10 clients).
How does this differ from this existing support?
> Instructions:
> 
> Stick the dkms.conf file in the top of your lustre source directory and
> copy it to /usr/src.
> 
> # register the source
> dkms add -m lustre -v 1.8.7wc1
> 
> # build module for currently installed kernel.
> dkms build -m lustre -v 1.8.7wc1
> 
> # optionally build for other kernel versions
> dkms build -m lustre -v 1.8.7wc1 -k <other kernel versions>
> 
> # build a kernel-module deb
> dkms mkdeb -m lustre -v 1.8.7wc1 --all
> dkms mkdsc -m lustre -v 1.8.7wc1 --all
> 
> #rpm systems (not tested)
> dkms mkrpm -m lustre -v 1.8.7wc1 --all
> 
> Cheers,
> 
> Guy
> 
> -- 
> Dr. Guy Coates, Informatics Systems Group
> The Wellcome Trust Sanger Institute, Hinxton, Cambridge, CB10 1HH, UK
> Tel: +44 (0)1223 834244 x 6925
> Fax: +44 (0)1223 496802
> 
> 
> 
> -- 
> The Wellcome Trust Sanger Institute is operated by Genome Research 
> Limited, a charity registered in England with number 1021457 and a 
> company registered in England with number 2742969, whose registered 
> office is 215 Euston Road, London, NW1 2BE. 
> <dkms.conf>_______________________________________________
> Lustre-discuss mailing list
> Lustre-discuss at lists.lustre.org
> http://lists.lustre.org/mailman/listinfo/lustre-discuss

Cheers, Andreas
--
Andreas Dilger 
Principal Engineer
Whamcloud, Inc.

Hi,
> It would be useful to others if you submitted a patch with this in it. 
I am happy to do this.

 There are already debian build targets (we build Ubuntu 10
clients).
> How does this differ from this existing support?

It provides are more convenient way to package the client-modules. The
current debian build uses module-assistant, which produces a deb which
is tied to a specific kernel version, and needs to be manually rebuilt
when the kernel is changed.

The dkms allows for modules for multiple kernel versions to be packaged
together into a single deb. Once installed, the package contains
triggers so that if a new kernel is installed for which no pre-build
modules exists, dkms will automatically build and install them.

The userspace packages are not affected.

Cheers,

Guy

-- 
Dr. Guy Coates, Informatics Systems Group
The Wellcome Trust Sanger Institute, Hinxton, Cambridge, CB10 1HH, UK
Tel: +44 (0)1223 834244 x 6925
Fax: +44 (0)1223 496802


-- 
 The Wellcome Trust Sanger Institute is operated by Genome Research 
 Limited, a charity registered in England with number 1021457 and a 
 company registered in England with number 2742969, whose registered 
 office is 215 Euston Road, London, NW1 2BE.