Lustre discuss - Jun 2008 - What do I need if I want to install lustre on ubuntu 8.04

When I input the command " apt-cache search lustre ", it gives me the
list of the package names including   liblustre, linux-patch-lustre,
lustre-dev, lustre-source and lustre-utils. Do these packages enough
for me to install both Lustre server and client??

Thank you!

On Tue, Jun 10, 2008 at 09:34:38AM -0700, Jmlover wrote:
> When I input the command " apt-cache search lustre ", it gives me
the
> list of the package names including   liblustre, linux-patch-lustre,
> lustre-dev, lustre-source and lustre-utils. Do these packages enough
> for me to install both Lustre server and client??
Yes, I would think so. You probably need to apply the kernel patches from the
linux-patch-lustre package on the server side, recompile the lustre modules
(from the lustre-source package with module-assistant) for both servers and
- patchless - clients and also install lustre-utils on all the nodes.

Johann

On Tue, 2008-06-10 at 09:34 -0700, Jmlover wrote:
> When I input the command " apt-cache search lustre ", it gives me
the
> list of the package names including   liblustre, linux-patch-lustre,
> lustre-dev, lustre-source and lustre-utils. Do these packages enough
> for me to install both Lustre server and client??
What distribution are you working on?

b.

-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 189 bytes
Desc: This is a digitally signed message part
Url :
http://lists.lustre.org/pipermail/lustre-discuss/attachments/20080613/e797a278/attachment.bin

On Fri, 2008-06-13 at 09:09 -0400, Brian J. Murrell
wrote:
> On Tue, 2008-06-10 at 09:34 -0700, Jmlover wrote:
> > When I input the command " apt-cache search lustre ", it
gives me the
> > list of the package names including   liblustre, linux-patch-lustre,
> > lustre-dev, lustre-source and lustre-utils. Do these packages enough
> > for me to install both Lustre server and client??
> 
> What distribution are you working on?
Doh!  It was pointed out to me that your distro is in the Subject.  :-/
I''m currently in "beginning of day" mailbox mode in which I
tend to plow
through the message bodies, not paying much attention to Subject lines.

In any case, the important question is what kernel release are you
using?  What does "uname -r" tell you?

b.
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 189 bytes
Desc: This is a digitally signed message part
Url :
http://lists.lustre.org/pipermail/lustre-discuss/attachments/20080613/0dfc5c45/attachment.bin

On 6/10/08 9:34 AM, "Jmlover" <Jmlover at gmail.com> wrote:
> When I input the command " apt-cache search lustre ", it gives me
the
> list of the package names including   liblustre, linux-patch-lustre,
> lustre-dev, lustre-source and lustre-utils. Do these packages enough
> for me to install both Lustre server and client??
> 
> Thank you!
> _______________________________________________
> Lustre-discuss mailing list
> Lustre-discuss at lists.lustre.org
> http://lists.lustre.org/mailman/listinfo/lustre-discuss
> 
The procedure is much the same as Debian, but the documentation is horrible.
Here is the idea, we''ve had to edit some patches at times to make it
work
because things were missing.

Apt-get all the luster packages, the kernel-source package, module-assistant
(should be already installed), kernel-package, fakeroot, and
build-essentials.

A kernel tar will be in /usr/src, untar it and run make menuconfig, or
whatever to configure your kernel. I usually just copy my old config from
/boot/<kernel-version>.conf to .config.

Then compile your kernel with something like:

CONCURRENCY_LEVEL=10 fakeroot make-kpkg --initrd --with-patches lustre
binary

*I would not recommend using --append-to-version as the lustre patches can
not handle finding the right kernel patches with stuff appended to the
version. This is a bug and I asked one of my workers to file a Debian bug
for it. The best place to fix it would be upstream though.

CONCURRENCAY_LEVEL is the same as make -j and will use multiple processors
to compile the kernel. I highly recommend using that to cut your compile
time down. After your kernel builds fine install the new kernel package that
is in /usr/src and reboot. Once you have rebooted then run module-assistant
to build the Lustre modules.

m-a auto-install lustre

This will build the modules and install them for you. Now follow the
instructions on the Lustre website to set up your servers and clients. Since
we built a nice deb package for the kernel, we usually install it on all of
our clients, but you could get away with a patchless config (haven''t
done it
though).

There may be some errors in my instructions above as it has been many months
since I''ve done it. Also Open-IB is a pain in the neck to get to work
since
the whole project is Red Hat based. We usually cheat by getting their source
RPM with all the patches already done, get a Debian kernel with the same
version and make a patch file, then apply that to the kernel source right
before make-kpkg command.

Hope that helps.

Robert

-- 
Robert LeBlanc
Life Sciences Computer Support
Brigham Young University
leblanc at byu.edu
(801)422-1882

I just went down this road and ended up reverting back to a 2.6.22 kernel 
and using the patchless client.  Below are the steps I have used to get 
this working successfully.

1. Install the following packages: kernel-package, module-assiatnt, 
dpatch, libncurses5-dev, lustre-source, lustre-utils.

- there may be more packages necessary but I use a preseeded install and 
these were the packages I was missing.

2. Download the 2.6.22-19 kernel source from kernel.org and untar into 
/usr/src.

3. Copy the running config to the 2.6.22 kernel directory - "cp 
/boot/config-`uname -r` /usr/src/<kernel_source_dir>/.config"

4. run "make menuconfig" from with the kernel source directory and
make
any changes that you need.  You do not need any modifications for lustre. 
Save the config.

5. Build the kernel packages:

- make-kpkg clean
- make-kpkg --append-to-version=-<whatever_you_want> kernel_image --initrd
binary

6. You will now have several new .deb packages in /usr/src.  Install them. 
You can use these packages on other Ubuntu boxes and skip steps 1 - 5 on 
subsequent servers. Don''t forget to update /boot/grub/menu.lst if you
want
to boot this kernel by default.

7. Reboot

8. Now build the lustre modules:

- m-a update
- m-a a-i lustre

9. Reboot and mount your filesystems (i.e. mount -t lustre 
server at tcp0:/location/of/filesystem /local/mount/point)

Building the lustre modules (step 8) will also create a .deb in /usr/src. 
You can use this on subsequent server build as well thus eliminating the 
need for step 8 in future installs.

Hope this helps. I spent a lot of time getting the client working the way 
I wanted and this is working for me.

Thanks,

-brendan

On Fri, 13 Jun 2008, Robert LeBlanc wrote:
> On 6/10/08 9:34 AM, "Jmlover" <Jmlover at gmail.com> wrote:
>
>> When I input the command " apt-cache search lustre ", it
gives me the
>> list of the package names including   liblustre, linux-patch-lustre,
>> lustre-dev, lustre-source and lustre-utils. Do these packages enough
>> for me to install both Lustre server and client??
>>
>> Thank you!
>> _______________________________________________
>> Lustre-discuss mailing list
>> Lustre-discuss at lists.lustre.org
>> http://lists.lustre.org/mailman/listinfo/lustre-discuss
>>
>
> The procedure is much the same as Debian, but the documentation is
horrible.
> Here is the idea, we''ve had to edit some patches at times to make
it work
> because things were missing.
>
> Apt-get all the luster packages, the kernel-source package,
module-assistant
> (should be already installed), kernel-package, fakeroot, and
> build-essentials.
>
> A kernel tar will be in /usr/src, untar it and run make menuconfig, or
> whatever to configure your kernel. I usually just copy my old config from
> /boot/<kernel-version>.conf to .config.
>
> Then compile your kernel with something like:
>
> CONCURRENCY_LEVEL=10 fakeroot make-kpkg --initrd --with-patches lustre
> binary
>
> *I would not recommend using --append-to-version as the lustre patches can
> not handle finding the right kernel patches with stuff appended to the
> version. This is a bug and I asked one of my workers to file a Debian bug
> for it. The best place to fix it would be upstream though.
>
> CONCURRENCAY_LEVEL is the same as make -j and will use multiple processors
> to compile the kernel. I highly recommend using that to cut your compile
> time down. After your kernel builds fine install the new kernel package
that
> is in /usr/src and reboot. Once you have rebooted then run module-assistant
> to build the Lustre modules.
>
> m-a auto-install lustre
>
> This will build the modules and install them for you. Now follow the
> instructions on the Lustre website to set up your servers and clients.
Since
> we built a nice deb package for the kernel, we usually install it on all of
> our clients, but you could get away with a patchless config
(haven''t done it
> though).
>
> There may be some errors in my instructions above as it has been many
months
> since I''ve done it. Also Open-IB is a pain in the neck to get to
work since
> the whole project is Red Hat based. We usually cheat by getting their
source
> RPM with all the patches already done, get a Debian kernel with the same
> version and make a patch file, then apply that to the kernel source right
> before make-kpkg command.
>
> Hope that helps.
>
> Robert
>
> -- 
> Robert LeBlanc
> Life Sciences Computer Support
> Brigham Young University
> leblanc at byu.edu
> (801)422-1882
>
> _______________________________________________
> Lustre-discuss mailing list
> Lustre-discuss at lists.lustre.org
> http://lists.lustre.org/mailman/listinfo/lustre-discuss
>
> !DSPAM:4852922f296221133913078!
>

There are also binaries availible at
http://www.pdsi-scidac.org/repository/debian/index.html which should get
you running as well.

Evan
> -----Original Message-----
> From: lustre-discuss-bounces at lists.lustre.org 
> [mailto:lustre-discuss-bounces at lists.lustre.org] On Behalf Of 
> Johann Lombardi
> Sent: Friday, June 13, 2008 1:30 AM
> To: Jmlover
> Cc: lustre-discuss at clusterfs.com
> Subject: Re: [Lustre-discuss] What do I need if I want to 
> install lustreon ubuntu 8.04
> 
> On Tue, Jun 10, 2008 at 09:34:38AM -0700, Jmlover wrote:
> > When I input the command " apt-cache search lustre ", it 
> gives me the
> > list of the package names including   liblustre, linux-patch-lustre,
> > lustre-dev, lustre-source and lustre-utils. Do these 
> packages enough 
> > for me to install both Lustre server and client??
> 
> Yes, I would think so. You probably need to apply the kernel 
> patches from the linux-patch-lustre package on the server 
> side, recompile the lustre modules (from the lustre-source 
> package with module-assistant) for both servers and
> - patchless - clients and also install lustre-utils on all the nodes.
> 
> Johann
> _______________________________________________
> Lustre-discuss mailing list
> Lustre-discuss at lists.lustre.org
> http://lists.lustre.org/mailman/listinfo/lustre-discuss
>