Hello, I need PAE-enabled kernels for my cluster. Thus, I would like to rebuild the kernel packages as provided by lustre for RHEL/CentOS. I tried to follow the guide on the Lustre wiki [1], which unfortunately just produces a very generic rpm which does not take care of initrd, grub etc. Additionally, the -devel package is missing, breaking many dependencies. I tried to integrate the method described in [1] with the guide for CentOS kernel compilatiom [2], but didn''t succeed. Somehow, the lustre packages for ldiskfs aren''t compiled automatically, and I get a lot of missing symbol errors upon installing the resulting rpms. What is the correct way of producing these kernel rpms? Cheers, Arne [1] http://wiki.lustre.org/index.php/Building_and_Installing_Lustre_from_Source_Code [2] http://wiki.centos.org/HowTos/Custom_Kernel -- Arne Brutschy Ph.D. Student Email arne.brutschy(AT)ulb.ac.be IRIDIA CP 194/6 Web iridia.ulb.ac.be/~abrutschy Universite'' Libre de Bruxelles Tel +32 2 650 2273 Avenue Franklin Roosevelt 50 Fax +32 2 650 2715 1050 Bruxelles, Belgium (Fax at IRIDIA secretary)
On Thu, 2010-12-16 at 13:17 +0100, Arne Brutschy wrote:> Hello,Hi,> I need PAE-enabled kernels for my cluster.Do you actually use a 32 bit kernel/OS installation on your Lustre _servers_? Can I ask why (not use an x86_64 kernel)? b. -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 198 bytes Desc: This is a digitally signed message part Url : http://lists.lustre.org/pipermail/lustre-discuss/attachments/20101216/d4190578/attachment.bin
Hi, I am using the rocks distribution, which does not allow to mix 32bit and 64bit systems. So it''s either all 64bit or none, and I am quite hesitant to make the switch (we have no requirement for 64bit from the cluster users). Anyways, I need to apply other patches as well (network card driver, which can be installed as RPM as well but is a pain). Cheers, Arne On Thu, 2010-12-16 at 16:49 -0500, Brian J. Murrell wrote:> On Thu, 2010-12-16 at 13:17 +0100, Arne Brutschy wrote: > > Hello, > > Hi, > > > I need PAE-enabled kernels for my cluster. > > Do you actually use a 32 bit kernel/OS installation on your Lustre > _servers_? Can I ask why (not use an x86_64 kernel)? > > b. > > _______________________________________________ > Lustre-discuss mailing list > Lustre-discuss at lists.lustre.org > http://lists.lustre.org/mailman/listinfo/lustre-discuss-- Arne Brutschy Ph.D. Student Email arne.brutschy(AT)ulb.ac.be IRIDIA CP 194/6 Web iridia.ulb.ac.be/~abrutschy Universite'' Libre de Bruxelles Tel +32 2 650 2273 Avenue Franklin Roosevelt 50 Fax +32 2 650 2715 1050 Bruxelles, Belgium (Fax at IRIDIA secretary)
On Fri, 2010-12-17 at 09:50 +0100, Arne Brutschy wrote:> Hi,Hi,> I am using the rocks distribution, which does not allow to mix 32bit and > 64bit systems.That seems like quite a limitation.> So it''s either all 64bit or none, and I am quite hesitant > to make the switch (we have no requirement for 64bit from the cluster > users).I don''t know if PAE addresses this limitation but the one other problem with 32 bit kernels is the limited amount of RAM (~1GB only, no matter how much is in the machine) that the kernel can use. Given that Lustre is all in the kernel, it doesn''t make much sense to put even 4G of RAM into a system where the kernel can use only 1GB of it.> Anyways, I need to apply other patches as well (network card > driver, which can be installed as RPM as well but is a pain).A network card driver really should only require the kernel headers to build, which kernel-devel supplies, IIRC, for RHEL/CentOS. b. -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 198 bytes Desc: This is a digitally signed message part Url : http://lists.lustre.org/pipermail/lustre-discuss/attachments/20101217/0adae5f3/attachment.bin
Hello! On Dec 17, 2010, at 1:11 PM, Brian J. Murrell wrote:> I don''t know if PAE addresses this limitation but the one other problem > with 32 bit kernels is the limited amount of RAM (~1GB only, no matter > how much is in the machine) that the kernel can use. Given that Lustre > is all in the kernel, it doesn''t make much sense to put even 4G of RAM > into a system where the kernel can use only 1GB of it.In fact it''s possible to change user/kernel split to let kernel use up to 3G of RAM in such a case. There was also 1:1 split some time ago, though I have no idea if there are any current patches for that. That said, I sort of don''t understand how the rocks distribution would affect servers vs clients. I would think just install 64 bits rocks as servers and 32bit rocks as clients and since you don''t need to run anything from the servers on the clients or the other way around and 32bit clients can talk just fine to the 64 bit servers in Lustre, there should be no problems in such a setup. Bye, Oleg