Brock Palen
2008-Jul-25 18:03 UTC
[Lustre-discuss] Can''t build sun rdac driver against lustre source.
Hi I ran into two problems, The first was easy to resolve: /bin/sh: scripts/genksyms/genksyms: No such file or directory /bin/sh: scripts/mod/modpost: No such file or directory I just had to copy genksyms and mod from linux-2.6.9-67.0.7.EL_lustre.1.6.5.1 to linux-2.6.9-67.0.7.EL_lustre. 1.6.5.1-obj I figured you should be aware of this, if its a problem with sun''s build system for their multipath driver or lustre source package. This is on RHEL4. Using the lustre RPM''s form sun''s website. The next problem I am stuck on is: In file included from mppLnx26_spinlock_size.c:51: /usr/include/linux/autoconf.h:1:2: #error Invalid kernel header included in userspace mppLnx26_spinlock_size.c: In function `main'': mppLnx26_spinlock_size.c:102: error: `spinlock_t'' undeclared (first use in this function) mppLnx26_spinlock_size.c:102: error: (Each undeclared identifier is reported only once mppLnx26_spinlock_size.c:102: error: for each function it appears in.) make: *** [mppLnx_Spinlock_Size] Error 1 I guess what I should really ask is, Has anyone ever made multipath work with a sun 2540 array for use as the MDS/MGS file system? Brock Palen www.umich.edu/~brockp Center for Advanced Computing brockp at umich.edu (734)936-1985
Stuart Marshall
2008-Jul-25 18:19 UTC
[Lustre-discuss] Can''t build sun rdac driver against lustre source.
Hi, I have compiled and used the run rdac driver and my modified makefile is attached. The sequence I''ve used (perhaps not the best) is: - cd /lib/modules/2.6.9-67.0.7.EL_lustre.1.6.5.1smp/source/ - cp /boot/config-2.6.9-67.0.7.EL_lustre.1.6.5.1smp .config - make clean - make mrproper - make prepare-all - cd /tmp - tar xf <path_to_rdac_tarfile>/rdac-LINUX-09.01.B2.74-source.tar - cd linuxrdac-09.01.B2.74/ - cp <path_to_my_makefile>/Makefile_linuxrdac-09.01.B2.74 Makefile - make clean - make uninstall - make - make install - vim /boot/grub/menu.lst (initrd -> mpp) - reboot The changes in the Makefile may fix your problem. I''m using 6140 Sun arrays and also plan to use a 2540 as the MDT soon. Stuart On Fri, Jul 25, 2008 at 11:03 AM, Brock Palen <brockp at umich.edu> wrote:> Hi I ran into two problems, The first was easy to resolve: > > /bin/sh: scripts/genksyms/genksyms: No such file or directory > /bin/sh: scripts/mod/modpost: No such file or directory > > I just had to copy genksyms and mod from > linux-2.6.9-67.0.7.EL_lustre.1.6.5.1 to linux-2.6.9-67.0.7.EL_lustre. > 1.6.5.1-obj > > I figured you should be aware of this, if its a problem with sun''s > build system for their multipath driver or lustre source package. > This is on RHEL4. Using the lustre RPM''s form sun''s website. > > > The next problem I am stuck on is: > > In file included from mppLnx26_spinlock_size.c:51: > /usr/include/linux/autoconf.h:1:2: #error Invalid kernel header > included in userspace > mppLnx26_spinlock_size.c: In function `main'': > mppLnx26_spinlock_size.c:102: error: `spinlock_t'' undeclared (first > use in this function) > mppLnx26_spinlock_size.c:102: error: (Each undeclared identifier is > reported only once > mppLnx26_spinlock_size.c:102: error: for each function it appears in.) > make: *** [mppLnx_Spinlock_Size] Error 1 > > > I guess what I should really ask is, > Has anyone ever made multipath work with a sun 2540 array for use as > the MDS/MGS file system? > > Brock Palen > www.umich.edu/~brockp <http://www.umich.edu/%7Ebrockp> > Center for Advanced Computing > brockp at umich.edu > (734)936-1985 > > > > _______________________________________________ > Lustre-discuss mailing list > Lustre-discuss at lists.lustre.org > http://lists.lustre.org/mailman/listinfo/lustre-discuss >-------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.lustre.org/pipermail/lustre-discuss/attachments/20080725/62825465/attachment.html -------------- next part -------------- A non-text attachment was scrubbed... Name: Makefile_linuxrdac-09.01.B2.74 Type: application/octet-stream Size: 13610 bytes Desc: not available Url : http://lists.lustre.org/pipermail/lustre-discuss/attachments/20080725/62825465/attachment.obj
Kilian CAVALOTTI
2008-Jul-25 18:23 UTC
[Lustre-discuss] Can''t build sun rdac driver against lustre source.
Hi Brock, On Friday 25 July 2008 11:03:12 am Brock Palen wrote:> I just had to copy genksyms and mod from > linux-2.6.9-67.0.7.EL_lustre.1.6.5.1 to linux-2.6.9-67.0.7.EL_lustre. > 1.6.5.1-obj > > I figured you should be aware of this, if its a problem with sun''s > build system for their multipath driver or lustre source package. > This is on RHEL4. Using the lustre RPM''s form sun''s website.It''s a problem with the fact that Lustre kernels for RHEL4 are packaged the SuSE way, with a /usr/src/linux-$VERSION-$RELEASE/ and a /usr/src/linux-$VERSION-$RELEASE-obj/$ARCH/$FLAVOR/ directory holding the object files. Whereas RHEL4 expects everything to be located in /usr/src/linux-$VERSION-$RELEASE/. A workaround this is to put the .config file into the kernel sources directory, and prepare the kernel tree manually. What I usually do is the following (this is for Lustre 1.6.5.1): # rm /lib/modules/2.6.9-67.0.7.EL_lustre.1.6.5.1smp/build # ln -s /usr/src/linux-2.6.9-67.0.7.EL_lustre.1.6.5.1 /lib/modules/2.6.9-67.0.7.EL_lustre.1.6.5.1smp/build # cp /usr/src/linux-2.6.9-67.0.7.EL_lustre.1.6.5.1-obj/x86_64/smp/.config /usr/src/linux-2.6.9-67.0.7.EL_lustre.1.6.5.1/ # cd /usr/src/linux-2.6.9-67.0.7.EL_lustre.1.6.5.1/ # [edit Makefile, and replace ''custom'' by ''smp'' in EXTRAVERSION] # make oldconfig # make modules_prepare And then, you should be able to compile any additional kernel module.> The next problem I am stuck on is: > > In file included from mppLnx26_spinlock_size.c:51: > /usr/include/linux/autoconf.h:1:2: #error Invalid kernel header > included in userspace > mppLnx26_spinlock_size.c: In function `main'': > mppLnx26_spinlock_size.c:102: error: `spinlock_t'' undeclared (first > use in this function)Can''t be sure it will fix this problem too, but it may be worth a try. Cheers, -- Kilian
Kilian CAVALOTTI
2008-Jul-25 18:26 UTC
[Lustre-discuss] Can''t build sun rdac driver against lustre source.
Hi Stuart, On Friday 25 July 2008 11:19:18 am Stuart Marshall wrote:> The sequence I''ve used (perhaps not the best) is: > > - cd /lib/modules/2.6.9-67.0.7.EL_lustre.1.6.5.1smp/source/ > - cp /boot/config-2.6.9-67.0.7.EL_lustre.1.6.5.1smp .config > - make clean > - make mrproperDoesn''t "make mrproper" erase the .config file you just copied? In which case you probably end up with a default kernel, which doesn''t matter too much since it''s only about compiling an external module, but I guess it can bite you back if you ever consider recompiling the whole kernel. Cheers, -- Kilian
Brock Palen
2008-Jul-25 18:30 UTC
[Lustre-discuss] Can''t build sun rdac driver against lustre source.
Yes that worked! Thank you very much. Hin''t to sun, the 2540 is a very nice array for lustre, it would be good if all the tools with it were checked to work out the box with lustre. Just 2 cents. Brock Palen www.umich.edu/~brockp Center for Advanced Computing brockp at umich.edu (734)936-1985 On Jul 25, 2008, at 2:19 PM, Stuart Marshall wrote:> Hi, > > I have compiled and used the run rdac driver and my modified > makefile is attached. > > The sequence I''ve used (perhaps not the best) is: > > - cd /lib/modules/2.6.9-67.0.7.EL_lustre.1.6.5.1smp/source/ > - cp /boot/config-2.6.9-67.0.7.EL_lustre.1.6.5.1smp .config > - make clean > - make mrproper > - make prepare-all > > - cd /tmp > - tar xf <path_to_rdac_tarfile>/rdac-LINUX-09.01.B2.74-source.tar > - cd linuxrdac-09.01.B2.74/ > - cp <path_to_my_makefile>/Makefile_linuxrdac-09.01.B2.74 Makefile > - make clean > - make uninstall > - make > - make install > - vim /boot/grub/menu.lst (initrd -> mpp) > - reboot > > The changes in the Makefile may fix your problem. I''m using 6140 > Sun arrays and also plan to use a 2540 as the MDT soon. > > Stuart > > > On Fri, Jul 25, 2008 at 11:03 AM, Brock Palen <brockp at umich.edu> > wrote: > Hi I ran into two problems, The first was easy to resolve: > > /bin/sh: scripts/genksyms/genksyms: No such file or directory > /bin/sh: scripts/mod/modpost: No such file or directory > > I just had to copy genksyms and mod from > linux-2.6.9-67.0.7.EL_lustre.1.6.5.1 to linux-2.6.9-67.0.7.EL_lustre. > 1.6.5.1-obj > > I figured you should be aware of this, if its a problem with sun''s > build system for their multipath driver or lustre source package. > This is on RHEL4. Using the lustre RPM''s form sun''s website. > > > The next problem I am stuck on is: > > In file included from mppLnx26_spinlock_size.c:51: > /usr/include/linux/autoconf.h:1:2: #error Invalid kernel header > included in userspace > mppLnx26_spinlock_size.c: In function `main'': > mppLnx26_spinlock_size.c:102: error: `spinlock_t'' undeclared (first > use in this function) > mppLnx26_spinlock_size.c:102: error: (Each undeclared identifier is > reported only once > mppLnx26_spinlock_size.c:102: error: for each function it appears in.) > make: *** [mppLnx_Spinlock_Size] Error 1 > > > I guess what I should really ask is, > Has anyone ever made multipath work with a sun 2540 array for use as > the MDS/MGS file system? > > Brock Palen > www.umich.edu/~brockp > Center for Advanced Computing > brockp at umich.edu > (734)936-1985 > > > > _______________________________________________ > Lustre-discuss mailing list > Lustre-discuss at lists.lustre.org > http://lists.lustre.org/mailman/listinfo/lustre-discuss > > <Makefile_linuxrdac-09.01.B2.74>-------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.lustre.org/pipermail/lustre-discuss/attachments/20080725/b29fbc08/attachment.html
Brock Palen
2008-Jul-25 18:34 UTC
[Lustre-discuss] Can''t build sun rdac driver against lustre source.
Stuart, It looks like you have a newer rdac package than sun has on their website. So while your make file builds everything, it ties to install a bit of code that does not exist. FYI. Brock Palen www.umich.edu/~brockp Center for Advanced Computing brockp at umich.edu (734)936-1985 On Jul 25, 2008, at 2:30 PM, Brock Palen wrote:> Yes that worked! Thank you very much. > > Hin''t to sun, the 2540 is a very nice array for lustre, it would be > good if all the tools with it were checked to work out the box with > lustre. Just 2 cents. > > Brock Palen > www.umich.edu/~brockp > Center for Advanced Computing > brockp at umich.edu > (734)936-1985 > > > > On Jul 25, 2008, at 2:19 PM, Stuart Marshall wrote: >> Hi, >> >> I have compiled and used the run rdac driver and my modified >> makefile is attached. >> >> The sequence I''ve used (perhaps not the best) is: >> >> - cd /lib/modules/2.6.9-67.0.7.EL_lustre.1.6.5.1smp/source/ >> - cp /boot/config-2.6.9-67.0.7.EL_lustre.1.6.5.1smp .config >> - make clean >> - make mrproper >> - make prepare-all >> >> - cd /tmp >> - tar xf <path_to_rdac_tarfile>/rdac-LINUX-09.01.B2.74-source.tar >> - cd linuxrdac-09.01.B2.74/ >> - cp <path_to_my_makefile>/Makefile_linuxrdac-09.01.B2.74 >> Makefile >> - make clean >> - make uninstall >> - make >> - make install >> - vim /boot/grub/menu.lst (initrd -> mpp) >> - reboot >> >> The changes in the Makefile may fix your problem. I''m using 6140 >> Sun arrays and also plan to use a 2540 as the MDT soon. >> >> Stuart >> >> >> On Fri, Jul 25, 2008 at 11:03 AM, Brock Palen <brockp at umich.edu> >> wrote: >> Hi I ran into two problems, The first was easy to resolve: >> >> /bin/sh: scripts/genksyms/genksyms: No such file or directory >> /bin/sh: scripts/mod/modpost: No such file or directory >> >> I just had to copy genksyms and mod from >> linux-2.6.9-67.0.7.EL_lustre.1.6.5.1 to linux-2.6.9-67.0.7.EL_lustre. >> 1.6.5.1-obj >> >> I figured you should be aware of this, if its a problem with sun''s >> build system for their multipath driver or lustre source package. >> This is on RHEL4. Using the lustre RPM''s form sun''s website. >> >> >> The next problem I am stuck on is: >> >> In file included from mppLnx26_spinlock_size.c:51: >> /usr/include/linux/autoconf.h:1:2: #error Invalid kernel header >> included in userspace >> mppLnx26_spinlock_size.c: In function `main'': >> mppLnx26_spinlock_size.c:102: error: `spinlock_t'' undeclared (first >> use in this function) >> mppLnx26_spinlock_size.c:102: error: (Each undeclared identifier is >> reported only once >> mppLnx26_spinlock_size.c:102: error: for each function it appears >> in.) >> make: *** [mppLnx_Spinlock_Size] Error 1 >> >> >> I guess what I should really ask is, >> Has anyone ever made multipath work with a sun 2540 array for use as >> the MDS/MGS file system? >> >> Brock Palen >> www.umich.edu/~brockp >> Center for Advanced Computing >> brockp at umich.edu >> (734)936-1985 >> >> >> >> _______________________________________________ >> Lustre-discuss mailing list >> Lustre-discuss at lists.lustre.org >> http://lists.lustre.org/mailman/listinfo/lustre-discuss >> >> <Makefile_linuxrdac-09.01.B2.74> > > _______________________________________________ > Lustre-discuss mailing list > Lustre-discuss at lists.lustre.org > http://lists.lustre.org/mailman/listinfo/lustre-discuss-------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.lustre.org/pipermail/lustre-discuss/attachments/20080725/13cd426d/attachment.html