I follow the instruction (http://wiki.lustre.org/index.php/Debian_Install). When building with the command module-assistant -u . -k ./linux-source-3.0.0 -l 3.0.0 it throws the error saying kdist_config error as below: checking sys/quota.h presence... yes checking for sys/quota.h... yes checking whether to build kernel modules... yes (linux-gnu) checking for Linux sources... /usr/src/linux-source-3.0.0 checking for /usr/src/linux-source-3.0.0... yes checking for Linux objects dir... /usr/src/linux-source-3.0.0 checking for /boot/kernel.h... no checking for /var/adm/running-kernel.h... no checking for /usr/src/linux-source-3.0.0/.config... yes checking for /usr/src/linux-source-3.0.0/include/linux/autoconf.h... no configure: error: Run make config in /usr/src/linux-source-3.0.0. make[1]: *** [kdist_config] Error 1 make[1]: Leaving directory `/usr/src/linux-source-3.0.0/usr_src/modules/lustre'' make: *** [kdist_build] Error 2 What may go wrong? Environment: debian testing with kernel 3.0.0/ gcc (Debian 4.6.1-15) 4.6.1/ GNU Make 3.81 Thanks
On 11-11-16 07:02 AM, Thomas Anderson wrote:> > module-assistant -u . -k ./linux-source-3.0.0 -l 3.0.0 > > it throws the error saying kdist_config error as below: > > checking sys/quota.h presence... yes > checking for sys/quota.h... yes > checking whether to build kernel modules... yes (linux-gnu) > checking for Linux sources... /usr/src/linux-source-3.0.0 > checking for /usr/src/linux-source-3.0.0... yes > checking for Linux objects dir... /usr/src/linux-source-3.0.0 > checking for /boot/kernel.h... no > checking for /var/adm/running-kernel.h... no > checking for /usr/src/linux-source-3.0.0/.config... yes > checking for /usr/src/linux-source-3.0.0/include/linux/autoconf.h... > no > configure: error: Run make config in /usr/src/linux-source-3.0.0.As the error says, you need to run "make config" in your kernel source tree. If you have done that already then I would presume that the 3.0 kernel has changed enough that Lustre will need to be ported to support it. b. -- Brian J. Murrell Senior Software Engineer Whamcloud, Inc. -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 262 bytes Desc: OpenPGP digital signature Url : http://lists.lustre.org/pipermail/lustre-discuss/attachments/20111116/37565573/attachment.bin
Yes, Lustre will need porting to Linux 3.0. See http://jira.whamcloud.com/browse/LU-812 for more info. -Cory On 11/16/2011 6:50 AM, Brian J. Murrell wrote:> On 11-11-16 07:02 AM, Thomas Anderson wrote: >> >> module-assistant -u . -k ./linux-source-3.0.0 -l 3.0.0 >> >> it throws the error saying kdist_config error as below: >> >> checking sys/quota.h presence... yes >> checking for sys/quota.h... yes >> checking whether to build kernel modules... yes (linux-gnu) >> checking for Linux sources... /usr/src/linux-source-3.0.0 >> checking for /usr/src/linux-source-3.0.0... yes >> checking for Linux objects dir... /usr/src/linux-source-3.0.0 >> checking for /boot/kernel.h... no >> checking for /var/adm/running-kernel.h... no >> checking for /usr/src/linux-source-3.0.0/.config... yes >> checking for /usr/src/linux-source-3.0.0/include/linux/autoconf.h... >> no >> configure: error: Run make config in /usr/src/linux-source-3.0.0. > > As the error says, you need to run "make config" in your kernel source > tree. If you have done that already then I would presume that the 3.0 > kernel has changed enough that Lustre will need to be ported to support it. > > b. >
I''ve tested squeeze (kernel 2.6.32-5) and wheezy (2.6/ 3.0.0); both do not work. So looks like basically lusture module doesn''t work with kernel 2.6.32 onward. In addition to waiting for the patch, is there any chance that user can build by simply applying lustre patch and kernel source? Thanks again for all your help. On Thu, Nov 17, 2011 at 4:04 AM, Cory Spitz <spitzcor at cray.com> wrote:> Yes, Lustre will need porting to Linux 3.0. ?See > http://jira.whamcloud.com/browse/LU-812 for more info. > > -Cory > > On 11/16/2011 6:50 AM, Brian J. Murrell wrote: >> On 11-11-16 07:02 AM, Thomas Anderson wrote: >>> >>> module-assistant -u . ?-k ./linux-source-3.0.0 -l 3.0.0 >>> >>> it throws the error saying kdist_config error as below: >>> >>> ? checking sys/quota.h presence... yes >>> checking for sys/quota.h... yes >>> ? checking whether to build kernel modules... yes (linux-gnu) >>> ? checking for Linux sources... /usr/src/linux-source-3.0.0 >>> ? ?checking for /usr/src/linux-source-3.0.0... yes >>> checking for Linux objects dir... /usr/src/linux-source-3.0.0 >>> ? checking for /boot/kernel.h... no >>> ? checking for /var/adm/running-kernel.h... no >>> ? checking for /usr/src/linux-source-3.0.0/.config... yes >>> ? checking for /usr/src/linux-source-3.0.0/include/linux/autoconf.h... >>> no >>> ? ?configure: error: Run make config in /usr/src/linux-source-3.0.0. >> >> As the error says, you need to run "make config" in your kernel source >> tree. ?If you have done that already then I would presume that the 3.0 >> kernel has changed enough that Lustre will need to be ported to support it. >> >> b. >> > _______________________________________________ > Lustre-discuss mailing list > Lustre-discuss at lists.lustre.org > http://lists.lustre.org/mailman/listinfo/lustre-discuss >
Right, Lustre won''t currently build for kernels much beyond 2.6.32, but we''re (the community) is working on it. You may have better luck with patchless clients on late 2.6 kernels, but in 3.0 you''ll definitely need to wait for support. Feel free to contribute on your own ;) Do you just need to build clients or servers too? -Cory On 11/17/2011 4:37 AM, Thomas Anderson wrote:> I''ve tested squeeze (kernel 2.6.32-5) and wheezy (2.6/ 3.0.0); both do > not work. So looks like basically lusture module doesn''t work with > kernel 2.6.32 onward. > In addition to waiting for the patch, is there any chance that user > can build by simply applying lustre patch and kernel source? > > Thanks again for all your help. > > On Thu, Nov 17, 2011 at 4:04 AM, Cory Spitz<spitzcor at cray.com> wrote: >> Yes, Lustre will need porting to Linux 3.0. See >> http://jira.whamcloud.com/browse/LU-812 for more info. >> >> -Cory >> >> On 11/16/2011 6:50 AM, Brian J. Murrell wrote: >>> On 11-11-16 07:02 AM, Thomas Anderson wrote: >>>> >>>> module-assistant -u . -k ./linux-source-3.0.0 -l 3.0.0 >>>> >>>> it throws the error saying kdist_config error as below: >>>> >>>> checking sys/quota.h presence... yes >>>> checking for sys/quota.h... yes >>>> checking whether to build kernel modules... yes (linux-gnu) >>>> checking for Linux sources... /usr/src/linux-source-3.0.0 >>>> checking for /usr/src/linux-source-3.0.0... yes >>>> checking for Linux objects dir... /usr/src/linux-source-3.0.0 >>>> checking for /boot/kernel.h... no >>>> checking for /var/adm/running-kernel.h... no >>>> checking for /usr/src/linux-source-3.0.0/.config... yes >>>> checking for /usr/src/linux-source-3.0.0/include/linux/autoconf.h... >>>> no >>>> configure: error: Run make config in /usr/src/linux-source-3.0.0. >>> >>> As the error says, you need to run "make config" in your kernel source >>> tree. If you have done that already then I would presume that the 3.0 >>> kernel has changed enough that Lustre will need to be ported to support it. >>> >>> b. >>> >> _______________________________________________ >> Lustre-discuss mailing list >> Lustre-discuss at lists.lustre.org >> http://lists.lustre.org/mailman/listinfo/lustre-discuss >> > _______________________________________________ > Lustre-discuss mailing list > Lustre-discuss at lists.lustre.org > http://lists.lustre.org/mailman/listinfo/lustre-discuss
Hi, I''ve written a python script to walk the lustre filesystem, get the os.stat details for each file to get the file owner id and then generates a report of the total file size used by each user. I''m doing it this way as users own files sprinkled throughout the filesystem as opposed to all being filed away in neat subdirectories for each user. As this is just using the standard posix stuff it''s slow as it goes to the OSS''s to get the file info from there. Presumably it should be possible to get this info from the MDS ? If so, what lustre specific commands would be useful ? Is there a python module out there that links into the lustre client libraries to access info direct from the MDS ? Regards, Emyr
On 2011-11-17, at 4:39, Emyr James <emyrjames1 at gmail.com> wrote:> I''ve written a python script to walk the lustre filesystem, get the > os.stat details for each file to get the file owner id and then > generates a report of the total file size used by each user. I''m doing > it this way as users own files sprinkled throughout the filesystem as > opposed to all being filed away in neat subdirectories for each user.Why not simply enable quotas in accounting mode (without quota enforcement)? Then you can get this info without any scanning at all.> As this is just using the standard posix stuff it''s slow as it goes to the > OSS''s to get the file info from there. Presumably it should be possible > to get this info from the MDS ? If so, what lustre specific commands > would be useful ? Is there a python module out there that links into the > lustre client libraries to access info direct from the MDS ? > Regards, > Emyr > _______________________________________________ > Lustre-discuss mailing list > Lustre-discuss at lists.lustre.org > http://lists.lustre.org/mailman/listinfo/lustre-discuss
I want to test writing client for accessing to files stored on lustre environment. Now I can build lustre by following debian install page with lenny (kernerl 2.6.26-2-686). But when configuring lustre (http://wiki.lustre.org/index.php/Lustre_Configuration_Example) with command `mkfs.lustre --fsname=temp --mgs --mdt /dev/sdb5,` it throws error mkfs.lustre: Unable to mount /dev/sdb5: No such device Is the ldiskfs module available? It seems there is no ldiskfs command or kernel module existed. Where can I check if any step was wrong when building lustre? Thanks. On Thu, Nov 17, 2011 at 6:46 PM, Cory Spitz <spitzcor at cray.com> wrote:> Right, Lustre won''t currently build for kernels much beyond 2.6.32, but > we''re (the community) is working on it. ?You may have better luck with > patchless clients on late 2.6 kernels, but in 3.0 you''ll definitely need to > wait for support. ?Feel free to contribute on your own ;) > > Do you just need to build clients or servers too? > > -Cory > > On 11/17/2011 4:37 AM, Thomas Anderson wrote: >> >> I''ve tested squeeze (kernel 2.6.32-5) and wheezy (2.6/ 3.0.0); both do >> not work. So looks like basically lusture module doesn''t work with >> kernel 2.6.32 onward. >> In addition to waiting for the patch, is there any chance that user >> can build by simply applying lustre patch and kernel source? >> >> Thanks again for all your help. >> >> On Thu, Nov 17, 2011 at 4:04 AM, Cory Spitz<spitzcor at cray.com> ?wrote: >>> >>> Yes, Lustre will need porting to Linux 3.0. ?See >>> http://jira.whamcloud.com/browse/LU-812 for more info. >>> >>> -Cory >>> >>> On 11/16/2011 6:50 AM, Brian J. Murrell wrote: >>>> >>>> On 11-11-16 07:02 AM, Thomas Anderson wrote: >>>>> >>>>> module-assistant -u . ?-k ./linux-source-3.0.0 -l 3.0.0 >>>>> >>>>> it throws the error saying kdist_config error as below: >>>>> >>>>> ? checking sys/quota.h presence... yes >>>>> checking for sys/quota.h... yes >>>>> ? checking whether to build kernel modules... yes (linux-gnu) >>>>> ? checking for Linux sources... /usr/src/linux-source-3.0.0 >>>>> ? ?checking for /usr/src/linux-source-3.0.0... yes >>>>> checking for Linux objects dir... /usr/src/linux-source-3.0.0 >>>>> ? checking for /boot/kernel.h... no >>>>> ? checking for /var/adm/running-kernel.h... no >>>>> ? checking for /usr/src/linux-source-3.0.0/.config... yes >>>>> ? checking for /usr/src/linux-source-3.0.0/include/linux/autoconf.h... >>>>> no >>>>> ? ?configure: error: Run make config in /usr/src/linux-source-3.0.0. >>>> >>>> As the error says, you need to run "make config" in your kernel source >>>> tree. ?If you have done that already then I would presume that the 3.0 >>>> kernel has changed enough that Lustre will need to be ported to support >>>> it. >>>> >>>> b. >>>> >>> _______________________________________________ >>> Lustre-discuss mailing list >>> Lustre-discuss at lists.lustre.org >>> http://lists.lustre.org/mailman/listinfo/lustre-discuss >>> >> _______________________________________________ >> Lustre-discuss mailing list >> Lustre-discuss at lists.lustre.org >> http://lists.lustre.org/mailman/listinfo/lustre-discuss >
robinhood supplies this list, if you are using lustre 2.0 it directly queries the mdt. http://sourceforge.net/apps/trac/robinhood On this subject does anyone know of a tool/app that tracks folder sizes? mark ----- Original Message ----- From: "Andreas Dilger" <adilger at whamcloud.com> To: "Emyr James" <emyrjames1 at gmail.com> Cc: lustre-discuss at lists.lustre.org Sent: Friday, 18 November, 2011 3:30:02 AM Subject: Re: [Lustre-discuss] python lustre os.stat(path) On 2011-11-17, at 4:39, Emyr James <emyrjames1 at gmail.com> wrote:> I''ve written a python script to walk the lustre filesystem, get the > os.stat details for each file to get the file owner id and then > generates a report of the total file size used by each user. I''m doing > it this way as users own files sprinkled throughout the filesystem as > opposed to all being filed away in neat subdirectories for each user.Why not simply enable quotas in accounting mode (without quota enforcement)? Then you can get this info without any scanning at all.> As this is just using the standard posix stuff it''s slow as it goes to the > OSS''s to get the file info from there. Presumably it should be possible > to get this info from the MDS ? If so, what lustre specific commands > would be useful ? Is there a python module out there that links into the > lustre client libraries to access info direct from the MDS ? > Regards, > Emyr > _______________________________________________ > Lustre-discuss mailing list > Lustre-discuss at lists.lustre.org > http://lists.lustre.org/mailman/listinfo/lustre-discuss_______________________________________________ Lustre-discuss mailing list Lustre-discuss at lists.lustre.org http://lists.lustre.org/mailman/listinfo/lustre-discuss -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.lustre.org/pipermail/lustre-discuss/attachments/20111118/d36abeed/attachment.html
Mark Day a ?crit :> robinhood supplies this list, if you are using lustre 2.0 it directly > queries the mdt. > > http://sourceforge.net/apps/trac/robinhood > > On this subject does anyone know of a tool/app that tracks folder sizes?Robinhood can also do this. Aur?lien