Are there any gotchas? Or is it worth staying with the older Centos
5.4/5.5 based kernels from the download site?
Thanks!
--
Joseph Landman, Ph.D
Founder and CEO
Scalable Informatics Inc.
email: landman at scalableinformatics.com
web : http://scalableinformatics.com
http://scalableinformatics.com/sicluster
phone: +1 734 786 8423 x121
fax : +1 866 888 3112
cell : +1 734 612 4615
On Tue, May 31, 2011 at 10:56 PM, Joe Landman <landman at scalableinformatics.com> wrote:> Are there any gotchas? ?Or is it worth staying with the older Centos > 5.4/5.5 based kernels from the download site?Hi Joseph, are you talking about the client or the server? The client works fine with the 2.6.18-238.9.1.el5 kernel, on Scientific Linux 5, that is. Regards, G?tz Waschk
On 06/01/2011 04:13 AM, G?tz Waschk wrote:> On Tue, May 31, 2011 at 10:56 PM, Joe Landman > <landman at scalableinformatics.com> wrote: >> Are there any gotchas? Or is it worth staying with the older Centos >> 5.4/5.5 based kernels from the download site? > Hi Joseph, > > are you talking about the client or the server? The client works fine > with the 2.6.18-238.9.1.el5 kernel, on Scientific Linux 5, that is.Server side. I finished the build, and put the results here (if this is useful for anyone else) http://download.scalableinformatics.com/lustre/1.8git_build/ Thanks to all for the pointer to the documents. -- Joseph Landman, Ph.D Founder and CEO Scalable Informatics, Inc. email: landman at scalableinformatics.com web : http://scalableinformatics.com http://scalableinformatics.com/sicluster phone: +1 734 786 8423 x121 fax : +1 866 888 3112 cell : +1 734 612 4615
Actually, we have 2.6.18-238 in testing for Lustre 1.8.6 release, builds fine, you can get RPMS/SRPMS here: http://newbuild.whamcloud.com/job/lustre-b1_8/lastSuccessfulBuild/ including the server kernels. or source from our git repo cliffw On Wed, Jun 1, 2011 at 1:16 AM, Joe Landman <landman at scalableinformatics.com> wrote:> On 06/01/2011 04:13 AM, G?tz Waschk wrote: > > On Tue, May 31, 2011 at 10:56 PM, Joe Landman > > <landman at scalableinformatics.com> wrote: > >> Are there any gotchas? Or is it worth staying with the older Centos > >> 5.4/5.5 based kernels from the download site? > > Hi Joseph, > > > > are you talking about the client or the server? The client works fine > > with the 2.6.18-238.9.1.el5 kernel, on Scientific Linux 5, that is. > > Server side. I finished the build, and put the results here (if this is > useful for anyone else) > http://download.scalableinformatics.com/lustre/1.8git_build/ > > Thanks to all for the pointer to the documents. > > > > -- > Joseph Landman, Ph.D > Founder and CEO > Scalable Informatics, Inc. > email: landman at scalableinformatics.com > web : http://scalableinformatics.com > http://scalableinformatics.com/sicluster > phone: +1 734 786 8423 x121 > fax : +1 866 888 3112 > cell : +1 734 612 4615 > _______________________________________________ > Lustre-discuss mailing list > Lustre-discuss at lists.lustre.org > http://lists.lustre.org/mailman/listinfo/lustre-discuss >-- cliffw Support Guy WhamCloud, Inc. www.whamcloud.com -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.lustre.org/pipermail/lustre-discuss/attachments/20110601/370de90c/attachment.html
Christopher Walker
2011-Jun-02 03:33 UTC
[Lustre-discuss] Has anyone built 1.8.5 on Centos 5.6?
Hi, What testing have these builds gone through? I was thinking about using one of these to get around LU-274, but I was under the impression that these weren''t as thoroughly tested as the proper releases are. This build system is fantastic, BTW. Thanks, Chris On 6/1/11 4:53 PM, Cliff White wrote:> Actually, we have 2.6.18-238 in testing for Lustre 1.8.6 release, > builds fine, > you can get RPMS/SRPMS > here: http://newbuild.whamcloud.com/job/lustre-b1_8/lastSuccessfulBuild/ > including the server kernels. > > or source from our git repo > cliffw > > > > On Wed, Jun 1, 2011 at 1:16 AM, Joe Landman > <landman at scalableinformatics.com > <mailto:landman at scalableinformatics.com>> wrote: > > On 06/01/2011 04:13 AM, G?tz Waschk wrote: > > On Tue, May 31, 2011 at 10:56 PM, Joe Landman > > <landman at scalableinformatics.com > <mailto:landman at scalableinformatics.com>> wrote: > >> Are there any gotchas? Or is it worth staying with the older > Centos > >> 5.4/5.5 based kernels from the download site? > > Hi Joseph, > > > > are you talking about the client or the server? The client works > fine > > with the 2.6.18-238.9.1.el5 kernel, on Scientific Linux 5, that is. > > Server side. I finished the build, and put the results here (if > this is > useful for anyone else) > http://download.scalableinformatics.com/lustre/1.8git_build/ > > Thanks to all for the pointer to the documents. > > > > -- > Joseph Landman, Ph.D > Founder and CEO > Scalable Informatics, Inc. > email: landman at scalableinformatics.com > <mailto:landman at scalableinformatics.com> > web : http://scalableinformatics.com > http://scalableinformatics.com/sicluster > phone: +1 734 786 8423 x121 > fax : +1 866 888 3112 > cell : +1 734 612 4615 > _______________________________________________ > Lustre-discuss mailing list > Lustre-discuss at lists.lustre.org > <mailto:Lustre-discuss at lists.lustre.org> > http://lists.lustre.org/mailman/listinfo/lustre-discuss > > > > > -- > cliffw > Support Guy > WhamCloud, Inc. > www.whamcloud.com <http://www.whamcloud.com> > >
Chris Any patches have to pass some automated regression test before they can land to our git repo but you are correct that we would usually recommend waiting for fuller testing before using in production. Such testing is in progress. Peter Whamcloud On 11-06-01 8:33 PM, Christopher Walker wrote:> Hi, > > What testing have these builds gone through? I was thinking about using > one of these to get around LU-274, but I was under the impression that > these weren''t as thoroughly tested as the proper releases are. > > This build system is fantastic, BTW. > > Thanks, > Chris > > On 6/1/11 4:53 PM, Cliff White wrote: >> Actually, we have 2.6.18-238 in testing for Lustre 1.8.6 release, >> builds fine, >> you can get RPMS/SRPMS >> here: http://newbuild.whamcloud.com/job/lustre-b1_8/lastSuccessfulBuild/ >> including the server kernels. >> >> or source from our git repo >> cliffw >> >> >> >> On Wed, Jun 1, 2011 at 1:16 AM, Joe Landman >> <landman at scalableinformatics.com >> <mailto:landman at scalableinformatics.com>> wrote: >> >> On 06/01/2011 04:13 AM, G?tz Waschk wrote: >> > On Tue, May 31, 2011 at 10:56 PM, Joe Landman >> > <landman at scalableinformatics.com >> <mailto:landman at scalableinformatics.com>> wrote: >> >> Are there any gotchas? Or is it worth staying with the older >> Centos >> >> 5.4/5.5 based kernels from the download site? >> > Hi Joseph, >> > >> > are you talking about the client or the server? The client works >> fine >> > with the 2.6.18-238.9.1.el5 kernel, on Scientific Linux 5, that is. >> >> Server side. I finished the build, and put the results here (if >> this is >> useful for anyone else) >> http://download.scalableinformatics.com/lustre/1.8git_build/ >> >> Thanks to all for the pointer to the documents. >> >> >> >> -- >> Joseph Landman, Ph.D >> Founder and CEO >> Scalable Informatics, Inc. >> email: landman at scalableinformatics.com >> <mailto:landman at scalableinformatics.com> >> web : http://scalableinformatics.com >> http://scalableinformatics.com/sicluster >> phone: +1 734 786 8423 x121 >> fax : +1 866 888 3112 >> cell : +1 734 612 4615 >> _______________________________________________ >> Lustre-discuss mailing list >> Lustre-discuss at lists.lustre.org >> <mailto:Lustre-discuss at lists.lustre.org> >> http://lists.lustre.org/mailman/listinfo/lustre-discuss >> >> >> >> >> -- >> cliffw >> Support Guy >> WhamCloud, Inc. >> www.whamcloud.com<http://www.whamcloud.com> >> >> > _______________________________________________ > Lustre-discuss mailing list > Lustre-discuss at lists.lustre.org > http://lists.lustre.org/mailman/listinfo/lustre-discuss >-- Peter Jones Whamcloud, Inc. www.whamcloud.com
Peter Kjellström
2011-Jun-07 09:24 UTC
[Lustre-discuss] Has anyone built 1.8.5 on Centos 5.6?
On Thursday, June 02, 2011 05:33:40 AM Christopher Walker wrote:> Hi, > > What testing have these builds gone through? I was thinking about using > one of these to get around LU-274, but I was under the impression that > these weren''t as thoroughly tested as the proper releases are.We decided to get around LU-274 by rebuilding 1.8.5(final) with only the LU-274 patch and are now running this in production. If you''re interested in detailed instructions or packages ping me off-list. /Peter> This build system is fantastic, BTW. > > Thanks, > Chris-------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 198 bytes Desc: This is a digitally signed message part. Url : http://lists.lustre.org/pipermail/lustre-discuss/attachments/20110607/b4727f13/attachment.bin
Michael Di Domenico
2011-Jun-13 20:07 UTC
[Lustre-discuss] Has anyone built 1.8.5 on Centos 5.6?
Joe, I''m trying to compile 1.8.5 i686/x86_64 on RHEL5.6 with 2.6.8-238 kernel. Did you happen to hit this error with your compile? If so how did you fix it? Has anyone else seen this? CC [M] fs/jbd2/journal.o fs/jbd2/journal.c:94: error: redefinition of ?__kcrctab_jbd2_log_start_commit? fs/jbd2/journal.c:80: error: previous definition of ?__kcrctab_jbd2_log_start_commit? was here fs/jbd2/journal.c:94: error: redefinition of ?__kstrtab_jbd2_log_start_commit? fs/jbd2/journal.c:80: error: previous definition of ?__kstrtab_jbd2_log_start_commit? was here fs/jbd2/journal.c:94: error: redefinition of ?__ksymtab_jbd2_log_start_commit? fs/jbd2/journal.c:80: error: previous definition of ?__ksymtab_jbd2_log_start_commit? was here make[3]: *** [fs/jbd2/journal.o] Error 1 make[2]: *** [fs/jbd2] Error 2 make[1]: *** [fs] Error 2 make: *** [modules] Error 2 On Wed, Jun 1, 2011 at 4:16 AM, Joe Landman <landman at scalableinformatics.com> wrote:> On 06/01/2011 04:13 AM, G?tz Waschk wrote: >> On Tue, May 31, 2011 at 10:56 PM, Joe Landman >> <landman at scalableinformatics.com> ?wrote: >>> Are there any gotchas? ?Or is it worth staying with the older Centos >>> 5.4/5.5 based kernels from the download site? >> Hi Joseph, >> >> are you talking about the client or the server? The client works fine >> with the 2.6.18-238.9.1.el5 kernel, on Scientific Linux 5, that is. > > Server side. ?I finished the build, and put the results here (if this is > useful for anyone else) > http://download.scalableinformatics.com/lustre/1.8git_build/ > > Thanks to all for the pointer to the documents. > > > > -- > Joseph Landman, Ph.D > Founder and CEO > Scalable Informatics, Inc. > email: landman at scalableinformatics.com > web ?: http://scalableinformatics.com > ? ? ? ?http://scalableinformatics.com/sicluster > phone: +1 734 786 8423 x121 > fax ?: +1 866 888 3112 > cell : +1 734 612 4615 > _______________________________________________ > Lustre-discuss mailing list > Lustre-discuss at lists.lustre.org > http://lists.lustre.org/mailman/listinfo/lustre-discuss >
On 06/13/2011 04:07 PM, Michael Di Domenico wrote:> Joe, > > I''m trying to compile 1.8.5 i686/x86_64 on RHEL5.6 with 2.6.8-238 > kernel. Did you happen to hit this error with your compile? If so > how did you fix it? Has anyone else seen this? > > CC [M] fs/jbd2/journal.o > fs/jbd2/journal.c:94: error: redefinition of ?__kcrctab_jbd2_log_start_commit? > fs/jbd2/journal.c:80: error: previous definition of > ?__kcrctab_jbd2_log_start_commit? was here > fs/jbd2/journal.c:94: error: redefinition of ?__kstrtab_jbd2_log_start_commit? > fs/jbd2/journal.c:80: error: previous definition of > ?__kstrtab_jbd2_log_start_commit? was here > fs/jbd2/journal.c:94: error: redefinition of ?__ksymtab_jbd2_log_start_commit? > fs/jbd2/journal.c:80: error: previous definition of > ?__ksymtab_jbd2_log_start_commit? was here > make[3]: *** [fs/jbd2/journal.o] Error 1 > make[2]: *** [fs/jbd2] Error 2 > make[1]: *** [fs] Error 2 > make: *** [modules] Error 2 >Hi Michael: I had tried 1.8.5 against the newer kernels and ran into problems. So I pursued using the updated bits. For our successful build, I used the updated Centos 5.6 kernel, and the git repository. You can pull our build from here: http://download.scalableinformatics.com/lustre/1.8git_build/ if you wish. Customers are using it, and so far, its looking pretty good. Regards, Joe -- Joseph Landman, Ph.D Founder and CEO Scalable Informatics Inc. email: landman at scalableinformatics.com web : http://scalableinformatics.com http://scalableinformatics.com/sicluster phone: +1 734 786 8423 x121 fax : +1 866 888 3112 cell : +1 734 612 4615
Hi Michael, We are one of the customers using it, and so far (about 2 weeks) it''s been stable on a ~8700 core cluster. fragmentation statistics as reported by brw_stats look much better than 1.8.2 as an added bonus. Mark On 06/13/2011 03:11 PM, Joe Landman wrote:> On 06/13/2011 04:07 PM, Michael Di Domenico wrote: >> Joe, >> >> I''m trying to compile 1.8.5 i686/x86_64 on RHEL5.6 with 2.6.8-238 >> kernel. Did you happen to hit this error with your compile? If so >> how did you fix it? Has anyone else seen this? >> >> CC [M] fs/jbd2/journal.o >> fs/jbd2/journal.c:94: error: redefinition of ?__kcrctab_jbd2_log_start_commit? >> fs/jbd2/journal.c:80: error: previous definition of >> ?__kcrctab_jbd2_log_start_commit? was here >> fs/jbd2/journal.c:94: error: redefinition of ?__kstrtab_jbd2_log_start_commit? >> fs/jbd2/journal.c:80: error: previous definition of >> ?__kstrtab_jbd2_log_start_commit? was here >> fs/jbd2/journal.c:94: error: redefinition of ?__ksymtab_jbd2_log_start_commit? >> fs/jbd2/journal.c:80: error: previous definition of >> ?__ksymtab_jbd2_log_start_commit? was here >> make[3]: *** [fs/jbd2/journal.o] Error 1 >> make[2]: *** [fs/jbd2] Error 2 >> make[1]: *** [fs] Error 2 >> make: *** [modules] Error 2 >> > > Hi Michael: > > I had tried 1.8.5 against the newer kernels and ran into problems. > So I pursued using the updated bits. > > For our successful build, I used the updated Centos 5.6 kernel, and > the git repository. You can pull our build from here: > http://download.scalableinformatics.com/lustre/1.8git_build/ if you > wish. Customers are using it, and so far, its looking pretty good. > > Regards, > > Joe > >-- Mark Nelson, HPC Systems Administrator Minnesota Supercomputing Institute Phone: (612)626-4479 Email: mark at msi.umn.edu
Michael Di Domenico
2011-Jun-13 22:04 UTC
[Lustre-discuss] Has anyone built 1.8.5 on Centos 5.6?
Thanks. Looks like my previous error was just a duplicate export symbol which cleaned up the compile (thought the rpm didn''t build quite right, didnt get an initrd file). I''d like to use the stock lustre-1.8.5 source tree rather then git clone (appeases management better), but i did not get a chance to compile that before i left the office for the day, will try tomorrow. worst case I''ll fall back to the git clone, but it''s good to hear others have success. On Mon, Jun 13, 2011 at 5:30 PM, Mark Nelson <mark at msi.umn.edu> wrote:> Hi Michael, > > We are one of the customers using it, and so far (about 2 weeks) it''s > been stable on a ~8700 core cluster. ?fragmentation statistics as > reported by brw_stats look much better than 1.8.2 as an added bonus. > > Mark > > On 06/13/2011 03:11 PM, Joe Landman wrote: >> On 06/13/2011 04:07 PM, Michael Di Domenico wrote: >>> Joe, >>> >>> I''m trying to compile 1.8.5 i686/x86_64 on RHEL5.6 with 2.6.8-238 >>> kernel. ?Did you happen to hit this error with your compile? ?If so >>> how did you fix it? ?Has anyone else seen this? >>> >>> ? ? CC [M] ?fs/jbd2/journal.o >>> fs/jbd2/journal.c:94: error: redefinition of ?__kcrctab_jbd2_log_start_commit? >>> fs/jbd2/journal.c:80: error: previous definition of >>> ?__kcrctab_jbd2_log_start_commit? was here >>> fs/jbd2/journal.c:94: error: redefinition of ?__kstrtab_jbd2_log_start_commit? >>> fs/jbd2/journal.c:80: error: previous definition of >>> ?__kstrtab_jbd2_log_start_commit? was here >>> fs/jbd2/journal.c:94: error: redefinition of ?__ksymtab_jbd2_log_start_commit? >>> fs/jbd2/journal.c:80: error: previous definition of >>> ?__ksymtab_jbd2_log_start_commit? was here >>> make[3]: *** [fs/jbd2/journal.o] Error 1 >>> make[2]: *** [fs/jbd2] Error 2 >>> make[1]: *** [fs] Error 2 >>> make: *** [modules] Error 2 >>> >> >> Hi Michael: >> >> ? ? I had tried 1.8.5 against the newer kernels and ran into problems. >> So I pursued using the updated bits. >> >> ? ? For our successful build, I used the updated Centos 5.6 kernel, and >> the git repository. ?You can pull our build from here: >> http://download.scalableinformatics.com/lustre/1.8git_build/ if you >> wish. ?Customers are using it, and so far, its looking pretty good. >> >> ? ? Regards, >> >> Joe >> >> > > > -- > Mark Nelson, HPC Systems Administrator > Minnesota Supercomputing Institute > Phone: (612)626-4479 > Email: mark at msi.umn.edu > _______________________________________________ > Lustre-discuss mailing list > Lustre-discuss at lists.lustre.org > http://lists.lustre.org/mailman/listinfo/lustre-discuss >