Hello all, I have compiled lustre myself against a 2.6.12.6-xen kernel. The patch and compile of the kernel happened without any errors and the tools and modules compiles worked with no errors. However after running the llmount.sh or running the basic example in the Howto I keep getting the following errors. Mar 5 05:00:49 xen1 kernel: LustreError: 27144:0:(lvfs.h:130:ll_lookup_one_len()) bad inode returned 25002/3133433428 Mar 5 05:00:49 xen1 kernel: LustreError: 27144:0:(mds_fs.c:466:mds_fs_setup()) cannot create LOGS directory: rc = -2 Mar 5 05:00:49 xen1 kernel: LustreError: 27144:0:(handler.c:1834:mds_setup()) mds1: MDS filesystem method init failed: rc = -2 Mar 5 05:00:49 xen1 kernel: LustreError: 27146:0:(obd_config.c:323:class_cleanup()) Device 3 not setup These errors happen both using loopback devices and physical devices. Any help would be greatly appreciated. Jacob -------------- next part -------------- An HTML attachment was scrubbed... URL: http://mail.clusterfs.com/pipermail/lustre-discuss/attachments/20060306/be645b41/attachment.html
Thank you for the response. What filesystem should it be? Does lconf --reformat not add the files system? Is there a command I should run to do that? Is the cause of this likely a bad compile, a bad device or me just being dumb :) Jacob On 3/6/06, Andreas Dilger <adilger@clusterfs.com> wrote:> > On Mar 06, 2006 09:24 -0700, Jacob Boswell wrote: > > Hello all, I have compiled lustre myself against a 2.6.12.6-xen kernel. > The > > patch and compile of the kernel happened without any errors and the > tools > > and modules compiles worked with no errors. However after running the > > llmount.sh or running the basic example in the Howto I keep getting the > > following errors. > > > > Mar 5 05:00:49 xen1 kernel: LustreError: > > 27144:0:(lvfs.h:130:ll_lookup_one_len()) > > bad inode returned 25002/3133433428 > > Mar 5 05:00:49 xen1 kernel: LustreError: > > 27144:0:(mds_fs.c:466:mds_fs_setup()) cannot create LOGS directory: rc > -2 > > Mar 5 05:00:49 xen1 kernel: LustreError: 27144:0:(handler.c > :1834:mds_setup()) > > mds1: MDS filesystem method init failed: rc = -2 > > Mar 5 05:00:49 xen1 kernel: LustreError: > > 27146:0:(obd_config.c:323:class_cleanup()) Device 3 not setup > > > > These errors happen both using loopback devices and physical devices. > > This indicates the MDS backing filesystem is broken somehow (e.g. inode > table not being written to disk?). > > Cheers, Andreas > -- > Andreas Dilger > Principal Software Engineer > Cluster File Systems, Inc. > >-------------- next part -------------- An HTML attachment was scrubbed... URL: http://mail.clusterfs.com/pipermail/lustre-discuss/attachments/20060307/867c410c/attachment.html
Thank you for the response. What filesystem should it be? Does lconf --reformat not add the files system? Is there a command I should run to do that? Is the cause of this likely a bad compile, a bad device or me just being dumb :) Jacob On 3/6/06, Andreas Dilger <adilger@clusterfs.com> wrote:> > On Mar 06, 2006 09:24 -0700, Jacob Boswell wrote: > > Hello all, I have compiled lustre myself against a 2.6.12.6-xen kernel. > The > > patch and compile of the kernel happened without any errors and the > tools > > and modules compiles worked with no errors. However after running the > > llmount.sh or running the basic example in the Howto I keep getting the > > following errors. > > > > Mar 5 05:00:49 xen1 kernel: LustreError: > > 27144:0:(lvfs.h:130:ll_lookup_one_len()) > > bad inode returned 25002/3133433428 > > Mar 5 05:00:49 xen1 kernel: LustreError: > > 27144:0:(mds_fs.c:466:mds_fs_setup()) cannot create LOGS directory: rc > -2 > > Mar 5 05:00:49 xen1 kernel: LustreError: 27144:0:(handler.c > :1834:mds_setup()) > > mds1: MDS filesystem method init failed: rc = -2 > > Mar 5 05:00:49 xen1 kernel: LustreError: > > 27146:0:(obd_config.c:323:class_cleanup()) Device 3 not setup > > > > These errors happen both using loopback devices and physical devices. > > This indicates the MDS backing filesystem is broken somehow (e.g. inode > table not being written to disk?). > > Cheers, Andreas > -- > Andreas Dilger > Principal Software Engineer > Cluster File Systems, Inc. > >-------------- next part -------------- An HTML attachment was scrubbed... URL: http://mail.clusterfs.com/pipermail/lustre-discuss/attachments/20060307/2707e438/attachment.html
Hello all, I have compiled lustre myself against a 2.6.12.6-xen kernel. The patch and compile of the kernel happened without any errors and the tools and modules compiles worked with no errors. However after running the llmount.sh or running the basic example in the Howto I keep getting the following errors. Mar 5 05:00:49 xen1 kernel: LustreError: 27144:0:(lvfs.h:130:ll_lookup_one_len()) bad inode returned 25002/3133433428 Mar 5 05:00:49 xen1 kernel: LustreError: 27144:0:(mds_fs.c:466:mds_fs_setup()) cannot create LOGS directory: rc = -2 Mar 5 05:00:49 xen1 kernel: LustreError: 27144:0:(handler.c:1834:mds_setup()) mds1: MDS filesystem method init failed: rc = -2 Mar 5 05:00:49 xen1 kernel: LustreError: 27146:0:(obd_config.c:323:class_cleanup()) Device 3 not setup These errors happen both using loopback devices and physical devices. Any help would be greatly appreciated. Jacob -------------- next part -------------- An HTML attachment was scrubbed... URL: http://mail.clusterfs.com/pipermail/lustre-discuss/attachments/20060306/fa27739d/attachment.html
On Mar 06, 2006 09:24 -0700, Jacob Boswell wrote:> Hello all, I have compiled lustre myself against a 2.6.12.6-xen kernel. The > patch and compile of the kernel happened without any errors and the tools > and modules compiles worked with no errors. However after running the > llmount.sh or running the basic example in the Howto I keep getting the > following errors. > > Mar 5 05:00:49 xen1 kernel: LustreError: > 27144:0:(lvfs.h:130:ll_lookup_one_len()) > bad inode returned 25002/3133433428 > Mar 5 05:00:49 xen1 kernel: LustreError: > 27144:0:(mds_fs.c:466:mds_fs_setup()) cannot create LOGS directory: rc = -2 > Mar 5 05:00:49 xen1 kernel: LustreError: 27144:0:(handler.c:1834:mds_setup()) > mds1: MDS filesystem method init failed: rc = -2 > Mar 5 05:00:49 xen1 kernel: LustreError: > 27146:0:(obd_config.c:323:class_cleanup()) Device 3 not setup > > These errors happen both using loopback devices and physical devices.This indicates the MDS backing filesystem is broken somehow (e.g. inode table not being written to disk?). Cheers, Andreas -- Andreas Dilger Principal Software Engineer Cluster File Systems, Inc.
Jacob Boswell wrote:> Thank you for the response. > > What filesystem should it be? Does lconf --reformat not add the files > system? Is there a command I should run to do that? Is the cause of this > likely a bad compile, a bad device or me just being dumb :)lconf --reformat will format the filesystem, if everything else is specified properly. Basically, you specify the MDS device on the ''--add mds'' line in your script, with the --dev option. So, whatever you have specified there needs to be happy and functional. If you are using a loopback device, you also should specify --size Hope this helps cliffw> > Jacob > > On 3/6/06, Andreas Dilger <adilger@clusterfs.com> wrote: > >>On Mar 06, 2006 09:24 -0700, Jacob Boswell wrote: >> >>>Hello all, I have compiled lustre myself against a 2.6.12.6-xen kernel. >> >>The >> >>>patch and compile of the kernel happened without any errors and the >> >>tools >> >>>and modules compiles worked with no errors. However after running the >>>llmount.sh or running the basic example in the Howto I keep getting the >>>following errors. >>> >>>Mar 5 05:00:49 xen1 kernel: LustreError: >>>27144:0:(lvfs.h:130:ll_lookup_one_len()) >>>bad inode returned 25002/3133433428 >>>Mar 5 05:00:49 xen1 kernel: LustreError: >>>27144:0:(mds_fs.c:466:mds_fs_setup()) cannot create LOGS directory: rc >> >>-2 >> >>>Mar 5 05:00:49 xen1 kernel: LustreError: 27144:0:(handler.c >> >>:1834:mds_setup()) >> >>>mds1: MDS filesystem method init failed: rc = -2 >>>Mar 5 05:00:49 xen1 kernel: LustreError: >>>27146:0:(obd_config.c:323:class_cleanup()) Device 3 not setup >>> >>>These errors happen both using loopback devices and physical devices. >> >>This indicates the MDS backing filesystem is broken somehow (e.g. inode >>table not being written to disk?). >> >>Cheers, Andreas >>-- >>Andreas Dilger >>Principal Software Engineer >>Cluster File Systems, Inc. >> >> > > > > ------------------------------------------------------------------------ > > _______________________________________________ > Lustre-discuss mailing list > Lustre-discuss@clusterfs.com > https://mail.clusterfs.com/mailman/listinfo/lustre-discuss
Hi, Jacob, I had the same problem you reported here with lustre-1.4.6 patched for linux-2.6.15.4 . My guess is that there is a racing condition somewhere in the use of logs directory. I used a workaround to avoid this problem, shown with the following patch. Basically, it tried to avoid the LOGS directory, but used PENDING instead when it is needed. It may or may not help with your problem. But just to throw some thoughts here to get more opinions people who have experienced the same problem. Weikuan -------------- next part -------------- A non-text attachment was scrubbed... Name: mds_fs_setup.workaround Type: application/octet-stream Size: 2518 bytes Desc: not available Url : http://mail.clusterfs.com/pipermail/lustre-discuss/attachments/20060327/8d7dd357/mds_fs_setup.obj -------------- next part -------------- On Mar 6, 2006, at 11:24 AM, Jacob Boswell wrote:> Hello all, I have compiled lustre myself against a 2.6.12.6-xen > kernel. The patch and compile of the kernel happened without any > errors and the tools and modules compiles worked with no errors. > However after running the llmount.sh or running the basic example in > the Howto I keep getting the following errors. > > Mar? 5 05:00:49 xen1 kernel: LustreError: > 27144:0:(lvfs.h:130:ll_lookup_one_len()) bad inode returned > 25002/3133433428 > Mar? 5 05:00:49 xen1 kernel: LustreError: > 27144:0:(mds_fs.c:466:mds_fs_setup()) cannot create LOGS directory: rc > = -2 > Mar? 5 05:00:49 xen1 kernel: LustreError: > 27144:0:(handler.c:1834:mds_setup()) mds1: MDS filesystem method init > failed: rc = -2 > Mar? 5 05:00:49 xen1 kernel: LustreError: > 27146:0:(obd_config.c:323:class_cleanup()) Device 3 not setup > > These errors happen both using loopback devices and physical devices. > > Any help would be greatly appreciated. > > Jacob_______________________________________________ > Lustre-discuss mailing list > Lustre-discuss@clusterfs.com > https://mail.clusterfs.com/mailman/listinfo/lustre-discuss >-- Weikuan Yu, Computer Science, OSU http://www.cse.ohio-state.edu/~yuw