HI, I am using luster 1.8.5. Server s are up and mounted without any problem. But client failed to mount the luster file system. I also did not see luster in /proc/filesystems. Is there other rpm I needed to install on the client system? The below is log from the client system: [root@localhost client]# rpm -ivh lustre-client-modules-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5.i686.rpm Preparing... ########################################### [100%] 1:lustre-client-modules ########################################### [100%] Congratulations on finishing your Lustre installation! To register your copy of Lustre and find out more about Lustre Support, Service, and Training offerings please visit http://www.sun.com/software/products/lustre/lustre_reg.jsp [root@localhost client]# rpm -qa | grep lustrelustre-client-modules-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5 [root@localhost client]# rpm -ivh lustre-client-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5.i686.rpm Preparing... ########################################### [100%] 1:lustre-client ########################################### [100%] [root@localhost client]# mount -t lustre 10.193.35.54@tcp0:/lustrefs /lustrefs mount.lustre: mount 10.193.35.54@tcp0:/lustrefs at /lustrefs failed: No such device Are the lustre modules loaded? Check /etc/modprobe.conf and /proc/filesystems Note ''alias lustre llite'' should be removed from modprobe.conf [root@localhost client]# cat /etc/modprobe.conf alias eth0 e1000e alias eth1 e1000e alias scsi_hostadapter ahci options lnet networks=tcp [root@localhost client]# cat /proc/filesystems | grep -i lustre [root@localhost client]# rpm -qa | grep -i lustre lustre-client-modules-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5 lustre-client-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5 _______________________________________________ Lustre-discuss mailing list Lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org http://lists.lustre.org/mailman/listinfo/lustre-discuss
Do I need to upgrade e2fsprogs on the client system? -Weilin From: Weilin Chang Sent: Wednesday, October 16, 2013 3:45 PM To: lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org Cc: Weilin Chang Subject: lustre 1.8.5 client failed to mount lustre HI, I am using luster 1.8.5. Server s are up and mounted without any problem. But client failed to mount the luster file system. I also did not see luster in /proc/filesystems. Is there other rpm I needed to install on the client system? The below is log from the client system: [root@localhost client]# rpm -ivh lustre-client-modules-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5.i686.rpm Preparing... ########################################### [100%] 1:lustre-client-modules ########################################### [100%] Congratulations on finishing your Lustre installation! To register your copy of Lustre and find out more about Lustre Support, Service, and Training offerings please visit http://www.sun.com/software/products/lustre/lustre_reg.jsp [root@localhost client]# rpm -qa | grep lustrelustre-client-modules-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5 [root@localhost client]# rpm -ivh lustre-client-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5.i686.rpm Preparing... ########################################### [100%] 1:lustre-client ########################################### [100%] [root@localhost client]# mount -t lustre 10.193.35.54@tcp0:/lustrefs /lustrefs mount.lustre: mount 10.193.35.54@tcp0:/lustrefs at /lustrefs failed: No such device Are the lustre modules loaded? Check /etc/modprobe.conf and /proc/filesystems Note ''alias lustre llite'' should be removed from modprobe.conf [root@localhost client]# cat /etc/modprobe.conf alias eth0 e1000e alias eth1 e1000e alias scsi_hostadapter ahci options lnet networks=tcp [root@localhost client]# cat /proc/filesystems | grep -i lustre [root@localhost client]# rpm -qa | grep -i lustre lustre-client-modules-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5 lustre-client-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5 _______________________________________________ Lustre-discuss mailing list Lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org http://lists.lustre.org/mailman/listinfo/lustre-discuss
Chan Ching Yu Patrick
2013-Oct-17 02:48 UTC
Re: lustre 1.8.5 client failed to mount lustre
What''s the output?
lctl list_nids
On 10/17/2013 08:36 AM, Weilin Chang wrote:
Do I need to
upgrade e2fsprogs on the client system?
-Weilin
From:
Weilin Chang
Sent: Wednesday, October 16, 2013 3:45 PM
To: lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org
Cc: Weilin Chang
Subject: lustre 1.8.5 client failed to mount
lustre
HI,
I am using luster 1.8.5. Server s are up
and mounted without any problem. But client failed to mount
the luster file system. I also did not see luster in
/proc/filesystems. Is there other rpm I needed to install on
the client system?
The below is log from the client system:
[root@localhost client]# rpm -ivh
lustre-client-modules-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5.i686.rpm
Preparing...
########################################### [100%]
1:lustre-client-modules
########################################### [100%]
Congratulations on finishing your Lustre
installation! To register
your copy of Lustre and find out more about
Lustre Support, Service,
and Training offerings please visit
http://www.sun.com/software/products/lustre/lustre_reg.jsp
[root@localhost client]# rpm -qa | grep
lustrelustre-client-modules-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5
[root@localhost client]# rpm -ivh
lustre-client-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5.i686.rpm
Preparing...
########################################### [100%]
1:lustre-client
########################################### [100%]
[root@localhost client]# mount -t lustre
10.193.35.54@tcp0:/lustrefs /lustrefs
mount.lustre: mount
10.193.35.54@tcp0:/lustrefs at /lustrefs failed: No such
device
Are the lustre modules loaded?
Check /etc/modprobe.conf and
/proc/filesystems
Note ''alias lustre llite'' should be removed
from modprobe.conf
[root@localhost client]# cat
/etc/modprobe.conf
alias eth0 e1000e
alias eth1 e1000e
alias scsi_hostadapter ahci
options lnet networks=tcp
[root@localhost client]# cat
/proc/filesystems | grep -i lustre
[root@localhost client]# rpm -qa | grep -i
lustre
lustre-client-modules-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5
lustre-client-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5
_______________________________________________
Lustre-discuss mailing list
Lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org
http://lists.lustre.org/mailman/listinfo/lustre-discuss
--
Chan Ching Yu, Patrick
Senior System Engineer
Cluster Technology
Limited
Modernize Your Business with Advanced
Computing Technologies
Cloud
Computing | Cluster | Financial Engineering | Business
Intelligence
Email: cychan @clustertech.com
Direct Line: +852 2655 6113
Tel: +852 2655 6100
Fax: +852 2994 2101
Website: www.clustertech.com
Address: Units 211 - 213,
Lakeside 1, No. 8 Science Park West Avenue, Hong Kong Science
Park, N.T. Hong Kong
Hong Kong
Beijing Shanghai Guangzhou Shenzhen Wuhan
Sydney
**************************************************************************
The information contained in this e-mail and its attachments is
confidential and intended solely for the specified addressees.
If you have received this email in error, please do not read,
copy, distribute, disclose or use any information of this email
in any way and please immediately notify the sender and delete
this email. Thank you for your cooperation.
**************************************************************************
_______________________________________________
Lustre-discuss mailing list
Lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org
http://lists.lustre.org/mailman/listinfo/lustre-discuss
I got the following message for "lctl list_nids": Opening /dev/lnet failed: No such device Hint: the kerenel modules may not be loaded IOC_LIBCFS_GET_NI error 19: No such device It looks like the lunstre packet has been installed, but it does not hook with kernel correctly. Which part went wrong? -Weilin From: Chan Ching Yu Patrick [mailto:cychan-eQCasaxV0mrc+919tysfdA@public.gmane.org] Sent: Wednesday, October 16, 2013 7:49 PM To: Weilin Chang Cc: lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org Subject: Re: [Lustre-discuss] lustre 1.8.5 client failed to mount lustre What''s the output? lctl list_nids On 10/17/2013 08:36 AM, Weilin Chang wrote: Do I need to upgrade e2fsprogs on the client system? -Weilin From: Weilin Chang Sent: Wednesday, October 16, 2013 3:45 PM To: lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org<mailto:lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org> Cc: Weilin Chang Subject: lustre 1.8.5 client failed to mount lustre HI, I am using luster 1.8.5. Server s are up and mounted without any problem. But client failed to mount the luster file system. I also did not see luster in /proc/filesystems. Is there other rpm I needed to install on the client system? The below is log from the client system: [root@localhost client]# rpm -ivh lustre-client-modules-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5.i686.rpm Preparing... ########################################### [100%] 1:lustre-client-modules ########################################### [100%] Congratulations on finishing your Lustre installation! To register your copy of Lustre and find out more about Lustre Support, Service, and Training offerings please visit http://www.sun.com/software/products/lustre/lustre_reg.jsp [root@localhost client]# rpm -qa | grep lustrelustre-client-modules-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5 [root@localhost client]# rpm -ivh lustre-client-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5.i686.rpm Preparing... ########################################### [100%] 1:lustre-client ########################################### [100%] [root@localhost client]# mount -t lustre 10.193.35.54@tcp0:/lustrefs /lustrefs mount.lustre: mount 10.193.35.54@tcp0:/lustrefs at /lustrefs failed: No such device Are the lustre modules loaded? Check /etc/modprobe.conf and /proc/filesystems Note ''alias lustre llite'' should be removed from modprobe.conf [root@localhost client]# cat /etc/modprobe.conf alias eth0 e1000e alias eth1 e1000e alias scsi_hostadapter ahci options lnet networks=tcp [root@localhost client]# cat /proc/filesystems | grep -i lustre [root@localhost client]# rpm -qa | grep -i lustre lustre-client-modules-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5 lustre-client-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5 _______________________________________________ Lustre-discuss mailing list Lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org<mailto:Lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org> http://lists.lustre.org/mailman/listinfo/lustre-discuss -- Chan Ching Yu, Patrick Senior System Engineer Cluster Technology Limited Modernize Your Business with Advanced Computing Technologies Cloud Computing | Cluster | Financial Engineering | Business Intelligence Email: cychan @clustertech.com<mailto:cychan-eQCasaxV0mrc+919tysfdA@public.gmane.org> Direct Line: +852 2655 6113 Tel: +852 2655 6100 Fax: +852 2994 2101 Website: www.clustertech.com<http://www.clustertech.com> Address: Units 211 - 213, Lakeside 1, No. 8 Science Park West Avenue, Hong Kong Science Park, N.T. Hong Kong Hong Kong Beijing Shanghai Guangzhou Shenzhen Wuhan Sydney ************************************************************************** The information contained in this e-mail and its attachments is confidential and intended solely for the specified addressees. If you have received this email in error, please do not read, copy, distribute, disclose or use any information of this email in any way and please immediately notify the sender and delete this email. Thank you for your cooperation. ************************************************************************** _______________________________________________ Lustre-discuss mailing list Lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org http://lists.lustre.org/mailman/listinfo/lustre-discuss
Please check if your client''s kernel version matches the luster''s. What is the output of uname –a? Thanks -Minh From: Weilin Chang <Weilin.Chang-hv44wF8Li93QT0dZR+AlfA@public.gmane.org<mailto:Weilin.Chang-hv44wF8Li93QT0dZR+AlfA@public.gmane.org>> Date: Thursday, October 17, 2013 10:25 AM To: Chan Ching Yu Patrick <cychan-eQCasaxV0mrc+919tysfdA@public.gmane.org<mailto:cychan@clustertech.com>> Cc: Weilin Chang <Weilin.Chang-hv44wF8Li93QT0dZR+AlfA@public.gmane.org<mailto:Weilin.Chang-hv44wF8Li93QT0dZR+AlfA@public.gmane.org>>, "lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org<mailto:lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org>" <lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org<mailto:lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org>> Subject: Re: [Lustre-discuss] lustre 1.8.5 client failed to mount lustre I got the following message for “lctl list_nids”: Opening /dev/lnet failed: No such device Hint: the kerenel modules may not be loaded IOC_LIBCFS_GET_NI error 19: No such device It looks like the lunstre packet has been installed, but it does not hook with kernel correctly. Which part went wrong? -Weilin From: Chan Ching Yu Patrick [mailto:cychan-eQCasaxV0mrc+919tysfdA@public.gmane.org] Sent: Wednesday, October 16, 2013 7:49 PM To: Weilin Chang Cc: lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org<mailto:lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org> Subject: Re: [Lustre-discuss] lustre 1.8.5 client failed to mount lustre What''s the output? lctl list_nids On 10/17/2013 08:36 AM, Weilin Chang wrote: Do I need to upgrade e2fsprogs on the client system? -Weilin From: Weilin Chang Sent: Wednesday, October 16, 2013 3:45 PM To: lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org<mailto:lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org> Cc: Weilin Chang Subject: lustre 1.8.5 client failed to mount lustre HI, I am using luster 1.8.5. Server s are up and mounted without any problem. But client failed to mount the luster file system. I also did not see luster in /proc/filesystems. Is there other rpm I needed to install on the client system? The below is log from the client system: [root@localhost client]# rpm -ivh lustre-client-modules-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5.i686.rpm Preparing... ########################################### [100%] 1:lustre-client-modules ########################################### [100%] Congratulations on finishing your Lustre installation! To register your copy of Lustre and find out more about Lustre Support, Service, and Training offerings please visit http://www.sun.com/software/products/lustre/lustre_reg.jsp [root@localhost client]# rpm -qa | grep lustrelustre-client-modules-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5 [root@localhost client]# rpm -ivh lustre-client-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5.i686.rpm Preparing... ########################################### [100%] 1:lustre-client ########################################### [100%] [root@localhost client]# mount -t lustre 10.193.35.54@tcp0:/lustrefs /lustrefs mount.lustre: mount 10.193.35.54@tcp0:/lustrefs at /lustrefs failed: No such device Are the lustre modules loaded? Check /etc/modprobe.conf and /proc/filesystems Note ''alias lustre llite'' should be removed from modprobe.conf [root@localhost client]# cat /etc/modprobe.conf alias eth0 e1000e alias eth1 e1000e alias scsi_hostadapter ahci options lnet networks=tcp [root@localhost client]# cat /proc/filesystems | grep -i lustre [root@localhost client]# rpm -qa | grep -i lustre lustre-client-modules-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5 lustre-client-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5 _______________________________________________ Lustre-discuss mailing list Lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org<mailto:Lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org> http://lists.lustre.org/mailman/listinfo/lustre-discuss -- Chan Ching Yu, Patrick Senior System Engineer Cluster Technology Limited Modernize Your Business with Advanced Computing Technologies Cloud Computing | Cluster | Financial Engineering | Business Intelligence Email:cychan @clustertech.com<mailto:cychan-eQCasaxV0mrc+919tysfdA@public.gmane.org> Direct Line: +852 2655 6113 Tel: +852 2655 6100 Fax: +852 2994 2101 Website:www.clustertech.com<http://www.clustertech.com> Address: Units 211 - 213, Lakeside 1, No. 8 Science Park West Avenue, Hong Kong Science Park, N.T. Hong Kong Hong Kong Beijing Shanghai Guangzhou Shenzhen Wuhan Sydney ************************************************************************** The information contained in this e-mail and its attachments is confidential and intended solely for the specified addressees. If you have received this email in error, please do not read, copy, distribute, disclose or use any information of this email in any way and please immediately notify the sender and delete this email. Thank you for your cooperation. **************************************************************************
From: Weilin Chang <Weilin.Chang-hv44wF8Li93QT0dZR+AlfA@public.gmane.org<mailto:Weilin.Chang-hv44wF8Li93QT0dZR+AlfA@public.gmane.org>> Date: Thursday, October 17, 2013 10:25 AM To: Chan Ching Yu Patrick <cychan-eQCasaxV0mrc+919tysfdA@public.gmane.org<mailto:cychan@clustertech.com>> Cc: Weilin Chang <Weilin.Chang-hv44wF8Li93QT0dZR+AlfA@public.gmane.org<mailto:Weilin.Chang-hv44wF8Li93QT0dZR+AlfA@public.gmane.org>>, "lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org<mailto:lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org>" <lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org<mailto:lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org>> Subject: Re: [Lustre-discuss] lustre 1.8.5 client failed to mount lustre I got the following message for “lctl list_nids”: Opening /dev/lnet failed: No such device Hint: the kerenel modules may not be loaded IOC_LIBCFS_GET_NI error 19: No such device It looks like the lunstre packet has been installed, but it does not hook with kernel correctly. Which part went wrong? -Weilin You might try ''lustre_rmmod'' following by ''modprobe –v lustre'' - usually you will have useful error messages. The ''networks'' option In /etc/modprobe.conf Is unnecessary – lnet will default to TCP. I would delete that line, as the syntax does not look correct. Cliffw From: Chan Ching Yu Patrick [mailto:cychan-eQCasaxV0mrc+919tysfdA@public.gmane.org] Sent: Wednesday, October 16, 2013 7:49 PM To: Weilin Chang Cc: lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org<mailto:lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org> Subject: Re: [Lustre-discuss] lustre 1.8.5 client failed to mount lustre What''s the output? lctl list_nids On 10/17/2013 08:36 AM, Weilin Chang wrote: Do I need to upgrade e2fsprogs on the client system? -Weilin From: Weilin Chang Sent: Wednesday, October 16, 2013 3:45 PM To: lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org<mailto:lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org> Cc: Weilin Chang Subject: lustre 1.8.5 client failed to mount lustre HI, I am using luster 1.8.5. Server s are up and mounted without any problem. But client failed to mount the luster file system. I also did not see luster in /proc/filesystems. Is there other rpm I needed to install on the client system? The below is log from the client system: [root@localhost client]# rpm -ivh lustre-client-modules-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5.i686.rpm Preparing... ########################################### [100%] 1:lustre-client-modules ########################################### [100%] Congratulations on finishing your Lustre installation! To register your copy of Lustre and find out more about Lustre Support, Service, and Training offerings please visit http://www.sun.com/software/products/lustre/lustre_reg.jsp [root@localhost client]# rpm -qa | grep lustrelustre-client-modules-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5 [root@localhost client]# rpm -ivh lustre-client-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5.i686.rpm Preparing... ########################################### [100%] 1:lustre-client ########################################### [100%] [root@localhost client]# mount -t lustre 10.193.35.54@tcp0:/lustrefs /lustrefs mount.lustre: mount 10.193.35.54@tcp0:/lustrefs at /lustrefs failed: No such device Are the lustre modules loaded? Check /etc/modprobe.conf and /proc/filesystems Note ''alias lustre llite'' should be removed from modprobe.conf [root@localhost client]# cat /etc/modprobe.conf alias eth0 e1000e alias eth1 e1000e alias scsi_hostadapter ahci options lnet networks=tcp [root@localhost client]# cat /proc/filesystems | grep -i lustre [root@localhost client]# rpm -qa | grep -i lustre lustre-client-modules-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5 lustre-client-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5 _______________________________________________ Lustre-discuss mailing list Lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org<mailto:Lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org> http://lists.lustre.org/mailman/listinfo/lustre-discuss -- Chan Ching Yu, Patrick Senior System Engineer Cluster Technology Limited Modernize Your Business with Advanced Computing Technologies Cloud Computing | Cluster | Financial Engineering | Business Intelligence Email:cychan @clustertech.com<mailto:cychan-eQCasaxV0mrc+919tysfdA@public.gmane.org> Direct Line: +852 2655 6113 Tel: +852 2655 6100 Fax: +852 2994 2101 Website:www.clustertech.com<http://www.clustertech.com> Address: Units 211 - 213, Lakeside 1, No. 8 Science Park West Avenue, Hong Kong Science Park, N.T. Hong Kong Hong Kong Beijing Shanghai Guangzhou Shenzhen Wuhan Sydney ************************************************************************** The information contained in this e-mail and its attachments is confidential and intended solely for the specified addressees. If you have received this email in error, please do not read, copy, distribute, disclose or use any information of this email in any way and please immediately notify the sender and delete this email. Thank you for your cooperation. **************************************************************************
[root@localhost client]# uname -a Linux localhost.localdomain 2.6.18-194.el5PAE #1 SMP Fri Apr 2 15:37:44 EDT 2010 i686 i686 i386 GNU/Linux Is this version OK for luster 1.8.5? -Weilin -----Original Message----- From: Diep, Minh [mailto:minh.diep-ral2JQCrhuEAvxtiuMwx3w@public.gmane.org] Sent: Thursday, October 17, 2013 10:59 AM To: Weilin Chang; Chan Ching Yu Patrick Cc: lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org Subject: Re: [Lustre-discuss] lustre 1.8.5 client failed to mount lustre Please check if your client''s kernel version matches the luster''s. What is the output of uname -a? Thanks -Minh From: Weilin Chang <Weilin.Chang-hv44wF8Li93QT0dZR+AlfA@public.gmane.org<mailto:Weilin.Chang-hv44wF8Li93QT0dZR+AlfA@public.gmane.org>> Date: Thursday, October 17, 2013 10:25 AM To: Chan Ching Yu Patrick <cychan-eQCasaxV0mrc+919tysfdA@public.gmane.org<mailto:cychan-eQCasaxV0mrc+919tysfdA@public.gmane.org>> Cc: Weilin Chang <Weilin.Chang-hv44wF8Li93QT0dZR+AlfA@public.gmane.org<mailto:Weilin.Chang-hv44wF8Li93QT0dZR+AlfA@public.gmane.org>>, "lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org<mailto:lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org>" <lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org<mailto:lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org>> Subject: Re: [Lustre-discuss] lustre 1.8.5 client failed to mount lustre I got the following message for "lctl list_nids": Opening /dev/lnet failed: No such device Hint: the kerenel modules may not be loaded IOC_LIBCFS_GET_NI error 19: No such device It looks like the lunstre packet has been installed, but it does not hook with kernel correctly. Which part went wrong? -Weilin From: Chan Ching Yu Patrick [mailto:cychan-eQCasaxV0mrc+919tysfdA@public.gmane.org] Sent: Wednesday, October 16, 2013 7:49 PM To: Weilin Chang Cc: lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org<mailto:lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org> Subject: Re: [Lustre-discuss] lustre 1.8.5 client failed to mount lustre What''s the output? lctl list_nids On 10/17/2013 08:36 AM, Weilin Chang wrote: Do I need to upgrade e2fsprogs on the client system? -Weilin From: Weilin Chang Sent: Wednesday, October 16, 2013 3:45 PM To: lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org<mailto:lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org> Cc: Weilin Chang Subject: lustre 1.8.5 client failed to mount lustre HI, I am using luster 1.8.5. Server s are up and mounted without any problem. But client failed to mount the luster file system. I also did not see luster in /proc/filesystems. Is there other rpm I needed to install on the client system? The below is log from the client system: [root@localhost client]# rpm -ivh lustre-client-modules-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5.i686.rpm Preparing... ########################################### [100%] 1:lustre-client-modules ########################################### [100%] Congratulations on finishing your Lustre installation! To register your copy of Lustre and find out more about Lustre Support, Service, and Training offerings please visit http://www.sun.com/software/products/lustre/lustre_reg.jsp [root@localhost client]# rpm -qa | grep lustrelustre-client-modules-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5 [root@localhost client]# rpm -ivh lustre-client-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5.i686.rpm Preparing... ########################################### [100%] 1:lustre-client ########################################### [100%] [root@localhost client]# mount -t lustre 10.193.35.54@tcp0:/lustrefs /lustrefs mount.lustre: mount 10.193.35.54@tcp0:/lustrefs at /lustrefs failed: No such device Are the lustre modules loaded? Check /etc/modprobe.conf and /proc/filesystems Note ''alias lustre llite'' should be removed from modprobe.conf [root@localhost client]# cat /etc/modprobe.conf alias eth0 e1000e alias eth1 e1000e alias scsi_hostadapter ahci options lnet networks=tcp [root@localhost client]# cat /proc/filesystems | grep -i lustre [root@localhost client]# rpm -qa | grep -i lustre lustre-client-modules-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5 lustre-client-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5 _______________________________________________ Lustre-discuss mailing list Lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org<mailto:Lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org> http://lists.lustre.org/mailman/listinfo/lustre-discuss -- Chan Ching Yu, Patrick Senior System Engineer Cluster Technology Limited Modernize Your Business with Advanced Computing Technologies Cloud Computing | Cluster | Financial Engineering | Business Intelligence Email:cychan @clustertech.com<mailto:cychan-eQCasaxV0mrc+919tysfdA@public.gmane.org> Direct Line: +852 2655 6113 Tel: +852 2655 6100 Fax: +852 2994 2101 Website:www.clustertech.com<http://www.clustertech.com> Address: Units 211 - 213, Lakeside 1, No. 8 Science Park West Avenue, Hong Kong Science Park, N.T. Hong Kong Hong Kong Beijing Shanghai Guangzhou Shenzhen Wuhan Sydney ************************************************************************** The information contained in this e-mail and its attachments is confidential and intended solely for the specified addressees. If you have received this email in error, please do not read, copy, distribute, disclose or use any information of this email in any way and please immediately notify the sender and delete this email. Thank you for your cooperation. **************************************************************************
On 2013/10/16 4:45 PM, "Weilin Chang" <Weilin.Chang-hv44wF8Li93QT0dZR+AlfA@public.gmane.org> wrote:>HI, > >I am using luster 1.8.5. Server s are up and mounted without any problem. >But client failed to mount the luster file system. I also did not see >luster in /proc/filesystems. Is there other rpm I needed to install on >the client system?The most important question is why are you starting with this very old 1.8.5 release from 3 years ago instead of a newer release like 2.1.6 or 2.4.1? You will definitely find better support for newer kernels with newer releases, as well as a better chance that someone will be able to fix your problem. My first guess is that your client network is not configured correctly, since it has a hostname of "localhost". Second guess is that the Lustre modules are not properly matched with your kernel and they are not loading at all. Cheers, Andreas> >The below is log from the client system: > >[root@localhost client]# rpm -ivh >lustre-client-modules-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5.i686.rpm >Preparing... ########################################### >[100%] > 1:lustre-client-modules ########################################### >[100%] >Congratulations on finishing your Lustre installation! To register >your copy of Lustre and find out more about Lustre Support, Service, >and Training offerings please visit > >http://www.sun.com/software/products/lustre/lustre_reg.jsp >[root@localhost client]# rpm -qa | grep >lustrelustre-client-modules-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5 >[root@localhost client]# rpm -ivh >lustre-client-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5.i686.rpm >Preparing... ########################################### >[100%] > 1:lustre-client ########################################### >[100%] >[root@localhost client]# mount -t lustre 10.193.35.54@tcp0:/lustrefs >/lustrefs >mount.lustre: mount 10.193.35.54@tcp0:/lustrefs at /lustrefs failed: No >such device >Are the lustre modules loaded? >Check /etc/modprobe.conf and /proc/filesystems >Note ''alias lustre llite'' should be removed from modprobe.conf > > >[root@localhost client]# cat /etc/modprobe.conf >alias eth0 e1000e >alias eth1 e1000e >alias scsi_hostadapter ahci >options lnet networks=tcp > > >[root@localhost client]# cat /proc/filesystems | grep -i lustre > >[root@localhost client]# rpm -qa | grep -i lustre >lustre-client-modules-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5 >lustre-client-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5 > > > >Cheers, Andreas -- Andreas Dilger Lustre Software Architect Intel High Performance Data Division
Lustre_rmmod failed with the following message: Open /proc/sys/lnet/dump_kernel failed: No such file or directory Open(dump_kernel) failed: No such file or directory The package does not install correct for the directory /proc/syus/lnet does not exist. -Weilin -----Original Message----- From: White, Cliff [mailto:cliff.white-ral2JQCrhuEAvxtiuMwx3w@public.gmane.org] Sent: Thursday, October 17, 2013 10:59 AM To: Weilin Chang; Chan Ching Yu Patrick Cc: lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org Subject: Re: [Lustre-discuss] lustre 1.8.5 client failed to mount lustre From: Weilin Chang <Weilin.Chang-hv44wF8Li93QT0dZR+AlfA@public.gmane.org<mailto:Weilin.Chang-hv44wF8Li93QT0dZR+AlfA@public.gmane.org>> Date: Thursday, October 17, 2013 10:25 AM To: Chan Ching Yu Patrick <cychan-eQCasaxV0mrc+919tysfdA@public.gmane.org<mailto:cychan-eQCasaxV0mrc+919tysfdA@public.gmane.org>> Cc: Weilin Chang <Weilin.Chang-hv44wF8Li93QT0dZR+AlfA@public.gmane.org<mailto:Weilin.Chang-hv44wF8Li93QT0dZR+AlfA@public.gmane.org>>, "lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org<mailto:lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org>" <lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org<mailto:lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org>> Subject: Re: [Lustre-discuss] lustre 1.8.5 client failed to mount lustre I got the following message for "lctl list_nids": Opening /dev/lnet failed: No such device Hint: the kerenel modules may not be loaded IOC_LIBCFS_GET_NI error 19: No such device It looks like the lunstre packet has been installed, but it does not hook with kernel correctly. Which part went wrong? -Weilin You might try ''lustre_rmmod'' following by ''modprobe -v lustre'' - usually you will have useful error messages. The ''networks'' option In /etc/modprobe.conf Is unnecessary - lnet will default to TCP. I would delete that line, as the syntax does not look correct. Cliffw From: Chan Ching Yu Patrick [mailto:cychan-eQCasaxV0mrc+919tysfdA@public.gmane.org] Sent: Wednesday, October 16, 2013 7:49 PM To: Weilin Chang Cc: lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org<mailto:lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org> Subject: Re: [Lustre-discuss] lustre 1.8.5 client failed to mount lustre What''s the output? lctl list_nids On 10/17/2013 08:36 AM, Weilin Chang wrote: Do I need to upgrade e2fsprogs on the client system? -Weilin From: Weilin Chang Sent: Wednesday, October 16, 2013 3:45 PM To: lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org<mailto:lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org> Cc: Weilin Chang Subject: lustre 1.8.5 client failed to mount lustre HI, I am using luster 1.8.5. Server s are up and mounted without any problem. But client failed to mount the luster file system. I also did not see luster in /proc/filesystems. Is there other rpm I needed to install on the client system? The below is log from the client system: [root@localhost client]# rpm -ivh lustre-client-modules-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5.i686.rpm Preparing... ########################################### [100%] 1:lustre-client-modules ########################################### [100%] Congratulations on finishing your Lustre installation! To register your copy of Lustre and find out more about Lustre Support, Service, and Training offerings please visit http://www.sun.com/software/products/lustre/lustre_reg.jsp [root@localhost client]# rpm -qa | grep lustrelustre-client-modules-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5 [root@localhost client]# rpm -ivh lustre-client-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5.i686.rpm Preparing... ########################################### [100%] 1:lustre-client ########################################### [100%] [root@localhost client]# mount -t lustre 10.193.35.54@tcp0:/lustrefs /lustrefs mount.lustre: mount 10.193.35.54@tcp0:/lustrefs at /lustrefs failed: No such device Are the lustre modules loaded? Check /etc/modprobe.conf and /proc/filesystems Note ''alias lustre llite'' should be removed from modprobe.conf [root@localhost client]# cat /etc/modprobe.conf alias eth0 e1000e alias eth1 e1000e alias scsi_hostadapter ahci options lnet networks=tcp [root@localhost client]# cat /proc/filesystems | grep -i lustre [root@localhost client]# rpm -qa | grep -i lustre lustre-client-modules-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5 lustre-client-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5 _______________________________________________ Lustre-discuss mailing list Lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org<mailto:Lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org> http://lists.lustre.org/mailman/listinfo/lustre-discuss -- Chan Ching Yu, Patrick Senior System Engineer Cluster Technology Limited Modernize Your Business with Advanced Computing Technologies Cloud Computing | Cluster | Financial Engineering | Business Intelligence Email:cychan @clustertech.com<mailto:cychan-eQCasaxV0mrc+919tysfdA@public.gmane.org> Direct Line: +852 2655 6113 Tel: +852 2655 6100 Fax: +852 2994 2101 Website:www.clustertech.com<http://www.clustertech.com> Address: Units 211 - 213, Lakeside 1, No. 8 Science Park West Avenue, Hong Kong Science Park, N.T. Hong Kong Hong Kong Beijing Shanghai Guangzhou Shenzhen Wuhan Sydney ************************************************************************** The information contained in this e-mail and its attachments is confidential and intended solely for the specified addressees. If you have received this email in error, please do not read, copy, distribute, disclose or use any information of this email in any way and please immediately notify the sender and delete this email. Thank you for your cooperation. **************************************************************************
On 10/17/13 11:10 AM, "Weilin Chang" <Weilin.Chang-hv44wF8Li93QT0dZR+AlfA@public.gmane.org> wrote:>Lustre_rmmod failed with the following message: >Open /proc/sys/lnet/dump_kernel failed: No such file or directory >Open(dump_kernel) failed: No such file or directory > >The package does not install correct for the directory /proc/syus/lnet >does not exist.That''s not the problem. What error messages does ''modprobe -v lustre'' give?> > >-Weilin > >-----Original Message----- >From: White, Cliff [mailto:cliff.white-ral2JQCrhuEAvxtiuMwx3w@public.gmane.org] >Sent: Thursday, October 17, 2013 10:59 AM >To: Weilin Chang; Chan Ching Yu Patrick >Cc: lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org >Subject: Re: [Lustre-discuss] lustre 1.8.5 client failed to mount lustre > >From: Weilin Chang ><Weilin.Chang-hv44wF8Li93QT0dZR+AlfA@public.gmane.org<mailto:Weilin.Chang-hv44wF8Li93QT0dZR+AlfA@public.gmane.org>> >Date: Thursday, October 17, 2013 10:25 AM >To: Chan Ching Yu Patrick ><cychan-eQCasaxV0mrc+919tysfdA@public.gmane.org<mailto:cychan-eQCasaxV0mrc+919tysfdA@public.gmane.org>> >Cc: Weilin Chang ><Weilin.Chang-hv44wF8Li93QT0dZR+AlfA@public.gmane.org<mailto:Weilin.Chang-hv44wF8Li93QT0dZR+AlfA@public.gmane.org>>, >"lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org<mailto:lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org>" ><lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org<mailto:lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org>> >Subject: Re: [Lustre-discuss] lustre 1.8.5 client failed to mount lustre > >I got the following message for "lctl list_nids": >Opening /dev/lnet failed: No such device >Hint: the kerenel modules may not be loaded >IOC_LIBCFS_GET_NI error 19: No such device > > >It looks like the lunstre packet has been installed, but it does not hook >with kernel correctly. Which part went wrong? >-Weilin > > >You might try ''lustre_rmmod'' following by ''modprobe -v lustre'' - usually >you will have useful error messages. >The ''networks'' option In /etc/modprobe.conf Is unnecessary - lnet will >default to TCP. I would delete that line, as the syntax does not look >correct. >Cliffw > > > >From: Chan Ching Yu Patrick [mailto:cychan-eQCasaxV0mrc+919tysfdA@public.gmane.org] >Sent: Wednesday, October 16, 2013 7:49 PM >To: Weilin Chang >Cc: >lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org<mailto:lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org> >Subject: Re: [Lustre-discuss] lustre 1.8.5 client failed to mount lustre > >What''s the output? > >lctl list_nids > > > >On 10/17/2013 08:36 AM, Weilin Chang wrote: >Do I need to upgrade e2fsprogs on the client system? > >-Weilin > >From: Weilin Chang >Sent: Wednesday, October 16, 2013 3:45 PM >To: >lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org<mailto:lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org> >Cc: Weilin Chang >Subject: lustre 1.8.5 client failed to mount lustre > >HI, > >I am using luster 1.8.5. Server s are up and mounted without any problem. >But client failed to mount the luster file system. I also did not see >luster in /proc/filesystems. Is there other rpm I needed to install on >the client system? > >The below is log from the client system: > >[root@localhost client]# rpm -ivh >lustre-client-modules-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5.i686.rpm >Preparing... ########################################### >[100%] > 1:lustre-client-modules ########################################### >[100%] >Congratulations on finishing your Lustre installation! To register >your copy of Lustre and find out more about Lustre Support, Service, >and Training offerings please visit > >http://www.sun.com/software/products/lustre/lustre_reg.jsp >[root@localhost client]# rpm -qa | grep >lustrelustre-client-modules-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5 >[root@localhost client]# rpm -ivh >lustre-client-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5.i686.rpm >Preparing... ########################################### >[100%] > 1:lustre-client ########################################### >[100%] >[root@localhost client]# mount -t lustre 10.193.35.54@tcp0:/lustrefs >/lustrefs >mount.lustre: mount 10.193.35.54@tcp0:/lustrefs at /lustrefs failed: No >such device >Are the lustre modules loaded? >Check /etc/modprobe.conf and /proc/filesystems >Note ''alias lustre llite'' should be removed from modprobe.conf > > >[root@localhost client]# cat /etc/modprobe.conf >alias eth0 e1000e >alias eth1 e1000e >alias scsi_hostadapter ahci >options lnet networks=tcp > > >[root@localhost client]# cat /proc/filesystems | grep -i lustre > >[root@localhost client]# rpm -qa | grep -i lustre >lustre-client-modules-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5 >lustre-client-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5 > > > > > > >_______________________________________________ > >Lustre-discuss mailing list > >Lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org<mailto:Lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org> > >http://lists.lustre.org/mailman/listinfo/lustre-discuss > >-- >Chan Ching Yu, Patrick >Senior System Engineer >Cluster Technology Limited > >Modernize Your Business with Advanced Computing Technologies >Cloud Computing | Cluster | Financial Engineering | Business Intelligence >Email:cychan @clustertech.com<mailto:cychan-eQCasaxV0mrc+919tysfdA@public.gmane.org> >Direct Line: +852 2655 6113 Tel: +852 2655 6100 Fax: +852 2994 >2101 >Website:www.clustertech.com<http://www.clustertech.com> >Address: Units 211 - 213, Lakeside 1, No. 8 Science Park West Avenue, >Hong Kong Science Park, N.T. Hong Kong >Hong Kong Beijing Shanghai Guangzhou Shenzhen Wuhan > Sydney > >************************************************************************** >The information contained in this e-mail and its attachments is >confidential and intended solely for the specified addressees. If you >have received this email in error, please do not read, copy, distribute, >disclose or use any information of this email in any way and please >immediately notify the sender and delete this email. Thank you for your >cooperation. >************************************************************************** > > >
I agree with your observation. My purpose is to run Lustre on a 32 bit Linux system. The latest Lustre release does not support kernel patch for 32 bit Linux system. I don''t know how well to generate a 32 bit Linux kernel from a 64 bit Linux system without having other problems. I think the older Lustre release which had been tested and should be ok to use it. Do I need to patch my Linux from version 2.6.18-194.e15 to 2.6.18-194.17.1.e15 in order to work with Lustre 1.8.5? -Weilin -----Original Message----- From: Dilger, Andreas [mailto:andreas.dilger-ral2JQCrhuEAvxtiuMwx3w@public.gmane.org] Sent: Thursday, October 17, 2013 11:06 AM To: Weilin Chang Cc: lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org; hpdd-discuss-hn68Rpc1hR1g9hUCZPvPmw@public.gmane.org Subject: Re: [Lustre-discuss] lustre 1.8.5 client failed to mount lustre On 2013/10/16 4:45 PM, "Weilin Chang" <Weilin.Chang-hv44wF8Li93QT0dZR+AlfA@public.gmane.org> wrote:>HI, > >I am using luster 1.8.5. Server s are up and mounted without any problem. >But client failed to mount the luster file system. I also did not see >luster in /proc/filesystems. Is there other rpm I needed to install on >the client system?The most important question is why are you starting with this very old 1.8.5 release from 3 years ago instead of a newer release like 2.1.6 or 2.4.1? You will definitely find better support for newer kernels with newer releases, as well as a better chance that someone will be able to fix your problem. My first guess is that your client network is not configured correctly, since it has a hostname of "localhost". Second guess is that the Lustre modules are not properly matched with your kernel and they are not loading at all. Cheers, Andreas> >The below is log from the client system: > >[root@localhost client]# rpm -ivh >lustre-client-modules-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5.i686.rpm >Preparing... ########################################### >[100%] > 1:lustre-client-modules ########################################### >[100%] >Congratulations on finishing your Lustre installation! To register >your copy of Lustre and find out more about Lustre Support, Service, >and Training offerings please visit > >http://www.sun.com/software/products/lustre/lustre_reg.jsp >[root@localhost client]# rpm -qa | grep >lustrelustre-client-modules-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5 >[root@localhost client]# rpm -ivh >lustre-client-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5.i686.rpm >Preparing... ########################################### >[100%] > 1:lustre-client ########################################### >[100%] >[root@localhost client]# mount -t lustre 10.193.35.54@tcp0:/lustrefs >/lustrefs >mount.lustre: mount 10.193.35.54@tcp0:/lustrefs at /lustrefs failed: No >such device >Are the lustre modules loaded? >Check /etc/modprobe.conf and /proc/filesystems >Note ''alias lustre llite'' should be removed from modprobe.conf > > >[root@localhost client]# cat /etc/modprobe.conf >alias eth0 e1000e >alias eth1 e1000e >alias scsi_hostadapter ahci >options lnet networks=tcp > > >[root@localhost client]# cat /proc/filesystems | grep -i lustre > >[root@localhost client]# rpm -qa | grep -i lustre >lustre-client-modules-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5 >lustre-client-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5 > > > >Cheers, Andreas -- Andreas Dilger Lustre Software Architect Intel High Performance Data Division
Weilin, Earlier in the week you were discussing trying to get Lustre running on 32-bit ARM. Are the systems you have installed 1.8.5 upon x86 systems or are you doing this on ARM processor based platforms? --Jeff On 10/17/13 11:10 AM, Weilin Chang wrote:> Lustre_rmmod failed with the following message: > Open /proc/sys/lnet/dump_kernel failed: No such file or directory > Open(dump_kernel) failed: No such file or directory > > The package does not install correct for the directory /proc/syus/lnet does not exist. > > -Weilin > > -----Original Message----- > From: White, Cliff [mailto:cliff.white-ral2JQCrhuEAvxtiuMwx3w@public.gmane.org] > Sent: Thursday, October 17, 2013 10:59 AM > To: Weilin Chang; Chan Ching Yu Patrick > Cc: lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org > Subject: Re: [Lustre-discuss] lustre 1.8.5 client failed to mount lustre > > From: Weilin Chang <Weilin.Chang-hv44wF8Li93QT0dZR+AlfA@public.gmane.org<mailto:Weilin.Chang-hv44wF8Li93QT0dZR+AlfA@public.gmane.org>> > Date: Thursday, October 17, 2013 10:25 AM > To: Chan Ching Yu Patrick <cychan-eQCasaxV0mrc+919tysfdA@public.gmane.org<mailto:cychan-eQCasaxV0mrc+919tysfdA@public.gmane.org>> > Cc: Weilin Chang <Weilin.Chang-hv44wF8Li93QT0dZR+AlfA@public.gmane.org<mailto:Weilin.Chang-hv44wF8Li93QT0dZR+AlfA@public.gmane.org>>, "lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org<mailto:lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org>" <lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org<mailto:lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org>> > Subject: Re: [Lustre-discuss] lustre 1.8.5 client failed to mount lustre > > I got the following message for "lctl list_nids": > Opening /dev/lnet failed: No such device > Hint: the kerenel modules may not be loaded > IOC_LIBCFS_GET_NI error 19: No such device > > > It looks like the lunstre packet has been installed, but it does not hook with kernel correctly. Which part went wrong? > -Weilin > > > You might try ''lustre_rmmod'' following by ''modprobe -v lustre'' - usually you will have useful error messages. > The ''networks'' option In /etc/modprobe.conf Is unnecessary - lnet will default to TCP. I would delete that line, as the syntax does not look correct. > Cliffw > > > > From: Chan Ching Yu Patrick [mailto:cychan-eQCasaxV0mrc+919tysfdA@public.gmane.org] > Sent: Wednesday, October 16, 2013 7:49 PM > To: Weilin Chang > Cc: lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org<mailto:lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org> > Subject: Re: [Lustre-discuss] lustre 1.8.5 client failed to mount lustre > > What''s the output? > > lctl list_nids > > > > On 10/17/2013 08:36 AM, Weilin Chang wrote: > Do I need to upgrade e2fsprogs on the client system? > > -Weilin > > From: Weilin Chang > Sent: Wednesday, October 16, 2013 3:45 PM > To: lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org<mailto:lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org> > Cc: Weilin Chang > Subject: lustre 1.8.5 client failed to mount lustre > > HI, > > I am using luster 1.8.5. Server s are up and mounted without any problem. But client failed to mount the luster file system. I also did not see luster in /proc/filesystems. Is there other rpm I needed to install on the client system? > > The below is log from the client system: > > [root@localhost client]# rpm -ivh lustre-client-modules-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5.i686.rpm > Preparing... ########################################### [100%] > 1:lustre-client-modules ########################################### [100%] > Congratulations on finishing your Lustre installation! To register > your copy of Lustre and find out more about Lustre Support, Service, > and Training offerings please visit > > http://www.sun.com/software/products/lustre/lustre_reg.jsp > [root@localhost client]# rpm -qa | grep lustrelustre-client-modules-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5 > [root@localhost client]# rpm -ivh lustre-client-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5.i686.rpm > Preparing... ########################################### [100%] > 1:lustre-client ########################################### [100%] > [root@localhost client]# mount -t lustre 10.193.35.54@tcp0:/lustrefs /lustrefs > mount.lustre: mount 10.193.35.54@tcp0:/lustrefs at /lustrefs failed: No such device > Are the lustre modules loaded? > Check /etc/modprobe.conf and /proc/filesystems > Note ''alias lustre llite'' should be removed from modprobe.conf > > > [root@localhost client]# cat /etc/modprobe.conf > alias eth0 e1000e > alias eth1 e1000e > alias scsi_hostadapter ahci > options lnet networks=tcp > > > [root@localhost client]# cat /proc/filesystems | grep -i lustre > > [root@localhost client]# rpm -qa | grep -i lustre > lustre-client-modules-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5 > lustre-client-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5 > > > > > > > _______________________________________________ > > Lustre-discuss mailing list > > Lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org<mailto:Lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org> > > http://lists.lustre.org/mailman/listinfo/lustre-discuss > > -- > Chan Ching Yu, Patrick > Senior System Engineer > Cluster Technology Limited > > Modernize Your Business with Advanced Computing Technologies > Cloud Computing | Cluster | Financial Engineering | Business Intelligence > Email:cychan @clustertech.com<mailto:cychan-eQCasaxV0mrc+919tysfdA@public.gmane.org> > Direct Line: +852 2655 6113 Tel: +852 2655 6100 Fax: +852 2994 2101 > Website:www.clustertech.com<http://www.clustertech.com> > Address: Units 211 - 213, Lakeside 1, No. 8 Science Park West Avenue, Hong Kong Science Park, N.T. Hong Kong > Hong Kong Beijing Shanghai Guangzhou Shenzhen Wuhan Sydney > > ************************************************************************** > The information contained in this e-mail and its attachments is confidential and intended solely for the specified addressees. If you have received this email in error, please do not read, copy, distribute, disclose or use any information of this email in any way and please immediately notify the sender and delete this email. Thank you for your cooperation. > ************************************************************************** > > > _______________________________________________ > Lustre-discuss mailing list > Lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org > http://lists.lustre.org/mailman/listinfo/lustre-discuss-- ------------------------------ Jeff Johnson Co-Founder Aeon Computing jeff.johnson-OPZmt/DU+TakJOqCEYON2AC/G2K4zDHf@public.gmane.org www.aeoncomputing.com t: 858-412-3810 x1001 f: 858-412-3845 m: 619-204-9061 4170 Morena Boulevard, Suite D - San Diego, CA 92117 High-performance Computing / Lustre Filesystems / Scale-out Storage
I upgrade my system, but mount on client still failed. Here are what I got from the client system. [root@localhost guest]# uname -a Linux lustreClient 2.6.18-194.17.1.el5 #1 SMP Wed Sep 29 12:19:22 EDT 2010 i686 i686 i386 GNU/Linux [root@localhost guest]# lustre_rmmod [root@localhost guest]# modprobe -v lustre insmod /lib/modules/2.6.18-194.17.1.el5/updates/kernel/net/lustre/libcfs.ko insmod /lib/modules/2.6.18-194.17.1.el5/updates/kernel/fs/lustre/lvfs.ko insmod /lib/modules/2.6.18-194.17.1.el5/updates/kernel/net/lustre/lnet.ko networks=tcp insmod /lib/modules/2.6.18-194.17.1.el5/updates/kernel/fs/lustre/obdclass.ko insmod /lib/modules/2.6.18-194.17.1.el5/updates/kernel/fs/lustre/ptlrpc.ko insmod /lib/modules/2.6.18-194.17.1.el5/updates/kernel/fs/lustre/osc.ko insmod /lib/modules/2.6.18-194.17.1.el5/updates/kernel/fs/lustre/mdc.ko insmod /lib/modules/2.6.18-194.17.1.el5/updates/kernel/fs/lustre/lov.ko insmod /lib/modules/2.6.18-194.17.1.el5/updates/kernel/fs/lustre/lustre.ko [root@localhost guest]# mount -t lustre 10.193.35.54:/lustrefs /lustrefs mount.lustre: mount 10.193.35.54:/lustrefs at /lustrefs failed: Cannot send after transport endpoint shutdown [root@localhost guest]# dmesg | tail -23 Lustre: Lustre Client File System; http://www.lustre.org/ Lustre: 5338:0:(client.c:1476:ptlrpc_expire_one_request()) @@@ Request x1449175313022977 sent from MGC10.193.35.54@tcp to NID 10.193.35.54@tcp 5s ago has timed out (5s prior to deadline). req@f3ce2600 x1449175313022977/t0 o250->MGS-eDW5HPv6K0QAh7MuyqD4+A@public.gmane.org@tcp_0:26/25 lens 368/584 e 0 to 1 dl 1382041281 ref 1 fl Rpc:N/0/0 rc 0/0 LustreError: 5286:0:(client.c:858:ptlrpc_import_delay_req()) @@@ IMP_INVALID req@f3ce2200 x1449175313022979/t0 o501->MGS-eDW5HPv6K0QAh7MuyqD4+A@public.gmane.org@tcp_0:26/25 lens 264/432 e 0 to 1 dl 0 ref 1 fl Rpc:/0/0 rc 0/0 LustreError: 15c-8: MGC10.193.35.54@tcp: The configuration from log ''lustrefs-client'' failed (-108). This may be the result of communication errors between this node and the MGS, a bad configuration, or other errors. See the syslog for more information. LustreError: 5286:0:(llite_lib.c:1079:ll_fill_super()) Unable to process log: -108 Lustre: client f46c3a00 umount complete LustreError: 5286:0:(obd_mount.c:2050:lustre_fill_super()) Unable to mount (-108) Lustre: Acceptor stopping Lustre: Removed LNI 10.193.35.95@tcp Lustre: OBD class driver, http://www.lustre.org/ Lustre: Lustre Version: 1.8.5 Lustre: Build Version: 1.8.5-20101116201452-PRISTINE-2.6.18-194.17.1.el5 Lustre: Added LNI 10.193.35.95@tcp [8/256/0/180] Lustre: Accept secure, port 988 Lustre: Lustre Client File System; http://www.lustre.org/ Lustre: 5659:0:(client.c:1476:ptlrpc_expire_one_request()) @@@ Request x1449175758667777 sent from MGC10.193.35.54@tcp to NID 10.193.35.54@tcp 5s ago has timed out (5s prior to deadline). req@f428e000 x1449175758667777/t0 o250->MGS-eDW5HPv6K0QAh7MuyqD4+A@public.gmane.org@tcp_0:26/25 lens 368/584 e 0 to 1 dl 1382041716 ref 1 fl Rpc:N/0/0 rc 0/0 LustreError: 5697:0:(client.c:858:ptlrpc_import_delay_req()) @@@ IMP_INVALID req@f4290c00 x1449175758667779/t0 o501->MGS-eDW5HPv6K0QAh7MuyqD4+A@public.gmane.org@tcp_0:26/25 lens 264/432 e 0 to 1 dl 0 ref 1 fl Rpc:/0/0 rc 0/0 LustreError: 15c-8: MGC10.193.35.54@tcp: The configuration from log ''lustrefs-client'' failed (-108). This may be the result of communication errors between this node and the MGS, a bad configuration, or other errors. See the syslog for more information. LustreError: 5697:0:(llite_lib.c:1079:ll_fill_super()) Unable to process log: -108 Lustre: client f7034000 umount complete LustreError: 5697:0:(obd_mount.c:2050:lustre_fill_super()) Unable to mount (-108) -----Original Message----- From: White, Cliff [mailto:cliff.white-ral2JQCrhuEAvxtiuMwx3w@public.gmane.org] Sent: Thursday, October 17, 2013 10:59 AM To: Weilin Chang; Chan Ching Yu Patrick Cc: lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org Subject: Re: [Lustre-discuss] lustre 1.8.5 client failed to mount lustre From: Weilin Chang <Weilin.Chang-hv44wF8Li93QT0dZR+AlfA@public.gmane.org<mailto:Weilin.Chang-hv44wF8Li93QT0dZR+AlfA@public.gmane.org>> Date: Thursday, October 17, 2013 10:25 AM To: Chan Ching Yu Patrick <cychan-eQCasaxV0mrc+919tysfdA@public.gmane.org<mailto:cychan-eQCasaxV0mrc+919tysfdA@public.gmane.org>> Cc: Weilin Chang <Weilin.Chang-hv44wF8Li93QT0dZR+AlfA@public.gmane.org<mailto:Weilin.Chang-hv44wF8Li93QT0dZR+AlfA@public.gmane.org>>, "lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org<mailto:lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org>" <lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org<mailto:lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org>> Subject: Re: [Lustre-discuss] lustre 1.8.5 client failed to mount lustre I got the following message for "lctl list_nids": Opening /dev/lnet failed: No such device Hint: the kerenel modules may not be loaded IOC_LIBCFS_GET_NI error 19: No such device It looks like the lunstre packet has been installed, but it does not hook with kernel correctly. Which part went wrong? -Weilin You might try ''lustre_rmmod'' following by ''modprobe -v lustre'' - usually you will have useful error messages. The ''networks'' option In /etc/modprobe.conf Is unnecessary - lnet will default to TCP. I would delete that line, as the syntax does not look correct. Cliffw From: Chan Ching Yu Patrick [mailto:cychan-eQCasaxV0mrc+919tysfdA@public.gmane.org] Sent: Wednesday, October 16, 2013 7:49 PM To: Weilin Chang Cc: lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org<mailto:lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org> Subject: Re: [Lustre-discuss] lustre 1.8.5 client failed to mount lustre What''s the output? lctl list_nids On 10/17/2013 08:36 AM, Weilin Chang wrote: Do I need to upgrade e2fsprogs on the client system? -Weilin From: Weilin Chang Sent: Wednesday, October 16, 2013 3:45 PM To: lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org<mailto:lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org> Cc: Weilin Chang Subject: lustre 1.8.5 client failed to mount lustre HI, I am using luster 1.8.5. Server s are up and mounted without any problem. But client failed to mount the luster file system. I also did not see luster in /proc/filesystems. Is there other rpm I needed to install on the client system? The below is log from the client system: [root@localhost client]# rpm -ivh lustre-client-modules-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5.i686.rpm Preparing... ########################################### [100%] 1:lustre-client-modules ########################################### [100%] Congratulations on finishing your Lustre installation! To register your copy of Lustre and find out more about Lustre Support, Service, and Training offerings please visit http://www.sun.com/software/products/lustre/lustre_reg.jsp [root@localhost client]# rpm -qa | grep lustrelustre-client-modules-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5 [root@localhost client]# rpm -ivh lustre-client-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5.i686.rpm Preparing... ########################################### [100%] 1:lustre-client ########################################### [100%] [root@localhost client]# mount -t lustre 10.193.35.54@tcp0:/lustrefs /lustrefs mount.lustre: mount 10.193.35.54@tcp0:/lustrefs at /lustrefs failed: No such device Are the lustre modules loaded? Check /etc/modprobe.conf and /proc/filesystems Note ''alias lustre llite'' should be removed from modprobe.conf [root@localhost client]# cat /etc/modprobe.conf alias eth0 e1000e alias eth1 e1000e alias scsi_hostadapter ahci options lnet networks=tcp [root@localhost client]# cat /proc/filesystems | grep -i lustre [root@localhost client]# rpm -qa | grep -i lustre lustre-client-modules-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5 lustre-client-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5 _______________________________________________ Lustre-discuss mailing list Lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org<mailto:Lustre-discuss-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org> http://lists.lustre.org/mailman/listinfo/lustre-discuss -- Chan Ching Yu, Patrick Senior System Engineer Cluster Technology Limited Modernize Your Business with Advanced Computing Technologies Cloud Computing | Cluster | Financial Engineering | Business Intelligence Email:cychan @clustertech.com<mailto:cychan-eQCasaxV0mrc+919tysfdA@public.gmane.org> Direct Line: +852 2655 6113 Tel: +852 2655 6100 Fax: +852 2994 2101 Website:www.clustertech.com<http://www.clustertech.com> Address: Units 211 - 213, Lakeside 1, No. 8 Science Park West Avenue, Hong Kong Science Park, N.T. Hong Kong Hong Kong Beijing Shanghai Guangzhou Shenzhen Wuhan Sydney ************************************************************************** The information contained in this e-mail and its attachments is confidential and intended solely for the specified addressees. If you have received this email in error, please do not read, copy, distribute, disclose or use any information of this email in any way and please immediately notify the sender and delete this email. Thank you for your cooperation. **************************************************************************