vaibhav pol
2010-Dec-10 08:36 UTC
[Lustre-discuss] Multihome question : unable to mount lustre over tcp.
Dear Lustre users,
I am using lustre file system(lustre-1.8.1) over ib.Now i
required lustre over ib and over Ethernet also.
I modified the modprobe.conf on client , mds(mdt),oss(ost).
I add below line in modprobe.conf.
options lnet networks=o2ib(ib0),tcp1(eth1)
I am able to mount lustre over ib on client but not able to mount over
Ethernet.
I am getting following error on stdout .
mount.lustre: mount 172.29.2.25 at tcp1:/home at /mnt failed: No such file
or directory
Is the MGS specification correct?
Is the file system name correct?
If upgrading, is the copied client log valid? (see upgrade docs)
and /var/log/message is
kernel: LustreError: 6943:0:(ldlm_lib.c:329:client_obd_setup())
can''t
add initial connection
kernel: LustreError: 6943:0:(obd_config.c:370:class_setup()) setup
home-MDT0000-mdc-ffff810f39c8ac00 failed (-2)
kernel: LustreError:
6943:0:(obd_config.c:1197:class_config_llog_handler()) Err -2 on cfg
command:
kernel: Lustre: cmd=cf003 0:home-MDT0000-mdc 1:home-MDT0000_UUID
2:172.31.65.49 at o2ib
kernel: LustreError: 15c-8: MGC172.29.2.25 at tcp1: The configuration from
log ''home-client'' failed (-2). This may be the result of
communication
errors between this node and the MGS, a bad configuration, or other errors.
See the syslog for more information.
kernel: LustreError: 6933:0:(llite_lib.c:1171:ll_fill_super()) Unable to
process log: -2
kernel: LustreError: 6933:0:(obd_config.c:441:class_cleanup()) Device 2
not setup
kernel: LustreError: 6933:0:(ldlm_request.c:1030:ldlm_cli_cancel_req())
Got rc -108 from cancel RPC: canceling anyway
kernel: LustreError: 6933:0:(ldlm_request.c:1533:ldlm_cli_cancel_list())
ldlm_cli_cancel_list: -108
kernel: Lustre: client ffff810f39c8ac00 umount complete
kernel: LustreError: 6933:0:(obd_mount.c:1997:lustre_fill_super())
Unable to mount (-2)
I am able to ping mgs from client .
lctl list_nids command output on mgs give following output.
172.31.65.49 at o2ib
172.29.2.25 at tcp1
also i able to mount lustre client on mgs itself over Ethernet
Following is tunefs.lustre output
1) mgs tunefs.lustre output
checking for existing Lustre data: found CONFIGS/mountdata
Reading CONFIGS/mountdata
Read previous values:
Target: MGS
Index: unassigned
Lustre FS: scratch
Mount type: ldiskfs
Flags: 0x174
(MGS needs_index first_time update writeconf )
Persistent mount opts: errors=remount-ro,iopen_nopriv,user_xattr
Parameters:
Permanent disk data:
Target: MGS
Index: unassigned
Lustre FS: scratch
Mount type: ldiskfs
Flags: 0x174
(MGS needs_index first_time update writeconf )
Persistent mount opts: errors=remount-ro,iopen_nopriv,user_xattr
2) mds(mdt) tunefs.lustre output
Read previous values:
Target: home-MDT0000
Index: 0
Lustre FS: home
Mount type: ldiskfs
Flags: 0x1
(MDT )
Persistent mount opts: errors=remount-ro,iopen_nopriv,user_xattr
Parameters:
mgsnode=172.31.65.49 at o2ibmdt.group_upcall=/usr/sbin/l_getgroups
Permanent disk data:
Target: home-MDT0000
Index: 0
Lustre FS: home
Mount type: ldiskfs
Flags: 0x1
(MDT )
Persistent mount opts: errors=remount-ro,iopen_nopriv,user_xattr
Parameters:
mgsnode=172.31.65.49 at o2ibmdt.group_upcall=/usr/sbin/l_getgroups
3) oss(ost) tunefs.lustre output
Read previous values:
Target: home-OST0003
Index: 3
Lustre FS: home
Mount type: ldiskfs
Flags: 0x2
(OST )
Persistent mount opts: errors=remount-ro,extents,mballoc
Parameters: mgsnode=172.31.65.49 at o2ib mdt.quota_type=ug
Permanent disk data:
Target: home-OST0003
Index: 3
Lustre FS: home
Mount type: ldiskfs
Flags: 0x2
(OST )
Persistent mount opts: errors=remount-ro,extents,mballoc
Parameters: mgsnode=172.31.65.49 at o2ib mdt.quota_type=ug
exiting before disk write.
I am not able to figure out what is the exact problem.
Thanks and regards
Vaibhi
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
http://lists.lustre.org/pipermail/lustre-discuss/attachments/20101210/fb62c5d7/attachment.html
Temple Jason
2010-Dec-10 09:12 UTC
[Lustre-discuss] Multihome question : unable to mount lustre over tcp.
Hi,
You need to run tunefs.lustre on all the servers to add the new nid @tcp nids.
Thanks,
Jason
From: lustre-discuss-bounces at lists.lustre.org [mailto:lustre-discuss-bounces
at lists.lustre.org] On Behalf Of vaibhav pol
Sent: venerd?, 10. dicembre 2010 09:36
To: lustre-discuss at lists.lustre.org
Subject: [Lustre-discuss] Multihome question : unable to mount lustre over tcp.
Dear Lustre users,
I am using lustre file system(lustre-1.8.1) over ib.Now i required
lustre over ib and over Ethernet also.
I modified the modprobe.conf on client , mds(mdt),oss(ost).
I add below line in modprobe.conf.
options lnet networks=o2ib(ib0),tcp1(eth1)
I am able to mount lustre over ib on client but not able to mount over
Ethernet.
I am getting following error on stdout .
mount.lustre: mount 172.29.2.25 at tcp1:/home at /mnt failed: No such file
or directory
Is the MGS specification correct?
Is the file system name correct?
If upgrading, is the copied client log valid? (see upgrade docs)
and /var/log/message is
kernel: LustreError: 6943:0:(ldlm_lib.c:329:client_obd_setup())
can''t add initial connection
kernel: LustreError: 6943:0:(obd_config.c:370:class_setup()) setup
home-MDT0000-mdc-ffff810f39c8ac00 failed (-2)
kernel: LustreError: 6943:0:(obd_config.c:1197:class_config_llog_handler())
Err -2 on cfg command:
kernel: Lustre: cmd=cf003 0:home-MDT0000-mdc 1:home-MDT0000_UUID
2:172.31.65.49 at o2ib
kernel: LustreError: 15c-8: MGC172.29.2.25 at tcp1: The configuration from
log ''home-client'' failed (-2). This may be the result of
communication errors between this node and the MGS, a bad configuration, or
other errors. See the syslog for more information.
kernel: LustreError: 6933:0:(llite_lib.c:1171:ll_fill_super()) Unable to
process log: -2
kernel: LustreError: 6933:0:(obd_config.c:441:class_cleanup()) Device 2 not
setup
kernel: LustreError: 6933:0:(ldlm_request.c:1030:ldlm_cli_cancel_req()) Got
rc -108 from cancel RPC: canceling anyway
kernel: LustreError: 6933:0:(ldlm_request.c:1533:ldlm_cli_cancel_list())
ldlm_cli_cancel_list: -108
kernel: Lustre: client ffff810f39c8ac00 umount complete
kernel: LustreError: 6933:0:(obd_mount.c:1997:lustre_fill_super()) Unable to
mount (-2)
I am able to ping mgs from client .
lctl list_nids command output on mgs give following output.
172.31.65.49 at o2ib
172.29.2.25 at tcp1
also i able to mount lustre client on mgs itself over Ethernet
Following is tunefs.lustre output
1) mgs tunefs.lustre output
checking for existing Lustre data: found CONFIGS/mountdata
Reading CONFIGS/mountdata
Read previous values:
Target: MGS
Index: unassigned
Lustre FS: scratch
Mount type: ldiskfs
Flags: 0x174
(MGS needs_index first_time update writeconf )
Persistent mount opts: errors=remount-ro,iopen_nopriv,user_xattr
Parameters:
Permanent disk data:
Target: MGS
Index: unassigned
Lustre FS: scratch
Mount type: ldiskfs
Flags: 0x174
(MGS needs_index first_time update writeconf )
Persistent mount opts: errors=remount-ro,iopen_nopriv,user_xattr
2) mds(mdt) tunefs.lustre output
Read previous values:
Target: home-MDT0000
Index: 0
Lustre FS: home
Mount type: ldiskfs
Flags: 0x1
(MDT )
Persistent mount opts: errors=remount-ro,iopen_nopriv,user_xattr
Parameters: mgsnode=172.31.65.49 at o2ib
mdt.group_upcall=/usr/sbin/l_getgroups
Permanent disk data:
Target: home-MDT0000
Index: 0
Lustre FS: home
Mount type: ldiskfs
Flags: 0x1
(MDT )
Persistent mount opts: errors=remount-ro,iopen_nopriv,user_xattr
Parameters: mgsnode=172.31.65.49 at o2ib
mdt.group_upcall=/usr/sbin/l_getgroups
3) oss(ost) tunefs.lustre output
Read previous values:
Target: home-OST0003
Index: 3
Lustre FS: home
Mount type: ldiskfs
Flags: 0x2
(OST )
Persistent mount opts: errors=remount-ro,extents,mballoc
Parameters: mgsnode=172.31.65.49 at o2ib mdt.quota_type=ug
Permanent disk data:
Target: home-OST0003
Index: 3
Lustre FS: home
Mount type: ldiskfs
Flags: 0x2
(OST )
Persistent mount opts: errors=remount-ro,extents,mballoc
Parameters: mgsnode=172.31.65.49 at o2ib mdt.quota_type=ug
exiting before disk write.
I am not able to figure out what is the exact problem.
Thanks and regards
Vaibhi
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
http://lists.lustre.org/pipermail/lustre-discuss/attachments/20101210/64ea8604/attachment-0001.html