Dear all, I try to install the lustre on Red Hat Enterprise 5.3 follow the step in the doc "Lustre File System". When come to mount the logic volumn to the local folder, the system give the error, "mount.lustre: mount /dev/vg02/mdt at /mdt failed: Unknown error 256". The full info is : [root at localhost Desktop]# mount -t lustre /dev/vg02/mdt /mdt mount.lustre: mount /dev/vg02/mdt at /mdt failed: Unknown error 256 The the two directory do exsit, but the mount can not go through. Can you guys give me some advise? Thanks -- -- Li, Tan PhD Student & Teaching Assistant, Electrical Engineering, Stony Brook University, NY Personal Web Site: https://sites.google.com/site/homepagelitan/Home Email: fanqielee at gmail.com
Johann Lombardi
2010-Oct-12 08:44 UTC
[Lustre-discuss] mount error when install lustre Metadata
On Oct 12, 2010, at 1:59 AM, Tanin wrote:> [root at localhost Desktop]# mount -t lustre /dev/vg02/mdt /mdt > mount.lustre: mount /dev/vg02/mdt at /mdt failed: Unknown error 256 > > The the two directory do exsit, but the mount can not go through. Can > you guys give me some advise? ThanksI would check the output of dmesg, it likely contains some error messages. Cheers, Johann
Hello,
very often we see the following error messages on lustre clients,
after which the client hangs.
~]# lfs check servers
error: check ''lustrefs-OST000f-osc-ffff810069b5d400''
Resource
temporarily unavailable
On the server side the log is
==============Oct 12 15:27:50 oss03 kernel: Lustre:
4070:0:(ldlm_lib.c:837:target_handle_connect()) lustrefs-OST000f: refuse
reconnection from
68739331-439d-9818-9d70-47e53e0644c2 at 192.168.200.246@tcp to
0xffff810416a5f200; still busy with 1 active RPCs
Oct 12 15:27:50 oss03 kernel: Lustre:
4070:0:(ldlm_lib.c:837:target_handle_connect()) Skipped 19 previous
similar messages
Oct 12 15:27:50 oss03 kernel: LustreError:
4070:0:(ldlm_lib.c:1848:target_send_reply_msg()) @@@ processing error
(-16) req at ffff81042f788c00 x1348876697425130/t0
o8->68739331-439d-9818-9d70-47e53e0644c2 at NET_0x20000c0a8c8f6_UUID:0/0
lens 368/264 e 0 to 0 dl 1286890170 ref 1 fl Interpret:/0/0 rc -16/0
Oct 12 15:27:50 oss03 kernel: LustreError:
4070:0:(ldlm_lib.c:1848:target_send_reply_msg()) Skipped 19 previous
similar messages
Oct 12 15:30:03 oss03 kernel: Lustre:
4094:0:(ldlm_lib.c:540:target_handle_reconnect()) lustrefs-OST000f:
68739331-439d-9818-9d70-47e53e0644c2 reconnecting
Oct 12 15:30:03 oss03 kernel: Lustre:
4094:0:(ldlm_lib.c:540:target_handle_reconnect()) Skipped 37 previous
similar messages
Oct 12 15:30:03 oss03 kernel: Lustre:
4094:0:(ldlm_lib.c:837:target_handle_connect()) lustrefs-OST000f: refuse
reconnection from
68739331-439d-9818-9d70-47e53e0644c2 at 192.168.200.246@tcp to
0xffff810416a5f200; still busy with 1 active RPCs
Oct 12 15:30:03 oss03 kernel: Lustre:
4094:0:(ldlm_lib.c:837:target_handle_connect()) Skipped 37 previous
similar messages
Oct 12 15:30:03 oss03 kernel: LustreError:
4094:0:(ldlm_lib.c:1848:target_send_reply_msg()) @@@ processing error
(-16) req at ffff81041eb0b000 x1348876697426353/t0
o8->68739331-439d-9818-9d70-47e53e0644c2 at NET_0x20000c0a8c8f6_UUID:0/0
lens 368/264 e 0 to 0 dl 1286890303 ref 1 fl Interpret:/0/0 rc -16/0
Oct 12 15:30:03 oss03 kernel: LustreError:
4094:0:(ldlm_lib.c:1848:target_send_reply_msg()) Skipped 37 previous
similar messages
============
Lustre file servers are setup preserving almost all recommendations from
its manual(except separate raid controllers for
each OSTs), but anyway we are getting this annoying messages.
Is this a bug? Should we upgrade to newer version?
Kernel: 2.6.18-164.11.1.el5
Lustre: 1.8.2
Thank you
Oh, I check the dmesg, it contains some error infomation. Do you know
[tanli at localhost ~]$ dmesg|grep error
hdc: drive_cmd: error=0x04 { AbortedCommand }
LustreError: 4799:0:(obd_mount.c:481:lustre_start_simple()) MGS setup error -256
LustreError: 6774:0:(obd_mount.c:481:lustre_start_simple()) MGS setup error -256
LustreError: 6977:0:(obd_mount.c:481:lustre_start_simple()) MGS setup error -256
On Tue, Oct 12, 2010 at 1:44 AM, Johann Lombardi
<johann.lombardi at oracle.com> wrote:> On Oct 12, 2010, at 1:59 AM, Tanin wrote:
>>
>> [root at localhost Desktop]# ?mount -t lustre /dev/vg02/mdt ?/mdt
>> mount.lustre: mount /dev/vg02/mdt at /mdt failed: Unknown error 256
>>
>> The the two directory do exsit, but the mount can not go through. Can
>> you guys give me some advise? Thanks
>
> I would check the output of dmesg, it likely contains some error messages.
>
> Cheers,
> Johann
>
--
--
Li, Tan
PhD Student & Teaching Assistant,
Electrical Engineering,
Stony Brook University, NY
Personal Web Site: https://sites.google.com/site/homepagelitan/Home
Email: fanqielee at gmail.com
Oh, I check the dmesg, it contains some error infomation. Do you guys know what is the problem? Thanks LustreError: 4799:0:(obd_mount.c:481:lustre_start_simple()) MGS setup error -256 LustreError: 6774:0:(obd_mount.c:481:lustre_start_simple()) MGS setup error -256 LustreError: 6977:0:(obd_mount.c:481:lustre_start_simple()) MGS setup error -256On Wed, Oct 13, 2010 at 5:14 PM, Tanin <fanqielee at gmail.com> wrote:> Oh, I check the dmesg, it contains some error infomation. Do you know > > [tanli at localhost ~]$ dmesg|grep error > hdc: drive_cmd: error=0x04 { AbortedCommand } > LustreError: 4799:0:(obd_mount.c:481:lustre_start_simple()) MGS setup error -256 > LustreError: 6774:0:(obd_mount.c:481:lustre_start_simple()) MGS setup error -256 > LustreError: 6977:0:(obd_mount.c:481:lustre_start_simple()) MGS setup error -256 > > > On Tue, Oct 12, 2010 at 1:44 AM, Johann Lombardi > <johann.lombardi at oracle.com> wrote: >> On Oct 12, 2010, at 1:59 AM, Tanin wrote: >>> >>> [root at localhost Desktop]# ?mount -t lustre /dev/vg02/mdt ?/mdt >>> mount.lustre: mount /dev/vg02/mdt at /mdt failed: Unknown error 256 >>> >>> The the two directory do exsit, but the mount can not go through. Can >>> you guys give me some advise? Thanks >> >> I would check the output of dmesg, it likely contains some error messages. >> >> Cheers, >> Johann >> > > > > -- > -- > Li, Tan > PhD Student & Teaching Assistant, > Electrical Engineering, > Stony Brook University, NY > > Personal Web Site: https://sites.google.com/site/homepagelitan/Home > > Email: fanqielee at gmail.com >-- -- Li, Tan PhD Student & Teaching Assistant, Electrical Engineering, Stony Brook University, NY Personal Web Site: https://sites.google.com/site/homepagelitan/Home Email: fanqielee at gmail.com
Colin Faber
2010-Oct-13 21:54 UTC
[Lustre-discuss] mount error when install lustre Metadata
Hi, When you created the mdt did you make sure to specify --mgs as well? -cf On 10/13/2010 03:15 PM, Tanin wrote:> Oh, I check the dmesg, it contains some error infomation. Do you guys > know what is the problem? Thanks > > LustreError: 4799:0:(obd_mount.c:481:lustre_start_simple()) MGS setup > error -256 > LustreError: 6774:0:(obd_mount.c:481:lustre_start_simple()) MGS setup > error -256 > LustreError: 6977:0:(obd_mount.c:481:lustre_start_simple()) MGS setup > error -256On Wed, Oct 13, 2010 at 5:14 PM, Tanin<fanqielee at gmail.com> > wrote: > >> Oh, I check the dmesg, it contains some error infomation. Do you know >> >> [tanli at localhost ~]$ dmesg|grep error >> hdc: drive_cmd: error=0x04 { AbortedCommand } >> LustreError: 4799:0:(obd_mount.c:481:lustre_start_simple()) MGS setup error -256 >> LustreError: 6774:0:(obd_mount.c:481:lustre_start_simple()) MGS setup error -256 >> LustreError: 6977:0:(obd_mount.c:481:lustre_start_simple()) MGS setup error -256 >> >> >> On Tue, Oct 12, 2010 at 1:44 AM, Johann Lombardi >> <johann.lombardi at oracle.com> wrote: >> >>> On Oct 12, 2010, at 1:59 AM, Tanin wrote: >>> >>>> [root at localhost Desktop]# mount -t lustre /dev/vg02/mdt /mdt >>>> mount.lustre: mount /dev/vg02/mdt at /mdt failed: Unknown error 256 >>>> >>>> The the two directory do exsit, but the mount can not go through. Can >>>> you guys give me some advise? Thanks >>>> >>> I would check the output of dmesg, it likely contains some error messages. >>> >>> Cheers, >>> Johann >>> >>> >> >> >> -- >> -- >> Li, Tan >> PhD Student& Teaching Assistant, >> Electrical Engineering, >> Stony Brook University, NY >> >> Personal Web Site: https://sites.google.com/site/homepagelitan/Home >> >> Email: fanqielee at gmail.com >> >> > > >
yes, I have specified it. And I check with other emails for this question. When I set the SELINUX option in file "/etc/sysconfig/selinux" to "disable", it can mount successfully. Thanks a lot for your help, guys! On Wed, Oct 13, 2010 at 5:54 PM, Colin Faber <cfaber at gmail.com> wrote:> Hi, > > When you created the mdt did you make sure to specify --mgs as well? > > -cf > > On 10/13/2010 03:15 PM, Tanin wrote: >> >> Oh, I check the dmesg, it contains some error infomation. Do you guys >> know what is the problem? Thanks >> >> ?LustreError: 4799:0:(obd_mount.c:481:lustre_start_simple()) MGS setup >> error -256 >> ?LustreError: 6774:0:(obd_mount.c:481:lustre_start_simple()) MGS setup >> error -256 >> ?LustreError: 6977:0:(obd_mount.c:481:lustre_start_simple()) MGS setup >> error -256On Wed, Oct 13, 2010 at 5:14 PM, Tanin<fanqielee at gmail.com> >> wrote: >> >>> >>> Oh, I check the dmesg, it contains some error infomation. Do you know >>> >>> [tanli at localhost ~]$ dmesg|grep error >>> hdc: drive_cmd: error=0x04 { AbortedCommand } >>> LustreError: 4799:0:(obd_mount.c:481:lustre_start_simple()) MGS setup >>> error -256 >>> LustreError: 6774:0:(obd_mount.c:481:lustre_start_simple()) MGS setup >>> error -256 >>> LustreError: 6977:0:(obd_mount.c:481:lustre_start_simple()) MGS setup >>> error -256 >>> >>> >>> On Tue, Oct 12, 2010 at 1:44 AM, Johann Lombardi >>> <johann.lombardi at oracle.com> ?wrote: >>> >>>> >>>> On Oct 12, 2010, at 1:59 AM, Tanin wrote: >>>> >>>>> >>>>> [root at localhost Desktop]# ?mount -t lustre /dev/vg02/mdt ?/mdt >>>>> mount.lustre: mount /dev/vg02/mdt at /mdt failed: Unknown error 256 >>>>> >>>>> The the two directory do exsit, but the mount can not go through. Can >>>>> you guys give me some advise? Thanks >>>>> >>>> >>>> I would check the output of dmesg, it likely contains some error >>>> messages. >>>> >>>> Cheers, >>>> Johann >>>> >>>> >>> >>> >>> -- >>> -- >>> Li, Tan >>> PhD Student& ?Teaching Assistant, >>> Electrical Engineering, >>> Stony Brook University, NY >>> >>> Personal Web Site: https://sites.google.com/site/homepagelitan/Home >>> >>> Email: fanqielee at gmail.com >>> >>> >> >> >> > >-- -- Li, Tan PhD Student & Teaching Assistant, Electrical Engineering, Stony Brook University, NY Personal Web Site: https://sites.google.com/site/homepagelitan/Home Email: fanqielee at gmail.com