Lustre discuss - Apr 2009 - exporting lustre over nfs to osx

Is it possible to mount a lustre file system that''s being exported via
nfs, on a Mac OSX workstation?

I searched through the web, but I''m unable to find any references to
anyone trying it whether successful or failure.

When I try it here on my testbed it mounts fine, but sending any data
causes an input/output error and does not create the file at all.

Can anyone point me to some documentation that shows any quirks on the
implementation that I might have missed?

Thanks

On Tue, 2009-04-21 at 15:59 -0400, Michael Di Domenico
wrote:
> Is it possible to mount a lustre file system that''s being exported
via
> nfs,
Yes.
> on a Mac OSX workstation?
Dunno about that part.  I haven''t done that myself.
> I searched through the web, but I''m unable to find any references
to
> anyone trying it whether successful or failure.
Certainly there is lots of success stories of mounting nfs exported
lustre.  As for the specifically with MacOS X, that''s the unknown.
> When I try it here on my testbed it mounts fine, but sending any data
> causes an input/output error and does not create the file at all.
Do you get any errors on the Lustre client (NFS server)?

b.

-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 197 bytes
Desc: This is a digitally signed message part
Url :
http://lists.lustre.org/pipermail/lustre-discuss/attachments/20090421/2f258254/attachment.bin

On Apr 21, 2009  15:59 -0400, Michael Di Domenico wrote:
> Is it possible to mount a lustre file system that''s being exported
via
> nfs, on a Mac OSX workstation?
Yes, one of our NFS-on-Lustre developers tests this configuration.
There were a number of bugs fixed in the OS/X NFS stack, I don''t
know the details of which OS/X release they were in.  He is currently
on vacation, hopefully he''ll reply when he gets back.
> When I try it here on my testbed it mounts fine, but sending any data
> causes an input/output error and does not create the file at all.
> 
> Can anyone point me to some documentation that shows any quirks on the
> implementation that I might have missed?
Cheers, Andreas
--
Andreas Dilger
Sr. Staff Engineer, Lustre Group
Sun Microsystems of Canada, Inc.

I used finder on the mac to mount the filesystem, but i wouldn''t
expect that to be any different then opening a terminal window and
using the mount command, but i''ll try it

I do see these in /var/log/messages

Apr 21 15:52:19 orange kernel: nfsd: non-standard errno: -43
Apr 21 15:52:19 orange last message repeated 3 times


On 4/21/09, Brian J. Murrell <Brian.Murrell at sun.com>
wrote:
> On Tue, 2009-04-21 at 15:59 -0400, Michael Di Domenico wrote:
>> Is it possible to mount a lustre file system that''s being
exported via
>> nfs,
>
> Yes.
>
>> on a Mac OSX workstation?
>
> Dunno about that part.  I haven''t done that myself.
>
>> I searched through the web, but I''m unable to find any
references to
>> anyone trying it whether successful or failure.
>
> Certainly there is lots of success stories of mounting nfs exported
> lustre.  As for the specifically with MacOS X, that''s the unknown.
>
>> When I try it here on my testbed it mounts fine, but sending any data
>> causes an input/output error and does not create the file at all.
>
> Do you get any errors on the Lustre client (NFS server)?
>
> b.
>
>

I would try using ''mount'' from the command line because you
can try
various options. The ''-P'' (resvport) option may be required to
force
the client to connect using a reserved port number. You will need to  
run ''mount'' as root in order to use this option.

check the man pages for mount and mount_nfs on your mac.

------
Yemi

On Apr 21, 2009, at 1:29 PM, Michael Di Domenico wrote:
> I used finder on the mac to mount the filesystem, but i wouldn''t
> expect that to be any different then opening a terminal window and
> using the mount command, but i''ll try it
>
> I do see these in /var/log/messages
>
> Apr 21 15:52:19 orange kernel: nfsd: non-standard errno: -43
> Apr 21 15:52:19 orange last message repeated 3 times
>
>
> On 4/21/09, Brian J. Murrell <Brian.Murrell at sun.com> wrote:
>> On Tue, 2009-04-21 at 15:59 -0400, Michael Di Domenico wrote:
>>> Is it possible to mount a lustre file system that''s being
exported
>>> via
>>> nfs,
>>
>> Yes.
>>
>>> on a Mac OSX workstation?
>>
>> Dunno about that part.  I haven''t done that myself.
>>
>>> I searched through the web, but I''m unable to find any
references to
>>> anyone trying it whether successful or failure.
>>
>> Certainly there is lots of success stories of mounting nfs exported
>> lustre.  As for the specifically with MacOS X, that''s the
unknown.
>>
>>> When I try it here on my testbed it mounts fine, but sending any  
>>> data
>>> causes an input/output error and does not create the file at all.
>>
>> Do you get any errors on the Lustre client (NFS server)?
>>
>> b.
>>
>>
> _______________________________________________
> Lustre-discuss mailing list
> Lustre-discuss at lists.lustre.org
> http://lists.lustre.org/mailman/listinfo/lustre-discuss

yes, using mount from terminal does seem to work just fine without options.
 i would have liked to use the finder to mount, but it works so far. 
i''ll
keep testing though
On Tue, Apr 21, 2009 at 4:35 PM, Adeyemi Adesanya <yemi at
slac.stanford.edu>wrote:
>
> I would try using ''mount'' from the command line because
you can try various
> options. The ''-P'' (resvport) option may be required to
force the client to
> connect using a reserved port number. You will need to run
''mount'' as root
> in order to use this option.
>
> check the man pages for mount and mount_nfs on your mac.
>
> ------
> Yemi
>
>
> On Apr 21, 2009, at 1:29 PM, Michael Di Domenico wrote:
>
>  I used finder on the mac to mount the filesystem, but i wouldn''t
>> expect that to be any different then opening a terminal window and
>> using the mount command, but i''ll try it
>>
>> I do see these in /var/log/messages
>>
>> Apr 21 15:52:19 orange kernel: nfsd: non-standard errno: -43
>> Apr 21 15:52:19 orange last message repeated 3 times
>>
>>
>> On 4/21/09, Brian J. Murrell <Brian.Murrell at sun.com> wrote:
>>
>>> On Tue, 2009-04-21 at 15:59 -0400, Michael Di Domenico wrote:
>>>
>>>> Is it possible to mount a lustre file system that''s
being exported via
>>>> nfs,
>>>>
>>>
>>> Yes.
>>>
>>>  on a Mac OSX workstation?
>>>>
>>>
>>> Dunno about that part.  I haven''t done that myself.
>>>
>>>  I searched through the web, but I''m unable to find any
references to
>>>> anyone trying it whether successful or failure.
>>>>
>>>
>>> Certainly there is lots of success stories of mounting nfs exported
>>> lustre.  As for the specifically with MacOS X, that''s the
unknown.
>>>
>>>  When I try it here on my testbed it mounts fine, but sending any
data
>>>> causes an input/output error and does not create the file at
all.
>>>>
>>>
>>> Do you get any errors on the Lustre client (NFS server)?
>>>
>>> b.
>>>
>>>
>>>  _______________________________________________
>> Lustre-discuss mailing list
>> Lustre-discuss at lists.lustre.org
>> http://lists.lustre.org/mailman/listinfo/lustre-discuss
>>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
http://lists.lustre.org/pipermail/lustre-discuss/attachments/20090421/a0a1a0ab/attachment.html

it seems that everything is working, so long as i''m root.  when i try
to do
operations on the nfs share as a regular user i''m getting i/o errors,
both
cmdline and through the finder.
i created a directory as root and then chown''d it my user, switched to
my
user in another terminal window and tried to touch a file

this seems to pop up in /var/log/messages on the nfs server

Apr 21 16:54:25 orange kernel: LustreError: 9357:0:(dir.c:384:ll_readdir())
error reading dir 95641/3917193484 page 0: rc -43
Apr 21 16:54:25 orange kernel: nfsd: non-standard errno: -43


On Tue, Apr 21, 2009 at 4:51 PM, Michael Di Domenico <mdidomenico4 at
gmail.com
> wrote:
> yes, using mount from terminal does seem to work just fine without options.
>  i would have liked to use the finder to mount, but it works so far. 
i''ll
> keep testing though
>
> On Tue, Apr 21, 2009 at 4:35 PM, Adeyemi Adesanya <yemi at
slac.stanford.edu>wrote:
>
>>
>> I would try using ''mount'' from the command line
because you can try
>> various options. The ''-P'' (resvport) option may be
required to force the
>> client to connect using a reserved port number. You will need to run
''mount''
>> as root in order to use this option.
>>
>> check the man pages for mount and mount_nfs on your mac.
>>
>> ------
>> Yemi
>>
>>
>> On Apr 21, 2009, at 1:29 PM, Michael Di Domenico wrote:
>>
>>  I used finder on the mac to mount the filesystem, but i
wouldn''t
>>> expect that to be any different then opening a terminal window and
>>> using the mount command, but i''ll try it
>>>
>>> I do see these in /var/log/messages
>>>
>>> Apr 21 15:52:19 orange kernel: nfsd: non-standard errno: -43
>>> Apr 21 15:52:19 orange last message repeated 3 times
>>>
>>>
>>> On 4/21/09, Brian J. Murrell <Brian.Murrell at sun.com>
wrote:
>>>
>>>> On Tue, 2009-04-21 at 15:59 -0400, Michael Di Domenico wrote:
>>>>
>>>>> Is it possible to mount a lustre file system
that''s being exported via
>>>>> nfs,
>>>>>
>>>>
>>>> Yes.
>>>>
>>>>  on a Mac OSX workstation?
>>>>>
>>>>
>>>> Dunno about that part.  I haven''t done that myself.
>>>>
>>>>  I searched through the web, but I''m unable to find
any references to
>>>>> anyone trying it whether successful or failure.
>>>>>
>>>>
>>>> Certainly there is lots of success stories of mounting nfs
exported
>>>> lustre.  As for the specifically with MacOS X, that''s
the unknown.
>>>>
>>>>  When I try it here on my testbed it mounts fine, but sending
any data
>>>>> causes an input/output error and does not create the file
at all.
>>>>>
>>>>
>>>> Do you get any errors on the Lustre client (NFS server)?
>>>>
>>>> b.
>>>>
>>>>
>>>>  _______________________________________________
>>> Lustre-discuss mailing list
>>> Lustre-discuss at lists.lustre.org
>>> http://lists.lustre.org/mailman/listinfo/lustre-discuss
>>>
>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
http://lists.lustre.org/pipermail/lustre-discuss/attachments/20090421/7928f7ac/attachment-0001.html

On Apr 21, 2009  16:56 -0400, Michael Di Domenico wrote:
> it seems that everything is working, so long as i''m root.  when i
try to do
> operations on the nfs share as a regular user i''m getting i/o
errors, both
> cmdline and through the finder.
> i created a directory as root and then chown''d it my user,
switched to my
> user in another terminal window and tried to touch a file
> 
> this seems to pop up in /var/log/messages on the nfs server
> 
> Apr 21 16:54:25 orange kernel: LustreError: 9357:0:(dir.c:384:ll_readdir())
> error reading dir 95641/3917193484 page 0: rc -43
> Apr 21 16:54:25 orange kernel: nfsd: non-standard errno: -43
-43 = Linux errno -EIDRM, which means that the UID/GID on your mac does not
match any known UID/GID on the MDS.  You need to update /etc/hosts and
/etc/group on the MDS to add your user.  There are lots of past postings
about EIDRM if you are interested in the details.

Alternately, in the past I''ve updated the UID/GID on my Mac, with
careful
use of the ldap tool, but I don''t recall the details (I found it on a
Mac
site via Google).  I created a temporary Admin account, updated the Mac
LDAP for my main user account to reflect the new UID/GID I wanted, then
did "find -uid {olduid} -print0 /my/home/dir | xargs -0 chown
{newuid}",
and the same for the GID.

Please update the list on your results, so that it will be in the archive
for future reference.
> On Tue, Apr 21, 2009 at 4:51 PM, Michael Di Domenico <mdidomenico4 at
gmail.com
> > wrote:
> 
> > yes, using mount from terminal does seem to work just fine without
options.
> >  i would have liked to use the finder to mount, but it works so far. 
i''ll
> > keep testing though
> >
> > On Tue, Apr 21, 2009 at 4:35 PM, Adeyemi Adesanya <yemi at
slac.stanford.edu>wrote:
> >
> >>
> >> I would try using ''mount'' from the command line
because you can try
> >> various options. The ''-P'' (resvport) option may
be required to force the
> >> client to connect using a reserved port number. You will need to
run ''mount''
> >> as root in order to use this option.
> >>
> >> check the man pages for mount and mount_nfs on your mac.
> >>
> >> ------
> >> Yemi
> >>
> >>
> >> On Apr 21, 2009, at 1:29 PM, Michael Di Domenico wrote:
> >>
> >>  I used finder on the mac to mount the filesystem, but i
wouldn''t
> >>> expect that to be any different then opening a terminal window
and
> >>> using the mount command, but i''ll try it
> >>>
> >>> I do see these in /var/log/messages
> >>>
> >>> Apr 21 15:52:19 orange kernel: nfsd: non-standard errno: -43
> >>> Apr 21 15:52:19 orange last message repeated 3 times
> >>>
> >>>
> >>> On 4/21/09, Brian J. Murrell <Brian.Murrell at sun.com>
wrote:
> >>>
> >>>> On Tue, 2009-04-21 at 15:59 -0400, Michael Di Domenico
wrote:
> >>>>
> >>>>> Is it possible to mount a lustre file system
that''s being exported via
> >>>>> nfs,
> >>>>>
> >>>>
> >>>> Yes.
> >>>>
> >>>>  on a Mac OSX workstation?
> >>>>>
> >>>>
> >>>> Dunno about that part.  I haven''t done that
myself.
> >>>>
> >>>>  I searched through the web, but I''m unable to
find any references to
> >>>>> anyone trying it whether successful or failure.
> >>>>>
> >>>>
> >>>> Certainly there is lots of success stories of mounting nfs
exported
> >>>> lustre.  As for the specifically with MacOS X,
that''s the unknown.
> >>>>
> >>>>  When I try it here on my testbed it mounts fine, but
sending any data
> >>>>> causes an input/output error and does not create the
file at all.
> >>>>>
> >>>>
> >>>> Do you get any errors on the Lustre client (NFS server)?
> >>>>
> >>>> b.
> >>>>
> >>>>
> >>>>  _______________________________________________
> >>> Lustre-discuss mailing list
> >>> Lustre-discuss at lists.lustre.org
> >>> http://lists.lustre.org/mailman/listinfo/lustre-discuss
> >>>
> >>
> >>
> >
> _______________________________________________
> Lustre-discuss mailing list
> Lustre-discuss at lists.lustre.org
> http://lists.lustre.org/mailman/listinfo/lustre-discuss

Cheers, Andreas
--
Andreas Dilger
Sr. Staff Engineer, Lustre Group
Sun Microsystems of Canada, Inc.

Andreas,
Thanks, that does seem to fix the error.  Fortunately its just a test
environment so i can just create the uid on the lustre servers and off i go,
i dont need to mess around with ldap.

a more descriptive error message would have been nice... :)

On Tue, Apr 21, 2009 at 5:12 PM, Andreas Dilger <adilger at sun.com>
wrote:
> On Apr 21, 2009  16:56 -0400, Michael Di Domenico wrote:
> > it seems that everything is working, so long as i''m root. 
when i try to
> do
> > operations on the nfs share as a regular user i''m getting i/o
errors,
> both
> > cmdline and through the finder.
> > i created a directory as root and then chown''d it my user,
switched to my
> > user in another terminal window and tried to touch a file
> >
> > this seems to pop up in /var/log/messages on the nfs server
> >
> > Apr 21 16:54:25 orange kernel: LustreError:
> 9357:0:(dir.c:384:ll_readdir())
> > error reading dir 95641/3917193484 page 0: rc -43
> > Apr 21 16:54:25 orange kernel: nfsd: non-standard errno: -43
>
> -43 = Linux errno -EIDRM, which means that the UID/GID on your mac does not
> match any known UID/GID on the MDS.  You need to update /etc/hosts and
> /etc/group on the MDS to add your user.  There are lots of past postings
> about EIDRM if you are interested in the details.
>
> Alternately, in the past I''ve updated the UID/GID on my Mac, with
careful
> use of the ldap tool, but I don''t recall the details (I found it
on a Mac
> site via Google).  I created a temporary Admin account, updated the Mac
> LDAP for my main user account to reflect the new UID/GID I wanted, then
> did "find -uid {olduid} -print0 /my/home/dir | xargs -0 chown
{newuid}",
> and the same for the GID.
>
> Please update the list on your results, so that it will be in the archive
> for future reference.
>
> > On Tue, Apr 21, 2009 at 4:51 PM, Michael Di Domenico <
> mdidomenico4 at gmail.com
> > > wrote:
> >
> > > yes, using mount from terminal does seem to work just fine
without
> options.
> > >  i would have liked to use the finder to mount, but it works so
far.
>  i''ll
> > > keep testing though
> > >
> > > On Tue, Apr 21, 2009 at 4:35 PM, Adeyemi Adesanya <
> yemi at slac.stanford.edu>wrote:
> > >
> > >>
> > >> I would try using ''mount'' from the command
line because you can try
> > >> various options. The ''-P'' (resvport) option
may be required to force
> the
> > >> client to connect using a reserved port number. You will need
to run
> ''mount''
> > >> as root in order to use this option.
> > >>
> > >> check the man pages for mount and mount_nfs on your mac.
> > >>
> > >> ------
> > >> Yemi
> > >>
> > >>
> > >> On Apr 21, 2009, at 1:29 PM, Michael Di Domenico wrote:
> > >>
> > >>  I used finder on the mac to mount the filesystem, but i
wouldn''t
> > >>> expect that to be any different then opening a terminal
window and
> > >>> using the mount command, but i''ll try it
> > >>>
> > >>> I do see these in /var/log/messages
> > >>>
> > >>> Apr 21 15:52:19 orange kernel: nfsd: non-standard errno:
-43
> > >>> Apr 21 15:52:19 orange last message repeated 3 times
> > >>>
> > >>>
> > >>> On 4/21/09, Brian J. Murrell <Brian.Murrell at
sun.com> wrote:
> > >>>
> > >>>> On Tue, 2009-04-21 at 15:59 -0400, Michael Di
Domenico wrote:
> > >>>>
> > >>>>> Is it possible to mount a lustre file system
that''s being exported
> via
> > >>>>> nfs,
> > >>>>>
> > >>>>
> > >>>> Yes.
> > >>>>
> > >>>>  on a Mac OSX workstation?
> > >>>>>
> > >>>>
> > >>>> Dunno about that part.  I haven''t done that
myself.
> > >>>>
> > >>>>  I searched through the web, but I''m unable
to find any references
> to
> > >>>>> anyone trying it whether successful or failure.
> > >>>>>
> > >>>>
> > >>>> Certainly there is lots of success stories of
mounting nfs exported
> > >>>> lustre.  As for the specifically with MacOS X,
that''s the unknown.
> > >>>>
> > >>>>  When I try it here on my testbed it mounts fine, but
sending any
> data
> > >>>>> causes an input/output error and does not create
the file at all.
> > >>>>>
> > >>>>
> > >>>> Do you get any errors on the Lustre client (NFS
server)?
> > >>>>
> > >>>> b.
> > >>>>
> > >>>>
> > >>>>  _______________________________________________
> > >>> Lustre-discuss mailing list
> > >>> Lustre-discuss at lists.lustre.org
> > >>> http://lists.lustre.org/mailman/listinfo/lustre-discuss
> > >>>
> > >>
> > >>
> > >
>
> > _______________________________________________
> > Lustre-discuss mailing list
> > Lustre-discuss at lists.lustre.org
> > http://lists.lustre.org/mailman/listinfo/lustre-discuss
>
>
> Cheers, Andreas
> --
> Andreas Dilger
> Sr. Staff Engineer, Lustre Group
> Sun Microsystems of Canada, Inc.
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
http://lists.lustre.org/pipermail/lustre-discuss/attachments/20090421/fcb980e0/attachment.html

Hello!

On Apr 21, 2009, at 4:29 PM, Andreas Dilger wrote:
> Yes, one of our NFS-on-Lustre developers tests this configuration.
> There were a number of bugs fixed in the OS/X NFS stack, I don''t
> know the details of which OS/X release they were in.  He is currently
> on vacation, hopefully he''ll reply when he gets back.
Actually, I mostly use it the other way around (osx nfs exports (non  
lustre,
obviously), Linux mounts the nfs). That''s where the bugs in osx nfsd  
were
fixed.

Bye,
     Oleg