Just wondering if anybody is successfully NFS exporting their lustre filesystem. I''m also curious to hear about experiences doing this. I tried this back with some of the early 1.6 releases and ended up with the lustre nfs exports freezing after a few minutes of heavy i/o and having to reboot the nfs server for activity to resume.
On 2009-12-30, at 20:15, Aaron Knister wrote:> Just wondering if anybody is successfully NFS exporting their lustre > filesystem. I''m also curious to hear about experiences doing this. I > tried this back with some of the early 1.6 releases and ended up with > the lustre nfs exports freezing after a few minutes of heavy i/o and > having to reboot the nfs server for activity to resume.I don''t do this in any serious capacity, but I use NFS re-export to share my music collection to the Mac clients in my house without trouble. Cheers, Andreas -- Andreas Dilger Sr. Staff Engineer, Lustre Group Sun Microsystems of Canada, Inc.
Under lustre 1.6.4.3 we have to use the single threaded user space nfsd in order to not lock up our OSSs. As you may expect, the performance is not very good. The kernel nfsd works fine for us so far in our 1.8 testing. -----Original Message----- From: lustre-discuss-bounces at lists.lustre.org [mailto:lustre-discuss-bounces at lists.lustre.org] On Behalf Of Aaron Knister Sent: Wednesday, December 30, 2009 10:16 PM To: lustre-discuss at lists.lustre.org Subject: [Lustre-discuss] NFS re-exporting lustre Just wondering if anybody is successfully NFS exporting their lustre filesystem. I''m also curious to hear about experiences doing this. I tried this back with some of the early 1.6 releases and ended up with the lustre nfs exports freezing after a few minutes of heavy i/o and having to reboot the nfs server for activity to resume. _______________________________________________ Lustre-discuss mailing list Lustre-discuss at lists.lustre.org http://lists.lustre.org/mailman/listinfo/lustre-discuss IMPORTANT: The information contained in this email and/or its attachments is confidential. If you are not the intended recipient, please notify the sender immediately by reply and immediately delete this message and all its attachments. Any review, use, reproduction, disclosure or dissemination of this message or any attachment by an unintended recipient is strictly prohibited. Neither this message nor any attachment is intended as or should be construed as an offer, solicitation or recommendation to buy or sell any security or other financial instrument. Neither the sender, his or her employer nor any of their respective affiliates makes any warranties as to the completeness or accuracy of any of the information contained herein or that this message or any of its attachments is free of viruses.
Aaron Knister wrote:> Just wondering if anybody is successfully NFS exporting their lustre > filesystem. I''m also curious to hear about experiences doing this. I > tried this back with some of the early 1.6 releases and ended up with > the lustre nfs exports freezing after a few minutes of heavy i/o and > having to reboot the nfs server for activity to resume.Yes, we NFS export our Lustre file system without too much problems. We certainly don''t have to reboot the NFS server. This is with RHEL5 and Lustre 1.6.6 (and 1.6.7.2) on the NFS servers. I''m not sure if our usage counts as heavy i/o, but some of our detectors write via NFS and we reach transfer rates of 20-40MB/s over 1Gig ethernet without problems when both Lustre and NFS traffic use the same 1G NIC. We also use NFS server to export the file system to our workstations and have not noticed any stability problems. We use the (RHEL default) kernel NFSd. If you check the archives you''ll find a message from me about soft lockups on NFS but I later discovered that it seems samba in combination with a kernel bug was to blame for that as we''ve never seen these issues on a NFS server that was not also samba server. Hope this helps, feel free to ask for more details if you want to know more. Regards, Frederik -- Frederik Ferner Computer Systems Administrator phone: +44 1235 77 8624 Diamond Light Source Ltd. mob: +44 7917 08 5110 (Apologies in advance for the lines below. Some bits are a legal requirement and I have no control over them.)