We upgraded from a 10/100Mbs to a 2 100/1000 bonding. We notice the speeds of NFS to be around 70-80Mb/sec. Which is slow, especially with bonding. I was wondering if we need to tune anything special with the Network and NFS. Does anyone have any experience with this? TIA
Mag Gam wrote:> We upgraded from a 10/100Mbs to a 2 100/1000 bonding. We notice the > speeds of NFS to be around 70-80Mb/sec. Which is slow, especially with > bonding. I was wondering if we need to tune anything special with the > Network and NFS. Does anyone have any experience with this? >my general experience is that Linux has a rather poor implementation of NFS server. Solaris works much better as a NFS server.
Mag Gam wrote:> We upgraded from a 10/100Mbs to a 2 100/1000 bonding. We notice the > speeds of NFS to be around 70-80Mb/sec. Which is slow, especially with > bonding. I was wondering if we need to tune anything special with the > Network and NFS. Does anyone have any experience with this?What kind of test are you running? How many clients vs servers? If you have 1 client and 1 server you won't use more than 1 NIC with bonding. Because bonding operates based on source/destination MAC or IP addresses (some bonding can take into account layer 4 ports as well). I just ran a really simple test on my home network between two debian systems on a gigE network(no bonding). No special tuning at all. Just a 'dd' write test. To local disk I got 198MB/sec, to the NFS volume (same controller, disks, OS, kernel on the other end) I got 29MB/sec(232Mbit). This was for 410MB of data, on oldish systems(new HDDs, 3 year old raid cards and 3year old systems). Running an iperf test to test raw network throughput I get 940Mbit. (Intel E1000 on each end, with a Linksys in between) But as another poster noted, NFS under linux isn't that great. My company uses a BlueArc for their NFS needs, it works well (fastest NAS in the world I think). Though the model we have is pretty old and is going end of life soon. I certainly would never use Linux for any *really* serious NFS use. Casual stuff, fine.. nate
On Wednesday 30 July 2008 05:20:10 Mag Gam wrote:> We upgraded from a 10/100Mbs to a 2 100/1000 bonding. We notice the > speeds of NFS to be around 70-80Mb/sec. Which is slow, especially with > bonding. I was wondering if we need to tune anything special with the > Network and NFS. Does anyone have any experience with this? > > TIA > _______________________________________________ > CentOS mailing list > CentOS at centos.org > http://lists.centos.org/mailman/listinfo/centosDid you configure the bonding like it should be? Cause configuring a loadbalanced bonding (which I suppose you're using) is not at all an easy task. For example if you are using rr bonding the switch where the nfsserver is connected to has to channel the ports the nfs-server is connected to. And much more. I would recheck bonding. Test how fast it is with only one nic in the bond and the like. But first of all read the bonding.txt which comes along with the kernel-docs or can be found here: http://www.mjmwired.net/kernel/Documentation/networking/bonding.txt -- Gruss / Regards, Marc Grimme http://www.atix.de/ http://www.open-sharedroot.org/
Mag Gam wrote on Tue, 29 Jul 2008 23:20:10 -0400:> 70-80Mb/sec.Mb or MB? Kai -- Kai Sch?tzl, Berlin, Germany Get your web at Conactive Internet Services: http://www.conactive.com
70-80MB/s is good for NFS/CIFS networking given the 4k block size and network latency. It's not the MB/s driven by your storage system that get you it's the IOPS throttled by the network latency and two-way communication over it. -Ross ----- Original Message ----- From: centos-bounces at centos.org <centos-bounces at centos.org> To: CentOS mailing list <centos at centos.org> Sent: Tue Jul 29 23:20:10 2008 Subject: [CentOS] slow NFS speed We upgraded from a 10/100Mbs to a 2 100/1000 bonding. We notice the speeds of NFS to be around 70-80Mb/sec. Which is slow, especially with bonding. I was wondering if we need to tune anything special with the Network and NFS. Does anyone have any experience with this? TIA _______________________________________________ CentOS mailing list CentOS at centos.org http://lists.centos.org/mailman/listinfo/centos ______________________________________________________________________ This e-mail, and any attachments thereto, is intended only for use by the addressee(s) named herein and may contain legally privileged and/or confidential information. If you are not the intended recipient of this e-mail, you are hereby notified that any dissemination, distribution or copying of this e-mail, and any attachments thereto, is strictly prohibited. If you have received this e-mail in error, please immediately notify the sender and permanently delete the original and any copy or printout thereof. -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.centos.org/pipermail/centos/attachments/20080730/a68fbfcf/attachment-0001.html>