hi, I have a host (Dell R730) with both cards, connected to an HP8200 switch at 10Gb. when writing to the same storage (netapp) this is what I get: ix0: ~130MGB/s mlxen0 ~330MGB/s this is via nfs/tcpv3 I can get similar (bad) performance with the mellanox if I increase the file size to 512MGB. so at face value, it seems the mlxen does a better use of resources than the intel. Any ideas how to improve ix/intel?s performance? cheers, dnny
On Mon, Aug 17, 2015 at 10:27:41AM +0300, Daniel Braniss wrote:> hi, > I have a host (Dell R730) with both cards, connected to an HP8200 switch at 10Gb. > when writing to the same storage (netapp) this is what I get: > ix0: ~130MGB/s > mlxen0 ~330MGB/s > this is via nfs/tcpv3 > > I can get similar (bad) performance with the mellanox if I increase the file size > to 512MGB.Look like mellanox have internal beffer for caching and do ACK acclerating.> so at face value, it seems the mlxen does a better use of resources than the intel. > Any ideas how to improve ix/intel's performance?Are you sure about netapp performance?
On Mon, Aug 17, 2015 at 10:27:41AM +0300, Daniel Braniss wrote:> hi, > I have a host (Dell R730) with both cards, connected to an HP8200 switch at 10Gb. > when writing to the same storage (netapp) this is what I get: > ix0: ~130MGB/s > mlxen0 ~330MGB/s > this is via nfs/tcpv3 > > I can get similar (bad) performance with the mellanox if I increase the file size > to 512MGB. > so at face value, it seems the mlxen does a better use of resources than the intel. > Any ideas how to improve ix/intel's performance?Any way, please show OS version /var/run/dmesg.boot What's tuning perfomed (loader.conf, sysctl.conf)? top -PHS in both cases ifconfig -a in both cases netstat -rn in both cases I am don't know netapp -- what is hardware configuration (disks and etc) and software tuning (MTU?).