On Mon, Aug 17, 2015 at 10:27:41AM +0300, Daniel Braniss wrote:> hi, > I have a host (Dell R730) with both cards, connected to an HP8200 switch at 10Gb. > when writing to the same storage (netapp) this is what I get: > ix0: ~130MGB/s > mlxen0 ~330MGB/s > this is via nfs/tcpv3 > > I can get similar (bad) performance with the mellanox if I increase the file size > to 512MGB.Look like mellanox have internal beffer for caching and do ACK acclerating.> so at face value, it seems the mlxen does a better use of resources than the intel. > Any ideas how to improve ix/intel's performance?Are you sure about netapp performance?
> On Aug 17, 2015, at 12:41 PM, Slawa Olhovchenkov <slw at zxy.spb.ru> wrote: > > On Mon, Aug 17, 2015 at 10:27:41AM +0300, Daniel Braniss wrote: > >> hi, >> I have a host (Dell R730) with both cards, connected to an HP8200 switch at 10Gb. >> when writing to the same storage (netapp) this is what I get: >> ix0: ~130MGB/s >> mlxen0 ~330MGB/s >> this is via nfs/tcpv3 >> >> I can get similar (bad) performance with the mellanox if I increase the file size >> to 512MGB. > > Look like mellanox have internal beffer for caching and do ACK acclerating.what ever they are doing, it?s impressive :-)> >> so at face value, it seems the mlxen does a better use of resources than the intel. >> Any ideas how to improve ix/intel's performance? > > Are you sure about netapp performance?yes, and why should it act differently if the request is coming from the same host? in any case the numbers are quiet consistent since I have measured it from several hosts, and at different times. danny
FYI, I can regularly hit 9.3 Gib/s with my Intel X520-DA2's and FreeBSD 10.1. Before 10.1 it was less. I used to tweak the card settings, but now it's just stock. You may want to check your settings, the Mellanox may just have better defaults for your switch. On Mon, Aug 17, 2015 at 6:41 AM, Slawa Olhovchenkov <slw at zxy.spb.ru> wrote:> On Mon, Aug 17, 2015 at 10:27:41AM +0300, Daniel Braniss wrote: > > > hi, > > I have a host (Dell R730) with both cards, connected to an HP8200 > switch at 10Gb. > > when writing to the same storage (netapp) this is what I get: > > ix0: ~130MGB/s > > mlxen0 ~330MGB/s > > this is via nfs/tcpv3 > > > > I can get similar (bad) performance with the mellanox if I > increase the file size > > to 512MGB. > > Look like mellanox have internal beffer for caching and do ACK acclerating. > > > so at face value, it seems the mlxen does a better use of > resources than the intel. > > Any ideas how to improve ix/intel's performance? > > Are you sure about netapp performance? > _______________________________________________ > freebsd-net at freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe at freebsd.org" >