Hi. Could someone recommend a decent 40Gbit adapter that are proven to be working under FreeBSD ? The intended purpose - iSCSI traffic, not much pps, but rates definitely above 10G. I've tried Supermicro-manufactured Intel XL710 ones (two boards, different servers - same sad story: packets loss, server unresponsive, spikes), seems like they have a problem in a driver (or firmware), and though Intel support states this is because the Supermicro tampered with the adapter, I'm still suspicious about ixl(4). I've also seen in the ML a guy reported the exact same problem with ixl(4) as I have found. So, what would you say ? Chelsio ? Thanks. Eugene.
On 01/18/17 10:48, Eugene M. Zheganin wrote:> Hi. > > Could someone recommend a decent 40Gbit adapter that are proven to be > working under FreeBSD ? The intended purpose - iSCSI traffic, not much > pps, but rates definitely above 10G. I've tried Supermicro-manufactured > Intel XL710 ones (two boards, different servers - same sad story: > packets loss, server unresponsive, spikes), seems like they have a > problem in a driver (or firmware), and though Intel support states this > is because the Supermicro tampered with the adapter, I'm still > suspicious about ixl(4). I've also seen in the ML a guy reported the > exact same problem with ixl(4) as I have found. > > So, what would you say ? Chelsio ? >Hi, I think also the Mellanox, mlx4 and mlx5 drivers will support this. Are you using infiniband or TCP for backend? --HPS
On 01/18/2017 12:48 PM, Eugene M. Zheganin wrote:> Hi. > > Could someone recommend a decent 40Gbit adapter that are proven to be > working under FreeBSD ? The intended purpose - iSCSI traffic, not much > pps, but rates definitely above 10G. I've tried Supermicro-manufactured > Intel XL710 ones (two boards, different servers - same sad story: > packets loss, server unresponsive, spikes), seems like they have a > problem in a driver (or firmware), and though Intel support states this > is because the Supermicro tampered with the adapter, I'm still > suspicious about ixl(4). I've also seen in the ML a guy reported the > exact same problem with ixl(4) as I have found. > > So, what would you say ? Chelsio ?Hi, Solarflare SFN8542 with sfxge driver will do the job Andrew.> Thanks. > Eugene. > > _______________________________________________ > freebsd-net at freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe at freebsd.org"
On Wed, Jan 18, 2017 at 02:48:19PM +0500, Eugene M. Zheganin wrote:> Hi. > > Could someone recommend a decent 40Gbit adapter that are proven to be > working under FreeBSD ? The intended purpose - iSCSI traffic, not much > pps, but rates definitely above 10G. I've tried Supermicro-manufactured > Intel XL710 ones (two boards, different servers - same sad story: > packets loss, server unresponsive, spikes), seems like they have a > problem in a driver (or firmware), and though Intel support states this > is because the Supermicro tampered with the adapter, I'm still > suspicious about ixl(4). I've also seen in the ML a guy reported the > exact same problem with ixl(4) as I have found. > > So, what would you say ? Chelsio ?I am use Chelsio and Solarflare. Not sure about you workload -- I am have 40K+ TCP connections, you workload need different tuning. Do you planed to utilise both ports? For this case you need PCIe 16x card. This is Chelsio T6 and Solarflare 9200.
On 0118T1448, Eugene M. Zheganin wrote:> Hi. > > Could someone recommend a decent 40Gbit adapter that are proven to be > working under FreeBSD ? The intended purpose - iSCSI traffic, not much > pps, but rates definitely above 10G. I've tried Supermicro-manufactured > Intel XL710 ones (two boards, different servers - same sad story: > packets loss, server unresponsive, spikes), seems like they have a > problem in a driver (or firmware), and though Intel support states this > is because the Supermicro tampered with the adapter, I'm still > suspicious about ixl(4). I've also seen in the ML a guy reported the > exact same problem with ixl(4) as I have found. > > So, what would you say ? Chelsio ?I'd say Chelsio; it's very well supported, it's actively involved in FreeBSD development, and there's hardware-specific iSCSI offload for it (cxgbei).