Götz Reinicke - IT-Koordinator
2009-Oct-14 06:14 UTC
[CentOS] Best practice settings for channel bonding interface mode?
Hi, may be there are some best practice suggestions for the "best mode" for channel bonding interface? Or in other words, when should/would I use which mode? E.g. I do have some fileservers connected to the users lan and to some ISCSI Storages. Or some Webservers only connected to the LAN. The switches are all new cisco models. I've read sone docs (1), (2) and (3) so the theory is mostly clear. Thanks for any suggestion or hint, Best regards, G?tz (1) http://www.linuxhorizon.ro/bonding.html (2) http://www.linuxtopia.org/online_books/rhel5/rhel5_administration/rhel5_s1-networkscripts-interfaces.html#s2-networkscripts-interfaces-chan (3) http://www.linuxtopia.org/online_books/rhel5/rhel5_administration/rhel5_s1-modules-ethernet.html#s2-modules-bonding -- G?tz Reinicke IT-Koordinator Tel. +49 7141 969 420 Fax +49 7141 969 55 420 E-Mail goetz.reinicke at filmakademie.de Filmakademie Baden-W?rttemberg GmbH Akademiehof 10 71638 Ludwigsburg www.filmakademie.de Eintragung Amtsgericht Stuttgart HRB 205016 Vorsitzende des Aufsichtsrats: Prof. Dr. Claudia H?bner Staatsr?tin f?r Demographischen Wandel und f?r Senioren im Staatsministerium Gesch?ftsf?hrer: Prof. Thomas Schadt
Joseph L. Casale
2009-Oct-14 12:55 UTC
[CentOS] Best practice settings for channel bonding interface mode?
>E.g. I do have some fileservers connected to the users lan and to some >ISCSI Storages. Or some Webservers only connected to the LAN. The >switches are all new cisco models.Just as an example, the Microsoft ini recommends against running it through bonded interfaces but suggests to use multipathing instead, something you might want to consider for the iSCSI case.
nate
2009-Oct-14 13:00 UTC
[CentOS] Best practice settings for channel bonding interface mode?
G?tz Reinicke - IT-Koordinator wrote:> E.g. I do have some fileservers connected to the users lan and to some > ISCSI Storages. Or some Webservers only connected to the LAN. The > switches are all new cisco models.For me the only valid bonding modes to use are: - active/backup - 802.3ad If you have systems using iSCSI, I strongly reccomend using dedicated NICs for accessing iSCSI and putting them in VLANs that have jumbo frames enabled, and enable jumbo frames on the iSCSI targets. The nice thing about iSCSI is since it runs on top of TCP you can configure your iSCSI system to use jumbo frames and both standard frame and jumbo frame systems can talk to it because TCP has MTU negotiation(forget what the real name is called). Note that 802.3ad will not provide any higher throughput than 1 link in the bond can do to a single ip/port. It is meant for many:1 improvement in throughput. If you have 802.3ad on the client side and say your iSCSI target uses 802.3ad as well, and everything is GbE, you won't get more than 1GbE of throughput even if you have 8 ports in a bond/trunk. For faster throughput than 1GbE between hosts I suggest going to 10GbaseT, which allows 10GbE speeds on CAT5e up to 55 meters, and CAT6a up to 100 meters. Really makes for cost effective 10GbE. There aren't many 10GbE NICs on the market yet that can use 10GbE over UTP (Chelsio is one vendor that I know of). Active/backup is pretty simple, you typically have 1 link that is active the other is standby, by default if the system detects the first link going down it switches over in about a second or so. nate