ABOKHALAF, Nassri Abdellatif
2006-Jan-12 17:15 UTC
[CentOS] Broadcom NIC Binding under Centos 4.2
Hello all, I'm having unusual difficulty configuring teaming with Centos 4.2. The 2 NIC's are Broadcom. The HW is HP DL360 and there is no teaming driver for RHEL4 since it comes with package (says HP). Since there is no teaming driver from centos (as far as I know), I tried the Broadcom Driver, configured the team file, but the team just wont come up. A Virtual Interface should be up but only eth0 & eth1 appear. I fell really stupid because with Intel this is pretty straightforward. Any clues, any suggestions, Nassri
On Thu, 12 Jan 2006, ABOKHALAF, Nassri Abdellatif wrote:> Hello all, > > I'm having unusual difficulty configuring teaming with Centos 4.2. > > The 2 NIC's are Broadcom. The HW is HP DL360 and there is no teaming > driver for RHEL4 since it comes with package (says HP). > > Since there is no teaming driver from centos (as far as I know), I tried > the Broadcom Driver, configured the team file, but the team just wont > come up. A Virtual Interface should be up but only eth0 & eth1 appear. > > I fell really stupid because with Intel this is pretty straightforward. > > Any clues, any suggestions, >super simple now. linux has the bonding driver/ here is a sample. If you want to use tagged vlans it will be slightly different. Let me know if you want a tagged vlan sample. < /etc/sysconfig/network > NETWORKING=yes HOSTNAME=smtcorms04.samuelmanutech.com VLAN=yes GATEWAY=10.10.0.253 GATEWAYDEV=bond0 < /etc/modprobe.conf > alias bond0 bonding options bonding miimon=100 mode=1 alias eth0 tg3 alias eth1 tg3 < /etc/sysconfig/network-scripts/ifcfg-eth0 > DEVICE=eth0 BOOTPROTO=static TYPE=Ethernet ONBOOT=yes SLAVE=yes MASTER=bond0 < /etc/sysconfig/network-scripts/ifcfg-eth1 > DEVICE=eth1 BOOTPROTO=static TYPE=Ethernet ONBOOT=yes SLAVE=yes MASTER=bond0 < /etc/sysconfig/network-scripts/ifcfg-bond0 > DEVICE=bond0 ONBOOT=yes IPADDR=10.10.4.27 NETMASK=255.255.255.0
ABOKHALAF, Nassri Abdellatif
2006-Jan-12 18:04 UTC
[CentOS] Broadcom NIC Binding under Centos 4.2
Thanks Robin,> > here is a sample. If you want to use tagged vlans it will be > slightly different. Let me know if you want a tagged vlan sample.Looks good ! I will try it right now ! Nassri
ABOKHALAF, Nassri Abdellatif
2006-Jan-13 10:20 UTC
[CentOS] RE: Broadcom NIC Binding under Centos 4.2
Thanks Robin,> here is a sample. If you want to use tagged vlans it will be > slightly different. Let me know if you want a tagged vlan sample.Followed you samples and team is working just fine now. Tested both nics for failover and never lost a ping. One question : Could you configure both interfaces so you could bind bandwith of both interfaces and still have failover? Nassri
ABOKHALAF, Nassri Abdellatif
2006-Jan-13 17:30 UTC
[CentOS] RE: Broadcom NIC Binding under Centos 4.2
Robin,> I have not had time to test this, but the documentation > states that it can be done with some of the other mode=x > numbers, where the mode number represents different types of > bonding ie. round robin, active/standby, etc.. > > Let us know which mode you go with.I'm reading the bonding doc, i'll give a try to the active/active mode, just nedd to make shore that bonding emultates only one MAC addr. Need also to understand if the switch needs to deliver a trunk or just a usual port to my box. I'll come back later with me config. Thanks, Nassri
ABOKHALAF, Nassri Abdellatif
2006-Jan-19 15:25 UTC
[CentOS] RE: Broadcom NIC Binding under Centos 4.2
Hello all, again, Still stocked with this NIC binding problem. With Robin's conf both nics work fine in the active-backup config (thanks Robin !) I wanted to go a little bit further & bind both interfaces in an active-active conf. James pointed out the Documentation/networking/bonding.txt. (thanks James!) It states that there is a HA-mode where both NIC'S can work in active-active mode. I've configured the switch to operate in trunk mode for my VLAN and configured my CENTOS box to aggregate the links, but cannot manage to ping my gateway. All interfaces show the same mac addr what is good but, arp -a shows nothing ! Question: Documentation does not say how or if you have to configure de bonding mode for HA in /etc/modprobe.conf. From my point of view it should be mode=6 (balance-alb), but since it does not work I must be wrong! Or should it be left empty ? Any clues ? Could it be the switch ? Thanks, Nassri My conf: Switch - Cisco 3750 interface GigabitEthernet1/0/19 description DNS1 switchport trunk encapsulation dot1q switchport trunk allowed vlan 201 switchport mode trunk end ! interface GigabitEthernet1/0/18 description DNS2 switchport trunk encapsulation dot1q switchport trunk allowed vlan 201 switchport mode trunk end CENTOS BOX /etc/sysconfig/network-scripts/ifcfg-eth0 & ifcfg-eth1 DEVICE=ethx BOOTPROTO=static TYPE=Ethernet ONBOOT=yes SLAVE=yes MASTER=bond0 etc/sysconfig/network-scripts/ifcfg-bond0 DEVICE=bond0 ONBOOT=yes IPADDR=10.10.4.27 NETMASK=255.255.255.0 /etc/modprobe.conf alias bond0 bonding options bonding miimon=100 alias eth0 tg3 alias eth1 tg3 < /etc/sysconfig/network > NETWORKING=yes HOSTNAME=dns GATEWAY=10.192.32.254 GATEWAYDEV=bond0> I have not had time to test this, but the documentation > states that it can be done with some of the other mode=x > numbers, where the mode number represents different types of > bonding ie. round robin, active/standby, etc.. >
ABOKHALAF, Nassri Abdellatif
2006-Jan-20 11:31 UTC
[CentOS] RE: Broadcom NIC Binding under Centos 4.2
Thanks for your reply Robin,> It looks like you switch is configured to use tagged vlans.I must use tagged vlans. I configured the switch as your example.> Then add the following config file. >/etc/sysconfig/network-scripts/ifcfg-bond0.201 >DEVICE=bond0.201I cannot bring this interface up. If you do ifconfig it only shows bond0, eth0 & eth1. Since bond0.201 does not come up, the system has no default gateway. Any clue? Nassri
ABOKHALAF, Nassri Abdellatif
2006-Jan-20 17:04 UTC
[CentOS] RE: Broadcom NIC Binding under Centos 4.2
Ethernet Channel Bonding Driver: v2.6.1 (October 29, 2004) Bonding Mode: fault-tolerance (active-backup) Primary Slave: None Currently Active Slave: eth0 MII Status: up MII Polling Interval (ms): 100 Up Delay (ms): 0 Down Delay (ms): 0 Slave Interface: eth0 MII Status: up Link Failure Count: 0 Permanent HW addr: 00:15:60:ad:a0:8a Slave Interface: eth1 MII Status: up Link Failure Count: 0 Permanent HW addr: 00:15:60:ad:a0:89> show me your modprobe.conf/etc/modprobe.conf alias vlan 8021q alias bond0 bonding options bonding miimon=100 mode=1 alias eth0 tg3 alias eth1 tg3 alias scsi_hostadapter cciss alias usb-controller ehci-hcd alias usb-controller1 uhci-hcd alias net-pf-10 off /etc/sysconfig/network NETWORKING=yes HOSTNAME=dns.refertelecom.pt GATEWAY=10.192.32.254 GATEWAYDEV=bond0.201 eth0 DEVICE=eth0 BOOTPROTO=static TYPE=Ethernet ONBOOT=yes SLAVE=yes MASTER=bond0 eth1 DEVICE=eth1 BOOTPROTO=static TYPE=Ethernet ONBOOT=yes SLAVE=yes MASTER=bond0 bond0.201 DEVICE=bond0.201 ONBOOT=yes IPADDR=10.192.32.37 NETMASK=255.255.255.0 bond0 DEVICE=bond0 ONBOOT=yes Regards, Nassri
ABOKHALAF, Nassri Abdellatif
2006-Jan-23 15:03 UTC
[CentOS] RE: Broadcom NIC Binding under Centos 4.2
Hello Robin,> Add this line to the /etc/sysconfig/network > > VLAN=yesDone. Tested both interfaces & failover works nice. Thanks ! How do I check that both interfaces are working binded together ? Regards, Nassri
ABOKHALAF, Nassri Abdellatif
2006-Jan-23 15:52 UTC
[CentOS] RE: Broadcom NIC Binding under Centos 4.2
Hello> Have a look at /proc/net/bonding/bond0Here it is...seems like it's only fault tolerant. I'll be tweaking with the modes like Robin suggested. Ethernet Channel Bonding Driver: v2.6.1 (October 29, 2004) Bonding Mode: fault-tolerance (active-backup) Primary Slave: None Currently Active Slave: eth0 MII Status: up MII Polling Interval (ms): 100 Up Delay (ms): 0 Down Delay (ms): 0 Slave Interface: eth0 MII Status: up Link Failure Count: 1 Permanent HW addr: 00:15:60:ad:a0:8a Slave Interface: eth1 MII Status: up Link Failure Count: 1 Permanent HW addr: 00:15:60:ad:a0:89 Nassri
ABOKHALAF, Nassri Abdellatif
2006-Jan-23 15:55 UTC
[CentOS] RE: Broadcom NIC Binding under Centos 4.2
Hello,> you can experiment with the different mode=x settings and do > cat /proc/net/bond0 to see that status.I'll give a try with the different modes available.> Then to do some benchmarks you can use netcat.I'll come back with the netcat results. Thanks again, Nassri