I am running multiple DomUs on the same subnet and wanted to spread the load over multiple network interfaces. In addition, the system has other DomUs with interfaces (bridges) on other subnets. The NICs and bridges do not have any IPs on the Dom0, only in the DomUs. If I run two DomUs with separate bridges (server1 - br1/eth1 and server2 - br2/eth2) on the same subnet, everything runs fine for a while (up to 24 hours) and suddenly, all bridge traffic stops. Even bridge traffic on other DomUs on separate networks stops. Nothing is logged by the Dom0 or any of the DomUs. All interface configurations and routing tables look fine. Shutting down the DomUs, restarting networking and restarting the DomUs clears the problem. The Dom0 which has its own interface (eth0) always works. Should I not be running multiple bridges on the same subnet or am I missing some network configuration? If I share one bridge with multiple DomUs, all works well even under heavy load. The network however, is a bottleneck. Platform: Sun x4140, dual hex core AMD64 Debian 5.0.4 (kernel 2.6.26-2-xen-amd64) Xen 3.2-1-amd64 # The first bridge auto br1 iface br1 inet manual bridge_ports eth1 bridge_stp off bridge_maxwait 5 # The second bridge auto br2 iface br2 inet manual bridge_ports eth2 bridge_stp off bridge_maxwait 5 First DomU: vif = [ ''bridge=br1'' ] Second DomU: vif = [ ''bridge=br2'' ] Thanks in advance, Steve. _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
And what about creating bond on the eth1 and eth2? You will also gain redundancy in network connection this way. Regards Matej -----Original Message----- From: xen-users-bounces@lists.xensource.com [mailto:xen-users-bounces@lists.xensource.com] On Behalf Of Steve Arntzen Sent: Monday, April 19, 2010 2:33 PM To: xen-users@lists.xensource.com Subject: [Xen-users] Multiple bridges on same subnet? I am running multiple DomUs on the same subnet and wanted to spread the load over multiple network interfaces. In addition, the system has other DomUs with interfaces (bridges) on other subnets. The NICs and bridges do not have any IPs on the Dom0, only in the DomUs. If I run two DomUs with separate bridges (server1 - br1/eth1 and server2 - br2/eth2) on the same subnet, everything runs fine for a while (up to 24 hours) and suddenly, all bridge traffic stops. Even bridge traffic on other DomUs on separate networks stops. Nothing is logged by the Dom0 or any of the DomUs. All interface configurations and routing tables look fine. Shutting down the DomUs, restarting networking and restarting the DomUs clears the problem. The Dom0 which has its own interface (eth0) always works. Should I not be running multiple bridges on the same subnet or am I missing some network configuration? If I share one bridge with multiple DomUs, all works well even under heavy load. The network however, is a bottleneck. Platform: Sun x4140, dual hex core AMD64 Debian 5.0.4 (kernel 2.6.26-2-xen-amd64) Xen 3.2-1-amd64 # The first bridge auto br1 iface br1 inet manual bridge_ports eth1 bridge_stp off bridge_maxwait 5 # The second bridge auto br2 iface br2 inet manual bridge_ports eth2 bridge_stp off bridge_maxwait 5 First DomU: vif = [ 'bridge=br1' ] Second DomU: vif = [ 'bridge=br2' ] Thanks in advance, Steve. _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Yes, you are correct and I may do that on some of the internal servers. The downside is, on some of the public servers, they could see each other''s network traffic if using the same bridge. I want to avoid that if possible. Thanks for the reply, Steve. On Mon, 2010-04-19 at 14:54 +0200, Matej Zary wrote:> And what about creating bond on the eth1 and eth2? You will also gain redundancy in network connection this way. > > Regards > > Matej > > -----Original Message----- > From: xen-users-bounces@lists.xensource.com [mailto:xen-users-bounces@lists.xensource.com] On Behalf Of Steve Arntzen > Sent: Monday, April 19, 2010 2:33 PM > To: xen-users@lists.xensource.com > Subject: [Xen-users] Multiple bridges on same subnet? > > I am running multiple DomUs on the same subnet and wanted to spread the > load over multiple network interfaces. In addition, the system has > other DomUs with interfaces (bridges) on other subnets. The NICs and > bridges do not have any IPs on the Dom0, only in the DomUs. > > If I run two DomUs with separate bridges (server1 - br1/eth1 and server2 > - br2/eth2) on the same subnet, everything runs fine for a while (up to > 24 hours) and suddenly, all bridge traffic stops. Even bridge traffic > on other DomUs on separate networks stops. Nothing is logged by the > Dom0 or any of the DomUs. All interface configurations and routing > tables look fine. Shutting down the DomUs, restarting networking and > restarting the DomUs clears the problem. > > The Dom0 which has its own interface (eth0) always works. > > Should I not be running multiple bridges on the same subnet or am I > missing some network configuration? > > If I share one bridge with multiple DomUs, all works well even under > heavy load. The network however, is a bottleneck. > > Platform: > Sun x4140, dual hex core AMD64 > Debian 5.0.4 (kernel 2.6.26-2-xen-amd64) > Xen 3.2-1-amd64 > > # The first bridge > auto br1 > iface br1 inet manual > bridge_ports eth1 > bridge_stp off > bridge_maxwait 5 > > # The second bridge > auto br2 > iface br2 inet manual > bridge_ports eth2 > bridge_stp off > bridge_maxwait 5 > > First DomU: > vif = [ ''bridge=br1'' ] > > Second DomU: > vif = [ ''bridge=br2'' ] > > > Thanks in advance, > > Steve. > > > > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xensource.com > http://lists.xensource.com/xen-users > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xensource.com > http://lists.xensource.com/xen-users_______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users