NewXenUser
2007-Oct-24 23:37 UTC
[Xen-users] Bridging on the blink with greater than 2 xen domains
Hi, My bridging stops when I start a third Xen domain !?!? I have a few domains setup (mail, wiki, pbx). If I start two domains bridge networking works great. But if I start a third, either the new domains does not work or one of the other DomUs stops working! By stop working I mean I can''t route traffic outside of Dom0. I have been looking at this on and off for a couple of weeks. Any insight or things I should look at would be greatly appreciated. I don''t want to bombard this email with 10,000 dumps. I will gladly post any information needed to figure this one out. Basic network is a 10.20.10.X network. Gateway is 10.20.10.1 Xen Dom0 IP is 10.20.10.125 Xen Mail domain is 10.20.10.150 Xen PBX domain is 10.20.10.152 Xen wiki domain is 10.20.10.153 [root@abc ~]# rpm -qa | grep xen kernel-xen-2.6.20-2925.13.fc7 kernel-xen-2.6.20-2936.fc7 xen-libs-3.1.0-6.fc7 xen-3.1.0-6.fc7 *************** Below.... 2 work fine ******************* [root@abc ~]# for i in wiki mail; do echo "# $i"; ssh $i arp; ssh $i "ping -c 4 4.2.2.2"; done # wiki Address HWtype HWaddress Flags Mask Iface 10.20.10.125 ether 00:19:B9:D7:FB:4B C eth0 10.20.10.199 ether 00:07:E9:82:60:33 C eth0 PING 4.2.2.2 (4.2.2.2) 56(84) bytes of data.>From 10.20.10.125: icmp_seq=1 Redirect Host(New nexthop: 10.20.10.1)64 bytes from 4.2.2.2: icmp_seq=1 ttl=56 time=37.1 ms>From 10.20.10.125: icmp_seq=2 Redirect Host(New nexthop: 10.20.10.1)64 bytes from 4.2.2.2: icmp_seq=2 ttl=56 time=32.3 ms 64 bytes from 4.2.2.2: icmp_seq=3 ttl=56 time=30.8 ms 64 bytes from 4.2.2.2: icmp_seq=4 ttl=56 time=29.9 ms --- 4.2.2.2 ping statistics --- 4 packets transmitted, 4 received, 0% packet loss, time 3000ms rtt min/avg/max/mdev = 29.954/32.570/37.142/2.781 ms # mail Address HWtype HWaddress Flags Mask Iface 10.20.10.125 ether 00:19:B9:D7:FB:4B C eth0 10.20.10.1 ether 00:14:1C:5D:B6:BB C eth0 PING 4.2.2.2 (4.2.2.2) 56(84) bytes of data.>From 10.20.10.125: icmp_seq=1 Redirect Host(New nexthop: 10.20.10.1)64 bytes from 4.2.2.2: icmp_seq=1 ttl=56 time=38.1 ms 64 bytes from 4.2.2.2: icmp_seq=2 ttl=56 time=27.1 ms 64 bytes from 4.2.2.2: icmp_seq=3 ttl=56 time=31.3 ms 64 bytes from 4.2.2.2: icmp_seq=4 ttl=56 time=28.8 ms --- 4.2.2.2 ping statistics --- 4 packets transmitted, 4 received, 0% packet loss, time 3009ms rtt min/avg/max/mdev = 27.144/31.359/38.120/4.180 ms [root@abc ~]# ***************** Here we start the third xen domain, "pbx" ************ [root@abc ~]# xm start pbx [root@abc ~]# ***************** Initially WIKI works and PBX does not work ********* ***************** WAIT 5 MINUTES AND THE PBX WORKS, WIKI DOES NOT ******* [root@abc~]# for i in wiki mail pbx; do echo "# $i"; ssh $i arp; ssh $i "ping -c 4 4.2.2.2"; done # wiki Address HWtype HWaddress Flags Mask Iface 10.20.10.125 ether 00:19:B9:D7:FB:4B C eth0 10.20.10.1 ether 00:14:1C:5D:B6:BB C eth0 PING 4.2.2.2 (4.2.2.2) 56(84) bytes of data. --- 4.2.2.2 ping statistics --- 4 packets transmitted, 0 received, 100% packet loss, time 3008ms # mail Address HWtype HWaddress Flags Mask Iface 10.20.10.125 ether 00:19:B9:D7:FB:4B C eth0 10.20.10.1 ether 00:14:1C:5D:B6:BB C eth0 PING 4.2.2.2 (4.2.2.2) 56(84) bytes of data.>From 10.20.10.125: icmp_seq=1 Redirect Host(New nexthop: 10.20.10.1)64 bytes from 4.2.2.2: icmp_seq=1 ttl=56 time=28.8 ms 64 bytes from 4.2.2.2: icmp_seq=2 ttl=56 time=30.3 ms 64 bytes from 4.2.2.2: icmp_seq=3 ttl=56 time=26.8 ms 64 bytes from 4.2.2.2: icmp_seq=4 ttl=56 time=26.7 ms --- 4.2.2.2 ping statistics --- 4 packets transmitted, 4 received, 0% packet loss, time 2997ms rtt min/avg/max/mdev = 26.794/28.220/30.383/1.513 ms # pbx Address HWtype HWaddress Flags Mask Iface 10.20.10.1 ether 00:14:1C:5D:B6:BB C eth0 10.20.10.125 ether 00:19:B9:D7:FB:4B C eth0 PING 4.2.2.2 (4.2.2.2) 56(84) bytes of data.>From 10.20.10.125: icmp_seq=1 Redirect Host(New nexthop: 10.20.10.1)64 bytes from 4.2.2.2: icmp_seq=1 ttl=56 time=29.5 ms 64 bytes from 4.2.2.2: icmp_seq=2 ttl=56 time=27.9 ms 64 bytes from 4.2.2.2: icmp_seq=3 ttl=56 time=28.5 ms 64 bytes from 4.2.2.2: icmp_seq=4 ttl=56 time=33.1 ms --- 4.2.2.2 ping statistics --- 4 packets transmitted, 4 received, 0% packet loss, time 3002ms rtt min/avg/max/mdev = 27.900/29.783/33.102/2.006 ms [root@abc123~]# ********************************************* Thanks _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Christian Horn
2007-Oct-25 04:49 UTC
Re: [Xen-users] Bridging on the blink with greater than 2 xen domains
On Wed, Oct 24, 2007 at 05:37:29PM -0600, NewXenUser wrote:> > My bridging stops when I start a third Xen domain !?!?Double-check you are using different macs for the domains on a bridge. Christian _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
NewXenUser
2007-Oct-25 17:45 UTC
Re: [Xen-users] Bridging on the blink with greater than 2 xen domains
I am not 100% sure what to expect?
Here is what I have...
[root@abc ~]# for i in mail pbx wiki; do echo "# $i"; ssh $i
"ifconfig
eth0 | grep HWaddr"; done
# mail
eth0 Link encap:Ethernet HWaddr 00:16:3E:5A:F1:C2
# pbx
eth0 Link encap:Ethernet HWaddr 00:16:3E:27:EF:D8
# wiki
eth0 Link encap:Ethernet HWaddr 00:16:3E:70:95:C2
[root@abc ~]# ifconfig | grep HWaddr
eth0 Link encap:Ethernet HWaddr 00:19:B9:D7:FB:4B
peth0 Link encap:Ethernet HWaddr 00:19:B9:D7:FB:4B
vif19.0 Link encap:Ethernet HWaddr FE:FF:FF:FF:FF:FF
vif20.0 Link encap:Ethernet HWaddr FE:FF:FF:FF:FF:FF
vif21.0 Link encap:Ethernet HWaddr FE:FF:FF:FF:FF:FF
virbr0 Link encap:Ethernet HWaddr 00:00:00:00:00:00
[root@abc ~]#
[root@abc ~]# brctl show
bridge name bridge id STP enabled interfaces
eth0 8000.0019b9d7fb4b no vif21.0
vif20.0
vif19.0
peth0
virbr0 8000.000000000000 no
_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users
NewXenUser
2007-Oct-25 23:32 UTC
[Xen-users] Re: Bridging on the blink with greater than 2 xen domains
Ok. I restarted all three domains (mail, wiki, pbx) and for about 15 minutes the bridge networking worked. Then it dropped back to just two working. From the failed domain, I can still ping Dom0, I just can''t ping outside Dom0! Any suggestions? Thanks On 10/24/07, NewXenUser <newxenuser@gmail.com> wrote:> Hi, > > My bridging stops when I start a third Xen domain !?!? > > I have a few domains setup (mail, wiki, pbx). If I start two domains > bridge networking works great. But if I start a third, either the new > domains does not work or one of the other DomUs stops working! By > stop working I mean I can''t route traffic outside of Dom0. I have > been looking at this on and off for a couple of weeks. Any insight or > things I should look at would be greatly appreciated. > > I don''t want to bombard this email with 10,000 dumps. I will gladly > post any information needed to figure this one out. > > Basic network is a 10.20.10.X network. > Gateway is 10.20.10.1 > > Xen Dom0 IP is 10.20.10.125 > Xen Mail domain is 10.20.10.150 > Xen PBX domain is 10.20.10.152 > Xen wiki domain is 10.20.10.153 > > [root@abc ~]# rpm -qa | grep xen > kernel-xen-2.6.20-2925.13.fc7 > kernel-xen-2.6.20-2936.fc7 > xen-libs-3.1.0-6.fc7 > xen-3.1.0-6.fc7 > > *************** Below.... 2 work fine ******************* > > [root@abc ~]# for i in wiki mail; do echo "# $i"; ssh $i arp; ssh $i > "ping -c 4 4.2.2.2"; done > # wiki > Address HWtype HWaddress Flags Mask Iface > 10.20.10.125 ether 00:19:B9:D7:FB:4B C eth0 > 10.20.10.199 ether 00:07:E9:82:60:33 C eth0 > PING 4.2.2.2 (4.2.2.2) 56(84) bytes of data. > From 10.20.10.125: icmp_seq=1 Redirect Host(New nexthop: 10.20.10.1) > 64 bytes from 4.2.2.2: icmp_seq=1 ttl=56 time=37.1 ms > From 10.20.10.125: icmp_seq=2 Redirect Host(New nexthop: 10.20.10.1) > 64 bytes from 4.2.2.2: icmp_seq=2 ttl=56 time=32.3 ms > 64 bytes from 4.2.2.2: icmp_seq=3 ttl=56 time=30.8 ms > 64 bytes from 4.2.2.2: icmp_seq=4 ttl=56 time=29.9 ms > > --- 4.2.2.2 ping statistics --- > 4 packets transmitted, 4 received, 0% packet loss, time 3000ms > rtt min/avg/max/mdev = 29.954/32.570/37.142/2.781 ms > # mail > Address HWtype HWaddress Flags Mask Iface > 10.20.10.125 ether 00:19:B9:D7:FB:4B C eth0 > 10.20.10.1 ether 00:14:1C:5D:B6:BB C eth0 > PING 4.2.2.2 (4.2.2.2) 56(84) bytes of data. > From 10.20.10.125: icmp_seq=1 Redirect Host(New nexthop: 10.20.10.1) > 64 bytes from 4.2.2.2: icmp_seq=1 ttl=56 time=38.1 ms > 64 bytes from 4.2.2.2: icmp_seq=2 ttl=56 time=27.1 ms > 64 bytes from 4.2.2.2: icmp_seq=3 ttl=56 time=31.3 ms > 64 bytes from 4.2.2.2: icmp_seq=4 ttl=56 time=28.8 ms > > --- 4.2.2.2 ping statistics --- > 4 packets transmitted, 4 received, 0% packet loss, time 3009ms > rtt min/avg/max/mdev = 27.144/31.359/38.120/4.180 ms > [root@abc ~]# > > ***************** Here we start the third xen domain, "pbx" ************ > > [root@abc ~]# xm start pbx > [root@abc ~]# > > > ***************** Initially WIKI works and PBX does not work ********* > ***************** WAIT 5 MINUTES AND THE PBX WORKS, WIKI DOES NOT ******* > > > [root@abc~]# for i in wiki mail pbx; do echo "# $i"; ssh $i arp; ssh > $i "ping -c 4 4.2.2.2"; done > # wiki > Address HWtype HWaddress Flags Mask Iface > 10.20.10.125 ether 00:19:B9:D7:FB:4B C eth0 > 10.20.10.1 ether 00:14:1C:5D:B6:BB C eth0 > PING 4.2.2.2 (4.2.2.2) 56(84) bytes of data. > > --- 4.2.2.2 ping statistics --- > 4 packets transmitted, 0 received, 100% packet loss, time 3008ms > > # mail > Address HWtype HWaddress Flags Mask Iface > 10.20.10.125 ether 00:19:B9:D7:FB:4B C eth0 > 10.20.10.1 ether 00:14:1C:5D:B6:BB C eth0 > PING 4.2.2.2 (4.2.2.2) 56(84) bytes of data. > From 10.20.10.125: icmp_seq=1 Redirect Host(New nexthop: 10.20.10.1) > 64 bytes from 4.2.2.2: icmp_seq=1 ttl=56 time=28.8 ms > 64 bytes from 4.2.2.2: icmp_seq=2 ttl=56 time=30.3 ms > 64 bytes from 4.2.2.2: icmp_seq=3 ttl=56 time=26.8 ms > 64 bytes from 4.2.2.2: icmp_seq=4 ttl=56 time=26.7 ms > > --- 4.2.2.2 ping statistics --- > 4 packets transmitted, 4 received, 0% packet loss, time 2997ms > rtt min/avg/max/mdev = 26.794/28.220/30.383/1.513 ms > # pbx > Address HWtype HWaddress Flags Mask Iface > 10.20.10.1 ether 00:14:1C:5D:B6:BB C eth0 > 10.20.10.125 ether 00:19:B9:D7:FB:4B C eth0 > PING 4.2.2.2 (4.2.2.2) 56(84) bytes of data. > From 10.20.10.125: icmp_seq=1 Redirect Host(New nexthop: 10.20.10.1) > 64 bytes from 4.2.2.2: icmp_seq=1 ttl=56 time=29.5 ms > 64 bytes from 4.2.2.2: icmp_seq=2 ttl=56 time=27.9 ms > 64 bytes from 4.2.2.2: icmp_seq=3 ttl=56 time=28.5 ms > 64 bytes from 4.2.2.2: icmp_seq=4 ttl=56 time=33.1 ms > > --- 4.2.2.2 ping statistics --- > 4 packets transmitted, 4 received, 0% packet loss, time 3002ms > rtt min/avg/max/mdev = 27.900/29.783/33.102/2.006 ms > [root@abc123~]# > > ********************************************* > > Thanks >_______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users