CentOS - Nov 2017 - Centos and xen network bridge issue

Hi All,

We have a single Centos 5.11 server running a xen hypervisor that went 
down hard after an extended power outage this weekend. I'm mostly 
familiar for KVM as that is the majority of what our guests run under 
and have tried getting up to speed on xen bridging to no avail.

The problem is that after the xen server spun back up, the previously 
defined xen bridges were lost.  I've been going in circles and am 
seeking advise on to how to restore them. I found the bridge interfaces 
defined in /etc/xen/scripts/network-bridge-pcl, this is what I am trying 
to restore. Logs/configs files are posted below.

There are two guests running, one uses 'xen-dmz1' and the other 
'xen-dmz2' I created 'xenbr3' somehow with an interface named
after one
of the guests.

The server will be retired shortly. Any help would be greatly appreciated.

Thank you,
Scott




/etc/xen/scripts/network-bridge-pcl

#/bin/sh

dir=$(dirname "$0")
"$dir/network-bridge" "$@" vifnum=1 netdev=eth2
bridge=xen-dmz2
"$dir/network-bridge" "$@" vifnum=3 netdev=eth0
bridge=xen-dmz1

=====
#brctl show

bridge name    bridge id        STP enabled    interfaces
virbr0        8000.000000000000    yes
xenbr3        8000.feffffffffff    no        guestname
                             vif0.3
                             peth3
=====
#ifconfig -a

eth0      Link encap:Ethernet  HWaddr 00:22:19:5E:F9:F8
           inet6 addr: fe80::222:19ff:fe5e:f9f8/64 Scope:Link
           UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
           RX packets:100820 errors:0 dropped:0 overruns:0 frame:0
           TX packets:6 errors:0 dropped:0 overruns:0 carrier:0
           collisions:0 txqueuelen:1000
           RX bytes:9736214 (9.2 MiB)  TX bytes:492 (492.0 b)
           Interrupt:24 Memory:ce000000-ce012800

eth1      Link encap:Ethernet  HWaddr 00:22:19:5E:F9:FA
           inet6 addr: fe80::222:19ff:fe5e:f9fa/64 Scope:Link
           UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
           RX packets:33304 errors:0 dropped:0 overruns:0 frame:0
           TX packets:6 errors:0 dropped:0 overruns:0 carrier:0
           collisions:0 txqueuelen:1000
           RX bytes:2559435 (2.4 MiB)  TX bytes:492 (492.0 b)
           Interrupt:25 Memory:d0000000-d0012800

eth2      Link encap:Ethernet  HWaddr 00:22:19:5E:F9:FC
           inet6 addr: fe80::222:19ff:fe5e:f9fc/64 Scope:Link
           UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
           RX packets:46169 errors:0 dropped:0 overruns:0 frame:0
           TX packets:6 errors:0 dropped:0 overruns:0 carrier:0
           collisions:0 txqueuelen:1000
           RX bytes:2954816 (2.8 MiB)  TX bytes:492 (492.0 b)
           Interrupt:26 Memory:d2000000-d2012800

eth3      Link encap:Ethernet  HWaddr 00:22:19:5E:F9:FE
           inet addr:10.30.2.20  Bcast:10.30.2.255 Mask:255.255.255.0
           inet6 addr: fe80::222:19ff:fe5e:f9fe/64 Scope:Link
           UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
           RX packets:1092768 errors:0 dropped:0 overruns:0 frame:0
           TX packets:993657 errors:0 dropped:0 overruns:0 carrier:0
           collisions:0 txqueuelen:0
           RX bytes:136283932 (129.9 MiB)  TX bytes:183732069 (175.2 MiB)

eth4      Link encap:Ethernet  HWaddr 00:10:18:56:73:D0
           BROADCAST MULTICAST  MTU:1500  Metric:1
           RX packets:0 errors:0 dropped:0 overruns:0 frame:0
           TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
           collisions:0 txqueuelen:1000
           RX bytes:0 (0.0 b)  TX bytes:0 (0.0 b)
           Interrupt:28 Memory:d6000000-d6012800

eth5      Link encap:Ethernet  HWaddr 00:10:18:56:73:D2
           BROADCAST MULTICAST  MTU:1500  Metric:1
           RX packets:0 errors:0 dropped:0 overruns:0 frame:0
           TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
           collisions:0 txqueuelen:1000
           RX bytes:0 (0.0 b)  TX bytes:0 (0.0 b)
           Interrupt:29 Memory:d8000000-d8012800

eth6      Link encap:Ethernet  HWaddr 00:10:18:56:73:DC
           BROADCAST MULTICAST  MTU:1500  Metric:1
           RX packets:0 errors:0 dropped:0 overruns:0 frame:0
           TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
           collisions:0 txqueuelen:1000
           RX bytes:0 (0.0 b)  TX bytes:0 (0.0 b)
           Interrupt:30 Memory:da000000-da012800

eth7      Link encap:Ethernet  HWaddr 00:10:18:56:73:DE
           UP BROADCAST MULTICAST  MTU:1500  Metric:1
           RX packets:0 errors:0 dropped:0 overruns:0 frame:0
           TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
           collisions:0 txqueuelen:1000
           RX bytes:0 (0.0 b)  TX bytes:0 (0.0 b)
           Interrupt:31 Memory:dc000000-dc012800

lo        Link encap:Local Loopback
           inet addr:127.0.0.1  Mask:255.0.0.0
           inet6 addr: ::1/128 Scope:Host
           UP LOOPBACK RUNNING  MTU:16436  Metric:1
           RX packets:32 errors:0 dropped:0 overruns:0 frame:0
           TX packets:32 errors:0 dropped:0 overruns:0 carrier:0
           collisions:0 txqueuelen:0
           RX bytes:5951 (5.8 KiB)  TX bytes:5951 (5.8 KiB)

peth3     Link encap:Ethernet  HWaddr FE:FF:FF:FF:FF:FF
           inet6 addr: fe80::fcff:ffff:feff:ffff/64 Scope:Link
           UP BROADCAST RUNNING NOARP  MTU:1500  Metric:1
           RX packets:1132794 errors:0 dropped:0 overruns:0 frame:0
           TX packets:1000019 errors:0 dropped:0 overruns:0 carrier:0
           collisions:0 txqueuelen:1000
           RX bytes:146054455 (139.2 MiB)  TX bytes:188561087 (179.8 MiB)
           Interrupt:27 Memory:d4000000-d4012800

guestname Link encap:Ethernet  HWaddr FE:FF:FF:FF:FF:FF
           inet6 addr: fe80::fcff:ffff:feff:ffff/64 Scope:Link
           UP BROADCAST RUNNING NOARP  MTU:1500  Metric:1
           RX packets:4155 errors:0 dropped:0 overruns:0 frame:0
           TX packets:100856 errors:0 dropped:0 overruns:0 carrier:0
           collisions:0 txqueuelen:500
           RX bytes:530960 (518.5 KiB)  TX bytes:10863800 (10.3 MiB)

sit0      Link encap:IPv6-in-IPv4
           NOARP  MTU:1480  Metric:1
           RX packets:0 errors:0 dropped:0 overruns:0 frame:0
           TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
           collisions:0 txqueuelen:0
           RX bytes:0 (0.0 b)  TX bytes:0 (0.0 b)

veth0     Link encap:Ethernet  HWaddr 00:00:00:00:00:00
           BROADCAST MULTICAST  MTU:1500  Metric:1
           RX packets:0 errors:0 dropped:0 overruns:0 frame:0
           TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
           collisions:0 txqueuelen:0
           RX bytes:0 (0.0 b)  TX bytes:0 (0.0 b)

veth1     Link encap:Ethernet  HWaddr 00:00:00:00:00:00
           BROADCAST MULTICAST  MTU:1500  Metric:1
           RX packets:0 errors:0 dropped:0 overruns:0 frame:0
           TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
           collisions:0 txqueuelen:0
           RX bytes:0 (0.0 b)  TX bytes:0 (0.0 b)

veth2     Link encap:Ethernet  HWaddr 00:00:00:00:00:00
           BROADCAST MULTICAST  MTU:1500  Metric:1
           RX packets:0 errors:0 dropped:0 overruns:0 frame:0
           TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
           collisions:0 txqueuelen:0
           RX bytes:0 (0.0 b)  TX bytes:0 (0.0 b)

veth4     Link encap:Ethernet  HWaddr 00:00:00:00:00:00
           BROADCAST MULTICAST  MTU:1500  Metric:1
           RX packets:0 errors:0 dropped:0 overruns:0 frame:0
           TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
           collisions:0 txqueuelen:0
           RX bytes:0 (0.0 b)  TX bytes:0 (0.0 b)

veth5     Link encap:Ethernet  HWaddr 00:00:00:00:00:00
           BROADCAST MULTICAST  MTU:1500  Metric:1
           RX packets:0 errors:0 dropped:0 overruns:0 frame:0
           TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
           collisions:0 txqueuelen:0
           RX bytes:0 (0.0 b)  TX bytes:0 (0.0 b)

veth6     Link encap:Ethernet  HWaddr 00:00:00:00:00:00
           BROADCAST MULTICAST  MTU:1500  Metric:1
           RX packets:0 errors:0 dropped:0 overruns:0 frame:0
           TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
           collisions:0 txqueuelen:0
           RX bytes:0 (0.0 b)  TX bytes:0 (0.0 b)

veth7     Link encap:Ethernet  HWaddr 00:00:00:00:00:00
           BROADCAST MULTICAST  MTU:1500  Metric:1
           RX packets:0 errors:0 dropped:0 overruns:0 frame:0
           TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
           collisions:0 txqueuelen:0
           RX bytes:0 (0.0 b)  TX bytes:0 (0.0 b)

veth8     Link encap:Ethernet  HWaddr 00:00:00:00:00:00
           BROADCAST MULTICAST  MTU:1500  Metric:1
           RX packets:0 errors:0 dropped:0 overruns:0 frame:0
           TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
           collisions:0 txqueuelen:0
           RX bytes:0 (0.0 b)  TX bytes:0 (0.0 b)

veth9     Link encap:Ethernet  HWaddr 00:00:00:00:00:00
           BROADCAST MULTICAST  MTU:1500  Metric:1
           RX packets:0 errors:0 dropped:0 overruns:0 frame:0
           TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
           collisions:0 txqueuelen:0
           RX bytes:0 (0.0 b)  TX bytes:0 (0.0 b)

veth10    Link encap:Ethernet  HWaddr 00:00:00:00:00:00
           BROADCAST MULTICAST  MTU:1500  Metric:1
           RX packets:0 errors:0 dropped:0 overruns:0 frame:0
           TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
           collisions:0 txqueuelen:0
           RX bytes:0 (0.0 b)  TX bytes:0 (0.0 b)

vif0.0    Link encap:Ethernet  HWaddr FE:FF:FF:FF:FF:FF
           BROADCAST MULTICAST  MTU:1500  Metric:1
           RX packets:0 errors:0 dropped:0 overruns:0 frame:0
           TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
           collisions:0 txqueuelen:0
           RX bytes:0 (0.0 b)  TX bytes:0 (0.0 b)

vif0.1    Link encap:Ethernet  HWaddr FE:FF:FF:FF:FF:FF
           BROADCAST MULTICAST  MTU:1500  Metric:1
           RX packets:0 errors:0 dropped:0 overruns:0 frame:0
           TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
           collisions:0 txqueuelen:0
           RX bytes:0 (0.0 b)  TX bytes:0 (0.0 b)

vif0.2    Link encap:Ethernet  HWaddr FE:FF:FF:FF:FF:FF
           BROADCAST MULTICAST  MTU:1500  Metric:1
           RX packets:0 errors:0 dropped:0 overruns:0 frame:0
           TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
           collisions:0 txqueuelen:0
           RX bytes:0 (0.0 b)  TX bytes:0 (0.0 b)

vif0.3    Link encap:Ethernet  HWaddr FE:FF:FF:FF:FF:FF
           inet6 addr: fe80::fcff:ffff:feff:ffff/64 Scope:Link
           UP BROADCAST RUNNING NOARP  MTU:1500  Metric:1
           RX packets:993721 errors:0 dropped:0 overruns:0 frame:0
           TX packets:1092813 errors:0 dropped:0 overruns:0 carrier:0
           collisions:0 txqueuelen:0
           RX bytes:183747013 (175.2 MiB)  TX bytes:136286954 (129.9 MiB)

vif0.4    Link encap:Ethernet  HWaddr FE:FF:FF:FF:FF:FF
           BROADCAST MULTICAST  MTU:1500  Metric:1
           RX packets:0 errors:0 dropped:0 overruns:0 frame:0
           TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
           collisions:0 txqueuelen:0
           RX bytes:0 (0.0 b)  TX bytes:0 (0.0 b)

vif0.5    Link encap:Ethernet  HWaddr FE:FF:FF:FF:FF:FF
           BROADCAST MULTICAST  MTU:1500  Metric:1
           RX packets:0 errors:0 dropped:0 overruns:0 frame:0
           TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
           collisions:0 txqueuelen:0
           RX bytes:0 (0.0 b)  TX bytes:0 (0.0 b)

vif0.6    Link encap:Ethernet  HWaddr FE:FF:FF:FF:FF:FF
           BROADCAST MULTICAST  MTU:1500  Metric:1
           RX packets:0 errors:0 dropped:0 overruns:0 frame:0
           TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
           collisions:0 txqueuelen:0
           RX bytes:0 (0.0 b)  TX bytes:0 (0.0 b)

vif0.7    Link encap:Ethernet  HWaddr FE:FF:FF:FF:FF:FF
           BROADCAST MULTICAST  MTU:1500  Metric:1
           RX packets:0 errors:0 dropped:0 overruns:0 frame:0
           TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
           collisions:0 txqueuelen:0
           RX bytes:0 (0.0 b)  TX bytes:0 (0.0 b)

vif0.8    Link encap:Ethernet  HWaddr FE:FF:FF:FF:FF:FF
           BROADCAST MULTICAST  MTU:1500  Metric:1
           RX packets:0 errors:0 dropped:0 overruns:0 frame:0
           TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
           collisions:0 txqueuelen:0
           RX bytes:0 (0.0 b)  TX bytes:0 (0.0 b)

vif0.9    Link encap:Ethernet  HWaddr FE:FF:FF:FF:FF:FF
           BROADCAST MULTICAST  MTU:1500  Metric:1
           RX packets:0 errors:0 dropped:0 overruns:0 frame:0
           TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
           collisions:0 txqueuelen:0
           RX bytes:0 (0.0 b)  TX bytes:0 (0.0 b)

vif0.10   Link encap:Ethernet  HWaddr FE:FF:FF:FF:FF:FF
           BROADCAST MULTICAST  MTU:1500  Metric:1
           RX packets:0 errors:0 dropped:0 overruns:0 frame:0
           TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
           collisions:0 txqueuelen:0
           RX bytes:0 (0.0 b)  TX bytes:0 (0.0 b)

virbr0    Link encap:Ethernet  HWaddr 00:00:00:00:00:00
           inet addr:192.168.122.1  Bcast:192.168.122.255 Mask:255.255.255.0
           UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
           RX packets:0 errors:0 dropped:0 overruns:0 frame:0
           TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
           collisions:0 txqueuelen:0
           RX bytes:0 (0.0 b)  TX bytes:0 (0.0 b)

xenbr3    Link encap:Ethernet  HWaddr FE:FF:FF:FF:FF:FF
           UP BROADCAST RUNNING NOARP  MTU:1500  Metric:1
           RX packets:97810 errors:0 dropped:0 overruns:0 frame:0
           TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
           collisions:0 txqueuelen:0
           RX bytes:9282152 (8.8 MiB)  TX bytes:0 (0.0 b)


=====
network-scripts]# cat ifcfg-eth0 ifcfg-eth2
# Broadcom Corporation NetXtreme II BCM5709 Gigabit Ethernet
DEVICE=eth0
BOOTPROTO=static
HWADDR=00:22:19:5E:F9:F8
ONBOOT=yes

# Broadcom Corporation NetXtreme II BCM5709 Gigabit Ethernet
DEVICE=eth2
BOOTPROTO=static
HWADDR=00:22:19:5E:F9:FC
ONBOOT=yes

On 11/01/2017 07:55 AM, Scott Gennari wrote:
> /etc/xen/scripts/network-bridge-pcl
>
> #/bin/sh
>
> dir=$(dirname "$0")
> "$dir/network-bridge" "$@" vifnum=1 netdev=eth2
bridge=xen-dmz2
> "$dir/network-bridge" "$@" vifnum=3 netdev=eth0
bridge=xen-dmz1

Do you get any error output when you run:

/etc/xen/scripts/network-bridge vifnum=1 netdev=eth2 bridge=xen-dmz2

If not, try:

bash -x /etc/xen/scripts/network-bridge vifnum=1 netdev=eth2 bridge=xen-dmz2

And if all else fails, set up a bridged interface by hand:

brctl addbr xen-dmz2
ip link set dev eth2 up
brctl addif xen-dmz2 eth2

On 11/01/2017 03:06 PM, Gordon Messmer wrote:
> On 11/01/2017 07:55 AM, Scott Gennari wrote:
>> /etc/xen/scripts/network-bridge-pcl
>>
>> #/bin/sh
>>
>> dir=$(dirname "$0")
>> "$dir/network-bridge" "$@" vifnum=1 netdev=eth2
bridge=xen-dmz2
>> "$dir/network-bridge" "$@" vifnum=3 netdev=eth0
bridge=xen-dmz1
>
>
> Do you get any error output when you run:
>
> /etc/xen/scripts/network-bridge vifnum=1 netdev=eth2 bridge=xen-dmz2
>
> If not, try:
>
> bash -x /etc/xen/scripts/network-bridge vifnum=1 netdev=eth2 
> bridge=xen-dmz2
>
> And if all else fails, set up a bridged interface by hand:
>
> brctl addbr xen-dmz2
> ip link set dev eth2 up
> brctl addif xen-dmz2 eth2
>
> --
Hi Gordon,

Thanks for this, I was able to get xen-dmz1 & 2 setup using the manual 
method you described and get the domain/guests back online.

Much appreciated,
Scott