Greetings, I hope this is the correct place to go to ask for help. I've inherited a Xen server that hosts 5 FreePBX servers. I've installed FreePBX on a sixth, but cannot for the life of me get networking working. I have assigned two static addresses to my two interfaces in the guest machine, but cannot ping the gateway, and am not seeing arp. I'm happy to provide any information needed. New guest: cat /etc/xen/trixbox6.conf name = "trixbox6" kernel = "/usr/lib/xen/boot/hvmloader" device_model = '/usr/lib/xen/bin/qemu-dm' builder='hvm' memory = 512 shadow_memory = 8 vcpus=1 vif = [ 'type=ioemu, mac=00:16:3e:10:78:9b, bridge=br115' , 'type=ioemu, mac=00:16:3e:2a:48:d4, bridge=eth0'] #nographic=1 #sdl=0 #vnc=0 vnc=1 vnclisten="0.0.0.0" vncconsole=6 vncpasswd='secretsquirrel' stdvga=0 sdl=0 serial='pty' #disk ['file:/root/FreePBX-STABLE32.iso,xvdc:cdrom,r','phy:/dev/md7,xvda,w'] #boot='d' disk = ['phy:/dev/md7,xvda,w'] boot='c' on_poweroff='destroy' on_reboot='restart' on_crash='restart' Ifconfig from the xen guest (copy,paste doesn't work for me over VNC) eth0 IP: 192.168.14.9/24 GW:192.168.14.1 eth1 IP: 192.168.194.17/27 GW: 192.168.194.6 Xen host: xen:~# xm list Name ID Mem VCPUs State Time(s) Domain-0 0 844 4 r----- 7483.7 trixbox1 10 512 1 -b---- 2568.6 trixbox2 3 512 1 -b---- 7937.5 trixbox3 12 512 1 -b---- 6871.8 trixbox4 5 512 1 -b---- 8442.2 trixbox5 6 512 1 -b---- 3280.9 trixbox6 15 512 1 -b---- 210.5 [2014-10-17 15:11:32 3013] DEBUG (DevController:120) DevController: writing {'bridge': 'br115', 'domain': 'trixbox6', 'handle': '0', 'uuid': 'b260a4ed-99a1-7ad1-a440-6e6f6959de37', 'script': '/etc/xen/scripts/vif-bridge', 'mac': '00:16:3e:10:78:9b', 'frontend-id': '13', 'state': '1', 'online': '1', 'frontend': '/local/domain/13/device/vif/0', 'type': 'ioemu'} to /local/domain/0/backend/vif/13/0. [2014-10-17 15:11:32 3013] INFO (image:289) spawning device models: /usr/lib/xen/bin/qemu-dm ['/usr/lib/xen/bin/qemu-dm', '-d', '13', '-domain-name', 'trixbox6', '-vnc', '0.0.0.0:0,password', '-vncunused', '-vcpus', '1', '-boot', 'c', '-serial', 'pty', '-acpi', '-net', 'nic,vlan=1,macaddr=00:16:3e:10:78:9b,model=rtl8139', '-net', 'tap,vlan=1,bridge=br115', '-net', 'nic,vlan=2,macaddr=00:16:3e:2a:48:d4,model=rtl8139', '-net', 'tap,vlan=2,bridge=eth0', '-M', 'xenfv', '-vncviewer'] xen:~# brctl showstp br115 br115 bridge id 8000.003048643759 designated root 8000.003048643759 root port 0 path cost 0 max age 20.00 bridge max age 20.00 hello time 2.00 bridge hello time 2.00 forward delay 0.00 bridge forward delay 0.00 ageing time 300.01 hello timer 1.39 tcn timer 0.00 topology change timer 0.00 gc timer 0.39 flags peth1.115 (1) port id 8001 state forwarding designated root 8000.003048643759 path cost 100 designated bridge 8000.003048643759 message age timer 0.00 designated port 8001 forward delay timer 0.00 designated cost 0 hold timer 0.39 flags tap10 (2) port id 8002 state forwarding designated root 8000.003048643759 path cost 100 designated bridge 8000.003048643759 message age timer 0.00 designated port 8002 forward delay timer 0.00 designated cost 0 hold timer 0.39 flags vif15.0 (3) port id 8003 state forwarding designated root 8000.003048643759 path cost 100 designated bridge 8000.003048643759 message age timer 0.00 designated port 8003 forward delay timer 0.00 designated cost 0 hold timer 0.39 flags Here's ifconfig on the xen host: br110 Link encap:Ethernet HWaddr 00:30:48:64:37:59 inet6 addr: fe80::230:48ff:fe64:3759/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:10292 errors:0 dropped:0 overruns:0 frame:0 TX packets:6 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:299889 (292.8 KiB) TX bytes:468 (468.0 B) br111 Link encap:Ethernet HWaddr 00:30:48:64:37:59 inet6 addr: fe80::230:48ff:fe64:3759/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:12211 errors:0 dropped:0 overruns:0 frame:0 TX packets:6 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:607410 (593.1 KiB) TX bytes:468 (468.0 B) br112 Link encap:Ethernet HWaddr 00:30:48:64:37:59 inet6 addr: fe80::230:48ff:fe64:3759/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:29173 errors:0 dropped:0 overruns:0 frame:0 TX packets:6 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:5955146 (5.6 MiB) TX bytes:468 (468.0 B) br113 Link encap:Ethernet HWaddr 00:30:48:64:37:59 inet6 addr: fe80::230:48ff:fe64:3759/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:166 errors:0 dropped:0 overruns:0 frame:0 TX packets:6 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:13238 (12.9 KiB) TX bytes:468 (468.0 B) br114 Link encap:Ethernet HWaddr 00:30:48:64:37:59 inet6 addr: fe80::230:48ff:fe64:3759/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:42 errors:0 dropped:0 overruns:0 frame:0 TX packets:6 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:4927 (4.8 KiB) TX bytes:468 (468.0 B) br115 Link encap:Ethernet HWaddr 00:30:48:64:37:59 inet6 addr: fe80::230:48ff:fe64:3759/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:28101 errors:0 dropped:0 overruns:0 frame:0 TX packets:6 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:810906 (791.9 KiB) TX bytes:468 (468.0 B) eth0 Link encap:Ethernet HWaddr 00:30:48:64:37:58 inet addr:192.168.194.11 Bcast:192.168.194.31 Mask:255.255.255.224 inet6 addr: fe80::230:48ff:fe64:3758/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:695866 errors:0 dropped:0 overruns:0 frame:0 TX packets:529326 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:55516710 (52.9 MiB) TX bytes:642317486 (612.5 MiB) eth1 Link encap:Ethernet HWaddr 00:30:48:64:37:59 inet addr:192.168.1.1 Bcast:192.168.1.255 Mask:255.255.255.0 inet6 addr: fe80::230:48ff:fe64:3759/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:3092332 errors:0 dropped:0 overruns:0 frame:0 TX packets:2861597 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:100 RX bytes:694748497 (662.5 MiB) TX bytes:670839768 (639.7 MiB) Memory:d8060000-d8080000 lo Link encap:Local Loopback inet addr:127.0.0.1 Mask:255.0.0.0 inet6 addr: ::1/128 Scope:Host UP LOOPBACK RUNNING MTU:16436 Metric:1 RX packets:194509 errors:0 dropped:0 overruns:0 frame:0 TX packets:194509 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:602747736 (574.8 MiB) TX bytes:602747736 (574.8 MiB) peth0 Link encap:Ethernet HWaddr 00:30:48:64:37:58 inet6 addr: fe80::230:48ff:fe64:3758/64 Scope:Link UP BROADCAST RUNNING PROMISC MULTICAST MTU:1500 Metric:1 RX packets:4036599 errors:0 dropped:0 overruns:0 frame:0 TX packets:4912996 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:100 RX bytes:689834120 (657.8 MiB) TX bytes:3662144961 (3.4 GiB) Memory:d8020000-d8040000 peth1.110 Link encap:Ethernet HWaddr 00:30:48:64:37:59 inet6 addr: fe80::230:48ff:fe64:3759/64 Scope:Link UP BROADCAST RUNNING PROMISC MULTICAST MTU:1500 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:10304 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:0 (0.0 B) TX bytes:444913 (434.4 KiB) peth1.111 Link encap:Ethernet HWaddr 00:30:48:64:37:59 inet6 addr: fe80::230:48ff:fe64:3759/64 Scope:Link UP BROADCAST RUNNING PROMISC MULTICAST MTU:1500 Metric:1 RX packets:98062 errors:0 dropped:0 overruns:0 frame:0 TX packets:86155 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:37019875 (35.3 MiB) TX bytes:33909366 (32.3 MiB) peth1.112 Link encap:Ethernet HWaddr 00:30:48:64:37:59 inet6 addr: fe80::230:48ff:fe64:3759/64 Scope:Link UP BROADCAST RUNNING PROMISC MULTICAST MTU:1500 Metric:1 RX packets:462284 errors:0 dropped:0 overruns:0 frame:0 TX packets:365546 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:99612791 (94.9 MiB) TX bytes:98676051 (94.1 MiB) peth1.113 Link encap:Ethernet HWaddr 00:30:48:64:37:59 inet6 addr: fe80::230:48ff:fe64:3759/64 Scope:Link UP BROADCAST RUNNING PROMISC MULTICAST MTU:1500 Metric:1 RX packets:1602071 errors:0 dropped:0 overruns:0 frame:0 TX packets:1605065 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:322935409 (307.9 MiB) TX bytes:349110541 (332.9 MiB) peth1.114 Link encap:Ethernet HWaddr 00:30:48:64:37:59 inet6 addr: fe80::230:48ff:fe64:3759/64 Scope:Link UP BROADCAST RUNNING PROMISC MULTICAST MTU:1500 Metric:1 RX packets:767284 errors:0 dropped:0 overruns:0 frame:0 TX packets:766407 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:178135216 (169.8 MiB) TX bytes:187493131 (178.8 MiB) peth1.115 Link encap:Ethernet HWaddr 00:30:48:64:37:59 inet6 addr: fe80::230:48ff:fe64:3759/64 Scope:Link UP BROADCAST RUNNING PROMISC MULTICAST MTU:1500 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:28113 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:0 (0.0 B) TX bytes:1205256 (1.1 MiB) tap0 Link encap:Ethernet HWaddr 00:ff:dd:f9:22:27 inet6 addr: fe80::2ff:ddff:fef9:2227/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:7928 errors:0 dropped:0 overruns:0 frame:0 TX packets:6 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:500 RX bytes:336511 (328.6 KiB) TX bytes:468 (468.0 B) tap1 Link encap:Ethernet HWaddr 00:ff:76:f7:fe:a9 inet6 addr: fe80::2ff:76ff:fef7:fea9/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:12344 errors:0 dropped:0 overruns:0 frame:0 TX packets:101063 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:500 RX bytes:4477780 (4.2 MiB) TX bytes:8518490 (8.1 MiB) tap2 Link encap:Ethernet HWaddr 00:ff:74:ed:9b:91 inet6 addr: fe80::2ff:74ff:feed:9b91/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:86143 errors:0 dropped:0 overruns:0 frame:0 TX packets:98068 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:500 RX bytes:33908430 (32.3 MiB) TX bytes:38393134 (36.6 MiB) tap3 Link encap:Ethernet HWaddr 00:ff:01:89:56:1a inet6 addr: fe80::2ff:1ff:fe89:561a/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:85079 errors:0 dropped:0 overruns:0 frame:0 TX packets:175179 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:500 RX bytes:58301479 (55.6 MiB) TX bytes:20382626 (19.4 MiB) tap4 Link encap:Ethernet HWaddr 00:ff:54:73:2c:13 inet6 addr: fe80::2ff:54ff:fe73:2c13/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:365476 errors:0 dropped:0 overruns:0 frame:0 TX packets:438571 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:500 RX bytes:98661401 (94.0 MiB) TX bytes:101002771 (96.3 MiB) tap5 Link encap:Ethernet HWaddr 00:ff:18:97:1c:a6 inet6 addr: fe80::2ff:18ff:fe97:1ca6/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:1862547 errors:0 dropped:0 overruns:0 frame:0 TX packets:940618 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:500 RX bytes:2333683620 (2.1 GiB) TX bytes:108459347 (103.4 MiB) tap6 Link encap:Ethernet HWaddr 00:ff:7d:42:81:7a inet6 addr: fe80::2ff:7dff:fe42:817a/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:1605053 errors:0 dropped:0 overruns:0 frame:0 TX packets:1602078 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:500 RX bytes:349109605 (332.9 MiB) TX bytes:345348221 (329.3 MiB) tap7 Link encap:Ethernet HWaddr 00:ff:14:41:fc:da inet6 addr: fe80::2ff:14ff:fe41:fcda/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:1598177 errors:0 dropped:0 overruns:0 frame:0 TX packets:1687448 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:500 RX bytes:338452688 (322.7 MiB) TX bytes:347078410 (330.9 MiB) tap8 Link encap:Ethernet HWaddr 00:ff:e4:d3:7c:2b inet6 addr: fe80::2ff:e4ff:fed3:7c2b/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:766395 errors:0 dropped:0 overruns:0 frame:0 TX packets:767291 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:500 RX bytes:187492195 (178.8 MiB) TX bytes:188877730 (180.1 MiB) tap9 Link encap:Ethernet HWaddr 00:ff:a7:da:ea:b1 inet6 addr: fe80::2ff:a7ff:feda:eab1/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:785886 errors:0 dropped:0 overruns:0 frame:0 TX packets:838566 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:500 RX bytes:267272947 (254.8 MiB) TX bytes:158628536 (151.2 MiB) tap10 Link encap:Ethernet HWaddr 00:ff:8c:d4:26:ee inet6 addr: fe80::2ff:8cff:fed4:26ee/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:22131 errors:0 dropped:0 overruns:0 frame:0 TX packets:6 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:500 RX bytes:935265 (913.3 KiB) TX bytes:468 (468.0 B) tap11 Link encap:Ethernet HWaddr 00:ff:e3:01:d8:9f inet6 addr: fe80::2ff:e3ff:fe01:d89f/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:45 errors:0 dropped:0 overruns:0 frame:0 TX packets:78946 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:500 RX bytes:7641 (7.4 KiB) TX bytes:4884463 (4.6 MiB) vif10.0 Link encap:Ethernet HWaddr fe:ff:ff:ff:ff:ff inet6 addr: fe80::fcff:ffff:feff:ffff/64 Scope:Link UP BROADCAST RUNNING PROMISC MULTICAST MTU:1500 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:0 errors:0 dropped:7934 overruns:0 carrier:0 collisions:0 txqueuelen:32 RX bytes:0 (0.0 B) TX bytes:0 (0.0 B) vif10.1 Link encap:Ethernet HWaddr fe:ff:ff:ff:ff:ff inet6 addr: fe80::fcff:ffff:feff:ffff/64 Scope:Link UP BROADCAST RUNNING PROMISC MULTICAST MTU:1500 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:0 errors:0 dropped:87364 overruns:0 carrier:0 collisions:0 txqueuelen:32 RX bytes:0 (0.0 B) TX bytes:0 (0.0 B) vif13.0 Link encap:Ethernet HWaddr fe:ff:ff:ff:ff:ff inet6 addr: fe80::fcff:ffff:feff:ffff/64 Scope:Link UP BROADCAST RUNNING PROMISC MULTICAST MTU:1500 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:0 errors:0 dropped:22137 overruns:0 carrier:0 collisions:0 txqueuelen:32 RX bytes:0 (0.0 B) TX bytes:0 (0.0 B) vif13.1 Link encap:Ethernet HWaddr fe:ff:ff:ff:ff:ff inet6 addr: fe80::fcff:ffff:feff:ffff/64 Scope:Link UP BROADCAST RUNNING PROMISC MULTICAST MTU:1500 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:0 errors:0 dropped:78991 overruns:0 carrier:0 collisions:0 txqueuelen:32 RX bytes:0 (0.0 B) TX bytes:0 (0.0 B) vif6.0 Link encap:Ethernet HWaddr fe:ff:ff:ff:ff:ff inet6 addr: fe80::fcff:ffff:feff:ffff/64 Scope:Link UP BROADCAST RUNNING PROMISC MULTICAST MTU:1500 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:0 errors:0 dropped:48 overruns:0 carrier:0 collisions:0 txqueuelen:32 RX bytes:0 (0.0 B) TX bytes:0 (0.0 B) vif6.1 Link encap:Ethernet HWaddr fe:ff:ff:ff:ff:ff inet6 addr: fe80::fcff:ffff:feff:ffff/64 Scope:Link UP BROADCAST RUNNING PROMISC MULTICAST MTU:1500 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:0 errors:0 dropped:110337 overruns:0 carrier:0 collisions:0 txqueuelen:32 RX bytes:0 (0.0 B) TX bytes:0 (0.0 B) I noticed there's some matching in the mac addresses. I tried changing one (thinking it was conflicting) and it stopped working until I changed the mac back. xen:~# cat /etc/xen/trixbox{1,2,3,4,5,6}.conf | grep mac | sort vif = [ 'type=ioemu, mac=00:16:3e:10:78:9b, bridge=br115' , 'type=ioemu, mac=00:16:3e:2a:48:d4, bridge=eth0'] vif = [ 'type=ioemu, mac=00:16:3e:1f:fd:71, bridge=br110' , 'type=ioemu, mac=00:16:3e:44:1b:fd, bridge=eth0'] vif = [ 'type=ioemu, mac=00:16:3e:1f:fd:71, bridge=br112' , 'type=ioemu, mac=00:16:3e:44:1b:fd, bridge=eth0'] #vif = [ 'type=ioemu, mac=00:16:3e:1f:fd:72, bridge=br112' , 'type=ioemu, mac=00:16:3e:44:2b:fd, bridge=eth0'] vif = [ 'type=ioemu, mac=00:16:3e:28:7b:3f, bridge=br111' , 'type=ioemu, mac=00:16:3e:30:bb:a3, bridge=eth0'] vif = [ 'type=ioemu, mac=00:16:3e:60:0e:e2, bridge=br114' , 'type=ioemu, mac=00:16:3e:4d:b6:cb, bridge=eth0'] vif = [ 'type=ioemu, mac=00:16:3e:6b:0a:65, bridge=br113' , 'type=ioemu, mac=00:16:3e:05:09:bf, bridge=eth0'] xen:~# route -n Kernel IP routing table Destination Gateway Genmask Flags Metric Ref Use Iface 192.168.194.0 0.0.0.0 255.255.255.224 U 0 0 0 eth0 192.168.1.0 0.0.0.0 255.255.255.0 U 0 0 0 eth1 0.0.0.0 192.168.194.6 0.0.0.0 UG 0 0 0 eth0 xen:~# arp -an ? (192.168.194.6) at 00:02:fd:73:77:a0 [ether] on eth0