Pkg xen devel - Dec 2012 - Bug#679533: Traffic forwarding issue between Xen domU/dom0

retitle Traffic forwarding issue between Xen domU/dom0
thanks

This week again this bug occurred again so we are trying to create some 
kind of reproduce algorithm.

First we've created two virtual machines named 
koekiemonster.bofh.hq.mendix.net and netappsim.bofh.hq.mendix.net. We've 
added 29 vifs to koekiemonster.bofh.hq.mendix.net.

During this tests we've always had a ping running to all ip addresses on 
koekiemonster.bofh.hq.mendix.net.

Dom0 details:
Debian Squeeze 6.0.6
Linux sirius 2.6.32-5-xen-amd64 #1 SMP Sun Sep 23 13:49:30 UTC 2012 
x86_64 GNU/Linux
ii  openvswitch-common                             1.4.0-1~mxbp60+1
ii  openvswitch-controller                         1.4.0-1~mxbp60+1
ii  openvswitch-datapath-module-2.6.32-5-xen-amd64 1.4.0-1~mxbp60+1
ii  openvswitch-pki                                1.4.0-1~mxbp60+1
ii  openvswitch-switch                             1.4.0-1~mxbp60+1
ii  libxenstore3.0                                 4.0.1-5.4
ii  linux-image-2.6.32-5-xen-amd64                 2.6.32-46
ii  linux-image-xen-amd64                          2.6.32+29
ii  openvswitch-datapath-module-2.6.32-5-xen-amd64 1.4.0-1~mxbp60+1
ii  xen-hypervisor-4.0-amd64                       4.0.1-5.4
ii  xen-linux-system-2.6-xen-amd64                 2.6.32+29
ii  xen-linux-system-2.6.32-5-xen-amd64            2.6.32-46
ii  xen-qemu-dm-4.0                                4.0.1-2+squeeze2
ii  xen-utils-4.0                                  4.0.1-5.4
ii  xen-utils-common                               4.0.0-1
ii  xenstore-utils                                 4.0.1-5.4

Test 1 Passed:
250 times xm destroy netappsim.bofh.hq.mendix.net; sleep 2; xm create 
netappsim.bofh.hq.mendix.net

Test 2 Passed:
720 times sleep 90; xm reboot netappsim.bofh.hq.mendix.net

Now we changed our setup, we've added 23 other domU's to the dom0.

Test 3 Passed:
500 times xm destroy netappsim.bofh.hq.mendix.net; sleep 2; xm create 
netappsim.bofh.hq.mendix.net

Test 4 Failed four times in a row with a clean reboot of the dom0.
15 times sleep 90; reboot every domU with 2 seconds sleep between a reboot.

Dom0 details changed, we've upgraded openvswitch to the latest version 
available in Wheezy:
Changed to:
ii  openvswitch-common 
1.4.2+git20120612-9~mxbp60+1
ii  openvswitch-controller 
1.4.2+git20120612-9~mxbp60+1
ii  openvswitch-datapath-module-2.6.32-5-xen-amd64 
1.4.2+git20120612-9~mxbp60+1
ii  openvswitch-pki 
1.4.2+git20120612-9~mxbp60+1
ii  openvswitch-switch 
1.4.2+git20120612-9~mxbp60+1

Test 5 (same test as Test 4) with upgraded openvswitch failed as well.

Installed bridge-utils so we can reproduce this with Linux bridge.
ii  bridge-utils                                   1.4-5

Test 6 (same test as Test 4) with Linux bridge failed as well.

Our first conclusion right now is that the problem is bridge/openvswitch 
independent. Next step we are going
to try is upgrade the dom0 to wheezy and try again.

-- 
Frank Baalbergen - System / Network Engineer
T +31 (0)10 2760434 | frank.baalbergen at mendix.com | www.mendix.com