Alexander Pirsig
2009-Jun-25 12:26 UTC
[Xen-users] Xen 3.2 Bridge performance problem (debian lenny)
Hello everybody,
at the moment we''re have a strange problem during high load on our
DOMUs
Network services became unavailable for a short period connection time
takes several seconds.
Will the service (tomcat) is still available from inside of the domU
connections from DOM0 and even from other servers hangs.
If tried to desiable checksuming (ethtool -K eth0 tx off) on DOMUs interface
netstat output DOMU is as follows:
netstat -an|awk ''/tcp/ {print $6}''|sort|uniq -c
============================ 231 ESTABLISHED
259 FIN_WAIT2
1 LAST_ACK
6 LISTEN
340 TIME_WAIT
brctl show on DOM0:
============bridge name bridge id STP enabled interfaces
eth0 8000.001ec9edee5e no peth0
vif135.0
vif144.0
xenbr1 8000.001ec9edee60 no eth1
xenbr2 8000.0015178538c2 no eth2
vif134.0
vif137.0
xenbr3 8000.0015178538c3 no eth3
vif143.0
vif148.0
One of DOMUs configuration:
====================kernel =
''/boot/vmlinuz-2.6.26-2-xen-amd64''
ramdisk = ''/boot/initrd.img-2.6.26-2-xen-amd64''
extra=''console=hvc0''
memory = ''2400''
vcpus = ''8''
#
# Disk device(s).
#
root = ''/dev/sda1 ro''
disk = [ ''phy:system/tomcat03-disk,sda1,w'',
''phy:system/tomcat03-swap,sda2,w'' ]
#
# Hostname
#
name = ''tomcat03''
#
# Networking
#
vif = [ ''ip=192.168.0.98,mac=00:16:3E:41:2C:18,bridge=xenbr3''
]
#
# Behaviour
#
on_poweroff = ''destroy''
on_reboot = ''restart''
on_crash = ''restart''
How can I repeat?
Regards,
Alex
_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users
Jeff Sturm
2009-Jun-25 13:53 UTC
RE: [Xen-users] Xen 3.2 Bridge performance problem (debian lenny)
> -----Original Message----- > From: xen-users-bounces@lists.xensource.com [mailto:xen-users- > bounces@lists.xensource.com] On Behalf Of Alexander Pirsig > Sent: Thursday, June 25, 2009 8:27 AM > To: xen-users > Subject: [Xen-users] Xen 3.2 Bridge performance problem (debian lenny) > > at the moment we''re have a strange problem during high load on ourDOMUs> Network services became unavailable for a short period connection time > takes several seconds.Any chance of a loop somewhere in your bridge infrastructure? I solved a problem similar to yours recently by enabling STP (brctl stp <bridge> on). I really don''t see much downside to STP, so I''m considering turning it on for all my dom0 hosts. -Jeff _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Alexander Pirsig
2009-Jun-25 13:59 UTC
Re: [Xen-users] Xen 3.2 Bridge performance problem (debian lenny)
Hi again,
sorry it was my fault the problem is I used (ethtool -K xenbr1 tx off)
in my DOM0-network config which is bad on high loads ;( right config
that works for me looks like that:
# eth1 -> intern 1
iface eth1 inet static
up ifconfig eth1 0.0.0.0 promisc up
# eth1 -> xenbr1
auto xenbr1
iface xenbr1 inet manual
bridge_ports eth1
bridge_fd 1
bridge_stp off
bridge_hello 1
post-up ethtool -K xenbr1 tx on
down ifconfig xenbr1 down
post-down brctl delbr xenbr1
The (ethtool -K xenbr1 tx off) needs to be inside of DOMu on postup
Sorry again,
Cheers,
Alex
Alexander Pirsig wrote:> Hello everybody,
>
> at the moment we''re have a strange problem during high load on our
> DOMUs Network services became unavailable for a short period
> connection time takes several seconds.
>
> Will the service (tomcat) is still available from inside of the domU
> connections from DOM0 and even from other servers hangs.
>
> If tried to desiable checksuming (ethtool -K eth0 tx off) on DOMUs
> interface
>
> netstat output DOMU is as follows:
>
> netstat -an|awk ''/tcp/ {print $6}''|sort|uniq -c
> ============================> 231 ESTABLISHED
> 259 FIN_WAIT2
> 1 LAST_ACK
> 6 LISTEN
> 340 TIME_WAIT
>
>
> brctl show on DOM0:
> ============> bridge name bridge id STP enabled
interfaces
> eth0 8000.001ec9edee5e no peth0
> vif135.0
> vif144.0
> xenbr1 8000.001ec9edee60 no eth1
> xenbr2 8000.0015178538c2 no eth2
> vif134.0
> vif137.0
> xenbr3 8000.0015178538c3 no eth3
> vif143.0
> vif148.0
>
>
> One of DOMUs configuration:
> ====================> kernel =
''/boot/vmlinuz-2.6.26-2-xen-amd64''
> ramdisk = ''/boot/initrd.img-2.6.26-2-xen-amd64''
> extra=''console=hvc0''
> memory = ''2400''
>
> vcpus = ''8''
>
> #
> # Disk device(s).
> #
> root = ''/dev/sda1 ro''
>
> disk = [ ''phy:system/tomcat03-disk,sda1,w'',
> ''phy:system/tomcat03-swap,sda2,w'' ]
>
> #
> # Hostname
> #
> name = ''tomcat03''
>
>
> #
> # Networking
> #
> vif = [
''ip=192.168.0.98,mac=00:16:3E:41:2C:18,bridge=xenbr3'' ]
>
> #
> # Behaviour
> #
> on_poweroff = ''destroy''
> on_reboot = ''restart''
> on_crash = ''restart''
>
>
>
> How can I repeat?
>
> Regards,
>
> Alex
>
>
> _______________________________________________
> Xen-users mailing list
> Xen-users@lists.xensource.com
> http://lists.xensource.com/xen-users
>
_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users
Peter Booth
2009-Jun-25 16:02 UTC
Re: [Xen-users] Xen 3.2 Bridge performance problem (debian lenny)
Just out of interest, do you any domu vmstat mpstat or sar output from the problem time? Sent from my iPhone On Jun 25, 2009, at 9:59 AM, Alexander Pirsig <alex@pirsig.net> wrote:> Hi again, > > sorry it was my fault the problem is I used (ethtool -K xenbr1 tx > off) in my DOM0-network config which is bad on high loads ;( right > config that works for me looks like that: > > # eth1 -> intern 1 > iface eth1 inet static > up ifconfig eth1 0.0.0.0 promisc up > > # eth1 -> xenbr1 > auto xenbr1 > iface xenbr1 inet manual > bridge_ports eth1 > bridge_fd 1 > bridge_stp off > bridge_hello 1 > post-up ethtool -K xenbr1 tx on > down ifconfig xenbr1 down > post-down brctl delbr xenbr1 > > The (ethtool -K xenbr1 tx off) needs to be inside of DOMu on postup > > Sorry again, > > Cheers, > > Alex > > > Alexander Pirsig wrote: >> Hello everybody, >> >> at the moment we''re have a strange problem during high load on our >> DOMUs Network services became unavailable for a short period >> connection time takes several seconds. >> >> Will the service (tomcat) is still available from inside of the >> domU connections from DOM0 and even from other servers hangs. >> >> If tried to desiable checksuming (ethtool -K eth0 tx off) on DOMUs >> interface >> >> netstat output DOMU is as follows: >> >> netstat -an|awk ''/tcp/ {print $6}''|sort|uniq -c >> ============================>> 231 ESTABLISHED >> 259 FIN_WAIT2 >> 1 LAST_ACK >> 6 LISTEN >> 340 TIME_WAIT >> >> >> brctl show on DOM0: >> ============>> bridge name bridge id STP enabled interfaces >> eth0 8000.001ec9edee5e no peth0 >> vif135.0 >> vif144.0 >> xenbr1 8000.001ec9edee60 no eth1 >> xenbr2 8000.0015178538c2 no eth2 >> vif134.0 >> vif137.0 >> xenbr3 8000.0015178538c3 no eth3 >> vif143.0 >> vif148.0 >> >> >> One of DOMUs configuration: >> ====================>> kernel = ''/boot/vmlinuz-2.6.26-2-xen-amd64'' >> ramdisk = ''/boot/initrd.img-2.6.26-2-xen-amd64'' >> extra=''console=hvc0'' >> memory = ''2400'' >> >> vcpus = ''8'' >> >> # >> # Disk device(s). >> # >> root = ''/dev/sda1 ro'' >> >> disk = [ ''phy:system/tomcat03-disk,sda1,w'', ''phy:system/tomcat03- >> swap,sda2,w'' ] >> >> # >> # Hostname >> # >> name = ''tomcat03'' >> >> >> # >> # Networking >> # >> vif = [ ''ip=192.168.0.98,mac=00:16:3E:41:2C:18,bridge=xenbr3'' ] >> >> # >> # Behaviour >> # >> on_poweroff = ''destroy'' >> on_reboot = ''restart'' >> on_crash = ''restart'' >> >> >> >> How can I repeat? >> >> Regards, >> >> Alex >> >> >> _______________________________________________ >> Xen-users mailing list >> Xen-users@lists.xensource.com >> http://lists.xensource.com/xen-users >> > > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xensource.com > http://lists.xensource.com/xen-users_______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users