I try to get working together vlan and bonding both for dom0 and domU. I
lost packets sent to dom0 while domU is OK.
Nightly stats for dom0:
52879 packets transmitted, 45293 received, 14% packet loss, time 52879599ms
rtt min/avg/max/mdev = 0.144/0.224/717.306/5.129 ms
Nightly stats for domU:
52952 packets transmitted, 52952 received, 0% packet loss, time 52952554ms
rtt min/avg/max/mdev = 0.157/0.209/3.166/0.048 ms
Alsow I ping dom0 on production server (which have no bonding) in same
rack and switch and see no packet drop. I see nothing strange in logs.
System config:
CentOS 5, Kernel 2.6.21, Xen 3.1.0
# brctl show
bridge name bridge id STP enabled interfaces
br0 8000.001d0921ddee no bond0
xenbrVLAN2000 8000.001d0921ddee no vif1.0
bond0.2000
# cat /proc/net/bonding/bond0
Ethernet Channel Bonding Driver: v3.1.2 (January 20, 2007)
Bonding Mode: fault-tolerance (active-backup)
Primary Slave: None
Currently Active Slave: eth0
MII Status: up
MII Polling Interval (ms): 80
Up Delay (ms): 0
Down Delay (ms): 0
Slave Interface: eth0
MII Status: up
Link Failure Count: 0
Permanent HW addr: 00:1d:09:21:dd:ee
Slave Interface: eth1
MII Status: up
Link Failure Count: 0
Permanent HW addr: 00:1d:09:21:dd:f0
# cat /proc/net/vlan/config
VLAN Dev name | VLAN ID
Name-Type: VLAN_NAME_TYPE_RAW_PLUS_VID_NO_PAD
bond0.2000 | 2000 | bond0
I''m sorry if anyone will get this message twice because I sent this
message this mornining and still did not receive it back.
_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users
brudas@iponweb.net wrote:> > I try to get working together vlan and bonding both for dom0 and domU. I > lost packets sent to dom0 while domU is OK. > > Nightly stats for dom0: > 52879 packets transmitted, 45293 received, 14% packet loss, time 52879599ms > rtt min/avg/max/mdev = 0.144/0.224/717.306/5.129 ms > > Nightly stats for domU: > 52952 packets transmitted, 52952 received, 0% packet loss, time 52952554ms > rtt min/avg/max/mdev = 0.157/0.209/3.166/0.048 ms > > Alsow I ping dom0 on production server (which have no bonding) in same > rack and switch and see no packet drop. I see nothing strange in logs. > > System config: > CentOS 5, Kernel 2.6.21, Xen 3.1.0 > > # brctl show > bridge name bridge id STP enabled interfaces > br0 8000.001d0921ddee no bond0 > xenbrVLAN2000 8000.001d0921ddee no vif1.0 > bond0.2000 > # cat /proc/net/bonding/bond0 > Ethernet Channel Bonding Driver: v3.1.2 (January 20, 2007) > > Bonding Mode: fault-tolerance (active-backup) > Primary Slave: None > Currently Active Slave: eth0 > MII Status: up > MII Polling Interval (ms): 80 > Up Delay (ms): 0 > Down Delay (ms): 0 > > Slave Interface: eth0 > MII Status: up > Link Failure Count: 0 > Permanent HW addr: 00:1d:09:21:dd:ee > > Slave Interface: eth1 > MII Status: up > Link Failure Count: 0 > Permanent HW addr: 00:1d:09:21:dd:f0 > > # cat /proc/net/vlan/config > VLAN Dev name | VLAN ID > Name-Type: VLAN_NAME_TYPE_RAW_PLUS_VID_NO_PAD > bond0.2000 | 2000 | bond0 > > I''m sorry if anyone will get this message twice because I sent this > message this mornining and still did not receive it back.I heard on the list that disabling checksum offloading on the NIC with ethtool helps clear it up. I believe it is on TX only and this is of course on the physical interface in dom0. -Ross ______________________________________________________________________ This e-mail, and any attachments thereto, is intended only for use by the addressee(s) named herein and may contain legally privileged and/or confidential information. If you are not the intended recipient of this e-mail, you are hereby notified that any dissemination, distribution or copying of this e-mail, and any attachments thereto, is strictly prohibited. If you have received this e-mail in error, please immediately notify the sender and permanently delete the original and any copy or printout thereof. _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
On Wed, 23 Apr 2008 13:12:11 -0400 "Ross S. W. Walker" <rwalker@medallion.com> wrote:> > I heard on the list that disabling checksum offloading on the NIC > with ethtool helps clear it up. I believe it is on TX only and this > is of course on the physical interface in dom0. >Thanx for your advice. I did: ethtool -K eth0 rx off ethtool -K eth1 rx off ethtool -K eth0 tx off ethtool -K eth1 tx off # ethtool -k eth0 Offload parameters for eth0: Cannot get device udp large send offload settings: Operation not supported rx-checksumming: off tx-checksumming: off scatter-gather: off tcp segmentation offload: off udp fragmentation offload: off generic segmentation offload: off # ethtool -k eth1 Offload parameters for eth1: Cannot get device udp large send offload settings: Operation not supported rx-checksumming: off tx-checksumming: off scatter-gather: off tcp segmentation offload: off udp fragmentation offload: off generic segmentation offload: off There are still packet loss: dom0: 44745 packets transmitted, 43039 received, 3% packet loss, time 44745397ms rtt min/avg/max/mdev = 0.135/0.199/4.386/0.061 ms domU: 44643 packets transmitted, 43879 received, 1% packet loss, time 44643431ms rtt min/avg/max/mdev = 0.153/0.208/2.991/0.043 ms _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Bogdan B. Rudas wrote:> On Wed, 23 Apr 2008 13:12:11 -0400 > "Ross S. W. Walker" <rwalker@medallion.com> wrote: >> I heard on the list that disabling checksum offloading on the NIC >> with ethtool helps clear it up. I believe it is on TX only and this >> is of course on the physical interface in dom0. >> > > Thanx for your advice.[snip]> There are still packet loss:I''m also seeing large amounts of packet loss as displayed in xm top for the vif of any domU which is doing disk and network IO concurrently. Network performance is fine by itself, but when there is disk IO at the same time network gets very bad. Tried disabling checksum offloading and this has made no difference.> dom0: > > 44745 packets transmitted, 43039 received, 3% packet loss, time 44745397ms > rtt min/avg/max/mdev = 0.135/0.199/4.386/0.061 ms > > domU: > > 44643 packets transmitted, 43879 received, 1% packet loss, time 44643431ms > rtt min/avg/max/mdev = 0.153/0.208/2.991/0.043 ms > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xensource.com > http://lists.xensource.com/xen-users_______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users