Hi
I''m losing the network connection on both the Dom0 and the
DomU''s,
fx SSH is randomly losing the connection and nfs time-out for 30-60
seconds periods.
I''ve tried "ethtool -K ethN (rx off| sx off| sg off| tso
off)" as
similar threads suggest to correct connection loss, but nothing.
Dom0 is based on Debian Etch Amd64 (AMD Athlon64 X2 3800+, 1GB RAM),
kernel 2.6.18-4, Xen-3.1.0 x86_64. The DomU''s is also Debian Etch
Amd64 (lvm), based on the same kernel and i got a Windows 2003 (hvm)
host. The DomU''s has fixed IP and MAC-address (00:16:3E:00:xx:xx).
The reason I use the binaries instead of the Debian packages is that
couldn''t get Windows 2003 working. It works flawless on 3.1, but
instead it brought the network problem.
Dom0 has 2 NIC''s. Eth0 is 172.16.0.2/27 and lanbr, and eth1 is
dmzbr. Unfortunately I never manageded to put the entire
configuration into "interfaces". But in the end it should give the
same result.
I turned debug on in Xen. And this is the part of the xend.log
either during or right after I lost the ssh connection to Dom0 and
to one of the DomU''s, but not the one mentioned in the log.
/Lars
--------- /etc/network/interfaces ------
auto eth0
iface eth0 inet static
address 172.16.0.2
netmask 255.255.255.224
network 172.16.0.0
broadcast 172.16.0.31
gateway 172.16.0.1
dns-nameservers 172.16.0.3 172.16.0.5
pre-up /etc/xen/scripts/network-bridge start netdev=eth0
bridge=lanbr
auto eth1
iface eth1 inet manual
auto dmzbr
iface dmzbr inet manual
bridge_ports eth1
bridge_stp off
bridge_fd 0
bridge_maxwait 0
bridge_helo 0
---------- Part of xend.log ------------------------
[2007-09-05 12:42:16 5231] DEBUG (__init__:1072) SrvServer.cleanup()
[2007-09-05 12:42:16 5231] DEBUG (__init__:1072) XMLRPCServer.cleanup()
[2007-09-05 12:42:16 5231] DEBUG (__init__:1072) XMLRPCServer.cleanup()
[2007-09-05 12:42:16 5231] DEBUG (__init__:1072) cleanup_domains
[2007-09-05 12:42:16 5227] INFO (__init__:1072) Xend exited with
status 0.
[2007-09-05 12:42:16 6755] INFO (__init__:1072) Xend Daemon started
[2007-09-05 12:42:16 6755] INFO (__init__:1072) Xend changeset: Fri
May 18 15:44:01 2007 +0100 15041:2d268f9a6a8b.
[2007-09-05 12:42:16 6755] INFO (__init__:1072) Xend version: Unknown.
[2007-09-05 12:42:17 6755] DEBUG (__init__:1072)
XendDomainInfo.recreate({''max_vcpu_id'': 1,
''cpu_time'':
174614927787L, ''ssidref'': 0, ''hvm'': 0,
''shutdown_reason'': 0,
''dying'': 0, ''online_vcpus'': 2,
''domid'': 0, ''paused'': 0,
''crashed'':
0, ''running'': 1, ''maxmem_kb'': 17179869180L,
''shutdown'': 0, ''mem_kb'':
247808L, ''handle'': [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0],
''blocked'': 0, ''name'':
''Domain-0''})
[2007-09-05 12:42:17 6755] INFO (__init__:1072) Recreating domain 0,
UUID 00000000-0000-0000-0000-000000000000. at /local/domain/0
[2007-09-05 12:42:17 6755] DEBUG (__init__:1072) Adding Domain: 0
[2007-09-05 12:42:17 6755] DEBUG (__init__:1072) number of vcpus to
use is 0
[2007-09-05 12:42:17 6755] DEBUG (__init__:1072)
XendDomainInfo.recreate({''max_vcpu_id'': 0,
''cpu_time'': 68130304956L,
''ssidref'': 0, ''hvm'': 0,
''shutdown_reason'': 0, ''dying'': 0,
''online_vcpus'': 1, ''domid'': 1,
''paused'': 0, ''crashed'': 0,
''running'':
0, ''maxmem_kb'': 98304L, ''shutdown'': 0,
''mem_kb'': 98304L, ''handle'':
[45, 194, 2, 128, 149, 195, 36, 123, 129, 72, 32, 78, 196, 118, 119,
250], ''blocked'': 1})
[2007-09-05 12:42:17 6755] INFO (__init__:1072) Recreating domain 1,
UUID 2dc20280-95c3-247b-8148-204ec47677fa. at /local/domain/1
[2007-09-05 12:42:17 6755] DEBUG (__init__:1072) Storing domain
details: {''name'': ''Domain-0'',
''console/limit'': ''1048576'',
''memory/target'': ''247808'',
''vm'':
''/vm/00000000-0000-0000-0000-000000000000'',
''domid'': ''0'',
''cpu/0/availability'': ''online'',
''cpu/1/availability'': ''online'',
''control/platform-feature-multiprocessor-suspend'':
''1''}
[2007-09-05 12:42:17 6755] DEBUG (__init__:1072) Adding Domain: 1
[2007-09-05 12:42:17 6755] DEBUG (__init__:1072)
XendDomainInfo.recreate({''max_vcpu_id'': 0,
''cpu_time'': 63343753061L,
''ssidref'': 0, ''hvm'': 0,
''shutdown_reason'': 0, ''dying'': 0,
''online_vcpus'': 1, ''domid'': 2,
''paused'': 0, ''crashed'': 0,
''running'':
0, ''maxmem_kb'': 131072L, ''shutdown'': 0,
''mem_kb'': 131072L, ''handle'':
[97, 175, 25, 215, 96, 111, 86, 16, 38, 151, 206, 97, 225, 211, 7,
127], ''blocked'': 1})
[2007-09-05 12:42:17 6755] DEBUG (__init__:1072)
XendDomainInfo.handleShutdownWatch
[2007-09-05 12:42:17 6755] INFO (__init__:1072) Recreating domain 2,
UUID 61af19d7-606f-5610-2697-ce61e1d3077f. at /local/domain/2
[2007-09-05 12:42:17 6755] DEBUG (__init__:1072) Adding Domain: 2
[2007-09-05 12:42:17 6755] DEBUG (__init__:1072)
XendDomainInfo.recreate({''max_vcpu_id'': 0,
''cpu_time'': 72743415590L,
''ssidref'': 0, ''hvm'': 0,
''shutdown_reason'': 0, ''dying'': 0,
''online_vcpus'': 1, ''domid'': 3,
''paused'': 0, ''crashed'': 0,
''running'':
0, ''maxmem_kb'': 98304L, ''shutdown'': 0,
''mem_kb'': 98304L, ''handle'':
[217, 52, 247, 214, 82, 0, 19, 194, 57, 133, 237, 12, 178, 179, 213,
213], ''blocked'': 1})
[2007-09-05 12:42:17 6755] INFO (__init__:1072) Recreating domain 3,
UUID d934f7d6-5200-13c2-3985-ed0cb2b3d5d5. at /local/domain/3
[2007-09-05 12:42:17 6755] DEBUG (__init__:1072) Adding Domain: 3
[2007-09-05 12:42:17 6755] DEBUG (__init__:1072)
XendDomainInfo.recreate({''max_vcpu_id'': 0,
''cpu_time'': 63398779796L,
''ssidref'': 0, ''hvm'': 1,
''shutdown_reason'': 0, ''dying'': 0,
''online_vcpus'': 1, ''domid'': 4,
''paused'': 0, ''crashed'': 0,
''running'':
0, ''maxmem_kb'': 421888L, ''shutdown'': 0,
''mem_kb'': 413568L, ''handle'':
[13, 169, 8, 145, 186, 187, 232, 7, 250, 51, 87, 144, 27, 235, 245,
175], ''blocked'': 1})
[2007-09-05 12:42:17 6755] INFO (__init__:1072) Recreating domain 4,
UUID 0da90891-babb-e807-fa33-57901bebf5af. at /local/domain/4
[2007-09-05 12:42:17 6755] DEBUG (__init__:1072) args: boot, val: c
[2007-09-05 12:42:17 6755] DEBUG (__init__:1072) args: fda, val: None
[2007-09-05 12:42:17 6755] DEBUG (__init__:1072) args: fdb, val: None
[2007-09-05 12:42:17 6755] DEBUG (__init__:1072) args: soundhw, val:
None
[2007-09-05 12:42:17 6755] DEBUG (__init__:1072) args: localtime, val: 0
[2007-09-05 12:42:17 6755] DEBUG (__init__:1072) args: serial, val: None
[2007-09-05 12:42:17 6755] DEBUG (__init__:1072) args: std-vga, val: 0
[2007-09-05 12:42:17 6755] DEBUG (__init__:1072) args: isa, val: 0
[2007-09-05 12:42:17 6755] DEBUG (__init__:1072) args: acpi, val: 1
[2007-09-05 12:42:17 6755] DEBUG (__init__:1072) args: usb, val: 1
[2007-09-05 12:42:17 6755] DEBUG (__init__:1072) args: usbdevice,
val: None
[2007-09-05 12:42:17 6755] DEBUG (__init__:1072) args: k, val: da
[2007-09-05 12:42:17 6755] DEBUG (__init__:1072) Adding Domain: 4
[2007-09-05 12:42:18 6755] DEBUG (__init__:1072)
XendDomainInfo.handleShutdownWatch
[2007-09-05 12:42:18 6755] DEBUG (__init__:1072)
XendDomainInfo.handleShutdownWatch
[2007-09-05 12:42:18 6755] DEBUG (__init__:1072) Storing domain
details: {''image/entry'':
''18446744071564165120'', ''console/port'':
''2'', ''image/loader'':
''generic'', ''vm'':
''/vm/d934f7d6-5200-13c2-3985-ed0cb2b3d5d5'',
''control/platform-feature-multiprocessor-suspend'':
''1'',
''image/guest-os'': ''linux'',
''image/features/writable-descriptor-tables'':
''1'',
''image/hypercall-page'':
''18446744071564189696'', ''memory/target'':
''98304'', ''image/guest-version'':
''2.6'',
''image/features/supervisor-mode-kernel'':
''1'', ''console/limit'':
''1048576'', ''image/paddr-offset'':
''18446744071562067968'',
''image/virt-base'': ''18446744071562067968'',
''image/suspend-cancel'':
''1'', ''cpu/0/availability'':
''online'',
''image/features/pae-pgdir-above-4gb'': ''1'',
''image/features/writable-page-tables'': ''1'',
''image/features/auto-translated-physmap'':
''1'', ''name'':
''cityhall.dom.dk'', ''domid'':
''3'', ''image/xen-version'':
''xen-3.0''}
[2007-09-05 12:42:18 6755] WARNING (__init__:1072) API call:
VBD.set_device not found
[2007-09-05 12:42:18 6755] WARNING (__init__:1072) API call:
VBD.set_mode not found
[2007-09-05 12:42:18 6755] WARNING (__init__:1072) API call:
VBD.set_type not found
[2007-09-05 12:42:18 6755] WARNING (__init__:1072) API call:
VM.get_auto_power_on not found
[2007-09-05 12:42:18 6755] WARNING (__init__:1072) API call:
VM.set_auto_power_on not found
[2007-09-05 12:42:18 6755] DEBUG (__init__:1072)
XendDomainInfo.handleShutdownWatch
[2007-09-05 12:42:18 6755] WARNING (__init__:1072) API call:
VM.set_VCPUs_max not found
[2007-09-05 12:42:18 6755] WARNING (__init__:1072) API call:
VM.set_VCPUs_at_startup not found
[2007-09-05 12:42:18 6755] DEBUG (__init__:1072)
XendDomainInfo.handleShutdownWatch
[2007-09-05 12:42:18 6755] WARNING (__init__:1072) API call:
debug.get_all not found
[2007-09-05 12:42:18 6755] WARNING (__init__:1072) API call:
console.get_other_config not found
[2007-09-05 12:42:18 6755] WARNING (__init__:1072) API call:
console.set_other_config not found
[2007-09-05 12:42:18 6755] WARNING (__init__:1072) API call:
VIF.get_network not found
[2007-09-05 12:42:18 6755] WARNING (__init__:1072) API call:
VIF.set_device not found
[2007-09-05 12:42:18 6755] WARNING (__init__:1072) API call:
VIF.set_MAC not found
[2007-09-05 12:42:18 6755] WARNING (__init__:1072) API call:
VIF.set_MTU not found
[2007-09-05 12:42:18 6755] WARNING (__init__:1072) API call:
session.get_all_records not found
[2007-09-05 12:42:18 6755] WARNING (__init__:1072) API call:
event.get_record not found
[2007-09-05 12:42:18 6755] WARNING (__init__:1072) API call:
event.get_all not found
[2007-09-05 12:42:18 6755] INFO (__init__:1072) Opening Unix domain
socket XML-RPC server on /var/run/xend/xen-api.sock; authentication
has been disabled for this server.
[2007-09-05 12:42:18 6755] INFO (__init__:1072) Opening Unix domain
socket XML-RPC server on /var/run/xend/xmlrpc.sock.
_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users
Lars Staun Knudsen
2007-Sep-09 20:39 UTC
Re: [Xen-users] Network connection problem (ssh,nfs)
Matthew Haas wrote:> What I ended up doing, after some digging: My xenbr0, peth0, etc. > devices on the dom0s all were using the same MAC address > (ff:ff:ff:ff:ff:fe or something like that)... I found a modified > /etc/xen/scripts/network-bridge script that would let you set the MAC > address of these interfaces via some variable at the start of the > script... so I went and made sure all my Xen machines had unique MAC > addresses for their bridge interfaces.Hi Matthew I read your mail regarding MAC and I started looking in a new direction and searching the maillist etc. Then I noticed that ARP was enabled on the NIC''s and I disabled it. That combined with the ethtool trick has been a successful solution (a stable ssh connection for 9+ hours, so I''m hoping).> I don''t know if it has "fixed the glitch"... as during this I had a set > of domUs that worked just fine, and yet others, hosted on the same > machine, would refuse to work adequately. But it certainly makes the > machines functional.I''m a bit curious of that network script. Because in the beginning, before I discovered the ARP-thing, I tried to change the MAC as you described. Can you perhaps paste it? Are you using fixed mac-addresses on the DomU''s as well? Thanks. /Lars _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users