Velamala, Vivekananda (Vivek)
2009-Jan-04 18:56 UTC
[Xen-devel] "xm migrate VM_ID dest_IP_addr --kemari" fails
Hi
I have a setup where I have an eth2 10GB interface setup a loop back
between two dell 1950 servers. I have enabled VT in the bios. The eth0
interface is on a 1GB network. I am using an iscsi shared drive for the
HVM image.
I have followed the instruction provided in
http://www.osrg.net/kemari/usage.html
Now once everything is setup:
After launching the HVM, I execute the following command:
"xm migrate 3 192.168.20.21 --kemari &"
This after 2-3 seconds gives an error on the console:
"Error: /usr/lib/xen/bin/xc_kemari_save 51 3 0 0 4 failed"
Is this some sort of bug, or there is something wrong with the
configuration I am using.
Thank you in advance for any help you can provide in resolving this
issue.
Vivek.
Additional information:
The xend.log file on the destination server shows some error with mmap
failing. Here is an excerpt:
-------- ---------- -------
[2009-01-03 21:29:09 4814] INFO (XendCheckpoint:277) restore hvm domain
10, apic=1, pae=1
[2009-01-03 21:29:09 4814] DEBUG (image:743) args: boot, val: c
[2009-01-03 21:29:09 4814] DEBUG (image:743) args: fda, val: None
[2009-01-03 21:29:09 4814] DEBUG (image:743) args: fdb, val: None
[2009-01-03 21:29:09 4814] DEBUG (image:743) args: soundhw, val: None
[2009-01-03 21:29:09 4814] DEBUG (image:743) args: localtime, val: 0
[2009-01-03 21:29:09 4814] DEBUG (image:743) args: serial, val: pty
[2009-01-03 21:29:09 4814] DEBUG (image:743) args: std-vga, val: 0
[2009-01-03 21:29:09 4814] DEBUG (image:743) args: isa, val: 0
[2009-01-03 21:29:09 4814] DEBUG (image:743) args: acpi, val: 1
[2009-01-03 21:29:09 4814] DEBUG (image:743) args: usb, val: 0
[2009-01-03 21:29:09 4814] DEBUG (image:743) args: usbdevice, val: None
[2009-01-03 21:29:09 4814] DEBUG (XendCheckpoint:295)
restore:shadow=0x9, _static_max=0x40000000, _static_min=0x0,
[2009-01-03 21:29:09 4814] DEBUG (balloon:132) Balloon: 2564668 KiB
free; need 1065984; done.
[2009-01-03 21:29:09 4814] DEBUG (XendCheckpoint:320) [xc_restore]:
/usr/lib/xen/bin/xc_kemari_restore 15 10 2 3 1 1 1
[2009-01-03 21:29:09 4814] INFO (XendCheckpoint:466) xc_kemari_restore
start: p2m_size = 100000
[2009-01-03 21:29:10 4814] INFO (XendCheckpoint:466) xc_kemari_restore:
shared_info_frame: f2000
[2009-01-03 21:29:10 4814] INFO (XendCheckpoint:466)
xc_map_foreign_batch: mmap failed: Cannot allocate memory
[2009-01-03 21:29:10 4814] INFO (XendCheckpoint:466) ERROR Internal
error: map batch failed
[2009-01-03 21:29:11 4814] INFO (XendCheckpoint:466) Restore exit with
rc=1
[2009-01-03 21:29:11 4814] DEBUG (XendDomainInfo:2420)
XendDomainInfo.destroy: domid=10
[2009-01-03 21:29:11 4814] ERROR (XendDomainInfo:2435)
XendDomainInfo.destroy: domain destruction failed.
Traceback (most recent call last):
File "//usr/lib/python/xen/xend/XendDomainInfo.py", line 2428, in
destroy
xc.domain_pause(self.domid)
Error: (3, ''No such process'')
-------------- ------------- ----------------
Excerpt of logs in the source server:
-------- -------- -----
[2009-01-03 20:58:55 6693] INFO (XendDomain:1174) Domain AES-HVM (3)
unpaused.
[2009-01-03 20:59:48 6693] DEBUG (XendDomainInfo:1974) No device model
[2009-01-03 20:59:48 6693] DEBUG (XendDomainInfo:1976) Releasing devices
[2009-01-03 20:59:48 6693] DEBUG (XendDomainInfo:1974) No device model
[2009-01-03 20:59:48 6693] DEBUG (XendDomainInfo:1976) Releasing devices
[2009-01-03 21:34:29 6693] DEBUG (XendCheckpoint:136) [xc_save]:
/usr/lib/xen/bin/xc_kemari_save 51 3 0 0 4
[2009-01-03 21:34:29 6693] DEBUG (XendCheckpoint:141) [xc_save]:
/usr/lib/xen/bin/xc_kemari_save 51 3 0 0 4
[2009-01-03 21:34:29 6693] INFO (XendCheckpoint:466) xc_kemari_control:
cmd=1
[2009-01-03 21:34:29 6693] INFO (XendCheckpoint:466) kemari_port=8,
kemari_mfn=3008, kemari_ring_size=8
[2009-01-03 21:34:29 6693] INFO (XendCheckpoint:466) xc_kemari_save:
shared_info_frame: 991232
[2009-01-03 21:34:29 6693] INFO (XendCheckpoint:466) xc_kemari_save:
p2m_size: 1048576
[2009-01-03 21:34:29 6693] INFO (XendCheckpoint:466) kemari_restore:
magic_pfns 0: 262142, 1: 262140, 2: 262141
[2009-01-03 21:34:31 6693] INFO (XendCheckpoint:466) kemari_restore:
callback irq 100000000001800Saving memory pages: iter 1 0%ERROR
Internal error: Error when writing to state file (4a) (errno 104)
[2009-01-03 21:34:31 6693] INFO (XendCheckpoint:466) Save exit rc=1
[2009-01-03 21:34:31 6693] INFO (XendCheckpoint:466) ERROR Internal
error: xc_kemari_save failed
[2009-01-03 21:34:31 6693] INFO (XendCheckpoint:466) xc_kemari_control:
cmd=2
[2009-01-03 21:34:31 6693] INFO (XendCheckpoint:466) successufully
execute KEMARI_OP_off
[2009-01-03 21:34:31 6693] ERROR (XendCheckpoint:195) Save failed on
domain AES-HVM (3) - resuming.
Traceback (most recent call last):
File "//usr/lib/python/xen/xend/XendCheckpoint.py", line 163, in
save
forkHelper(cmd, fd, saveInputHandler, False)
File "//usr/lib/python/xen/xend/XendCheckpoint.py", line 454, in
forkHelper
raise XendError("%s failed" % string.join(cmd))
XendError: /usr/lib/xen/bin/xc_kemari_save 51 3 0 0 4 failed
--------- -------- ----------------------
The HVM was launched using the following configuration:
----------- --------- --------------------
name = "AES-HVM"
uuid = "a30857d1-546d-2ad6-f2b7-35e222782c0d"
maxmem = 1024
memory = 1024
vcpus = 1
builder = "hvm"
kernel = "/usr/lib/xen/boot/hvmloader"
boot = "c"
pae = 1
acpi = 1
apic = 1
localtime = 0
on_poweroff = "destroy"
on_reboot = "restart"
on_crash = "restart"
device_model = "/usr/lib/xen/bin/qemu-dm"
sdl = 0
vnc = 0
vncunused = 0
disk = [
"phy:/dev/disk/by-id/scsi-16465616462656166323a3100000000000000000000000
000,hda,w", ",hdc:cdrom,r" ]
vif = [ "mac=00:16:3e:7d:cc:8a,bridge=xenbr0" ]
serial = "pty"
-------------------------------------------
The image is on an iscsi shared drive where the target is on an external
server setup over a 1GB network.
"xm info" on dom0 shows the following:
------------ ---------------
0[root@copper2 xen]# xm info
host : xxx2.yyy.zzz.com
release : 2.6.18.8-xen
version : #1 SMP Thu Dec 11 03:25:15 MST 2008
machine : i686
nr_cpus : 4
nr_nodes : 1
cores_per_socket : 4
threads_per_core : 1
cpu_mhz : 2327
hw_caps :
bfebfbff:20100000:00000000:00000140:000ce3bd:00000000:00000001:00000000
virt_caps : hvm
total_memory : 4090
free_memory : 1464
node_to_cpu : node0:0-3
node_to_memory : node0:1464
xen_major : 3
xen_minor : 3
xen_extra : .1-rc1-pre
xen_caps : xen-3.0-x86_32p hvm-3.0-x86_32 hvm-3.0-x86_32p
xen_scheduler : credit
xen_pagesize : 4096
platform_params : virt_start=0xf5800000
xen_changeset : Thu Sep 25 13:33:50 2008 +0100
18430:19201eebab16
cc_compiler : gcc version 4.1.2 20071124 (Red Hat 4.1.2-42)
cc_compile_by : root
cc_compile_domain : yyy.zzz.com
cc_compile_date : Thu Dec 11 04:40:56 MST 2008
xend_config_format : 4
------ ------- -------
"uname -a" shows the following:
Linux xxx2.yyy.zzz.com 2.6.18.8-xen #1 SMP Thu Dec 11 03:25:15 MST 2008
i686 i686 i386 GNU/Linux
_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xensource.com
http://lists.xensource.com/xen-devel
Possibly Parallel Threads
Wisdom of the Ancients
