HI, I compile and build xen 4.1.2 and kernel 3.0.23 from source on ubuntu 11.10. with xm command (xm migrate --live my_vm host2 ) my virtual machine migrate from host1 to host2 successfully, after migration is done, I use (xm list) in host 2 and I can see my_vm in host2 virtual machines list while it is running .it disappear from host1 virtual machines list. I know if migration is successful then some details such as Saving memory pages: iter 1 1: sent 28847, skipped 3921, delta ..... must be appeared in my xend.log.but when I see xend.log below messages appear. [2012-04-17 01:52:07 26453] DEBUG (XendDomainInfo:2498) XendDomainInfo.constructDomain [2012-04-17 01:52:07 26453] DEBUG (balloon:187) Balloon: 538500 KiB free; need 16384; done. [2012-04-17 01:52:07 26453] DEBUG (XendDomain:476) Adding Domain: 7 [2012-04-17 01:52:07 26453] DEBUG (XendDomainInfo:3420) Storing VM details: {''on_xend_stop'': ''ignore'', ''pool_name'': ''Pool-0'', ''shadow_memory'': ''5'', ''uuid'': ''50012590-62ac-0666-115d-91bef70f1cc8'', ''on_reboot'': ''restart'', ''start_time'': ''1334608987.7'', ''on_poweroff'': ''destroy'', ''bootloader_args'': '''', ''on_xend_start'': ''ignore'', ''on_crash'': ''restart'', ''xend/restart_count'': ''0'', ''vcpus'': ''1'', ''vcpu_avail'': ''1'', ''bootloader'': '''', ''image'': "(hvm (kernel '''') (superpages 0) (videoram 4) (hpet 0) (stdvga 0) (loader /usr/lib/xen/boot/hvmloader) (xen_platform_pci 1) (opengl 1) (rtc_timeoffset 0) (pci ()) (hap 1) (localtime 0) (timer_mode 1) (pci_msitranslate 1) (oos 1) (apic 1) (sdl 0) (display :0.0) (vpt_align 1) (serial pty) (vncunused 1) (boot c) (pae 1) (viridian 0) (acpi 1) (vnc 1) (nographic 0) (nomigrate 0) (usb 0) (tsc_mode 0) (guest_os_type default) (device_model /usr/lib/xen/bin/qemu-dm) (pci_power_mgmt 0) (xauthority /root/.Xauthority) (isa 0) (notes (SUSPEND_CANCEL 1)))", ''name'': ''ubuntu''} [2012-04-17 01:52:07 26453] INFO (XendDomainInfo:2357) createDevice: console : {''protocol'': ''vt100'', ''location'': ''3'', ''uuid'': ''743e2e7c-9c5b-3786-bb47-d95f54e85cfd''} [2012-04-17 01:52:07 26453] DEBUG (DevController:95) DevController: writing {''state'': ''1'', ''backend-id'': ''0'', ''backend'': ''/local/domain/0/backend/console/7/0''} to /local/domain/7/device/console/0. [2012-04-17 01:52:07 26453] DEBUG (DevController:97) DevController: writing {''domain'': ''ubuntu'', ''frontend'': ''/local/domain/7/device/console/0'', ''uuid'': ''743e2e7c-9c5b-3786-bb47-d95f54e85cfd'', ''frontend-id'': ''7'', ''state'': ''1'', ''location'': ''3'', ''online'': ''1'', ''protocol'': ''vt100''} to /local/domain/0/backend/console/7/0. [2012-04-17 01:52:07 26453] INFO (XendDomainInfo:2357) createDevice: vfb : {''vncunused'': ''1'', ''other_config'': {''vncunused'': ''1'', ''vnc'': ''1''}, ''vnc'': ''1'', ''uuid'': ''bd8a739a-9a08-ee89-fe7e-547e721fecb0'', ''location'': ''127.0.0.1:5900''} [2012-04-17 01:52:07 26453] DEBUG (DevController:95) DevController: writing {''state'': ''1'', ''backend-id'': ''0'', ''backend'': ''/local/domain/0/backend/vfb/7/0''} to /local/domain/7/device/vfb/0. [2012-04-17 01:52:07 26453] DEBUG (DevController:97) DevController: writing {''vncunused'': ''1'', ''domain'': ''ubuntu'', ''frontend'': ''/local/domain/7/device/vfb/0'', ''uuid'': ''bd8a739a-9a08-ee89-fe7e-547e721fecb0'', ''frontend-id'': ''7'', ''state'': ''1'', ''location'': ''127.0.0.1:5900'', ''online'': ''1'', ''vnc'': ''1''} to /local/domain/0/backend/vfb/7/0. [2012-04-17 01:52:07 26453] INFO (XendDomainInfo:2357) createDevice: vbd : {''uuid'': ''5ae36766-81b1-791e-585d-4a653611923b'', ''bootable'': 1, ''driver'': ''paravirtualised'', ''dev'': ''hda:disk'', ''uname'': ''file:/var/lib/libvirt/images/ubuntu.img'', ''mode'': ''w'', ''VDI'': '''', ''backend'': ''0''} [2012-04-17 01:52:07 26453] DEBUG (DevController:95) DevController: writing {''backend-id'': ''0'', ''virtual-device'': ''768'', ''device-type'': ''disk'', ''state'': ''1'', ''backend'': ''/local/domain/0/backend/vbd/7/768''} to /local/domain/7/device/vbd/768. [2012-04-17 01:52:07 26453] DEBUG (DevController:97) DevController: writing {''domain'': ''ubuntu'', ''frontend'': ''/local/domain/7/device/vbd/768'', ''uuid'': ''5ae36766-81b1-791e-585d-4a653611923b'', ''bootable'': ''1'', ''dev'': ''hda'', ''state'': ''1'', ''params'': ''/var/lib/libvirt/images/ubuntu.img'', ''mode'': ''w'', ''online'': ''1'', ''frontend-id'': ''7'', ''type'': ''file''} to /local/domain/0/backend/vbd/7/768. [2012-04-17 01:52:07 26453] INFO (XendDomainInfo:2357) createDevice: vbd : {''uuid'': ''d891fb8b-1d4b-d023-7d6f-acfd89f92178'', ''bootable'': 0, ''driver'': ''paravirtualised'', ''dev'': ''hdc:cdrom'', ''uname'': ''phy:/dev/cdrom'', ''mode'': ''r'', ''VDI'': '''', ''backend'': ''0''} [2012-04-17 01:52:07 26453] DEBUG (DevController:95) DevController: writing {''backend-id'': ''0'', ''virtual-device'': ''5632'', ''device-type'': ''cdrom'', ''state'': ''1'', ''backend'': ''/local/domain/0/backend/vbd/7/5632''} to /local/domain/7/device/vbd/5632. [2012-04-17 01:52:07 26453] DEBUG (DevController:97) DevController: writing {''domain'': ''ubuntu'', ''frontend'': ''/local/domain/7/device/vbd/5632'', ''uuid'': ''d891fb8b-1d4b-d023-7d6f-acfd89f92178'', ''bootable'': ''0'', ''dev'': ''hdc'', ''state'': ''1'', ''params'': ''/dev/cdrom'', ''mode'': ''r'', ''online'': ''1'', ''frontend-id'': ''7'', ''type'': ''phy''} to /local/domain/0/backend/vbd/7/5632. [2012-04-17 01:52:07 26453] INFO (XendDomainInfo:2357) createDevice: vif : {''bridge'': ''xenbr0'', ''uuid'': ''08cb242e-758e-8284-4250-34d2bd318338'', ''script'': ''/etc/xen/scripts/vif-bridge'', ''mac'': ''00:16:3e:60:30:b1'', ''type'': ''ioemu'', ''backend'': ''0''} [2012-04-17 01:52:07 26453] DEBUG (DevController:95) DevController: writing {''state'': ''1'', ''backend-id'': ''0'', ''backend'': ''/local/domain/0/backend/vif/7/0''} to /local/domain/7/device/vif/0. [2012-04-17 01:52:07 26453] DEBUG (DevController:97) DevController: writing {''bridge'': ''xenbr0'', ''domain'': ''ubuntu'', ''handle'': ''0'', ''uuid'': ''08cb242e-758e-8284-4250-34d2bd318338'', ''script'': ''/etc/xen/scripts/vif-bridge'', ''mac'': ''00:16:3e:60:30:b1'', ''frontend-id'': ''7'', ''state'': ''1'', ''online'': ''1'', ''frontend'': ''/local/domain/7/device/vif/0'', ''type'': ''ioemu''} to /local/domain/0/backend/vif/7/0. [2012-04-17 01:52:07 26453] DEBUG (XendDomainInfo:1794) Storing domain details: {''console/port'': ''3'', ''description'': '''', ''console/limit'': ''1048576'', ''image/suspend-cancel'': ''1'', ''domid'': ''7'', ''vm'': ''/vm/50012590-62ac-0666-115d-91bef70f1cc8'', ''cpu/0/availability'': ''online'', ''memory/target'': ''524288'', ''control/platform-feature-multiprocessor-suspend'': ''1'', ''console/type'': ''ioemu'', ''store/port'': ''2'', ''name'': ''ubuntu''} [2012-04-17 01:52:07 26453] INFO (XendCheckpoint:260) restore hvm domain 7, apic=1, pae=1 [2012-04-17 01:52:07 26453] DEBUG (image:339) No VNC passwd configured for vfb access [2012-04-17 01:52:07 26453] DEBUG (image:891) args: boot, val: c [2012-04-17 01:52:07 26453] DEBUG (image:891) args: fda, val: None [2012-04-17 01:52:07 26453] DEBUG (image:891) args: fdb, val: None [2012-04-17 01:52:07 26453] DEBUG (image:891) args: soundhw, val: None [2012-04-17 01:52:07 26453] DEBUG (image:891) args: localtime, val: 0 [2012-04-17 01:52:07 26453] DEBUG (image:891) args: serial, val: [''pty''] [2012-04-17 01:52:07 26453] DEBUG (image:891) args: std-vga, val: 0 [2012-04-17 01:52:07 26453] DEBUG (image:891) args: isa, val: 0 [2012-04-17 01:52:07 26453] DEBUG (image:891) args: acpi, val: 1 [2012-04-17 01:52:07 26453] DEBUG (image:891) args: usb, val: 0 [2012-04-17 01:52:07 26453] DEBUG (image:891) args: usbdevice, val: None [2012-04-17 01:52:07 26453] DEBUG (image:891) args: gfx_passthru, val: None [2012-04-17 01:52:07 26453] INFO (image:822) Need to create platform device.[domid:7] [2012-04-17 01:52:07 26453] DEBUG (XendCheckpoint:278) restore:shadow=0x5, _static_max=0x20000000, _static_min=0x0, [2012-04-17 01:52:07 26453] DEBUG (XendCheckpoint:305) [xc_restore]: /usr/lib/xen/bin/xc_restore 26 7 2 3 1 1 1 0 [2012-04-17 01:52:16 26453] DEBUG (XendCheckpoint:394) store-mfn 1044476 [2012-04-17 01:52:16 26453] DEBUG (XendDomainInfo:3010) XendDomainInfo.completeRestore [2012-04-17 01:52:16 26453] DEBUG (image:339) No VNC passwd configured for vfb access [2012-04-17 01:52:16 26453] DEBUG (image:891) args: boot, val: c [2012-04-17 01:52:16 26453] DEBUG (image:891) args: fda, val: None [2012-04-17 01:52:16 26453] DEBUG (image:891) args: fdb, val: None [2012-04-17 01:52:16 26453] DEBUG (image:891) args: soundhw, val: None [2012-04-17 01:52:16 26453] DEBUG (image:891) args: localtime, val: 0 [2012-04-17 01:52:16 26453] DEBUG (image:891) args: serial, val: [''pty''] [2012-04-17 01:52:16 26453] DEBUG (image:891) args: std-vga, val: 0 [2012-04-17 01:52:16 26453] DEBUG (image:891) args: isa, val: 0 [2012-04-17 01:52:16 26453] DEBUG (image:891) args: acpi, val: 1 [2012-04-17 01:52:16 26453] DEBUG (image:891) args: usb, val: 0 [2012-04-17 01:52:16 26453] DEBUG (image:891) args: usbdevice, val: None [2012-04-17 01:52:16 26453] DEBUG (image:891) args: gfx_passthru, val: None [2012-04-17 01:52:17 26453] INFO (image:822) Need to create platform device.[domid:7] [2012-04-17 01:52:17 26453] INFO (image:418) spawning device models: /usr/lib/xen/bin/qemu-dm [''/usr/lib/xen/bin/qemu-dm'', ''-d'', ''7'', ''-domain-name'', ''ubuntu'', ''-videoram'', ''4'', ''-vnc'', ''127.0.0.1:0'', ''-vncunused'', ''-vcpus'', ''1'', ''-vcpu_avail'', ''0x1L'', ''-boot'', ''c'', ''-serial'', ''pty'', ''-acpi'', ''-net'', ''nic,vlan=1,macaddr=00:16:3e:60:30:b1,model=rtl8139'', ''-net'', ''tap,vlan=1,ifname=tap7.0,bridge=xenbr0'', ''-M'', ''xenfv'', ''-loadvm'', ''/var/lib/xen/qemu-resume.7''] [2012-04-17 01:52:17 26453] INFO (image:467) device model pid: 26903 [2012-04-17 01:52:17 26453] DEBUG (XendDomainInfo:1794) Storing domain details: {''console/port'': ''3'', ''description'': '''', ''console/limit'': ''1048576'', ''store/port'': ''2'', ''vm'': ''/vm/50012590-62ac-0666-115d-91bef70f1cc8'', ''domid'': ''7'', ''image/suspend-cancel'': ''1'', ''cpu/0/availability'': ''online'', ''memory/target'': ''524288'', ''control/platform-feature-multiprocessor-suspend'': ''1'', ''store/ring-ref'': ''1044476'', ''console/type'': ''ioemu'', ''name'': ''ubuntu''} [2012-04-17 01:52:17 26453] INFO (image:590) waiting for sentinel_fifo [2012-04-17 01:52:17 26453] DEBUG (XendDomainInfo:1881) XendDomainInfo.handleShutdownWatch [2012-04-17 01:52:17 26453] DEBUG (XendDomainInfo:3023) XendDomainInfo.completeRestore done [2012-04-17 01:52:17 26453] DEBUG (DevController:139) Waiting for devices tap2. [2012-04-17 01:52:17 26453] DEBUG (DevController:139) Waiting for devices vif. [2012-04-17 01:52:17 26453] DEBUG (DevController:144) Waiting for 0. [2012-04-17 01:52:17 26453] DEBUG (DevController:628) hotplugStatusCallback /local/domain/0/backend/vif/7/0/hotplug-status. [2012-04-17 01:52:17 26453] DEBUG (DevController:642) hotplugStatusCallback 1. [2012-04-17 01:52:17 26453] DEBUG (DevController:139) Waiting for devices vkbd. [2012-04-17 01:52:17 26453] DEBUG (DevController:139) Waiting for devices ioports. [2012-04-17 01:52:17 26453] DEBUG (DevController:139) Waiting for devices tap. [2012-04-17 01:52:17 26453] DEBUG (DevController:139) Waiting for devices vif2. [2012-04-17 01:52:17 26453] DEBUG (DevController:139) Waiting for devices console. [2012-04-17 01:52:17 26453] DEBUG (DevController:144) Waiting for 0. [2012-04-17 01:52:17 26453] DEBUG (DevController:139) Waiting for devices vscsi. [2012-04-17 01:52:17 26453] DEBUG (DevController:139) Waiting for devices vbd. [2012-04-17 01:52:17 26453] DEBUG (DevController:144) Waiting for 768. [2012-04-17 01:52:17 26453] DEBUG (DevController:628) hotplugStatusCallback /local/domain/0/backend/vbd/7/768/hotplug-status. [2012-04-17 01:52:17 26453] DEBUG (DevController:642) hotplugStatusCallback 1. [2012-04-17 01:52:17 26453] DEBUG (DevController:144) Waiting for 5632. [2012-04-17 01:52:17 26453] DEBUG (DevController:628) hotplugStatusCallback /local/domain/0/backend/vbd/7/5632/hotplug-status. [2012-04-17 01:52:17 26453] DEBUG (DevController:642) hotplugStatusCallback 1. [2012-04-17 01:52:17 26453] DEBUG (DevController:139) Waiting for devices irq. [2012-04-17 01:52:17 26453] DEBUG (DevController:139) Waiting for devices vfb. [2012-04-17 01:52:17 26453] DEBUG (DevController:139) Waiting for devices pci. [2012-04-17 01:52:17 26453] DEBUG (DevController:139) Waiting for devices vusb. [2012-04-17 01:52:17 26453] DEBUG (DevController:139) Waiting for devices vtpm. [2012-04-17 01:54:33 26453] DEBUG (XendCheckpoint:124) [xc_save]: /usr/lib/xen/bin/xc_save 26 7 0 0 5 [2012-04-17 01:54:33 26453] INFO (XendCheckpoint:423) xc_save: failed to get the suspend evtchn port [2012-04-17 01:54:33 26453] INFO (XendCheckpoint:423) [2012-04-17 01:55:04 26453] DEBUG (XendCheckpoint:394) suspend [2012-04-17 01:55:04 26453] DEBUG (XendCheckpoint:127) In saveInputHandler suspend [2012-04-17 01:55:04 26453] DEBUG (XendCheckpoint:129) Suspending 7 ... [2012-04-17 01:55:04 26453] DEBUG (XendDomainInfo:524) XendDomainInfo.shutdown(suspend) [2012-04-17 01:55:04 26453] DEBUG (XendDomainInfo:1881) XendDomainInfo.handleShutdownWatch [2012-04-17 01:55:04 26453] INFO (XendDomainInfo:541) HVM save:remote shutdown dom 7! [2012-04-17 01:55:04 26453] INFO (XendCheckpoint:135) Domain 7 suspended. [2012-04-17 01:55:04 26453] INFO (XendDomainInfo:2078) Domain has shutdown: name=migrating-ubuntu id=7 reason=suspend. [2012-04-17 01:55:04 26453] INFO (image:538) signalDeviceModel:restore dm state to running [2012-04-17 01:55:04 26453] DEBUG (XendCheckpoint:144) Written done [2012-04-17 01:55:04 26453] DEBUG (XendDomainInfo:3071) XendDomainInfo.destroy: domid=7 [2012-04-17 01:55:04 26453] DEBUG (XendDomainInfo:2401) Destroying device model [2012-04-17 01:55:04 26453] INFO (image:615) migrating-ubuntu device model terminated [2012-04-17 01:55:04 26453] DEBUG (XendDomainInfo:2408) Releasing devices [2012-04-17 01:55:04 26453] DEBUG (XendDomainInfo:2414) Removing vif/0 [2012-04-17 01:55:04 26453] DEBUG (XendDomainInfo:1276) XendDomainInfo.destroyDevice: deviceClass = vif, device = vif/0 [2012-04-17 01:55:04 26453] DEBUG (XendDomainInfo:2414) Removing console/0 [2012-04-17 01:55:04 26453] DEBUG (XendDomainInfo:1276) XendDomainInfo.destroyDevice: deviceClass = console, device = console/0 [2012-04-17 01:55:04 26453] DEBUG (XendDomainInfo:2414) Removing vbd/768 [2012-04-17 01:55:04 26453] DEBUG (XendDomainInfo:1276) XendDomainInfo.destroyDevice: deviceClass = vbd, device = vbd/768 [2012-04-17 01:55:04 26453] DEBUG (XendDomainInfo:2414) Removing vbd/5632 [2012-04-17 01:55:04 26453] DEBUG (XendDomainInfo:1276) XendDomainInfo.destroyDevice: deviceClass = vbd, device = vbd/5632 [2012-04-17 01:55:04 26453] DEBUG (XendDomainInfo:2414) Removing vfb/0 [2012-04-17 01:55:04 26453] DEBUG (XendDomainInfo:1276) XendDomainInfo.destroyDevice: deviceClass = vfb, device = vfb/0 [2012-04-17 02:14:21 26453] DEBUG (SrvServer:77) SrvServer.cleanup() [2012-04-17 02:14:21 26453] DEBUG (XMLRPCServer:251) XMLRPCServer.cleanup() [2012-04-17 02:14:21 26453] DEBUG (XMLRPCServer:251) XMLRPCServer.cleanup() [2012-04-17 02:14:21 26453] DEBUG (XendDomain:644) cleanup_domains [2012-04-17 02:14:21 26452] INFO (SrvDaemon:220) Xend exited with status 0. Javanshir Farzin _______________________________________________ Xen-devel mailing list Xen-devel@lists.xen.org http://lists.xen.org/xen-devel