thr3ads.net - Xen users - [Xen-users] Xen 4.0 - prerequisites for succesfull live migration? [Jul 2011]

If this information is useful, please help other people find it:
Share via:

Danilo Godec

2011-Jul-06 13:19 UTC

[Xen-users] Xen 4.0 - prerequisites for succesfull live migration?

Hi,

I have three Xen hosts running Xen 4.0.2 (OpenSuSE 11.4 based). I also 
have one ''NFS'' server with an NFS export holding VM images and
configuration files.

Each host has a dedicated LAN link directly to the NFS server. I have 
another separated NFS export for VM locking (but I had the same issues 
before).

When I attempt to live migrate a VM, it *looks''*like it''s OK,
but I end
up with a non-responsive VM on the target host.

There are no fail or error lines in the source host xend.log file.

The xend.log file on the target host these ''fail'' or
''error'' lines:

[2011-07-06 14:57:11 26204] INFO (XendCheckpoint:485) read_exact_timed 
failed (select returned 0)
[2011-07-06 14:57:11 26204] INFO (XendCheckpoint:485) ERROR Internal 
error: Error when reading batch size
[2011-07-06 14:57:11 26204] INFO (XendCheckpoint:485) ERROR Internal 
error: error when buffering batch, finishing

I can also see that the VM lock file is changed and shows the VM is 
running on target host as if everything is OK.

Yet the VM is unresponsive - xm console, reboot or shutdown don''t work
-
the only thing I can do is ''destroy'' and re-create the VM.

My typical VM config looks like this:

name="ab1"
description="Apache Bench Server 1"
uuid="5383bef7-0794-4372-8c3d-e211e65e22d9"
memory=1024                    # It should start with 1G
maxmem=16384                # but we want to be able to add memory if needed
vcpu_avail=2                        # this VM should start with 2 VCPUs
vcpus=8                                # but 8 cores are available and 
we want to be able to add some if needed
cpus="1-8"                           # core 0 is
''reserved'' for Domain 0
on_poweroff="destroy"
on_reboot="restart"
on_crash="destroy"
localtime=0
builder="linux"
bootloader="/usr/lib/xen/boot/domUloader.py"
bootargs="--entry=xvda1:/boot/vmlinuz-xen,/boot/initrd-xen"
extra=" 3 mem=4096m xencons=tty apparmor=0"
disk=[ ''tap:aio:/var/lib/xen/images/ab1/ab1.raw,xvda,w'', ]
vif=[ ''mac=00:16:3E:02:00:43,bridge=br0'' ]
vfb=[''type=vnc,vncunused=1'']


What am I missing? Anyone using a similar NFS approach and has live 
migration working OK?


   Danilo


_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

Todd Deshane

2011-Jul-06 18:30 UTC

head link

Re: [Xen-users] Xen 4.0 - prerequisites for succesfull live migration?

On Wed, Jul 6, 2011 at 9:19 AM, Danilo Godec <danilo.godec@agenda.si>
wrote:> Hi,
>
> I have three Xen hosts running Xen 4.0.2 (OpenSuSE 11.4 based). I also have
> one ''NFS'' server with an NFS export holding VM images and
configuration
> files.
>
> Each host has a dedicated LAN link directly to the NFS server. I have
> another separated NFS export for VM locking (but I had the same issues
> before).
>
> When I attempt to live migrate a VM, it *looks''*like it''s
OK, but I end up
> with a non-responsive VM on the target host.
>
> There are no fail or error lines in the source host xend.log file.
>
> The xend.log file on the target host these ''fail'' or
''error'' lines:
>
> [2011-07-06 14:57:11 26204] INFO (XendCheckpoint:485) read_exact_timed
> failed (select returned 0)
> [2011-07-06 14:57:11 26204] INFO (XendCheckpoint:485) ERROR Internal error:
> Error when reading batch size
> [2011-07-06 14:57:11 26204] INFO (XendCheckpoint:485) ERROR Internal error:
> error when buffering batch, finishing
>
> I can also see that the VM lock file is changed and shows the VM is running
> on target host as if everything is OK.
>
> Yet the VM is unresponsive - xm console, reboot or shutdown don''t
work - the
> only thing I can do is ''destroy'' and re-create the VM.
>
> My typical VM config looks like this:
>
> name="ab1"
> description="Apache Bench Server 1"
> uuid="5383bef7-0794-4372-8c3d-e211e65e22d9"
> memory=1024                    # It should start with 1G
> maxmem=16384                # but we want to be able to add memory if
needed
> vcpu_avail=2                        # this VM should start with 2 VCPUs
> vcpus=8                                # but 8 cores are available and we
> want to be able to add some if needed
> cpus="1-8"                           # core 0 is
''reserved'' for Domain 0
> on_poweroff="destroy"
> on_reboot="restart"
> on_crash="destroy"
> localtime=0
> builder="linux"
> bootloader="/usr/lib/xen/boot/domUloader.py"
> bootargs="--entry=xvda1:/boot/vmlinuz-xen,/boot/initrd-xen"
> extra=" 3 mem=4096m xencons=tty apparmor=0"
> disk=[ ''tap:aio:/var/lib/xen/images/ab1/ab1.raw,xvda,w'',
]
> vif=[ ''mac=00:16:3E:02:00:43,bridge=br0'' ]
> vfb=[''type=vnc,vncunused=1'']
>
>
> What am I missing? Anyone using a similar NFS approach and has live
> migration working OK?
>
Can you try an xm save, followed by an xm restore manually to see if
those work? xm migrate is basically just a combination of those.

>
>  Danilo
>
>
> _______________________________________________
> Xen-users mailing list
> Xen-users@lists.xensource.com
> http://lists.xensource.com/xen-users
>


-- 
Todd Deshane
http://www.linkedin.com/in/deshantm
http://www.xen.org/products/cloudxen.html
http://runningxen.com/

_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

Danilo Godec

2011-Jul-06 22:44 UTC

head link

Re: [Xen-users] Xen 4.0 - prerequisites for succesfull live migration?

On 6.7.2011 20:30, Todd Deshane wrote:> Can you try an xm save, followed by an xm restore manually to see if
> those work? xm migrate is basically just a combination of those.
I tried the save / restore on the same host and it doesn''t work - the
restored VM is not responsive.

I f I try ''xm save'' with the VM in this state, I get
''Error: Timeout
waiting for domain 29 to suspend''.


Here''s what I get in xend.log when I save the VM (I removed some of the
lines that were ''repeated'')::

[2011-07-07 00:36:29 3297] DEBUG (XendCheckpoint:127) [xc_save]:
/usr/lib64/xen/bin/xc_save 75 34 0 0 0
[2011-07-07 00:36:30 3297] DEBUG (XendCheckpoint:456) suspended
[2011-07-07 00:36:30 3297] DEBUG (XendCheckpoint:130) In
saveInputHandler suspended
[2011-07-07 00:36:30 3297] DEBUG (XendDomainInfo:4568) Releasing lock
for domain ab1
[2011-07-07 00:36:30 3297] INFO (XendCheckpoint:485) Had 0 unexplained
entries in p2m table
[2011-07-07 00:36:30 3297] INFO (XendCheckpoint:485) Saving memory
pages: iter 1   0%outbuf_write: 4194304 > 4161520@12615696
[2011-07-07 00:36:30 3297] INFO (XendCheckpoint:485) outbuf_write:
4096> 4084@16773132[2011-07-07 00:36:30 3297] INFO (XendCheckpoint:485) outbuf_write:
4194304 > 4132848@12644368
[2011-07-07 00:36:30 3297] INFO (XendCheckpoint:485) outbuf_write:
4194304 > 4169716@12607500
[2011-07-07 00:36:30 3297] INFO (XendCheckpoint:140) Domain 34 suspended.
[2011-07-07 00:36:30 3297] INFO (XendCheckpoint:485) outbuf_write:
4194304 > 4169716@12607500
....
[2011-07-07 00:36:31 3297] INFO (XendCheckpoint:4  5%outbuf_write:
4194304 > 4169716@12607500
....
[2011-07-07 00:36:33 3297] INFO (XendCheckpoint:4 10%outbuf_write:
4194304 > 4169716@12607500
....
[2011-07-07 00:36:38 3297] INFO (XendCheckpoint:4 15%outbuf_write:
4194304 > 4169716@12607500
....
[2011-07-07 00:36:41 3297] INFO (XendCheckpoint:4 20%outbuf_write:
4194304 > 4169716@12607500
....
[2011-07-07 00:36:42 3297] INFO (XendCheckpoint:485) outbuf_write:
77824> 53236@16723980[2011-07-07 00:36:42 3297] INFO (XendCheckpoint:485) outbuf_write:
45056> 28656@16748560 1: sent 262144, skipped 0, delta 12753ms, dom0 67%, target 0%, sent
673Mb/s, dirtied 84Mb/s 32767 pages
[2011-07-07 00:36:42 3297] INFO (XendCheckpoint:485) Total pages sent262144
(0.25x)
[2011-07-07 00:36:42 3297] INFO (XendCheckpoint:485) (of which 0 were
fixups)
[2011-07-07 00:36:42 3297] INFO (XendCheckpoint:485) All memory is saved
[2011-07-07 00:36:42 3297] INFO (XendCheckpoint:485) outbuf_write:
8192> 8156@16769060[2011-07-07 00:36:51 3297] INFO (XendCheckpoint:485) Save exit rc=0
[2011-07-07 00:36:51 3297] DEBUG (XendDomainInfo:3124)
XendDomainInfo.destroy: domid=34
[2011-07-07 00:36:52 3297] DEBUG (XendDomainInfo:2452) Destroying device
model
[2011-07-07 00:36:52 3297] INFO (image:712) migrating-ab1 device model
terminated
[2011-07-07 00:36:52 3297] DEBUG (XendDomainInfo:2459) Releasing devices
[2011-07-07 00:36:52 3297] DEBUG (XendDomainInfo:2465) Removing vif/0
[2011-07-07 00:36:52 3297] DEBUG (XendDomainInfo:1293)
XendDomainInfo.destroyDevice: deviceClass = vif, device = vif/0
[2011-07-07 00:36:52 3297] DEBUG (XendDomainInfo:2465) Removing vkbd/0
[2011-07-07 00:36:52 3297] DEBUG (XendDomainInfo:1293)
XendDomainInfo.destroyDevice: deviceClass = vkbd, device = vkbd/0
[2011-07-07 00:36:52 3297] DEBUG (XendDomainInfo:2465) Removing console/0
[2011-07-07 00:36:52 3297] DEBUG (XendDomainInfo:1293)
XendDomainInfo.destroyDevice: deviceClass = console, device = console/0
[2011-07-07 00:36:52 3297] DEBUG (XendDomainInfo:2465) Removing vbd/51712
[2011-07-07 00:36:52 3297] DEBUG (XendDomainInfo:1293)
XendDomainInfo.destroyDevice: deviceClass = vbd, device = vbd/51712
[2011-07-07 00:36:52 3297] DEBUG (XendDomainInfo:2465) Removing vfb/0
[2011-07-07 00:36:52 3297] DEBUG (XendDomainInfo:1293)
XendDomainInfo.destroyDevice: deviceClass = vfb, device = vfb/0
[2011-07-07 00:36:52 3297] DEBUG (XendDomainInfo:4568) Releasing lock
for domain migrating-ab1
[2011-07-07 00:36:52 3297] DEBUG (XendDomainInfo:2457) No device model
[2011-07-07 00:36:52 3297] DEBUG (XendDomainInfo:2459) Releasing devices
[2011-07-07 00:36:52 3297] DEBUG (XendDomainInfo:2465) Removing vif/0
[2011-07-07 00:36:52 3297] DEBUG (XendDomainInfo:1293)
XendDomainInfo.destroyDevice: deviceClass = vif, device = vif/0
[2011-07-07 00:36:52 3297] DEBUG (XendDomainInfo:2465) Removing vbd/51712
[2011-07-07 00:36:52 3297] DEBUG (XendDomainInfo:1293)
XendDomainInfo.destroyDevice: deviceClass = vbd, device = vbd/51712
[2011-07-07 00:36:52 3297] DEBUG (XendDomainInfo:4568) Releasing lock
for domain migrating-ab1
[2011-07-07 00:36:53 3297] ERROR (XendDomainInfo:4584) Failed to remove
unmanaged directory /xen_locks/5383bef7-0794-4372-8c3d-e211e65e22d9.
Traceback (most recent call last):
  File
"/usr/lib64/python2.7/site-packages/xen/xend/XendDomainInfo.py",
line 4581, in release_running_lock
    if len(os.listdir(path)) == 0:
OSError: [Errno 2] No such file or directory:
''/xen_locks/5383bef7-0794-4372-8c3d-e211e65e22d9''


And here is what I get when I try to restore the VM:

[2011-07-07 00:40:09 3297] DEBUG (XendDomainInfo:237)
XendDomainInfo.restore([''domain'', [''domid'',
''34''], [''cpu_weight'',
''256''], [''cpu_cap'', ''0''],
[''pool_name'', ''Pool-0''],
[''bootloader'',
''/usr/lib/xen/boot/domUloader.py''],
[''vcpus'', ''8''], [''cpus'',
[[''1'', ''2'',
''3'', ''4'', ''5'',
''6'', ''7'', ''8'',
''9'', ''10'', ''11'',
''12'', ''13'', ''14'',
''15'',
''16'', ''17'', ''18'',
''19'', ''20'', ''21'',
''22'', ''23'', ''24'',
''25'', ''26'', ''27'',
''28'', ''29'', ''30'',
''31'', ''32''], [''1'',
''2'', ''3'', ''4'',
''5'', ''6'', ''7'',
''8'',
''9'', ''10'', ''11'',
''12'', ''13'', ''14'',
''15'', ''16'', ''17'',
''18'', ''19'', ''20'',
''21'', ''22'', ''23'',
''24'', ''25'', ''26'',
''27'', ''28'', ''29'',
''30'', ''31'', ''32''],
[''1'', ''2'', ''3'',
''4'', ''5'', ''6'',
''7'', ''8'', ''9'',
''10'', ''11'', ''12'',
''13'',
''14'', ''15'', ''16'',
''17'', ''18'', ''19'',
''20'', ''21'', ''22'',
''23'', ''24'', ''25'',
''26'', ''27'', ''28'',
''29'', ''30'', ''31'',
''32''], [''1'', ''2'',
''3'', ''4'', ''5'',
''6'', ''7'', ''8'',
''9'', ''10'', ''11'',
''12'', ''13'', ''14'',
''15'', ''16'', ''17'',
''18'', ''19'', ''20'',
''21'', ''22'', ''23'',
''24'', ''25'', ''26'',
''27'', ''28'', ''29'',
''30'', ''31'', ''32''],
[''1'', ''2'', ''3'',
''4'', ''5'', ''6'',
''7'', ''8'', ''9'',
''10'',
''11'', ''12'', ''13'',
''14'', ''15'', ''16'',
''17'', ''18'', ''19'',
''20'', ''21'', ''22'',
''23'', ''24'', ''25'',
''26'', ''27'', ''28'',
''29'', ''30'', ''31'',
''32''], [''1'', ''2'',
''3'', ''4'', ''5'',
''6'', ''7'', ''8'',
''9'', ''10'', ''11'',
''12'', ''13'', ''14'',
''15'',
''16'', ''17'', ''18'',
''19'', ''20'', ''21'',
''22'', ''23'', ''24'',
''25'', ''26'', ''27'',
''28'', ''29'', ''30'',
''31'', ''32''], [''1'',
''2'', ''3'', ''4'',
''5'', ''6'', ''7'',
''8'',
''9'', ''10'', ''11'',
''12'', ''13'', ''14'',
''15'', ''16'', ''17'',
''18'', ''19'', ''20'',
''21'', ''22'', ''23'',
''24'', ''25'', ''26'',
''27'', ''28'', ''29'',
''30'', ''31'', ''32''],
[''1'', ''2'', ''3'',
''4'', ''5'', ''6'',
''7'', ''8'', ''9'',
''10'', ''11'', ''12'',
''13'',
''14'', ''15'', ''16'',
''17'', ''18'', ''19'',
''20'', ''21'', ''22'',
''23'', ''24'', ''25'',
''26'', ''27'', ''28'',
''29'', ''30'', ''31'',
''32'']]], [''on_poweroff'',
''destroy''],
[''description'', ''Apache Bench Server 1''],
[''on_crash'', ''destroy''],
[''uuid'',
''5383bef7-0794-4372-8c3d-e211e65e22d9''],
[''bootloader_args'',
''--entry=xvda1:/boot/vmlinuz-xen,/boot/initrd-xen''],
[''name'', ''ab1''],
[''on_reboot'', ''restart''],
[''maxmem'', ''16384''],
[''memory'', ''1024''],
[''shadow_memory'', ''0''],
[''vcpu_avail'', ''2''],
[''features''],
[''on_xend_start'', ''ignore''],
[''on_xend_stop'', ''ignore''],
[''start_time'',
''1309991719.34''], [''cpu_time'',
''7.507435461''], [''online_vcpus'',
''2''],
[''image'', [''linux'',
[''kernel''], [''args'', '' 3 mem=4096m
xencons=tty
apparmor=0''], [''superpages'', ''0''],
[''videoram'', ''4''], [''pci'',
[]],
[''nomigrate'', ''0''],
[''tsc_mode'', ''0''],
[''device_model'',
''/usr/lib/xen/bin/qemu-dm''], [''notes'',
[''FEATURES'',
''writable_page_tables|writable_descriptor_tables|auto_translated_physmap|pae_pgdir_above_4gb|supervisor_mode_kernel''],
[''VIRT_BASE'', ''18446744071562067968''],
[''GUEST_VERSION'', ''2.6''],
[''PADDR_OFFSET'', ''0''],
[''GUEST_OS'', ''linux''],
[''HYPERCALL_PAGE'',
''18446744071562100736''], [''LOADER'',
''generic''], [''INIT_P2M'',
''18446719884453740544''], [''SUSPEND_CANCEL'',
''1''], [''ENTRY'',
''18446744071562076160''], [''XEN_VERSION'',
''xen-3.0'']]]], [''status'',
''2''],
[''state'', ''-b----''],
[''store_mfn'', ''426453''],
[''console_mfn'', ''426452''],
[''device'', [''vif'',
[''bridge'', ''br0''], [''mac'',
''00:16:3E:02:00:43''],
[''script'', ''/etc/xen/scripts/vif-bridge''],
[''uuid'',
''f93b2c80-edb5-5bc1-92d8-a86db1ec3f62''],
[''backend'', ''0'']]],
[''device'',
[''vkbd'', [''backend'',
''0'']]], [''device'',
[''console'', [''protocol'',
''vt100''], [''location'',
''2''], [''uuid'',
''4a2816e7-c6d3-9478-f724-a02d123609fb'']]],
[''device'', [''vbd'',
[''protocol'', ''x86_64-abi''],
[''uuid'',
''d8d0c47e-cb7f-4e50-67e0-08047158a89a''],
[''bootable'', ''1''], [''dev'',
''xvda:disk''], [''uname'',
''file:/var/lib/xen/images/ab1/ab1.raw''],
[''mode'', ''w''], [''backend'',
''0''], [''VDI'']]],
[''device'', [''vfb'',
[''vncunused'', ''1''],
[''vnc'', ''1''], [''uuid'',
''d562419b-452f-24fb-5e30-3bb365b035b2''],
[''location'', ''127.0.0.1:5918''],
[''display'', ''localhost:10.0''],
[''xauthority'', ''/root/.Xauthority'']]]])
[2011-07-07 00:40:09 3297] DEBUG (XendDomainInfo:2549)
XendDomainInfo.constructDomain
[2011-07-07 00:40:09 3297] DEBUG (balloon:239) Balloon: 1665028 KiB
free; need 16384; done.
[2011-07-07 00:40:09 3297] DEBUG (XendDomain:482) Adding Domain: 35
[2011-07-07 00:40:09 3297] DEBUG (image:341) No VNC passwd configured
for vfb access
[2011-07-07 00:40:09 3297] DEBUG (XendCheckpoint:364)
restore:shadow=0x0, _static_max=0x400000000, _static_min=0x0,
[2011-07-07 00:40:09 3297] DEBUG (XendCheckpoint:383) [xc_restore]:
/usr/lib64/xen/bin/xc_restore 75 35 1 2 0 0 0 0
[2011-07-07 00:40:09 3297] INFO (XendCheckpoint:485) xc_domain_restore
start: p2m_size = 100000
[2011-07-07 00:40:09 3297] INFO (XendCheckpoint:485) Reloading memory
pages:   0%
[2011-07-07 00:40:22 3297] INFO (XendCheckpoint:485) ERROR Internal
error: Max batch size exceeded (1970103633). Giving up.
[2011-07-07 00:40:22 3297] INFO (XendCheckpoint:485) ERROR Internal
error: error when buffering batch, finishing
[2011-07-07 00:40:22 3297] INFO (XendCheckpoint:485)
[2011-07-07 00:40:22 3297] INFO (XendCheckpoint:4100%
[2011-07-07 00:40:22 3297] INFO (XendCheckpoint:485) Memory reloaded
(7163 pages)
[2011-07-07 00:40:22 3297] INFO (XendCheckpoint:485) read VCPU 0
[2011-07-07 00:40:22 3297] INFO (XendCheckpoint:485) read VCPU 1
[2011-07-07 00:40:22 3297] INFO (XendCheckpoint:485) Completed
checkpoint load
[2011-07-07 00:40:22 3297] INFO (XendCheckpoint:485) Domain ready to be
built.
[2011-07-07 00:40:22 3297] INFO (XendCheckpoint:485) Restore exit with rc=0
[2011-07-07 00:40:22 3297] DEBUG (XendCheckpoint:456) store-mfn 426230
[2011-07-07 00:40:22 3297] DEBUG (XendCheckpoint:456) console-mfn 426229
[2011-07-07 00:40:22 3297] DEBUG (XendDomainInfo:3061)
XendDomainInfo.completeRestore
[2011-07-07 00:40:23 3297] DEBUG (image:341) No VNC passwd configured
for vfb access
[2011-07-07 00:40:23 3297] INFO (XendDomainInfo:2408) createDevice: vkbd
: {''uuid'':
''972ead7e-6692-ac80-8f01-58dc7f7dbd3c'',
''backend'': ''0''}
[2011-07-07 00:40:23 3297] DEBUG (DevController:95) DevController:
writing {''state'': ''1'',
''backend-id'': ''0'',
''backend'':
''/local/domain/0/backend/vkbd/35/0''} to
/local/domain/35/device/vkbd/0.
[2011-07-07 00:40:23 3297] DEBUG (DevController:97) DevController:
writing {''frontend-id'': ''35'',
''domain'': ''ab1'',
''frontend'':
''/local/domain/35/device/vkbd/0'', ''state'':
''1'', ''online'': ''1''} to
/local/domain/0/backend/vkbd/35/0.
[2011-07-07 00:40:23 3297] INFO (XendDomainInfo:2408) createDevice:
console : {''protocol'': ''vt100'',
''location'': ''2'', ''uuid'':
''4a2816e7-c6d3-9478-f724-a02d123609fb''}
[2011-07-07 00:40:23 3297] DEBUG (DevController:95) DevController:
writing {''state'': ''1'',
''backend-id'': ''0'',
''backend'':
''/local/domain/0/backend/console/35/0''} to
/local/domain/35/device/console/0.
[2011-07-07 00:40:23 3297] DEBUG (DevController:97) DevController:
writing {''domain'': ''ab1'',
''frontend'':
''/local/domain/35/device/console/0'', ''uuid'':
''4a2816e7-c6d3-9478-f724-a02d123609fb'',
''frontend-id'': ''35'',
''state'':
''1'', ''location'': ''2'',
''online'': ''1'', ''protocol'':
''vt100''} to
/local/domain/0/backend/console/35/0.
[2011-07-07 00:40:23 3297] INFO (XendDomainInfo:2408) createDevice: vfb
: {''vncunused'': ''1'',
''vnc'': ''1'', ''xauthority'':
''/root/.Xauthority'',
''other_config'': {''vncunused'':
''1'', ''vnc'': ''1'',
''display'':
''localhost:10.0'', ''xauthority'':
''/root/.Xauthority''}, ''location'':
''127.0.0.1:5918'', ''display'':
''localhost:10.0'', ''uuid'':
''d562419b-452f-24fb-5e30-3bb365b035b2''}
[2011-07-07 00:40:23 3297] DEBUG (DevController:95) DevController:
writing {''state'': ''1'',
''backend-id'': ''0'',
''backend'':
''/local/domain/0/backend/vfb/35/0''} to
/local/domain/35/device/vfb/0.
[2011-07-07 00:40:23 3297] DEBUG (DevController:97) DevController:
writing {''vncunused'': ''1'',
''domain'': ''ab1'',
''frontend'':
''/local/domain/35/device/vfb/0'', ''uuid'':
''d562419b-452f-24fb-5e30-3bb365b035b2'',
''frontend-id'': ''35'',
''state'':
''1'', ''location'':
''127.0.0.1:5918'', ''online'':
''1'', ''vnc'': ''1'',
''display'':
''localhost:10.0'', ''xauthority'':
''/root/.Xauthority''} to
/local/domain/0/backend/vfb/35/0.
[2011-07-07 00:40:23 3297] INFO (XendDomainInfo:2408) createDevice: vbd
: {''protocol'': ''x86_64-abi'',
''uuid'':
''d8d0c47e-cb7f-4e50-67e0-08047158a89a'',
''bootable'': 1, ''driver'':
''paravirtualised'', ''dev'':
''xvda:disk'', ''uname'':
''file:/var/lib/xen/images/ab1/ab1.raw'',
''mode'': ''w'', ''backend'':
''0''}
[2011-07-07 00:40:23 3297] DEBUG (DevController:95) DevController:
writing {''virtual-device'': ''51712'',
''protocol'': ''x86_64-abi'',
''device-type'': ''disk'',
''backend-id'': ''0'',
''state'': ''1'', ''backend'':
''/local/domain/0/backend/vbd/35/51712''} to
/local/domain/35/device/vbd/51712.
[2011-07-07 00:40:23 3297] DEBUG (DevController:97) DevController:
writing {''domain'': ''ab1'',
''frontend'':
''/local/domain/35/device/vbd/51712'', ''uuid'':
''d8d0c47e-cb7f-4e50-67e0-08047158a89a'',
''bootable'': ''1'', ''dev'':
''xvda'',
''state'': ''1'', ''params'':
''/var/lib/xen/images/ab1/ab1.raw'', ''mode'':
''w'',
''online'': ''1'',
''frontend-id'': ''35'',
''type'': ''file''} to
/local/domain/0/backend/vbd/35/51712.
[2011-07-07 00:40:23 3297] INFO (XendDomainInfo:2408) createDevice: vif
: {''bridge'': ''br0'', ''mac'':
''00:16:3E:02:00:43'', ''script'':
''/etc/xen/scripts/vif-bridge'', ''uuid'':
''f93b2c80-edb5-5bc1-92d8-a86db1ec3f62'',
''backend'': ''0''}
[2011-07-07 00:40:23 3297] DEBUG (DevController:95) DevController:
writing {''backend-id'': ''0'',
''mac'': ''00:16:3E:02:00:43'',
''handle'': ''0'',
''state'': ''1'', ''backend'':
''/local/domain/0/backend/vif/35/0''} to
/local/domain/35/device/vif/0.
[2011-07-07 00:40:23 3297] DEBUG (DevController:97) DevController:
writing {''bridge'': ''br0'',
''domain'': ''ab1'', ''handle'':
''0'', ''uuid'':
''f93b2c80-edb5-5bc1-92d8-a86db1ec3f62'',
''script'':
''/etc/xen/scripts/vif-bridge'', ''mac'':
''00:16:3E:02:00:43'',
''frontend-id'': ''35'',
''state'': ''1'', ''online'':
''1'', ''frontend'':
''/local/domain/35/device/vif/0''} to
/local/domain/0/backend/vif/35/0.
[2011-07-07 00:40:23 3297] INFO (image:504) spawning device models:
/usr/lib/xen/bin/qemu-dm [''/usr/lib/xen/bin/qemu-dm'',
''-d'', ''35'',
''-serial'', ''pty'',
''-domain-name'', ''ab1'',
''-videoram'', ''4'', ''-vnc'',
''127.0.0.1:0'', ''-vncunused'',
''-M'', ''xenpv'']
[2011-07-07 00:40:23 3297] INFO (image:553) device model pid: 18012
[2011-07-07 00:40:23 3297] INFO (image:687) waiting for sentinel_fifo
[2011-07-07 00:40:23 3297] DEBUG (XendDomainInfo:3489) Storing VM
details: {''on_xend_stop'': ''ignore'',
''pool_name'': ''Pool-0'',
''shadow_memory'': ''0'',
''uuid'':
''5383bef7-0794-4372-8c3d-e211e65e22d9'',
''on_reboot'': ''restart'',
''start_time'': ''1309991719.34'',
''on_poweroff'':
''destroy'', ''bootloader_args'':
''--entry=xvda1:/boot/vmlinuz-xen,/boot/initrd-xen'',
''on_xend_start'':
''ignore'', ''on_crash'':
''destroy'', ''xend/restart_count'':
''0'', ''vcpus'':
''8'', ''vcpu_avail'': ''2'',
''bootloader'':
''/usr/lib/xen/boot/domUloader.py'',
''image'': "(linux (kernel ) (args '' 3 mem=4096m
xencons=tty apparmor=0'')
(superpages 0) (videoram 4) (pci ()) (nomigrate 0) (tsc_mode 0)
(device_model /usr/lib/xen/bin/qemu-dm) (notes (FEATURES
''writable_page_tables|writable_descriptor_tables|auto_translated_physmap|pae_pgdir_above_4gb|supervisor_mode_kernel'')
(VIRT_BASE 18446744071562067968) (GUEST_VERSION 2.6) (PADDR_OFFSET 0)
(GUEST_OS linux) (HYPERCALL_PAGE 18446744071562100736) (LOADER generic)
(INIT_P2M 18446719884453740544) (SUSPEND_CANCEL 1) (ENTRY
18446744071562076160) (XEN_VERSION xen-3.0)))", ''name'':
''ab1''}
[2011-07-07 00:40:23 3297] DEBUG (XendDomainInfo:1839) Storing domain
details: {''console/ring-ref'': ''426229'',
''image/entry'':
''18446744071562076160'',
''cpu/2/availability'': ''offline'',
''cpu/3/availability'': ''offline'',
''store/ring-ref'': ''426230'',
''image/loader'': ''generic'',
''image/features/writable-page-tables'': ''1'',
''vm'':
''/vm/5383bef7-0794-4372-8c3d-e211e65e22d9'',
''control/platform-feature-multiprocessor-suspend'':
''1'',
''image/guest-os'': ''linux'',
''cpu/1/availability'': ''online'',
''image/features/writable-descriptor-tables'':
''1'', ''cpu/7/availability'':
''offline'', ''image/virt-base'':
''18446744071562067968'', ''memory/target'':
''1048576'', ''image/guest-version'':
''2.6'',
''image/features/supervisor-mode-kernel'':
''1'', ''cpu/4/availability'':
''offline'', ''description'': ''Apache
Bench Server 1'', ''console/limit'':
''1048576'', ''image/paddr-offset'':
''0'', ''image/hypercall-page'':
''18446744071562100736'',
''image/suspend-cancel'': ''1'',
''cpu/5/availability'': ''offline'',
''cpu/0/availability'': ''offline'',
''image/features/pae-pgdir-above-4gb'': ''1'',
''cpu/6/availability'':
''offline'', ''console/type'':
''ioemu'',
''image/features/auto-translated-physmap'':
''1'', ''name'': ''ab1'',
''domid'':
''35'', ''image/xen-version'':
''xen-3.0'', ''image/init-p2m'':
''18446719884453740544'', ''store/port'':
''1''}
[2011-07-07 00:40:23 3297] DEBUG (XendDomainInfo:3076)
XendDomainInfo.completeRestore done
[2011-07-07 00:40:23 3297] DEBUG (DevController:139) Waiting for devices
tap2.
[2011-07-07 00:40:23 3297] DEBUG (XendDomainInfo:1926)
XendDomainInfo.handleShutdownWatch
[2011-07-07 00:40:23 3297] DEBUG (DevController:139) Waiting for devices
vif.
[2011-07-07 00:40:23 3297] DEBUG (DevController:144) Waiting for 0.
[2011-07-07 00:40:23 3297] DEBUG (DevController:671)
hotplugStatusCallback /local/domain/0/backend/vif/35/0/hotplug-status.
[2011-07-07 00:40:23 3297] DEBUG (DevController:685)
hotplugStatusCallback 1.
[2011-07-07 00:40:23 3297] DEBUG (DevController:139) Waiting for devices
vkbd.
[2011-07-07 00:40:23 3297] DEBUG (DevController:139) Waiting for devices
ioports.
[2011-07-07 00:40:23 3297] DEBUG (DevController:139) Waiting for devices
tap.
[2011-07-07 00:40:23 3297] DEBUG (DevController:139) Waiting for devices
vif2.
[2011-07-07 00:40:23 3297] DEBUG (DevController:139) Waiting for devices
console.
[2011-07-07 00:40:23 3297] DEBUG (DevController:144) Waiting for 0.
[2011-07-07 00:40:23 3297] DEBUG (DevController:139) Waiting for devices
vscsi.
[2011-07-07 00:40:23 3297] DEBUG (DevController:139) Waiting for devices
vbd.
[2011-07-07 00:40:23 3297] DEBUG (DevController:144) Waiting for 51712.
[2011-07-07 00:40:24 3297] DEBUG (DevController:671)
hotplugStatusCallback /local/domain/0/backend/vbd/35/51712/hotplug-status.
[2011-07-07 00:40:24 3297] DEBUG (DevController:685)
hotplugStatusCallback 1.
[2011-07-07 00:40:24 3297] DEBUG (DevController:139) Waiting for devices
irq.
[2011-07-07 00:40:24 3297] DEBUG (DevController:139) Waiting for devices
vfb.
[2011-07-07 00:40:24 3297] DEBUG (DevController:139) Waiting for devices
pci.
[2011-07-07 00:40:24 3297] DEBUG (DevController:139) Waiting for devices
vusb.
[2011-07-07 00:40:24 3297] DEBUG (DevController:139) Waiting for devices
vtpm.
[2011-07-07 00:40:24 3297] DEBUG (XendDomainInfo:4539) Acquiring lock
for domain ab1



   Danilo


_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

Todd Deshane

2011-Jul-07 04:06 UTC

head link

Re: [Xen-users] Xen 4.0 - prerequisites for succesfull live migration?

On Wed, Jul 6, 2011 at 6:44 PM, Danilo Godec <danilo.godec@agenda.si>
wrote:> On 6.7.2011 20:30, Todd Deshane wrote:
>> Can you try an xm save, followed by an xm restore manually to see if
>> those work? xm migrate is basically just a combination of those.
>
> I tried the save / restore on the same host and it doesn''t work -
the
> restored VM is not responsive.
>
So this is the first problem. I wonder if there is a known problem
with this specific Xen version or something specific to your setup on
OpenSUSE?

I''ve added the opensuse-virtual list to the CC just in case someone
can shed some light on it. (here is this message in context
http://lists.xensource.com/archives/html/xen-users/2011-07/msg00090.html)

Thanks,
Todd
> I f I try ''xm save'' with the VM in this state, I get
''Error: Timeout
> waiting for domain 29 to suspend''.
>
>
> Here''s what I get in xend.log when I save the VM (I removed some
of the
> lines that were ''repeated'')::
>
> [2011-07-07 00:36:29 3297] DEBUG (XendCheckpoint:127) [xc_save]:
> /usr/lib64/xen/bin/xc_save 75 34 0 0 0
> [2011-07-07 00:36:30 3297] DEBUG (XendCheckpoint:456) suspended
> [2011-07-07 00:36:30 3297] DEBUG (XendCheckpoint:130) In
> saveInputHandler suspended
> [2011-07-07 00:36:30 3297] DEBUG (XendDomainInfo:4568) Releasing lock
> for domain ab1
> [2011-07-07 00:36:30 3297] INFO (XendCheckpoint:485) Had 0 unexplained
> entries in p2m table
> [2011-07-07 00:36:30 3297] INFO (XendCheckpoint:485) Saving memory
> pages: iter 1   0%outbuf_write: 4194304 > 4161520@12615696
> [2011-07-07 00:36:30 3297] INFO (XendCheckpoint:485) outbuf_write: 4096
>> 4084@16773132
> [2011-07-07 00:36:30 3297] INFO (XendCheckpoint:485) outbuf_write:
> 4194304 > 4132848@12644368
> [2011-07-07 00:36:30 3297] INFO (XendCheckpoint:485) outbuf_write:
> 4194304 > 4169716@12607500
> [2011-07-07 00:36:30 3297] INFO (XendCheckpoint:140) Domain 34 suspended.
> [2011-07-07 00:36:30 3297] INFO (XendCheckpoint:485) outbuf_write:
> 4194304 > 4169716@12607500
> ....
> [2011-07-07 00:36:31 3297] INFO (XendCheckpoint:4  5%outbuf_write:
> 4194304 > 4169716@12607500
> ....
> [2011-07-07 00:36:33 3297] INFO (XendCheckpoint:4 10%outbuf_write:
> 4194304 > 4169716@12607500
> ....
> [2011-07-07 00:36:38 3297] INFO (XendCheckpoint:4 15%outbuf_write:
> 4194304 > 4169716@12607500
> ....
> [2011-07-07 00:36:41 3297] INFO (XendCheckpoint:4 20%outbuf_write:
> 4194304 > 4169716@12607500
> ....
> [2011-07-07 00:36:42 3297] INFO (XendCheckpoint:485) outbuf_write: 77824
>> 53236@16723980
> [2011-07-07 00:36:42 3297] INFO (XendCheckpoint:485) outbuf_write: 45056
>> 28656@16748560
>  1: sent 262144, skipped 0, delta 12753ms, dom0 67%, target 0%, sent
> 673Mb/s, dirtied 84Mb/s 32767 pages
> [2011-07-07 00:36:42 3297] INFO (XendCheckpoint:485) Total pages sent>
262144 (0.25x)
> [2011-07-07 00:36:42 3297] INFO (XendCheckpoint:485) (of which 0 were
> fixups)
> [2011-07-07 00:36:42 3297] INFO (XendCheckpoint:485) All memory is saved
> [2011-07-07 00:36:42 3297] INFO (XendCheckpoint:485) outbuf_write: 8192
>> 8156@16769060
> [2011-07-07 00:36:51 3297] INFO (XendCheckpoint:485) Save exit rc=0
> [2011-07-07 00:36:51 3297] DEBUG (XendDomainInfo:3124)
> XendDomainInfo.destroy: domid=34
> [2011-07-07 00:36:52 3297] DEBUG (XendDomainInfo:2452) Destroying device
> model
> [2011-07-07 00:36:52 3297] INFO (image:712) migrating-ab1 device model
> terminated
> [2011-07-07 00:36:52 3297] DEBUG (XendDomainInfo:2459) Releasing devices
> [2011-07-07 00:36:52 3297] DEBUG (XendDomainInfo:2465) Removing vif/0
> [2011-07-07 00:36:52 3297] DEBUG (XendDomainInfo:1293)
> XendDomainInfo.destroyDevice: deviceClass = vif, device = vif/0
> [2011-07-07 00:36:52 3297] DEBUG (XendDomainInfo:2465) Removing vkbd/0
> [2011-07-07 00:36:52 3297] DEBUG (XendDomainInfo:1293)
> XendDomainInfo.destroyDevice: deviceClass = vkbd, device = vkbd/0
> [2011-07-07 00:36:52 3297] DEBUG (XendDomainInfo:2465) Removing console/0
> [2011-07-07 00:36:52 3297] DEBUG (XendDomainInfo:1293)
> XendDomainInfo.destroyDevice: deviceClass = console, device = console/0
> [2011-07-07 00:36:52 3297] DEBUG (XendDomainInfo:2465) Removing vbd/51712
> [2011-07-07 00:36:52 3297] DEBUG (XendDomainInfo:1293)
> XendDomainInfo.destroyDevice: deviceClass = vbd, device = vbd/51712
> [2011-07-07 00:36:52 3297] DEBUG (XendDomainInfo:2465) Removing vfb/0
> [2011-07-07 00:36:52 3297] DEBUG (XendDomainInfo:1293)
> XendDomainInfo.destroyDevice: deviceClass = vfb, device = vfb/0
> [2011-07-07 00:36:52 3297] DEBUG (XendDomainInfo:4568) Releasing lock
> for domain migrating-ab1
> [2011-07-07 00:36:52 3297] DEBUG (XendDomainInfo:2457) No device model
> [2011-07-07 00:36:52 3297] DEBUG (XendDomainInfo:2459) Releasing devices
> [2011-07-07 00:36:52 3297] DEBUG (XendDomainInfo:2465) Removing vif/0
> [2011-07-07 00:36:52 3297] DEBUG (XendDomainInfo:1293)
> XendDomainInfo.destroyDevice: deviceClass = vif, device = vif/0
> [2011-07-07 00:36:52 3297] DEBUG (XendDomainInfo:2465) Removing vbd/51712
> [2011-07-07 00:36:52 3297] DEBUG (XendDomainInfo:1293)
> XendDomainInfo.destroyDevice: deviceClass = vbd, device = vbd/51712
> [2011-07-07 00:36:52 3297] DEBUG (XendDomainInfo:4568) Releasing lock
> for domain migrating-ab1
> [2011-07-07 00:36:53 3297] ERROR (XendDomainInfo:4584) Failed to remove
> unmanaged directory /xen_locks/5383bef7-0794-4372-8c3d-e211e65e22d9.
> Traceback (most recent call last):
>  File
"/usr/lib64/python2.7/site-packages/xen/xend/XendDomainInfo.py",
> line 4581, in release_running_lock
>    if len(os.listdir(path)) == 0:
> OSError: [Errno 2] No such file or directory:
> ''/xen_locks/5383bef7-0794-4372-8c3d-e211e65e22d9''
>
>
> And here is what I get when I try to restore the VM:
>
> [2011-07-07 00:40:09 3297] DEBUG (XendDomainInfo:237)
> XendDomainInfo.restore([''domain'',
[''domid'', ''34''],
[''cpu_weight'',
> ''256''], [''cpu_cap'',
''0''], [''pool_name'',
''Pool-0''], [''bootloader'',
> ''/usr/lib/xen/boot/domUloader.py''],
[''vcpus'', ''8''], [''cpus'',
[[''1'', ''2'',
> ''3'', ''4'', ''5'',
''6'', ''7'', ''8'',
''9'', ''10'', ''11'',
''12'', ''13'', ''14'',
''15'',
> ''16'', ''17'', ''18'',
''19'', ''20'', ''21'',
''22'', ''23'', ''24'',
''25'', ''26'', ''27'',
> ''28'', ''29'', ''30'',
''31'', ''32''], [''1'',
''2'', ''3'', ''4'',
''5'', ''6'', ''7'',
''8'',
> ''9'', ''10'', ''11'',
''12'', ''13'', ''14'',
''15'', ''16'', ''17'',
''18'', ''19'', ''20'',
> ''21'', ''22'', ''23'',
''24'', ''25'', ''26'',
''27'', ''28'', ''29'',
''30'', ''31'', ''32''],
> [''1'', ''2'', ''3'',
''4'', ''5'', ''6'',
''7'', ''8'', ''9'',
''10'', ''11'', ''12'',
''13'',
> ''14'', ''15'', ''16'',
''17'', ''18'', ''19'',
''20'', ''21'', ''22'',
''23'', ''24'', ''25'',
> ''26'', ''27'', ''28'',
''29'', ''30'', ''31'',
''32''], [''1'', ''2'',
''3'', ''4'', ''5'',
> ''6'', ''7'', ''8'',
''9'', ''10'', ''11'',
''12'', ''13'', ''14'',
''15'', ''16'', ''17'',
> ''18'', ''19'', ''20'',
''21'', ''22'', ''23'',
''24'', ''25'', ''26'',
''27'', ''28'', ''29'',
> ''30'', ''31'', ''32''],
[''1'', ''2'', ''3'',
''4'', ''5'', ''6'',
''7'', ''8'', ''9'',
''10'',
> ''11'', ''12'', ''13'',
''14'', ''15'', ''16'',
''17'', ''18'', ''19'',
''20'', ''21'', ''22'',
> ''23'', ''24'', ''25'',
''26'', ''27'', ''28'',
''29'', ''30'', ''31'',
''32''], [''1'', ''2'',
> ''3'', ''4'', ''5'',
''6'', ''7'', ''8'',
''9'', ''10'', ''11'',
''12'', ''13'', ''14'',
''15'',
> ''16'', ''17'', ''18'',
''19'', ''20'', ''21'',
''22'', ''23'', ''24'',
''25'', ''26'', ''27'',
> ''28'', ''29'', ''30'',
''31'', ''32''], [''1'',
''2'', ''3'', ''4'',
''5'', ''6'', ''7'',
''8'',
> ''9'', ''10'', ''11'',
''12'', ''13'', ''14'',
''15'', ''16'', ''17'',
''18'', ''19'', ''20'',
> ''21'', ''22'', ''23'',
''24'', ''25'', ''26'',
''27'', ''28'', ''29'',
''30'', ''31'', ''32''],
> [''1'', ''2'', ''3'',
''4'', ''5'', ''6'',
''7'', ''8'', ''9'',
''10'', ''11'', ''12'',
''13'',
> ''14'', ''15'', ''16'',
''17'', ''18'', ''19'',
''20'', ''21'', ''22'',
''23'', ''24'', ''25'',
> ''26'', ''27'', ''28'',
''29'', ''30'', ''31'',
''32'']]], [''on_poweroff'',
''destroy''],
> [''description'', ''Apache Bench Server
1''], [''on_crash'', ''destroy''],
> [''uuid'',
''5383bef7-0794-4372-8c3d-e211e65e22d9''],
[''bootloader_args'',
> ''--entry=xvda1:/boot/vmlinuz-xen,/boot/initrd-xen''],
[''name'', ''ab1''],
> [''on_reboot'', ''restart''],
[''maxmem'', ''16384''],
[''memory'', ''1024''],
> [''shadow_memory'', ''0''],
[''vcpu_avail'', ''2''],
[''features''],
> [''on_xend_start'', ''ignore''],
[''on_xend_stop'', ''ignore''],
[''start_time'',
> ''1309991719.34''], [''cpu_time'',
''7.507435461''], [''online_vcpus'',
''2''],
> [''image'', [''linux'',
[''kernel''], [''args'', '' 3 mem=4096m
xencons=tty
> apparmor=0''], [''superpages'',
''0''], [''videoram'', ''4''],
[''pci'', []],
> [''nomigrate'', ''0''],
[''tsc_mode'', ''0''],
[''device_model'',
> ''/usr/lib/xen/bin/qemu-dm''], [''notes'',
[''FEATURES'',
>
''writable_page_tables|writable_descriptor_tables|auto_translated_physmap|pae_pgdir_above_4gb|supervisor_mode_kernel''],
> [''VIRT_BASE'', ''18446744071562067968''],
[''GUEST_VERSION'', ''2.6''],
> [''PADDR_OFFSET'', ''0''],
[''GUEST_OS'', ''linux''],
[''HYPERCALL_PAGE'',
> ''18446744071562100736''], [''LOADER'',
''generic''], [''INIT_P2M'',
> ''18446719884453740544''],
[''SUSPEND_CANCEL'', ''1''],
[''ENTRY'',
> ''18446744071562076160''],
[''XEN_VERSION'', ''xen-3.0'']]]],
[''status'', ''2''],
> [''state'', ''-b----''],
[''store_mfn'', ''426453''],
[''console_mfn'', ''426452''],
> [''device'', [''vif'',
[''bridge'', ''br0''], [''mac'',
''00:16:3E:02:00:43''],
> [''script'',
''/etc/xen/scripts/vif-bridge''], [''uuid'',
> ''f93b2c80-edb5-5bc1-92d8-a86db1ec3f62''],
[''backend'', ''0'']]],
[''device'',
> [''vkbd'', [''backend'',
''0'']]], [''device'',
[''console'', [''protocol'',
> ''vt100''], [''location'',
''2''], [''uuid'',
> ''4a2816e7-c6d3-9478-f724-a02d123609fb'']]],
[''device'', [''vbd'',
> [''protocol'', ''x86_64-abi''],
[''uuid'',
> ''d8d0c47e-cb7f-4e50-67e0-08047158a89a''],
[''bootable'', ''1''], [''dev'',
> ''xvda:disk''], [''uname'',
''file:/var/lib/xen/images/ab1/ab1.raw''],
> [''mode'', ''w''],
[''backend'', ''0''],
[''VDI'']]], [''device'',
[''vfb'',
> [''vncunused'', ''1''],
[''vnc'', ''1''], [''uuid'',
> ''d562419b-452f-24fb-5e30-3bb365b035b2''],
[''location'', ''127.0.0.1:5918''],
> [''display'', ''localhost:10.0''],
[''xauthority'', ''/root/.Xauthority'']]]])
> [2011-07-07 00:40:09 3297] DEBUG (XendDomainInfo:2549)
> XendDomainInfo.constructDomain
> [2011-07-07 00:40:09 3297] DEBUG (balloon:239) Balloon: 1665028 KiB
> free; need 16384; done.
> [2011-07-07 00:40:09 3297] DEBUG (XendDomain:482) Adding Domain: 35
> [2011-07-07 00:40:09 3297] DEBUG (image:341) No VNC passwd configured
> for vfb access
> [2011-07-07 00:40:09 3297] DEBUG (XendCheckpoint:364)
> restore:shadow=0x0, _static_max=0x400000000, _static_min=0x0,
> [2011-07-07 00:40:09 3297] DEBUG (XendCheckpoint:383) [xc_restore]:
> /usr/lib64/xen/bin/xc_restore 75 35 1 2 0 0 0 0
> [2011-07-07 00:40:09 3297] INFO (XendCheckpoint:485) xc_domain_restore
> start: p2m_size = 100000
> [2011-07-07 00:40:09 3297] INFO (XendCheckpoint:485) Reloading memory
> pages:   0%
> [2011-07-07 00:40:22 3297] INFO (XendCheckpoint:485) ERROR Internal
> error: Max batch size exceeded (1970103633). Giving up.
> [2011-07-07 00:40:22 3297] INFO (XendCheckpoint:485) ERROR Internal
> error: error when buffering batch, finishing
> [2011-07-07 00:40:22 3297] INFO (XendCheckpoint:485)
> [2011-07-07 00:40:22 3297] INFO (XendCheckpoint:4100%
> [2011-07-07 00:40:22 3297] INFO (XendCheckpoint:485) Memory reloaded
> (7163 pages)
> [2011-07-07 00:40:22 3297] INFO (XendCheckpoint:485) read VCPU 0
> [2011-07-07 00:40:22 3297] INFO (XendCheckpoint:485) read VCPU 1
> [2011-07-07 00:40:22 3297] INFO (XendCheckpoint:485) Completed
> checkpoint load
> [2011-07-07 00:40:22 3297] INFO (XendCheckpoint:485) Domain ready to be
> built.
> [2011-07-07 00:40:22 3297] INFO (XendCheckpoint:485) Restore exit with rc=0
> [2011-07-07 00:40:22 3297] DEBUG (XendCheckpoint:456) store-mfn 426230
> [2011-07-07 00:40:22 3297] DEBUG (XendCheckpoint:456) console-mfn 426229
> [2011-07-07 00:40:22 3297] DEBUG (XendDomainInfo:3061)
> XendDomainInfo.completeRestore
> [2011-07-07 00:40:23 3297] DEBUG (image:341) No VNC passwd configured
> for vfb access
> [2011-07-07 00:40:23 3297] INFO (XendDomainInfo:2408) createDevice: vkbd
> : {''uuid'':
''972ead7e-6692-ac80-8f01-58dc7f7dbd3c'',
''backend'': ''0''}
> [2011-07-07 00:40:23 3297] DEBUG (DevController:95) DevController:
> writing {''state'': ''1'',
''backend-id'': ''0'',
''backend'':
> ''/local/domain/0/backend/vkbd/35/0''} to
/local/domain/35/device/vkbd/0.
> [2011-07-07 00:40:23 3297] DEBUG (DevController:97) DevController:
> writing {''frontend-id'': ''35'',
''domain'': ''ab1'',
''frontend'':
> ''/local/domain/35/device/vkbd/0'',
''state'': ''1'', ''online'':
''1''} to
> /local/domain/0/backend/vkbd/35/0.
> [2011-07-07 00:40:23 3297] INFO (XendDomainInfo:2408) createDevice:
> console : {''protocol'': ''vt100'',
''location'': ''2'', ''uuid'':
> ''4a2816e7-c6d3-9478-f724-a02d123609fb''}
> [2011-07-07 00:40:23 3297] DEBUG (DevController:95) DevController:
> writing {''state'': ''1'',
''backend-id'': ''0'',
''backend'':
> ''/local/domain/0/backend/console/35/0''} to
> /local/domain/35/device/console/0.
> [2011-07-07 00:40:23 3297] DEBUG (DevController:97) DevController:
> writing {''domain'': ''ab1'',
''frontend'':
> ''/local/domain/35/device/console/0'',
''uuid'':
> ''4a2816e7-c6d3-9478-f724-a02d123609fb'',
''frontend-id'': ''35'',
''state'':
> ''1'', ''location'': ''2'',
''online'': ''1'', ''protocol'':
''vt100''} to
> /local/domain/0/backend/console/35/0.
> [2011-07-07 00:40:23 3297] INFO (XendDomainInfo:2408) createDevice: vfb
> : {''vncunused'': ''1'',
''vnc'': ''1'', ''xauthority'':
''/root/.Xauthority'',
> ''other_config'': {''vncunused'':
''1'', ''vnc'': ''1'',
''display'':
> ''localhost:10.0'', ''xauthority'':
''/root/.Xauthority''}, ''location'':
> ''127.0.0.1:5918'', ''display'':
''localhost:10.0'', ''uuid'':
> ''d562419b-452f-24fb-5e30-3bb365b035b2''}
> [2011-07-07 00:40:23 3297] DEBUG (DevController:95) DevController:
> writing {''state'': ''1'',
''backend-id'': ''0'',
''backend'':
> ''/local/domain/0/backend/vfb/35/0''} to
/local/domain/35/device/vfb/0.
> [2011-07-07 00:40:23 3297] DEBUG (DevController:97) DevController:
> writing {''vncunused'': ''1'',
''domain'': ''ab1'',
''frontend'':
> ''/local/domain/35/device/vfb/0'',
''uuid'':
> ''d562419b-452f-24fb-5e30-3bb365b035b2'',
''frontend-id'': ''35'',
''state'':
> ''1'', ''location'':
''127.0.0.1:5918'', ''online'':
''1'', ''vnc'': ''1'',
''display'':
> ''localhost:10.0'', ''xauthority'':
''/root/.Xauthority''} to
> /local/domain/0/backend/vfb/35/0.
> [2011-07-07 00:40:23 3297] INFO (XendDomainInfo:2408) createDevice: vbd
> : {''protocol'': ''x86_64-abi'',
''uuid'':
> ''d8d0c47e-cb7f-4e50-67e0-08047158a89a'',
''bootable'': 1, ''driver'':
> ''paravirtualised'', ''dev'':
''xvda:disk'', ''uname'':
> ''file:/var/lib/xen/images/ab1/ab1.raw'',
''mode'': ''w'', ''backend'':
''0''}
> [2011-07-07 00:40:23 3297] DEBUG (DevController:95) DevController:
> writing {''virtual-device'': ''51712'',
''protocol'': ''x86_64-abi'',
> ''device-type'': ''disk'',
''backend-id'': ''0'',
''state'': ''1'', ''backend'':
> ''/local/domain/0/backend/vbd/35/51712''} to
> /local/domain/35/device/vbd/51712.
> [2011-07-07 00:40:23 3297] DEBUG (DevController:97) DevController:
> writing {''domain'': ''ab1'',
''frontend'':
> ''/local/domain/35/device/vbd/51712'',
''uuid'':
> ''d8d0c47e-cb7f-4e50-67e0-08047158a89a'',
''bootable'': ''1'', ''dev'':
''xvda'',
> ''state'': ''1'',
''params'': ''/var/lib/xen/images/ab1/ab1.raw'',
''mode'': ''w'',
> ''online'': ''1'',
''frontend-id'': ''35'',
''type'': ''file''} to
> /local/domain/0/backend/vbd/35/51712.
> [2011-07-07 00:40:23 3297] INFO (XendDomainInfo:2408) createDevice: vif
> : {''bridge'': ''br0'',
''mac'': ''00:16:3E:02:00:43'',
''script'':
> ''/etc/xen/scripts/vif-bridge'', ''uuid'':
> ''f93b2c80-edb5-5bc1-92d8-a86db1ec3f62'',
''backend'': ''0''}
> [2011-07-07 00:40:23 3297] DEBUG (DevController:95) DevController:
> writing {''backend-id'': ''0'',
''mac'': ''00:16:3E:02:00:43'',
''handle'': ''0'',
> ''state'': ''1'',
''backend'':
''/local/domain/0/backend/vif/35/0''} to
> /local/domain/35/device/vif/0.
> [2011-07-07 00:40:23 3297] DEBUG (DevController:97) DevController:
> writing {''bridge'': ''br0'',
''domain'': ''ab1'', ''handle'':
''0'', ''uuid'':
> ''f93b2c80-edb5-5bc1-92d8-a86db1ec3f62'',
''script'':
> ''/etc/xen/scripts/vif-bridge'', ''mac'':
''00:16:3E:02:00:43'',
> ''frontend-id'': ''35'',
''state'': ''1'', ''online'':
''1'', ''frontend'':
> ''/local/domain/35/device/vif/0''} to
/local/domain/0/backend/vif/35/0.
> [2011-07-07 00:40:23 3297] INFO (image:504) spawning device models:
> /usr/lib/xen/bin/qemu-dm [''/usr/lib/xen/bin/qemu-dm'',
''-d'', ''35'',
> ''-serial'', ''pty'',
''-domain-name'', ''ab1'',
''-videoram'', ''4'', ''-vnc'',
> ''127.0.0.1:0'', ''-vncunused'',
''-M'', ''xenpv'']
> [2011-07-07 00:40:23 3297] INFO (image:553) device model pid: 18012
> [2011-07-07 00:40:23 3297] INFO (image:687) waiting for sentinel_fifo
> [2011-07-07 00:40:23 3297] DEBUG (XendDomainInfo:3489) Storing VM
> details: {''on_xend_stop'': ''ignore'',
''pool_name'': ''Pool-0'',
> ''shadow_memory'': ''0'',
''uuid'':
''5383bef7-0794-4372-8c3d-e211e65e22d9'',
> ''on_reboot'': ''restart'',
''start_time'': ''1309991719.34'',
''on_poweroff'':
> ''destroy'', ''bootloader_args'':
> ''--entry=xvda1:/boot/vmlinuz-xen,/boot/initrd-xen'',
''on_xend_start'':
> ''ignore'', ''on_crash'':
''destroy'', ''xend/restart_count'':
''0'', ''vcpus'':
> ''8'', ''vcpu_avail'':
''2'', ''bootloader'':
''/usr/lib/xen/boot/domUloader.py'',
> ''image'': "(linux (kernel ) (args '' 3
mem=4096m xencons=tty apparmor=0'')
> (superpages 0) (videoram 4) (pci ()) (nomigrate 0) (tsc_mode 0)
> (device_model /usr/lib/xen/bin/qemu-dm) (notes (FEATURES
>
''writable_page_tables|writable_descriptor_tables|auto_translated_physmap|pae_pgdir_above_4gb|supervisor_mode_kernel'')
> (VIRT_BASE 18446744071562067968) (GUEST_VERSION 2.6) (PADDR_OFFSET 0)
> (GUEST_OS linux) (HYPERCALL_PAGE 18446744071562100736) (LOADER generic)
> (INIT_P2M 18446719884453740544) (SUSPEND_CANCEL 1) (ENTRY
> 18446744071562076160) (XEN_VERSION xen-3.0)))",
''name'': ''ab1''}
> [2011-07-07 00:40:23 3297] DEBUG (XendDomainInfo:1839) Storing domain
> details: {''console/ring-ref'': ''426229'',
''image/entry'':
> ''18446744071562076160'',
''cpu/2/availability'': ''offline'',
> ''cpu/3/availability'': ''offline'',
''store/ring-ref'': ''426230'',
> ''image/loader'': ''generic'',
''image/features/writable-page-tables'': ''1'',
> ''vm'':
''/vm/5383bef7-0794-4372-8c3d-e211e65e22d9'',
> ''control/platform-feature-multiprocessor-suspend'':
''1'',
> ''image/guest-os'': ''linux'',
''cpu/1/availability'': ''online'',
> ''image/features/writable-descriptor-tables'':
''1'', ''cpu/7/availability'':
> ''offline'', ''image/virt-base'':
''18446744071562067968'', ''memory/target'':
> ''1048576'', ''image/guest-version'':
''2.6'',
> ''image/features/supervisor-mode-kernel'':
''1'', ''cpu/4/availability'':
> ''offline'', ''description'':
''Apache Bench Server 1'', ''console/limit'':
> ''1048576'', ''image/paddr-offset'':
''0'', ''image/hypercall-page'':
> ''18446744071562100736'',
''image/suspend-cancel'': ''1'',
> ''cpu/5/availability'': ''offline'',
''cpu/0/availability'': ''offline'',
> ''image/features/pae-pgdir-above-4gb'':
''1'', ''cpu/6/availability'':
> ''offline'', ''console/type'':
''ioemu'',
> ''image/features/auto-translated-physmap'':
''1'', ''name'': ''ab1'',
''domid'':
> ''35'', ''image/xen-version'':
''xen-3.0'', ''image/init-p2m'':
> ''18446719884453740544'', ''store/port'':
''1''}
> [2011-07-07 00:40:23 3297] DEBUG (XendDomainInfo:3076)
> XendDomainInfo.completeRestore done
> [2011-07-07 00:40:23 3297] DEBUG (DevController:139) Waiting for devices
> tap2.
> [2011-07-07 00:40:23 3297] DEBUG (XendDomainInfo:1926)
> XendDomainInfo.handleShutdownWatch
> [2011-07-07 00:40:23 3297] DEBUG (DevController:139) Waiting for devices
> vif.
> [2011-07-07 00:40:23 3297] DEBUG (DevController:144) Waiting for 0.
> [2011-07-07 00:40:23 3297] DEBUG (DevController:671)
> hotplugStatusCallback /local/domain/0/backend/vif/35/0/hotplug-status.
> [2011-07-07 00:40:23 3297] DEBUG (DevController:685)
> hotplugStatusCallback 1.
> [2011-07-07 00:40:23 3297] DEBUG (DevController:139) Waiting for devices
> vkbd.
> [2011-07-07 00:40:23 3297] DEBUG (DevController:139) Waiting for devices
> ioports.
> [2011-07-07 00:40:23 3297] DEBUG (DevController:139) Waiting for devices
> tap.
> [2011-07-07 00:40:23 3297] DEBUG (DevController:139) Waiting for devices
> vif2.
> [2011-07-07 00:40:23 3297] DEBUG (DevController:139) Waiting for devices
> console.
> [2011-07-07 00:40:23 3297] DEBUG (DevController:144) Waiting for 0.
> [2011-07-07 00:40:23 3297] DEBUG (DevController:139) Waiting for devices
> vscsi.
> [2011-07-07 00:40:23 3297] DEBUG (DevController:139) Waiting for devices
> vbd.
> [2011-07-07 00:40:23 3297] DEBUG (DevController:144) Waiting for 51712.
> [2011-07-07 00:40:24 3297] DEBUG (DevController:671)
> hotplugStatusCallback /local/domain/0/backend/vbd/35/51712/hotplug-status.
> [2011-07-07 00:40:24 3297] DEBUG (DevController:685)
> hotplugStatusCallback 1.
> [2011-07-07 00:40:24 3297] DEBUG (DevController:139) Waiting for devices
> irq.
> [2011-07-07 00:40:24 3297] DEBUG (DevController:139) Waiting for devices
> vfb.
> [2011-07-07 00:40:24 3297] DEBUG (DevController:139) Waiting for devices
> pci.
> [2011-07-07 00:40:24 3297] DEBUG (DevController:139) Waiting for devices
> vusb.
> [2011-07-07 00:40:24 3297] DEBUG (DevController:139) Waiting for devices
> vtpm.
> [2011-07-07 00:40:24 3297] DEBUG (XendDomainInfo:4539) Acquiring lock
> for domain ab1
>
>
>
>   Danilo
>
>


-- 
Todd Deshane
http://www.linkedin.com/in/deshantm
http://www.xen.org/products/cloudxen.html
http://runningxen.com/

_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

Mark Dokter

2011-Jul-07 09:32 UTC

head link

Re: [Xen-users] Xen 4.0 - prerequisites for succesfull live migration?

On 07/07/2011 06:06 AM, Todd Deshane wrote:> On Wed, Jul 6, 2011 at 6:44 PM, Danilo Godec <danilo.godec@agenda.si>
wrote:
>> On 6.7.2011 20:30, Todd Deshane wrote:
>>> Can you try an xm save, followed by an xm restore manually to see
if
>>> those work? xm migrate is basically just a combination of those.
>>
>> I tried the save / restore on the same host and it doesn''t
work - the
>> restored VM is not responsive.
>>
> 
I had migration and save/restore issues with xen 4.0 on debian and
ubuntu. (See thread "Live migration on xen 4.0.1 fails" on this list
(dated 04/2011).
I did not really find out, what went wrong. Now I use xen 4.1 and
migration works (with 2.6.38+ pv-on-hvm domUs).
> So this is the first problem. I wonder if there is a known problem
> with this specific Xen version or something specific to your setup on
> OpenSUSE?
> 
> I''ve added the opensuse-virtual list to the CC just in case
someone
> can shed some light on it. (here is this message in context
> http://lists.xensource.com/archives/html/xen-users/2011-07/msg00090.html)
> 
> Thanks,
> Todd
> 
regards,

Mark

_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

Danilo Godec

2011-Jul-08 12:15 UTC

head link

Re: [Xen-users] Xen 4.0 - prerequisites for succesfull live migration?

On 07/07/2011 11:32 AM, Mark Dokter wrote:> I had migration and save/restore issues with xen 4.0 on debian and 
> ubuntu. (See thread "Live migration on xen 4.0.1 fails" on this
list
> (dated 04/2011). I did not really find out, what went wrong. Now I use 
> xen 4.1 and migration works (with 2.6.38+ pv-on-hvm domUs).
Thanks, I''ll try to setup a lab to test 4.1...

But in the mean time I made some discoveries:

I''m using the ''vcpus=X'' and
''vcpu_avail=''Y'' to start my VM''s with
''Y''
VCPU''s, but still be able to add some VCPU''s later if needed
(where X is
the number of cores in my biggest server and Y is typically 2).
In this case, live migration fails.

If I omit the ''vcpu_avail'' option and only use
''vcpus=Y'',  live
migration seems to work. However ''xm console'' doesn''t
work after
migration and
''xm shutdown'' doesn''t work either  - instead the CPU
usage according to
xentop shoots up to 100% and ultimately the DomU has to be destroyed.

    Danilo

PS: I''m using para-virtualisation. Would I be better off using HVM?

>
>> So this is the first problem. I wonder if there is a known problem
>> with this specific Xen version or something specific to your setup on
>> OpenSUSE?
>>
>> I''ve added the opensuse-virtual list to the CC just in case
someone
>> can shed some light on it. (here is this message in context
>>
http://lists.xensource.com/archives/html/xen-users/2011-07/msg00090.html)
>>
>> Thanks,
>> Todd
>>
> regards,
>
> Mark
>
> _______________________________________________
> Xen-users mailing list
> Xen-users@lists.xensource.com
> http://lists.xensource.com/xen-users

-- 
Danilo Godec, sistemska podpora / system administration

Predlog! Obiscite prenovljeno spletno stran www.agenda.si

ODPRTA KODA IN LINUX
STORITVE : POSLOVNE RESITVE : UPRAVLJANJE IT : INFRASTRUKTURA IT : IZOBRAZEVANJE
: PROGRAMSKA OPREMA

Visit our updated web page at www.agenda.si

OPEN SOURCE AND LINUX
SERVICES : BUSINESS SOLUTIONS : IT MANAGEMENT : IT INFRASTRUCTURE : TRAINING :
SOFTWARE

_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

Olivier B.

2011-Jul-08 14:35 UTC

head link

Re: [Xen-users] Xen 4.0 - prerequisites for succesfull live migration?

Which kernel are you using on DomU ?

For me, the same DomU can me migrate or no, depending only of the kernel 
used on it. With a 2.6.32.42 pvops, I can''t migrate any DomU, if I 
reboot the DomU with a 2.6.39.2 pvops, it works fine.

Olivier

Le 08/07/2011 14:15, Danilo Godec a écrit :> On 07/07/2011 11:32 AM, Mark Dokter wrote:
>> I had migration and save/restore issues with xen 4.0 on debian and
>> ubuntu. (See thread "Live migration on xen 4.0.1 fails" on
this list
>> (dated 04/2011). I did not really find out, what went wrong. Now I use
>> xen 4.1 and migration works (with 2.6.38+ pv-on-hvm domUs).
>
> Thanks, I''ll try to setup a lab to test 4.1...
>
> But in the mean time I made some discoveries:
>
> I''m using the ''vcpus=X'' and
''vcpu_avail=''Y'' to start my VM''s with
''Y''
> VCPU''s, but still be able to add some VCPU''s later if
needed (where X is
> the number of cores in my biggest server and Y is typically 2).
> In this case, live migration fails.
>
> If I omit the ''vcpu_avail'' option and only use
''vcpus=Y'', live migration
> seems to work. However ''xm console'' doesn''t work
after migration and
> ''xm shutdown'' doesn''t work either - instead the
CPU usage according to
> xentop shoots up to 100% and ultimately the DomU has to be destroyed.
>
>
> Danilo
>
> PS: I''m using para-virtualisation. Would I be better off using
HVM?
>
>
>>
>>> So this is the first problem. I wonder if there is a known problem
>>> with this specific Xen version or something specific to your setup
on
>>> OpenSUSE?
>>>
>>> I''ve added the opensuse-virtual list to the CC just in
case someone
>>> can shed some light on it. (here is this message in context
>>>
http://lists.xensource.com/archives/html/xen-users/2011-07/msg00090.html)
>>>
>>>
>>> Thanks,
>>> Todd
>>>
>> regards,
>>
>> Mark
>>
>> _______________________________________________
>> Xen-users mailing list
>> Xen-users@lists.xensource.com
>> http://lists.xensource.com/xen-users
>
>

_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

George Shuklin

2011-Jul-11 22:01 UTC

head link

Re: [Xen-users] Xen 4.0 - prerequisites for succesfull live migration?

I know this bug:

if vcpu_max > vcpu_online migration of SUSE fails badly. Confirmed with 
2.6.34, 2.6.37 and XCP (xen 3.4) multiple times.


On 08.07.2011 16:15, Danilo Godec wrote:> On 07/07/2011 11:32 AM, Mark Dokter wrote:
>> I had migration and save/restore issues with xen 4.0 on debian and 
>> ubuntu. (See thread "Live migration on xen 4.0.1 fails" on
this list
>> (dated 04/2011). I did not really find out, what went wrong. Now I 
>> use xen 4.1 and migration works (with 2.6.38+ pv-on-hvm domUs).
>
> Thanks, I''ll try to setup a lab to test 4.1...
>
> But in the mean time I made some discoveries:
>
> I''m using the ''vcpus=X'' and
''vcpu_avail=''Y'' to start my VM''s with
''Y''
> VCPU''s, but still be able to add some VCPU''s later if
needed (where X
> is the number of cores in my biggest server and Y is typically 2).
> In this case, live migration fails.
>
> If I omit the ''vcpu_avail'' option and only use
''vcpus=Y'',  live
> migration seems to work. However ''xm console''
doesn''t work after
> migration and
> ''xm shutdown'' doesn''t work either  - instead the
CPU usage according
> to xentop shoots up to 100% and ultimately the DomU has to be destroyed.
>
>
>    Danilo
>
> PS: I''m using para-virtualisation. Would I be better off using
HVM?
>
>
>>
>>> So this is the first problem. I wonder if there is a known problem
>>> with this specific Xen version or something specific to your setup
on
>>> OpenSUSE?
>>>
>>> I''ve added the opensuse-virtual list to the CC just in
case someone
>>> can shed some light on it. (here is this message in context
>>>
http://lists.xensource.com/archives/html/xen-users/2011-07/msg00090.html)
>>>
>>>
>>> Thanks,
>>> Todd
>>>
>> regards,
>>
>> Mark
>>
>> _______________________________________________
>> Xen-users mailing list
>> Xen-users@lists.xensource.com
>> http://lists.xensource.com/xen-users
>
>
_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

Possibly Parallel Threads

Search for more maybe matching threads

Xen users - Jul 2011 - Xen 4.0 - prerequisites for succesfull live migration?

[Xen-users] Xen 4.0 - prerequisites for succesfull live migration?

Re: [Xen-users] Xen 4.0 - prerequisites for succesfull live migration?

Re: [Xen-users] Xen 4.0 - prerequisites for succesfull live migration?

Re: [Xen-users] Xen 4.0 - prerequisites for succesfull live migration?

Re: [Xen-users] Xen 4.0 - prerequisites for succesfull live migration?

Re: [Xen-users] Xen 4.0 - prerequisites for succesfull live migration?

Re: [Xen-users] Xen 4.0 - prerequisites for succesfull live migration?

Re: [Xen-users] Xen 4.0 - prerequisites for succesfull live migration?

Possibly Parallel Threads