Robert Dunkley
2009-Jan-22 08:41 UTC
[Xen-devel] HVM with PV Drivers - Live Migration broken?
Hi Everyone,
For some reason I cannot migrate HVMs using paravirt drivers. I have
asked the user list but no one seems to know why.
Non para Windows and Linux HVMs migrate OK on my setup but systems
running the Windows GPLPV drivers or Linux KMod paradrivers get stuck,
the receiving Dom0 shows the domain in a paused state and the sending
Dom0 show the domain with migrating- added to the beginning of the name
but it never completes.
I''m running Xen 3.3.0 on Centos 5.2 with DRBD 8.2.6 for shared storage,
NUMA enabled. The VMs will transfer live if I order the transfer very
quickly after starting them (I presume this is because the PV drivers
have not yet loaded). Is this likely a bug or some sort of configuration
issue?
Both Dom 0s show this in the xm dmesg:
save.c:159:d0 HVM restore: Xen changeset was not saved.
XM Log for each looks like this:
Sending Dom0:
[2009-01-21 14:19:33 11509] DEBUG (XendCheckpoint:103) [xc_save]:
/usr/lib64/xen/bin/xc_save 50 15 0 0 5
[2009-01-21 14:19:33 11509] INFO (XendCheckpoint:403) xc_save: could not
read suspend event channel
[2009-01-21 14:19:39 11509] INFO (XendCheckpoint:403) Saving memory
pages: iter 1: sent 982721, skipped 287, delta 6046ms, dom0 47%, target
0%, sent 5326Mb/s, dirtied 2Mb/s 503 pages
[2009-01-21 14:19:39 11509] INFO (XendCheckpoint:403) Saving memory
pages: iter 2: sent 509, skipped 0, delta 23ms, dom0 65%, target 0%,
sent 725Mb/s, dirtied 18Mb/s 13 pages
[2009-01-21 14:19:39 11509] INFO (XendCheckpoint:403) Saving memory
pages: iter 3: sent 0, skipped 13, Start last iteration
[2009-01-21 14:19:39 11509] DEBUG (XendCheckpoint:374) suspend
[2009-01-21 14:19:39 11509] DEBUG (XendCheckpoint:106) In
saveInputHandler suspend
[2009-01-21 14:19:39 11509] DEBUG (XendCheckpoint:108) Suspending 15 ...
[2009-01-21 14:19:39 11509] DEBUG (XendDomainInfo:472)
XendDomainInfo.shutdown(suspend)
[2009-01-21 14:19:39 11509] DEBUG (XendDomainInfo:1443)
XendDomainInfo.handleShutdownWatch
Receiving Dom0:
[2009-01-21 14:19:34 11571] DEBUG (DevController:124) DevController:
writing {''bridge'': ''lanbr'',
''domain'': ''dns2'',
''handle'': ''1'', ''uuid'':
''48bac5cb-2332-8ba8-8d59-484bb2969c59'',
''script'':
''/etc/xen/scripts/vif-bridge'', ''mac'':
''00:16:3e:44:d3:a9'',
''frontend-id'': ''13'',
''state'': ''1'', ''online'':
''1'', ''frontend'':
''/local/domain/13/device/vif/1''} to
/local/domain/0/backend/vif/13/1.
[2009-01-21 14:19:34 11571] DEBUG (XendDomainInfo:1359) Storing domain
details: {''console/port'': ''3'',
''name'': ''dns2'',
''console/limit'':
''1048576'', ''image/suspend-cancel'':
''1'', ''domid'': ''13'',
''vm'':
''/vm/9ef8a7c9-efc1-73c7-40c1-b3013c2f1336'',
''cpu/0/availability'':
''online'', ''memory/target'':
''524288'',
''control/platform-feature-multiprocessor-suspend'':
''1'', ''console/type'':
''ioemu'', ''store/port'':
''2''}
[2009-01-21 14:19:34 11571] INFO (XendCheckpoint:229) restore hvm domain
13, apic=1, pae=1
[2009-01-21 14:19:34 11571] DEBUG (image:300) Stored a VNC password for
vfb access
[2009-01-21 14:19:34 11571] DEBUG (image:743) args: boot, val: c
[2009-01-21 14:19:34 11571] DEBUG (image:743) args: fda, val: None
[2009-01-21 14:19:34 11571] DEBUG (image:743) args: fdb, val: None
[2009-01-21 14:19:34 11571] DEBUG (image:743) args: soundhw, val: None
[2009-01-21 14:19:34 11571] DEBUG (image:743) args: localtime, val: 0
[2009-01-21 14:19:34 11571] DEBUG (image:743) args: serial, val: pty
[2009-01-21 14:19:34 11571] DEBUG (image:743) args: std-vga, val: 0
[2009-01-21 14:19:34 11571] DEBUG (image:743) args: isa, val: 0
[2009-01-21 14:19:34 11571] DEBUG (image:743) args: acpi, val: 1
[2009-01-21 14:19:34 11571] DEBUG (image:743) args: usb, val: 0
[2009-01-21 14:19:34 11571] DEBUG (image:743) args: usbdevice, val: None
[2009-01-21 14:19:34 11571] DEBUG (XendCheckpoint:247)
restore:shadow=0x5, _static_max=0x20000000, _static_min=0x0,
[2009-01-21 14:19:34 11571] DEBUG (balloon:132) Balloon: 23809136 KiB
free; need 537600; done.
[2009-01-21 14:19:34 11571] DEBUG (XendCheckpoint:264) [xc_restore]:
/usr/lib64/xen/bin/xc_restore 4 13 2 3 1 1 1
[2009-01-21 14:19:34 11571] INFO (XendCheckpoint:403) xc_domain_restore
start: p2m_size = f2021
[2009-01-21 14:19:34 11571] INFO (XendCheckpoint:403) Reloading memory
pages: 0%
Thanks,
Rob
The SAQ Group
Registered Office: 18 Chapel Street, Petersfield, Hampshire GU32 3DZ
SAQ is the trading name of SEMTEC Limited. Registered in England & Wales
Company Number: 06481952
http://www.saqnet.co.uk AS29219
SAQ Group Delivers high quality, honestly priced communication and I.T. services
to UK Business.
Broadband : Domains : Email : Hosting : CoLo : Servers : Racks : Transit :
Backups : Managed Networks : Remote Support.
ISPA Member
Find us in http://www.thebestof.co.uk/petersfield
_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xensource.com
http://lists.xensource.com/xen-devel
James Harper
2009-Jan-22 09:11 UTC
RE: [Xen-devel] HVM with PV Drivers - Live Migration broken?
> Hi Everyone, > > For some reason I cannot migrate HVMs using paravirt drivers. I have > asked the user list but no one seems to know why. > > Non para Windows and Linux HVMs migrate OK on my setup but systems > running the Windows GPLPV drivers or Linux KMod paradrivers get stuck, > the receiving Dom0 shows the domain in a paused state and the sending > Dom0 show the domain with migrating- added to the beginning of thename> but it never completes. > > I''m running Xen 3.3.0 on Centos 5.2 with DRBD 8.2.6 for sharedstorage,> NUMA enabled. The VMs will transfer live if I order the transfer very > quickly after starting them (I presume this is because the PV drivers > have not yet loaded). Is this likely a bug or some sort ofconfiguration> issue? >GPLPV has had an on-again off-again love affair with live migration. It would likely be a bug except that you say that the Linux PV-on-HVM drivers won''t migrate either? What version of GPLPV are you using? James _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Pasi Kärkkäinen
2009-Jan-22 12:03 UTC
Re: [Xen-devel] HVM with PV Drivers - Live Migration broken?
On Thu, Jan 22, 2009 at 08:41:09AM -0000, Robert Dunkley wrote:> > Hi Everyone, > > For some reason I cannot migrate HVMs using paravirt drivers. I have > asked the user list but no one seems to know why. > > Non para Windows and Linux HVMs migrate OK on my setup but systems > running the Windows GPLPV drivers or Linux KMod paradrivers get stuck, > the receiving Dom0 shows the domain in a paused state and the sending > Dom0 show the domain with migrating- added to the beginning of the name > but it never completes. > > I''m running Xen 3.3.0 on Centos 5.2 with DRBD 8.2.6 for shared storage, > NUMA enabled. The VMs will transfer live if I order the transfer very > quickly after starting them (I presume this is because the PV drivers > have not yet loaded). Is this likely a bug or some sort of configuration > issue?Have you tried with the default Xen 3.1.2 that comes with CentOS 5.2 ? ie. only with the packages from CentOS 5.2 installed on dom0s. -- Pasi _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Pasi Kärkkäinen
2009-Jan-22 20:05 UTC
Re: [Xen-devel] HVM with PV Drivers - Live Migration broken?
On Thu, Jan 22, 2009 at 02:03:39PM +0200, Pasi Kärkkäinen wrote:> On Thu, Jan 22, 2009 at 08:41:09AM -0000, Robert Dunkley wrote: > > > > Hi Everyone, > > > > For some reason I cannot migrate HVMs using paravirt drivers. I have > > asked the user list but no one seems to know why. > > > > Non para Windows and Linux HVMs migrate OK on my setup but systems > > running the Windows GPLPV drivers or Linux KMod paradrivers get stuck, > > the receiving Dom0 shows the domain in a paused state and the sending > > Dom0 show the domain with migrating- added to the beginning of the name > > but it never completes. > > > > I''m running Xen 3.3.0 on Centos 5.2 with DRBD 8.2.6 for shared storage, > > NUMA enabled. The VMs will transfer live if I order the transfer very > > quickly after starting them (I presume this is because the PV drivers > > have not yet loaded). Is this likely a bug or some sort of configuration > > issue? > > Have you tried with the default Xen 3.1.2 that comes with CentOS 5.2 ? > > ie. only with the packages from CentOS 5.2 installed on dom0s. >If it works with the default CentOS 5.2 Xen packages, you know for sure other parts of your setup/configuration are OK. After that try upgrading to Xen 3.3.1, it has many fixes after 3.3.0. -- Pasi _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Carsten Schiers
2009-Jan-22 21:50 UTC
[Xen-devel] CPUFREQ on a bread-and-butter AMD 4050e part II was: AMD P-States not recognized for Xen 3.3 and 3.4
So, I continued my deep-dive into cpufreq handling for the above mentioned CPU. Compiled and installed xen-unstable.hg and linux-2.6.18-xen.hg as of 16.01.09 with the config from the original Bastian Blank (waldi) kernel I use. I left out dist/install/etc/xen because it killed my network config. Hope this doesn''t introduced finding 3. Finding 1 (good!): no powernow-k8 out of synchs anymore! Finding 2 (good!): no TSC drifts anymore! Finding 3 (bad): DomUs with PCI devices handed over complain that they need also the PCI device of the VGA card (although it doesn''t share an IRQ with the card in question. Although I still have trouble to treat the CPU so bad that the ondemand governor accelerates a bit, I am thinking I''m on the right way. This a bit of reporting just in case others check out the same configuration. BR, Carsten. _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel