I''m having issues with HVM live migration and every xen version I''ve tried - 3.0.1, 3.1.x, 3.3.0 and 3.3.1. Migrations will fail intermittently with messages like this on the receiving hypervisor: [2009-02-02 11:35:19 12629] DEBUG (XendCheckpoint:264) [xc_restore]: /usr/lib64/xen/bin/xc_restore 4 4 2 3 1 1 1 [2009-02-02 11:35:19 12629] INFO (XendCheckpoint:403) xc_domain_restore start: p2m_size = 100000 [2009-02-02 11:35:19 12629] INFO (XendCheckpoint:403) Reloading memory pages: 0% [2009-02-02 11:35:23 12629] INFO (XendCheckpoint:403) Received all pages (0 races) [2009-02-02 11:35:23 12629] INFO (XendCheckpoint:403) ERROR Internal error: error setting the HVM context [2009-02-02 11:35:23 12629] INFO (XendCheckpoint:403) Restore exit with rc=1 [2009-02-02 11:35:23 12629] DEBUG (XendDomainInfo:2402) XendDomainInfo.destroy: domid=4 [2009-02-02 11:35:23 12629] ERROR (XendDomainInfo:2416) XendDomainInfo.destroy: domain destruction failed. Traceback (most recent call last): File "/usr/lib64/python2.4/site-packages/xen/xend/XendDomainInfo.py", line 2409, in destroy xc.domain_pause(self.domid) Error: (3, ''No such process'') *xend appears to tear down the failed target vm* [2009-02-02 11:35:23 12629] ERROR (XendDomain:1145) Restore failed Traceback (most recent call last): File "/usr/lib64/python2.4/site-packages/xen/xend/XendDomain.py", line 1143, in domain_restore_fd return XendCheckpoint.restore(self, fd, paused=paused, relocating=relocating) File "/usr/lib64/python2.4/site-packages/xen/xend/XendCheckpoint.py", line 268, in restore forkHelper(cmd, fd, handler.handler, True) File "/usr/lib64/python2.4/site-packages/xen/xend/XendCheckpoint.py", line 391, in forkHelper raise XendError("%s failed" % string.join(cmd)) XendError: /usr/lib64/xen/bin/xc_restore 4 4 2 3 1 1 1 failed and on the sending hypervisor: [2009-02-02 11:57:32 11768] ERROR (XendCheckpoint:157) Save failed on domain xen20 (13) - r esuming. Traceback (most recent call last): File "/usr/lib64/python2.4/site-packages/xen/xend/XendCheckpoint.py", line 135, in save write_exact(fd, buf, "could not write device model state") File "/usr/lib64/python2.4/site-packages/xen/xend/XendCheckpoint.py", line 44, in write_e xact raise XendError(errmsg) XendError: could not write device model state what do "could not write device model state" and "error setting the HVM context" indicate? - jonathan _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Jonathan Dye
2009-Feb-03 23:01 UTC
Re: [Xen-users] HVM Live Migration Troubles - Xen 3.3.1
Jonathan Dye wrote:> I''m having issues with HVM live migration and every xen version I''ve > tried - 3.0.1, 3.1.x, 3.3.0 and 3.3.1. Migrations will fail > intermittently with messages like this on the receiving hypervisor: > > [2009-02-02 11:35:19 12629] DEBUG (XendCheckpoint:264) [xc_restore]: > /usr/lib64/xen/bin/xc_restore 4 4 2 3 1 1 1 > [2009-02-02 11:35:19 12629] INFO (XendCheckpoint:403) > xc_domain_restore start: p2m_size = 100000 > [2009-02-02 11:35:19 12629] INFO (XendCheckpoint:403) Reloading memory > pages: 0% > [2009-02-02 11:35:23 12629] INFO (XendCheckpoint:403) Received all > pages (0 races) > [2009-02-02 11:35:23 12629] INFO (XendCheckpoint:403) ERROR Internal > error: error setting the HVM context > [2009-02-02 11:35:23 12629] INFO (XendCheckpoint:403) Restore exit > with rc=1 > [2009-02-02 11:35:23 12629] DEBUG (XendDomainInfo:2402) > XendDomainInfo.destroy: domid=4 > [2009-02-02 11:35:23 12629] ERROR (XendDomainInfo:2416) > XendDomainInfo.destroy: domain destruction failed. > Traceback (most recent call last): > File "/usr/lib64/python2.4/site-packages/xen/xend/XendDomainInfo.py", > line 2409, in destroy > xc.domain_pause(self.domid) > Error: (3, ''No such process'') > *xend appears to tear down the failed target vm* > [2009-02-02 11:35:23 12629] ERROR (XendDomain:1145) Restore failed > Traceback (most recent call last): > File "/usr/lib64/python2.4/site-packages/xen/xend/XendDomain.py", > line 1143, in domain_restore_fd > return XendCheckpoint.restore(self, fd, paused=paused, > relocating=relocating) > File "/usr/lib64/python2.4/site-packages/xen/xend/XendCheckpoint.py", > line 268, in restore > forkHelper(cmd, fd, handler.handler, True) > File "/usr/lib64/python2.4/site-packages/xen/xend/XendCheckpoint.py", > line 391, in forkHelper > raise XendError("%s failed" % string.join(cmd)) > XendError: /usr/lib64/xen/bin/xc_restore 4 4 2 3 1 1 1 failed > > and on the sending hypervisor: > > [2009-02-02 11:57:32 11768] ERROR (XendCheckpoint:157) Save failed on > domain xen20 (13) - r > esuming. > Traceback (most recent call last): > File "/usr/lib64/python2.4/site-packages/xen/xend/XendCheckpoint.py", > line 135, in save > write_exact(fd, buf, "could not write device model state") > File "/usr/lib64/python2.4/site-packages/xen/xend/XendCheckpoint.py", > line 44, in write_e > xact > raise XendError(errmsg) > XendError: could not write device model state > > what do "could not write device model state" and "error setting the > HVM context" indicate? > > - jonathan > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xensource.com > http://lists.xensource.com/xen-usersis anyone aware of a restriction whereby you cannot live migrate multiple HVMs between the same pair of hypervisors simultaneously? - jonathan _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Pasi Kärkkäinen
2009-Feb-04 10:58 UTC
Re: [Xen-users] HVM Live Migration Troubles - Xen 3.3.1
On Mon, Feb 02, 2009 at 12:01:02PM -0700, Jonathan Dye wrote:> I''m having issues with HVM live migration and every xen version I''ve > tried - 3.0.1, 3.1.x, 3.3.0 and 3.3.1. Migrations will fail > intermittently with messages like this on the receiving hypervisor: >Does PV (Linux) guest live migration work for you? Are you running GPLPV drivers in your (Windows) HVM guests? -- Pasi _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Jonathan Dye
2009-Feb-04 19:26 UTC
Re: [Xen-users] HVM Live Migration Troubles - Xen 3.3.1
Pasi Kärkkäinen wrote:> On Mon, Feb 02, 2009 at 12:01:02PM -0700, Jonathan Dye wrote: > >> I''m having issues with HVM live migration and every xen version I''ve >> tried - 3.0.1, 3.1.x, 3.3.0 and 3.3.1. Migrations will fail >> intermittently with messages like this on the receiving hypervisor: >> >> > > Does PV (Linux) guest live migration work for you? > > Are you running GPLPV drivers in your (Windows) HVM guests? > > -- Pasi >these are all linux hvm machines, i''m sorry to say. i could try linux PV guests if it''s diagnostically helpful, but they are neither part of our requirements nor possible in our environment. - jonathan _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Pasi Kärkkäinen
2009-Feb-04 19:57 UTC
Re: [Xen-users] HVM Live Migration Troubles - Xen 3.3.1
On Wed, Feb 04, 2009 at 12:26:07PM -0700, Jonathan Dye wrote:> Pasi Kärkkäinen wrote: > >On Mon, Feb 02, 2009 at 12:01:02PM -0700, Jonathan Dye wrote: > > > >>I''m having issues with HVM live migration and every xen version I''ve > >>tried - 3.0.1, 3.1.x, 3.3.0 and 3.3.1. Migrations will fail > >>intermittently with messages like this on the receiving hypervisor: > >> > >> > > > >Does PV (Linux) guest live migration work for you? > > > >Are you running GPLPV drivers in your (Windows) HVM guests? > > > >-- Pasi > > > > these are all linux hvm machines, i''m sorry to say. i could try linux > PV guests if it''s diagnostically helpful, but they are neither part of > our requirements nor possible in our environment. >OK. And yes, it would be diagnostically helpful to try Linux PV guests. Are you running PV drivers in the Linux HVM guests? Have you tried without? -- Pasi _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Apparently Analagous Threads
- Modifying Xen migration
- Xen LVM DRBD live migration
- Snapshot fail, when snapshot a vm the second time. (already update to xen-4.0.1 and kernel-2.6.32.25)
- Snapshot fail, when snapshot a vm the second time. (already update to xen-4.0.1 and kernel-2.6.32.25)
- PV domain save/restore break