Sorry, ctrl entered. I'm hoping someone here can help me figure out what's going on here. I've got two CentOS 7 hosts with shared storage that I'm trying to do live migrations between and I'm running into an error with VMs that were originally created on a CentOS 6 host and then moved the CentOS 7 hosts. The CentOS 6 VM runs fine on the host, and can do non-live migrations without any issues, however when attempting to live migrate the VM it fails. The VM itself is CentOS 7. Live migration does work when using VMs created using CentOS 7. Error message: "libvirtd virKeepAliveTimerInternal connection closed due to keep alive timeout. Cannot acquire state change lock (held by remoteDispatchDomainMigratePrepare3params)" Surrounding error messages here: Origin Host: https://pastebin.com/fLN6DRiq Recipient Host: https://pastebin.com/xR6mnaW2 The command being run is: Virsh --connect qemu:///system migrate --live vmname qemu+SSH://host2/system Firewall is turned off, SELinux is turned off, CentOS 7 CPUs are identical, both hosts fully updated. I've tried: Converting the VM from QCOW2 to Raw Converting the VM from QCOW2 to QCOW2 to try to get it to regenerate the XML/inject CentOS 7 Drivers Installed new drivers Updated all the packages in the VM. Removed all the Devices from the VM, except the HDDs. Hans Knecht - DevOps Network Administrator Kinsale Insurance Company I 2221 Edward Holland Drive I Suite 600 I Richmond, VA 23230 (804) 289-1300 x5102 office I (804) 673-5697 fax I <mailto:hans.knecht@kinsaleins.com> hans.knecht@kinsaleins.com I www.kinsaleins.com From: Hans Knecht [mailto:hans.knecht@kinsaleins.com] Sent: Monday, November 06, 2017 8:38 AM To: 'libvirt-users@redhat.com' <libvirt-users@redhat.com> Subject: Live Migration Issue I'm hoping someone here can help me figure out what's going on here. I've got two CentOS 7 hosts with shared storage that I'm trying to do live migrations between and I'm running into an error with VMs that were originally created on a CentOS 6 host and then moved the CentOS 7 hosts. The CentOS 6 VM runs fine on the host, and can do non-live migrations without any issues, however when attempting to live migrate the VM it fails with the following error message: Hans Knecht - DevOps Network Administrator Kinsale Insurance Company I 2221 Edward Holland Drive I Suite 600 I Richmond, VA 23230 (804) 289-1300 x5102 office I (804) 673-5697 fax I <mailto:hans.knecht@kinsaleins.com> hans.knecht@kinsaleins.com I www.kinsaleins.com <http://www.kinsaleins.com/> This communication constitutes an electronic communication within the meaning of the Electronic Communications Privacy Act, 19 USC 2510, and its disclosure is strictly limited to the recipient intended by the sender of this message. This communication may contain confidential and privileged material for the sole use of the intended recipient and the disclosure to anyone other than the intended recipient does not constitute a loss of the confidential or privileged nature of the communication. If you are not the intended recipient, please contact the sender by return electronic mail and delete all copies of this communication. Please check for any defects or viruses before opening or using any attachments. There is no warranty that this e-mail is virus free or without error. No Kinsale Company is liable if an attachment is altered without its written consent. Thank you.
Marc-Aurèle Brothier - Exoscale
2017-Nov-07 08:08 UTC
Re: [libvirt-users] Live Migration Issue
Hi, I would suspect that you don't run the same version on the hosts and you hit an incompatibilty issue. Another question: does the SSH login works without passphrase? Marc-Aurèle On Mon, 2017-11-06 at 08:43 -0500, Hans Knecht wrote:> Sorry, ctrl entered. > > I’m hoping someone here can help me figure out what’s going on here. > > I’ve got two CentOS 7 hosts with shared storage that I’m trying to do > live migrations between and I’m running into an error with VMs that > were originally created on a CentOS 6 host and then moved the CentOS > 7 hosts. The CentOS 6 VM runs fine on the host, and can do non-live > migrations without any issues, however when attempting to live > migrate the VM it fails. The VM itself is CentOS 7. Live migration > does work when using VMs created using CentOS 7. > > Error message: > “libvirtd virKeepAliveTimerInternal connection closed due to keep > alive timeout. > Cannot acquire state change lock (held by > remoteDispatchDomainMigratePrepare3params)” > > Surrounding error messages here: > Origin Host: https://pastebin.com/fLN6DRiq > Recipient Host: https://pastebin.com/xR6mnaW2 > > The command being run is: > Virsh --connect qemu:///system migrate --live vmname > qemu+SSH://host2/system > > Firewall is turned off, SELinux is turned off, CentOS 7 CPUs are > identical, both hosts fully updated. > > I’ve tried: > > Converting the VM from QCOW2 to Raw > Converting the VM from QCOW2 to QCOW2 to try to get it to regenerate > the XML/inject CentOS 7 Drivers > Installed new drivers > Updated all the packages in the VM. > Removed all the Devices from the VM, except the HDDs. > > > Hans Knecht – DevOps Network Administrator > Kinsale Insurance Company I 2221 Edward Holland Drive I Suite 600 > I Richmond, VA 23230 > (804) 289-1300 x5102 office I (804) 673-5697 fax I hans.knecht@kinsa > leins.com I www.kinsaleins.com > > From: Hans Knecht [mailto:hans.knecht@kinsaleins.com] > Sent: Monday, November 06, 2017 8:38 AM > To: 'libvirt-users@redhat.com' <libvirt-users@redhat.com> > Subject: Live Migration Issue > > I’m hoping someone here can help me figure out what’s going on here. > > I’ve got two CentOS 7 hosts with shared storage that I’m trying to do > live migrations between and I’m running into an error with VMs that > were originally created on a CentOS 6 host and then moved the CentOS > 7 hosts. The CentOS 6 VM runs fine on the host, and can do non-live > migrations without any issues, however when attempting to live > migrate the VM it fails with the following error message: > > Hans Knecht – DevOps Network Administrator > Kinsale Insurance Company I 2221 Edward Holland Drive I Suite 600 > I Richmond, VA 23230 > (804) 289-1300 x5102 office I (804) 673-5697 fax I hans.knecht@kinsa > leins.com I www.kinsaleins.com > > This communication constitutes an electronic communication within the > meaning of the Electronic Communications Privacy Act, 19 USC 2510, > and its disclosure is strictly limited to the recipient intended by > the sender of this message. This communication may contain > confidential and privileged material for the sole use of the intended > recipient and the disclosure to anyone other than the intended > recipient does not constitute a loss of the confidential or > privileged nature of the communication. If you are not the intended > recipient, please contact the sender by return electronic mail and > delete all copies of this communication. Please check for any defects > or viruses before opening or using any attachments. There is no > warranty that this e-mail is virus free or without error. No Kinsale > Company is liable if an attachment is altered without its written > consent. Thank you. > > _______________________________________________ > libvirt-users mailing list > libvirt-users@redhat.com > https://www.redhat.com/mailman/listinfo/libvirt-users