Commit 3d0ad09412ffe00c9afa201d01effdb6023d09b4 ("drivers/net: Disable
UFO through virtio") breaks live migration of KVM guests from older to
newer host kernels:
https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git/commit/?id=3d0ad09412ffe00c9afa201d01effdb6023d09b4
The problem occurs when a guest running on a host kernel without commit
3d0ad0941 in tun.ko attempts to live migration to a host with commit
3d0ad0941.
Live migration fails in QEMU with the following error message:
virtio-net: saved image requires TUN_F_UFO support
The old host tun.ko advertised support for TUN_F_UFO. The new host
tun.ko does not and that's why QEMU aborts live migration. QEMU cannot
change the features of a running virtio-net device.
tuxcrafter provided logs from two Debian hosts migrating from
3.2.60-1+deb7u3 to 3.2.63-2+deb7u1:
http://paste.debian.net/131264/
I haven't investigated enough to suggest a fix, just wanted to bring it
to your attention. Soon a lot of people will be hitting this problem as
they upgrade their infrastructure and migrate guests - seems like a
critical issue.
Stefan
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 473 bytes
Desc: not available
URL:
<http://lists.linuxfoundation.org/pipermail/virtualization/attachments/20141111/cff8bd92/attachment.sig>
On Tue, 2014-11-11 at 10:58 +0000, Stefan Hajnoczi wrote:> Commit 3d0ad09412ffe00c9afa201d01effdb6023d09b4 ("drivers/net: Disable > UFO through virtio") breaks live migration of KVM guests from older to > newer host kernels: > > https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git/commit/?id=3d0ad09412ffe00c9afa201d01effdb6023d09b4 > > The problem occurs when a guest running on a host kernel without commit > 3d0ad0941 in tun.ko attempts to live migration to a host with commit > 3d0ad0941. > > Live migration fails in QEMU with the following error message: > > virtio-net: saved image requires TUN_F_UFO support > > The old host tun.ko advertised support for TUN_F_UFO. The new host > tun.ko does not and that's why QEMU aborts live migration. QEMU cannot > change the features of a running virtio-net device.Yes, this is known and was mentioned in the DSA.> tuxcrafter provided logs from two Debian hosts migrating from > 3.2.60-1+deb7u3 to 3.2.63-2+deb7u1: > > http://paste.debian.net/131264/ > > I haven't investigated enough to suggest a fix, just wanted to bring it > to your attention. Soon a lot of people will be hitting this problem as > they upgrade their infrastructure and migrate guests - seems like a > critical issue.You can work around this by making macvtap and tun still claim to support UFO. They continue to support it even if it's not advertised because the tap features don't reliably get propagated to virtio devices. Ben. -- Ben Hutchings Experience is directly proportional to the value of equipment destroyed. - Carolyn Scheppner -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 811 bytes Desc: This is a digitally signed message part URL: <http://lists.linuxfoundation.org/pipermail/virtualization/attachments/20141111/7d1a8308/attachment.sig>
On Tue, Nov 11, 2014 at 12:17:26PM +0000, Ben Hutchings wrote:> On Tue, 2014-11-11 at 10:58 +0000, Stefan Hajnoczi wrote: > > Commit 3d0ad09412ffe00c9afa201d01effdb6023d09b4 ("drivers/net: Disable > > UFO through virtio") breaks live migration of KVM guests from older to > > newer host kernels: > > > > https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git/commit/?id=3d0ad09412ffe00c9afa201d01effdb6023d09b4 > > > > The problem occurs when a guest running on a host kernel without commit > > 3d0ad0941 in tun.ko attempts to live migration to a host with commit > > 3d0ad0941. > > > > Live migration fails in QEMU with the following error message: > > > > virtio-net: saved image requires TUN_F_UFO support > > > > The old host tun.ko advertised support for TUN_F_UFO. The new host > > tun.ko does not and that's why QEMU aborts live migration. QEMU cannot > > change the features of a running virtio-net device. > > Yes, this is known and was mentioned in the DSA. > > > tuxcrafter provided logs from two Debian hosts migrating from > > 3.2.60-1+deb7u3 to 3.2.63-2+deb7u1: > > > > http://paste.debian.net/131264/ > > > > I haven't investigated enough to suggest a fix, just wanted to bring it > > to your attention. Soon a lot of people will be hitting this problem as > > they upgrade their infrastructure and migrate guests - seems like a > > critical issue. > > You can work around this by making macvtap and tun still claim to > support UFO.If this is what we want userspace to do, let's just put the feature flag back? Basically userspace assumed that features will only ever be added, never removed, so this change is breaking it.> They continue to support it even if it's not advertised > because the tap features don't reliably get propagated to virtio > devices. > > Ben.Hmm I don't understand this last sentence. features are actually reliably propagated to virtio devices.> -- > Ben Hutchings > Experience is directly proportional to the value of equipment destroyed. > - Carolyn Scheppner