I experienced a strange behavior of glusterfs during livemigration of a qemu-kvm guest? using a 10GB file on a mirrored gluster 3.4.2 volume (both on ubuntu 13.04) I runvirsh migrate --verbose --live --unsafe --p2p --domain atom01 --desturi qemu+ssh://<target_ip>/system and the migration works, the running machine is pingable and keeps sending pings. nevertheless, when I let the machine touch a file during migration it stops, complaining that it's filesystem is read only (from that moment that? migration finished) A reboot from inside the machine failes, machine goes down and comes up with an error unable to write to sector xxxxxx on hd0 (than falling into the initrd). a? virsh destroy VM && virsh start VM leads to a perfect running VM again, no matter on which of the two hosts I start the machine anybody better experience with livemigration? any hint on a procedure how to debug that? TIA Bernhard -- Bernhard Glomm IT Administration Phone: +49 (30) 86880 134 Fax: +49 (30) 86880 100 Skype: bernhard.glomm.ecologic Ecologic Institut gemeinn?tzige GmbH | Pfalzburger Str. 43/44 | 10717 Berlin | Germany GF: R. Andreas Kraemer | AG: Charlottenburg HRB 57947 | USt/VAT-IdNr.: DE811963464 Ecologic? is a Trade Mark (TM) of Ecologic Institut gemeinn?tzige GmbH -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://supercolony.gluster.org/pipermail/gluster-users/attachments/20140116/77603021/attachment.html>
Pranith Kumar Karampuri
2014-Jan-16 12:05 UTC
[Gluster-users] gluster and kvm livemigration
hi Bernhard, Could you give gluster volume info output? Pranith ----- Original Message -----> From: "Bernhard Glomm" <bernhard.glomm at ecologic.eu> > To: gluster-users at gluster.org > Sent: Thursday, January 16, 2014 4:22:36 PM > Subject: [Gluster-users] gluster and kvm livemigration > > I experienced a strange behavior of glusterfs during livemigration > of a qemu-kvm guest > using a 10GB file on a mirrored gluster 3.4.2 volume > (both on ubuntu 13.04) > I run > virsh migrate --verbose --live --unsafe --p2p --domain atom01 --desturi > qemu+ssh://<target_ip>/system > and the migration works, > the running machine is pingable and keeps sending pings. > nevertheless, when I let the machine touch a file during migration > it stops, complaining that it's filesystem is read only (from that moment > that > migration finished) > A reboot from inside the machine failes, > machine goes down and comes up with an error > unable to write to sector xxxxxx on hd0 > (than falling into the initrd). > a > virsh destroy VM && virsh start VM > leads to a perfect running VM again, > no matter on which of the two hosts I start the machine > anybody better experience with livemigration? > any hint on a procedure how to debug that? > TIA > Bernhard > > -- > > > Bernhard Glomm > IT Administration > > Phone: +49 (30) 86880 134 > Fax: +49 (30) 86880 100 > Skype: bernhard.glomm.ecologic > > Ecologic Institut gemeinn?tzige GmbH | Pfalzburger Str. 43/44 | 10717 Berlin > | Germany > GF: R. Andreas Kraemer | AG: Charlottenburg HRB 57947 | USt/VAT-IdNr.: > DE811963464 > Ecologic? is a Trade Mark (TM) of Ecologic Institut gemeinn?tzige GmbH > > > _______________________________________________ > Gluster-users mailing list > Gluster-users at gluster.org > http://supercolony.gluster.org/mailman/listinfo/gluster-users
Not sure if it's related at all, but is there any chance this has anything to do with: https://bugzilla.redhat.com/show_bug.cgi?id=987555 It came to mind as something to do with glusterfs+libvirt+migration. HTH, James On Thu, Jan 16, 2014 at 5:52 AM, Bernhard Glomm <bernhard.glomm at ecologic.eu>wrote:> I experienced a strange behavior of glusterfs during livemigration > of a qemu-kvm guest > using a 10GB file on a mirrored gluster 3.4.2 volume > (both on ubuntu 13.04) > I run > virsh migrate --verbose --live --unsafe --p2p --domain atom01 --desturi > qemu+ssh://<target_ip>/system > and the migration works, > the running machine is pingable and keeps sending pings. > nevertheless, when I let the machine touch a file during migration > it stops, complaining that it's filesystem is read only (from that moment > that > migration finished) > A reboot from inside the machine failes, > machine goes down and comes up with an error > unable to write to sector xxxxxx on hd0 > (than falling into the initrd). > a > virsh destroy VM && virsh start VM > leads to a perfect running VM again, > no matter on which of the two hosts I start the machine > anybody better experience with livemigration? > any hint on a procedure how to debug that? > TIA > Bernhard > > -- > ------------------------------ > [image: *Ecologic Institute*] *Bernhard Glomm* > IT Administration > > Phone: +49 (30) 86880 134 Fax: +49 (30) 86880 100 Skype: bernhard.glomm.ecologic [image: > Website:] <http://ecologic.eu> [image: | Video:]<http://www.youtube.com/v/hZtiK04A9Yo> [image: > | Newsletter:] <http://ecologic.eu/newsletter/subscribe> [image: | > Facebook:] <http://www.facebook.com/Ecologic.Institute> [image: | > Linkedin:]<http://www.linkedin.com/company/ecologic-institute-berlin-germany> [image: > | Twitter:] <http://twitter.com/EcologicBerlin> [image: | YouTube:]<http://www.youtube.com/user/EcologicInstitute> [image: > | Google+:] <http://plus.google.com/113756356645020994482> Ecologic > Institut gemeinn?tzige GmbH | Pfalzburger Str. 43/44 | 10717 Berlin | > Germany > GF: R. Andreas Kraemer | AG: Charlottenburg HRB 57947 | USt/VAT-IdNr.: > DE811963464 > Ecologic? is a Trade Mark (TM) of Ecologic Institut gemeinn?tzige GmbH > ------------------------------ > > _______________________________________________ > Gluster-users mailing list > Gluster-users at gluster.org > http://supercolony.gluster.org/mailman/listinfo/gluster-users >-------------- next part -------------- An HTML attachment was scrubbed... URL: <http://supercolony.gluster.org/pipermail/gluster-users/attachments/20140123/7ac99acc/attachment.html>