Xen users - Oct 2009 - Live-migration doesn''t work to Windows guest

Hi everyone,

I have tried to perform live-migration with an Windows XP SP3 guest,
but it fails with the following error:

"Error: /usr/lib64/xen/bin/xc_save 15 37 0 0 5 failed"

It doesn''t happen with my Linux PVM guests. In fact, live-migration
works fine with them.

I''m using GPLPV Drivers. Could this issue be related to those Drivers?
 (I have not tested without them yet.)

I''m on Red Hat 5.4, with Xen hipervisor 3.1.2.

I would appreciate any help. Thank you.

_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

On Fri, Oct 30, 2009 at 2:07 PM, Edson Marquezani Filho
<edsonmarquezani@gmail.com> wrote:
> Hi everyone,
>
> I have tried to perform live-migration with an Windows XP SP3 guest,
> but it fails with the following error:
>
> "Error: /usr/lib64/xen/bin/xc_save 15 37 0 0 5 failed"
>
> It doesn''t happen with my Linux PVM guests. In fact,
live-migration
> works fine with them.
>
> I''m using GPLPV Drivers. Could this issue be related to those
Drivers?
>  (I have not tested without them yet.)
>
The GPLPV drivers do not support live migrate or restore.


Keith Coleman

_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

>
> The GPLPV drivers do not support live migrate or restore.
>
I didnt''t know it. Xen Wiki doesn''t say that. Why?

Actualy, I''m not using Red Hat PVDrivers only because of a bug that
gives me a BSOD after install. What a bad luck. =/

_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

> 
> >
> > The GPLPV drivers do not support live migrate or restore.
> >
> 
> I didnt''t know it. Xen Wiki doesn''t say that. Why?
> 
> Actualy, I''m not using Red Hat PVDrivers only because of a bug
that
> gives me a BSOD after install. What a bad luck. =/
> 
Strictly speaking, it should have worked but there was a change made to
Xen around 3.4.x that broke migration/save/restore and a while a
workaround seems to exist, I haven''t yet applied it to GPLPV and
I''m not
completely sure I want to as it seems a bit messy.

James

_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

>
> Strictly speaking, it should have worked but there was a change made to
> Xen around 3.4.x that broke migration/save/restore and a while a
> workaround seems to exist, I haven''t yet applied it to GPLPV and
I''m not
> completely sure I want to as it seems a bit messy.
>
But my hypervisor is 3.1.x , from RHEL 5.4. Should migration work with
that version? Because it dont''t.
I''ve heard that there are some issues with GPLPV Drivers and old Xen
hypervisor versions. Do you confirm that?

Thanks.

_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

> 
> >
> > Strictly speaking, it should have worked but there was a change made
to
> > Xen around 3.4.x that broke migration/save/restore and a while a
> > workaround seems to exist, I haven''t yet applied it to GPLPV
and I''m
not
> > completely sure I want to as it seems a bit messy.
> >
> 
> But my hypervisor is 3.1.x , from RHEL 5.4. Should migration work with
> that version? Because it dont''t.
> I''ve heard that there are some issues with GPLPV Drivers and old
Xen
> hypervisor versions. Do you confirm that?
> 
How soon after starting the migrate do you get the error?

Could you also try a HVM Linux machine? That should rule out any problem
not related to GPLPV.

Also what version of GPLPV?

Thanks

James

_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

On Sat, Oct 31, 2009 at 09:10:30AM +1100, James Harper
wrote:
> > 
> > >
> > > The GPLPV drivers do not support live migrate or restore.
> > >
> > 
> > I didnt''t know it. Xen Wiki doesn''t say that. Why?
> > 
> > Actualy, I''m not using Red Hat PVDrivers only because of a
bug that
> > gives me a BSOD after install. What a bad luck. =/
> > 
> 
> Strictly speaking, it should have worked but there was a change made to
> Xen around 3.4.x that broke migration/save/restore and a while a
> workaround seems to exist, I haven''t yet applied it to GPLPV and
I''m not
> completely sure I want to as it seems a bit messy.
> 
Afaik the workaround has been working OK for Oracle PV drivers.. 

Better than nothing :)

-- Pasi


_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

On Mon, Nov 2, 2009 at 3:14 PM, Pasi Kärkkäinen <pasik@iki.fi>
wrote:
> On Sat, Oct 31, 2009 at 09:10:30AM +1100, James Harper wrote:
>> Strictly speaking, it should have worked but there was a change made to
>> Xen around 3.4.x that broke migration/save/restore and a while a
>> workaround seems to exist, I haven''t yet applied it to GPLPV
and I''m not
>> completely sure I want to as it seems a bit messy.
>>
>
> Afaik the workaround has been working OK for Oracle PV drivers..
Really? Their website says save/migrate is not supported.

-- 
Fajar

_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

On Mon, Nov 02, 2009 at 03:28:35PM +0700, Fajar A. Nugraha
wrote:
> On Mon, Nov 2, 2009 at 3:14 PM, Pasi Kärkkäinen <pasik@iki.fi> wrote:
> > On Sat, Oct 31, 2009 at 09:10:30AM +1100, James Harper wrote:
> 
> >> Strictly speaking, it should have worked but there was a change
made to
> >> Xen around 3.4.x that broke migration/save/restore and a while a
> >> workaround seems to exist, I haven''t yet applied it to
GPLPV and I''m not
> >> completely sure I want to as it seems a bit messy.
> >>
> >
> > Afaik the workaround has been working OK for Oracle PV drivers..
> 
> Really? Their website says save/migrate is not supported.
> 
Yeah.. there was a thread on xen-devel about this problem, and the
oracle developers confirmed the fix is working for them.

-- Pasi


_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

On Mon, Nov 2, 2009 at 3:14 AM, Pasi Kärkkäinen <pasik@iki.fi>
wrote:
> On Sat, Oct 31, 2009 at 09:10:30AM +1100, James Harper wrote:
>> >
>> > >
>> > > The GPLPV drivers do not support live migrate or restore.
>> > >
>> >
>> > I didnt''t know it. Xen Wiki doesn''t say that.
Why?
>> >
>> > Actualy, I''m not using Red Hat PVDrivers only because of
a bug that
>> > gives me a BSOD after install. What a bad luck. =/
>> >
>>
>> Strictly speaking, it should have worked but there was a change made to
>> Xen around 3.4.x that broke migration/save/restore and a while a
>> workaround seems to exist, I haven''t yet applied it to GPLPV
and I''m not
>> completely sure I want to as it seems a bit messy.
>>
>
> Afaik the workaround has been working OK for Oracle PV drivers..
>
> Better than nothing :)
>
> -- Pasi
>
>
I think this would be a very beneficial addition to the GPLPV drivers.


Keith Coleman

_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

>
> How soon after starting the migrate do you get the error?
Right after.
> Could you also try a HVM Linux machine? That should rule out any problem
> not related to GPLPV.
James, I have been away from the job, but I''m coming back tomorrow.
I will run those tests as soon as possible and I''ll give you feedback
next.
Thank you, very much.
> Also what version of GPLPV?
The latest stable - 0.10.0.86.
> Thanks
>
> James
>
_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

>> Could you also try a HVM Linux machine? That should rule out any
problem
>> not related to GPLPV.
>
Ok, some tests were done. Unfornately, migration (live or not) seems
to not work for HVM machines. I tried with a Linux HVM, as I was asked
for, and it really don''t work. I tried with an Windows XP SP2 guest
too, without any PV drivers, and had the same problem.

Error: /usr/lib64/xen/bin/xc_save <number_here> <number_here> ...
<number_here> failed

Which, to me, is a very useless error message, because numbers don''t
tell anything. =/

Any ideas? I would appreciate very much.

Thank you.

_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

On Wed, Nov 04, 2009 at 05:42:52PM -0200, Edson Marquezani Filho
wrote:
> >> Could you also try a HVM Linux machine? That should rule out any
problem
> >> not related to GPLPV.
> >
> 
> Ok, some tests were done. Unfornately, migration (live or not) seems
> to not work for HVM machines. I tried with a Linux HVM, as I was asked
> for, and it really don''t work. I tried with an Windows XP SP2
guest
> too, without any PV drivers, and had the same problem.
> 
> Error: /usr/lib64/xen/bin/xc_save <number_here> <number_here>
...
> <number_here> failed
> 
> Which, to me, is a very useless error message, because numbers
don''t
> tell anything. =/
> 
> Any ideas? I would appreciate very much.
> 
Did you already search redhat rhel bugzilla about this problem? 
http://bugzilla.redhat.com

Also, did you try upgrading Xen to 3.4.1? (gitco.de/repo has rpms for
centos5).

-- Pasi


_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

>
> Did you already search redhat rhel bugzilla about this problem?
> http://bugzilla.redhat.com
I have been told that it is a bug, indeed, related to hipervisor and
kernel, some kind of imcompatibility.
> Also, did you try upgrading Xen to 3.4.1? (gitco.de/repo has rpms for
> centos5).
No, I didn''t, altough it seems like this would solve the problem. But,
the question is that I would like to keep RHEL official packages, so
that I don''t lose my support. I''m going to open a support
ticket for
that issue. I was told that the same problem ocurred in Suse too, with
the same hypervisor''s version, and they fixed it some time ago.

Thank you.
> -- Pasi
>
>
_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

I''m very sorry people, the problem had nothing to do with bugs on
hypervisor, incompatibility, PV Drivers, or anything else. It was
simpler than I could imagine. I-VT was not enabled on my slave server,
I don''t know how. =/ Because, as far as I remember, I did it!
Obviously, the slave could not run HVM guests.

Anyway, live migration is working now for HVM guests as well.

Thank you, and my apologizes for bothering you.

_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

What did you do to enable it?

On 11/05/2009 04:43 PM, Edson Marquezani Filho wrote:
> I''m very sorry people, the problem had nothing to do with bugs on
> hypervisor, incompatibility, PV Drivers, or anything else. It was
> simpler than I could imagine. I-VT was not enabled on my slave server,
> I don''t know how. =/ Because, as far as I remember, I did it!
> Obviously, the slave could not run HVM guests.
>
> Anyway, live migration is working now for HVM guests as well.
>
> Thank you, and my apologizes for bothering you.
>
> _______________________________________________
> Xen-users mailing list
> Xen-users@lists.xensource.com
> http://lists.xensource.com/xen-users
>    
_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

On Fri, Nov 6, 2009 at 12:59, Thiago Vinhas <thiago@simpleweb.com.br>
wrote:
> What did you do to enable it?
>
Nothing. Just remember that I''m using hypervisor 3.1.X, from RHEL, not
the newest one (3.4.1), which, according to what James sayd, has
problems with PVDrivers on migration.

What I can say is that with RHEL Xen packages (hypervisor 3.1.2 and
kernel 2.6.18), migration for Windows guests with GPLPV Drivers works
just fine. I have seen no problems so far, in my tests.

(The original issue was because HVM support was not enabled on BIOS. Just it.)

_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

On Fri, Nov 06, 2009 at 02:10:06PM -0200, Edson Marquezani Filho
wrote:
> On Fri, Nov 6, 2009 at 12:59, Thiago Vinhas <thiago@simpleweb.com.br>
wrote:
> > What did you do to enable it?
> >
> 
> Nothing. Just remember that I''m using hypervisor 3.1.X, from RHEL,
not
> the newest one (3.4.1), which, according to what James sayd, has
> problems with PVDrivers on migration.
> 
> What I can say is that with RHEL Xen packages (hypervisor 3.1.2 and
> kernel 2.6.18), migration for Windows guests with GPLPV Drivers works
> just fine. I have seen no problems so far, in my tests.
> 
> (The original issue was because HVM support was not enabled on BIOS. Just
it.)
> 
Yeah, there was some changes in Xen 3.4.x, and those cause the migration to
fail with GPLPV drivers. GPLPV migration works with earlier Xen versions.

Oracle developers confirmed the workaround makes their Windows PV drivers 
work ok with Xen 3.4.x:
http://lists.xensource.com/archives/html/xen-devel/2009-09/msg00667.html

And:
http://lists.xensource.com/archives/html/xen-devel/2009-09/msg00727.html

So hopefully James will include the same workaround in GPLPV :)

-- Pasi


_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users