Robert Dunkley
2009-Jan-21  12:35 UTC
FW: [Xen-users] Standard VM live migration OK but Windows GPLPV VM livemigration broken
Sorry, a correction, it seems none of the Paravirt machines will live migrate (Centos PVs act in same way), all the unmodified HVMs migrate OK. -----Original Message----- From: xen-users-bounces@lists.xensource.com [mailto:xen-users-bounces@lists.xensource.com] On Behalf Of Robert Dunkley Sent: 21 January 2009 12:22 To: xen-users Subject: [Xen-users] Standard VM live migration OK but Windows GPLPV VM livemigration broken Hi Everyone, Is there something specific I need to do to get live migration with Windows GPLPV drivers working? Non para Windows VMs and Centos 4.7 Para VMs all migrate OK on my setup but systems running the Windows GPLPV drivers get stuck, the receiving Dom0 shows the domain in a paused state and the sending Dom0 show the domain with -migrating added to the name but never completes. Thanks, Rob The SAQ Group Registered Office: 18 Chapel Street, Petersfield, Hampshire GU32 3DZ SAQ is the trading name of SEMTEC Limited. Registered in England & Wales Company Number: 06481952 http://www.saqnet.co.uk AS29219 SAQ Group Delivers high quality, honestly priced communication and I.T. services to UK Business. Broadband : Domains : Email : Hosting : CoLo : Servers : Racks : Transit : Backups : Managed Networks : Remote Support. ISPA Member Find us in http://www.thebestof.co.uk/petersfield _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Fajar A. Nugraha
2009-Jan-21  14:07 UTC
Re: FW: [Xen-users] Standard VM live migration OK but Windows GPLPV VM livemigration broken
On Wed, Jan 21, 2009 at 7:35 PM, Robert Dunkley <Robert@saq.co.uk> wrote:> Sorry, a correction, it seems none of the Paravirt machines will live > migrate (Centos PVs act in same way)Now that''s weird. What OS/Xen combo are you using? Have you test it with RHEL/CentOS 5.2 PV domUs? _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Robert Dunkley
2009-Jan-21  14:24 UTC
RE: FW: [Xen-users] Standard VM live migration OK but Windows GPLPV VM livemigration broken
Hi,
I''m using Centos 5.2 with OFED 1.3 (Infiniband Drivers), Xen 3.3.0 from
Gitco RPM and DRBD 8.2.6 installed. I have always installed the VMs as
full HVM and modified them later for PV. I used an rpm called
kmod-xenpv-0.1-10.el4.centos.x86_64 to change the Centos 4.7 HVM to
para, it gave a good increase in performance but unfortunately a
suitable KMod does not seem to be available for Centos 5.2 yet. 
Below are the Xen logs during transfer of a PV VM. Does anything look
out of place?
Thanks,
Rob
Sending Dom0:
[2009-01-21 14:19:33 11509] DEBUG (XendCheckpoint:103) [xc_save]:
/usr/lib64/xen/bin/xc_save 50 15 0 0 5
[2009-01-21 14:19:33 11509] INFO (XendCheckpoint:403) xc_save: could not
read suspend event channel
[2009-01-21 14:19:39 11509] INFO (XendCheckpoint:403) Saving memory
pages: iter  1: sent 982721, skipped 287, delta 6046ms, dom0 47%, target
0%, sent 5326Mb/s, dirtied 2Mb/s 503 pages
[2009-01-21 14:19:39 11509] INFO (XendCheckpoint:403) Saving memory
pages: iter  2: sent 509, skipped 0, delta 23ms, dom0 65%, target 0%,
sent 725Mb/s, dirtied 18Mb/s 13 pages
[2009-01-21 14:19:39 11509] INFO (XendCheckpoint:403) Saving memory
pages: iter  3: sent 0, skipped 13, Start last iteration
[2009-01-21 14:19:39 11509] DEBUG (XendCheckpoint:374) suspend
[2009-01-21 14:19:39 11509] DEBUG (XendCheckpoint:106) In
saveInputHandler suspend
[2009-01-21 14:19:39 11509] DEBUG (XendCheckpoint:108) Suspending 15 ...
[2009-01-21 14:19:39 11509] DEBUG (XendDomainInfo:472)
XendDomainInfo.shutdown(suspend)
[2009-01-21 14:19:39 11509] DEBUG (XendDomainInfo:1443)
XendDomainInfo.handleShutdownWatch
Receiving Dom0:
[2009-01-21 14:19:34 11571] DEBUG (DevController:124) DevController:
writing {''bridge'': ''lanbr'',
''domain'': ''dns2'',
''handle'': ''1'', ''uuid'':
''48bac5cb-2332-8ba8-8d59-484bb2969c59'',
''script'':
''/etc/xen/scripts/vif-bridge'', ''mac'':
''00:16:3e:44:d3:a9'',
''frontend-id'': ''13'',
''state'': ''1'', ''online'':
''1'', ''frontend'':
''/local/domain/13/device/vif/1''} to
/local/domain/0/backend/vif/13/1.
[2009-01-21 14:19:34 11571] DEBUG (XendDomainInfo:1359) Storing domain
details: {''console/port'': ''3'',
''name'': ''dns2'',
''console/limit'':
''1048576'', ''image/suspend-cancel'':
''1'', ''domid'': ''13'',
''vm'':
''/vm/9ef8a7c9-efc1-73c7-40c1-b3013c2f1336'',
''cpu/0/availability'':
''online'', ''memory/target'':
''524288'',
''control/platform-feature-multiprocessor-suspend'':
''1'', ''console/type'':
''ioemu'', ''store/port'':
''2''}
[2009-01-21 14:19:34 11571] INFO (XendCheckpoint:229) restore hvm domain
13, apic=1, pae=1
[2009-01-21 14:19:34 11571] DEBUG (image:300) Stored a VNC password for
vfb access
[2009-01-21 14:19:34 11571] DEBUG (image:743) args: boot, val: c
[2009-01-21 14:19:34 11571] DEBUG (image:743) args: fda, val: None
[2009-01-21 14:19:34 11571] DEBUG (image:743) args: fdb, val: None
[2009-01-21 14:19:34 11571] DEBUG (image:743) args: soundhw, val: None
[2009-01-21 14:19:34 11571] DEBUG (image:743) args: localtime, val: 0
[2009-01-21 14:19:34 11571] DEBUG (image:743) args: serial, val: pty
[2009-01-21 14:19:34 11571] DEBUG (image:743) args: std-vga, val: 0
[2009-01-21 14:19:34 11571] DEBUG (image:743) args: isa, val: 0
[2009-01-21 14:19:34 11571] DEBUG (image:743) args: acpi, val: 1
[2009-01-21 14:19:34 11571] DEBUG (image:743) args: usb, val: 0
[2009-01-21 14:19:34 11571] DEBUG (image:743) args: usbdevice, val: None
[2009-01-21 14:19:34 11571] DEBUG (XendCheckpoint:247)
restore:shadow=0x5, _static_max=0x20000000, _static_min=0x0,
[2009-01-21 14:19:34 11571] DEBUG (balloon:132) Balloon: 23809136 KiB
free; need 537600; done.
[2009-01-21 14:19:34 11571] DEBUG (XendCheckpoint:264) [xc_restore]:
/usr/lib64/xen/bin/xc_restore 4 13 2 3 1 1 1
[2009-01-21 14:19:34 11571] INFO (XendCheckpoint:403) xc_domain_restore
start: p2m_size = f2021
[2009-01-21 14:19:34 11571] INFO (XendCheckpoint:403) Reloading memory
pages:   0%
-----Original Message-----
From: Fajar A. Nugraha [mailto:fajar@fajar.net] 
Sent: 21 January 2009 14:07
To: Robert Dunkley
Cc: xen-users
Subject: Re: FW: [Xen-users] Standard VM live migration OK but Windows
GPLPV VM livemigration broken
On Wed, Jan 21, 2009 at 7:35 PM, Robert Dunkley <Robert@saq.co.uk>
wrote:> Sorry, a correction, it seems none of the Paravirt machines will live
> migrate (Centos PVs act in same way)
Now that''s weird. What OS/Xen combo are you using? Have you test it
with RHEL/CentOS 5.2 PV domUs?
The SAQ Group
Registered Office: 18 Chapel Street, Petersfield, Hampshire GU32 3DZ
SAQ is the trading name of SEMTEC Limited. Registered in England & Wales
Company Number: 06481952
http://www.saqnet.co.uk AS29219
SAQ Group Delivers high quality, honestly priced communication and I.T. services
to UK Business.
Broadband : Domains : Email : Hosting : CoLo : Servers : Racks : Transit :
Backups : Managed Networks : Remote Support.
ISPA Member
Find us in http://www.thebestof.co.uk/petersfield
_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users
Fajar A. Nugraha
2009-Jan-21  14:50 UTC
Re: FW: [Xen-users] Standard VM live migration OK but Windows GPLPV VM livemigration broken
On Wed, Jan 21, 2009 at 9:24 PM, Robert Dunkley <Robert@saq.co.uk> wrote:> Hi, > > I''m using Centos 5.2 with OFED 1.3 (Infiniband Drivers), Xen 3.3.0 from > Gitco RPM and DRBD 8.2.6 installed. I have always installed the VMs as > full HVM and modified them later for PV. I used an rpm called > kmod-xenpv-0.1-10.el4.centos.x86_64 to change the Centos 4.7 HVM to > para,That''s not PV domU. It''s HVM Linux domU with PV drivers. I haven''t tried one of those, sorry. Is there a special reason why you don''t use PV domU instead? Centos 4.x has kernel-xenU for that purpose. It should provide much better performance, plus a working live migration.> it gave a good increase in performance but unfortunately a > suitable KMod does not seem to be available for Centos 5.2 yet. >Really? RHEL5 has kmod-xenpv-0.1-9.el5.x86_64.rpm. You can either rebuild that from SRPM, or wait several weeks for CentOS 5.3. See https://www.redhat.com/archives/rhelv5-announce/2009-January/msg00000.html Regards, Fajar _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Ricardo J. Barberis
2009-Jan-22  21:04 UTC
Re: FW: [Xen-users] Standard VM live migration OK but Windows GPLPV VM livemigration broken
El Miércoles 21 Enero 2009, Fajar A. Nugraha escribió:> On Wed, Jan 21, 2009 at 9:24 PM, Robert Dunkley <Robert@saq.co.uk> wrote: > > it gave a good increase in performance but unfortunately a > > suitable KMod does not seem to be available for Centos 5.2 yet. > > Really? RHEL5 has kmod-xenpv-0.1-9.el5.x86_64.rpm. You can either > rebuild that from SRPM, or wait several weeks for CentOS 5.3. See > https://www.redhat.com/archives/rhelv5-announce/2009-January/msg00000.htmlI''m also using CentOS 5.2 + Gitco''s xen 3.3.0 as dom0 and my CentOS 5.2 domU''s have installed the kernel-xen package and boot from it via pygrub. They live migrate fine, just like HVM''s but I''m facing the same problem than you with Windows 2003 Server and GPLPV drivers 0.9.11. Any hints on this would be very appreciated! Cheers, -- Ricardo J. Barberis Senior SysAdmin - I+D Dattatec.com :: Soluciones de Web Hosting Su Hosting hecho Simple..! _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users