thr3ads.net - Xen users - [Xen-users] Xen Migration Failure [Jun 2008]

If this information is useful, please help other people find it:
Share via:

Cody Jarrett

2008-Jun-19 03:22 UTC

[Xen-users] Xen Migration Failure

I''m having problems getting the migration from one machine to another.
When I start the migration, it run for probably 15 seconds and ends,  
and the virtual machines dies. Here''s my setup, 2 xen host running  
centos 5.1, xen-3.0.3-41.el5_1.6, and kernel 2.6.18-53.1.21.el5xen.  
Server01 has a VM called vm01 and I''m trying to migrate that over to  
server02. Server02 has an NFS mount to the directory on server01 that  
holds the virtual machine disk. Any ideas, is it my hardware?

xend.log from server01
[2008-06-18 22:14:56 xend 5112] DEBUG (balloon:127) Balloon: 3132 KiB  
free; need 2048; done.
[2008-06-18 22:14:56 xend 5112] DEBUG (XendCheckpoint:89) [xc_save]: / 
usr/lib/xen/bin/xc_save 20 17 0 0 1
[2008-06-18 22:14:56 xend 5112] INFO (XendCheckpoint:351) Had 0  
unexplained entries in p2m table
  1: sent 32438, skipped 288, delta 12485ms, dom0 16%, target 0%, sent  
85Mb/s, dirtied 0Mb/s 355 pages
  2: sent 355, skipped 0, delta 97ms, dom0 21%, target 0%, sent 119Mb/ 
s, dirtied 22Mb/s 67 pages
  3: sent 67, skipped 0, delta 3ms, dom0 100%, target 0%, sent 731Mb/ 
s, dirtied 0Mb/s 0 pages
  4: sent 0, skipped 0, Start last iterationheckpoint:351) Saving  
memory pages: iter 4   0%
[2008-06-18 22:15:09 xend 5112] DEBUG (XendCheckpoint:322) suspend
[2008-06-18 22:15:09 xend 5112] DEBUG (XendCheckpoint:92) In  
saveInputHandler suspend
[2008-06-18 22:15:09 xend 5112] DEBUG (XendCheckpoint:94) Suspending  
17 ...
[2008-06-18 22:15:09 xend.XendDomainInfo 5112] DEBUG (XendDomainInfo: 
988) XendDomainInfo.handleShutdownWatch
[2008-06-18 22:15:09 xend.XendDomainInfo 5112] DEBUG (XendDomainInfo: 
988) XendDomainInfo.handleShutdownWatch
[2008-06-18 22:15:09 xend.XendDomainInfo 5112] INFO (XendDomainInfo: 
947) Domain has shutdown: name=migrating-vm01 id=17 reason=suspend.
[2008-06-18 22:15:09 xend 5112] INFO (XendCheckpoint:99) Domain 17  
suspended.
[2008-06-18 22:15:09 xend 5112] DEBUG (XendCheckpoint:108) Written done
[2008-06-18 22:15:09 xend 5112] INFO (XendCheckpoint:351) SUSPEND  
shinfo 00000bdc
[2008-06-18 22:15:09 xend 5112] INFO (XendCheckpoint:351) delta 14ms,  
dom0 50%, target 14%, sent 0Mb/s, dirtied 229Mb/s 98 pages
  5: sent 98, skipped 0, delta 4ms, dom0 100%, target 0%, sent 802Mb/ 
s, dirtied 802Mb/s 98 pages
[2008-06-18 22:15:09 xend 5112] INFO (XendCheckpoint:351) Total pages  
sent= 32958 (0.95x)
[2008-06-18 22:15:09 xend 5112] INFO (XendCheckpoint:351) (of which 0  
were fixups)
[2008-06-18 22:15:09 xend 5112] INFO (XendCheckpoint:351) All memory  
is saved
[2008-06-18 22:15:09 xend 5112] INFO (XendCheckpoint:351) Save exit rc=0
[2008-06-18 22:15:09 xend.XendDomainInfo 5112] DEBUG (XendDomainInfo: 
1566) XendDomainInfo.destroyDomain(17)


--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------


xm dmesg from server 01
$ xm dmesg
  __  __            _____  _   ___    ____ _____  _   ____  _       _  
____
  \ \/ /___ _ __   |___ / / | / _ \  | ___|___ / / | |___ \/ |  ___| |  
___|
   \  // _ \ \047_ \    |_ \ | || | | |_|___ \ |_ \ | |   __) | | / _  
\ |___ \
   /  \  __/ | | |  ___) || || |_| |__|__) |__) || |_ / __/| ||  __/ | 
___) |
  /_/\_\___|_| |_| |____(_)_(_)___/  |____/____(_)_(_)_____|_(_)___|_| 
____/

  http://www.cl.cam.ac.uk/netos/xen
  University of Cambridge Computer Laboratory

  Xen version 3.1.0-53.1.21.el5 (mockbuild@) (gcc version 4.1.2  
20070626 (Red Hat 4.1.2-14)) Tue May 20 09:27:25 EDT 2008
  Latest ChangeSet: unavailable

(XEN) Command line: /xen.gz-2.6.18-53.1.21.el5
(XEN)  0000000000000000 - 000000000009f000 (usable)
(XEN)  000000000009f400 - 00000000000a0000 (reserved)
(XEN)  00000000000f0000 - 0000000000100000 (reserved)
(XEN)  0000000000100000 - 000000001f6e0000 (usable)
(XEN)  000000001f6e0000 - 000000001f6e3000 (ACPI NVS)
(XEN)  000000001f6e3000 - 000000001f6f0000 (ACPI data)
(XEN)  000000001f6f0000 - 000000001f700000 (reserved)
(XEN)  00000000e0000000 - 00000000f0000000 (reserved)
(XEN)  00000000fec00000 - 0000000100000000 (reserved)
(XEN) System RAM: 502MB (514556kB)
(XEN) Xen heap: 10MB (10256kB)
(XEN) Domain heap initialised: DMA width 32 bits
(XEN) PAE enabled, limit: 16 GB
(XEN) Processor #0 15:4 APIC version 20
(XEN) Processor #1 15:4 APIC version 20
(XEN) IOAPIC[0]: apic_id 4, version 32, address 0xfec00000, GSI 0-23
(XEN) IOAPIC[1]: apic_id 5, version 32, address 0xfec84400, GSI 24-47
(XEN) Enabling APIC mode:  Flat.  Using 2 I/O APICs
(XEN) Using scheduler: SMP Credit Scheduler (credit)
(XEN) Detected 3000.252 MHz processor.
(XEN) CPU0: Intel(R) Pentium(R) 4 CPU 3.00GHz stepping 01
(XEN) Mapping cpu 0 to node 255
(XEN) Booting processor 1/1 eip 90000
(XEN) Mapping cpu 1 to node 255
(XEN) CPU1: Intel(R) Pentium(R) 4 CPU 3.00GHz stepping 01
(XEN) Total of 2 processors activated.
(XEN) ENABLING IO-APIC IRQs
(XEN)  -> Using new ACK method
(XEN) Platform timer is 1.193MHz PIT
(XEN) Brought up 2 CPUs
(XEN) *** LOADING DOMAIN 0 ***
(XEN) elf_parse_binary: phdr: paddr=0xc0400000 memsz=0x25d640
(XEN) elf_parse_binary: phdr: paddr=0xc065e000 memsz=0x15a000
(XEN) elf_parse_binary: memory: 0xc0400000 -> 0xc07b8000
(XEN) elf_xen_parse_note: GUEST_OS = "linux"
(XEN) elf_xen_parse_note: GUEST_VERSION = "2.6"
(XEN) elf_xen_parse_note: XEN_VERSION = "xen-3.0"
(XEN) elf_xen_parse_note: VIRT_BASE = 0xc0000000
(XEN) elf_xen_parse_note: PADDR_OFFSET = 0xc0000000
(XEN) elf_xen_parse_note: ENTRY = 0xc0400000
(XEN) elf_xen_parse_note: HYPERCALL_PAGE = 0xc0401000
(XEN) elf_xen_parse_note: FEATURES = "writable_page_tables| 
writable_descriptor_tables|auto_translated_physmap|pae_pgdir_above_4gb| 
supervisor_mode_kernel"
(XEN) elf_xen_parse_note: PAE_MODE = "yes"
(XEN) elf_xen_parse_note: LOADER = "generic"
(XEN) elf_xen_addr_calc_check: addresses:
(XEN)     virt_base        = 0xc0000000
(XEN)     elf_paddr_offset = 0xc0000000
(XEN)     virt_offset      = 0x0
(XEN)     virt_kstart      = 0xc0400000
(XEN)     virt_kend        = 0xc07b8000
(XEN)     virt_entry       = 0xc0400000
(XEN)  Xen  kernel: 32-bit, PAE, lsb
(XEN)  Dom0 kernel: 32-bit, PAE, lsb, paddr 0xc0400000 -> 0xc07b8000
(XEN) PHYSICAL MEMORY ARRANGEMENT:
(XEN)  Dom0 alloc.:   000000001e000000->000000001f000000 (112527 pages  
to be allocated)
(XEN) VIRTUAL MEMORY ARRANGEMENT:
(XEN)  Loaded kernel: c0400000->c07b8000
(XEN)  Init. ramdisk: c07b8000->c0e4f800
(XEN)  Phys-Mach map: c0e50000->c0ec1e3c
(XEN)  Start info:    c0ec2000->c0ec246c
(XEN)  Page tables:   c0ec3000->c0ed0000
(XEN)  Boot stack:    c0ed0000->c0ed1000
(XEN)  TOTAL:         c0000000->c1000000
(XEN)  ENTRY ADDRESS: c0400000
(XEN) Dom0 has maximum 2 VCPUs
(XEN) elf_load_binary: phdr 0 at 0xc0400000 -> 0xc065d640
(XEN) elf_load_binary: phdr 1 at 0xc065e000 -> 0xc0702b64
(XEN) Initrd len 0x697800, start at 0xc07b8000
(XEN) Scrubbing Free RAM: done.
(XEN) Xen trace buffers: disabled
(XEN) Std. Loglevel: Errors and warnings
(XEN) Guest Loglevel: Nothing (Rate-limited: Errors and warnings)
(XEN) Xen is relinquishing VGA console.
(XEN) *** Serial input -> DOM0 (type \047CTRL-a\047 three times to  
switch input to Xen).
(XEN) mm.c:636:d0 Error getting mfn e046 (pfn 3c2a) from L1 entry  
800000000e046025 for dom3
(XEN) mm.c:636:d0 Error getting mfn fb9 (pfn 4409) from L1 entry  
8000000000fb9025 for dom3
(XEN) mm.c:636:d0 Error getting mfn 1530d (pfn 47b0) from L1 entry  
800000001530d025 for dom3
(XEN) mm.c:636:d0 Error getting mfn 15062 (pfn 3c2a) from L1 entry  
8000000015062025 for dom3
(XEN) mm.c:636:d0 Error getting mfn e124 (pfn 66f1) from L1 entry  
800000000e124025 for dom3
(XEN) mm.c:636:d0 Error getting mfn 15226 (pfn 47be) from L1 entry  
8000000015226025 for dom3
(XEN) mm.c:636:d0 Error getting mfn 152be (pfn 3c88) from L1 entry  
80000000152be025 for dom3
(XEN) mm.c:636:d0 Error getting mfn 1509d (pfn 4ca3) from L1 entry  
800000001509d025 for dom3
(XEN) mm.c:636:d0 Error getting mfn 157b7 (pfn 4b5b) from L1 entry  
80000000157b7025 for dom3
(XEN) mm.c:636:d0 Error getting mfn 15523 (pfn 4b6a) from L1 entry  
8000000015523025 for dom3
(XEN) printk: 12 messages suppressed.
(XEN) mm.c:636:d0 Error getting mfn 1525a (pfn 66d2) from L1 entry  
800000001525a025 for dom4
(XEN) mm.c:636:d0 Error getting mfn 1555e (pfn 7a52) from L1 entry  
800000001555e025 for dom4
(XEN) mm.c:636:d0 Error getting mfn 15bc3 (pfn 62df) from L1 entry  
8000000015bc3025 for dom4
(XEN) mm.c:636:d0 Error getting mfn 15ecc (pfn 6715) from L1 entry  
8000000015ecc025 for dom4
(XEN) mm.c:636:d0 Error getting mfn ef68 (pfn 625b) from L1 entry  
800000000ef68025 for dom4
(XEN) mm.c:636:d0 Error getting mfn 154c9 (pfn 618f) from L1 entry  
80000000154c9025 for dom4
(XEN) mm.c:636:d0 Error getting mfn 15b14 (pfn 66eb) from L1 entry  
8000000015b14025 for dom4
(XEN) mm.c:636:d0 Error getting mfn 14d52 (pfn 66fb) from L1 entry  
8000000014d52025 for dom4
(XEN) mm.c:636:d0 Error getting mfn 14c54 (pfn 61d7) from L1 entry  
8000000014c54025 for dom4
(XEN) mm.c:636:d0 Error getting mfn 14da1 (pfn 65e9) from L1 entry  
8000000014da1025 for dom4
(XEN) printk: 57 messages suppressed.
(XEN) mm.c:636:d0 Error getting mfn 152f8 (pfn 62af) from L1 entry  
80000000152f8025 for dom4
(XEN) printk: 7 messages suppressed.
(XEN) mm.c:636:d0 Error getting mfn 13989 (pfn 3261) from L1 entry  
8000000013989025 for dom5
(XEN) mm.c:636:d0 Error getting mfn 151fc (pfn 3272) from L1 entry  
80000000151fc025 for dom5
(XEN) mm.c:636:d0 Error getting mfn 15ca4 (pfn 54b3) from L1 entry  
8000000015ca4025 for dom5
(XEN) mm.c:636:d0 Error getting mfn 13e3b (pfn 6b23) from L1 entry  
8000000013e3b025 for dom5
(XEN) mm.c:636:d0 Error getting mfn 15277 (pfn 3224) from L1 entry  
8000000015277025 for dom5
(XEN) mm.c:636:d0 Error getting mfn f86a (pfn 651b) from L1 entry  
800000000f86a025 for dom5
(XEN) mm.c:636:d0 Error getting mfn cd27 (pfn 653d) from L1 entry  
800000000cd27025 for dom5
(XEN) mm.c:636:d0 Error getting mfn 26f1 (pfn 3275) from L1 entry  
80000000026f1025 for dom5
(XEN) mm.c:636:d0 Error getting mfn 15ca7 (pfn 6562) from L1 entry  
8000000015ca7025 for dom5
(XEN) mm.c:636:d0 Error getting mfn 149cc (pfn 2d67) from L1 entry  
80000000149cc025 for dom5
(XEN) printk: 15 messages suppressed.
(XEN) mm.c:636:d0 Error getting mfn 16172 (pfn 3a80) from L1 entry  
8000000016172025 for dom16
(XEN) mm.c:636:d0 Error getting mfn 1ab59 (pfn 3aa0) from L1 entry  
800000001ab59025 for dom16
(XEN) mm.c:636:d0 Error getting mfn 1a1d4 (pfn 3a8c) from L1 entry  
800000001a1d4025 for dom16
(XEN) mm.c:636:d0 Error getting mfn 177c4 (pfn 3a9c) from L1 entry  
80000000177c4025 for dom16
(XEN) mm.c:636:d0 Error getting mfn ed39 (pfn 3aac) from L1 entry  
800000000ed39025 for dom16
(XEN) mm.c:636:d0 Error getting mfn 142e2 (pfn 3abc) from L1 entry  
80000000142e2025 for dom16
(XEN) mm.c:636:d0 Error getting mfn 17ee6 (pfn 3a91) from L1 entry  
8000000017ee6025 for dom16
(XEN) mm.c:636:d0 Error getting mfn 129a2 (pfn 3aa1) from L1 entry  
80000000129a2025 for dom16
(XEN) mm.c:636:d0 Error getting mfn 19bbc (pfn 3ab2) from L1 entry  
8000000019bbc025 for dom16
(XEN) mm.c:636:d0 Error getting mfn 1d6c8 (pfn 3a93) from L1 entry  
800000001d6c8025 for dom16

--------------------------------------------------------------------------------------------------------------------------------
cpuinfo from server01

$ cat /proc/cpuinfo
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	: Intel(R) Pentium(R) 4 CPU 3.00GHz
stepping	: 1
cpu MHz		: 3000.252
cache size	: 1024 KB
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu tsc msr pae mce cx8 apic mtrr mca cmov pat pse36 clflush  
dts acpi mmx fxsr sse sse2 ss ht tm pbe nx constant_tsc pni monitor  
ds_cpl cid xtpr
bogomips	: 7508.56

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	: Intel(R) Pentium(R) 4 CPU 3.00GHz
stepping	: 1
cpu MHz		: 3000.252
cache size	: 1024 KB
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu tsc msr pae mce cx8 apic mtrr mca cmov pat pse36 clflush  
dts acpi mmx fxsr sse sse2 ss ht tm pbe nx constant_tsc up pni monitor  
ds_cpl cid xtpr
bogomips	: 7508.56

----------------------------------------------------------------------------------------------------------------------------------------------------
xend.log from server02
[2008-06-18 22:14:56 xend.XendDomainInfo 4241] DEBUG (XendDomainInfo: 
275) XendDomainInfo.restore([''domain'',
[''domid'', ''17''], [''uuid'',
''daab0e68-c50d-d678-bf36-b8de50fc4065''],
[''vcpus'', ''1''],
[''vcpu_avail'', ''1''],
[''cpu_weight'', ''1.0''],
[''memory'', ''128''],
[''shadow_memory'', ''0''],
[''maxmem'', ''128''],
[''bootloader'', ''/usr/bin/
pygrub''], [''features''], [''name'',
''vm01''], [''on_poweroff'',
''destroy''],
[''on_reboot'', ''restart''],
[''on_crash'', ''restart''],
[''image'', [''linux'',
[''ramdisk'',
''/var/lib/xen/boot_ramdisk.H-WMcf''],
[''kernel'', ''/var/lib/
xen/boot_kernel.CWSvum''], [''args'', ''ro
root=/dev/VolGroup00/LogVol00
console=xvc0'']]], [''device'',
[''vif'', [''backend'', ''0''],
[''script'', ''vif-
bridge''], [''bridge'', ''xenbr1''],
[''mac'', ''00:16:3e:2f:58:3e'']]],
[''device'', [''vkbd'',
[''backend'', ''0'']]],
[''device'', [''vfb'',
[''backend'',
''0''], [''type'', ''vnc''],
[''vncunused'', ''1''],
[''xauthority'', ''/
root/.Xauthority'']]], [''device'',
[''tap'', [''backend'', ''0''],
[''dev'',
''xvda:disk''], [''uname'',
''tap:aio:/home/vm/vm01.img''], [''mode'',
''w'']]],
[''state'', ''--p---''],
[''shutdown_reason'', ''poweroff''],
[''cpu_time'',
''0.0''], [''online_vcpus'',
''1''], [''up_time'',
''161.610284805''],
[''start_time'', ''1213845134.84''],
[''store_mfn'', ''77630''],
[''console_mfn'', ''77629'']])
[2008-06-18 22:14:56 xend.XendDomainInfo 4241] DEBUG (XendDomainInfo: 
306) parseConfig: config is [''domain'',
[''domid'', ''17''], [''uuid'',
''daab0e68-c50d-d678-bf36-b8de50fc4065''],
[''vcpus'', ''1''],
[''vcpu_avail'', ''1''],
[''cpu_weight'', ''1.0''],
[''memory'', ''128''],
[''shadow_memory'', ''0''],
[''maxmem'', ''128''],
[''bootloader'', ''/usr/bin/
pygrub''], [''features''], [''name'',
''vm01''], [''on_poweroff'',
''destroy''],
[''on_reboot'', ''restart''],
[''on_crash'', ''restart''],
[''image'', [''linux'',
[''ramdisk'',
''/var/lib/xen/boot_ramdisk.H-WMcf''],
[''kernel'', ''/var/lib/
xen/boot_kernel.CWSvum''], [''args'', ''ro
root=/dev/VolGroup00/LogVol00
console=xvc0'']]], [''device'',
[''vif'', [''backend'', ''0''],
[''script'', ''vif-
bridge''], [''bridge'', ''xenbr1''],
[''mac'', ''00:16:3e:2f:58:3e'']]],
[''device'', [''vkbd'',
[''backend'', ''0'']]],
[''device'', [''vfb'',
[''backend'',
''0''], [''type'', ''vnc''],
[''vncunused'', ''1''],
[''xauthority'', ''/
root/.Xauthority'']]], [''device'',
[''tap'', [''backend'', ''0''],
[''dev'',
''xvda:disk''], [''uname'',
''tap:aio:/home/vm/vm01.img''], [''mode'',
''w'']]],
[''state'', ''--p---''],
[''shutdown_reason'', ''poweroff''],
[''cpu_time'',
''0.0''], [''online_vcpus'',
''1''], [''up_time'',
''161.610284805''],
[''start_time'', ''1213845134.84''],
[''store_mfn'', ''77630''],
[''console_mfn'', ''77629'']]
[2008-06-18 22:14:56 xend.XendDomainInfo 4241] DEBUG (XendDomainInfo: 
411) parseConfig: result is {''shadow_memory'': 0,
''start_time'':
1213845134.8399999, ''uuid'':
''daab0e68-c50d-d678-bf36-b8de50fc4065'',
''on_crash'': ''restart'',
''on_reboot'': ''restart'',
''localtime'': None,
''image'': [''linux'',
[''ramdisk'',
''/var/lib/xen/boot_ramdisk.H-WMcf''],
[''kernel'',
''/var/lib/xen/boot_kernel.CWSvum''], [''args'',
''ro root=/dev/
VolGroup00/LogVol00 console=xvc0'']], ''on_poweroff'':
''destroy'',
''bootloader_args'': None, ''cpus'': None,
''name'': ''vm01'', ''backend'':
[],
''vcpus'': 1, ''cpu_weight'': 1.0,
''features'': None, ''vcpu_avail'': 1,
''memory'': 128, ''device'':
[(''vif'', [''vif'',
[''backend'', ''0''],
[''script'',
''vif-bridge''], [''bridge'',
''xenbr1''], [''mac'',
''00:16:3e:2f:58:3e'']]),
(''vkbd'', [''vkbd'',
[''backend'', ''0'']]),
(''vfb'', [''vfb'',
[''backend'',
''0''], [''type'', ''vnc''],
[''vncunused'', ''1''],
[''xauthority'', ''/
root/.Xauthority'']]), (''tap'',
[''tap'', [''backend'', ''0''],
[''dev'',
''xvda:disk''], [''uname'',
''tap:aio:/home/vm/vm01.img''], [''mode'',
''w'']])], ''bootloader'':
''/usr/bin/pygrub'', ''cpu'': None,
''maxmem'': 128}
[2008-06-18 22:14:56 xend.XendDomainInfo 4241] DEBUG (XendDomainInfo: 
1349) XendDomainInfo.construct: None
[2008-06-18 22:14:56 xend 4241] DEBUG (balloon:127) Balloon: 63964 KiB  
free; need 2048; done.
[2008-06-18 22:14:56 xend.XendDomainInfo 4241] DEBUG (XendDomainInfo: 
756) Storing VM details: {''shadow_memory'':
''0'', ''uuid'': ''daab0e68-c50d-
d678-bf36-b8de50fc4065'', ''on_reboot'':
''restart'', ''start_time'':
''1213845134.84'', ''on_poweroff'':
''destroy'', ''name'': ''vm01'',
''xend/
restart_count'': ''0'', ''vcpus'':
''1'', ''vcpu_avail'': ''1'',
''memory'': ''128'',
''on_crash'': ''restart'',
''image'': "(linux (ramdisk /var/lib/xen/
boot_ramdisk.H-WMcf) (kernel /var/lib/xen/boot_kernel.CWSvum) (args  
''ro root=/dev/VolGroup00/LogVol00 console=xvc0''))",
''maxmem'': ''128''}
[2008-06-18 22:14:56 xend 4241] DEBUG (DevController:110)  
DevController: writing {''state'': ''1'',
''backend-id'': ''0'',
''backend'': ''/
local/domain/0/backend/vkbd/1/0''} to /local/domain/1/device/vkbd/0.
[2008-06-18 22:14:56 xend 4241] DEBUG (DevController:112)  
DevController: writing {''frontend-id'': ''1'',
''domain'': ''vm01'',
''frontend'': ''/local/domain/1/device/vkbd/0'',
''state'': ''1'', ''online'':
''1''} to /local/domain/0/backend/vkbd/1/0.
[2008-06-18 22:14:56 xend 4241] DEBUG (DevController:110)  
DevController: writing {''backend-id'': ''0'',
''mac'': ''00:16:3e:2f:58:3e'',
''handle'': ''0'', ''state'':
''1'', ''backend'':
''/local/domain/0/backend/vif/
1/0''} to /local/domain/1/device/vif/0.
[2008-06-18 22:14:56 xend 4241] DEBUG (DevController:112)  
DevController: writing {''bridge'': ''xenbr1'',
''domain'': ''vm01'',
''handle'': ''0'', ''script'':
''/etc/xen/scripts/vif-bridge'', ''state'':
''1'',
''frontend'': ''/local/domain/1/device/vif/0'',
''mac'': ''00:16:3e:2f:
58:3e'', ''online'': ''1'',
''frontend-id'': ''1''} to
/local/domain/0/backend/
vif/1/0.
[2008-06-18 22:14:56 xend 4241] DEBUG (DevController:110)  
DevController: writing {''state'': ''1'',
''backend-id'': ''0'',
''backend'': ''/
local/domain/0/backend/vfb/1/0''} to /local/domain/1/device/vfb/0.
[2008-06-18 22:14:56 xend 4241] DEBUG (DevController:112)  
DevController: writing {''vncunused'': ''1'',
''domain'': ''vm01'',
''frontend'': ''/local/domain/1/device/vfb/0'',
''xauthority'': ''/
root/.Xauthority'', ''state'': ''1'',
''online'': ''1'',
''frontend-id'': ''1'',
''type'': ''vnc''} to
/local/domain/0/backend/vfb/1/0.
[2008-06-18 22:14:56 xend 4241] DEBUG (vfbif:64) No VNC passwd  
configured for vfb access
[2008-06-18 22:14:56 xend 4241] DEBUG (blkif:24) exception looking up  
device number for xvda: [Errno 2] No such file or directory:
''/dev/xvda''
[2008-06-18 22:14:56 xend 4241] DEBUG (DevController:110)  
DevController: writing {''backend-id'': ''0'',
''virtual-device'': ''51712'',
''device-type'': ''disk'',
''state'': ''1'', ''backend'':
''/local/domain/0/
backend/tap/1/51712''} to /local/domain/1/device/vbd/51712.
[2008-06-18 22:14:56 xend 4241] DEBUG (DevController:112)  
DevController: writing {''domain'': ''vm01'',
''frontend'': ''/local/domain/1/
device/vbd/51712'', ''format'': ''raw'',
''dev'': ''xvda'', ''state'':
''1'',
''params'': ''aio:/home/vm/vm01.img'',
''mode'': ''w'', ''online'':
''1'',
''frontend-id'': ''1'',
''type'': ''tap''} to
/local/domain/0/backend/tap/
1/51712.
[2008-06-18 22:14:56 xend.XendDomainInfo 4241] DEBUG (XendDomainInfo: 
791) Storing domain details: {''console/port'':
''2'', ''name'': ''vm01'',
''console/limit'': ''1048576'',
''vm'': ''/vm/daab0e68-c50d-d678-bf36-
b8de50fc4065'', ''domid'': ''1'',
''cpu/0/availability'': ''online'',
''memory/
target'': ''131072'', ''store/port'':
''1''}
[2008-06-18 22:14:56 xend 4241] DEBUG (XendCheckpoint:198)  
restore:shadow=0x0, _static_max=0x80, _static_min=0x80,
[2008-06-18 22:14:56 xend 4241] DEBUG (balloon:133) Balloon: 63964 KiB  
free; 0 to scrub; need 131072; retries: 20.
[2008-06-18 22:14:56 xend 4241] DEBUG (balloon:148) Balloon: setting  
dom0 target to 875 MiB.
[2008-06-18 22:14:56 xend.XendDomainInfo 4241] DEBUG (XendDomainInfo: 
1078) Setting memory target of domain Domain-0 (0) to 875 MiB.
[2008-06-18 22:14:57 xend 4241] DEBUG (balloon:127) Balloon: 131548  
KiB free; need 131072; done.
[2008-06-18 22:14:57 xend 4241] DEBUG (XendCheckpoint:215)  
[xc_restore]: /usr/lib/xen/bin/xc_restore 15 1 1 2 0 0 0
[2008-06-18 22:14:57 xend 4241] INFO (XendCheckpoint:351)  
xc_domain_restore start: p2m_size = 8800
[2008-06-18 22:14:57 xend 4241] INFO (XendCheckpoint:351) Reloading  
memory pages:   0%
[2008-06-18 22:15:09 xend 4241] INFO (XendCheckpoint:351) Received all  
pages (0 races)
[2008-06-18 22:15:09 xend 4241] INFO (XendCheckpoint:351) ERROR  
Internal error: Failed to pin batch of 31 page tables
[2008-06-18 22:15:09 xend 4241] INFO (XendCheckpoint:351) Restore exit  
with rc=1
[2008-06-18 22:15:09 xend.XendDomainInfo 4241] DEBUG (XendDomainInfo: 
1557) XendDomainInfo.destroy: domid=1
[2008-06-18 22:15:09 xend.XendDomainInfo 4241] DEBUG (XendDomainInfo: 
1566) XendDomainInfo.destroyDomain(1)
[2008-06-18 22:15:09 xend.XendDomainInfo 4241] ERROR (XendDomainInfo: 
1572) XendDomainInfo.destroy: xc.domain_destroy failed.
Traceback (most recent call last):
   File "/usr/lib/python2.4/site-packages/xen/xend/XendDomainInfo.py",
line 1570, in destroyDomain
     xc.domain_destroy(self.domid)
Error: (3, ''No such process'')
[2008-06-18 22:15:09 xend 4241] ERROR (XendDomain:268) Restore failed
Traceback (most recent call last):
   File "/usr/lib/python2.4/site-packages/xen/xend/XendDomain.py",  
line 263, in domain_restore_fd
     return XendCheckpoint.restore(self, fd)
   File "/usr/lib/python2.4/site-packages/xen/xend/XendCheckpoint.py",
line 219, in restore
     forkHelper(cmd, fd, handler.handler, True)
   File "/usr/lib/python2.4/site-packages/xen/xend/XendCheckpoint.py",
line 339, in forkHelper
     raise XendError("%s failed" % string.join(cmd))
XendError: /usr/lib/xen/bin/xc_restore 15 1 1 2 0 0 0 failed

-------------------------------------------------------------------------------------------------------------------------------------------
xm dmesg from server02
root@cjarrett:~
$ xm dmesg
  __  __            _____  _   ___    ____ _____  _   ____  _       _  
____
  \ \/ /___ _ __   |___ / / | / _ \  | ___|___ / / | |___ \/ |  ___| |  
___|
   \  // _ \ \047_ \    |_ \ | || | | |_|___ \ |_ \ | |   __) | | / _  
\ |___ \
   /  \  __/ | | |  ___) || || |_| |__|__) |__) || |_ / __/| ||  __/ | 
___) |
  /_/\_\___|_| |_| |____(_)_(_)___/  |____/____(_)_(_)_____|_(_)___|_| 
____/

  http://www.cl.cam.ac.uk/netos/xen
  University of Cambridge Computer Laboratory

  Xen version 3.1.0-53.1.21.el5 (mockbuild@) (gcc version 4.1.2  
20070626 (Red Hat 4.1.2-14)) Tue May 20 09:27:25 EDT 2008
  Latest ChangeSet: unavailable

(XEN) Command line: /xen.gz-2.6.18-53.1.21.el5
(XEN)  0000000000000000 - 00000000000a0000 (usable)
(XEN)  00000000000f0000 - 0000000000100000 (reserved)
(XEN)  0000000000100000 - 000000003ff77000 (usable)
(XEN)  000000003ff77000 - 000000003ff79000 (ACPI NVS)
(XEN)  000000003ff79000 - 0000000040000000 (reserved)
(XEN)  00000000fec00000 - 00000000fec10000 (reserved)
(XEN)  00000000fee00000 - 00000000fee10000 (reserved)
(XEN)  00000000ffb00000 - 0000000100000000 (reserved)
(XEN) System RAM: 1023MB (1047644kB)
(XEN) Xen heap: 10MB (10240kB)
(XEN) Domain heap initialised: DMA width 32 bits
(XEN) PAE enabled, limit: 16 GB
(XEN) Processor #0 15:1 APIC version 20
(XEN) Enabling APIC mode:  Flat.  Using 1 I/O APICs
(XEN) Using scheduler: SMP Credit Scheduler (credit)
(XEN) Detected 1694.561 MHz processor.
(XEN) CPU0: Intel(R) Pentium(R) 4 CPU 1.70GHz stepping 02
(XEN) Mapping cpu 0 to node 255
(XEN) Total of 1 processors activated.
(XEN) ExtINT not setup in hardware but reported by MP table
(XEN) ENABLING IO-APIC IRQs
(XEN)  -> Using new ACK method
(XEN) Platform timer is 1.193MHz PIT
(XEN) Brought up 1 CPUs
(XEN) *** LOADING DOMAIN 0 ***
(XEN) elf_parse_binary: phdr: paddr=0xc0400000 memsz=0x25d640
(XEN) elf_parse_binary: phdr: paddr=0xc065e000 memsz=0x15a000
(XEN) elf_parse_binary: memory: 0xc0400000 -> 0xc07b8000
(XEN) elf_xen_parse_note: GUEST_OS = "linux"
(XEN) elf_xen_parse_note: GUEST_VERSION = "2.6"
(XEN) elf_xen_parse_note: XEN_VERSION = "xen-3.0"
(XEN) elf_xen_parse_note: VIRT_BASE = 0xc0000000
(XEN) elf_xen_parse_note: PADDR_OFFSET = 0xc0000000
(XEN) elf_xen_parse_note: ENTRY = 0xc0400000
(XEN) elf_xen_parse_note: HYPERCALL_PAGE = 0xc0401000
(XEN) elf_xen_parse_note: FEATURES = "writable_page_tables| 
writable_descriptor_tables|auto_translated_physmap|pae_pgdir_above_4gb| 
supervisor_mode_kernel"
(XEN) elf_xen_parse_note: PAE_MODE = "yes"
(XEN) elf_xen_parse_note: LOADER = "generic"
(XEN) elf_xen_addr_calc_check: addresses:
(XEN)     virt_base        = 0xc0000000
(XEN)     elf_paddr_offset = 0xc0000000
(XEN)     virt_offset      = 0x0
(XEN)     virt_kstart      = 0xc0400000
(XEN)     virt_kend        = 0xc07b8000
(XEN)     virt_entry       = 0xc0400000
(XEN)  Xen  kernel: 32-bit, PAE, lsb
(XEN)  Dom0 kernel: 32-bit, PAE, lsb, paddr 0xc0400000 -> 0xc07b8000
(XEN) PHYSICAL MEMORY ARRANGEMENT:
(XEN)  Dom0 alloc.:   000000003e000000->000000003f000000 (236736 pages  
to be allocated)
(XEN) VIRTUAL MEMORY ARRANGEMENT:
(XEN)  Loaded kernel: c0400000->c07b8000
(XEN)  Init. ramdisk: c07b8000->c0ab2800
(XEN)  Phys-Mach map: c0ab3000->c0b9e300
(XEN)  Start info:    c0b9f000->c0b9f46c
(XEN)  Page tables:   c0ba0000->c0bad000
(XEN)  Boot stack:    c0bad000->c0bae000
(XEN)  TOTAL:         c0000000->c1000000
(XEN)  ENTRY ADDRESS: c0400000
(XEN) Dom0 has maximum 1 VCPUs
(XEN) elf_load_binary: phdr 0 at 0xc0400000 -> 0xc065d640
(XEN) elf_load_binary: phdr 1 at 0xc065e000 -> 0xc0702b64
(XEN) Initrd len 0x2fa800, start at 0xc07b8000
(XEN) Scrubbing Free RAM: done.
(XEN) Xen trace buffers: disabled
(XEN) Std. Loglevel: Errors and warnings
(XEN) Guest Loglevel: Nothing (Rate-limited: Errors and warnings)
(XEN) Xen is relinquishing VGA console.
(XEN) *** Serial input -> DOM0 (type \047CTRL-a\047 three times to  
switch input to Xen).
(XEN) mm.c:597:d0 Bad L1 flags 80000000
(XEN) mm.c:895:d0 Failure in alloc_l1_table: entry 287
(XEN) mm.c:1773:d0 Error while validating mfn f0b0 (pfn 47c5) for type  
20000000: caf=80000002 taf=20000001
(XEN) mm.c:644:d0 Attempt to create linear p.t. with write perms
(XEN) mm.c:1069:d0 Failure in alloc_l2_table: entry 0
(XEN) mm.c:1773:d0 Error while validating mfn 1505 (pfn a5) for type  
40000000: caf=80000002 taf=40000001
(XEN) mm.c:1143:d0 Failure in alloc_l3_table: entry 0
(XEN) mm.c:1773:d0 Error while validating mfn 1534 (pfn 97) for type  
60000000: caf=80000002 taf=60000001
(XEN) mm.c:2042:d0 Error while pinning mfn 1534

----------------------------------------------------------------------------------------------------
cpuinfo from server02
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 1
model name	: Intel(R) Pentium(R) 4 CPU 1.70GHz
stepping	: 2
cpu MHz		: 1694.503
cache size	: 256 KB
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 2
wp		: yes
flags		: fpu tsc msr pae mce cx8 apic mtrr mca cmov pat pse36 clflush  
dts acpi mmx fxsr sse sse2 ss ht tm up
bogomips	: 4242.78








_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

Cody Jarrett

2008-Jun-20 03:17 UTC

head link

Re: [Xen-users] Xen Migration Failure

Anyone have any ideas of what I might be doing wrong? Also, here is my  
vm configuration file:

$ cat /etc/xen/vm01
name = "vm01"
uuid = "daab0e68-c50d-d678-bf36-b8de50fc4065"
maxmem = 128
memory = 128
vcpus = 1
bootloader = "/usr/bin/pygrub"
on_poweroff = "destroy"
on_reboot = "restart"
on_crash = "restart"
vfb = [  ]
disk = [ "tap:aio:/home/vm/vm01.img,xvda,w" ]
vif = [ "mac=00:16:3e:2f:58:3e,bridge=xenbr1" ]
vnc=1


On Jun 18, 2008, at 10:22 PM, Cody Jarrett wrote:
> I''m having problems getting the migration from one machine to  
> another. When I start the migration, it run for probably 15 seconds  
> and ends, and the virtual machines dies. Here''s my setup, 2 xen
host
> running centos 5.1, xen-3.0.3-41.el5_1.6, and kernel  
> 2.6.18-53.1.21.el5xen. Server01 has a VM called vm01 and I''m
trying
> to migrate that over to server02. Server02 has an NFS mount to the  
> directory on server01 that holds the virtual machine disk. Any  
> ideas, is it my hardware?
>
> xend.log from server01
> [2008-06-18 22:14:56 xend 5112] DEBUG (balloon:127) Balloon: 3132  
> KiB free; need 2048; done.
> [2008-06-18 22:14:56 xend 5112] DEBUG (XendCheckpoint:89)  
> [xc_save]: /usr/lib/xen/bin/xc_save 20 17 0 0 1
> [2008-06-18 22:14:56 xend 5112] INFO (XendCheckpoint:351) Had 0  
> unexplained entries in p2m table
> 1: sent 32438, skipped 288, delta 12485ms, dom0 16%, target 0%, sent  
> 85Mb/s, dirtied 0Mb/s 355 pages
> 2: sent 355, skipped 0, delta 97ms, dom0 21%, target 0%, sent 119Mb/ 
> s, dirtied 22Mb/s 67 pages
> 3: sent 67, skipped 0, delta 3ms, dom0 100%, target 0%, sent 731Mb/ 
> s, dirtied 0Mb/s 0 pages
> 4: sent 0, skipped 0, Start last iterationheckpoint:351) Saving  
> memory pages: iter 4   0%
> [2008-06-18 22:15:09 xend 5112] DEBUG (XendCheckpoint:322) suspend
> [2008-06-18 22:15:09 xend 5112] DEBUG (XendCheckpoint:92) In  
> saveInputHandler suspend
> [2008-06-18 22:15:09 xend 5112] DEBUG (XendCheckpoint:94) Suspending  
> 17 ...
> [2008-06-18 22:15:09 xend.XendDomainInfo 5112] DEBUG (XendDomainInfo: 
> 988) XendDomainInfo.handleShutdownWatch
> [2008-06-18 22:15:09 xend.XendDomainInfo 5112] DEBUG (XendDomainInfo: 
> 988) XendDomainInfo.handleShutdownWatch
> [2008-06-18 22:15:09 xend.XendDomainInfo 5112] INFO (XendDomainInfo: 
> 947) Domain has shutdown: name=migrating-vm01 id=17 reason=suspend.
> [2008-06-18 22:15:09 xend 5112] INFO (XendCheckpoint:99) Domain 17  
> suspended.
> [2008-06-18 22:15:09 xend 5112] DEBUG (XendCheckpoint:108) Written  
> done
> [2008-06-18 22:15:09 xend 5112] INFO (XendCheckpoint:351) SUSPEND  
> shinfo 00000bdc
> [2008-06-18 22:15:09 xend 5112] INFO (XendCheckpoint:351) delta  
> 14ms, dom0 50%, target 14%, sent 0Mb/s, dirtied 229Mb/s 98 pages
> 5: sent 98, skipped 0, delta 4ms, dom0 100%, target 0%, sent 802Mb/ 
> s, dirtied 802Mb/s 98 pages
> [2008-06-18 22:15:09 xend 5112] INFO (XendCheckpoint:351) Total  
> pages sent= 32958 (0.95x)
> [2008-06-18 22:15:09 xend 5112] INFO (XendCheckpoint:351) (of which  
> 0 were fixups)
> [2008-06-18 22:15:09 xend 5112] INFO (XendCheckpoint:351) All memory  
> is saved
> [2008-06-18 22:15:09 xend 5112] INFO (XendCheckpoint:351) Save exit  
> rc=0
> [2008-06-18 22:15:09 xend.XendDomainInfo 5112] DEBUG (XendDomainInfo: 
> 1566) XendDomainInfo.destroyDomain(17)
>
>
>
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
>
>
> xm dmesg from server 01
> $ xm dmesg
> __  __            _____  _   ___    ____ _____  _   ____  _       _  
> ____
> \ \/ /___ _ __   |___ / / | / _ \  | ___|___ / / | |___ \/ |  ___| |  
> ___|
>  \  // _ \ \047_ \    |_ \ | || | | |_|___ \ |_ \ | |   __) | | / _  
> \ |___ \
>  /  \  __/ | | |  ___) || || |_| |__|__) |__) || |_ / __/| ||  __/ | 
> ___) |
> /_/\_\___|_| |_| |____(_)_(_)___/  |____/____(_)_(_)_____|_(_)___|_| 
> ____/
>
> http://www.cl.cam.ac.uk/netos/xen
> University of Cambridge Computer Laboratory
>
> Xen version 3.1.0-53.1.21.el5 (mockbuild@) (gcc version 4.1.2  
> 20070626 (Red Hat 4.1.2-14)) Tue May 20 09:27:25 EDT 2008
> Latest ChangeSet: unavailable
>
> (XEN) Command line: /xen.gz-2.6.18-53.1.21.el5
> (XEN)  0000000000000000 - 000000000009f000 (usable)
> (XEN)  000000000009f400 - 00000000000a0000 (reserved)
> (XEN)  00000000000f0000 - 0000000000100000 (reserved)
> (XEN)  0000000000100000 - 000000001f6e0000 (usable)
> (XEN)  000000001f6e0000 - 000000001f6e3000 (ACPI NVS)
> (XEN)  000000001f6e3000 - 000000001f6f0000 (ACPI data)
> (XEN)  000000001f6f0000 - 000000001f700000 (reserved)
> (XEN)  00000000e0000000 - 00000000f0000000 (reserved)
> (XEN)  00000000fec00000 - 0000000100000000 (reserved)
> (XEN) System RAM: 502MB (514556kB)
> (XEN) Xen heap: 10MB (10256kB)
> (XEN) Domain heap initialised: DMA width 32 bits
> (XEN) PAE enabled, limit: 16 GB
> (XEN) Processor #0 15:4 APIC version 20
> (XEN) Processor #1 15:4 APIC version 20
> (XEN) IOAPIC[0]: apic_id 4, version 32, address 0xfec00000, GSI 0-23
> (XEN) IOAPIC[1]: apic_id 5, version 32, address 0xfec84400, GSI 24-47
> (XEN) Enabling APIC mode:  Flat.  Using 2 I/O APICs
> (XEN) Using scheduler: SMP Credit Scheduler (credit)
> (XEN) Detected 3000.252 MHz processor.
> (XEN) CPU0: Intel(R) Pentium(R) 4 CPU 3.00GHz stepping 01
> (XEN) Mapping cpu 0 to node 255
> (XEN) Booting processor 1/1 eip 90000
> (XEN) Mapping cpu 1 to node 255
> (XEN) CPU1: Intel(R) Pentium(R) 4 CPU 3.00GHz stepping 01
> (XEN) Total of 2 processors activated.
> (XEN) ENABLING IO-APIC IRQs
> (XEN)  -> Using new ACK method
> (XEN) Platform timer is 1.193MHz PIT
> (XEN) Brought up 2 CPUs
> (XEN) *** LOADING DOMAIN 0 ***
> (XEN) elf_parse_binary: phdr: paddr=0xc0400000 memsz=0x25d640
> (XEN) elf_parse_binary: phdr: paddr=0xc065e000 memsz=0x15a000
> (XEN) elf_parse_binary: memory: 0xc0400000 -> 0xc07b8000
> (XEN) elf_xen_parse_note: GUEST_OS = "linux"
> (XEN) elf_xen_parse_note: GUEST_VERSION = "2.6"
> (XEN) elf_xen_parse_note: XEN_VERSION = "xen-3.0"
> (XEN) elf_xen_parse_note: VIRT_BASE = 0xc0000000
> (XEN) elf_xen_parse_note: PADDR_OFFSET = 0xc0000000
> (XEN) elf_xen_parse_note: ENTRY = 0xc0400000
> (XEN) elf_xen_parse_note: HYPERCALL_PAGE = 0xc0401000
> (XEN) elf_xen_parse_note: FEATURES = "writable_page_tables| 
> writable_descriptor_tables|auto_translated_physmap| 
> pae_pgdir_above_4gb|supervisor_mode_kernel"
> (XEN) elf_xen_parse_note: PAE_MODE = "yes"
> (XEN) elf_xen_parse_note: LOADER = "generic"
> (XEN) elf_xen_addr_calc_check: addresses:
> (XEN)     virt_base        = 0xc0000000
> (XEN)     elf_paddr_offset = 0xc0000000
> (XEN)     virt_offset      = 0x0
> (XEN)     virt_kstart      = 0xc0400000
> (XEN)     virt_kend        = 0xc07b8000
> (XEN)     virt_entry       = 0xc0400000
> (XEN)  Xen  kernel: 32-bit, PAE, lsb
> (XEN)  Dom0 kernel: 32-bit, PAE, lsb, paddr 0xc0400000 -> 0xc07b8000
> (XEN) PHYSICAL MEMORY ARRANGEMENT:
> (XEN)  Dom0 alloc.:   000000001e000000->000000001f000000 (112527  
> pages to be allocated)
> (XEN) VIRTUAL MEMORY ARRANGEMENT:
> (XEN)  Loaded kernel: c0400000->c07b8000
> (XEN)  Init. ramdisk: c07b8000->c0e4f800
> (XEN)  Phys-Mach map: c0e50000->c0ec1e3c
> (XEN)  Start info:    c0ec2000->c0ec246c
> (XEN)  Page tables:   c0ec3000->c0ed0000
> (XEN)  Boot stack:    c0ed0000->c0ed1000
> (XEN)  TOTAL:         c0000000->c1000000
> (XEN)  ENTRY ADDRESS: c0400000
> (XEN) Dom0 has maximum 2 VCPUs
> (XEN) elf_load_binary: phdr 0 at 0xc0400000 -> 0xc065d640
> (XEN) elf_load_binary: phdr 1 at 0xc065e000 -> 0xc0702b64
> (XEN) Initrd len 0x697800, start at 0xc07b8000
> (XEN) Scrubbing Free RAM: done.
> (XEN) Xen trace buffers: disabled
> (XEN) Std. Loglevel: Errors and warnings
> (XEN) Guest Loglevel: Nothing (Rate-limited: Errors and warnings)
> (XEN) Xen is relinquishing VGA console.
> (XEN) *** Serial input -> DOM0 (type \047CTRL-a\047 three times to  
> switch input to Xen).
> (XEN) mm.c:636:d0 Error getting mfn e046 (pfn 3c2a) from L1 entry  
> 800000000e046025 for dom3
> (XEN) mm.c:636:d0 Error getting mfn fb9 (pfn 4409) from L1 entry  
> 8000000000fb9025 for dom3
> (XEN) mm.c:636:d0 Error getting mfn 1530d (pfn 47b0) from L1 entry  
> 800000001530d025 for dom3
> (XEN) mm.c:636:d0 Error getting mfn 15062 (pfn 3c2a) from L1 entry  
> 8000000015062025 for dom3
> (XEN) mm.c:636:d0 Error getting mfn e124 (pfn 66f1) from L1 entry  
> 800000000e124025 for dom3
> (XEN) mm.c:636:d0 Error getting mfn 15226 (pfn 47be) from L1 entry  
> 8000000015226025 for dom3
> (XEN) mm.c:636:d0 Error getting mfn 152be (pfn 3c88) from L1 entry  
> 80000000152be025 for dom3
> (XEN) mm.c:636:d0 Error getting mfn 1509d (pfn 4ca3) from L1 entry  
> 800000001509d025 for dom3
> (XEN) mm.c:636:d0 Error getting mfn 157b7 (pfn 4b5b) from L1 entry  
> 80000000157b7025 for dom3
> (XEN) mm.c:636:d0 Error getting mfn 15523 (pfn 4b6a) from L1 entry  
> 8000000015523025 for dom3
> (XEN) printk: 12 messages suppressed.
> (XEN) mm.c:636:d0 Error getting mfn 1525a (pfn 66d2) from L1 entry  
> 800000001525a025 for dom4
> (XEN) mm.c:636:d0 Error getting mfn 1555e (pfn 7a52) from L1 entry  
> 800000001555e025 for dom4
> (XEN) mm.c:636:d0 Error getting mfn 15bc3 (pfn 62df) from L1 entry  
> 8000000015bc3025 for dom4
> (XEN) mm.c:636:d0 Error getting mfn 15ecc (pfn 6715) from L1 entry  
> 8000000015ecc025 for dom4
> (XEN) mm.c:636:d0 Error getting mfn ef68 (pfn 625b) from L1 entry  
> 800000000ef68025 for dom4
> (XEN) mm.c:636:d0 Error getting mfn 154c9 (pfn 618f) from L1 entry  
> 80000000154c9025 for dom4
> (XEN) mm.c:636:d0 Error getting mfn 15b14 (pfn 66eb) from L1 entry  
> 8000000015b14025 for dom4
> (XEN) mm.c:636:d0 Error getting mfn 14d52 (pfn 66fb) from L1 entry  
> 8000000014d52025 for dom4
> (XEN) mm.c:636:d0 Error getting mfn 14c54 (pfn 61d7) from L1 entry  
> 8000000014c54025 for dom4
> (XEN) mm.c:636:d0 Error getting mfn 14da1 (pfn 65e9) from L1 entry  
> 8000000014da1025 for dom4
> (XEN) printk: 57 messages suppressed.
> (XEN) mm.c:636:d0 Error getting mfn 152f8 (pfn 62af) from L1 entry  
> 80000000152f8025 for dom4
> (XEN) printk: 7 messages suppressed.
> (XEN) mm.c:636:d0 Error getting mfn 13989 (pfn 3261) from L1 entry  
> 8000000013989025 for dom5
> (XEN) mm.c:636:d0 Error getting mfn 151fc (pfn 3272) from L1 entry  
> 80000000151fc025 for dom5
> (XEN) mm.c:636:d0 Error getting mfn 15ca4 (pfn 54b3) from L1 entry  
> 8000000015ca4025 for dom5
> (XEN) mm.c:636:d0 Error getting mfn 13e3b (pfn 6b23) from L1 entry  
> 8000000013e3b025 for dom5
> (XEN) mm.c:636:d0 Error getting mfn 15277 (pfn 3224) from L1 entry  
> 8000000015277025 for dom5
> (XEN) mm.c:636:d0 Error getting mfn f86a (pfn 651b) from L1 entry  
> 800000000f86a025 for dom5
> (XEN) mm.c:636:d0 Error getting mfn cd27 (pfn 653d) from L1 entry  
> 800000000cd27025 for dom5
> (XEN) mm.c:636:d0 Error getting mfn 26f1 (pfn 3275) from L1 entry  
> 80000000026f1025 for dom5
> (XEN) mm.c:636:d0 Error getting mfn 15ca7 (pfn 6562) from L1 entry  
> 8000000015ca7025 for dom5
> (XEN) mm.c:636:d0 Error getting mfn 149cc (pfn 2d67) from L1 entry  
> 80000000149cc025 for dom5
> (XEN) printk: 15 messages suppressed.
> (XEN) mm.c:636:d0 Error getting mfn 16172 (pfn 3a80) from L1 entry  
> 8000000016172025 for dom16
> (XEN) mm.c:636:d0 Error getting mfn 1ab59 (pfn 3aa0) from L1 entry  
> 800000001ab59025 for dom16
> (XEN) mm.c:636:d0 Error getting mfn 1a1d4 (pfn 3a8c) from L1 entry  
> 800000001a1d4025 for dom16
> (XEN) mm.c:636:d0 Error getting mfn 177c4 (pfn 3a9c) from L1 entry  
> 80000000177c4025 for dom16
> (XEN) mm.c:636:d0 Error getting mfn ed39 (pfn 3aac) from L1 entry  
> 800000000ed39025 for dom16
> (XEN) mm.c:636:d0 Error getting mfn 142e2 (pfn 3abc) from L1 entry  
> 80000000142e2025 for dom16
> (XEN) mm.c:636:d0 Error getting mfn 17ee6 (pfn 3a91) from L1 entry  
> 8000000017ee6025 for dom16
> (XEN) mm.c:636:d0 Error getting mfn 129a2 (pfn 3aa1) from L1 entry  
> 80000000129a2025 for dom16
> (XEN) mm.c:636:d0 Error getting mfn 19bbc (pfn 3ab2) from L1 entry  
> 8000000019bbc025 for dom16
> (XEN) mm.c:636:d0 Error getting mfn 1d6c8 (pfn 3a93) from L1 entry  
> 800000001d6c8025 for dom16
>
>
--------------------------------------------------------------------------------------------------------------------------------
> cpuinfo from server01
>
> $ cat /proc/cpuinfo
> processor	: 0
> vendor_id	: GenuineIntel
> cpu family	: 15
> model		: 4
> model name	: Intel(R) Pentium(R) 4 CPU 3.00GHz
> stepping	: 1
> cpu MHz		: 3000.252
> cache size	: 1024 KB
> fdiv_bug	: no
> hlt_bug		: no
> f00f_bug	: no
> coma_bug	: no
> fpu		: yes
> fpu_exception	: yes
> cpuid level	: 5
> wp		: yes
> flags		: fpu tsc msr pae mce cx8 apic mtrr mca cmov pat pse36  
> clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe nx constant_tsc pni  
> monitor ds_cpl cid xtpr
> bogomips	: 7508.56
>
> processor	: 1
> vendor_id	: GenuineIntel
> cpu family	: 15
> model		: 4
> model name	: Intel(R) Pentium(R) 4 CPU 3.00GHz
> stepping	: 1
> cpu MHz		: 3000.252
> cache size	: 1024 KB
> fdiv_bug	: no
> hlt_bug		: no
> f00f_bug	: no
> coma_bug	: no
> fpu		: yes
> fpu_exception	: yes
> cpuid level	: 5
> wp		: yes
> flags		: fpu tsc msr pae mce cx8 apic mtrr mca cmov pat pse36  
> clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe nx constant_tsc up  
> pni monitor ds_cpl cid xtpr
> bogomips	: 7508.56
>
>
----------------------------------------------------------------------------------------------------------------------------------------------------
> xend.log from server02
> [2008-06-18 22:14:56 xend.XendDomainInfo 4241] DEBUG (XendDomainInfo: 
> 275) XendDomainInfo.restore([''domain'',
[''domid'', ''17''], [''uuid'',
> ''daab0e68-c50d-d678-bf36-b8de50fc4065''],
[''vcpus'', ''1''],
> [''vcpu_avail'', ''1''],
[''cpu_weight'', ''1.0''],
[''memory'', ''128''],
> [''shadow_memory'', ''0''],
[''maxmem'', ''128''],
[''bootloader'', ''/usr/bin/
> pygrub''], [''features''],
[''name'', ''vm01''],
[''on_poweroff'',
> ''destroy''], [''on_reboot'',
''restart''], [''on_crash'',
''restart''],
> [''image'', [''linux'',
[''ramdisk'',
''/var/lib/xen/boot_ramdisk.H-WMcf''],
> [''kernel'',
''/var/lib/xen/boot_kernel.CWSvum''], [''args'',
''ro root=/
> dev/VolGroup00/LogVol00 console=xvc0'']]],
[''device'', [''vif'',
> [''backend'', ''0''],
[''script'', ''vif-bridge''],
[''bridge'', ''xenbr1''],
> [''mac'', ''00:16:3e:2f:58:3e'']]],
[''device'', [''vkbd'',
[''backend'',
> ''0'']]], [''device'',
[''vfb'', [''backend'', ''0''],
[''type'', ''vnc''],
> [''vncunused'', ''1''],
[''xauthority'', ''/root/.Xauthority'']]],
> [''device'', [''tap'',
[''backend'', ''0''], [''dev'',
''xvda:disk''], [''uname'',
> ''tap:aio:/home/vm/vm01.img''], [''mode'',
''w'']]], [''state'',
''--p---''],
> [''shutdown_reason'', ''poweroff''],
[''cpu_time'', ''0.0''],
> [''online_vcpus'', ''1''],
[''up_time'', ''161.610284805''],
[''start_time'',
> ''1213845134.84''], [''store_mfn'',
''77630''], [''console_mfn'',
''77629'']])
> [2008-06-18 22:14:56 xend.XendDomainInfo 4241] DEBUG (XendDomainInfo: 
> 306) parseConfig: config is [''domain'',
[''domid'', ''17''], [''uuid'',
> ''daab0e68-c50d-d678-bf36-b8de50fc4065''],
[''vcpus'', ''1''],
> [''vcpu_avail'', ''1''],
[''cpu_weight'', ''1.0''],
[''memory'', ''128''],
> [''shadow_memory'', ''0''],
[''maxmem'', ''128''],
[''bootloader'', ''/usr/bin/
> pygrub''], [''features''],
[''name'', ''vm01''],
[''on_poweroff'',
> ''destroy''], [''on_reboot'',
''restart''], [''on_crash'',
''restart''],
> [''image'', [''linux'',
[''ramdisk'',
''/var/lib/xen/boot_ramdisk.H-WMcf''],
> [''kernel'',
''/var/lib/xen/boot_kernel.CWSvum''], [''args'',
''ro root=/
> dev/VolGroup00/LogVol00 console=xvc0'']]],
[''device'', [''vif'',
> [''backend'', ''0''],
[''script'', ''vif-bridge''],
[''bridge'', ''xenbr1''],
> [''mac'', ''00:16:3e:2f:58:3e'']]],
[''device'', [''vkbd'',
[''backend'',
> ''0'']]], [''device'',
[''vfb'', [''backend'', ''0''],
[''type'', ''vnc''],
> [''vncunused'', ''1''],
[''xauthority'', ''/root/.Xauthority'']]],
> [''device'', [''tap'',
[''backend'', ''0''], [''dev'',
''xvda:disk''], [''uname'',
> ''tap:aio:/home/vm/vm01.img''], [''mode'',
''w'']]], [''state'',
''--p---''],
> [''shutdown_reason'', ''poweroff''],
[''cpu_time'', ''0.0''],
> [''online_vcpus'', ''1''],
[''up_time'', ''161.610284805''],
[''start_time'',
> ''1213845134.84''], [''store_mfn'',
''77630''], [''console_mfn'',
''77629'']]
> [2008-06-18 22:14:56 xend.XendDomainInfo 4241] DEBUG (XendDomainInfo: 
> 411) parseConfig: result is {''shadow_memory'': 0,
''start_time'':
> 1213845134.8399999, ''uuid'':
''daab0e68-c50d-d678-bf36-b8de50fc4065'',
> ''on_crash'': ''restart'',
''on_reboot'': ''restart'',
''localtime'': None,
> ''image'': [''linux'',
[''ramdisk'',
''/var/lib/xen/boot_ramdisk.H-WMcf''],
> [''kernel'',
''/var/lib/xen/boot_kernel.CWSvum''], [''args'',
''ro root=/
> dev/VolGroup00/LogVol00 console=xvc0'']],
''on_poweroff'': ''destroy'',
> ''bootloader_args'': None, ''cpus'': None,
''name'': ''vm01'', ''backend'':
> [], ''vcpus'': 1, ''cpu_weight'': 1.0,
''features'': None, ''vcpu_avail'':
> 1, ''memory'': 128, ''device'':
[(''vif'', [''vif'',
[''backend'', ''0''],
> [''script'', ''vif-bridge''],
[''bridge'', ''xenbr1''],
[''mac'', ''00:16:3e:2f:
> 58:3e'']]), (''vkbd'', [''vkbd'',
[''backend'', ''0'']]),
(''vfb'', [''vfb'',
> [''backend'', ''0''],
[''type'', ''vnc''],
[''vncunused'', ''1''],
> [''xauthority'', ''/root/.Xauthority'']]),
(''tap'', [''tap'',
[''backend'',
> ''0''], [''dev'',
''xvda:disk''], [''uname'',
''tap:aio:/home/vm/vm01.img''],
> [''mode'', ''w'']])],
''bootloader'': ''/usr/bin/pygrub'',
''cpu'': None,
> ''maxmem'': 128}
> [2008-06-18 22:14:56 xend.XendDomainInfo 4241] DEBUG (XendDomainInfo: 
> 1349) XendDomainInfo.construct: None
> [2008-06-18 22:14:56 xend 4241] DEBUG (balloon:127) Balloon: 63964  
> KiB free; need 2048; done.
> [2008-06-18 22:14:56 xend.XendDomainInfo 4241] DEBUG (XendDomainInfo: 
> 756) Storing VM details: {''shadow_memory'':
''0'', ''uuid'': ''daab0e68-
> c50d-d678-bf36-b8de50fc4065'', ''on_reboot'':
''restart'', ''start_time'':
> ''1213845134.84'', ''on_poweroff'':
''destroy'', ''name'': ''vm01'',
''xend/
> restart_count'': ''0'', ''vcpus'':
''1'', ''vcpu_avail'': ''1'',
''memory'':
> ''128'', ''on_crash'':
''restart'', ''image'': "(linux (ramdisk
/var/lib/xen/
> boot_ramdisk.H-WMcf) (kernel /var/lib/xen/boot_kernel.CWSvum) (args  
> ''ro root=/dev/VolGroup00/LogVol00 console=xvc0''))",
''maxmem'': ''128''}
> [2008-06-18 22:14:56 xend 4241] DEBUG (DevController:110)  
> DevController: writing {''state'': ''1'',
''backend-id'': ''0'',
''backend'':
> ''/local/domain/0/backend/vkbd/1/0''} to
/local/domain/1/device/vkbd/0.
> [2008-06-18 22:14:56 xend 4241] DEBUG (DevController:112)  
> DevController: writing {''frontend-id'':
''1'', ''domain'': ''vm01'',
> ''frontend'':
''/local/domain/1/device/vkbd/0'', ''state'':
''1'', ''online'':
> ''1''} to /local/domain/0/backend/vkbd/1/0.
> [2008-06-18 22:14:56 xend 4241] DEBUG (DevController:110)  
> DevController: writing {''backend-id'':
''0'', ''mac'': ''00:16:3e:2f:
> 58:3e'', ''handle'': ''0'',
''state'': ''1'', ''backend'':
''/local/domain/0/
> backend/vif/1/0''} to /local/domain/1/device/vif/0.
> [2008-06-18 22:14:56 xend 4241] DEBUG (DevController:112)  
> DevController: writing {''bridge'':
''xenbr1'', ''domain'':
''vm01'',
> ''handle'': ''0'',
''script'': ''/etc/xen/scripts/vif-bridge'',
''state'':
> ''1'', ''frontend'':
''/local/domain/1/device/vif/0'', ''mac'':
''00:16:3e:2f:
> 58:3e'', ''online'': ''1'',
''frontend-id'': ''1''} to /local/domain/0/
> backend/vif/1/0.
> [2008-06-18 22:14:56 xend 4241] DEBUG (DevController:110)  
> DevController: writing {''state'': ''1'',
''backend-id'': ''0'',
''backend'':
> ''/local/domain/0/backend/vfb/1/0''} to
/local/domain/1/device/vfb/0.
> [2008-06-18 22:14:56 xend 4241] DEBUG (DevController:112)  
> DevController: writing {''vncunused'':
''1'', ''domain'': ''vm01'',
> ''frontend'':
''/local/domain/1/device/vfb/0'',
''xauthority'': ''/
> root/.Xauthority'', ''state'':
''1'', ''online'': ''1'',
''frontend-id'': ''1'',
> ''type'': ''vnc''} to
/local/domain/0/backend/vfb/1/0.
> [2008-06-18 22:14:56 xend 4241] DEBUG (vfbif:64) No VNC passwd  
> configured for vfb access
> [2008-06-18 22:14:56 xend 4241] DEBUG (blkif:24) exception looking  
> up device number for xvda: [Errno 2] No such file or directory: ''/
> dev/xvda''
> [2008-06-18 22:14:56 xend 4241] DEBUG (DevController:110)  
> DevController: writing {''backend-id'':
''0'', ''virtual-device'':
> ''51712'', ''device-type'':
''disk'', ''state'': ''1'',
''backend'': ''/local/
> domain/0/backend/tap/1/51712''} to
/local/domain/1/device/vbd/51712.
> [2008-06-18 22:14:56 xend 4241] DEBUG (DevController:112)  
> DevController: writing {''domain'':
''vm01'', ''frontend'': ''/local/domain/
> 1/device/vbd/51712'', ''format'':
''raw'', ''dev'': ''xvda'',
''state'': ''1'',
> ''params'': ''aio:/home/vm/vm01.img'',
''mode'': ''w'', ''online'':
''1'',
> ''frontend-id'': ''1'',
''type'': ''tap''} to
/local/domain/0/backend/tap/
> 1/51712.
> [2008-06-18 22:14:56 xend.XendDomainInfo 4241] DEBUG (XendDomainInfo: 
> 791) Storing domain details: {''console/port'':
''2'', ''name'': ''vm01'',
> ''console/limit'': ''1048576'',
''vm'': ''/vm/daab0e68-c50d-d678-bf36-
> b8de50fc4065'', ''domid'': ''1'',
''cpu/0/availability'': ''online'',
''memory/
> target'': ''131072'',
''store/port'': ''1''}
> [2008-06-18 22:14:56 xend 4241] DEBUG (XendCheckpoint:198)  
> restore:shadow=0x0, _static_max=0x80, _static_min=0x80,
> [2008-06-18 22:14:56 xend 4241] DEBUG (balloon:133) Balloon: 63964  
> KiB free; 0 to scrub; need 131072; retries: 20.
> [2008-06-18 22:14:56 xend 4241] DEBUG (balloon:148) Balloon: setting  
> dom0 target to 875 MiB.
> [2008-06-18 22:14:56 xend.XendDomainInfo 4241] DEBUG (XendDomainInfo: 
> 1078) Setting memory target of domain Domain-0 (0) to 875 MiB.
> [2008-06-18 22:14:57 xend 4241] DEBUG (balloon:127) Balloon: 131548  
> KiB free; need 131072; done.
> [2008-06-18 22:14:57 xend 4241] DEBUG (XendCheckpoint:215)  
> [xc_restore]: /usr/lib/xen/bin/xc_restore 15 1 1 2 0 0 0
> [2008-06-18 22:14:57 xend 4241] INFO (XendCheckpoint:351)  
> xc_domain_restore start: p2m_size = 8800
> [2008-06-18 22:14:57 xend 4241] INFO (XendCheckpoint:351) Reloading  
> memory pages:   0%
> [2008-06-18 22:15:09 xend 4241] INFO (XendCheckpoint:351) Received  
> all pages (0 races)
> [2008-06-18 22:15:09 xend 4241] INFO (XendCheckpoint:351) ERROR  
> Internal error: Failed to pin batch of 31 page tables
> [2008-06-18 22:15:09 xend 4241] INFO (XendCheckpoint:351) Restore  
> exit with rc=1
> [2008-06-18 22:15:09 xend.XendDomainInfo 4241] DEBUG (XendDomainInfo: 
> 1557) XendDomainInfo.destroy: domid=1
> [2008-06-18 22:15:09 xend.XendDomainInfo 4241] DEBUG (XendDomainInfo: 
> 1566) XendDomainInfo.destroyDomain(1)
> [2008-06-18 22:15:09 xend.XendDomainInfo 4241] ERROR (XendDomainInfo: 
> 1572) XendDomainInfo.destroy: xc.domain_destroy failed.
> Traceback (most recent call last):
>  File
"/usr/lib/python2.4/site-packages/xen/xend/XendDomainInfo.py",
> line 1570, in destroyDomain
>    xc.domain_destroy(self.domid)
> Error: (3, ''No such process'')
> [2008-06-18 22:15:09 xend 4241] ERROR (XendDomain:268) Restore failed
> Traceback (most recent call last):
>  File "/usr/lib/python2.4/site-packages/xen/xend/XendDomain.py",
> line 263, in domain_restore_fd
>    return XendCheckpoint.restore(self, fd)
>  File
"/usr/lib/python2.4/site-packages/xen/xend/XendCheckpoint.py",
> line 219, in restore
>    forkHelper(cmd, fd, handler.handler, True)
>  File
"/usr/lib/python2.4/site-packages/xen/xend/XendCheckpoint.py",
> line 339, in forkHelper
>    raise XendError("%s failed" % string.join(cmd))
> XendError: /usr/lib/xen/bin/xc_restore 15 1 1 2 0 0 0 failed
>
>
-------------------------------------------------------------------------------------------------------------------------------------------
> xm dmesg from server02
> root@cjarrett:~
> $ xm dmesg
> __  __            _____  _   ___    ____ _____  _   ____  _       _  
> ____
> \ \/ /___ _ __   |___ / / | / _ \  | ___|___ / / | |___ \/ |  ___| |  
> ___|
>  \  // _ \ \047_ \    |_ \ | || | | |_|___ \ |_ \ | |   __) | | / _  
> \ |___ \
>  /  \  __/ | | |  ___) || || |_| |__|__) |__) || |_ / __/| ||  __/ | 
> ___) |
> /_/\_\___|_| |_| |____(_)_(_)___/  |____/____(_)_(_)_____|_(_)___|_| 
> ____/
>
> http://www.cl.cam.ac.uk/netos/xen
> University of Cambridge Computer Laboratory
>
> Xen version 3.1.0-53.1.21.el5 (mockbuild@) (gcc version 4.1.2  
> 20070626 (Red Hat 4.1.2-14)) Tue May 20 09:27:25 EDT 2008
> Latest ChangeSet: unavailable
>
> (XEN) Command line: /xen.gz-2.6.18-53.1.21.el5
> (XEN)  0000000000000000 - 00000000000a0000 (usable)
> (XEN)  00000000000f0000 - 0000000000100000 (reserved)
> (XEN)  0000000000100000 - 000000003ff77000 (usable)
> (XEN)  000000003ff77000 - 000000003ff79000 (ACPI NVS)
> (XEN)  000000003ff79000 - 0000000040000000 (reserved)
> (XEN)  00000000fec00000 - 00000000fec10000 (reserved)
> (XEN)  00000000fee00000 - 00000000fee10000 (reserved)
> (XEN)  00000000ffb00000 - 0000000100000000 (reserved)
> (XEN) System RAM: 1023MB (1047644kB)
> (XEN) Xen heap: 10MB (10240kB)
> (XEN) Domain heap initialised: DMA width 32 bits
> (XEN) PAE enabled, limit: 16 GB
> (XEN) Processor #0 15:1 APIC version 20
> (XEN) Enabling APIC mode:  Flat.  Using 1 I/O APICs
> (XEN) Using scheduler: SMP Credit Scheduler (credit)
> (XEN) Detected 1694.561 MHz processor.
> (XEN) CPU0: Intel(R) Pentium(R) 4 CPU 1.70GHz stepping 02
> (XEN) Mapping cpu 0 to node 255
> (XEN) Total of 1 processors activated.
> (XEN) ExtINT not setup in hardware but reported by MP table
> (XEN) ENABLING IO-APIC IRQs
> (XEN)  -> Using new ACK method
> (XEN) Platform timer is 1.193MHz PIT
> (XEN) Brought up 1 CPUs
> (XEN) *** LOADING DOMAIN 0 ***
> (XEN) elf_parse_binary: phdr: paddr=0xc0400000 memsz=0x25d640
> (XEN) elf_parse_binary: phdr: paddr=0xc065e000 memsz=0x15a000
> (XEN) elf_parse_binary: memory: 0xc0400000 -> 0xc07b8000
> (XEN) elf_xen_parse_note: GUEST_OS = "linux"
> (XEN) elf_xen_parse_note: GUEST_VERSION = "2.6"
> (XEN) elf_xen_parse_note: XEN_VERSION = "xen-3.0"
> (XEN) elf_xen_parse_note: VIRT_BASE = 0xc0000000
> (XEN) elf_xen_parse_note: PADDR_OFFSET = 0xc0000000
> (XEN) elf_xen_parse_note: ENTRY = 0xc0400000
> (XEN) elf_xen_parse_note: HYPERCALL_PAGE = 0xc0401000
> (XEN) elf_xen_parse_note: FEATURES = "writable_page_tables| 
> writable_descriptor_tables|auto_translated_physmap| 
> pae_pgdir_above_4gb|supervisor_mode_kernel"
> (XEN) elf_xen_parse_note: PAE_MODE = "yes"
> (XEN) elf_xen_parse_note: LOADER = "generic"
> (XEN) elf_xen_addr_calc_check: addresses:
> (XEN)     virt_base        = 0xc0000000
> (XEN)     elf_paddr_offset = 0xc0000000
> (XEN)     virt_offset      = 0x0
> (XEN)     virt_kstart      = 0xc0400000
> (XEN)     virt_kend        = 0xc07b8000
> (XEN)     virt_entry       = 0xc0400000
> (XEN)  Xen  kernel: 32-bit, PAE, lsb
> (XEN)  Dom0 kernel: 32-bit, PAE, lsb, paddr 0xc0400000 -> 0xc07b8000
> (XEN) PHYSICAL MEMORY ARRANGEMENT:
> (XEN)  Dom0 alloc.:   000000003e000000->000000003f000000 (236736  
> pages to be allocated)
> (XEN) VIRTUAL MEMORY ARRANGEMENT:
> (XEN)  Loaded kernel: c0400000->c07b8000
> (XEN)  Init. ramdisk: c07b8000->c0ab2800
> (XEN)  Phys-Mach map: c0ab3000->c0b9e300
> (XEN)  Start info:    c0b9f000->c0b9f46c
> (XEN)  Page tables:   c0ba0000->c0bad000
> (XEN)  Boot stack:    c0bad000->c0bae000
> (XEN)  TOTAL:         c0000000->c1000000
> (XEN)  ENTRY ADDRESS: c0400000
> (XEN) Dom0 has maximum 1 VCPUs
> (XEN) elf_load_binary: phdr 0 at 0xc0400000 -> 0xc065d640
> (XEN) elf_load_binary: phdr 1 at 0xc065e000 -> 0xc0702b64
> (XEN) Initrd len 0x2fa800, start at 0xc07b8000
> (XEN) Scrubbing Free RAM: done.
> (XEN) Xen trace buffers: disabled
> (XEN) Std. Loglevel: Errors and warnings
> (XEN) Guest Loglevel: Nothing (Rate-limited: Errors and warnings)
> (XEN) Xen is relinquishing VGA console.
> (XEN) *** Serial input -> DOM0 (type \047CTRL-a\047 three times to  
> switch input to Xen).
> (XEN) mm.c:597:d0 Bad L1 flags 80000000
> (XEN) mm.c:895:d0 Failure in alloc_l1_table: entry 287
> (XEN) mm.c:1773:d0 Error while validating mfn f0b0 (pfn 47c5) for  
> type 20000000: caf=80000002 taf=20000001
> (XEN) mm.c:644:d0 Attempt to create linear p.t. with write perms
> (XEN) mm.c:1069:d0 Failure in alloc_l2_table: entry 0
> (XEN) mm.c:1773:d0 Error while validating mfn 1505 (pfn a5) for type  
> 40000000: caf=80000002 taf=40000001
> (XEN) mm.c:1143:d0 Failure in alloc_l3_table: entry 0
> (XEN) mm.c:1773:d0 Error while validating mfn 1534 (pfn 97) for type  
> 60000000: caf=80000002 taf=60000001
> (XEN) mm.c:2042:d0 Error while pinning mfn 1534
>
>
----------------------------------------------------------------------------------------------------
> cpuinfo from server02
> processor	: 0
> vendor_id	: GenuineIntel
> cpu family	: 15
> model		: 1
> model name	: Intel(R) Pentium(R) 4 CPU 1.70GHz
> stepping	: 2
> cpu MHz		: 1694.503
> cache size	: 256 KB
> fdiv_bug	: no
> hlt_bug		: no
> f00f_bug	: no
> coma_bug	: no
> fpu		: yes
> fpu_exception	: yes
> cpuid level	: 2
> wp		: yes
> flags		: fpu tsc msr pae mce cx8 apic mtrr mca cmov pat pse36  
> clflush dts acpi mmx fxsr sse sse2 ss ht tm up
> bogomips	: 4242.78
>
>
>
>
>
>
>
>
> _______________________________________________
> Xen-users mailing list
> Xen-users@lists.xensource.com
> http://lists.xensource.com/xen-users

_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

Jeff Snider

2008-Jun-20 22:45 UTC

head link

Re: [Xen-users] Xen Migration Failure

Could you run "xm info" on both and post the output?  I suspect
it''s
the difference in the hardware capabilities between the boxes.

-Jeff


On Jun 19, 2008, at 10:17 PM, Cody Jarrett wrote:
> Anyone have any ideas of what I might be doing wrong? Also, here is my
> vm configuration file:
>
> $ cat /etc/xen/vm01
> name = "vm01"
> uuid = "daab0e68-c50d-d678-bf36-b8de50fc4065"
> maxmem = 128
> memory = 128
> vcpus = 1
> bootloader = "/usr/bin/pygrub"
> on_poweroff = "destroy"
> on_reboot = "restart"
> on_crash = "restart"
> vfb = [  ]
> disk = [ "tap:aio:/home/vm/vm01.img,xvda,w" ]
> vif = [ "mac=00:16:3e:2f:58:3e,bridge=xenbr1" ]
> vnc=1
>
>
> On Jun 18, 2008, at 10:22 PM, Cody Jarrett wrote:
>
>> I''m having problems getting the migration from one machine to
>> another. When I start the migration, it run for probably 15 seconds
>> and ends, and the virtual machines dies. Here''s my setup, 2
xen host
>> running centos 5.1, xen-3.0.3-41.el5_1.6, and kernel
>> 2.6.18-53.1.21.el5xen. Server01 has a VM called vm01 and I''m
trying
>> to migrate that over to server02. Server02 has an NFS mount to the
>> directory on server01 that holds the virtual machine disk. Any
>> ideas, is it my hardware?
>>
>> xend.log from server01
>> [2008-06-18 22:14:56 xend 5112] DEBUG (balloon:127) Balloon: 3132
>> KiB free; need 2048; done.
>> [2008-06-18 22:14:56 xend 5112] DEBUG (XendCheckpoint:89)
>> [xc_save]: /usr/lib/xen/bin/xc_save 20 17 0 0 1
>> [2008-06-18 22:14:56 xend 5112] INFO (XendCheckpoint:351) Had 0
>> unexplained entries in p2m table
>> 1: sent 32438, skipped 288, delta 12485ms, dom0 16%, target 0%, sent
>> 85Mb/s, dirtied 0Mb/s 355 pages
>> 2: sent 355, skipped 0, delta 97ms, dom0 21%, target 0%, sent 119Mb/
>> s, dirtied 22Mb/s 67 pages
>> 3: sent 67, skipped 0, delta 3ms, dom0 100%, target 0%, sent 731Mb/
>> s, dirtied 0Mb/s 0 pages
>> 4: sent 0, skipped 0, Start last iterationheckpoint:351) Saving
>> memory pages: iter 4   0%
>> [2008-06-18 22:15:09 xend 5112] DEBUG (XendCheckpoint:322) suspend
>> [2008-06-18 22:15:09 xend 5112] DEBUG (XendCheckpoint:92) In
>> saveInputHandler suspend
>> [2008-06-18 22:15:09 xend 5112] DEBUG (XendCheckpoint:94) Suspending
>> 17 ...
>> [2008-06-18 22:15:09 xend.XendDomainInfo 5112] DEBUG (XendDomainInfo:
>> 988) XendDomainInfo.handleShutdownWatch
>> [2008-06-18 22:15:09 xend.XendDomainInfo 5112] DEBUG (XendDomainInfo:
>> 988) XendDomainInfo.handleShutdownWatch
>> [2008-06-18 22:15:09 xend.XendDomainInfo 5112] INFO (XendDomainInfo:
>> 947) Domain has shutdown: name=migrating-vm01 id=17 reason=suspend.
>> [2008-06-18 22:15:09 xend 5112] INFO (XendCheckpoint:99) Domain 17
>> suspended.
>> [2008-06-18 22:15:09 xend 5112] DEBUG (XendCheckpoint:108) Written
>> done
>> [2008-06-18 22:15:09 xend 5112] INFO (XendCheckpoint:351) SUSPEND
>> shinfo 00000bdc
>> [2008-06-18 22:15:09 xend 5112] INFO (XendCheckpoint:351) delta
>> 14ms, dom0 50%, target 14%, sent 0Mb/s, dirtied 229Mb/s 98 pages
>> 5: sent 98, skipped 0, delta 4ms, dom0 100%, target 0%, sent 802Mb/
>> s, dirtied 802Mb/s 98 pages
>> [2008-06-18 22:15:09 xend 5112] INFO (XendCheckpoint:351) Total
>> pages sent= 32958 (0.95x)
>> [2008-06-18 22:15:09 xend 5112] INFO (XendCheckpoint:351) (of which
>> 0 were fixups)
>> [2008-06-18 22:15:09 xend 5112] INFO (XendCheckpoint:351) All memory
>> is saved
>> [2008-06-18 22:15:09 xend 5112] INFO (XendCheckpoint:351) Save exit
>> rc=0
>> [2008-06-18 22:15:09 xend.XendDomainInfo 5112] DEBUG (XendDomainInfo:
>> 1566) XendDomainInfo.destroyDomain(17)
>>
>>
>>
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
>>
>>
>> xm dmesg from server 01
>> $ xm dmesg
>> __  __            _____  _   ___    ____ _____  _   ____  _       _
>> ____
>> \ \/ /___ _ __   |___ / / | / _ \  | ___|___ / / | |___ \/ |  ___| |
>> ___|
>> \  // _ \ \047_ \    |_ \ | || | | |_|___ \ |_ \ | |   __) | | / _
>> \ |___ \
>> /  \  __/ | | |  ___) || || |_| |__|__) |__) || |_ / __/| ||  __/ |
>> ___) |
>> /_/\_\___|_| |_| |____(_)_(_)___/  |____/____(_)_(_)_____|_(_)___|_|
>> ____/
>>
>> http://www.cl.cam.ac.uk/netos/xen
>> University of Cambridge Computer Laboratory
>>
>> Xen version 3.1.0-53.1.21.el5 (mockbuild@) (gcc version 4.1.2
>> 20070626 (Red Hat 4.1.2-14)) Tue May 20 09:27:25 EDT 2008
>> Latest ChangeSet: unavailable
>>
>> (XEN) Command line: /xen.gz-2.6.18-53.1.21.el5
>> (XEN)  0000000000000000 - 000000000009f000 (usable)
>> (XEN)  000000000009f400 - 00000000000a0000 (reserved)
>> (XEN)  00000000000f0000 - 0000000000100000 (reserved)
>> (XEN)  0000000000100000 - 000000001f6e0000 (usable)
>> (XEN)  000000001f6e0000 - 000000001f6e3000 (ACPI NVS)
>> (XEN)  000000001f6e3000 - 000000001f6f0000 (ACPI data)
>> (XEN)  000000001f6f0000 - 000000001f700000 (reserved)
>> (XEN)  00000000e0000000 - 00000000f0000000 (reserved)
>> (XEN)  00000000fec00000 - 0000000100000000 (reserved)
>> (XEN) System RAM: 502MB (514556kB)
>> (XEN) Xen heap: 10MB (10256kB)
>> (XEN) Domain heap initialised: DMA width 32 bits
>> (XEN) PAE enabled, limit: 16 GB
>> (XEN) Processor #0 15:4 APIC version 20
>> (XEN) Processor #1 15:4 APIC version 20
>> (XEN) IOAPIC[0]: apic_id 4, version 32, address 0xfec00000, GSI 0-23
>> (XEN) IOAPIC[1]: apic_id 5, version 32, address 0xfec84400, GSI 24-47
>> (XEN) Enabling APIC mode:  Flat.  Using 2 I/O APICs
>> (XEN) Using scheduler: SMP Credit Scheduler (credit)
>> (XEN) Detected 3000.252 MHz processor.
>> (XEN) CPU0: Intel(R) Pentium(R) 4 CPU 3.00GHz stepping 01
>> (XEN) Mapping cpu 0 to node 255
>> (XEN) Booting processor 1/1 eip 90000
>> (XEN) Mapping cpu 1 to node 255
>> (XEN) CPU1: Intel(R) Pentium(R) 4 CPU 3.00GHz stepping 01
>> (XEN) Total of 2 processors activated.
>> (XEN) ENABLING IO-APIC IRQs
>> (XEN)  -> Using new ACK method
>> (XEN) Platform timer is 1.193MHz PIT
>> (XEN) Brought up 2 CPUs
>> (XEN) *** LOADING DOMAIN 0 ***
>> (XEN) elf_parse_binary: phdr: paddr=0xc0400000 memsz=0x25d640
>> (XEN) elf_parse_binary: phdr: paddr=0xc065e000 memsz=0x15a000
>> (XEN) elf_parse_binary: memory: 0xc0400000 -> 0xc07b8000
>> (XEN) elf_xen_parse_note: GUEST_OS = "linux"
>> (XEN) elf_xen_parse_note: GUEST_VERSION = "2.6"
>> (XEN) elf_xen_parse_note: XEN_VERSION = "xen-3.0"
>> (XEN) elf_xen_parse_note: VIRT_BASE = 0xc0000000
>> (XEN) elf_xen_parse_note: PADDR_OFFSET = 0xc0000000
>> (XEN) elf_xen_parse_note: ENTRY = 0xc0400000
>> (XEN) elf_xen_parse_note: HYPERCALL_PAGE = 0xc0401000
>> (XEN) elf_xen_parse_note: FEATURES = "writable_page_tables|
>> writable_descriptor_tables|auto_translated_physmap|
>> pae_pgdir_above_4gb|supervisor_mode_kernel"
>> (XEN) elf_xen_parse_note: PAE_MODE = "yes"
>> (XEN) elf_xen_parse_note: LOADER = "generic"
>> (XEN) elf_xen_addr_calc_check: addresses:
>> (XEN)     virt_base        = 0xc0000000
>> (XEN)     elf_paddr_offset = 0xc0000000
>> (XEN)     virt_offset      = 0x0
>> (XEN)     virt_kstart      = 0xc0400000
>> (XEN)     virt_kend        = 0xc07b8000
>> (XEN)     virt_entry       = 0xc0400000
>> (XEN)  Xen  kernel: 32-bit, PAE, lsb
>> (XEN)  Dom0 kernel: 32-bit, PAE, lsb, paddr 0xc0400000 -> 0xc07b8000
>> (XEN) PHYSICAL MEMORY ARRANGEMENT:
>> (XEN)  Dom0 alloc.:   000000001e000000->000000001f000000 (112527
>> pages to be allocated)
>> (XEN) VIRTUAL MEMORY ARRANGEMENT:
>> (XEN)  Loaded kernel: c0400000->c07b8000
>> (XEN)  Init. ramdisk: c07b8000->c0e4f800
>> (XEN)  Phys-Mach map: c0e50000->c0ec1e3c
>> (XEN)  Start info:    c0ec2000->c0ec246c
>> (XEN)  Page tables:   c0ec3000->c0ed0000
>> (XEN)  Boot stack:    c0ed0000->c0ed1000
>> (XEN)  TOTAL:         c0000000->c1000000
>> (XEN)  ENTRY ADDRESS: c0400000
>> (XEN) Dom0 has maximum 2 VCPUs
>> (XEN) elf_load_binary: phdr 0 at 0xc0400000 -> 0xc065d640
>> (XEN) elf_load_binary: phdr 1 at 0xc065e000 -> 0xc0702b64
>> (XEN) Initrd len 0x697800, start at 0xc07b8000
>> (XEN) Scrubbing Free RAM: done.
>> (XEN) Xen trace buffers: disabled
>> (XEN) Std. Loglevel: Errors and warnings
>> (XEN) Guest Loglevel: Nothing (Rate-limited: Errors and warnings)
>> (XEN) Xen is relinquishing VGA console.
>> (XEN) *** Serial input -> DOM0 (type \047CTRL-a\047 three times to
>> switch input to Xen).
>> (XEN) mm.c:636:d0 Error getting mfn e046 (pfn 3c2a) from L1 entry
>> 800000000e046025 for dom3
>> (XEN) mm.c:636:d0 Error getting mfn fb9 (pfn 4409) from L1 entry
>> 8000000000fb9025 for dom3
>> (XEN) mm.c:636:d0 Error getting mfn 1530d (pfn 47b0) from L1 entry
>> 800000001530d025 for dom3
>> (XEN) mm.c:636:d0 Error getting mfn 15062 (pfn 3c2a) from L1 entry
>> 8000000015062025 for dom3
>> (XEN) mm.c:636:d0 Error getting mfn e124 (pfn 66f1) from L1 entry
>> 800000000e124025 for dom3
>> (XEN) mm.c:636:d0 Error getting mfn 15226 (pfn 47be) from L1 entry
>> 8000000015226025 for dom3
>> (XEN) mm.c:636:d0 Error getting mfn 152be (pfn 3c88) from L1 entry
>> 80000000152be025 for dom3
>> (XEN) mm.c:636:d0 Error getting mfn 1509d (pfn 4ca3) from L1 entry
>> 800000001509d025 for dom3
>> (XEN) mm.c:636:d0 Error getting mfn 157b7 (pfn 4b5b) from L1 entry
>> 80000000157b7025 for dom3
>> (XEN) mm.c:636:d0 Error getting mfn 15523 (pfn 4b6a) from L1 entry
>> 8000000015523025 for dom3
>> (XEN) printk: 12 messages suppressed.
>> (XEN) mm.c:636:d0 Error getting mfn 1525a (pfn 66d2) from L1 entry
>> 800000001525a025 for dom4
>> (XEN) mm.c:636:d0 Error getting mfn 1555e (pfn 7a52) from L1 entry
>> 800000001555e025 for dom4
>> (XEN) mm.c:636:d0 Error getting mfn 15bc3 (pfn 62df) from L1 entry
>> 8000000015bc3025 for dom4
>> (XEN) mm.c:636:d0 Error getting mfn 15ecc (pfn 6715) from L1 entry
>> 8000000015ecc025 for dom4
>> (XEN) mm.c:636:d0 Error getting mfn ef68 (pfn 625b) from L1 entry
>> 800000000ef68025 for dom4
>> (XEN) mm.c:636:d0 Error getting mfn 154c9 (pfn 618f) from L1 entry
>> 80000000154c9025 for dom4
>> (XEN) mm.c:636:d0 Error getting mfn 15b14 (pfn 66eb) from L1 entry
>> 8000000015b14025 for dom4
>> (XEN) mm.c:636:d0 Error getting mfn 14d52 (pfn 66fb) from L1 entry
>> 8000000014d52025 for dom4
>> (XEN) mm.c:636:d0 Error getting mfn 14c54 (pfn 61d7) from L1 entry
>> 8000000014c54025 for dom4
>> (XEN) mm.c:636:d0 Error getting mfn 14da1 (pfn 65e9) from L1 entry
>> 8000000014da1025 for dom4
>> (XEN) printk: 57 messages suppressed.
>> (XEN) mm.c:636:d0 Error getting mfn 152f8 (pfn 62af) from L1 entry
>> 80000000152f8025 for dom4
>> (XEN) printk: 7 messages suppressed.
>> (XEN) mm.c:636:d0 Error getting mfn 13989 (pfn 3261) from L1 entry
>> 8000000013989025 for dom5
>> (XEN) mm.c:636:d0 Error getting mfn 151fc (pfn 3272) from L1 entry
>> 80000000151fc025 for dom5
>> (XEN) mm.c:636:d0 Error getting mfn 15ca4 (pfn 54b3) from L1 entry
>> 8000000015ca4025 for dom5
>> (XEN) mm.c:636:d0 Error getting mfn 13e3b (pfn 6b23) from L1 entry
>> 8000000013e3b025 for dom5
>> (XEN) mm.c:636:d0 Error getting mfn 15277 (pfn 3224) from L1 entry
>> 8000000015277025 for dom5
>> (XEN) mm.c:636:d0 Error getting mfn f86a (pfn 651b) from L1 entry
>> 800000000f86a025 for dom5
>> (XEN) mm.c:636:d0 Error getting mfn cd27 (pfn 653d) from L1 entry
>> 800000000cd27025 for dom5
>> (XEN) mm.c:636:d0 Error getting mfn 26f1 (pfn 3275) from L1 entry
>> 80000000026f1025 for dom5
>> (XEN) mm.c:636:d0 Error getting mfn 15ca7 (pfn 6562) from L1 entry
>> 8000000015ca7025 for dom5
>> (XEN) mm.c:636:d0 Error getting mfn 149cc (pfn 2d67) from L1 entry
>> 80000000149cc025 for dom5
>> (XEN) printk: 15 messages suppressed.
>> (XEN) mm.c:636:d0 Error getting mfn 16172 (pfn 3a80) from L1 entry
>> 8000000016172025 for dom16
>> (XEN) mm.c:636:d0 Error getting mfn 1ab59 (pfn 3aa0) from L1 entry
>> 800000001ab59025 for dom16
>> (XEN) mm.c:636:d0 Error getting mfn 1a1d4 (pfn 3a8c) from L1 entry
>> 800000001a1d4025 for dom16
>> (XEN) mm.c:636:d0 Error getting mfn 177c4 (pfn 3a9c) from L1 entry
>> 80000000177c4025 for dom16
>> (XEN) mm.c:636:d0 Error getting mfn ed39 (pfn 3aac) from L1 entry
>> 800000000ed39025 for dom16
>> (XEN) mm.c:636:d0 Error getting mfn 142e2 (pfn 3abc) from L1 entry
>> 80000000142e2025 for dom16
>> (XEN) mm.c:636:d0 Error getting mfn 17ee6 (pfn 3a91) from L1 entry
>> 8000000017ee6025 for dom16
>> (XEN) mm.c:636:d0 Error getting mfn 129a2 (pfn 3aa1) from L1 entry
>> 80000000129a2025 for dom16
>> (XEN) mm.c:636:d0 Error getting mfn 19bbc (pfn 3ab2) from L1 entry
>> 8000000019bbc025 for dom16
>> (XEN) mm.c:636:d0 Error getting mfn 1d6c8 (pfn 3a93) from L1 entry
>> 800000001d6c8025 for dom16
>>
>>
--------------------------------------------------------------------------------------------------------------------------------
>> cpuinfo from server01
>>
>> $ cat /proc/cpuinfo
>> processor     : 0
>> vendor_id     : GenuineIntel
>> cpu family    : 15
>> model         : 4
>> model name    : Intel(R) Pentium(R) 4 CPU 3.00GHz
>> stepping      : 1
>> cpu MHz               : 3000.252
>> cache size    : 1024 KB
>> fdiv_bug      : no
>> hlt_bug               : no
>> f00f_bug      : no
>> coma_bug      : no
>> fpu           : yes
>> fpu_exception : yes
>> cpuid level   : 5
>> wp            : yes
>> flags         : fpu tsc msr pae mce cx8 apic mtrr mca cmov pat pse36
>> clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe nx constant_tsc pni
>> monitor ds_cpl cid xtpr
>> bogomips      : 7508.56
>>
>> processor     : 1
>> vendor_id     : GenuineIntel
>> cpu family    : 15
>> model         : 4
>> model name    : Intel(R) Pentium(R) 4 CPU 3.00GHz
>> stepping      : 1
>> cpu MHz               : 3000.252
>> cache size    : 1024 KB
>> fdiv_bug      : no
>> hlt_bug               : no
>> f00f_bug      : no
>> coma_bug      : no
>> fpu           : yes
>> fpu_exception : yes
>> cpuid level   : 5
>> wp            : yes
>> flags         : fpu tsc msr pae mce cx8 apic mtrr mca cmov pat pse36
>> clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe nx constant_tsc up
>> pni monitor ds_cpl cid xtpr
>> bogomips      : 7508.56
>>
>>
----------------------------------------------------------------------------------------------------------------------------------------------------
>> xend.log from server02
>> [2008-06-18 22:14:56 xend.XendDomainInfo 4241] DEBUG (XendDomainInfo:
>> 275) XendDomainInfo.restore([''domain'',
[''domid'', ''17''], [''uuid'',
>> ''daab0e68-c50d-d678-bf36-b8de50fc4065''],
[''vcpus'', ''1''],
>> [''vcpu_avail'', ''1''],
[''cpu_weight'', ''1.0''],
[''memory'', ''128''],
>> [''shadow_memory'', ''0''],
[''maxmem'', ''128''],
[''bootloader'', ''/usr/bin/
>> pygrub''], [''features''],
[''name'', ''vm01''],
[''on_poweroff'',
>> ''destroy''], [''on_reboot'',
''restart''], [''on_crash'',
''restart''],
>> [''image'', [''linux'',
[''ramdisk'',
''/var/lib/xen/boot_ramdisk.H-WMcf''],
>> [''kernel'',
''/var/lib/xen/boot_kernel.CWSvum''], [''args'',
''ro root=/
>> dev/VolGroup00/LogVol00 console=xvc0'']]],
[''device'', [''vif'',
>> [''backend'', ''0''],
[''script'', ''vif-bridge''],
[''bridge'', ''xenbr1''],
>> [''mac'', ''00:16:3e:2f:58:3e'']]],
[''device'', [''vkbd'',
[''backend'',
>> ''0'']]], [''device'',
[''vfb'', [''backend'', ''0''],
[''type'', ''vnc''],
>> [''vncunused'', ''1''],
[''xauthority'', ''/root/.Xauthority'']]],
>> [''device'', [''tap'',
[''backend'', ''0''], [''dev'',
''xvda:disk''], [''uname'',
>> ''tap:aio:/home/vm/vm01.img''],
[''mode'', ''w'']]], [''state'',
''--p---''],
>> [''shutdown_reason'', ''poweroff''],
[''cpu_time'', ''0.0''],
>> [''online_vcpus'', ''1''],
[''up_time'', ''161.610284805''],
[''start_time'',
>> ''1213845134.84''], [''store_mfn'',
''77630''], [''console_mfn'',
''77629'']])
>> [2008-06-18 22:14:56 xend.XendDomainInfo 4241] DEBUG (XendDomainInfo:
>> 306) parseConfig: config is [''domain'',
[''domid'', ''17''], [''uuid'',
>> ''daab0e68-c50d-d678-bf36-b8de50fc4065''],
[''vcpus'', ''1''],
>> [''vcpu_avail'', ''1''],
[''cpu_weight'', ''1.0''],
[''memory'', ''128''],
>> [''shadow_memory'', ''0''],
[''maxmem'', ''128''],
[''bootloader'', ''/usr/bin/
>> pygrub''], [''features''],
[''name'', ''vm01''],
[''on_poweroff'',
>> ''destroy''], [''on_reboot'',
''restart''], [''on_crash'',
''restart''],
>> [''image'', [''linux'',
[''ramdisk'',
''/var/lib/xen/boot_ramdisk.H-WMcf''],
>> [''kernel'',
''/var/lib/xen/boot_kernel.CWSvum''], [''args'',
''ro root=/
>> dev/VolGroup00/LogVol00 console=xvc0'']]],
[''device'', [''vif'',
>> [''backend'', ''0''],
[''script'', ''vif-bridge''],
[''bridge'', ''xenbr1''],
>> [''mac'', ''00:16:3e:2f:58:3e'']]],
[''device'', [''vkbd'',
[''backend'',
>> ''0'']]], [''device'',
[''vfb'', [''backend'', ''0''],
[''type'', ''vnc''],
>> [''vncunused'', ''1''],
[''xauthority'', ''/root/.Xauthority'']]],
>> [''device'', [''tap'',
[''backend'', ''0''], [''dev'',
''xvda:disk''], [''uname'',
>> ''tap:aio:/home/vm/vm01.img''],
[''mode'', ''w'']]], [''state'',
''--p---''],
>> [''shutdown_reason'', ''poweroff''],
[''cpu_time'', ''0.0''],
>> [''online_vcpus'', ''1''],
[''up_time'', ''161.610284805''],
[''start_time'',
>> ''1213845134.84''], [''store_mfn'',
''77630''], [''console_mfn'',
''77629'']]
>> [2008-06-18 22:14:56 xend.XendDomainInfo 4241] DEBUG (XendDomainInfo:
>> 411) parseConfig: result is {''shadow_memory'': 0,
''start_time'':
>> 1213845134.8399999, ''uuid'':
''daab0e68-c50d-d678-bf36-b8de50fc4065'',
>> ''on_crash'': ''restart'',
''on_reboot'': ''restart'',
''localtime'': None,
>> ''image'': [''linux'',
[''ramdisk'',
''/var/lib/xen/boot_ramdisk.H-WMcf''],
>> [''kernel'',
''/var/lib/xen/boot_kernel.CWSvum''], [''args'',
''ro root=/
>> dev/VolGroup00/LogVol00 console=xvc0'']],
''on_poweroff'': ''destroy'',
>> ''bootloader_args'': None, ''cpus'':
None, ''name'': ''vm01'',
''backend'':
>> [], ''vcpus'': 1, ''cpu_weight'': 1.0,
''features'': None, ''vcpu_avail'':
>> 1, ''memory'': 128, ''device'':
[(''vif'', [''vif'',
[''backend'', ''0''],
>> [''script'', ''vif-bridge''],
[''bridge'', ''xenbr1''],
[''mac'', ''00:16:3e:2f:
>> 58:3e'']]), (''vkbd'',
[''vkbd'', [''backend'',
''0'']]), (''vfb'', [''vfb'',
>> [''backend'', ''0''],
[''type'', ''vnc''],
[''vncunused'', ''1''],
>> [''xauthority'',
''/root/.Xauthority'']]), (''tap'',
[''tap'', [''backend'',
>> ''0''], [''dev'',
''xvda:disk''], [''uname'',
''tap:aio:/home/vm/vm01.img''],
>> [''mode'', ''w'']])],
''bootloader'': ''/usr/bin/pygrub'',
''cpu'': None,
>> ''maxmem'': 128}
>> [2008-06-18 22:14:56 xend.XendDomainInfo 4241] DEBUG (XendDomainInfo:
>> 1349) XendDomainInfo.construct: None
>> [2008-06-18 22:14:56 xend 4241] DEBUG (balloon:127) Balloon: 63964
>> KiB free; need 2048; done.
>> [2008-06-18 22:14:56 xend.XendDomainInfo 4241] DEBUG (XendDomainInfo:
>> 756) Storing VM details: {''shadow_memory'':
''0'', ''uuid'': ''daab0e68-
>> c50d-d678-bf36-b8de50fc4065'', ''on_reboot'':
''restart'', ''start_time'':
>> ''1213845134.84'', ''on_poweroff'':
''destroy'', ''name'': ''vm01'',
''xend/
>> restart_count'': ''0'',
''vcpus'': ''1'',
''vcpu_avail'': ''1'',
''memory'':
>> ''128'', ''on_crash'':
''restart'', ''image'': "(linux (ramdisk
/var/lib/xen/
>> boot_ramdisk.H-WMcf) (kernel /var/lib/xen/boot_kernel.CWSvum) (args
>> ''ro root=/dev/VolGroup00/LogVol00
console=xvc0''))", ''maxmem'':
''128''}
>> [2008-06-18 22:14:56 xend 4241] DEBUG (DevController:110)
>> DevController: writing {''state'':
''1'', ''backend-id'': ''0'',
''backend'':
>> ''/local/domain/0/backend/vkbd/1/0''} to
/local/domain/1/device/vkbd/0.
>> [2008-06-18 22:14:56 xend 4241] DEBUG (DevController:112)
>> DevController: writing {''frontend-id'':
''1'', ''domain'': ''vm01'',
>> ''frontend'':
''/local/domain/1/device/vkbd/0'', ''state'':
''1'', ''online'':
>> ''1''} to /local/domain/0/backend/vkbd/1/0.
>> [2008-06-18 22:14:56 xend 4241] DEBUG (DevController:110)
>> DevController: writing {''backend-id'':
''0'', ''mac'': ''00:16:3e:2f:
>> 58:3e'', ''handle'': ''0'',
''state'': ''1'', ''backend'':
''/local/domain/0/
>> backend/vif/1/0''} to /local/domain/1/device/vif/0.
>> [2008-06-18 22:14:56 xend 4241] DEBUG (DevController:112)
>> DevController: writing {''bridge'':
''xenbr1'', ''domain'':
''vm01'',
>> ''handle'': ''0'',
''script'': ''/etc/xen/scripts/vif-bridge'',
''state'':
>> ''1'', ''frontend'':
''/local/domain/1/device/vif/0'', ''mac'':
''00:16:3e:2f:
>> 58:3e'', ''online'': ''1'',
''frontend-id'': ''1''} to /local/domain/0/
>> backend/vif/1/0.
>> [2008-06-18 22:14:56 xend 4241] DEBUG (DevController:110)
>> DevController: writing {''state'':
''1'', ''backend-id'': ''0'',
''backend'':
>> ''/local/domain/0/backend/vfb/1/0''} to
/local/domain/1/device/vfb/0.
>> [2008-06-18 22:14:56 xend 4241] DEBUG (DevController:112)
>> DevController: writing {''vncunused'':
''1'', ''domain'': ''vm01'',
>> ''frontend'':
''/local/domain/1/device/vfb/0'',
''xauthority'': ''/
>> root/.Xauthority'', ''state'':
''1'', ''online'': ''1'',
''frontend-id'': ''1'',
>> ''type'': ''vnc''} to
/local/domain/0/backend/vfb/1/0.
>> [2008-06-18 22:14:56 xend 4241] DEBUG (vfbif:64) No VNC passwd
>> configured for vfb access
>> [2008-06-18 22:14:56 xend 4241] DEBUG (blkif:24) exception looking
>> up device number for xvda: [Errno 2] No such file or directory:
''/
>> dev/xvda''
>> [2008-06-18 22:14:56 xend 4241] DEBUG (DevController:110)
>> DevController: writing {''backend-id'':
''0'', ''virtual-device'':
>> ''51712'', ''device-type'':
''disk'', ''state'': ''1'',
''backend'': ''/local/
>> domain/0/backend/tap/1/51712''} to
/local/domain/1/device/vbd/51712.
>> [2008-06-18 22:14:56 xend 4241] DEBUG (DevController:112)
>> DevController: writing {''domain'':
''vm01'', ''frontend'': ''/local/domain/
>> 1/device/vbd/51712'', ''format'':
''raw'', ''dev'': ''xvda'',
''state'': ''1'',
>> ''params'': ''aio:/home/vm/vm01.img'',
''mode'': ''w'', ''online'':
''1'',
>> ''frontend-id'': ''1'',
''type'': ''tap''} to
/local/domain/0/backend/tap/
>> 1/51712.
>> [2008-06-18 22:14:56 xend.XendDomainInfo 4241] DEBUG (XendDomainInfo:
>> 791) Storing domain details: {''console/port'':
''2'', ''name'': ''vm01'',
>> ''console/limit'': ''1048576'',
''vm'': ''/vm/daab0e68-c50d-d678-bf36-
>> b8de50fc4065'', ''domid'':
''1'', ''cpu/0/availability'':
''online'', ''memory/
>> target'': ''131072'',
''store/port'': ''1''}
>> [2008-06-18 22:14:56 xend 4241] DEBUG (XendCheckpoint:198)
>> restore:shadow=0x0, _static_max=0x80, _static_min=0x80,
>> [2008-06-18 22:14:56 xend 4241] DEBUG (balloon:133) Balloon: 63964
>> KiB free; 0 to scrub; need 131072; retries: 20.
>> [2008-06-18 22:14:56 xend 4241] DEBUG (balloon:148) Balloon: setting
>> dom0 target to 875 MiB.
>> [2008-06-18 22:14:56 xend.XendDomainInfo 4241] DEBUG (XendDomainInfo:
>> 1078) Setting memory target of domain Domain-0 (0) to 875 MiB.
>> [2008-06-18 22:14:57 xend 4241] DEBUG (balloon:127) Balloon: 131548
>> KiB free; need 131072; done.
>> [2008-06-18 22:14:57 xend 4241] DEBUG (XendCheckpoint:215)
>> [xc_restore]: /usr/lib/xen/bin/xc_restore 15 1 1 2 0 0 0
>> [2008-06-18 22:14:57 xend 4241] INFO (XendCheckpoint:351)
>> xc_domain_restore start: p2m_size = 8800
>> [2008-06-18 22:14:57 xend 4241] INFO (XendCheckpoint:351) Reloading
>> memory pages:   0%
>> [2008-06-18 22:15:09 xend 4241] INFO (XendCheckpoint:351) Received
>> all pages (0 races)
>> [2008-06-18 22:15:09 xend 4241] INFO (XendCheckpoint:351) ERROR
>> Internal error: Failed to pin batch of 31 page tables
>> [2008-06-18 22:15:09 xend 4241] INFO (XendCheckpoint:351) Restore
>> exit with rc=1
>> [2008-06-18 22:15:09 xend.XendDomainInfo 4241] DEBUG (XendDomainInfo:
>> 1557) XendDomainInfo.destroy: domid=1
>> [2008-06-18 22:15:09 xend.XendDomainInfo 4241] DEBUG (XendDomainInfo:
>> 1566) XendDomainInfo.destroyDomain(1)
>> [2008-06-18 22:15:09 xend.XendDomainInfo 4241] ERROR (XendDomainInfo:
>> 1572) XendDomainInfo.destroy: xc.domain_destroy failed.
>> Traceback (most recent call last):
>> File
"/usr/lib/python2.4/site-packages/xen/xend/XendDomainInfo.py",
>> line 1570, in destroyDomain
>>   xc.domain_destroy(self.domid)
>> Error: (3, ''No such process'')
>> [2008-06-18 22:15:09 xend 4241] ERROR (XendDomain:268) Restore failed
>> Traceback (most recent call last):
>> File
"/usr/lib/python2.4/site-packages/xen/xend/XendDomain.py",
>> line 263, in domain_restore_fd
>>   return XendCheckpoint.restore(self, fd)
>> File
"/usr/lib/python2.4/site-packages/xen/xend/XendCheckpoint.py",
>> line 219, in restore
>>   forkHelper(cmd, fd, handler.handler, True)
>> File
"/usr/lib/python2.4/site-packages/xen/xend/XendCheckpoint.py",
>> line 339, in forkHelper
>>   raise XendError("%s failed" % string.join(cmd))
>> XendError: /usr/lib/xen/bin/xc_restore 15 1 1 2 0 0 0 failed
>>
>>
-------------------------------------------------------------------------------------------------------------------------------------------
>> xm dmesg from server02
>> root@cjarrett:~
>> $ xm dmesg
>> __  __            _____  _   ___    ____ _____  _   ____  _       _
>> ____
>> \ \/ /___ _ __   |___ / / | / _ \  | ___|___ / / | |___ \/ |  ___| |
>> ___|
>> \  // _ \ \047_ \    |_ \ | || | | |_|___ \ |_ \ | |   __) | | / _
>> \ |___ \
>> /  \  __/ | | |  ___) || || |_| |__|__) |__) || |_ / __/| ||  __/ |
>> ___) |
>> /_/\_\___|_| |_| |____(_)_(_)___/  |____/____(_)_(_)_____|_(_)___|_|
>> ____/
>>
>> http://www.cl.cam.ac.uk/netos/xen
>> University of Cambridge Computer Laboratory
>>
>> Xen version 3.1.0-53.1.21.el5 (mockbuild@) (gcc version 4.1.2
>> 20070626 (Red Hat 4.1.2-14)) Tue May 20 09:27:25 EDT 2008
>> Latest ChangeSet: unavailable
>>
>> (XEN) Command line: /xen.gz-2.6.18-53.1.21.el5
>> (XEN)  0000000000000000 - 00000000000a0000 (usable)
>> (XEN)  00000000000f0000 - 0000000000100000 (reserved)
>> (XEN)  0000000000100000 - 000000003ff77000 (usable)
>> (XEN)  000000003ff77000 - 000000003ff79000 (ACPI NVS)
>> (XEN)  000000003ff79000 - 0000000040000000 (reserved)
>> (XEN)  00000000fec00000 - 00000000fec10000 (reserved)
>> (XEN)  00000000fee00000 - 00000000fee10000 (reserved)
>> (XEN)  00000000ffb00000 - 0000000100000000 (reserved)
>> (XEN) System RAM: 1023MB (1047644kB)
>> (XEN) Xen heap: 10MB (10240kB)
>> (XEN) Domain heap initialised: DMA width 32 bits
>> (XEN) PAE enabled, limit: 16 GB
>> (XEN) Processor #0 15:1 APIC version 20
>> (XEN) Enabling APIC mode:  Flat.  Using 1 I/O APICs
>> (XEN) Using scheduler: SMP Credit Scheduler (credit)
>> (XEN) Detected 1694.561 MHz processor.
>> (XEN) CPU0: Intel(R) Pentium(R) 4 CPU 1.70GHz stepping 02
>> (XEN) Mapping cpu 0 to node 255
>> (XEN) Total of 1 processors activated.
>> (XEN) ExtINT not setup in hardware but reported by MP table
>> (XEN) ENABLING IO-APIC IRQs
>> (XEN)  -> Using new ACK method
>> (XEN) Platform timer is 1.193MHz PIT
>> (XEN) Brought up 1 CPUs
>> (XEN) *** LOADING DOMAIN 0 ***
>> (XEN) elf_parse_binary: phdr: paddr=0xc0400000 memsz=0x25d640
>> (XEN) elf_parse_binary: phdr: paddr=0xc065e000 memsz=0x15a000
>> (XEN) elf_parse_binary: memory: 0xc0400000 -> 0xc07b8000
>> (XEN) elf_xen_parse_note: GUEST_OS = "linux"
>> (XEN) elf_xen_parse_note: GUEST_VERSION = "2.6"
>> (XEN) elf_xen_parse_note: XEN_VERSION = "xen-3.0"
>> (XEN) elf_xen_parse_note: VIRT_BASE = 0xc0000000
>> (XEN) elf_xen_parse_note: PADDR_OFFSET = 0xc0000000
>> (XEN) elf_xen_parse_note: ENTRY = 0xc0400000
>> (XEN) elf_xen_parse_note: HYPERCALL_PAGE = 0xc0401000
>> (XEN) elf_xen_parse_note: FEATURES = "writable_page_tables|
>> writable_descriptor_tables|auto_translated_physmap|
>> pae_pgdir_above_4gb|supervisor_mode_kernel"
>> (XEN) elf_xen_parse_note: PAE_MODE = "yes"
>> (XEN) elf_xen_parse_note: LOADER = "generic"
>> (XEN) elf_xen_addr_calc_check: addresses:
>> (XEN)     virt_base        = 0xc0000000
>> (XEN)     elf_paddr_offset = 0xc0000000
>> (XEN)     virt_offset      = 0x0
>> (XEN)     virt_kstart      = 0xc0400000
>> (XEN)     virt_kend        = 0xc07b8000
>> (XEN)     virt_entry       = 0xc0400000
>> (XEN)  Xen  kernel: 32-bit, PAE, lsb
>> (XEN)  Dom0 kernel: 32-bit, PAE, lsb, paddr 0xc0400000 -> 0xc07b8000
>> (XEN) PHYSICAL MEMORY ARRANGEMENT:
>> (XEN)  Dom0 alloc.:   000000003e000000->000000003f000000 (236736
>> pages to be allocated)
>> (XEN) VIRTUAL MEMORY ARRANGEMENT:
>> (XEN)  Loaded kernel: c0400000->c07b8000
>> (XEN)  Init. ramdisk: c07b8000->c0ab2800
>> (XEN)  Phys-Mach map: c0ab3000->c0b9e300
>> (XEN)  Start info:    c0b9f000->c0b9f46c
>> (XEN)  Page tables:   c0ba0000->c0bad000
>> (XEN)  Boot stack:    c0bad000->c0bae000
>> (XEN)  TOTAL:         c0000000->c1000000
>> (XEN)  ENTRY ADDRESS: c0400000
>> (XEN) Dom0 has maximum 1 VCPUs
>> (XEN) elf_load_binary: phdr 0 at 0xc0400000 -> 0xc065d640
>> (XEN) elf_load_binary: phdr 1 at 0xc065e000 -> 0xc0702b64
>> (XEN) Initrd len 0x2fa800, start at 0xc07b8000
>> (XEN) Scrubbing Free RAM: done.
>> (XEN) Xen trace buffers: disabled
>> (XEN) Std. Loglevel: Errors and warnings
>> (XEN) Guest Loglevel: Nothing (Rate-limited: Errors and warnings)
>> (XEN) Xen is relinquishing VGA console.
>> (XEN) *** Serial input -> DOM0 (type \047CTRL-a\047 three times to
>> switch input to Xen).
>> (XEN) mm.c:597:d0 Bad L1 flags 80000000
>> (XEN) mm.c:895:d0 Failure in alloc_l1_table: entry 287
>> (XEN) mm.c:1773:d0 Error while validating mfn f0b0 (pfn 47c5) for
>> type 20000000: caf=80000002 taf=20000001
>> (XEN) mm.c:644:d0 Attempt to create linear p.t. with write perms
>> (XEN) mm.c:1069:d0 Failure in alloc_l2_table: entry 0
>> (XEN) mm.c:1773:d0 Error while validating mfn 1505 (pfn a5) for type
>> 40000000: caf=80000002 taf=40000001
>> (XEN) mm.c:1143:d0 Failure in alloc_l3_table: entry 0
>> (XEN) mm.c:1773:d0 Error while validating mfn 1534 (pfn 97) for type
>> 60000000: caf=80000002 taf=60000001
>> (XEN) mm.c:2042:d0 Error while pinning mfn 1534
>>
>>
----------------------------------------------------------------------------------------------------
>> cpuinfo from server02
>> processor     : 0
>> vendor_id     : GenuineIntel
>> cpu family    : 15
>> model         : 1
>> model name    : Intel(R) Pentium(R) 4 CPU 1.70GHz
>> stepping      : 2
>> cpu MHz               : 1694.503
>> cache size    : 256 KB
>> fdiv_bug      : no
>> hlt_bug               : no
>> f00f_bug      : no
>> coma_bug      : no
>> fpu           : yes
>> fpu_exception : yes
>> cpuid level   : 2
>> wp            : yes
>> flags         : fpu tsc msr pae mce cx8 apic mtrr mca cmov pat pse36
>> clflush dts acpi mmx fxsr sse sse2 ss ht tm up
>> bogomips      : 4242.78
>>
>>
>>
>>
>>
>>
>>
>>
>> _______________________________________________
>> Xen-users mailing list
>> Xen-users@lists.xensource.com
>> http://lists.xensource.com/xen-users
>
>
> _______________________________________________
> Xen-users mailing list
> Xen-users@lists.xensource.com
> http://lists.xensource.com/xen-users


_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

Cody Jarrett

2008-Jun-23 12:55 UTC

head link

Re: [Xen-users] Xen Migration Failure

Sure, here is the info:

Server01:
root@localhost:~
$ xm info
host                   : localhost
release                : 2.6.18-53.1.21.el5xen
version                : #1 SMP Tue May 20 10:31:46 EDT 2008
machine                : i686
nr_cpus                : 2
nr_nodes               : 1
sockets_per_node       : 1
cores_per_socket       : 1
threads_per_core       : 2
cpu_mhz                : 3000
hw_caps                : bfebfbff:00100000:00000000:00000180:0000441d
total_memory           : 502
free_memory            : 2
xen_major              : 3
xen_minor              : 1
xen_extra              : .0-53.1.21.el5
xen_caps               : xen-3.0-x86_32p
xen_pagesize           : 4096
platform_params        : virt_start=0xf5800000
xen_changeset          : unavailable
cc_compiler            : gcc version 4.1.2 20070626 (Red Hat 4.1.2-14)
cc_compile_by          : mockbuild
cc_compile_domain      :
cc_compile_date        : Tue May 20 09:27:25 EDT 2008
xend_config_format     : 2


Server02:
$ xm info
host                   : server02
release                : 2.6.18-53.1.21.el5xen
version                : #1 SMP Tue May 20 10:31:46 EDT 2008
machine                : i686
nr_cpus                : 1
nr_nodes               : 1
sockets_per_node       : 1
cores_per_socket       : 1
threads_per_core       : 1
cpu_mhz                : 1694
hw_caps                : 3febfbff:00000000:00000000:00000080
total_memory           : 1023
free_memory            : 128
xen_major              : 3
xen_minor              : 1
xen_extra              : .0-53.1.21.el5
xen_caps               : xen-3.0-x86_32p
xen_pagesize           : 4096
platform_params        : virt_start=0xf5800000
xen_changeset          : unavailable
cc_compiler            : gcc version 4.1.2 20070626 (Red Hat 4.1.2-14)
cc_compile_by          : mockbuild
cc_compile_domain      :
cc_compile_date        : Tue May 20 09:27:25 EDT 2008
xend_config_format     : 2



On Jun 20, 2008, at 5:45 PM, Jeff Snider wrote:
> Could you run "xm info" on both and post the output?  I suspect
it''s
> the difference in the hardware capabilities between the boxes.
>
> -Jeff
>
>
> On Jun 19, 2008, at 10:17 PM, Cody Jarrett wrote:
>
>> Anyone have any ideas of what I might be doing wrong? Also, here is  
>> my
>> vm configuration file:
>>
>> $ cat /etc/xen/vm01
>> name = "vm01"
>> uuid = "daab0e68-c50d-d678-bf36-b8de50fc4065"
>> maxmem = 128
>> memory = 128
>> vcpus = 1
>> bootloader = "/usr/bin/pygrub"
>> on_poweroff = "destroy"
>> on_reboot = "restart"
>> on_crash = "restart"
>> vfb = [  ]
>> disk = [ "tap:aio:/home/vm/vm01.img,xvda,w" ]
>> vif = [ "mac=00:16:3e:2f:58:3e,bridge=xenbr1" ]
>> vnc=1
>>
>>
>> On Jun 18, 2008, at 10:22 PM, Cody Jarrett wrote:
>>
>>> I''m having problems getting the migration from one machine
to
>>> another. When I start the migration, it run for probably 15 seconds
>>> and ends, and the virtual machines dies. Here''s my setup,
2 xen host
>>> running centos 5.1, xen-3.0.3-41.el5_1.6, and kernel
>>> 2.6.18-53.1.21.el5xen. Server01 has a VM called vm01 and
I''m trying
>>> to migrate that over to server02. Server02 has an NFS mount to the
>>> directory on server01 that holds the virtual machine disk. Any
>>> ideas, is it my hardware?
>>>
>>> xend.log from server01
>>> [2008-06-18 22:14:56 xend 5112] DEBUG (balloon:127) Balloon: 3132
>>> KiB free; need 2048; done.
>>> [2008-06-18 22:14:56 xend 5112] DEBUG (XendCheckpoint:89)
>>> [xc_save]: /usr/lib/xen/bin/xc_save 20 17 0 0 1
>>> [2008-06-18 22:14:56 xend 5112] INFO (XendCheckpoint:351) Had 0
>>> unexplained entries in p2m table
>>> 1: sent 32438, skipped 288, delta 12485ms, dom0 16%, target 0%,
sent
>>> 85Mb/s, dirtied 0Mb/s 355 pages
>>> 2: sent 355, skipped 0, delta 97ms, dom0 21%, target 0%, sent
119Mb/
>>> s, dirtied 22Mb/s 67 pages
>>> 3: sent 67, skipped 0, delta 3ms, dom0 100%, target 0%, sent 731Mb/
>>> s, dirtied 0Mb/s 0 pages
>>> 4: sent 0, skipped 0, Start last iterationheckpoint:351) Saving
>>> memory pages: iter 4   0%
>>> [2008-06-18 22:15:09 xend 5112] DEBUG (XendCheckpoint:322) suspend
>>> [2008-06-18 22:15:09 xend 5112] DEBUG (XendCheckpoint:92) In
>>> saveInputHandler suspend
>>> [2008-06-18 22:15:09 xend 5112] DEBUG (XendCheckpoint:94)
Suspending
>>> 17 ...
>>> [2008-06-18 22:15:09 xend.XendDomainInfo 5112] DEBUG  
>>> (XendDomainInfo:
>>> 988) XendDomainInfo.handleShutdownWatch
>>> [2008-06-18 22:15:09 xend.XendDomainInfo 5112] DEBUG  
>>> (XendDomainInfo:
>>> 988) XendDomainInfo.handleShutdownWatch
>>> [2008-06-18 22:15:09 xend.XendDomainInfo 5112] INFO
(XendDomainInfo:
>>> 947) Domain has shutdown: name=migrating-vm01 id=17 reason=suspend.
>>> [2008-06-18 22:15:09 xend 5112] INFO (XendCheckpoint:99) Domain 17
>>> suspended.
>>> [2008-06-18 22:15:09 xend 5112] DEBUG (XendCheckpoint:108) Written
>>> done
>>> [2008-06-18 22:15:09 xend 5112] INFO (XendCheckpoint:351) SUSPEND
>>> shinfo 00000bdc
>>> [2008-06-18 22:15:09 xend 5112] INFO (XendCheckpoint:351) delta
>>> 14ms, dom0 50%, target 14%, sent 0Mb/s, dirtied 229Mb/s 98 pages
>>> 5: sent 98, skipped 0, delta 4ms, dom0 100%, target 0%, sent 802Mb/
>>> s, dirtied 802Mb/s 98 pages
>>> [2008-06-18 22:15:09 xend 5112] INFO (XendCheckpoint:351) Total
>>> pages sent= 32958 (0.95x)
>>> [2008-06-18 22:15:09 xend 5112] INFO (XendCheckpoint:351) (of which
>>> 0 were fixups)
>>> [2008-06-18 22:15:09 xend 5112] INFO (XendCheckpoint:351) All
memory
>>> is saved
>>> [2008-06-18 22:15:09 xend 5112] INFO (XendCheckpoint:351) Save exit
>>> rc=0
>>> [2008-06-18 22:15:09 xend.XendDomainInfo 5112] DEBUG  
>>> (XendDomainInfo:
>>> 1566) XendDomainInfo.destroyDomain(17)
>>>
>>>
>>>
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
>>>
>>>
>>> xm dmesg from server 01
>>> $ xm dmesg
>>> __  __            _____  _   ___    ____ _____  _   ____  _       _
>>> ____
>>> \ \/ /___ _ __   |___ / / | / _ \  | ___|___ / / | |___ \/ |  ___|
|
>>> ___|
>>> \  // _ \ \047_ \    |_ \ | || | | |_|___ \ |_ \ | |   __) | | / _
>>> \ |___ \
>>> /  \  __/ | | |  ___) || || |_| |__|__) |__) || |_ / __/| ||  __/ |
>>> ___) |
>>> /_/\_\___|_| |_| |____(_)_(_)___/ 
|____/____(_)_(_)_____|_(_)___|_|
>>> ____/
>>>
>>> http://www.cl.cam.ac.uk/netos/xen
>>> University of Cambridge Computer Laboratory
>>>
>>> Xen version 3.1.0-53.1.21.el5 (mockbuild@) (gcc version 4.1.2
>>> 20070626 (Red Hat 4.1.2-14)) Tue May 20 09:27:25 EDT 2008
>>> Latest ChangeSet: unavailable
>>>
>>> (XEN) Command line: /xen.gz-2.6.18-53.1.21.el5
>>> (XEN)  0000000000000000 - 000000000009f000 (usable)
>>> (XEN)  000000000009f400 - 00000000000a0000 (reserved)
>>> (XEN)  00000000000f0000 - 0000000000100000 (reserved)
>>> (XEN)  0000000000100000 - 000000001f6e0000 (usable)
>>> (XEN)  000000001f6e0000 - 000000001f6e3000 (ACPI NVS)
>>> (XEN)  000000001f6e3000 - 000000001f6f0000 (ACPI data)
>>> (XEN)  000000001f6f0000 - 000000001f700000 (reserved)
>>> (XEN)  00000000e0000000 - 00000000f0000000 (reserved)
>>> (XEN)  00000000fec00000 - 0000000100000000 (reserved)
>>> (XEN) System RAM: 502MB (514556kB)
>>> (XEN) Xen heap: 10MB (10256kB)
>>> (XEN) Domain heap initialised: DMA width 32 bits
>>> (XEN) PAE enabled, limit: 16 GB
>>> (XEN) Processor #0 15:4 APIC version 20
>>> (XEN) Processor #1 15:4 APIC version 20
>>> (XEN) IOAPIC[0]: apic_id 4, version 32, address 0xfec00000, GSI
0-23
>>> (XEN) IOAPIC[1]: apic_id 5, version 32, address 0xfec84400, GSI  
>>> 24-47
>>> (XEN) Enabling APIC mode:  Flat.  Using 2 I/O APICs
>>> (XEN) Using scheduler: SMP Credit Scheduler (credit)
>>> (XEN) Detected 3000.252 MHz processor.
>>> (XEN) CPU0: Intel(R) Pentium(R) 4 CPU 3.00GHz stepping 01
>>> (XEN) Mapping cpu 0 to node 255
>>> (XEN) Booting processor 1/1 eip 90000
>>> (XEN) Mapping cpu 1 to node 255
>>> (XEN) CPU1: Intel(R) Pentium(R) 4 CPU 3.00GHz stepping 01
>>> (XEN) Total of 2 processors activated.
>>> (XEN) ENABLING IO-APIC IRQs
>>> (XEN)  -> Using new ACK method
>>> (XEN) Platform timer is 1.193MHz PIT
>>> (XEN) Brought up 2 CPUs
>>> (XEN) *** LOADING DOMAIN 0 ***
>>> (XEN) elf_parse_binary: phdr: paddr=0xc0400000 memsz=0x25d640
>>> (XEN) elf_parse_binary: phdr: paddr=0xc065e000 memsz=0x15a000
>>> (XEN) elf_parse_binary: memory: 0xc0400000 -> 0xc07b8000
>>> (XEN) elf_xen_parse_note: GUEST_OS = "linux"
>>> (XEN) elf_xen_parse_note: GUEST_VERSION = "2.6"
>>> (XEN) elf_xen_parse_note: XEN_VERSION = "xen-3.0"
>>> (XEN) elf_xen_parse_note: VIRT_BASE = 0xc0000000
>>> (XEN) elf_xen_parse_note: PADDR_OFFSET = 0xc0000000
>>> (XEN) elf_xen_parse_note: ENTRY = 0xc0400000
>>> (XEN) elf_xen_parse_note: HYPERCALL_PAGE = 0xc0401000
>>> (XEN) elf_xen_parse_note: FEATURES = "writable_page_tables|
>>> writable_descriptor_tables|auto_translated_physmap|
>>> pae_pgdir_above_4gb|supervisor_mode_kernel"
>>> (XEN) elf_xen_parse_note: PAE_MODE = "yes"
>>> (XEN) elf_xen_parse_note: LOADER = "generic"
>>> (XEN) elf_xen_addr_calc_check: addresses:
>>> (XEN)     virt_base        = 0xc0000000
>>> (XEN)     elf_paddr_offset = 0xc0000000
>>> (XEN)     virt_offset      = 0x0
>>> (XEN)     virt_kstart      = 0xc0400000
>>> (XEN)     virt_kend        = 0xc07b8000
>>> (XEN)     virt_entry       = 0xc0400000
>>> (XEN)  Xen  kernel: 32-bit, PAE, lsb
>>> (XEN)  Dom0 kernel: 32-bit, PAE, lsb, paddr 0xc0400000 ->
0xc07b8000
>>> (XEN) PHYSICAL MEMORY ARRANGEMENT:
>>> (XEN)  Dom0 alloc.:   000000001e000000->000000001f000000 (112527
>>> pages to be allocated)
>>> (XEN) VIRTUAL MEMORY ARRANGEMENT:
>>> (XEN)  Loaded kernel: c0400000->c07b8000
>>> (XEN)  Init. ramdisk: c07b8000->c0e4f800
>>> (XEN)  Phys-Mach map: c0e50000->c0ec1e3c
>>> (XEN)  Start info:    c0ec2000->c0ec246c
>>> (XEN)  Page tables:   c0ec3000->c0ed0000
>>> (XEN)  Boot stack:    c0ed0000->c0ed1000
>>> (XEN)  TOTAL:         c0000000->c1000000
>>> (XEN)  ENTRY ADDRESS: c0400000
>>> (XEN) Dom0 has maximum 2 VCPUs
>>> (XEN) elf_load_binary: phdr 0 at 0xc0400000 -> 0xc065d640
>>> (XEN) elf_load_binary: phdr 1 at 0xc065e000 -> 0xc0702b64
>>> (XEN) Initrd len 0x697800, start at 0xc07b8000
>>> (XEN) Scrubbing Free RAM: done.
>>> (XEN) Xen trace buffers: disabled
>>> (XEN) Std. Loglevel: Errors and warnings
>>> (XEN) Guest Loglevel: Nothing (Rate-limited: Errors and warnings)
>>> (XEN) Xen is relinquishing VGA console.
>>> (XEN) *** Serial input -> DOM0 (type \047CTRL-a\047 three times
to
>>> switch input to Xen).
>>> (XEN) mm.c:636:d0 Error getting mfn e046 (pfn 3c2a) from L1 entry
>>> 800000000e046025 for dom3
>>> (XEN) mm.c:636:d0 Error getting mfn fb9 (pfn 4409) from L1 entry
>>> 8000000000fb9025 for dom3
>>> (XEN) mm.c:636:d0 Error getting mfn 1530d (pfn 47b0) from L1 entry
>>> 800000001530d025 for dom3
>>> (XEN) mm.c:636:d0 Error getting mfn 15062 (pfn 3c2a) from L1 entry
>>> 8000000015062025 for dom3
>>> (XEN) mm.c:636:d0 Error getting mfn e124 (pfn 66f1) from L1 entry
>>> 800000000e124025 for dom3
>>> (XEN) mm.c:636:d0 Error getting mfn 15226 (pfn 47be) from L1 entry
>>> 8000000015226025 for dom3
>>> (XEN) mm.c:636:d0 Error getting mfn 152be (pfn 3c88) from L1 entry
>>> 80000000152be025 for dom3
>>> (XEN) mm.c:636:d0 Error getting mfn 1509d (pfn 4ca3) from L1 entry
>>> 800000001509d025 for dom3
>>> (XEN) mm.c:636:d0 Error getting mfn 157b7 (pfn 4b5b) from L1 entry
>>> 80000000157b7025 for dom3
>>> (XEN) mm.c:636:d0 Error getting mfn 15523 (pfn 4b6a) from L1 entry
>>> 8000000015523025 for dom3
>>> (XEN) printk: 12 messages suppressed.
>>> (XEN) mm.c:636:d0 Error getting mfn 1525a (pfn 66d2) from L1 entry
>>> 800000001525a025 for dom4
>>> (XEN) mm.c:636:d0 Error getting mfn 1555e (pfn 7a52) from L1 entry
>>> 800000001555e025 for dom4
>>> (XEN) mm.c:636:d0 Error getting mfn 15bc3 (pfn 62df) from L1 entry
>>> 8000000015bc3025 for dom4
>>> (XEN) mm.c:636:d0 Error getting mfn 15ecc (pfn 6715) from L1 entry
>>> 8000000015ecc025 for dom4
>>> (XEN) mm.c:636:d0 Error getting mfn ef68 (pfn 625b) from L1 entry
>>> 800000000ef68025 for dom4
>>> (XEN) mm.c:636:d0 Error getting mfn 154c9 (pfn 618f) from L1 entry
>>> 80000000154c9025 for dom4
>>> (XEN) mm.c:636:d0 Error getting mfn 15b14 (pfn 66eb) from L1 entry
>>> 8000000015b14025 for dom4
>>> (XEN) mm.c:636:d0 Error getting mfn 14d52 (pfn 66fb) from L1 entry
>>> 8000000014d52025 for dom4
>>> (XEN) mm.c:636:d0 Error getting mfn 14c54 (pfn 61d7) from L1 entry
>>> 8000000014c54025 for dom4
>>> (XEN) mm.c:636:d0 Error getting mfn 14da1 (pfn 65e9) from L1 entry
>>> 8000000014da1025 for dom4
>>> (XEN) printk: 57 messages suppressed.
>>> (XEN) mm.c:636:d0 Error getting mfn 152f8 (pfn 62af) from L1 entry
>>> 80000000152f8025 for dom4
>>> (XEN) printk: 7 messages suppressed.
>>> (XEN) mm.c:636:d0 Error getting mfn 13989 (pfn 3261) from L1 entry
>>> 8000000013989025 for dom5
>>> (XEN) mm.c:636:d0 Error getting mfn 151fc (pfn 3272) from L1 entry
>>> 80000000151fc025 for dom5
>>> (XEN) mm.c:636:d0 Error getting mfn 15ca4 (pfn 54b3) from L1 entry
>>> 8000000015ca4025 for dom5
>>> (XEN) mm.c:636:d0 Error getting mfn 13e3b (pfn 6b23) from L1 entry
>>> 8000000013e3b025 for dom5
>>> (XEN) mm.c:636:d0 Error getting mfn 15277 (pfn 3224) from L1 entry
>>> 8000000015277025 for dom5
>>> (XEN) mm.c:636:d0 Error getting mfn f86a (pfn 651b) from L1 entry
>>> 800000000f86a025 for dom5
>>> (XEN) mm.c:636:d0 Error getting mfn cd27 (pfn 653d) from L1 entry
>>> 800000000cd27025 for dom5
>>> (XEN) mm.c:636:d0 Error getting mfn 26f1 (pfn 3275) from L1 entry
>>> 80000000026f1025 for dom5
>>> (XEN) mm.c:636:d0 Error getting mfn 15ca7 (pfn 6562) from L1 entry
>>> 8000000015ca7025 for dom5
>>> (XEN) mm.c:636:d0 Error getting mfn 149cc (pfn 2d67) from L1 entry
>>> 80000000149cc025 for dom5
>>> (XEN) printk: 15 messages suppressed.
>>> (XEN) mm.c:636:d0 Error getting mfn 16172 (pfn 3a80) from L1 entry
>>> 8000000016172025 for dom16
>>> (XEN) mm.c:636:d0 Error getting mfn 1ab59 (pfn 3aa0) from L1 entry
>>> 800000001ab59025 for dom16
>>> (XEN) mm.c:636:d0 Error getting mfn 1a1d4 (pfn 3a8c) from L1 entry
>>> 800000001a1d4025 for dom16
>>> (XEN) mm.c:636:d0 Error getting mfn 177c4 (pfn 3a9c) from L1 entry
>>> 80000000177c4025 for dom16
>>> (XEN) mm.c:636:d0 Error getting mfn ed39 (pfn 3aac) from L1 entry
>>> 800000000ed39025 for dom16
>>> (XEN) mm.c:636:d0 Error getting mfn 142e2 (pfn 3abc) from L1 entry
>>> 80000000142e2025 for dom16
>>> (XEN) mm.c:636:d0 Error getting mfn 17ee6 (pfn 3a91) from L1 entry
>>> 8000000017ee6025 for dom16
>>> (XEN) mm.c:636:d0 Error getting mfn 129a2 (pfn 3aa1) from L1 entry
>>> 80000000129a2025 for dom16
>>> (XEN) mm.c:636:d0 Error getting mfn 19bbc (pfn 3ab2) from L1 entry
>>> 8000000019bbc025 for dom16
>>> (XEN) mm.c:636:d0 Error getting mfn 1d6c8 (pfn 3a93) from L1 entry
>>> 800000001d6c8025 for dom16
>>>
>>>
--------------------------------------------------------------------------------------------------------------------------------
>>> cpuinfo from server01
>>>
>>> $ cat /proc/cpuinfo
>>> processor     : 0
>>> vendor_id     : GenuineIntel
>>> cpu family    : 15
>>> model         : 4
>>> model name    : Intel(R) Pentium(R) 4 CPU 3.00GHz
>>> stepping      : 1
>>> cpu MHz               : 3000.252
>>> cache size    : 1024 KB
>>> fdiv_bug      : no
>>> hlt_bug               : no
>>> f00f_bug      : no
>>> coma_bug      : no
>>> fpu           : yes
>>> fpu_exception : yes
>>> cpuid level   : 5
>>> wp            : yes
>>> flags         : fpu tsc msr pae mce cx8 apic mtrr mca cmov pat
pse36
>>> clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe nx constant_tsc pni
>>> monitor ds_cpl cid xtpr
>>> bogomips      : 7508.56
>>>
>>> processor     : 1
>>> vendor_id     : GenuineIntel
>>> cpu family    : 15
>>> model         : 4
>>> model name    : Intel(R) Pentium(R) 4 CPU 3.00GHz
>>> stepping      : 1
>>> cpu MHz               : 3000.252
>>> cache size    : 1024 KB
>>> fdiv_bug      : no
>>> hlt_bug               : no
>>> f00f_bug      : no
>>> coma_bug      : no
>>> fpu           : yes
>>> fpu_exception : yes
>>> cpuid level   : 5
>>> wp            : yes
>>> flags         : fpu tsc msr pae mce cx8 apic mtrr mca cmov pat
pse36
>>> clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe nx constant_tsc up
>>> pni monitor ds_cpl cid xtpr
>>> bogomips      : 7508.56
>>>
>>>
----------------------------------------------------------------------------------------------------------------------------------------------------
>>> xend.log from server02
>>> [2008-06-18 22:14:56 xend.XendDomainInfo 4241] DEBUG  
>>> (XendDomainInfo:
>>> 275) XendDomainInfo.restore([''domain'',
[''domid'', ''17''], [''uuid'',
>>> ''daab0e68-c50d-d678-bf36-b8de50fc4065''],
[''vcpus'', ''1''],
>>> [''vcpu_avail'', ''1''],
[''cpu_weight'', ''1.0''],
[''memory'', ''128''],
>>> [''shadow_memory'', ''0''],
[''maxmem'', ''128''],
[''bootloader'', ''/usr/bin/
>>> pygrub''], [''features''],
[''name'', ''vm01''],
[''on_poweroff'',
>>> ''destroy''], [''on_reboot'',
''restart''], [''on_crash'',
''restart''],
>>> [''image'', [''linux'',
[''ramdisk'',
''/var/lib/xen/boot_ramdisk.H-WMcf''],
>>> [''kernel'',
''/var/lib/xen/boot_kernel.CWSvum''], [''args'',
''ro root=/
>>> dev/VolGroup00/LogVol00 console=xvc0'']]],
[''device'', [''vif'',
>>> [''backend'', ''0''],
[''script'', ''vif-bridge''],
[''bridge'', ''xenbr1''],
>>> [''mac'', ''00:16:3e:2f:58:3e'']]],
[''device'', [''vkbd'',
[''backend'',
>>> ''0'']]], [''device'',
[''vfb'', [''backend'', ''0''],
[''type'', ''vnc''],
>>> [''vncunused'', ''1''],
[''xauthority'', ''/root/.Xauthority'']]],
>>> [''device'', [''tap'',
[''backend'', ''0''], [''dev'',
''xvda:disk''], [''uname'',
>>> ''tap:aio:/home/vm/vm01.img''],
[''mode'', ''w'']]], [''state'',
''--p---''],
>>> [''shutdown_reason'',
''poweroff''], [''cpu_time'',
''0.0''],
>>> [''online_vcpus'', ''1''],
[''up_time'', ''161.610284805''],
[''start_time'',
>>> ''1213845134.84''], [''store_mfn'',
''77630''], [''console_mfn'',
''77629'']])
>>> [2008-06-18 22:14:56 xend.XendDomainInfo 4241] DEBUG  
>>> (XendDomainInfo:
>>> 306) parseConfig: config is [''domain'',
[''domid'', ''17''], [''uuid'',
>>> ''daab0e68-c50d-d678-bf36-b8de50fc4065''],
[''vcpus'', ''1''],
>>> [''vcpu_avail'', ''1''],
[''cpu_weight'', ''1.0''],
[''memory'', ''128''],
>>> [''shadow_memory'', ''0''],
[''maxmem'', ''128''],
[''bootloader'', ''/usr/bin/
>>> pygrub''], [''features''],
[''name'', ''vm01''],
[''on_poweroff'',
>>> ''destroy''], [''on_reboot'',
''restart''], [''on_crash'',
''restart''],
>>> [''image'', [''linux'',
[''ramdisk'',
''/var/lib/xen/boot_ramdisk.H-WMcf''],
>>> [''kernel'',
''/var/lib/xen/boot_kernel.CWSvum''], [''args'',
''ro root=/
>>> dev/VolGroup00/LogVol00 console=xvc0'']]],
[''device'', [''vif'',
>>> [''backend'', ''0''],
[''script'', ''vif-bridge''],
[''bridge'', ''xenbr1''],
>>> [''mac'', ''00:16:3e:2f:58:3e'']]],
[''device'', [''vkbd'',
[''backend'',
>>> ''0'']]], [''device'',
[''vfb'', [''backend'', ''0''],
[''type'', ''vnc''],
>>> [''vncunused'', ''1''],
[''xauthority'', ''/root/.Xauthority'']]],
>>> [''device'', [''tap'',
[''backend'', ''0''], [''dev'',
''xvda:disk''], [''uname'',
>>> ''tap:aio:/home/vm/vm01.img''],
[''mode'', ''w'']]], [''state'',
''--p---''],
>>> [''shutdown_reason'',
''poweroff''], [''cpu_time'',
''0.0''],
>>> [''online_vcpus'', ''1''],
[''up_time'', ''161.610284805''],
[''start_time'',
>>> ''1213845134.84''], [''store_mfn'',
''77630''], [''console_mfn'',
''77629'']]
>>> [2008-06-18 22:14:56 xend.XendDomainInfo 4241] DEBUG  
>>> (XendDomainInfo:
>>> 411) parseConfig: result is {''shadow_memory'': 0,
''start_time'':
>>> 1213845134.8399999, ''uuid'':
''daab0e68-c50d-d678-bf36-b8de50fc4065'',
>>> ''on_crash'': ''restart'',
''on_reboot'': ''restart'',
''localtime'': None,
>>> ''image'': [''linux'',
[''ramdisk'',
''/var/lib/xen/boot_ramdisk.H-WMcf''],
>>> [''kernel'',
''/var/lib/xen/boot_kernel.CWSvum''], [''args'',
''ro root=/
>>> dev/VolGroup00/LogVol00 console=xvc0'']],
''on_poweroff'': ''destroy'',
>>> ''bootloader_args'': None,
''cpus'': None, ''name'':
''vm01'', ''backend'':
>>> [], ''vcpus'': 1, ''cpu_weight'':
1.0, ''features'': None, ''vcpu_avail'':
>>> 1, ''memory'': 128, ''device'':
[(''vif'', [''vif'',
[''backend'', ''0''],
>>> [''script'', ''vif-bridge''],
[''bridge'', ''xenbr1''],
[''mac'', ''00:16:3e:
>>> 2f:
>>> 58:3e'']]), (''vkbd'',
[''vkbd'', [''backend'',
''0'']]), (''vfb'', [''vfb'',
>>> [''backend'', ''0''],
[''type'', ''vnc''],
[''vncunused'', ''1''],
>>> [''xauthority'',
''/root/.Xauthority'']]), (''tap'',
[''tap'', [''backend'',
>>> ''0''], [''dev'',
''xvda:disk''], [''uname'',
''tap:aio:/home/vm/vm01.img''],
>>> [''mode'', ''w'']])],
''bootloader'': ''/usr/bin/pygrub'',
''cpu'': None,
>>> ''maxmem'': 128}
>>> [2008-06-18 22:14:56 xend.XendDomainInfo 4241] DEBUG  
>>> (XendDomainInfo:
>>> 1349) XendDomainInfo.construct: None
>>> [2008-06-18 22:14:56 xend 4241] DEBUG (balloon:127) Balloon: 63964
>>> KiB free; need 2048; done.
>>> [2008-06-18 22:14:56 xend.XendDomainInfo 4241] DEBUG  
>>> (XendDomainInfo:
>>> 756) Storing VM details: {''shadow_memory'':
''0'', ''uuid'': ''daab0e68-
>>> c50d-d678-bf36-b8de50fc4065'',
''on_reboot'': ''restart'',
''start_time'':
>>> ''1213845134.84'', ''on_poweroff'':
''destroy'', ''name'': ''vm01'',
''xend/
>>> restart_count'': ''0'',
''vcpus'': ''1'',
''vcpu_avail'': ''1'',
''memory'':
>>> ''128'', ''on_crash'':
''restart'', ''image'': "(linux (ramdisk
/var/lib/
>>> xen/
>>> boot_ramdisk.H-WMcf) (kernel /var/lib/xen/boot_kernel.CWSvum) (args
>>> ''ro root=/dev/VolGroup00/LogVol00
console=xvc0''))", ''maxmem'':
''128''}
>>> [2008-06-18 22:14:56 xend 4241] DEBUG (DevController:110)
>>> DevController: writing {''state'':
''1'', ''backend-id'': ''0'',
''backend'':
>>> ''/local/domain/0/backend/vkbd/1/0''} to
/local/domain/1/device/vkbd/
>>> 0.
>>> [2008-06-18 22:14:56 xend 4241] DEBUG (DevController:112)
>>> DevController: writing {''frontend-id'':
''1'', ''domain'': ''vm01'',
>>> ''frontend'':
''/local/domain/1/device/vkbd/0'', ''state'':
''1'', ''online'':
>>> ''1''} to /local/domain/0/backend/vkbd/1/0.
>>> [2008-06-18 22:14:56 xend 4241] DEBUG (DevController:110)
>>> DevController: writing {''backend-id'':
''0'', ''mac'': ''00:16:3e:2f:
>>> 58:3e'', ''handle'': ''0'',
''state'': ''1'', ''backend'':
''/local/domain/0/
>>> backend/vif/1/0''} to /local/domain/1/device/vif/0.
>>> [2008-06-18 22:14:56 xend 4241] DEBUG (DevController:112)
>>> DevController: writing {''bridge'':
''xenbr1'', ''domain'':
''vm01'',
>>> ''handle'': ''0'',
''script'': ''/etc/xen/scripts/vif-bridge'',
''state'':
>>> ''1'', ''frontend'':
''/local/domain/1/device/vif/0'', ''mac'':
''00:16:3e:
>>> 2f:
>>> 58:3e'', ''online'': ''1'',
''frontend-id'': ''1''} to /local/domain/0/
>>> backend/vif/1/0.
>>> [2008-06-18 22:14:56 xend 4241] DEBUG (DevController:110)
>>> DevController: writing {''state'':
''1'', ''backend-id'': ''0'',
''backend'':
>>> ''/local/domain/0/backend/vfb/1/0''} to
/local/domain/1/device/vfb/0.
>>> [2008-06-18 22:14:56 xend 4241] DEBUG (DevController:112)
>>> DevController: writing {''vncunused'':
''1'', ''domain'': ''vm01'',
>>> ''frontend'':
''/local/domain/1/device/vfb/0'',
''xauthority'': ''/
>>> root/.Xauthority'', ''state'':
''1'', ''online'': ''1'',
''frontend-id'': ''1'',
>>> ''type'': ''vnc''} to
/local/domain/0/backend/vfb/1/0.
>>> [2008-06-18 22:14:56 xend 4241] DEBUG (vfbif:64) No VNC passwd
>>> configured for vfb access
>>> [2008-06-18 22:14:56 xend 4241] DEBUG (blkif:24) exception looking
>>> up device number for xvda: [Errno 2] No such file or directory:
''/
>>> dev/xvda''
>>> [2008-06-18 22:14:56 xend 4241] DEBUG (DevController:110)
>>> DevController: writing {''backend-id'':
''0'', ''virtual-device'':
>>> ''51712'', ''device-type'':
''disk'', ''state'': ''1'',
''backend'': ''/local/
>>> domain/0/backend/tap/1/51712''} to
/local/domain/1/device/vbd/51712.
>>> [2008-06-18 22:14:56 xend 4241] DEBUG (DevController:112)
>>> DevController: writing {''domain'':
''vm01'', ''frontend'': ''/local/
>>> domain/
>>> 1/device/vbd/51712'', ''format'':
''raw'', ''dev'': ''xvda'',
''state'': ''1'',
>>> ''params'':
''aio:/home/vm/vm01.img'', ''mode'':
''w'', ''online'': ''1'',
>>> ''frontend-id'': ''1'',
''type'': ''tap''} to
/local/domain/0/backend/tap/
>>> 1/51712.
>>> [2008-06-18 22:14:56 xend.XendDomainInfo 4241] DEBUG  
>>> (XendDomainInfo:
>>> 791) Storing domain details: {''console/port'':
''2'', ''name'': ''vm01'',
>>> ''console/limit'': ''1048576'',
''vm'': ''/vm/daab0e68-c50d-d678-bf36-
>>> b8de50fc4065'', ''domid'':
''1'', ''cpu/0/availability'':
''online'',
>>> ''memory/
>>> target'': ''131072'',
''store/port'': ''1''}
>>> [2008-06-18 22:14:56 xend 4241] DEBUG (XendCheckpoint:198)
>>> restore:shadow=0x0, _static_max=0x80, _static_min=0x80,
>>> [2008-06-18 22:14:56 xend 4241] DEBUG (balloon:133) Balloon: 63964
>>> KiB free; 0 to scrub; need 131072; retries: 20.
>>> [2008-06-18 22:14:56 xend 4241] DEBUG (balloon:148) Balloon:
setting
>>> dom0 target to 875 MiB.
>>> [2008-06-18 22:14:56 xend.XendDomainInfo 4241] DEBUG  
>>> (XendDomainInfo:
>>> 1078) Setting memory target of domain Domain-0 (0) to 875 MiB.
>>> [2008-06-18 22:14:57 xend 4241] DEBUG (balloon:127) Balloon: 131548
>>> KiB free; need 131072; done.
>>> [2008-06-18 22:14:57 xend 4241] DEBUG (XendCheckpoint:215)
>>> [xc_restore]: /usr/lib/xen/bin/xc_restore 15 1 1 2 0 0 0
>>> [2008-06-18 22:14:57 xend 4241] INFO (XendCheckpoint:351)
>>> xc_domain_restore start: p2m_size = 8800
>>> [2008-06-18 22:14:57 xend 4241] INFO (XendCheckpoint:351) Reloading
>>> memory pages:   0%
>>> [2008-06-18 22:15:09 xend 4241] INFO (XendCheckpoint:351) Received
>>> all pages (0 races)
>>> [2008-06-18 22:15:09 xend 4241] INFO (XendCheckpoint:351) ERROR
>>> Internal error: Failed to pin batch of 31 page tables
>>> [2008-06-18 22:15:09 xend 4241] INFO (XendCheckpoint:351) Restore
>>> exit with rc=1
>>> [2008-06-18 22:15:09 xend.XendDomainInfo 4241] DEBUG  
>>> (XendDomainInfo:
>>> 1557) XendDomainInfo.destroy: domid=1
>>> [2008-06-18 22:15:09 xend.XendDomainInfo 4241] DEBUG  
>>> (XendDomainInfo:
>>> 1566) XendDomainInfo.destroyDomain(1)
>>> [2008-06-18 22:15:09 xend.XendDomainInfo 4241] ERROR  
>>> (XendDomainInfo:
>>> 1572) XendDomainInfo.destroy: xc.domain_destroy failed.
>>> Traceback (most recent call last):
>>> File
"/usr/lib/python2.4/site-packages/xen/xend/XendDomainInfo.py",
>>> line 1570, in destroyDomain
>>>  xc.domain_destroy(self.domid)
>>> Error: (3, ''No such process'')
>>> [2008-06-18 22:15:09 xend 4241] ERROR (XendDomain:268) Restore  
>>> failed
>>> Traceback (most recent call last):
>>> File
"/usr/lib/python2.4/site-packages/xen/xend/XendDomain.py",
>>> line 263, in domain_restore_fd
>>>  return XendCheckpoint.restore(self, fd)
>>> File
"/usr/lib/python2.4/site-packages/xen/xend/XendCheckpoint.py",
>>> line 219, in restore
>>>  forkHelper(cmd, fd, handler.handler, True)
>>> File
"/usr/lib/python2.4/site-packages/xen/xend/XendCheckpoint.py",
>>> line 339, in forkHelper
>>>  raise XendError("%s failed" % string.join(cmd))
>>> XendError: /usr/lib/xen/bin/xc_restore 15 1 1 2 0 0 0 failed
>>>
>>>
-------------------------------------------------------------------------------------------------------------------------------------------
>>> xm dmesg from server02
>>> root@cjarrett:~
>>> $ xm dmesg
>>> __  __            _____  _   ___    ____ _____  _   ____  _       _
>>> ____
>>> \ \/ /___ _ __   |___ / / | / _ \  | ___|___ / / | |___ \/ |  ___|
|
>>> ___|
>>> \  // _ \ \047_ \    |_ \ | || | | |_|___ \ |_ \ | |   __) | | / _
>>> \ |___ \
>>> /  \  __/ | | |  ___) || || |_| |__|__) |__) || |_ / __/| ||  __/ |
>>> ___) |
>>> /_/\_\___|_| |_| |____(_)_(_)___/ 
|____/____(_)_(_)_____|_(_)___|_|
>>> ____/
>>>
>>> http://www.cl.cam.ac.uk/netos/xen
>>> University of Cambridge Computer Laboratory
>>>
>>> Xen version 3.1.0-53.1.21.el5 (mockbuild@) (gcc version 4.1.2
>>> 20070626 (Red Hat 4.1.2-14)) Tue May 20 09:27:25 EDT 2008
>>> Latest ChangeSet: unavailable
>>>
>>> (XEN) Command line: /xen.gz-2.6.18-53.1.21.el5
>>> (XEN)  0000000000000000 - 00000000000a0000 (usable)
>>> (XEN)  00000000000f0000 - 0000000000100000 (reserved)
>>> (XEN)  0000000000100000 - 000000003ff77000 (usable)
>>> (XEN)  000000003ff77000 - 000000003ff79000 (ACPI NVS)
>>> (XEN)  000000003ff79000 - 0000000040000000 (reserved)
>>> (XEN)  00000000fec00000 - 00000000fec10000 (reserved)
>>> (XEN)  00000000fee00000 - 00000000fee10000 (reserved)
>>> (XEN)  00000000ffb00000 - 0000000100000000 (reserved)
>>> (XEN) System RAM: 1023MB (1047644kB)
>>> (XEN) Xen heap: 10MB (10240kB)
>>> (XEN) Domain heap initialised: DMA width 32 bits
>>> (XEN) PAE enabled, limit: 16 GB
>>> (XEN) Processor #0 15:1 APIC version 20
>>> (XEN) Enabling APIC mode:  Flat.  Using 1 I/O APICs
>>> (XEN) Using scheduler: SMP Credit Scheduler (credit)
>>> (XEN) Detected 1694.561 MHz processor.
>>> (XEN) CPU0: Intel(R) Pentium(R) 4 CPU 1.70GHz stepping 02
>>> (XEN) Mapping cpu 0 to node 255
>>> (XEN) Total of 1 processors activated.
>>> (XEN) ExtINT not setup in hardware but reported by MP table
>>> (XEN) ENABLING IO-APIC IRQs
>>> (XEN)  -> Using new ACK method
>>> (XEN) Platform timer is 1.193MHz PIT
>>> (XEN) Brought up 1 CPUs
>>> (XEN) *** LOADING DOMAIN 0 ***
>>> (XEN) elf_parse_binary: phdr: paddr=0xc0400000 memsz=0x25d640
>>> (XEN) elf_parse_binary: phdr: paddr=0xc065e000 memsz=0x15a000
>>> (XEN) elf_parse_binary: memory: 0xc0400000 -> 0xc07b8000
>>> (XEN) elf_xen_parse_note: GUEST_OS = "linux"
>>> (XEN) elf_xen_parse_note: GUEST_VERSION = "2.6"
>>> (XEN) elf_xen_parse_note: XEN_VERSION = "xen-3.0"
>>> (XEN) elf_xen_parse_note: VIRT_BASE = 0xc0000000
>>> (XEN) elf_xen_parse_note: PADDR_OFFSET = 0xc0000000
>>> (XEN) elf_xen_parse_note: ENTRY = 0xc0400000
>>> (XEN) elf_xen_parse_note: HYPERCALL_PAGE = 0xc0401000
>>> (XEN) elf_xen_parse_note: FEATURES = "writable_page_tables|
>>> writable_descriptor_tables|auto_translated_physmap|
>>> pae_pgdir_above_4gb|supervisor_mode_kernel"
>>> (XEN) elf_xen_parse_note: PAE_MODE = "yes"
>>> (XEN) elf_xen_parse_note: LOADER = "generic"
>>> (XEN) elf_xen_addr_calc_check: addresses:
>>> (XEN)     virt_base        = 0xc0000000
>>> (XEN)     elf_paddr_offset = 0xc0000000
>>> (XEN)     virt_offset      = 0x0
>>> (XEN)     virt_kstart      = 0xc0400000
>>> (XEN)     virt_kend        = 0xc07b8000
>>> (XEN)     virt_entry       = 0xc0400000
>>> (XEN)  Xen  kernel: 32-bit, PAE, lsb
>>> (XEN)  Dom0 kernel: 32-bit, PAE, lsb, paddr 0xc0400000 ->
0xc07b8000
>>> (XEN) PHYSICAL MEMORY ARRANGEMENT:
>>> (XEN)  Dom0 alloc.:   000000003e000000->000000003f000000 (236736
>>> pages to be allocated)
>>> (XEN) VIRTUAL MEMORY ARRANGEMENT:
>>> (XEN)  Loaded kernel: c0400000->c07b8000
>>> (XEN)  Init. ramdisk: c07b8000->c0ab2800
>>> (XEN)  Phys-Mach map: c0ab3000->c0b9e300
>>> (XEN)  Start info:    c0b9f000->c0b9f46c
>>> (XEN)  Page tables:   c0ba0000->c0bad000
>>> (XEN)  Boot stack:    c0bad000->c0bae000
>>> (XEN)  TOTAL:         c0000000->c1000000
>>> (XEN)  ENTRY ADDRESS: c0400000
>>> (XEN) Dom0 has maximum 1 VCPUs
>>> (XEN) elf_load_binary: phdr 0 at 0xc0400000 -> 0xc065d640
>>> (XEN) elf_load_binary: phdr 1 at 0xc065e000 -> 0xc0702b64
>>> (XEN) Initrd len 0x2fa800, start at 0xc07b8000
>>> (XEN) Scrubbing Free RAM: done.
>>> (XEN) Xen trace buffers: disabled
>>> (XEN) Std. Loglevel: Errors and warnings
>>> (XEN) Guest Loglevel: Nothing (Rate-limited: Errors and warnings)
>>> (XEN) Xen is relinquishing VGA console.
>>> (XEN) *** Serial input -> DOM0 (type \047CTRL-a\047 three times
to
>>> switch input to Xen).
>>> (XEN) mm.c:597:d0 Bad L1 flags 80000000
>>> (XEN) mm.c:895:d0 Failure in alloc_l1_table: entry 287
>>> (XEN) mm.c:1773:d0 Error while validating mfn f0b0 (pfn 47c5) for
>>> type 20000000: caf=80000002 taf=20000001
>>> (XEN) mm.c:644:d0 Attempt to create linear p.t. with write perms
>>> (XEN) mm.c:1069:d0 Failure in alloc_l2_table: entry 0
>>> (XEN) mm.c:1773:d0 Error while validating mfn 1505 (pfn a5) for
type
>>> 40000000: caf=80000002 taf=40000001
>>> (XEN) mm.c:1143:d0 Failure in alloc_l3_table: entry 0
>>> (XEN) mm.c:1773:d0 Error while validating mfn 1534 (pfn 97) for
type
>>> 60000000: caf=80000002 taf=60000001
>>> (XEN) mm.c:2042:d0 Error while pinning mfn 1534
>>>
>>>
----------------------------------------------------------------------------------------------------
>>> cpuinfo from server02
>>> processor     : 0
>>> vendor_id     : GenuineIntel
>>> cpu family    : 15
>>> model         : 1
>>> model name    : Intel(R) Pentium(R) 4 CPU 1.70GHz
>>> stepping      : 2
>>> cpu MHz               : 1694.503
>>> cache size    : 256 KB
>>> fdiv_bug      : no
>>> hlt_bug               : no
>>> f00f_bug      : no
>>> coma_bug      : no
>>> fpu           : yes
>>> fpu_exception : yes
>>> cpuid level   : 2
>>> wp            : yes
>>> flags         : fpu tsc msr pae mce cx8 apic mtrr mca cmov pat
pse36
>>> clflush dts acpi mmx fxsr sse sse2 ss ht tm up
>>> bogomips      : 4242.78
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> _______________________________________________
>>> Xen-users mailing list
>>> Xen-users@lists.xensource.com
>>> http://lists.xensource.com/xen-users
>>
>>
>> _______________________________________________
>> Xen-users mailing list
>> Xen-users@lists.xensource.com
>> http://lists.xensource.com/xen-users
>
> _______________________________________________
> Xen-users mailing list
> Xen-users@lists.xensource.com
> http://lists.xensource.com/xen-users

_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

Jeff Snider

2008-Jun-23 15:32 UTC

head link

Re: [Xen-users] Xen Migration Failure

Thanks.  Your problem is definitely the difference of the hardware  
capabilities of the boxes. I ran into the same thing when I built my  
cluster.  Short answer is that you must always start your domain on  
the box with the most common caps, which in your case is Server02.   
Long answer is below.

Basically, when a domain starts it remembers the capabilities from the  
host on which it started.  You''ll even see it in the kernel boot  
messages.  After that, anything with less capabilities will not run  
the domain.  It will complete the migration, but as soon as the  
destination host tries to start it, it will immediately die.

Take a look at the hw_caps line from both boxes:

Server01: bfebfbff:00100000:00000000:00000180:0000441d
Server02: 3febfbff:00000000:00000000:00000080

These are bit masks, encoded as base64.  If we take the caps strings  
and convert them to binary, we get:

Server01: 101111111110101111111011111111110000000000010000...
Server02: 001111111110101111111011111111110000000000000000...

They''re actually much longer than that, but that''s enough to
get the
idea across.  As you can see, Server01 has two bits set that Server02  
doesn''t have.  A domain started on Server01, when migrated to  
Server02, will try to continue to use the capability it had when it  
was on Server01, and because Server02 can''t do that, Server02 will  
immediately error and destroy the domain.

However, notice that all the capabilities that Server02 has, Server01  
also has.  So if you start a domain on Server02, when migrated to  
Server01, it will not error, because Server02 can do everything  
Server01 could.  And because the capabilities are remembered at boot  
time, the domain will not notice that the host it''s running on now has
more caps than it did before.  So you can migrate it back to Server02  
and it will work fine.

This is how I believe it works, but I could certainly be wrong.  If  
there''s someone with more knowledge about what the hw_caps are and the
way they affect PV domains, please share what you know.

-Jeff

On Jun 23, 2008, at 7:55 AM, Cody Jarrett wrote:
> Sure, here is the info:
>
> Server01:
> root@localhost:~
> $ xm info
> host                   : localhost
> release                : 2.6.18-53.1.21.el5xen
> version                : #1 SMP Tue May 20 10:31:46 EDT 2008
> machine                : i686
> nr_cpus                : 2
> nr_nodes               : 1
> sockets_per_node       : 1
> cores_per_socket       : 1
> threads_per_core       : 2
> cpu_mhz                : 3000
> hw_caps                : bfebfbff:00100000:00000000:00000180:0000441d
> total_memory           : 502
> free_memory            : 2
> xen_major              : 3
> xen_minor              : 1
> xen_extra              : .0-53.1.21.el5
> xen_caps               : xen-3.0-x86_32p
> xen_pagesize           : 4096
> platform_params        : virt_start=0xf5800000
> xen_changeset          : unavailable
> cc_compiler            : gcc version 4.1.2 20070626 (Red Hat 4.1.2-14)
> cc_compile_by          : mockbuild
> cc_compile_domain      :
> cc_compile_date        : Tue May 20 09:27:25 EDT 2008
> xend_config_format     : 2
>
>
> Server02:
> $ xm info
> host                   : server02
> release                : 2.6.18-53.1.21.el5xen
> version                : #1 SMP Tue May 20 10:31:46 EDT 2008
> machine                : i686
> nr_cpus                : 1
> nr_nodes               : 1
> sockets_per_node       : 1
> cores_per_socket       : 1
> threads_per_core       : 1
> cpu_mhz                : 1694
> hw_caps                : 3febfbff:00000000:00000000:00000080
> total_memory           : 1023
> free_memory            : 128
> xen_major              : 3
> xen_minor              : 1
> xen_extra              : .0-53.1.21.el5
> xen_caps               : xen-3.0-x86_32p
> xen_pagesize           : 4096
> platform_params        : virt_start=0xf5800000
> xen_changeset          : unavailable
> cc_compiler            : gcc version 4.1.2 20070626 (Red Hat 4.1.2-14)
> cc_compile_by          : mockbuild
> cc_compile_domain      :
> cc_compile_date        : Tue May 20 09:27:25 EDT 2008
> xend_config_format     : 2

_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

Cody Jarrett

2008-Jun-23 18:08 UTC

head link

Re: [Xen-users] Xen Migration Failure

Jeff,
I just tried moving the VM from server02 to server01 and it worked.  
Thanks for the explanation, it helps a lot. I''d like to find out more  
what HW Caps are and is there any documentation on requirements for  
doing clustering or having machines ready for doing live migrations? I  
guess the member machines would have to have similar hardware, but I  
guess I''d like to know exactly what has to be the same. Also,
I''m in
the process of going through the manual.


On Jun 23, 2008, at 10:32 AM, Jeff Snider wrote:
> Thanks.  Your problem is definitely the difference of the hardware  
> capabilities of the boxes. I ran into the same thing when I built my  
> cluster.  Short answer is that you must always start your domain on  
> the box with the most common caps, which in your case is Server02.   
> Long answer is below.
>
> Basically, when a domain starts it remembers the capabilities from  
> the host on which it started.  You''ll even see it in the kernel
boot
> messages.  After that, anything with less capabilities will not run  
> the domain.  It will complete the migration, but as soon as the  
> destination host tries to start it, it will immediately die.
>
> Take a look at the hw_caps line from both boxes:
>
> Server01: bfebfbff:00100000:00000000:00000180:0000441d
> Server02: 3febfbff:00000000:00000000:00000080
>
> These are bit masks, encoded as base64.  If we take the caps strings  
> and convert them to binary, we get:
>
> Server01: 101111111110101111111011111111110000000000010000...
> Server02: 001111111110101111111011111111110000000000000000...
>
> They''re actually much longer than that, but that''s enough
to get the
> idea across.  As you can see, Server01 has two bits set that  
> Server02 doesn''t have.  A domain started on Server01, when
migrated
> to Server02, will try to continue to use the capability it had when  
> it was on Server01, and because Server02 can''t do that, Server02  
> will immediately error and destroy the domain.
>
> However, notice that all the capabilities that Server02 has,  
> Server01 also has.  So if you start a domain on Server02, when  
> migrated to Server01, it will not error, because Server02 can do  
> everything Server01 could.  And because the capabilities are  
> remembered at boot time, the domain will not notice that the host  
> it''s running on now has more caps than it did before.  So you can
> migrate it back to Server02 and it will work fine.
>
>
> This is how I believe it works, but I could certainly be wrong.  If  
> there''s someone with more knowledge about what the hw_caps are and
> the way they affect PV domains, please share what you know.
>
> -Jeff
>
>
> On Jun 23, 2008, at 7:55 AM, Cody Jarrett wrote:
>
>> Sure, here is the info:
>>
>> Server01:
>> root@localhost:~
>> $ xm info
>> host                   : localhost
>> release                : 2.6.18-53.1.21.el5xen
>> version                : #1 SMP Tue May 20 10:31:46 EDT 2008
>> machine                : i686
>> nr_cpus                : 2
>> nr_nodes               : 1
>> sockets_per_node       : 1
>> cores_per_socket       : 1
>> threads_per_core       : 2
>> cpu_mhz                : 3000
>> hw_caps                : bfebfbff:00100000:00000000:00000180:0000441d
>> total_memory           : 502
>> free_memory            : 2
>> xen_major              : 3
>> xen_minor              : 1
>> xen_extra              : .0-53.1.21.el5
>> xen_caps               : xen-3.0-x86_32p
>> xen_pagesize           : 4096
>> platform_params        : virt_start=0xf5800000
>> xen_changeset          : unavailable
>> cc_compiler            : gcc version 4.1.2 20070626 (Red Hat  
>> 4.1.2-14)
>> cc_compile_by          : mockbuild
>> cc_compile_domain      :
>> cc_compile_date        : Tue May 20 09:27:25 EDT 2008
>> xend_config_format     : 2
>>
>>
>> Server02:
>> $ xm info
>> host                   : server02
>> release                : 2.6.18-53.1.21.el5xen
>> version                : #1 SMP Tue May 20 10:31:46 EDT 2008
>> machine                : i686
>> nr_cpus                : 1
>> nr_nodes               : 1
>> sockets_per_node       : 1
>> cores_per_socket       : 1
>> threads_per_core       : 1
>> cpu_mhz                : 1694
>> hw_caps                : 3febfbff:00000000:00000000:00000080
>> total_memory           : 1023
>> free_memory            : 128
>> xen_major              : 3
>> xen_minor              : 1
>> xen_extra              : .0-53.1.21.el5
>> xen_caps               : xen-3.0-x86_32p
>> xen_pagesize           : 4096
>> platform_params        : virt_start=0xf5800000
>> xen_changeset          : unavailable
>> cc_compiler            : gcc version 4.1.2 20070626 (Red Hat  
>> 4.1.2-14)
>> cc_compile_by          : mockbuild
>> cc_compile_domain      :
>> cc_compile_date        : Tue May 20 09:27:25 EDT 2008
>> xend_config_format     : 2
>
> _______________________________________________
> Xen-users mailing list
> Xen-users@lists.xensource.com
> http://lists.xensource.com/xen-users

_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

Xen users - Jun 2008 - Xen Migration Failure

[Xen-users] Xen Migration Failure

Re: [Xen-users] Xen Migration Failure

Re: [Xen-users] Xen Migration Failure

Re: [Xen-users] Xen Migration Failure

Re: [Xen-users] Xen Migration Failure

Re: [Xen-users] Xen Migration Failure