Xen users - Jul 2013 - [Fwd: Re: XEN 4.2.2: Windows 2008 R2 server HVM does not start when attempting to use more than 3072MB of RAM]

> On Mon, Jul 01, 2013 at 12:12:31AM +0300, NiX wrote:
>> System:
>>
>> CPU''s: 2 x XEON X5450
>> Motherboard:
>> http://www.intel.com/p/en_US/support/highlights/server/s5000psl/
>> RAM: 16GB DDR2 ECC
>> OS: Debian 7.0 64bit
>>
>> If I attempt to use more than 3GB of RAM to the guest below (Windows
>> 2008
>> server R2 64bit) it will end up with the following error message:
>>
>> xl create win_2008_server_hvm.cfg
>> Parsing config from win_2008_server_hvm.cfg
>> xc: info: VIRTUAL MEMORY ARRANGEMENT:
>>   Loader:        0000000000100000->000000000019df48
>>   TOTAL:         0000000000000000->00000000ff000000
>>   ENTRY ADDRESS: 0000000000100000
>> xc: info: PHYSICAL MEMORY ALLOCATION:
>>   4KB PAGES: 0x0000000000000200
>>   2MB PAGES: 0x00000000000003f7
>>   1GB PAGES: 0x0000000000000002
>> xc: error: panic: xc_dom_boot.c:388: xc_dom_gnttab_hvm_seed: failed to
>> add
>> gnttab to physmap [errno=22]
>> : Internal error
>
> I think I''ve experience this before. And a fix by Tim / Jan went
into
> Xen-unstable to fix this.
>
> Unfortunately I could not get hold of that changeset as it was not
> directly related to this problem. Could you try Xen-4.3-rc6 and see if
> you still see this error?
The server is going live. Currently I cannot test anything as the server
is moving back to data center. I would rather use ''final''
version of XEN
because the server goes live, I cannot risk downtime/crashes that much...
>
>> libxl: error: libxl_dm.c:1218:device_model_spawn_outcome: domain 1
>> device
>> model: spawn failed (rc=-3)
>> libxl: error: libxl_exec.c:118:libxl_report_child_exitstatus:
>> /etc/xen/scripts/vif-bridge add [4567] exited with error status 1
>> libxl: error: libxl_create.c:1116:domcreate_attach_pci: unable to add
>> nic
>> devices
>> libxl: error: libxl_dm.c:1251:libxl__destroy_device_model: Device Model
>> already exited
>>
>> On my AMD 1090T CPU with 12GB DDR3, there is no issues whatsoever
>> starting
>> windows 2008 R2 server with more than 4GB of RAM.
>>
>
> So you mean the exact same version of Xen, exact configs of everything,
> on AMD box, doesn''t have this problem? Weird...
Yes. I was able to allocate for example 6GB of RAM (the setup on AMD is
exactly the same expect I use there Debian 6.0 but both XEN''s are
source
compiles) using AMD 1090T on Debian 6.0 64bit. I am using on both machines
custom kernel 3.2.47-grsec but it''s likely the issue is related to XEN.
I
already tested without grsec and it did not helped.
>
>
> Wei.
>
>> Any solution for XEON based hardware?
>>
>> ------------------------------
>> cat win_2008_server_hvm.cfg
>> ------------------------------
>> builder="hvm"
>> vcpus=1
>> memory=3072
>> name="Windows.Server.2008.R2.Enterprise.x64.SP1"
>>
>> # rtl8139 e1000
>>
>> vif = [
>>
"type=ioemu,ip=10.100.12.6,mac=00:16:3E:E6:7E:48,bridge=br0,model=rtl8139"
>> ]
>> disk = [
"raw:/home/servers/xen/images/win_2008_server.img,ioemu:hda,w"
>> ]
>>
>> boot="c"
>>
>> serial="pty"
>> usbdevice="tablet"
>>
>> sdl=0
>> vnc=1
>> vncpasswd="secret12345"
>> vnclisten="0.0.0.0"
>> vncdisplay=10
>> vncconsole=1
>> monitor=1
>>
>> acpi=1
>> apic=1
>> localtime=0
>> xen_platform_pci=1
>> stdvga=1
>> videoram=16
>> gfx_passthru=0
>>
>> shadow_memory=8
>>
>> on_poweroff="destroy"
>> on_reboot="restart"
>> on_crash="restart"
>>
>> ------------------------------
>> xl info
>> ------------------------------
>>
>> host                   : nix
>> release                : 3.2.47-grsec
>> version                : #10 SMP Sun Jun 23 00:19:06 EEST 2013
>> machine                : x86_64
>> nr_cpus                : 8
>> max_cpu_id             : 7
>> nr_nodes               : 1
>> cores_per_socket       : 4
>> threads_per_core       : 1
>> cpu_mhz                : 2992
>> hw_caps                :
>> bfebfbff:20100800:00000000:00000940:040ce3bd:00000000:00000001:00000000
>> virt_caps              : hvm
>> total_memory           : 16378
>> free_memory            : 646
>> sharing_freed_memory   : 0
>> sharing_used_memory    : 0
>> free_cpus              : 0
>> xen_major              : 4
>> xen_minor              : 2
>> xen_extra              : .2
>> xen_caps               : xen-3.0-x86_64 xen-3.0-x86_32p hvm-3.0-x86_32
>> hvm-3.0-x86_32p hvm-3.0-x86_64
>> xen_scheduler          : credit
>> xen_pagesize           : 4096
>> platform_params        : virt_start=0xffff800000000000
>> xen_changeset          : unavailable
>> xen_commandline        : placeholder
>> cc_compiler            : gcc (Debian 4.7.2-5) 4.7.2
>> cc_compile_by          : root
>> cc_compile_domain      :
>> cc_compile_date        : Mon Jun  3 19:24:27 EEST 2013
>> xend_config_format     : 4
>>
>> ------------------------------
>> xl dmesg
>> ------------------------------
>>  __  __            _  _    ____    ____
>>  \ \/ /___ _ __   | || |  |___ \  |___ \
>>   \  // _ \ ''_ \  | || |_   __) |   __) |
>>   /  \  __/ | | | |__   _| / __/ _ / __/
>>  /_/\_\___|_| |_|    |_|(_)_____(_)_____|
>>
>> (XEN) Xen version 4.2.2 (root@) (gcc (Debian 4.7.2-5) 4.7.2) Mon Jun  3
>> 19:24:27 EEST 2013
>> (XEN) Latest ChangeSet: unavailable
>> (XEN) Bootloader: GRUB 1.99-27+deb7u1
>> (XEN) Command line: placeholder
>> (XEN) Video information:
>> (XEN)  VGA is text mode 80x25, font 8x16
>> (XEN)  VBE/DDC methods: V2; EDID transfer time: 2 seconds
>> (XEN) Disc information:
>> (XEN)  Found 5 MBR signatures
>> (XEN)  Found 5 EDD information structures
>> (XEN) Xen-e820 RAM map:
>> (XEN)  0000000000000000 - 000000000009b000 (usable)
>> (XEN)  000000000009b000 - 0000000000100000 (reserved)
>> (XEN)  0000000000100000 - 00000000df91a000 (usable)
>> (XEN)  00000000df91a000 - 00000000df9d1000 (ACPI NVS)
>> (XEN)  00000000df9d1000 - 00000000dfa32000 (usable)
>> (XEN)  00000000dfa32000 - 00000000dfa9a000 (reserved)
>> (XEN)  00000000dfa9a000 - 00000000dfab4000 (usable)
>> (XEN)  00000000dfab4000 - 00000000dfb1a000 (ACPI NVS)
>> (XEN)  00000000dfb1a000 - 00000000dfb28000 (usable)
>> (XEN)  00000000dfb28000 - 00000000dfb3a000 (ACPI data)
>> (XEN)  00000000dfb3a000 - 00000000dfc00000 (usable)
>> (XEN)  00000000dfc00000 - 00000000f0000000 (reserved)
>> (XEN)  00000000ffc00000 - 00000000ffc0c000 (reserved)
>> (XEN)  0000000100000000 - 0000000420000000 (usable)
>> (XEN) ACPI: RSDP 000F0410, 0024 (r2 INTEL )
>> (XEN) ACPI: XSDT DFB39120, 0074 (r1 INTEL  S5000PSL        0 INTL
>> 1000013)
>> (XEN) ACPI: FACP DFB37000, 00F4 (r3 INTEL  S5000PSL        0 INTL
>> 1000013)
>> (XEN) ACPI: DSDT DFB30000, 5809 (r2 INTEL  S5000PSL        1 INTL
>> 1000013)
>> (XEN) ACPI: FACS DFAB4000, 0040
>> (XEN) ACPI: APIC DFB36000, 00C8 (r1 INTEL  S5000PSL        0 INTL
>> 1000013)
>> (XEN) ACPI: SPCR DFB2F000, 0050 (r1 INTEL  S5000PSL        0 INTL
>> 1000013)
>> (XEN) ACPI: HPET DFB2E000, 0038 (r1 INTEL  S5000PSL        1 INTL
>> 1000013)
>> (XEN) ACPI: MCFG DFB2D000, 003C (r1 INTEL  S5000PSL        1 INTL
>> 1000013)
>> (XEN) ACPI: SSDT DFB2C000, 0193 (r2  INTEL IPMI         4000 INTL
>> 20060317)
>> (XEN) ACPI: HEST DFB2B000, 00A8 (r1 INTEL  S5000PSL        1 INTL
>> 1)
>> (XEN) ACPI: BERT DFB2A000, 0030 (r1 INTEL  S5000PSL        1 INTL
>> 1)
>> (XEN) ACPI: ERST DFB29000, 0230 (r1 INTEL  S5000PSL        1 INTL
>> 1)
>> (XEN) ACPI: EINJ DFB28000, 0130 (r1 INTEL  S5000PSL        1 INTL
>> 1)
>> (XEN) System RAM: 16378MB (16771088kB)
>> (XEN) Domain heap initialised
>> (XEN) Processor #0 7:7 APIC version 20
>> (XEN) Processor #2 7:7 APIC version 20
>> (XEN) Processor #4 7:7 APIC version 20
>> (XEN) Processor #6 7:7 APIC version 20
>> (XEN) Processor #1 7:7 APIC version 20
>> (XEN) Processor #3 7:7 APIC version 20
>> (XEN) Processor #5 7:7 APIC version 20
>> (XEN) Processor #7 7:7 APIC version 20
>> (XEN) IOAPIC[0]: apic_id 8, version 32, address 0xfec00000, GSI 0-23
>> (XEN) IOAPIC[1]: apic_id 9, version 32, address 0xfec80000, GSI 24-47
>> (XEN) Enabling APIC mode:  Flat.  Using 2 I/O APICs
>> (XEN) Using scheduler: SMP Credit Scheduler (credit)
>> (XEN) Detected 2992.578 MHz processor.
>> (XEN) Initing memory sharing.
>> (XEN) xstate_init: using cntxt_size: 0x240 and states: 0x3
>> (XEN) I/O virtualisation disabled
>> (XEN) ENABLING IO-APIC IRQs
>> (XEN)  -> Using new ACK method
>> (XEN) Platform timer is 14.318MHz HPET
>> (XEN) Allocated console ring of 16 KiB.
>> (XEN) VMX: Supported advanced features:
>> (XEN)  - APIC MMIO access virtualisation
>> (XEN)  - APIC TPR shadow
>> (XEN)  - Virtual NMI
>> (XEN)  - MSR direct-access bitmap
>> (XEN) HVM: ASIDs disabled.
>> (XEN) HVM: VMX enabled
>> (XEN) Brought up 8 CPUs
>> (XEN) *** LOADING DOMAIN 0 ***
>> (XEN)  Xen  kernel: 64-bit, lsb, compat32
>> (XEN)  Dom0 kernel: 64-bit, PAE, lsb, paddr 0x1000000 -> 0x1c00000
>> (XEN) PHYSICAL MEMORY ARRANGEMENT:
>> (XEN)  Dom0 alloc.:   000000040c000000->0000000410000000 (4095169
pages
>> to
>> be allocated)
>> (XEN)  Init. ramdisk: 000000041fa89000->000000041ffffe00
>> (XEN) VIRTUAL MEMORY ARRANGEMENT:
>> (XEN)  Loaded kernel: ffffffff81000000->ffffffff81c00000
>> (XEN)  Init. ramdisk: ffffffff81c00000->ffffffff82176e00
>> (XEN)  Phys-Mach map: ffffffff82177000->ffffffff840d81c0
>> (XEN)  Start info:    ffffffff840d9000->ffffffff840d94b4
>> (XEN)  Page tables:   ffffffff840da000->ffffffff840ff000
>> (XEN)  Boot stack:    ffffffff840ff000->ffffffff84100000
>> (XEN)  TOTAL:         ffffffff80000000->ffffffff84400000
>> (XEN)  ENTRY ADDRESS: ffffffff819661c0
>> (XEN) Dom0 has maximum 8 VCPUs
>> (XEN) Scrubbing Free RAM: .done.
>> (XEN) Initial low memory virq threshold set at 0x4000 pages.
>> (XEN) Std. Loglevel: Errors and warnings
>> (XEN) Guest Loglevel: Nothing (Rate-limited: Errors and warnings)
>> (XEN) Xen is relinquishing VGA console.
>> (XEN) *** Serial input -> DOM0 (type ''CTRL-a''
three times to switch
>> input
>> to Xen)
>> (XEN) Freed 268kB init memory.
>>
>>
>> _______________________________________________
>> Xen-users mailing list
>> Xen-users@lists.xen.org
>> http://lists.xen.org/xen-users
>