Pasi Kärkkäinen wrote:> On Mon, Mar 08, 2010 at 03:46:31PM +0100, Kalle Happonen wrote:
>
>> Hello all,
>>
>> I''m running Xen on a HP DL385G6 machine. I use Centos 5.4 on
the dom0,
>> which comes with the seemingly old 3.0.3 (accoring to rpm) version of
>> xen.(Although another thread just said: RHEL5 has Xen hypervisor
version
>> 3.1.2 + tools version 3.0.3.)
>>
>> The machine runs a pair of AMD Istanbuls (Six-Core AMD Opteron(tm)
>> Processor 2431). I have an Ininiband card on the machine which I would
>> like to pass on to a domU. When I try to attach the pci device to the
>> domu, I get the following output though..
>>
>> xm pci-attach jade 0000:48:00.0
>> Error: failed to assign device: maybe the platform doesn''t
support VT-d,
>> or VT-d isn''t enabled properly?
>> Usage: xm pci-attach <Domain> <domain:bus:slot.func>
[virtual slot]
>>
>> Insert a new pass-through pci device.
>>
>> If I have understood correctly, this new AMDs should support it though.
>> The virtualization option has been enabled in the BIOS.
>>
>> Looking at xm dmesg, however, I get the following
>>
>> ...
>> (XEN) HVM: SVM enabled
>> (XEN) HVM: Hardware Assisted Paging detected and enabled.
>> (XEN) I/O virtualisation disabled
>> ...
>>
>> I have tried adding "amd_enable_iommu=1" to grub, but it
doesn''t seem to
>> help. Is the version of xen too old to support this? If so, how big of
a
>> task is it to upgrade xen, and which version would be required?
Sticking
>> with the stock version would be nice from the security update point of
>> view.
>>
>>
>
> Please paste the full "xm dmesg" log.
> Are you sure your hardware has IOMMU, that is required for IO
virtualization?
>
Well, I have tried to look into this, but the information is a bit
scarce. As far as I can tell, this hardware should have IOMMU support.
Unless HP has problems with the firmware...> Also I think only the very latest Xen versions (aka upcoming Xen 4.0.0) has
> support for AMD IOMMUs..
>
Yeah, I assumed this might be the case. Well it''s not completely
critical, but it would be nice.> Dunno if Redhat has backported AMD IOMMU support to their Xen version.
>
The xm dmesg output is below,
Cheers,
Kalle Happonen
Xen version 3.1.2-164.11.1.el5 (mockbuild@centos.org) (gcc version
4.1.2 20080704 (Red Hat 4.1.2-46)) Wed Jan 20 07:24:59 EST 2010
Latest ChangeSet: unavailable
(XEN) Command line: dom0_mem=2048MB dom0_max_vcpus=2 amd_enable_iommu=1
(XEN) Video information:
(XEN) VGA is text mode 80x25, font 8x16
(XEN) VBE/DDC methods: none; EDID transfer time: 2 seconds
(XEN) EDID info not retrieved because no DDC retrieval method detected
(XEN) Disc information:
(XEN) Found 1 MBR signatures
(XEN) Found 1 EDD information structures
(XEN) Xen-e820 RAM map:
(XEN) 0000000000000000 - 000000000009f400 (usable)
(XEN) 000000000009f400 - 00000000000a0000 (reserved)
(XEN) 00000000000f0000 - 0000000000100000 (reserved)
(XEN) 0000000000100000 - 00000000cfe3e000 (usable)
(XEN) 00000000cfe3e000 - 00000000cfe46000 (ACPI data)
(XEN) 00000000cfe46000 - 00000000cfe47000 (usable)
(XEN) 00000000cfe47000 - 00000000e0000000 (reserved)
(XEN) 00000000fec00000 - 00000000fee10000 (reserved)
(XEN) 00000000ffc00000 - 0000000100000000 (reserved)
(XEN) 0000000100000000 - 000000082ffff000 (usable)
(XEN) System RAM: 32765MB (33552244kB)
(XEN) Xen heap: 13MB (13980kB)
(XEN) Domain heap initialised: DMA width 32 bits
(XEN) Processor #0 0:8 APIC version 16
(XEN) Processor #8 0:8 APIC version 16
(XEN) Processor #1 0:8 APIC version 16
(XEN) Processor #9 0:8 APIC version 16
(XEN) Processor #2 0:8 APIC version 16
(XEN) Processor #10 0:8 APIC version 16
(XEN) Processor #3 0:8 APIC version 16
(XEN) Processor #11 0:8 APIC version 16
(XEN) Processor #4 0:8 APIC version 16
(XEN) Processor #12 0:8 APIC version 16
(XEN) Processor #5 0:8 APIC version 16
(XEN) Processor #13 0:8 APIC version 16
(XEN) IOAPIC[0]: apic_id 8, version 17, address 0xfec00000, GSI 0-15
(XEN) IOAPIC[1]: apic_id 9, version 17, address 0xfec01000, GSI 16-31
(XEN) IOAPIC[2]: apic_id 10, version 17, address 0xfec02000, GSI 32-47
(XEN) Enabling APIC mode: Phys. Using 3 I/O APICs
(XEN) Using scheduler: SMP Credit Scheduler (credit)
(XEN) Detected 2400.192 MHz processor.
(XEN) AMD SVM: ASIDs enabled.
(XEN) HVM: SVM enabled
(XEN) HVM: Hardware Assisted Paging detected and enabled.
(XEN) I/O virtualisation disabled
(XEN) CPU0: AMD Six-Core AMD Opteron(tm) Processor 2431 stepping 00
(XEN) Booting processor 1/8 eip 90000
(XEN) AMD SVM: ASIDs enabled.
(XEN) CPU1: AMD Six-Core AMD Opteron(tm) Processor 2431 stepping 00
(XEN) Booting processor 2/1 eip 90000
(XEN) AMD SVM: ASIDs enabled.
(XEN) CPU2: AMD Six-Core AMD Opteron(tm) Processor 2431 stepping 00
(XEN) Booting processor 3/9 eip 90000
(XEN) AMD SVM: ASIDs enabled.
(XEN) CPU3: AMD Six-Core AMD Opteron(tm) Processor 2431 stepping 00
(XEN) Booting processor 4/2 eip 90000
(XEN) AMD SVM: ASIDs enabled.
(XEN) CPU4: AMD Six-Core AMD Opteron(tm) Processor 2431 stepping 00
(XEN) Booting processor 5/10 eip 90000
(XEN) AMD SVM: ASIDs enabled.
(XEN) CPU5: AMD Six-Core AMD Opteron(tm) Processor 2431 stepping 00
(XEN) Booting processor 6/3 eip 90000
(XEN) AMD SVM: ASIDs enabled.
(XEN) CPU6: AMD Six-Core AMD Opteron(tm) Processor 2431 stepping 00
(XEN) Booting processor 7/11 eip 90000
(XEN) AMD SVM: ASIDs enabled.
(XEN) CPU7: AMD Six-Core AMD Opteron(tm) Processor 2431 stepping 00
(XEN) Booting processor 8/4 eip 90000
(XEN) AMD SVM: ASIDs enabled.
(XEN) CPU8: AMD Six-Core AMD Opteron(tm) Processor 2431 stepping 00
(XEN) Booting processor 9/12 eip 90000
(XEN) AMD SVM: ASIDs enabled.
(XEN) CPU9: AMD Six-Core AMD Opteron(tm) Processor 2431 stepping 00
(XEN) Booting processor 10/5 eip 90000
(XEN) AMD SVM: ASIDs enabled.
(XEN) CPU10: AMD Six-Core AMD Opteron(tm) Processor 2431 stepping 00
(XEN) Booting processor 11/13 eip 90000
(XEN) AMD SVM: ASIDs enabled.
(XEN) CPU11: AMD Six-Core AMD Opteron(tm) Processor 2431 stepping 00
(XEN) Total of 12 processors activated.
(XEN) ENABLING IO-APIC IRQs
(XEN) -> Using new ACK method
(XEN) Platform timer overflows in 14998 jiffies.
(XEN) Platform timer is 14.318MHz HPET
(XEN) Brought up 12 CPUs
(XEN) *** LOADING DOMAIN 0 ***
(XEN) elf_parse_binary: phdr: paddr=0xffffffff80200000 memsz=0x2edd48
(XEN) elf_parse_binary: phdr: paddr=0xffffffff804edd80 memsz=0x14a4f0
(XEN) elf_parse_binary: phdr: paddr=0xffffffff80639000 memsz=0xc08
(XEN) elf_parse_binary: phdr: paddr=0xffffffff8063a000 memsz=0x11c50c
(XEN) elf_parse_binary: memory: 0xffffffff80200000 -> 0xffffffff8075650c
(XEN) elf_xen_parse_note: GUEST_OS = "linux"
(XEN) elf_xen_parse_note: GUEST_VERSION = "2.6"
(XEN) elf_xen_parse_note: XEN_VERSION = "xen-3.0"
(XEN) elf_xen_parse_note: VIRT_BASE = 0xffffffff80000000
(XEN) elf_xen_parse_note: PADDR_OFFSET = 0xffffffff80000000
(XEN) elf_xen_parse_note: ENTRY = 0xffffffff80200000
(XEN) elf_xen_parse_note: HYPERCALL_PAGE = 0xffffffff80206000
(XEN) elf_xen_parse_note: FEATURES =
"writable_page_tables|writable_descriptor_tables|auto_translated_physmap|pae_pgdir_above_4gb|supervisor_mode_kernel"
(XEN) elf_xen_parse_note: LOADER = "generic"
(XEN) elf_xen_addr_calc_check: addresses:
(XEN) virt_base = 0xffffffff80000000
(XEN) elf_paddr_offset = 0xffffffff80000000
(XEN) virt_offset = 0x0
(XEN) virt_kstart = 0xffffffff80200000
(XEN) virt_kend = 0xffffffff8075650c
(XEN) virt_entry = 0xffffffff80200000
(XEN) Xen kernel: 64-bit, lsb, compat32
(XEN) Dom0 kernel: 64-bit, lsb, paddr 0xffffffff80200000 ->
0xffffffff8075650c
(XEN) PHYSICAL MEMORY ARRANGEMENT:
(XEN) Dom0 alloc.: 0000000806000000->0000000808000000 (516096 pages
to be allocated)
(XEN) VIRTUAL MEMORY ARRANGEMENT:
(XEN) Loaded kernel: ffffffff80200000->ffffffff8075650c
(XEN) Init. ramdisk: ffffffff80757000->ffffffff80e18e00
(XEN) Phys-Mach map: ffffffff80e19000->ffffffff81219000
(XEN) Start info: ffffffff81219000->ffffffff8121949c
(XEN) Page tables: ffffffff8121a000->ffffffff81227000
(XEN) Boot stack: ffffffff81227000->ffffffff81228000
(XEN) TOTAL: ffffffff80000000->ffffffff81400000
(XEN) ENTRY ADDRESS: ffffffff80200000
(XEN) Dom0 has maximum 2 VCPUs
(XEN) elf_load_binary: phdr 0 at 0xffffffff80200000 -> 0xffffffff804edd48
(XEN) elf_load_binary: phdr 1 at 0xffffffff804edd80 -> 0xffffffff80638270
(XEN) elf_load_binary: phdr 2 at 0xffffffff80639000 -> 0xffffffff80639c08
(XEN) elf_load_binary: phdr 3 at 0xffffffff8063a000 -> 0xffffffff80677028
(XEN) Initrd len 0x6c1e00, start at 0xffffffff80757000
(XEN) Scrubbing Free RAM:
.............................................................................................................................................................................................................................................................................................................done.
(XEN) Xen trace buffers: disabled
(XEN) Std. Loglevel: Errors and warnings
(XEN) Guest Loglevel: Nothing (Rate-limited: Errors and warnings)
(XEN) Xen is relinquishing VGA console.
(XEN) *** Serial input -> DOM0 (type \047CTRL-a\047 three times to
switch input to Xen).
(XEN) Freed 112kB init memory.
_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users