Markus Rhonheimer
2012-Oct-24 16:41 UTC
XCP 1.6 beta Ram restriction for pci passthrough to pv Ubuntu 12.04 template
Hi,
I use XCP 1.6.06 with a Ubuntu 12.04 64bit pv domU created with the template
through xencenter 6.1.
I also used this command on xcp: xe vm-param-set other-config:pci=0/0000:00:1f.2
uuid=d6eb559e-af70-6f8e-d10f-62fc9f73db89 which passes a "SATA controller:
Intel Corporation 6 Series/C200 Series Chipset Family SATA AHCI Controller (rev
05)" through to the domU. extlinux boot configuration has the passthrough
option.
After booting the domU lspci shows the passed through device but none of the
attached HDDs are visible.
This message can be seen within dmesg:
[ 1.367184] pcifront pci-0: Installing PCI frontend
[ 1.367232] pcifront pci-0: Creating PCI Frontend Bus 0000:00
[ 1.367789] pci 0000:00:00.2: [8086:1c02] type 0 class 0x000106
[ 1.368217] pci 0000:00:00.2: reg 10: [io 0xf070-0xf077]
[ 1.368416] pci 0000:00:00.2: reg 14: [io 0xf060-0xf063]
[ 1.368595] pci 0000:00:00.2: reg 18: [io 0xf050-0xf057]
[ 1.368781] pci 0000:00:00.2: reg 1c: [io 0xf040-0xf043]
[ 1.368904] pci 0000:00:00.2: reg 20: [io 0xf000-0xf01f]
[ 1.369028] pci 0000:00:00.2: reg 24: [mem 0xfbe21000-0xfbe217ff]
[ 1.370396] pcifront pci-0: New device on 0000:00:00.02 found.
[ 1.375540] pcifront pci-0: claiming resource 0000:00:00.2/0
[ 1.375546] pcifront pci-0: claiming resource 0000:00:00.2/1
[ 1.375556] pcifront pci-0: claiming resource 0000:00:00.2/2
[ 1.375558] pcifront pci-0: claiming resource 0000:00:00.2/3
[ 1.375559] pcifront pci-0: claiming resource 0000:00:00.2/4
[ 1.375560] pcifront pci-0: claiming resource 0000:00:00.2/5
[ 1.375563] pci 0000:00:00.2: address space collision: [mem
0xfbe21000-0xfbe217ff] conflicts with System RAM [mem 0x00100000-0x237ffffff]
[ 1.375565] pcifront pci-0: Could not claim resource 0000:00:00.2/5! Device
offline. Try using e820_host=1 in the guest config.
[ 1.376935] ahci 0000:00:00.2: version 3.0
[ 1.376991] ahci 0000:00:00.2: device not available (can''t reserve
[mem 0xfbe21000-0xfbe217ff])
[ 1.376999] ahci: probe of 0000:00:00.2 failed with error -22
[ 1.436181] lp: driver loaded but no devices found
The domU has about 8GB of Ram and therefore this bug seems to apply:
http://bugzilla.xensource.com/bugzilla/show_bug.cgi?id=1673
This report mentions a more detailed thread at:
http://www.gossamer-threads.com/lists/xen/devel/187533
These are further informations about the host:
[root@flicka ~]# xe host-list params=all
uuid ( RO) :
9f0c1ea2-70b4-4776-8349-932ec5fc4ba0
name-label ( RW): flicka
name-description ( RW): Default install of XenServer
allowed-operations (SRO): VM.migrate; evacuate; provision;
VM.resume; VM.start
current-operations (SRO):
enabled ( RO): true
API-version-major ( RO): 1
API-version-minor ( RO): 10
API-version-vendor ( RO): XenSource
API-version-vendor-implementation (MRO):
logging (MRW):
suspend-image-sr-uuid ( RW):
46d93d6b-5daf-ec05-6615-e43335687be1
crash-dump-sr-uuid ( RW):
46d93d6b-5daf-ec05-6615-e43335687be1
software-version (MRO): platform_name: XCP;
platform_version: 1.6.06; build_number: 61002c; hostname: dagu-1; date:
2012-10-05; xapi: 1.3; xen: 4.1.3; linux:
2.6.32.43-0.4.1.xs1.6.06.734.170748xen; xencenter_min: 1.10; xencenter_max:
1.10; network_backend: openvswitch; xcp:main: Base Pack, version 1.6.06, build
61002c; xcp:extras: XCP Pack, version 1.6.06, build 61002c
capabilities (SRO): xen-3.0-x86_64; xen-3.0-x86_32p;
hvm-3.0-x86_32; hvm-3.0-x86_32p; hvm-3.0-x86_64;
other-config (MRW): agent_start_time: 1351091919.;
boot_time: 1351091870.; iscsi_iqn: iqn.2012-10.com.example:9827b10a
cpu_info (MRO): cpu_count: 4; vendor: GenuineIntel;
speed: 3093.038; modelname: Intel(R) Xeon(R) CPU E31220 @ 3.10GHz; family: 6;
model: 42; stepping: 7; flags: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov
pat clflush acpi mmx fxsr sse sse2 ss ht nx constant_tsc nonstop_tsc aperfmperf
pni pclmulqdq vmx est ssse3 sse4_1 sse4_2 x2apic popcnt aes hypervisor ida arat
tpr_shadow vnmi flexpriority ept vpid; features:
17bae3ff-bfebfbff-00000001-28100800; features_after_reboot:
17bae3ff-bfebfbff-00000001-28100800; physical_features:
17bae3ff-bfebfbff-00000001-28100800; maskable: full
chipset-info (MRO): iommu: true
hostname ( RO): flicka
address ( RO): 192.168.178.46
supported-bootloaders (SRO): pygrub; eliloader
blobs ( RO):
memory-overhead ( RO): 302686208
memory-total ( RO): 17156595712
memory-free ( RO): 6461456384
memory-free-computed ( RO): <expensive field>
host-metrics-live ( RO): true
patches (SRO):
ha-statefiles ( RO):
ha-network-peers ( RO):
external-auth-type ( RO):
external-auth-service-name ( RO):
external-auth-configuration (MRO):
edition ( RO): free
license-server (MRO): address: localhost; port: 27000
power-on-mode ( RO):
power-on-config (MRO):
local-cache-sr ( RO): <not in database>
tags (SRW):
The kernel version of the Ubuntu domU is:
3.2.0-32-generic
I would appreciate any help.
Thanks in advance
Markus
Pasi Kärkkäinen
2012-Oct-28 13:35 UTC
Re: [Xen-API] XCP 1.6 beta Ram restriction for pci passthrough to pv Ubuntu 12.04 template
On Wed, Oct 24, 2012 at 06:41:39PM +0200, Markus Rhonheimer wrote:> Hi, > > I use XCP 1.6.06 with a Ubuntu 12.04 64bit pv domU created with the template through xencenter 6.1. > I also used this command on xcp: xe vm-param-set other-config:pci=0/0000:00:1f.2 uuid=d6eb559e-af70-6f8e-d10f-62fc9f73db89 which passes a "SATA controller: Intel Corporation 6 Series/C200 Series Chipset Family SATA AHCI Controller (rev 05)" through to the domU. extlinux boot configuration has the passthrough option. > After booting the domU lspci shows the passed through device but none of the attached HDDs are visible. > This message can be seen within dmesg: ><snip>> > The domU has about 8GB of Ram and therefore this bug seems to apply: > > http://bugzilla.xensource.com/bugzilla/show_bug.cgi?id=1673 > > This report mentions a more detailed thread at: > > http://www.gossamer-threads.com/lists/xen/devel/187533 > > These are further informations about the host: > ><snip>> The kernel version of the Ubuntu domU is: > > 3.2.0-32-generic > > I would appreciate any help. > Thanks in advance >Linux 3.2.0 does not support PCI passthru with >3G of RAM. The issues is fixed in xen-pcifront driver in later kernel versions. -- Pasi
danswartz
2013-Feb-27 01:08 UTC
Re: [Xen-API] XCP 1.6 beta Ram restriction for pci passthrough to pv Ubuntu 12.04 template
Hi, Pasi. Can you say which kernel version(s) have this fix? I have looked as recently as 3.8 kernels and don''t see anything in the xen-pcifront.c file that looks related to this (although it''s possible it''s elsewhere?) Like the OP I am using Ubuntu 12.04 with a 3.2.0-xx kernel and got bit by this. I was working around it with an HVM, but my HBA (an LSI HBA) would get a MPT BIOS fault on boot, requiring ''hit any key to continue'', which is obviously not acceptable for unattended operation :) I would dearly love a 64-bit dom0, since I want to serve up data via NFS/CIFS from a ZFS dom0, but restricting that to 3GB is a major showstopper. -- View this message in context: http://xen.1045712.n5.nabble.com/XCP-1-6-beta-Ram-restriction-for-pci-passthrough-to-pv-Ubuntu-12-04-template-tp5712107p5714476.html Sent from the Xen - User mailing list archive at Nabble.com.