Bruce Edge
2010-Jun-10 23:25 UTC
[Xen-devel] PCI devices missing from domU in pv kernel, hvm OK.
I had hvm domU working fine. This problem is specific to my pv-ops
config. I''m not seeing any PCI devices after I bring up the domU. I
was able to get this working as an hvm instance, but not pv.
I''d appreciate if anyone could offer some insight as to why I
can''t
see the PCI devices in domU.
I''ve gone through these
http://wiki.xensource.com/xenwiki/XenPCIpassthrough
I sync''d up with Jeremy''s 2.6.32x tree and xen 4.0.1-rc3.pre
current
as of today.
The hardware is a proliant G5 (intel X58 chipset) with dual i7''s.
The dom0 shows these devices available:
xm pci-list-assignable-devices
0000:17:00.0
0000:17:00.1
0000:14:00.0
0000:14:00.1
0000:10:00.0
0000:10:00.1
0000:10:00.2
0000:10:00.3
0000:0a:00.0
0000:0a:00.1
0000:07:00.0
0000:07:00.1
0000:07:00.2
0000:07:00.3
but the domU see''s nothing:
~# lspci
~#
Are there any boot options that need to change from hvm to pv
regarding pci passthrough/iommu settings?
I''m using:
menuentry "Xen osa-dom0 6.0.14-01, linux 2.6.32.15" {
multiboot /boot/xen.gz dummy=dummy console=com1 115200,8n1
dom0_mem=512M dom0_max_vcpus=1 dom0_vcpus_pin=true
iommu=1,passthrough,no-intremap loglvl=all loglvl_guest=all loglevl=10
debug acpi=force apic=on apic_verbosity=verbose numa=on
extra_guest_irqs=80
module /boot/vmlinuz-2.6.32.15
root=UUID=89eb87f0-58af-47e0-a1e4-dfbbac9e57bf ro earlyprintk=xen
loglevel=10 debug acpi=force console=hvc0,115200n8
module /boot/initrd.img-2.6.32.15 /boot/initrd.img-2.6.32.15
Are these messages from the domU boot significant?
[ 0.000000] No local APIC present
[ 0.000000] APIC: disable apic facility
[ 0.000000] PCI: Warning: Cannot find a gap in the 32bit address range
[ 0.000000] PCI: Unassigned devices with 32bit resource registers may break!
[ 0.000000] Allocating PCI resources starting at 100100000 (gap:
100100000:400000)
I''m running the same kernel on dom0 and domU.
I attached the .config, the dom0 kern.log, /var/log/xen/* and the domU
boot is inline below.
To unbind the PCI devices from dom0 I ran:
echo 0000:17:00.0 > /sys/bus/pci/drivers/pci-stub/unbind
echo 0000:14:00.0 > /sys/bus/pci/drivers/pci-stub/unbind
echo 0000:10:00.0 > /sys/bus/pci/drivers/pci-stub/unbind
echo 0000:0a:00.0 > /sys/bus/pci/drivers/pci-stub/unbind
echo 0000:07:00.0 > /sys/bus/pci/drivers/pci-stub/unbind
echo 11f8 8032 > /sys/bus/pci/drivers/pci-stub/new_id
echo 0000:07:00.0 > /sys/bus/pci/devices/0000:07:00.0/driver/unbind
echo 0000:07:00.0 > /sys/bus/pci/drivers/pci-stub/bind
echo 11f8 8032 > /sys/bus/pci/drivers/pci-stub/new_id
echo 0000:07:00.1 > /sys/bus/pci/devices/0000:07:00.1/driver/unbind
echo 0000:07:00.1 > /sys/bus/pci/drivers/pci-stub/bind
echo 11f8 8032 > /sys/bus/pci/drivers/pci-stub/new_id
echo 0000:07:00.2 > /sys/bus/pci/devices/0000:07:00.2/driver/unbind
echo 0000:07:00.2 > /sys/bus/pci/drivers/pci-stub/bind
echo 11f8 8032 > /sys/bus/pci/drivers/pci-stub/new_id
echo 0000:07:00.3 > /sys/bus/pci/devices/0000:07:00.3/driver/unbind
echo 0000:07:00.3 > /sys/bus/pci/drivers/pci-stub/bind
echo 11f8 8032 > /sys/bus/pci/drivers/pci-stub/new_id
echo 0000:0a:00.0 > /sys/bus/pci/devices/0000:0a:00.0/driver/unbind
echo 0000:0a:00.0 > /sys/bus/pci/drivers/pci-stub/bind
echo 11f8 8032 > /sys/bus/pci/drivers/pci-stub/new_id
echo 0000:0a:00.1 > /sys/bus/pci/devices/0000:0a:00.1/driver/unbind
echo 0000:0a:00.1 > /sys/bus/pci/drivers/pci-stub/bind
echo 11f8 8032 > /sys/bus/pci/drivers/pci-stub/new_id
echo 0000:10:00.0 > /sys/bus/pci/devices/0000:10:00.0/driver/unbind
echo 0000:10:00.0 > /sys/bus/pci/drivers/pci-stub/bind
echo 11f8 8032 > /sys/bus/pci/drivers/pci-stub/new_id
echo 0000:10:00.1 > /sys/bus/pci/devices/0000:10:00.1/driver/unbind
echo 0000:10:00.1 > /sys/bus/pci/drivers/pci-stub/bind
echo 11f8 8032 > /sys/bus/pci/drivers/pci-stub/new_id
echo 0000:10:00.2 > /sys/bus/pci/devices/0000:10:00.2/driver/unbind
echo 0000:10:00.2 > /sys/bus/pci/drivers/pci-stub/bind
echo 11f8 8032 > /sys/bus/pci/drivers/pci-stub/new_id
echo 0000:10:00.3 > /sys/bus/pci/devices/0000:10:00.3/driver/unbind
echo 0000:10:00.3 > /sys/bus/pci/drivers/pci-stub/bind
echo 11f8 8032 > /sys/bus/pci/drivers/pci-stub/new_id
echo 0000:14:00.0 > /sys/bus/pci/devices/0000:14:00.0/driver/unbind
echo 0000:14:00.0 > /sys/bus/pci/drivers/pci-stub/bind
echo 11f8 8032 > /sys/bus/pci/drivers/pci-stub/new_id
echo 0000:14:00.1 > /sys/bus/pci/devices/0000:14:00.1/driver/unbind
echo 0000:14:00.1 > /sys/bus/pci/drivers/pci-stub/bind
echo 11f8 8032 > /sys/bus/pci/drivers/pci-stub/new_id
echo 0000:17:00.0 > /sys/bus/pci/devices/0000:17:00.0/driver/unbind
echo 0000:17:00.0 > /sys/bus/pci/drivers/pci-stub/bind
echo 11f8 8032 > /sys/bus/pci/drivers/pci-stub/new_id
echo 0000:17:00.1 > /sys/bus/pci/devices/0000:17:00.1/driver/unbind
echo 0000:17:00.1 > /sys/bus/pci/drivers/pci-stub/bind
Here''s the domU boot log:
root = /dev/nfs
nfs_server = 135.149.75.134
nfs_root = /home/root,tcp
initrd = /import/root/boot/initrd.img-2.6.32.14.nfs
builder = linux
kernel
/import/kaan/bedge/dev_kaan_kernel.kaan.debug/root/boot/vmlinuz-2.6.32.14
memory = 4096
extra = root=/dev/nfs ip=dhcp raid=noautodetect
bigphysarea=128000 kdb=on nmi_watchdog=1 init_cpus=0 console=hvc0
pci = [''10:00.3@10'',
''10:00.2@11'', ''10:00.1@12'',
''10:00.0@13'', ''07:00.3@14'',
''07:00.2@15'', ''07:00.1@16'',
''07:00.0@17'',
''17:00.0@18'', ''17:00.1@19'',
''14:00.0@1a'', ''14:00.1@1b'',
''0a:00.0@1c'',
''0a:00.1@1d'']
vif = [''model=e1000, bridge=eth0,
mac=00:16:3e:00:22:01,vifname=vif-target'']
Started domain dpm (id=2)
[ 0.000000] Initializing cgroup subsys cpuset
[ 0.000000] Initializing cgroup subsys cpu
[ 0.000000] Linux version 2.6.32.14 (root@kaan) (gcc version 4.3.3
(Ubuntu 4.3.3-5ubuntu4) ) #1 SMP Thu Jun 10 09:10:45 PDT 2010
[ 0.000000] Command line:
nfsroot=135.149.75.134:/home/bedge/dev_kaan_kernel.kaan.debug/root,tcp
root=/dev/nfs ip=dhcp raid=noautodetect bigphysarea=128000 kdb=on
nmi_watchdog=1 init_cpus=0 console=hvc0
[ 0.000000] KERNEL supported cpus:
[ 0.000000] Intel GenuineIntel
[ 0.000000] AMD AuthenticAMD
[ 0.000000] Centaur CentaurHauls
[ 0.000000] ACPI in unprivileged domain disabled
[ 0.000000] released 0 pages of unused memory
[ 0.000000] BIOS-provided physical RAM map:
[ 0.000000] Xen: 0000000000000000 - 00000000000a0000 (usable)
[ 0.000000] Xen: 00000000000a0000 - 0000000000100000 (reserved)
[ 0.000000] Xen: 0000000000100000 - 0000000100000000 (usable)
[ 0.000000] DMI not present or invalid.
[ 0.000000] last_pfn = 0x100000 max_arch_pfn = 0x400000000
[ 0.000000] Scanning 1 areas for low memory corruption
[ 0.000000] modified physical RAM map:
[ 0.000000] modified: 0000000000000000 - 0000000000001000 (usable)
[ 0.000000] modified: 0000000000001000 - 0000000000006000 (reserved)
[ 0.000000] modified: 0000000000006000 - 00000000000a0000 (usable)
[ 0.000000] modified: 00000000000a0000 - 0000000000100000 (reserved)
[ 0.000000] modified: 0000000000100000 - 0000000100000000 (usable)
[ 0.000000] init_memory_mapping: 0000000000000000-0000000100000000
[ 0.000000] (6 early reservations) ==> bootmem [0000000000 - 0100000000]
[ 0.000000] #0 [0000000000 - 0000001000] BIOS data page ==>
[0000000000 - 0000001000]
[ 0.000000] #1 [00022b3000 - 00022c8000] XEN PAGETABLES ==>
[00022b3000 - 00022c8000]
[ 0.000000] #2 [0000006000 - 0000008000] TRAMPOLINE ==>
[0000006000 - 0000008000]
[ 0.000000] #3 [0001000000 - 0001a8fa08] TEXT DATA BSS ==>
[0001000000 - 0001a8fa08]
[ 0.000000] #4 [0001ab0000 - 00022b3000] XEN START INFO ==>
[0001ab0000 - 00022b3000]
[ 0.000000] #5 [0000100000 - 00008ed000] PGTABLE ==>
[0000100000 - 00008ed000]
[ 0.000000] Zone PFN ranges:
[ 0.000000] DMA 0x00000000 -> 0x00001000
[ 0.000000] DMA32 0x00001000 -> 0x00100000
[ 0.000000] Normal 0x00100000 -> 0x00100000
[ 0.000000] Movable zone start PFN for each node
[ 0.000000] early_node_map[3] active PFN ranges
[ 0.000000] 0: 0x00000000 -> 0x00000001
[ 0.000000] 0: 0x00000006 -> 0x000000a0
[ 0.000000] 0: 0x00000100 -> 0x00100000
[ 0.000000] SMP: Allowing 16 CPUs, 0 hotplug CPUs
[ 0.000000] No local APIC present
[ 0.000000] APIC: disable apic facility
[ 0.000000] PCI: Warning: Cannot find a gap in the 32bit address range
[ 0.000000] PCI: Unassigned devices with 32bit resource registers may break!
[ 0.000000] Allocating PCI resources starting at 100100000 (gap:
100100000:400000)
[ 0.000000] Booting paravirtualized kernel on Xen
[ 0.000000] Xen version: 4.0.1-rc3-pre (preserve-AD)
[ 0.000000] NR_CPUS:64 nr_cpumask_bits:64 nr_cpu_ids:16 nr_node_ids:1
[ 0.000000] PERCPU: Embedded 29 pages/cpu @ffff8800022e7000 s88536
r8192 d22056 u118784
[ 0.000000] pcpu-alloc: s88536 r8192 d22056 u118784 alloc=29*4096
[ 0.000000] pcpu-alloc: [0] 00 [0] 01 [0] 02 [0] 03 [0] 04 [0] 05
[0] 06 [0] 07
[ 0.000000] pcpu-alloc: [0] 08 [0] 09 [0] 10 [0] 11 [0] 12 [0] 13
[0] 14 [0] 15
[ 0.000000] Xen: using vcpu_info placement
[ 0.000000] Built 1 zonelists in Zone order, mobility grouping on.
Total pages: 1032107
[ 0.000000] Kernel command line:
nfsroot=135.149.75.134:/home/bedge/dev_kaan_kernel.kaan.debug/root,tcp
root=/dev/nfs ip=dhcp raid=noautodetect bigphysarea=128000 kdb=on
nmi_watchdog=1 init_cpus=0 console=hvc0
[ 0.000000] init_cpus[0]=1
[ 0.000000] setting init process cpumask to 1
[ 0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
[ 0.000000] Dentry cache hash table entries: 524288 (order: 10,
4194304 bytes)
[ 0.000000] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes)
[ 0.000000] Initializing CPU#0
[ 0.000000] Checking aperture...
[ 0.000000] No AGP bridge found
[ 0.000000] Memory: 4100524k/4194304k available (5628k kernel code,
404k absent, 92864k reserved, 3205k data, 608k init)
[ 0.000000] SLUB: Genslabs=13, HWalign=64, Order=0-3, MinObjects=0,
CPUs=16, Nodes=1
[ 0.000000] Hierarchical RCU implementation.
[ 0.000000] NR_IRQS:4352 nr_irqs:656
[ 0.000000] Console: colour dummy device 80x25
[ 0.000000] console [tty0] enabled
[ 0.000000] console [hvc0] enabled
[ 0.000000] allocated 41943040 bytes of page_cgroup
[ 0.000000] please try ''cgroup_disable=memory'' option if
you don''t
want memory cgroups
[ 0.000000] installing Xen timer for CPU 0
[ 0.000000] Detected 2533.490 MHz processor.
[ 0.010000] Calibrating delay loop (skipped), value calculated
using timer frequency.. 5066.98 BogoMIPS (lpj=25334900)
[ 0.010037] kdb version 4.4 by Keith Owens, Scott Lurndal.
Copyright SGI, All Rights Reserved
kdb_cmd[0]: defcmd archkdb "" "First line arch debugging"
kdb_cmd[8]: defcmd archkdbcpu "" "archkdb with only tasks on
cpus"
kdb_cmd[15]: defcmd archkdbshort "" "archkdb with less detailed
backtrace"
[ 0.010164] Security Framework initialized
[ 0.010175] SELinux: Disabled at boot.
[ 0.010185] Mount-cache hash table entries: 256
[ 0.010326] Initializing cgroup subsys ns
[ 0.010333] Initializing cgroup subsys cpuacct
[ 0.010339] Initializing cgroup subsys memory
[ 0.010350] Initializing cgroup subsys freezer
[ 0.010385] CPU: L1 I cache: 32K, L1 D cache: 32K
[ 0.010392] CPU: L2 cache: 256K
[ 0.010395] CPU: L3 cache: 8192K
[ 0.010401] CPU: Physical Processor ID: 0
[ 0.010404] CPU: Processor Core ID: 0
[ 0.010409] Performance Events: unsupported p6 CPU model 26 no PMU
driver, software events only.
[ 0.010428] SMP alternatives: switching to UP code
[ 0.020056] cpu 0 spinlock event irq 654
[ 0.020348] installing Xen timer for CPU 1
[ 0.020373] cpu 1 spinlock event irq 648
[ 0.020394] SMP alternatives: switching to SMP code
[ 0.000015] Initializing CPU#1
[ 0.000081] CPU: L1 I cache: 32K, L1 D cache: 32K
[ 0.000086] CPU: L2 cache: 256K
[ 0.000089] CPU: L3 cache: 8192K
[ 0.000094] CPU: Physical Processor ID: 0
[ 0.000097] CPU: Processor Core ID: 0
[ 0.030372] installing Xen timer for CPU 2
[ 0.030372] cpu 2 spinlock event irq 642
[ 0.000010] Initializing CPU#2
[ 0.000061] CPU: L1 I cache: 32K, L1 D cache: 32K
[ 0.000066] CPU: L2 cache: 256K
[ 0.000068] CPU: L3 cache: 8192K
[ 0.000074] CPU: Physical Processor ID: 0
[ 0.000076] CPU: Processor Core ID: 0
[ 0.030822] installing Xen timer for CPU 3
[ 0.030822] cpu 3 spinlock event irq 636
[ 0.000010] Initializing CPU#3
[ 0.000059] CPU: L1 I cache: 32K, L1 D cache: 32K
[ 0.000064] CPU: L2 cache: 256K
[ 0.000067] CPU: L3 cache: 8192K
[ 0.000072] CPU: Physical Processor ID: 0
[ 0.000075] CPU: Processor Core ID: 0
[ 0.031235] installing Xen timer for CPU 4
[ 0.031235] cpu 4 spinlock event irq 630
[ 0.000010] Initializing CPU#4
[ 0.000058] CPU: L1 I cache: 32K, L1 D cache: 32K
[ 0.000063] CPU: L2 cache: 256K
[ 0.000065] CPU: L3 cache: 8192K
[ 0.000071] CPU: Physical Processor ID: 0
[ 0.000074] CPU: Processor Core ID: 0
[ 0.031661] installing Xen timer for CPU 5
[ 0.170047] cpu 5 spinlock event irq 624
[ 0.000010] Initializing CPU#5
[ 0.000059] CPU: L1 I cache: 32K, L1 D cache: 32K
[ 0.000064] CPU: L2 cache: 256K
[ 0.000066] CPU: L3 cache: 8192K
[ 0.000072] CPU: Physical Processor ID: 0
[ 0.000074] CPU: Processor Core ID: 0
[ 0.174685] installing Xen timer for CPU 6
[ 0.174685] cpu 6 spinlock event irq 618
[ 0.000009] Initializing CPU#6
[ 0.000056] CPU: L1 I cache: 32K, L1 D cache: 32K
[ 0.000060] CPU: L2 cache: 256K
[ 0.000062] CPU: L3 cache: 8192K
[ 0.000067] CPU: Physical Processor ID: 0
[ 0.000069] CPU: Processor Core ID: 0
[ 0.175143] installing Xen timer for CPU 7
[ 0.175143] cpu 7 spinlock event irq 612
[ 0.000010] Initializing CPU#7
[ 0.000059] CPU: L1 I cache: 32K, L1 D cache: 32K
[ 0.000064] CPU: L2 cache: 256K
[ 0.000067] CPU: L3 cache: 8192K
[ 0.000072] CPU: Physical Processor ID: 0
[ 0.000075] CPU: Processor Core ID: 0
[ 0.175606] installing Xen timer for CPU 8
[ 0.175606] cpu 8 spinlock event irq 606
[ 0.000009] Initializing CPU#8
[ 0.000055] CPU: L1 I cache: 32K, L1 D cache: 32K
[ 0.000059] CPU: L2 cache: 256K
[ 0.000061] CPU: L3 cache: 8192K
[ 0.000065] CPU: Physical Processor ID: 0
[ 0.000068] CPU: Processor Core ID: 0
[ 0.176088] installing Xen timer for CPU 9
[ 0.176088] cpu 9 spinlock event irq 600
[ 0.000008] Initializing CPU#9
[ 0.000055] CPU: L1 I cache: 32K, L1 D cache: 32K
[ 0.000060] CPU: L2 cache: 256K
[ 0.000063] CPU: L3 cache: 8192K
[ 0.000068] CPU: Physical Processor ID: 0
[ 0.000071] CPU: Processor Core ID: 0
[ 0.176599] installing Xen timer for CPU 10
[ 0.176599] cpu 10 spinlock event irq 594
[ 0.000008] Initializing CPU#10
[ 0.000053] CPU: L1 I cache: 32K, L1 D cache: 32K
[ 0.000058] CPU: L2 cache: 256K
[ 0.000060] CPU: L3 cache: 8192K
[ 0.000065] CPU: Physical Processor ID: 0
[ 0.000068] CPU: Processor Core ID: 0
[ 0.177066] installing Xen timer for CPU 11
[ 0.177066] cpu 11 spinlock event irq 588
[ 0.000009] Initializing CPU#11
[ 0.000055] CPU: L1 I cache: 32K, L1 D cache: 32K
[ 0.000060] CPU: L2 cache: 256K
[ 0.000063] CPU: L3 cache: 8192K
[ 0.000068] CPU: Physical Processor ID: 0
[ 0.000071] CPU: Processor Core ID: 0
[ 0.177529] installing Xen timer for CPU 12
[ 0.177529] cpu 12 spinlock event irq 582
[ 0.000008] Initializing CPU#12
[ 0.000052] CPU: L1 I cache: 32K, L1 D cache: 32K
[ 0.000056] CPU: L2 cache: 256K
[ 0.000058] CPU: L3 cache: 8192K
[ 0.000063] CPU: Physical Processor ID: 0
[ 0.000065] CPU: Processor Core ID: 0
[ 0.177982] installing Xen timer for CPU 13
[ 0.177982] cpu 13 spinlock event irq 576
[ 0.000009] Initializing CPU#13
[ 0.000055] CPU: L1 I cache: 32K, L1 D cache: 32K
[ 0.000060] CPU: L2 cache: 256K
[ 0.000062] CPU: L3 cache: 8192K
[ 0.000068] CPU: Physical Processor ID: 0
[ 0.000070] CPU: Processor Core ID: 0
[ 0.178445] installing Xen timer for CPU 14
[ 0.178445] cpu 14 spinlock event irq 570
[ 0.000008] Initializing CPU#14
[ 0.000056] CPU: L1 I cache: 32K, L1 D cache: 32K
[ 0.000060] CPU: L2 cache: 256K
[ 0.000062] CPU: L3 cache: 8192K
[ 0.000067] CPU: Physical Processor ID: 0
[ 0.000069] CPU: Processor Core ID: 0
[ 0.178896] installing Xen timer for CPU 15
[ 0.178896] cpu 15 spinlock event irq 564
[ 0.000009] Initializing CPU#15
[ 0.000055] CPU: L1 I cache: 32K, L1 D cache: 32K
[ 0.000060] CPU: L2 cache: 256K
[ 0.000063] CPU: L3 cache: 8192K
[ 0.000068] CPU: Physical Processor ID: 0
[ 0.000071] CPU: Processor Core ID: 0
[ 0.178896] Brought up 16 CPUs
[ 0.182662] Grant table initialized
[ 0.182671] regulator: core version 0.5
[ 0.182755] NET: Registered protocol family 16
[ 0.185945] PCI: setting up Xen PCI frontend stub
[ 0.189397] bio: create slab <bio-0> at 0
[ 0.190440] ACPI: Interpreter disabled.
[ 0.193793] xen_balloon: Initialising balloon driver with page order 0.
[ 0.194019] vgaarb: loaded
[ 0.194019] SCSI subsystem initialized
[ 0.195724] usbcore: registered new interface driver usbfs
[ 0.195724] usbcore: registered new interface driver hub
[ 0.195865] usbcore: registered new device driver usb
[ 0.195962] PCI: System does not support PCI
[ 0.195962] PCI: System does not support PCI
[ 0.195962] NetLabel: Initializing
[ 0.195962] NetLabel: domain hash size = 128
[ 0.195962] NetLabel: protocols = UNLABELED CIPSOv4
[ 0.195962] NetLabel: unlabeled traffic allowed by default
[ 0.195962] Switching to clocksource xen
[ 0.197558] pnp: PnP ACPI: disabled
[ 0.197558] NET: Registered protocol family 2
[ 0.197558] IP route cache hash table entries: 131072 (order: 8,
1048576 bytes)
[ 0.197558] TCP established hash table entries: 262144 (order: 10,
4194304 bytes)
[ 0.197558] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[ 0.197558] TCP: Hash tables configured (established 262144 bind 65536)
[ 0.202508] TCP reno registered
[ 0.377078] NET: Registered protocol family 1
[ 0.378157] RPC: Registered udp transport module.
[ 0.378157] RPC: Registered tcp transport module.
[ 0.378157] RPC: Registered tcp NFSv4.1 backchannel transport module.
[ 0.378318] platform rtc_cmos: registered platform RTC device (no
PNP device found)
[ 0.379715] Scanning for low memory corruption every 60 seconds
[ 0.380152] audit: initializing netlink socket (disabled)
[ 0.380171] type=2000 audit(1276184586.557:1): initialized
[ 0.387843] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[ 0.390344] VFS: Disk quotas dquot_6.5.2
[ 0.390446] Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[ 0.391143] Installing knfsd (copyright (C) 1996 okir@monad.swb.de).
[ 0.391355] fuse init (API version 7.13)
[ 0.391449] msgmni has been set to 8009
[ 0.392802] alg: No test for stdrng (krng)
[ 0.392816] io scheduler noop registered
[ 0.392816] io scheduler anticipatory registered
[ 0.392816] io scheduler deadline registered (default)
[ 0.392816] io scheduler cfq registered
[ 0.392922] pci_hotplug: PCI Hot Plug PCI Core version: 0.5
[ 0.392952] pciehp: PCI Express Hot Plug Controller Driver version: 0.4
[ 0.392971] pci-stub: invalid id string ""
[ 0.413634] Event-channel device installed.
[ 0.415727] blktap_device_init: blktap device major 253
[ 0.415738] blktap_ring_init: blktap ring major: 254
[ 0.423053] registering netback
[ 0.423122] xen-platform-pcifailed backend handshake: unrecognised
magic value
[ 0.425494] brd: module loaded
[ 0.426026] loop: module loaded
[ 0.426147] Initialising Xen virtual ethernet driver.
[ 0.427868] pcifront pci-0: backend going away!
[ 0.444704] ehci_hcd: USB 2.0 ''Enhanced'' Host Controller
(EHCI) Driver
[ 0.444704] ohci_hcd: USB 1.1 ''Open'' Host Controller (OHCI)
Driver
[ 0.444704] uhci_hcd: USB Universal Host Controller Interface driver
[ 0.444704] usbcore: registered new interface driver usblp
[ 0.444704] Initializing USB Mass Storage driver...
[ 0.444704] usbcore: registered new interface driver usb-storage
[ 0.444704] USB Mass Storage support registered.
[ 0.444704] usbcore: registered new interface driver libusual
[ 0.444704] PNP: No PS/2 controller found. Probing ports directly.
[ 0.445167] i8042.c: No controller found.
[ 0.445203] mice: PS/2 mouse device common for all mice
[ 0.445291] input: PC Speaker as /devices/platform/pcspkr/input/input0
[ 0.445433] device-mapper: uevent: version 1.0.3
[ 0.446132] device-mapper: ioctl: 4.15.0-ioctl (2009-04-01)
initialised: dm-devel@redhat.com
[ 0.450190] device-mapper: multipath: version 1.1.0 loaded
[ 0.450198] device-mapper: multipath round-robin: version 1.0.0 loaded
[ 0.451549] cpuidle: using governor ladder
[ 0.517849] TCP cubic registered
[ 0.518035] NET: Registered protocol family 10
[ 0.519184] lo: Disabled Privacy Extensions
[ 0.520961] NET: Registered protocol family 17
[ 0.521084] registered taskstats version 1
[ 0.521178] XENBUS: Device with no driver: device/console/0
[ 0.521197] BIOS EDD facility v0.16 2004-Jun-25, 0 devices found
[ 0.521203] EDD information not available.
[ 2.040051] Sending DHCP requests ., OK
[ 2.120041] IP-Config: Got DHCP answer from 135.149.78.198, my
address is 135.149.77.123
[ 2.120602] IP-Config: Complete:
[ 2.120609] device=eth0, addr=135.149.77.123,
mask=255.255.252.0, gw=135.149.76.1,
[ 2.120629] host=target, domain=XXXX, nis-domain=(none),
[ 2.120637] bootserver=135.149.78.198, rootserver=135.149.75.134
[ 2.120695] md: Skipping autodetection of RAID arrays.
(raid=autodetect will force)
[ 2.120760] Looking up port of RPC 100003/2 on 135.149.75.134
[ 2.131876] Looking up port of RPC 100005/1 on 135.149.75.134
[ 2.148520] VFS: Mounted root (nfs filesystem) on device 0:14.
[ 2.148697] Freeing unused kernel memory: 608k freed
[ 2.148896] Write protecting the kernel read-only data: 8156k
* Setting hostname to ''target''...
[ OK ]
* Setting preliminary keymap... [ OK ]
* Starting kernel event manager... [ OK ]
* Loading hardware drivers...
[ 4.818275] rtc_cmos rtc_cmos: rtc core: registered
rtc_cmos as rtc0
[ OK ]
* Loading manual drivers...
* Setting kernel variables (/etc/sysctl.conf)...
[ OK ]
* Setting kernel variables
(/etc/sysctl.d/10-console-messages.conf)... kernel.printk = 4
4 1 7
[ OK ]
* Setting kernel variables
(/etc/sysctl.d/10-network-security.conf)...
net.ipv4.conf.default.rp_filter = 1
net.ipv4.conf.all.rp_filter = 1
net.ipv4.tcp_syncookies = 1
[ OK ]
* Activating swap [ OK ]
* Will now check all file systems
fsck 1.41.4 (27-Jan-2009)
Checking all file systems.
* Done checking file systems.
A log is being saved in /var/log/fsck/checkfs if that location is writable.
* Enable login on console [ OK ]
* Will now mount local filesystems [ OK ]
* Will now activate swapfile swap [ OK ]
* Check for hostname changes... [ OK ]
* Get hostname from DNS
* Configuring network interfaces... [ OK ]
* Starting portmap daemon... [ OK ]
* Starting NFS common utilities [ OK ]
* Setting up console font and keymap... [ OK ]
* Initializing random number generator... [ OK ]
* Setting up X server socket directory /tmp/.X11-unix... [ OK ]
* Setting up ICE socket directory /tmp/.ICE-unix... [ OK ]
* Starting system logging syslog-ng [ OK ]
* Starting system message bus dbus [ OK ]
* Starting OpenBSD Secure Shell server sshd [ OK ]
* Starting NFS common utilities [ OK ]
* Starting internet superserver inetd [ OK ]
* Setting sysfs variables... [ OK ]
* Starting ipmi drivers [ OK ]
* Starting deferred execution scheduler atd [ OK ]
* Starting periodic command scheduler crond [ OK ]
* Running local boot scripts (/etc/rc.local) [ OK ]
-Bruce
_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xensource.com
http://lists.xensource.com/xen-devel
Pasi Kärkkäinen
2010-Jun-11 06:09 UTC
Re: [Xen-devel] PCI devices missing from domU in pv kernel, hvm OK.
On Thu, Jun 10, 2010 at 04:25:54PM -0700, Bruce Edge wrote:> I had hvm domU working fine. This problem is specific to my pv-ops > config. I''m not seeing any PCI devices after I bring up the domU. I > was able to get this working as an hvm instance, but not pv. > I''d appreciate if anyone could offer some insight as to why I can''t > see the PCI devices in domU. > > I''ve gone through these > http://wiki.xensource.com/xenwiki/XenPCIpassthrough >It seems you''re missing the required kernel parameters for the domU kernel.. They''re described on that wiki page.> > Here''s the domU boot log: > root = /dev/nfs > nfs_server = 135.149.75.134 > nfs_root = /home/root,tcp > initrd = /import/root/boot/initrd.img-2.6.32.14.nfs > builder = linux > kernel > /import/kaan/bedge/dev_kaan_kernel.kaan.debug/root/boot/vmlinuz-2.6.32.14 > memory = 4096 > extra = root=/dev/nfs ip=dhcp raid=noautodetect > bigphysarea=128000 kdb=on nmi_watchdog=1 init_cpus=0 console=hvc0> [ 0.000000] Command line: > nfsroot=135.149.75.134:/home/bedge/dev_kaan_kernel.kaan.debug/root,tcp > root=/dev/nfs ip=dhcp raid=noautodetect bigphysarea=128000 kdb=on > nmi_watchdog=1 init_cpus=0 console=hvc0 >-- Pasi _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Sander Eikelenboom
2010-Jun-11 07:12 UTC
Re: [Xen-devel] PCI devices missing from domU in pv kernel, hvm OK.
Hi Bruce, You echo to pci-stub (/sys/bus/pci/drivers/pci-stub/new_id), for what i know that only works for HVM''s and Qemu handling the passthrough. For PV domains you should use xen-pciback (should work for HVM''s as well). -- Sander Friday, June 11, 2010, 1:25:54 AM, you wrote:> I had hvm domU working fine. This problem is specific to my pv-ops > config. I''m not seeing any PCI devices after I bring up the domU. I > was able to get this working as an hvm instance, but not pv. > I''d appreciate if anyone could offer some insight as to why I can''t > see the PCI devices in domU.> I''ve gone through these > http://wiki.xensource.com/xenwiki/XenPCIpassthrough> I sync''d up with Jeremy''s 2.6.32x tree and xen 4.0.1-rc3.pre current > as of today. > The hardware is a proliant G5 (intel X58 chipset) with dual i7''s.> The dom0 shows these devices available: > xm pci-list-assignable-devices > 0000:17:00.0 > 0000:17:00.1 > 0000:14:00.0 > 0000:14:00.1 > 0000:10:00.0 > 0000:10:00.1 > 0000:10:00.2 > 0000:10:00.3 > 0000:0a:00.0 > 0000:0a:00.1 > 0000:07:00.0 > 0000:07:00.1 > 0000:07:00.2 > 0000:07:00.3> but the domU see''s nothing: > ~# lspci > ~#> Are there any boot options that need to change from hvm to pv > regarding pci passthrough/iommu settings? > I''m using:> menuentry "Xen osa-dom0 6.0.14-01, linux 2.6.32.15" { > multiboot /boot/xen.gz dummy=dummy console=com1 115200,8n1 > dom0_mem=512M dom0_max_vcpus=1 dom0_vcpus_pin=true > iommu=1,passthrough,no-intremap loglvl=all loglvl_guest=all loglevl=10 > debug acpi=force apic=on apic_verbosity=verbose numa=on > extra_guest_irqs=80 > module /boot/vmlinuz-2.6.32.15 > root=UUID=89eb87f0-58af-47e0-a1e4-dfbbac9e57bf ro earlyprintk=xen > loglevel=10 debug acpi=force console=hvc0,115200n8 > module /boot/initrd.img-2.6.32.15 /boot/initrd.img-2.6.32.15> Are these messages from the domU boot significant?> [ 0.000000] No local APIC present > [ 0.000000] APIC: disable apic facility > [ 0.000000] PCI: Warning: Cannot find a gap in the 32bit address range > [ 0.000000] PCI: Unassigned devices with 32bit resource registers may break! > [ 0.000000] Allocating PCI resources starting at 100100000 (gap: > 100100000:400000)> I''m running the same kernel on dom0 and domU. > I attached the .config, the dom0 kern.log, /var/log/xen/* and the domU > boot is inline below.> To unbind the PCI devices from dom0 I ran:echo 0000:17:00.0 >> /sys/bus/pci/drivers/pci-stub/unbind echo 0000:14:00.0 >> /sys/bus/pci/drivers/pci-stub/unbind echo 0000:10:00.0 >> /sys/bus/pci/drivers/pci-stub/unbind echo 0000:0a:00.0 >> /sys/bus/pci/drivers/pci-stub/unbind echo 0000:07:00.0 >> /sys/bus/pci/drivers/pci-stub/unbind echo 11f8 8032 >> /sys/bus/pci/drivers/pci-stub/new_id echo 0000:07:00.0 >> /sys/bus/pci/devices/0000:07:00.0/driver/unbind echo 0000:07:00.0 >> /sys/bus/pci/drivers/pci-stub/bind echo 11f8 8032 >> /sys/bus/pci/drivers/pci-stub/new_id echo 0000:07:00.1 >> /sys/bus/pci/devices/0000:07:00.1/driver/unbind echo 0000:07:00.1 >> /sys/bus/pci/drivers/pci-stub/bind echo 11f8 8032 >> /sys/bus/pci/drivers/pci-stub/new_id echo 0000:07:00.2 >> /sys/bus/pci/devices/0000:07:00.2/driver/unbind echo 0000:07:00.2 >> /sys/bus/pci/drivers/pci-stub/bind echo 11f8 8032 >> /sys/bus/pci/drivers/pci-stub/new_id echo 0000:07:00.3 >> /sys/bus/pci/devices/0000:07:00.3/driver/unbind echo 0000:07:00.3 >> /sys/bus/pci/drivers/pci-stub/bind echo 11f8 8032 >> /sys/bus/pci/drivers/pci-stub/new_id echo 0000:0a:00.0 >> /sys/bus/pci/devices/0000:0a:00.0/driver/unbind echo 0000:0a:00.0 >> /sys/bus/pci/drivers/pci-stub/bind echo 11f8 8032 >> /sys/bus/pci/drivers/pci-stub/new_id echo 0000:0a:00.1 >> /sys/bus/pci/devices/0000:0a:00.1/driver/unbind echo 0000:0a:00.1 >> /sys/bus/pci/drivers/pci-stub/bind echo 11f8 8032 >> /sys/bus/pci/drivers/pci-stub/new_id echo 0000:10:00.0 >> /sys/bus/pci/devices/0000:10:00.0/driver/unbind echo 0000:10:00.0 >> /sys/bus/pci/drivers/pci-stub/bind echo 11f8 8032 >> /sys/bus/pci/drivers/pci-stub/new_id echo 0000:10:00.1 >> /sys/bus/pci/devices/0000:10:00.1/driver/unbind echo 0000:10:00.1 >> /sys/bus/pci/drivers/pci-stub/bind echo 11f8 8032 >> /sys/bus/pci/drivers/pci-stub/new_id echo 0000:10:00.2 >> /sys/bus/pci/devices/0000:10:00.2/driver/unbind echo 0000:10:00.2 >> /sys/bus/pci/drivers/pci-stub/bind echo 11f8 8032 >> /sys/bus/pci/drivers/pci-stub/new_id echo 0000:10:00.3 >> /sys/bus/pci/devices/0000:10:00.3/driver/unbind echo 0000:10:00.3 >> /sys/bus/pci/drivers/pci-stub/bind echo 11f8 8032 >> /sys/bus/pci/drivers/pci-stub/new_id echo 0000:14:00.0 >> /sys/bus/pci/devices/0000:14:00.0/driver/unbind echo 0000:14:00.0 >> /sys/bus/pci/drivers/pci-stub/bind echo 11f8 8032 >> /sys/bus/pci/drivers/pci-stub/new_id echo 0000:14:00.1 >> /sys/bus/pci/devices/0000:14:00.1/driver/unbind echo 0000:14:00.1 >> /sys/bus/pci/drivers/pci-stub/bind echo 11f8 8032 >> /sys/bus/pci/drivers/pci-stub/new_id echo 0000:17:00.0 >> /sys/bus/pci/devices/0000:17:00.0/driver/unbind echo 0000:17:00.0 >> /sys/bus/pci/drivers/pci-stub/bind echo 11f8 8032 >> /sys/bus/pci/drivers/pci-stub/new_id echo 0000:17:00.1 >> /sys/bus/pci/devices/0000:17:00.1/driver/unbind echo 0000:17:00.1 >> /sys/bus/pci/drivers/pci-stub/bind> Here''s the domU boot log: > root = /dev/nfs > nfs_server = 135.149.75.134 > nfs_root = /home/root,tcp > initrd = /import/root/boot/initrd.img-2.6.32.14.nfs > builder = linux > kernel > /import/kaan/bedge/dev_kaan_kernel.kaan.debug/root/boot/vmlinuz-2.6.32.14 > memory = 4096 > extra = root=/dev/nfs ip=dhcp raid=noautodetect > bigphysarea=128000 kdb=on nmi_watchdog=1 init_cpus=0 console=hvc0 > pci = [''10:00.3@10'', ''10:00.2@11'', ''10:00.1@12'', > ''10:00.0@13'', ''07:00.3@14'', ''07:00.2@15'', ''07:00.1@16'', ''07:00.0@17'', > ''17:00.0@18'', ''17:00.1@19'', ''14:00.0@1a'', ''14:00.1@1b'', ''0a:00.0@1c'', > ''0a:00.1@1d''] > vif = [''model=e1000, bridge=eth0, > mac=00:16:3e:00:22:01,vifname=vif-target''] > Started domain dpm (id=2) > [ 0.000000] Initializing cgroup subsys cpuset > [ 0.000000] Initializing cgroup subsys cpu > [ 0.000000] Linux version 2.6.32.14 (root@kaan) (gcc version 4.3.3 > (Ubuntu 4.3.3-5ubuntu4) ) #1 SMP Thu Jun 10 09:10:45 PDT 2010 > [ 0.000000] Command line: > nfsroot=135.149.75.134:/home/bedge/dev_kaan_kernel.kaan.debug/root,tcp > root=/dev/nfs ip=dhcp raid=noautodetect bigphysarea=128000 kdb=on > nmi_watchdog=1 init_cpus=0 console=hvc0 > [ 0.000000] KERNEL supported cpus: > [ 0.000000] Intel GenuineIntel > [ 0.000000] AMD AuthenticAMD > [ 0.000000] Centaur CentaurHauls > [ 0.000000] ACPI in unprivileged domain disabled > [ 0.000000] released 0 pages of unused memory > [ 0.000000] BIOS-provided physical RAM map: > [ 0.000000] Xen: 0000000000000000 - 00000000000a0000 (usable) > [ 0.000000] Xen: 00000000000a0000 - 0000000000100000 (reserved) > [ 0.000000] Xen: 0000000000100000 - 0000000100000000 (usable) > [ 0.000000] DMI not present or invalid. > [ 0.000000] last_pfn = 0x100000 max_arch_pfn = 0x400000000 > [ 0.000000] Scanning 1 areas for low memory corruption > [ 0.000000] modified physical RAM map: > [ 0.000000] modified: 0000000000000000 - 0000000000001000 (usable) > [ 0.000000] modified: 0000000000001000 - 0000000000006000 (reserved) > [ 0.000000] modified: 0000000000006000 - 00000000000a0000 (usable) > [ 0.000000] modified: 00000000000a0000 - 0000000000100000 (reserved) > [ 0.000000] modified: 0000000000100000 - 0000000100000000 (usable) > [ 0.000000] init_memory_mapping: 0000000000000000-0000000100000000 > [ 0.000000] (6 early reservations) ==> bootmem [0000000000 - 0100000000] > [ 0.000000] #0 [0000000000 - 0000001000] BIOS data page ==> > [0000000000 - 0000001000] > [ 0.000000] #1 [00022b3000 - 00022c8000] XEN PAGETABLES ==> > [00022b3000 - 00022c8000] > [ 0.000000] #2 [0000006000 - 0000008000] TRAMPOLINE ==> > [0000006000 - 0000008000] > [ 0.000000] #3 [0001000000 - 0001a8fa08] TEXT DATA BSS ==> > [0001000000 - 0001a8fa08] > [ 0.000000] #4 [0001ab0000 - 00022b3000] XEN START INFO ==> > [0001ab0000 - 00022b3000] > [ 0.000000] #5 [0000100000 - 00008ed000] PGTABLE ==> > [0000100000 - 00008ed000] > [ 0.000000] Zone PFN ranges: > [ 0.000000] DMA 0x00000000 -> 0x00001000 > [ 0.000000] DMA32 0x00001000 -> 0x00100000 > [ 0.000000] Normal 0x00100000 -> 0x00100000 > [ 0.000000] Movable zone start PFN for each node > [ 0.000000] early_node_map[3] active PFN ranges > [ 0.000000] 0: 0x00000000 -> 0x00000001 > [ 0.000000] 0: 0x00000006 -> 0x000000a0 > [ 0.000000] 0: 0x00000100 -> 0x00100000 > [ 0.000000] SMP: Allowing 16 CPUs, 0 hotplug CPUs > [ 0.000000] No local APIC present > [ 0.000000] APIC: disable apic facility > [ 0.000000] PCI: Warning: Cannot find a gap in the 32bit address range > [ 0.000000] PCI: Unassigned devices with 32bit resource registers may break! > [ 0.000000] Allocating PCI resources starting at 100100000 (gap: > 100100000:400000) > [ 0.000000] Booting paravirtualized kernel on Xen > [ 0.000000] Xen version: 4.0.1-rc3-pre (preserve-AD) > [ 0.000000] NR_CPUS:64 nr_cpumask_bits:64 nr_cpu_ids:16 nr_node_ids:1 > [ 0.000000] PERCPU: Embedded 29 pages/cpu @ffff8800022e7000 s88536 > r8192 d22056 u118784 > [ 0.000000] pcpu-alloc: s88536 r8192 d22056 u118784 alloc=29*4096 > [ 0.000000] pcpu-alloc: [0] 00 [0] 01 [0] 02 [0] 03 [0] 04 [0] 05 > [0] 06 [0] 07 > [ 0.000000] pcpu-alloc: [0] 08 [0] 09 [0] 10 [0] 11 [0] 12 [0] 13 > [0] 14 [0] 15 > [ 0.000000] Xen: using vcpu_info placement > [ 0.000000] Built 1 zonelists in Zone order, mobility grouping on. > Total pages: 1032107 > [ 0.000000] Kernel command line: > nfsroot=135.149.75.134:/home/bedge/dev_kaan_kernel.kaan.debug/root,tcp > root=/dev/nfs ip=dhcp raid=noautodetect bigphysarea=128000 kdb=on > nmi_watchdog=1 init_cpus=0 console=hvc0 > [ 0.000000] init_cpus[0]=1 > [ 0.000000] setting init process cpumask to 1 > [ 0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes) > [ 0.000000] Dentry cache hash table entries: 524288 (order: 10, > 4194304 bytes) > [ 0.000000] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes) > [ 0.000000] Initializing CPU#0 > [ 0.000000] Checking aperture... > [ 0.000000] No AGP bridge found > [ 0.000000] Memory: 4100524k/4194304k available (5628k kernel code, > 404k absent, 92864k reserved, 3205k data, 608k init) > [ 0.000000] SLUB: Genslabs=13, HWalign=64, Order=0-3, MinObjects=0, > CPUs=16, Nodes=1 > [ 0.000000] Hierarchical RCU implementation. > [ 0.000000] NR_IRQS:4352 nr_irqs:656 > [ 0.000000] Console: colour dummy device 80x25 > [ 0.000000] console [tty0] enabled > [ 0.000000] console [hvc0] enabled > [ 0.000000] allocated 41943040 bytes of page_cgroup > [ 0.000000] please try ''cgroup_disable=memory'' option if you don''t > want memory cgroups > [ 0.000000] installing Xen timer for CPU 0 > [ 0.000000] Detected 2533.490 MHz processor. > [ 0.010000] Calibrating delay loop (skipped), value calculated > using timer frequency.. 5066.98 BogoMIPS (lpj=25334900) > [ 0.010037] kdb version 4.4 by Keith Owens, Scott Lurndal. > Copyright SGI, All Rights Reserved > kdb_cmd[0]: defcmd archkdb "" "First line arch debugging" > kdb_cmd[8]: defcmd archkdbcpu "" "archkdb with only tasks on cpus" > kdb_cmd[15]: defcmd archkdbshort "" "archkdb with less detailed backtrace" > [ 0.010164] Security Framework initialized > [ 0.010175] SELinux: Disabled at boot. > [ 0.010185] Mount-cache hash table entries: 256 > [ 0.010326] Initializing cgroup subsys ns > [ 0.010333] Initializing cgroup subsys cpuacct > [ 0.010339] Initializing cgroup subsys memory > [ 0.010350] Initializing cgroup subsys freezer > [ 0.010385] CPU: L1 I cache: 32K, L1 D cache: 32K > [ 0.010392] CPU: L2 cache: 256K > [ 0.010395] CPU: L3 cache: 8192K > [ 0.010401] CPU: Physical Processor ID: 0 > [ 0.010404] CPU: Processor Core ID: 0 > [ 0.010409] Performance Events: unsupported p6 CPU model 26 no PMU > driver, software events only. > [ 0.010428] SMP alternatives: switching to UP code > [ 0.020056] cpu 0 spinlock event irq 654 > [ 0.020348] installing Xen timer for CPU 1 > [ 0.020373] cpu 1 spinlock event irq 648 > [ 0.020394] SMP alternatives: switching to SMP code > [ 0.000015] Initializing CPU#1 > [ 0.000081] CPU: L1 I cache: 32K, L1 D cache: 32K > [ 0.000086] CPU: L2 cache: 256K > [ 0.000089] CPU: L3 cache: 8192K > [ 0.000094] CPU: Physical Processor ID: 0 > [ 0.000097] CPU: Processor Core ID: 0 > [ 0.030372] installing Xen timer for CPU 2 > [ 0.030372] cpu 2 spinlock event irq 642 > [ 0.000010] Initializing CPU#2 > [ 0.000061] CPU: L1 I cache: 32K, L1 D cache: 32K > [ 0.000066] CPU: L2 cache: 256K > [ 0.000068] CPU: L3 cache: 8192K > [ 0.000074] CPU: Physical Processor ID: 0 > [ 0.000076] CPU: Processor Core ID: 0 > [ 0.030822] installing Xen timer for CPU 3 > [ 0.030822] cpu 3 spinlock event irq 636 > [ 0.000010] Initializing CPU#3 > [ 0.000059] CPU: L1 I cache: 32K, L1 D cache: 32K > [ 0.000064] CPU: L2 cache: 256K > [ 0.000067] CPU: L3 cache: 8192K > [ 0.000072] CPU: Physical Processor ID: 0 > [ 0.000075] CPU: Processor Core ID: 0 > [ 0.031235] installing Xen timer for CPU 4 > [ 0.031235] cpu 4 spinlock event irq 630 > [ 0.000010] Initializing CPU#4 > [ 0.000058] CPU: L1 I cache: 32K, L1 D cache: 32K > [ 0.000063] CPU: L2 cache: 256K > [ 0.000065] CPU: L3 cache: 8192K > [ 0.000071] CPU: Physical Processor ID: 0 > [ 0.000074] CPU: Processor Core ID: 0 > [ 0.031661] installing Xen timer for CPU 5 > [ 0.170047] cpu 5 spinlock event irq 624 > [ 0.000010] Initializing CPU#5 > [ 0.000059] CPU: L1 I cache: 32K, L1 D cache: 32K > [ 0.000064] CPU: L2 cache: 256K > [ 0.000066] CPU: L3 cache: 8192K > [ 0.000072] CPU: Physical Processor ID: 0 > [ 0.000074] CPU: Processor Core ID: 0 > [ 0.174685] installing Xen timer for CPU 6 > [ 0.174685] cpu 6 spinlock event irq 618 > [ 0.000009] Initializing CPU#6 > [ 0.000056] CPU: L1 I cache: 32K, L1 D cache: 32K > [ 0.000060] CPU: L2 cache: 256K > [ 0.000062] CPU: L3 cache: 8192K > [ 0.000067] CPU: Physical Processor ID: 0 > [ 0.000069] CPU: Processor Core ID: 0 > [ 0.175143] installing Xen timer for CPU 7 > [ 0.175143] cpu 7 spinlock event irq 612 > [ 0.000010] Initializing CPU#7 > [ 0.000059] CPU: L1 I cache: 32K, L1 D cache: 32K > [ 0.000064] CPU: L2 cache: 256K > [ 0.000067] CPU: L3 cache: 8192K > [ 0.000072] CPU: Physical Processor ID: 0 > [ 0.000075] CPU: Processor Core ID: 0 > [ 0.175606] installing Xen timer for CPU 8 > [ 0.175606] cpu 8 spinlock event irq 606 > [ 0.000009] Initializing CPU#8 > [ 0.000055] CPU: L1 I cache: 32K, L1 D cache: 32K > [ 0.000059] CPU: L2 cache: 256K > [ 0.000061] CPU: L3 cache: 8192K > [ 0.000065] CPU: Physical Processor ID: 0 > [ 0.000068] CPU: Processor Core ID: 0 > [ 0.176088] installing Xen timer for CPU 9 > [ 0.176088] cpu 9 spinlock event irq 600 > [ 0.000008] Initializing CPU#9 > [ 0.000055] CPU: L1 I cache: 32K, L1 D cache: 32K > [ 0.000060] CPU: L2 cache: 256K > [ 0.000063] CPU: L3 cache: 8192K > [ 0.000068] CPU: Physical Processor ID: 0 > [ 0.000071] CPU: Processor Core ID: 0 > [ 0.176599] installing Xen timer for CPU 10 > [ 0.176599] cpu 10 spinlock event irq 594 > [ 0.000008] Initializing CPU#10 > [ 0.000053] CPU: L1 I cache: 32K, L1 D cache: 32K > [ 0.000058] CPU: L2 cache: 256K > [ 0.000060] CPU: L3 cache: 8192K > [ 0.000065] CPU: Physical Processor ID: 0 > [ 0.000068] CPU: Processor Core ID: 0 > [ 0.177066] installing Xen timer for CPU 11 > [ 0.177066] cpu 11 spinlock event irq 588 > [ 0.000009] Initializing CPU#11 > [ 0.000055] CPU: L1 I cache: 32K, L1 D cache: 32K > [ 0.000060] CPU: L2 cache: 256K > [ 0.000063] CPU: L3 cache: 8192K > [ 0.000068] CPU: Physical Processor ID: 0 > [ 0.000071] CPU: Processor Core ID: 0 > [ 0.177529] installing Xen timer for CPU 12 > [ 0.177529] cpu 12 spinlock event irq 582 > [ 0.000008] Initializing CPU#12 > [ 0.000052] CPU: L1 I cache: 32K, L1 D cache: 32K > [ 0.000056] CPU: L2 cache: 256K > [ 0.000058] CPU: L3 cache: 8192K > [ 0.000063] CPU: Physical Processor ID: 0 > [ 0.000065] CPU: Processor Core ID: 0 > [ 0.177982] installing Xen timer for CPU 13 > [ 0.177982] cpu 13 spinlock event irq 576 > [ 0.000009] Initializing CPU#13 > [ 0.000055] CPU: L1 I cache: 32K, L1 D cache: 32K > [ 0.000060] CPU: L2 cache: 256K > [ 0.000062] CPU: L3 cache: 8192K > [ 0.000068] CPU: Physical Processor ID: 0 > [ 0.000070] CPU: Processor Core ID: 0 > [ 0.178445] installing Xen timer for CPU 14 > [ 0.178445] cpu 14 spinlock event irq 570 > [ 0.000008] Initializing CPU#14 > [ 0.000056] CPU: L1 I cache: 32K, L1 D cache: 32K > [ 0.000060] CPU: L2 cache: 256K > [ 0.000062] CPU: L3 cache: 8192K > [ 0.000067] CPU: Physical Processor ID: 0 > [ 0.000069] CPU: Processor Core ID: 0 > [ 0.178896] installing Xen timer for CPU 15 > [ 0.178896] cpu 15 spinlock event irq 564 > [ 0.000009] Initializing CPU#15 > [ 0.000055] CPU: L1 I cache: 32K, L1 D cache: 32K > [ 0.000060] CPU: L2 cache: 256K > [ 0.000063] CPU: L3 cache: 8192K > [ 0.000068] CPU: Physical Processor ID: 0 > [ 0.000071] CPU: Processor Core ID: 0 > [ 0.178896] Brought up 16 CPUs > [ 0.182662] Grant table initialized > [ 0.182671] regulator: core version 0.5 > [ 0.182755] NET: Registered protocol family 16 > [ 0.185945] PCI: setting up Xen PCI frontend stub > [ 0.189397] bio: create slab <bio-0> at 0 > [ 0.190440] ACPI: Interpreter disabled. > [ 0.193793] xen_balloon: Initialising balloon driver with page order 0. > [ 0.194019] vgaarb: loaded > [ 0.194019] SCSI subsystem initialized > [ 0.195724] usbcore: registered new interface driver usbfs > [ 0.195724] usbcore: registered new interface driver hub > [ 0.195865] usbcore: registered new device driver usb > [ 0.195962] PCI: System does not support PCI > [ 0.195962] PCI: System does not support PCI > [ 0.195962] NetLabel: Initializing > [ 0.195962] NetLabel: domain hash size = 128 > [ 0.195962] NetLabel: protocols = UNLABELED CIPSOv4 > [ 0.195962] NetLabel: unlabeled traffic allowed by default > [ 0.195962] Switching to clocksource xen > [ 0.197558] pnp: PnP ACPI: disabled > [ 0.197558] NET: Registered protocol family 2 > [ 0.197558] IP route cache hash table entries: 131072 (order: 8, > 1048576 bytes) > [ 0.197558] TCP established hash table entries: 262144 (order: 10, > 4194304 bytes) > [ 0.197558] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes) > [ 0.197558] TCP: Hash tables configured (established 262144 bind 65536) > [ 0.202508] TCP reno registered > [ 0.377078] NET: Registered protocol family 1 > [ 0.378157] RPC: Registered udp transport module. > [ 0.378157] RPC: Registered tcp transport module. > [ 0.378157] RPC: Registered tcp NFSv4.1 backchannel transport module. > [ 0.378318] platform rtc_cmos: registered platform RTC device (no > PNP device found) > [ 0.379715] Scanning for low memory corruption every 60 seconds > [ 0.380152] audit: initializing netlink socket (disabled) > [ 0.380171] type=2000 audit(1276184586.557:1): initialized > [ 0.387843] HugeTLB registered 2 MB page size, pre-allocated 0 pages > [ 0.390344] VFS: Disk quotas dquot_6.5.2 > [ 0.390446] Dquot-cache hash table entries: 512 (order 0, 4096 bytes) > [ 0.391143] Installing knfsd (copyright (C) 1996 okir@monad.swb.de). > [ 0.391355] fuse init (API version 7.13) > [ 0.391449] msgmni has been set to 8009 > [ 0.392802] alg: No test for stdrng (krng) > [ 0.392816] io scheduler noop registered > [ 0.392816] io scheduler anticipatory registered > [ 0.392816] io scheduler deadline registered (default) > [ 0.392816] io scheduler cfq registered > [ 0.392922] pci_hotplug: PCI Hot Plug PCI Core version: 0.5 > [ 0.392952] pciehp: PCI Express Hot Plug Controller Driver version: 0.4 > [ 0.392971] pci-stub: invalid id string "" > [ 0.413634] Event-channel device installed. > [ 0.415727] blktap_device_init: blktap device major 253 > [ 0.415738] blktap_ring_init: blktap ring major: 254 > [ 0.423053] registering netback > [ 0.423122] xen-platform-pcifailed backend handshake: unrecognised > magic value > [ 0.425494] brd: module loaded > [ 0.426026] loop: module loaded > [ 0.426147] Initialising Xen virtual ethernet driver. > [ 0.427868] pcifront pci-0: backend going away! > [ 0.444704] ehci_hcd: USB 2.0 ''Enhanced'' Host Controller (EHCI) Driver > [ 0.444704] ohci_hcd: USB 1.1 ''Open'' Host Controller (OHCI) Driver > [ 0.444704] uhci_hcd: USB Universal Host Controller Interface driver > [ 0.444704] usbcore: registered new interface driver usblp > [ 0.444704] Initializing USB Mass Storage driver... > [ 0.444704] usbcore: registered new interface driver usb-storage > [ 0.444704] USB Mass Storage support registered. > [ 0.444704] usbcore: registered new interface driver libusual > [ 0.444704] PNP: No PS/2 controller found. Probing ports directly. > [ 0.445167] i8042.c: No controller found. > [ 0.445203] mice: PS/2 mouse device common for all mice > [ 0.445291] input: PC Speaker as /devices/platform/pcspkr/input/input0 > [ 0.445433] device-mapper: uevent: version 1.0.3 > [ 0.446132] device-mapper: ioctl: 4.15.0-ioctl (2009-04-01) > initialised: dm-devel@redhat.com > [ 0.450190] device-mapper: multipath: version 1.1.0 loaded > [ 0.450198] device-mapper: multipath round-robin: version 1.0.0 loaded > [ 0.451549] cpuidle: using governor ladder > [ 0.517849] TCP cubic registered > [ 0.518035] NET: Registered protocol family 10 > [ 0.519184] lo: Disabled Privacy Extensions > [ 0.520961] NET: Registered protocol family 17 > [ 0.521084] registered taskstats version 1 > [ 0.521178] XENBUS: Device with no driver: device/console/0 > [ 0.521197] BIOS EDD facility v0.16 2004-Jun-25, 0 devices found > [ 0.521203] EDD information not available. > [ 2.040051] Sending DHCP requests ., OK > [ 2.120041] IP-Config: Got DHCP answer from 135.149.78.198, my > address is 135.149.77.123 > [ 2.120602] IP-Config: Complete: > [ 2.120609] device=eth0, addr=135.149.77.123, > mask=255.255.252.0, gw=135.149.76.1, > [ 2.120629] host=target, domain=XXXX, nis-domain=(none), > [ 2.120637] bootserver=135.149.78.198, rootserver=135.149.75.134 > [ 2.120695] md: Skipping autodetection of RAID arrays. > (raid=autodetect will force) > [ 2.120760] Looking up port of RPC 100003/2 on 135.149.75.134 > [ 2.131876] Looking up port of RPC 100005/1 on 135.149.75.134 > [ 2.148520] VFS: Mounted root (nfs filesystem) on device 0:14. > [ 2.148697] Freeing unused kernel memory: 608k freed > [ 2.148896] Write protecting the kernel read-only data: 8156k > * Setting hostname to ''target''... > [ OK ] > * Setting preliminary keymap... [ OK ] > * Starting kernel event manager... [ OK ] > * Loading hardware drivers... > [ 4.818275] rtc_cmos rtc_cmos: rtc core: registered > rtc_cmos as rtc0 > [ OK ] > * Loading manual drivers... > * Setting kernel variables (/etc/sysctl.conf)... > [ OK ] > * Setting kernel variables > (/etc/sysctl.d/10-console-messages.conf)... kernel.printk = 4 > 4 1 7 > [ OK ] > * Setting kernel variables > (/etc/sysctl.d/10-network-security.conf)... > net.ipv4.conf.default.rp_filter = 1 > net.ipv4.conf.all.rp_filter = 1 > net.ipv4.tcp_syncookies = 1 > [ OK ] > * Activating swap [ OK ] > * Will now check all file systems > fsck 1.41.4 (27-Jan-2009) > Checking all file systems. > * Done checking file systems. > A log is being saved in /var/log/fsck/checkfs if that location is writable. > * Enable login on console [ OK ] > * Will now mount local filesystems [ OK ] > * Will now activate swapfile swap [ OK ] > * Check for hostname changes... [ OK ] > * Get hostname from DNS > * Configuring network interfaces... [ OK ] > * Starting portmap daemon... [ OK ] > * Starting NFS common utilities [ OK ] > * Setting up console font and keymap... [ OK ] > * Initializing random number generator... [ OK ] > * Setting up X server socket directory /tmp/.X11-unix... [ OK ] > * Setting up ICE socket directory /tmp/.ICE-unix... [ OK ] > * Starting system logging syslog-ng [ OK ] > * Starting system message bus dbus [ OK ] > * Starting OpenBSD Secure Shell server sshd [ OK ] > * Starting NFS common utilities [ OK ] > * Starting internet superserver inetd [ OK ] > * Setting sysfs variables... [ OK ] > * Starting ipmi drivers [ OK ] > * Starting deferred execution scheduler atd [ OK ] > * Starting periodic command scheduler crond [ OK ] > * Running local boot scripts (/etc/rc.local) [ OK ]> -Bruce-- Best regards, Sander mailto:linux@eikelenboom.it _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Konrad Rzeszutek Wilk
2010-Jun-11 13:38 UTC
Re: [Xen-devel] PCI devices missing from domU in pv kernel, hvm OK.
On Fri, Jun 11, 2010 at 09:09:36AM +0300, Pasi Kärkkäinen wrote:> On Thu, Jun 10, 2010 at 04:25:54PM -0700, Bruce Edge wrote: > > I had hvm domU working fine. This problem is specific to my pv-ops > > config. I''m not seeing any PCI devices after I bring up the domU. I > > was able to get this working as an hvm instance, but not pv. > > I''d appreciate if anyone could offer some insight as to why I can''t > > see the PCI devices in domU. > > > > I''ve gone through these > > http://wiki.xensource.com/xenwiki/XenPCIpassthrough > > > > It seems you''re missing the required kernel parameters for the domU kernel.. > They''re described on that wiki page. > > > > > > Here''s the domU boot log: > > root = /dev/nfs > > nfs_server = 135.149.75.134 > > nfs_root = /home/root,tcp > > initrd = /import/root/boot/initrd.img-2.6.32.14.nfs > > builder = linux > > kernel > > /import/kaan/bedge/dev_kaan_kernel.kaan.debug/root/boot/vmlinuz-2.6.32.14 > > memory = 4096And also there is a bug where we can''t do PCI in PV guests when guest has more than 3GB. _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel