Xen users - Apr 2010 - Centos5, paravirtualization and infiniband passthrough

Hello all,
I''m trying to get an infiniband device passed through to a domU on 
Centos5 (standard centos5 xen, both dom0 and domU). The device in 
question is
InfiniBand: Mellanox Technologies MT26418 [ConnectX VPI PCIe 2.0 5GT/s - 
IB DDR / 10GigE] (rev a0)

Now, I hid the device, added it to the domU and all that went well. 
lspci on the domU sees the device and all, but it seems it can''t use
it.
The domU itself says

-bash-3.2# echo -n  "0000:00:00.0"  >
/sys/bus/pci/drivers/mlx4_core/bind
PCI: Enabling device 0000:00:00.0 (0000 -> 0002)
mlx4_core 0000:00:00.0: Couldn''t map HCA reset register, aborting.
mlx4_core 0000:00:00.0: Failed to reset HCA, aborting.
mlx4_core: probe of 0000:00:00.0 failed with error -12
-bash: echo: write error: Cannot allocate memory

Adn "xm dmesg" says
(XEN) mm.c:625:d34 Non-privileged (34) attempt to map I/O space 000fdff0

I assume the permissions to access the memory, and I read that putting 
this in /etc/xen/xend-pci-permissive.sxp should help

(unconstrained_dev_ids
     (''15b3:6732'')
)

(''15b3:6732'' gotten from lspci -n)

This doesn''t seem to help. Is there still something I need to do, 
anything I have missed?

Cheers,
Kalle Happonen

_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

On Mon, Apr 19, 2010 at 01:59:25PM +0200, Kalle Happonen
wrote:
> Hello all,
> I''m trying to get an infiniband device passed through to a domU on
> Centos5 (standard centos5 xen, both dom0 and domU). The device in  
> question is
> InfiniBand: Mellanox Technologies MT26418 [ConnectX VPI PCIe 2.0 5GT/s -  
> IB DDR / 10GigE] (rev a0)
>
> Now, I hid the device, added it to the domU and all that went well.  
> lspci on the domU sees the device and all, but it seems it can''t
use it.
> The domU itself says
>
> -bash-3.2# echo -n  "0000:00:00.0"  >
/sys/bus/pci/drivers/mlx4_core/bind
> PCI: Enabling device 0000:00:00.0 (0000 -> 0002)
> mlx4_core 0000:00:00.0: Couldn''t map HCA reset register, aborting.
> mlx4_core 0000:00:00.0: Failed to reset HCA, aborting.
> mlx4_core: probe of 0000:00:00.0 failed with error -12
> -bash: echo: write error: Cannot allocate memory
>
> Adn "xm dmesg" says
> (XEN) mm.c:625:d34 Non-privileged (34) attempt to map I/O space 000fdff0
>
> I assume the permissions to access the memory, and I read that putting  
> this in /etc/xen/xend-pci-permissive.sxp should help
>
> (unconstrained_dev_ids
>     (''15b3:6732'')
> )
>
> (''15b3:6732'' gotten from lspci -n)
>
> This doesn''t seem to help. Is there still something I need to do,
> anything I have missed?
>
I don''t know if this will help but here goes anyway:
http://wiki.xensource.com/xenwiki/XenPCIpassthrough

-- Pasi


_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users