Hello everybody, I am wondering now are there any ways to use InfiniBand network adapters in vSphere-based virtual machine so that I could build a virtual cluster using lustre as a shared storage? As far as I know, the only way of using InfiniBand into virtual machine requires enabling passthrough on ESXi host for InfiniBand network adapter, which automatically denies features like vMotion, which is one of the main reasons to think about virtual cluster for HPC. Sorry for some offtopic, and thanks in advance! -- Всеволод Никоноров, ОИТТиС, НИКИЭТ <v.nikonorov@nikiet.ru> _______________________________________________ Lustre-discuss mailing list Lustre-discuss@lists.lustre.org http://lists.lustre.org/mailman/listinfo/lustre-discuss
Le 05/07/2013 13:19, Vsevolod Nikonorov a écrit :> Hello everybody, I am wondering now are there any ways to use InfiniBand network adapters in vSphere-based virtual machine > so that I could build a virtual cluster using lustre as a shared storage? > As far as I know, the only way of using InfiniBand into virtual machine requires enabling passthrough on ESXi host >for InfiniBand network adapter, which automatically denies features like vMotion, >which is one of the main reasons to think about virtual cluster for HPC. > > Sorry for some offtopic, and thanks in advance! >we use IB on esxi5 host with mellanox driver but in VM only vmxnet3 (10G) we just have lustre client VM mounting the lustre filesystem over tcp -- Weill Philippe - Administrateur Systeme et Reseaux CNRS/UPMC/IPSL LATMOS (UMR 8190) _______________________________________________ Lustre-discuss mailing list Lustre-discuss@lists.lustre.org http://lists.lustre.org/mailman/listinfo/lustre-discuss
Am I undersrand correctly - esxi uses network bandwith from several IB adapters and provides it to VMs via vmxnet3 driver? So VMs only see 10G of bandwidth, but that is just virtualized IB resources, so it is possoble to establish a bond of several ethernet links inside a VM? On Fri, 05 Jul 2013 14:24:22 +0200 Philippe Weill <philippe.Weill@latmos.ipsl.fr> wrote:> Le 05/07/2013 13:19, Vsevolod Nikonorov a écrit : > > Hello everybody, I am wondering now are there any ways to use InfiniBand network adapters in vSphere-based virtual machine > > so that I could build a virtual cluster using lustre as a shared storage? > > As far as I know, the only way of using InfiniBand into virtual machine requires enabling passthrough on ESXi host > >for InfiniBand network adapter, which automatically denies features like vMotion, > >which is one of the main reasons to think about virtual cluster for HPC. > > > > Sorry for some offtopic, and thanks in advance! > > > > we use IB on esxi5 host with mellanox driver > but in VM only vmxnet3 (10G) > we just have lustre client VM mounting the lustre filesystem over tcp > -- > Weill Philippe - Administrateur Systeme et Reseaux > CNRS/UPMC/IPSL LATMOS (UMR 8190) > > _______________________________________________ > Lustre-discuss mailing list > Lustre-discuss@lists.lustre.org > http://lists.lustre.org/mailman/listinfo/lustre-discuss >-- Всеволод Никоноров, ОИТТиС, НИКИЭТ <v.nikonorov@nikiet.ru> _______________________________________________ Lustre-discuss mailing list Lustre-discuss@lists.lustre.org http://lists.lustre.org/mailman/listinfo/lustre-discuss