search for: rdma_cm

OK - finished some tests over tcp and ironed out a lot of problems. rdma is next; should be snap now.... [I must admit that this is my 1st foray into the land of IB, so some of the following may be obvious to a non-naive admin..] except that while I can create and start the volume with rdma as transport: ================================== root at pbs3:~ 622 $ gluster volume info glrdma

Hello, Not sure if this is the right forum: I''m encountering difficulties with o2ib which prevents an LNET shutdown from proceeding: Unloading OpenIB kernel modules:NET: Unregistered protocal family 27 Failed to unload rdma_cm Failed to unload rdma_cm Failed to unload ib_cm Failed to unload ib_sa LustreError: 131-3: Received notification of device removal Please shutdown LNET to allow this to proceed This happens on server and client nodes alike. We run RHEL5.1 and OFED 1.2, kernel 2.6.18-53.1.13.el5_lustre.1.6....

...xample What exact modules needed for this function? The error message I've got this: mount -t 9p -o trans=virtio,version=9p2000.L hostshare /tmp/hostfiles mount: special device hostshare does not exist syslog: 9pnet_virtio: no channels available my modules 9pnet_rdma 12966 0 rdma_cm 42325 1 9pnet_rdma ib_core 74297 6 rdma_cm,ib_cm,ib_sa,iw_cm,9pnet_rdma,ib_mad 9pnet_virtio 17519 0 virtio_ring 19975 3 virtio_balloon,9pnet_virtio,virtio_scsi virtio 14172 3 virtio_balloon,9pnet_virtio,virtio_scsi 9p...

...iblnd: Unknown symbol ib_dealloc_pd > LustreError: 4177:0:(api-ni.c:1002:lnet_startup_lndnis()) Can''t load LND > o2ib, module ko2iblnd, rc=256 > > lsmod | grep ib > libcfs 103060 1 lnet > ib_ucm 19332 0 > ib_addr 10756 1 rdma_cm > ib_cm 31968 2 ib_ucm,rdma_cm > ib_ipoib 48400 0 > ib_sa 16652 3 rdma_cm,ib_cm,ib_ipoib > ib_uverbs 38312 2 rdma_ucm,ib_ucm > ib_umad 17968 0 > ib_mthca 116240 0 > ib_mad...

...;> mount -t 9p -o trans=virtio,version=9p2000.L hostshare /tmp/hostfiles >> mount: special device hostshare does not exist >> >> syslog: >> 9pnet_virtio: no channels available >> >> my modules >> >> >> 9pnet_rdma 12966 0 >> rdma_cm 42325 1 9pnet_rdma >> ib_core 74297 6 >> rdma_cm,ib_cm,ib_sa,iw_cm,9pnet_rdma,ib_mad >> 9pnet_virtio 17519 0 >> virtio_ring 19975 3 virtio_balloon,9pnet_virtio,virtio_scsi >> virtio 14172 3 virtio_...

...tre/include -I/usr/local/ofed/3.5/sr c/compat-rdma-3.5/include M=/home/mhebenst/lustre-2.3.0/build make[1]: Warning: File `/home/mhebenst/lustre-2.3.0/build/conftest.c'' has modification time 7.2e+03 s in the future In file included from /usr/local/ofed/3.5/src/compat-rdma-3.5/include/rdma/rdma_cm.h:39, from /home/mhebenst/lustre-2.3.0/build/conftest.c:58: /usr/local/ofed/3.5/src/compat-rdma-3.5/include/rdma/ib_addr.h: In function ?iboe_get_rate?: /usr/local/ofed/3.5/src/compat-rdma-3.5/include/rdma/ib_addr.h:223: error: implicit declaration of function ?rtnl_lock? /usr/loca...

...the OpenMPI libs. I now get a different error when I try to load Rmpi > require(Rmpi) Loading required package: Rmpi librdmacm: couldn't read ABI version. librdmacm: assuming: 4 libibverbs: Fatal: couldn't read uverbs ABI version. CMA: unable to open /dev/infiniband/rdma_cm -------------------------------------------------------------------------- WARNING: Failed to open "OpenIB-cma" [DAT_INTERNAL_ERROR:]. This may be a real error or it may be an invalid entry in the uDAPL Registry which is contained in the dat.conf file. Contact your local System Administra...

...ror message I've got this: > > mount -t 9p -o trans=virtio,version=9p2000.L hostshare /tmp/hostfiles > mount: special device hostshare does not exist > > syslog: > 9pnet_virtio: no channels available > > my modules > > > 9pnet_rdma 12966 0 > rdma_cm 42325 1 9pnet_rdma > ib_core 74297 6 > rdma_cm,ib_cm,ib_sa,iw_cm,9pnet_rdma,ib_mad > 9pnet_virtio 17519 0 > virtio_ring 19975 3 virtio_balloon,9pnet_virtio,virtio_scsi > virtio 14172 3 virtio_balloon,9pnet_virtio...

...ith LXC. In accordance with http://libvirt.org/formatdomain.html#elementsHostDevCaps I pass an InfiniBand adapter through to the guest container. However, within the container the access permissions are not the same. Within the host they are like this: crw-rw-rw- 1 root root 10, 56 20. Jun 09:40 rdma_cm crw-rw-rw- 1 root root 231, 224 20. Jun 09:41 ucm0 crw-rw-rw- 1 root root 231, 0 20. Jun 09:41 umad0 crw-rw-rw- 1 root root 231, 1 20. Jun 09:41 umad1 crw-rw-rw- 1 root root 231, 192 20. Jun 09:41 uverbs0 Within the guest, only root may read or write from/to the device: crw------- 1 root root...

The spice-vdagent should be running in the guest. Have you installed the spice guest tools in your windows guest? Download them here: http://www.spice-space.org/download.html That should get clipboard sharing working. ----- Original Message ----- > From: "Laszlo Pal" <vlad@vlad.hu> > To: libvirt-users@redhat.com, virt-tools-list@redhat.com > Sent: Thursday, March 20,

...s shown up today. I had to do a hard reboot as graceful hanged on sync(). ------------[ cut here ]------------ kernel BUG at fs/btrfs/delayed-inode.c:1466! invalid opcode: 0000 [#1] SMP CPU 10 Modules linked in: btrfs zlib_deflate lzo_compress ipmi_devintf autofs4 be2iscsi iscsi_boot_sysfs ib_iser rdma_cm ib_cm iw_cm ib_sa ib_mad ib_addr iscsi_tcp bnx2i cnic uio ipv6 cxgb3i libcxgbi iw_cxgb3 ib_core cxgb3 libiscsi_tcp libiscsi scsi_transport_iscsi dm_mirror dm_region_hash dm_log dm_multipath video battery acpi_pad acpi_ipmi ac parport usbhid evdev acpi_power_meter radeon ttm drm_kms_helper drm hwmon...

Hey guys, So, we're testing Gluster RDMA storage, and are having some issues. Things are working...just not as we expected them. THere isn't a whole lot in the way, that I've foudn on docs for gluster rdma, aside from basically "install gluster-rdma", create a volume with transport=rdma, and mount w/ transport=rdma.... I've done that...and the IB fabric is known to be

.../tmp/test2/) [2013-07-02 21:04:51.408841] I [socket.c:3480:socket_init] 0-glusterfs: SSL support is NOT enabled [2013-07-02 21:04:51.408872] I [socket.c:3495:socket_init] 0-glusterfs: using system polling thread [2013-07-02 21:04:51.414278] W [rdma.c:4197:__gf_rdma_ctx_create] 0-rpc-transport/rdma: rdma_cm event channel creation failed (No such file or directory) [2013-07-02 21:04:51.414309] E [rdma.c:4485:init] 0-test2-client-1: Failed to initialize IB Device [2013-07-02 21:04:51.414324] E [rpc-transport.c:320:rpc_transport_load] 0-rpc-transport: 'rdma' initialization failed [2013-07-02 21:0...

...ered_feature+0x5/0x50 [ 75.114986] PGD 117b99067 PUD 114daa067 PMD 0 [ 75.114992] Oops: 0000 [#1] SMP [ 75.115006] Modules linked in: be2iscsi iscsi_boot_sysfs bnx2i fcoe libfcoe libfc cnic uio lockd cxgb4i cxgb4 scsi_transport_fc cxgb3i scsi_tgt libcxgbi cxgb3 8021q garp stp llc mdio ib_iser rdma_cm ib_cm iw_cm ib_sa ib_mad ib_core ib_addr iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi snd_hda_intel snd_hda_codec snd_hwdep snd_seq snd_seq_device snd_pcm joydev snd_timer snd microcode soundcore pcspkr virtio_net virtio_balloon 9pnet_virtio 9pnet snd_page_alloc i2c_piix4 i2c_core uinput su...

...ered_feature+0x5/0x50 [ 75.114986] PGD 117b99067 PUD 114daa067 PMD 0 [ 75.114992] Oops: 0000 [#1] SMP [ 75.115006] Modules linked in: be2iscsi iscsi_boot_sysfs bnx2i fcoe libfcoe libfc cnic uio lockd cxgb4i cxgb4 scsi_transport_fc cxgb3i scsi_tgt libcxgbi cxgb3 8021q garp stp llc mdio ib_iser rdma_cm ib_cm iw_cm ib_sa ib_mad ib_core ib_addr iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi snd_hda_intel snd_hda_codec snd_hwdep snd_seq snd_seq_device snd_pcm joydev snd_timer snd microcode soundcore pcspkr virtio_net virtio_balloon 9pnet_virtio 9pnet snd_page_alloc i2c_piix4 i2c_core uinput su...

..._conntrack ip6table_nat nf_nat_ipv6 ip6table_mangle ip6table_raw ip6table_security iptable_nat nf_nat_ipv4 nf_nat iptable_mangle iptable_raw iptable_security nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ip_set nfnetlink ip6table_filter ip6_tables iptable_filter dm_service_time rpcrdma sunrpc rdma_ucm rdma_cm configfs iw_cm ib_cm mlx4_ib ib_uverbs ib_core pkey ghash_s390 prng aes_s390 des_s390 des_generic sha512_s390 sha1_s390 zcrypt_cex4 zcrypt rng_core eadm_sch sch_fq_codel ip_tables x_tables mlx4_en mlx4_core sha256_s390 sha_common dm_multipath scsi_dh_rdac scsi_dh_emc scsi_dh_alua dm_mirror dm_regio...

...s appear to be installed on server [root at mseas-data2 ~]# service rdma status Low level hardware support loaded: ??????? mlx4_ib Upper layer protocol modules: ??????? ib_ipoib User space access modules: ??????? rdma_ucm ib_ucm ib_uverbs ib_umad Connection management modules: ??????? rdma_cm ib_cm iw_cm Configured IPoIB interfaces: none Currently active IPoIB interfaces: ib0

...> require(Rmpi) Loading required package: Rmpi librdmacm: couldn't read ABI version. librdmacm: assuming: 4 libibverbs: Fatal: couldn't read uverbs ABI version. CMA: unable to open /dev/infiniband/rdma_cm -------------------------------------------------------------------------- WARNING: Failed to open "OpenIB-cma" [DAT_INTERNAL_ERROR:]. This may be a real error or it may be an invalid entry in the uDAPL Registry which is contained in the dat.conf file. Contact your local System Administra...

...c2b68 RIP: [<ffffffff804158eb>] skb_copy_bits+0x114/0x1d3 PGD 11a4067 PUD 13a6067 PMD 154e067 PTE 0 Oops: 0000 [1] SMP last sysfs file: /devices/xen-backend/vbd-1-51712/statistics/wr_sect CPU 2 Modules linked in: bridge netloop netbk blktap blkbk sg bonding ipv6 xfrm_nalgo crypto_api ib_iser rdma_cm ib_cm iw_cm ib_sa ib_mad ib_core ib_addr iscsi_tcp libiscsi_tcp libiscsi2 scsi_transport_iscsi2 scsi_transport_iscsi dm_mirror dm_multipath scsi_dh video hwmon backlight sbs i2c_ec i2c_core button battery asus_acpi ac parport_pc lp parport e1000e serial_core bnx2 hpilo serio_raw pcspkr dm_raid45 dm...

...management: Using /var/lib/glusterd as working directory [2018-02-19 05:32:38.589264] I [MSGID: 106479] [glusterd.c:1486:init] 0-management: Using /var/run/gluster as pid file working directory [2018-02-19 05:32:38.609833] W [MSGID: 103071] [rdma.c:4630:__gf_rdma_ctx_create] 0-rpc-transport/rdma: rdma_cm event channel creation failed [No such device] [2018-02-19 05:32:38.609892] W [MSGID: 103055] [rdma.c:4939:init] 0-rdma.management: Failed to initialize IB Device [2018-02-19 05:32:38.609919] W [rpc-transport.c:350:rpc_transport_load] 0-rpc-transport: 'rdma' initialization failed [2018-0...