search for: ib_uverb

To Harry Mangalam about Gluster/RDMA: make sure these modules are loaded # modprobe -v rdma_ucm # modprobe -v ib_uverbs # modprobe -v ib_ucm To run the subnet manager # modprobe -v ib_umad Make sure libibverbs and (libmlx4 or libmthca) RPMs are installed. I don't understand why they appropriate modules aren't loaded automatically. Could put something in /etc/modprobe.d/ to make this happen maybe? Infi...

Is anyone using Gluster with the Rocks cluster system? If so, do you know if there is a Roll for Gluster? Or, do you have any advice about things to do and things to avoid doing? We're considering using Gluster with Infiniband on our cluster and trying to learn whether other people have done this so we can perhaps learn from their experience. Thanks. .. Lana (lana.deere at gmail.com)

...> lsmod | grep ib > libcfs 103060 1 lnet > ib_ucm 19332 0 > ib_addr 10756 1 rdma_cm > ib_cm 31968 2 ib_ucm,rdma_cm > ib_ipoib 48400 0 > ib_sa 16652 3 rdma_cm,ib_cm,ib_ipoib > ib_uverbs 38312 2 rdma_ucm,ib_ucm > ib_umad 17968 0 > ib_mthca 116240 0 > ib_mad 36116 4 ib_cm,ib_sa,ib_umad,ib_mthca > ib_core 49024 9 > ib_ucm,rdma_cm,ib_cm,ib_ipoib,ib_sa,ib_uverbs,ib_umad,ib_mthca,ib_mad > &gt...

...2.329993] IP: [<ffffffff8153c1a0>] tun_device_event+0x110/0x340 [ 72.336032] PGD 7f054f1067 PUD 7ef6f3f067 PMD 0 [ 72.340616] Oops: 0002 [#1] SMP DEBUG_PAGEALLOC [ 72.345498] gsmi: Log Shutdown Reason 0x03 [ 72.349541] Modules linked in: w1_therm wire cdc_acm ehci_pci ehci_hcd mlx4_en ib_uverbs mlx4_ib ib_core mlx4_core [ 72.359870] CPU: 12 PID: 7820 Comm: set.ixion-haswe Not tainted 4.7.0-dbx-DEV #10 [ 72.360253] mlx4_en: eth0: Link Up [ 72.370618] Hardware name: Intel Grantley,Wellsburg/Ixion_IT_15, BIOS 2.50.0 01/21/2016 [ 72.378525] task: ffff883f2501e8c0 ti: ffff883f3ef08000...

...2.329993] IP: [<ffffffff8153c1a0>] tun_device_event+0x110/0x340 [ 72.336032] PGD 7f054f1067 PUD 7ef6f3f067 PMD 0 [ 72.340616] Oops: 0002 [#1] SMP DEBUG_PAGEALLOC [ 72.345498] gsmi: Log Shutdown Reason 0x03 [ 72.349541] Modules linked in: w1_therm wire cdc_acm ehci_pci ehci_hcd mlx4_en ib_uverbs mlx4_ib ib_core mlx4_core [ 72.359870] CPU: 12 PID: 7820 Comm: set.ixion-haswe Not tainted 4.7.0-dbx-DEV #10 [ 72.360253] mlx4_en: eth0: Link Up [ 72.370618] Hardware name: Intel Grantley,Wellsburg/Ixion_IT_15, BIOS 2.50.0 01/21/2016 [ 72.378525] task: ffff883f2501e8c0 ti: ffff883f3ef08000...

...p6table_mangle ip6table_raw ip6table_security iptable_nat nf_nat_ipv4 nf_nat iptable_mangle iptable_raw iptable_security nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ip_set nfnetlink ip6table_filter ip6_tables iptable_filter dm_service_time rpcrdma sunrpc rdma_ucm rdma_cm configfs iw_cm ib_cm mlx4_ib ib_uverbs ib_core pkey ghash_s390 prng aes_s390 des_s390 des_generic sha512_s390 sha1_s390 zcrypt_cex4 zcrypt rng_core eadm_sch sch_fq_codel ip_tables x_tables mlx4_en mlx4_core sha256_s390 sha_common dm_multipath scsi_dh_rdac scsi_dh_emc scsi_dh_alua dm_mirror dm_region_hash dm_log dm_mod autofs4 [85109.57...

...1 BOOT_VLAN_P21 Needed packages: Most if not all packages appear to be installed on server [root at mseas-data2 ~]# service rdma status Low level hardware support loaded: ??????? mlx4_ib Upper layer protocol modules: ??????? ib_ipoib User space access modules: ??????? rdma_ucm ib_ucm ib_uverbs ib_umad Connection management modules: ??????? rdma_cm ib_cm iw_cm Configured IPoIB interfaces: none Currently active IPoIB interfaces: ib0

Hi have what might be some elementary questions. Really, what I"d love would be for someone who has had good success to publish his/her configuration files and, maybe, the output from ifconfig. At this point, when I see the not-so-good performance I"m getting, I don't realistically know if I'm in the right ballfield. It seems to me, that with so many mellanox cards out

..._ipmi ipmi_si ipmi_devintf ipmi_msghandler mac_hid sch_fq_codel ip_tables x_tables autofs4 btrfs blake2b_generic raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear mlx5_ib ses enclosure hid_generic usbhid uas hid usb_storage ib_uverbs ib_core crct10dif_pclmul crc32_pclmul ast ghash_clmulni_intel drm_vram_helper aesni_intel drm_ttm_helper crypto_simd ttm cryptd drm_kms_helper glue_helper syscopyarea sysfillrect sysimgblt mlx5_core fb_sys_fops pci_hyperv_intf igb cec mpt3sas dca rc_core raid_class nvme tls i2c_algo_bit scsi_trans...

...ff8153c1a0>] tun_device_event+0x110/0x340 > [ 72.336032] PGD 7f054f1067 PUD 7ef6f3f067 PMD 0 > [ 72.340616] Oops: 0002 [#1] SMP DEBUG_PAGEALLOC > [ 72.345498] gsmi: Log Shutdown Reason 0x03 > [ 72.349541] Modules linked in: w1_therm wire cdc_acm ehci_pci > ehci_hcd mlx4_en ib_uverbs mlx4_ib ib_core mlx4_core > [ 72.359870] CPU: 12 PID: 7820 Comm: set.ixion-haswe Not tainted > 4.7.0-dbx-DEV #10 > [ 72.360253] mlx4_en: eth0: Link Up > [ 72.370618] Hardware name: Intel Grantley,Wellsburg/Ixion_IT_15, > BIOS 2.50.0 01/21/2016 > [ 72.378525] task: ffff883...

...189784 12 osc,mgc,lustre,lov,lquota,mdc,ksocklnd,ko2iblnd,ptlrpc,obdclass,lnet,lvf s rdma_cm 65940 4 ko2iblnd,ib_iser,rdma_ucm,ib_sdp ib_core 88576 16 ko2iblnd,ib_iser,rdma_ucm,ib_ucm,ib_srp,ib_sdp,rdma_cm,ib_cm,iw_cm,ib_lo cal_sa,ib_ipoib,ib_sa,ib_uverbs,ib_umad,ib_mthca,ib_mad I''d be grateful for any hints. Regards, Michael

An user reported that he has hit an annoying deadlock while playing with ceph based on btrfs. Current updating device tree requires space from METADATA chunk, so we -may- need to do a recursive chunk allocation when adding/updating dev extent, that is where the deadlock comes from. If we use SYSTEM metadata to update device tree, we can avoid the recursive stuff. Reported-by: Jim Schutt

...p6table_mangle ip6table_raw ip6table_security iptable_nat nf_nat_ipv4 nf_nat iptable_mangle iptable_raw iptable_security nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ip_set nfnetlink ip6table_filter ip6_tables iptable_filter dm_service_time rpcrdma sunrpc rdma_ucm rdma_cm configfs iw_cm ib_cm mlx4_ib ib_uverbs ib_core pkey ghash_s390 prng aes_s390 des_s390 des_generic sha512_s390 sha1_s390 zcrypt_cex4 zcrypt rng_core eadm_sch sch_fq_codel ip_tables x_tables mlx4_en mlx4_core sha256_s390 sha_common dm_multipath scsi_dh_rdac scsi_dh_emc scsi_dh_alua dm_mirror dm_region_hash dm_log dm_mod autofs4 >>...

Hi I am hitting this Warning reproducible, the workload is a ceph osd, kernel ist 3.1.0-rc5. Best Regards, martin [ 5472.099766] ------------[ cut here ]------------ [ 5472.099833] WARNING: at fs/btrfs/inode.c:2193 btrfs_orphan_commit_root+0xb0/0xc0 [btrfs]() [ 5472.099838] Hardware name: MS-96B3 [ 5472.099842] Modules linked in: radeon ttm drm_kms_helper drm i2c_algo_bit psmouse sp5100_tco

...onntrack_sip nf_conntrack_proto_sctp nf_conntrack_pptp nf_conntrack_proto_gre nf_conntrack_netlink nf_conntrack_netbios_ns nf_conntrack_irc nf_conntrack_h323 nf_conntrack_ftp xt_physdev xt_hashlimit nfs ib_iser libiscsi scsi_transport_iscsi ib_ucm ib_ipoib rdma_ucm rdma_cm ib_cm iw_cm ib_sa ib_addr ib_uverbs ib_umad mlx4_ib ib_mthca ib_mad ib_core i7core_edac edac_core mlx4_core iTCO_wdt iTCO_vendor_support > [ 605.112285] > [ 605.112419] Pid: 16666, comm: mount Not tainted 2.6.37stg #6 X8DTU/X8DTU > [ 605.112586] RIP: 0010:[<ffffffff81100a7a>] [<ffffffff81100a7a>] bio_add_pa...