search for: qdr

Hi, all, Is the Xen currently compatible with the InfiniBand? I found some information about the Smart I/O module, but it was posted in 2006. Is the module still maintained? Or, are there any up-to-date alternatives for that? Many thanks, Chiu _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users

In IRC today, someone who was hitting that same IB performance ceiling that occasionally gets reported had this to say [11:50] <nissim> first, I ran fedora which is not supported by Mellanox OFED distro [11:50] <nissim> so I moved to CentOS 6.3 [11:51] <nissim> next I removed all distibution related infiniband rpms and build the latest OFED package [11:52] <nissim>

...lume now in mixed mode, config.transport=tcp,rdma). Mounting with transport=rdma shows this error, mouting with transport=tcp is fine. however, this problem does not arise on all large directories, not on all. I didn't recognize a pattern yet. I'm using glusterfs v3.12.6 on the servers, QDR Infiniband HCAs . Is this a known issue with RDMA transport? best wishes, Stefan

...toward Gluster 2.x. For some background, our compute cluster has 64 compute nodes. The gluster storage pool has 10 Dell PowerEdge R515 servers, each with 12 x 2 TB disks. We have another 16 Dell PowerEdge R515s used as Lustre storage servers. The compute and storage nodes are all connected via QDR Infiniband. Both Gluster and Lustre are set to use RDMA over Infiniband. We are using OFED version 1.5.2-20101219, Gluster 3.2.2 and CentOS 5.5 on both the compute and storage nodes. Oddly, it seems like there's some sort of bottleneck on the client side -- for example, we're only seei...

...et controller: Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01) 81:00.1 Ethernet controller: Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01) # lspci | grep Mellanox 06:00.0 InfiniBand: Mellanox Technologies MT26428 [ConnectX VPI PCIe 2.0 5GT/s - IB QDR / 10GigE] (rev b0) Originally the HBAs came up as host0, host1 and host2. After recent reboots we get host1, host2 and host3: # ls -l /sys/class/scsi_host/host* lrwxrwxrwx. 1 root root 0 Apr 9 19:10 /sys/class/scsi_host/host1 -> ../../devices/platform/host1/scsi_host/host1 lrwxrwxrwx. 1 root...

...fig.transport=tcp,rdma). Mounting > with transport=rdma shows this error, mouting with transport=tcp is fine. > > however, this problem does not arise on all large directories, not on all. > I didn't recognize a pattern yet. > > I'm using glusterfs v3.12.6 on the servers, QDR Infiniband HCAs . > > Is this a known issue with RDMA transport? > > best wishes, > Stefan > > _______________________________________________ > Gluster-users mailing list > Gluster-users at gluster.org > http://lists.gluster.org/mailman/listinfo/gluster-users > ---...

...Mounting >> with transport=rdma shows this error, mouting with transport=tcp is fine. >> >> however, this problem does not arise on all large directories, not on >> all. I didn't recognize a pattern yet. >> >> I'm using glusterfs v3.12.6 on the servers, QDR Infiniband HCAs . >> >> Is this a known issue with RDMA transport? >> >> best wishes, >> Stefan >> >> _______________________________________________ >> Gluster-users mailing list >> Gluster-users at gluster.org >> http://lists.gluster.org...

...output. Since this gluster storage was set up specifically for bioinformatics, this is a repeating problem and while some of the issues can be dealt with by trapping and converting output, it would be VERY NICE if we could deal with it at the OS level. The gluster volume is running over IPoIB on QDR IB and looks like this: Volume Name: gl Type: Distribute Volume ID: 21f480f7-fc5a-4fd8-a084-3964634a9332 Status: Started Number of Bricks: 8 Transport-type: tcp,rdma Bricks: Brick1: bs2:/raid1 Brick2: bs2:/raid2 Brick3: bs3:/raid1 Brick4: bs3:/raid2 Brick5: bs4:/raid1 Brick6: bs4:/raid2 Brick7: bs1...

...dd with bs=128K with 100GB data file generated from /dev/urandom. 1. volume transport set to RDMA is very very unstable. disconnecting all the time even with minimal load. I've found that when it does work the speeds are very fast - was getting around 1.4 - 1.6GB/s with 16 threads on 40gbit/s QDR link. 2. volume transport set to tcp works over IPoIB interface, but i've not managed to get a good level of performance with real data. I was maxing about 220MB/s with a single thread and around 550MB/s with 12 or more threads. Benchmarking with a huge file made from /dev/zero gives me arou...

...de, config.transport=tcp,rdma). Mounting with transport=rdma shows this error, mouting with transport=tcp is fine. > > however, this problem does not arise on all large directories, not on all. I didn't recognize a pattern yet. > > I'm using glusterfs v3.12.6 on the servers, QDR Infiniband HCAs . > > Is this a known issue with RDMA transport? > > best wishes, > Stefan > > _______________________________________________ > Gluster-users mailing list > Gluster-users at gluster.org > http://lists.gluster.org/mailman/listinfo/gluster-users >...

On 2017-08-24 13:00, Rowland Penny via samba wrote: > On Thu, 24 Aug 2017 12:41:36 +0200 > Sven Schwedas via samba <samba at lists.samba.org> wrote: > >> On 2017-08-24 12:27, Rowland Penny via samba wrote: >>> On Thu, 24 Aug 2017 12:03:42 +0200 >>> Sven Schwedas via samba <samba at lists.samba.org> wrote: >>> >>>> >>>>

...volreset ---- Good luck, if you need more help, you know where to find us. ;-) ( ps, when its all done, DONT run samba-tool ntacl sysvolreset again, never ever ) Until this bug is fixed. ( more GPO tips, google: https://www.google.nl/search?q=samba+L.P.H.+van+belle+GPO&source=lnt&tbs=qdr:y&sa=X&ved=0ahUKEwiknfbu-O_VAhXFh7QKHTa6DGoQpwUIHg&biw=1680&bih=853 ) Greetz, Louis > -----Oorspronkelijk bericht----- > Van: samba [mailto:samba-bounces at lists.samba.org] Namens > Rowland Penny via samba > Verzonden: donderdag 24 augustus 2017 14:42 > Aan:...

...gt; For some background, our compute cluster has 64 compute nodes. The gluste= r > storage pool has 10 Dell PowerEdge R515 servers, each with 12 x 2 TB disk= s. > We have another 16 Dell PowerEdge R515s used as Lustre storage servers. T= he > compute and storage nodes are all connected via QDR Infiniband. Both Glus= ter > and Lustre are set to use RDMA over Infiniband. We are using OFED version > 1.5.2-20101219, Gluster 3.2.2 and CentOS 5.5 on both the compute and stor= age > nodes. > > Oddly, it seems like there''s some sort of bottleneck on the client side -= - &...

hi Geoffrey, Since you are saying it happens on all types of volumes, lets do the following: 1) Create a dist-repl volume 2) Set the options etc you need. 3) enable gluster volume profile using "gluster volume profile <volname> start" 4) run the work load 5) give output of "gluster volume profile <volname> info" Repeat the steps above on new and old

...u know where to find us. ;-) > > ( ps, when its all done, DONT run samba-tool ntacl > sysvolreset again, never ever ) > > Until this bug is fixed. > > > > ( more GPO tips, google: > https://www.google.nl/search?q=samba+L.P.H.+van+belle+GPO&sour ce=lnt&tbs=qdr:y&sa=X&ved=0ahUKEwiknfbu-> O_VAhXFh7QKHTa6DGoQpwUIHg&biw=1680&bih=853 ) > > > > > > > > Greetz, > > > > Louis > > > >> -----Oorspronkelijk bericht----- > >> Van: samba [mailto:samba-bounces at lists.samba.org] Nam...

The most recent message is: [3108269.919256] sd 2:0:1:0: timing out command, waited 1080s [3108269.919528] sd 2:0:1:0: [sdb] Unhandled error code [3108269.919535] sd 2:0:1:0: [sdb] Result: hostbyte=DID_OK driverbyte=DRIVER_OK [3108269.919540] sd 2:0:1:0: [sdb] CDB: Read(10): 28 00 00 01 21 47 00 00 08 00 [3108269.919586] EXT4-fs error (device sdb1): ext4_find_entry: reading directory #2 offset 0

Hi all, Does anyone have, or know of a comparison chart of the different network adapters, i.e. 1GB / 10GB, Infiniband, etc. And if possible with a few top brand NIC's and switches listed as well. I would like to see, for example, what the max throughput is of a 1GB NIC (and this could probably differ from PCI to PCIE-x1 to PCIE-x4), and 10GBE. Different switches would probably also have

Hi, up until now I've always deployed VMs with their storage located directly on the host system but as the number of VMs grows and the hardware becomes more powerful and can handle more virtual machines I'm concerned about a failure of the host taking down too many VMs in one go. As a result I'm now looking at moving to an infrastructure that uses shared storage instead so I can

...n its all done, DONT run samba-tool ntacl > >> sysvolreset again, never ever ) > >>> Until this bug is fixed. > >>> > >>> ( more GPO tips, google: > >> https://www.google.nl/search?q=samba+L.P.H.+van+belle+GPO&sour > > ce=lnt&tbs=qdr:y&sa=X&ved=0ahUKEwiknfbu-> > > O_VAhXFh7QKHTa6DGoQpwUIHg&biw=1680&bih=853 ) > >>> > >>> > >>> > >>> Greetz, > >>> > >>> Louis > >>> > >>>> -----Oorspronkelijk bericht----- &g...

...NT run samba-tool ntacl >>>> sysvolreset again, never ever ) >>>>> Until this bug is fixed. >>>>> >>>>> ( more GPO tips, google: >>>> https://www.google.nl/search?q=samba+L.P.H.+van+belle+GPO&sour >>> ce=lnt&tbs=qdr:y&sa=X&ved=0ahUKEwiknfbu-> >>> O_VAhXFh7QKHTa6DGoQpwUIHg&biw=1680&bih=853 ) >>>>> >>>>> >>>>> >>>>> Greetz, >>>>> >>>>> Louis >>>>> >>>>>> -----Oor...