Arman Khalatyan
2017-Aug-15 10:07 UTC
[Gluster-users] Is transport=rdma tested with "stripe"?
looks like your rdma is not functional did you tested with qperf? On Mon, Aug 14, 2017 at 7:37 PM, Hatazaki, Takao <takao.hatazaki at hpe.com> wrote:> Forgot to mention that I was using CentOS7.3 and GlusterFS 3.10.3 that is > the latest available. > > > > *From:* gluster-users-bounces at gluster.org [mailto:gluster-users-bounces@ > gluster.org] *On Behalf Of *Hatazaki, Takao > *Sent:* Tuesday, August 15, 2017 2:32 AM > *To:* gluster-users at gluster.org > *Subject:* [Gluster-users] Is transport=rdma tested with "stripe"? > > > > Hi, > > > > I have 2 servers with Mellanox InfiniBand FDR hardware/software > installed. A volume with ?replica 2 transport rdma? works (create on > servers, mount and test on clients) ok. A volume with ?stripe 2 transport > tcp? works ok, too. A volume with ?stripe 2 transport rdma? created ok, > and mounted ok on a client, but writing a file caused ?endpoint not > connected? error on the client. Is this supposed to work or not tested? > > > > I wanted to check with experts before checking logs and other details. > > > > Regards, > > > > Takao > > > > _______________________________________________ > Gluster-users mailing list > Gluster-users at gluster.org > http://lists.gluster.org/mailman/listinfo/gluster-users >-------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.gluster.org/pipermail/gluster-users/attachments/20170815/1981a272/attachment.html>
Hatazaki, Takao
2017-Aug-15 10:42 UTC
[Gluster-users] Is transport=rdma tested with "stripe"?
Hi, I did ib_write_lat in perftest. It worked fine. Between servers and between server and client, 2-byte latency was ~0.8us, 8MB bandwidth was ~6GB/s. Very normal with IB/FDR. -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.gluster.org/pipermail/gluster-users/attachments/20170815/4217c89e/attachment.html>
Ji-Hyeon Gim
2017-Aug-15 10:55 UTC
[Gluster-users] Is transport=rdma tested with "stripe"?
Hi Takao. Could you attach some logs which we can diagnostic? On 2017? 08? 15? 19:42, Hatazaki, Takao wrote:> > Hi, > > > > I did ib_write_lat in perftest. It worked fine. Between servers and > between server and client, 2-byte latency was ~0.8us, 8MB bandwidth > was ~6GB/s. Very normal with IB/FDR. > > > > _______________________________________________ > Gluster-users mailing list > Gluster-users at gluster.org > http://lists.gluster.org/mailman/listinfo/gluster-usersBest regards. -- Ji-Hyeon Gim Research Engineer, Gluesys Address. Gluesys R&D Center, 5F, 11-31, Simin-daero 327beon-gil, Dongan-gu, Anyang-si, Gyeonggi-do, Korea (14055) Phone. +82-70-8787-1053 Fax. +82-31-388-3261 Mobile. +82-10-7293-8858 E-Mail. potatogim at potatogim.net Website. www.potatogim.net The time I wasted today is the tomorrow the dead man was eager to see yesterday. - Sophocles -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 516 bytes Desc: OpenPGP digital signature URL: <http://lists.gluster.org/pipermail/gluster-users/attachments/20170815/e21f9b95/attachment.sig>
Ji-Hyeon Gim
2017-Aug-15 12:16 UTC
[Gluster-users] Is transport=rdma tested with "stripe"?
[ Hi Takao. Could you attach some logs which we can diagnostic? On 2017? 08? 15? 19:42, Hatazaki, Takao wrote:> > Hi, > > > > I did ib_write_lat in perftest. It worked fine. Between servers and > between server and client, 2-byte latency was ~0.8us, 8MB bandwidth > was ~6GB/s. Very normal with IB/FDR. > > > > _______________________________________________ > Gluster-users mailing list > Gluster-users at gluster.org > http://lists.gluster.org/mailman/listinfo/gluster-usersBest regards. -- Ji-Hyeon Gim Research Engineer, Gluesys Address. Gluesys R&D Center, 5F, 11-31, Simin-daero 327beon-gil, Dongan-gu, Anyang-si, Gyeonggi-do, Korea (14055) Phone. +82-70-8787-1053 Fax. +82-31-388-3261 Mobile. +82-10-7293-8858 E-Mail. potatogim at potatogim.net Website. www.potatogim.net The time I wasted today is the tomorrow the dead man was eager to see yesterday. - Sophocles Best regards. -- Ji-Hyeon Gim Research Engineer, Gluesys Address. Gluesys R&D Center, 5F, 11-31, Simin-daero 327beon-gil, Dongan-gu, Anyang-si, Gyeonggi-do, Korea (14055) Phone. +82-70-8787-1053 Fax. +82-31-388-3261 Mobile. +82-10-7293-8858 E-Mail. potatogim at potatogim.net Website. www.potatogim.net The time I wasted today is the tomorrow the dead man was eager to see yesterday. - Sophocles -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 516 bytes Desc: OpenPGP digital signature URL: <http://lists.gluster.org/pipermail/gluster-users/attachments/20170815/e1bcae9a/attachment.sig>