Gluster users - Aug 2011 - Problem running Gluterfs over Infiniband

Dear List,

We  have lots of issues  running Glusterfs over Infiniband.  The client 
can mount the share, but when trying to access it  by ls, df,  touch du 
or any other  kind  the client hosts freeze the accessing shell and 
reboot is hardly possible.

OS:  CentOS 6.0 64 bit on i7  2600k machines
Version: GlusterFS 3.2.2, also found  in lower 3.2.1
Kernel Version 2.6.32
IB Stack and kernel moduls taken and built  from OFED /Open Fabrics (1.5.3)

/IP over IB works, I can ping ober Ib between the maschines,

Gluster System complains though  about RDMA errors...

IB Cards used: Mellanox  (kernel module mthca) dual port, 40GBps
one port per card only configured, used and  plugged on.


/
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://supercolony.gluster.org/pipermail/gluster-users/attachments/20110805/4230af34/attachment.html>

Sorry, that went out too fast,
forgotten
to sign
Greetings,
Vlad

Hi Vlad,

Would it be possible for you to provide the client log file?

Thanks,
Vijay



On Fri, Aug 5, 2011 at 8:04 PM, Vlad Popa <vlad at cosy.sbg.ac.at> wrote:
> **
> Dear List,
>
> We  have lots of issues  running Glusterfs over Infiniband.  The client can
> mount the share, but when trying to access it  by ls, df,  touch du or any
> other  kind  the client hosts freeze the accessing shell and reboot is
> hardly possible.
>
> OS:  CentOS 6.0 64 bit on i7  2600k machines
> Version: GlusterFS 3.2.2, also found  in lower 3.2.1
> Kernel Version 2.6.32
> IB Stack and kernel moduls taken and built  from OFED /Open Fabrics (1.5.3)
>
> *IP over IB works, I can ping ober Ib between the maschines,
>
> Gluster System complains though  about RDMA errors...
>
> IB Cards used: Mellanox  (kernel module mthca) dual port, 40GBps
> one port per card only configured, used and  plugged on.
>
>
> *
>
> _______________________________________________
> Gluster-users mailing list
> Gluster-users at gluster.org
> http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://supercolony.gluster.org/pipermail/gluster-users/attachments/20110805/7519956f/attachment.html>