Hi list, I just set up a configuration of several gluster servers (version 3.1.1-1) and one client (same version). On one of the servers, when I run /etc/init.d/glusterfsd and dive into /var/log/glusterfs/ directory, I have the following: $ sudo /etc/init.d/glusterd stop $ sudo /etc/init.d/glusterd start $ tail -n 20 /var/log/glusterfs/etc-glusterfs-glusterd.vol.log [2010-12-24 11:04:22.275284] I [glusterfsd.c:672:cleanup_and_exit] glusterfsd: shutting down [2010-12-24 11:04:27.923847] I [glusterd.c:275:init] management: Using /etc/glusterd as working directory [2010-12-24 11:04:27.924502] E [rpc-transport.c:905:rpc_transport_load] rpc-transport: /usr/lib/glusterfs/3.1.1/rpc-transport/rdma.so: cannot open shared object file: No such file or directory [2010-12-24 11:04:27.924523] E [rpc-transport.c:909:rpc_transport_load] rpc-transport: volume 'rdma.management': transport-type 'rdma' is not valid or not found on this machine [2010-12-24 11:04:27.924600] I [glusterd.c:87:glusterd_uuid_init] glusterd: retrieved UUID: a0f535fb-e176-47a3-a08a-b0600186e6f7 Given volfile: +------------------------------------------------------------------------------+ 1: volume management 2: type mgmt/glusterd 3: option working-directory /etc/glusterd 4: option transport-type socket,rdma 5: option transport.socket.keepalive-time 10 6: option transport.socket.keepalive-interval 2 7: end-volume 8: +------------------------------------------------------------------------------+ Apparently the .deb file doesn't provide any rdma.so file: $ dpkg -c glusterfs_3.1.1-1_amd64.deb | grep rdma $ Do you have any clue about what's happening? /g -- ????? ?????@Mail.Ru ? ???????? ? ??????????! http://r.mail.ru/cln4831/map.mail.ru/
Hi, Do you have libibverbs (and libibverbs-devel if you are using rpms) installed? One way of verifying is to check for the presence of file /usr/include/verbs/infiniband.h. libibverbs is a pre-requisite for building rdma. regards, Raghavendra. ----- Original Message -----> From: "void null" <guillaume at bk.ru> > To: gluster-users at gluster.org > Sent: Friday, December 24, 2010 2:35:38 PM > Subject: [Gluster-users] rdma.so file not found > Hi list, > > I just set up a configuration of several gluster servers (version > 3.1.1-1) and one client (same version). > > On one of the servers, when I run /etc/init.d/glusterfsd and dive into > /var/log/glusterfs/ directory, I have the following: > > $ sudo /etc/init.d/glusterd stop > $ sudo /etc/init.d/glusterd start > $ tail -n 20 /var/log/glusterfs/etc-glusterfs-glusterd.vol.log > > [2010-12-24 11:04:22.275284] I [glusterfsd.c:672:cleanup_and_exit] > glusterfsd: shutting down > [2010-12-24 11:04:27.923847] I [glusterd.c:275:init] management: Using > /etc/glusterd as working directory > [2010-12-24 11:04:27.924502] E > [rpc-transport.c:905:rpc_transport_load] rpc-transport: > /usr/lib/glusterfs/3.1.1/rpc-transport/rdma.so: cannot open shared > object file: No such file or directory > [2010-12-24 11:04:27.924523] E > [rpc-transport.c:909:rpc_transport_load] rpc-transport: volume > 'rdma.management': transport-type 'rdma' is not valid or not found on > this machine > [2010-12-24 11:04:27.924600] I [glusterd.c:87:glusterd_uuid_init] > glusterd: retrieved UUID: a0f535fb-e176-47a3-a08a-b0600186e6f7 > Given volfile: > +------------------------------------------------------------------------------+ > 1: volume management > 2: type mgmt/glusterd > 3: option working-directory /etc/glusterd > 4: option transport-type socket,rdma > 5: option transport.socket.keepalive-time 10 > 6: option transport.socket.keepalive-interval 2 > 7: end-volume > 8: > > +------------------------------------------------------------------------------+ > > Apparently the .deb file doesn't provide any rdma.so file: > > $ dpkg -c glusterfs_3.1.1-1_amd64.deb | grep rdma > $ > > > Do you have any clue about what's happening? > > /g > > -- > ????? ?????@Mail.Ru ? ???????? ? ??????????! > http://r.mail.ru/cln4831/map.mail.ru/ > > > _______________________________________________ > Gluster-users mailing list > Gluster-users at gluster.org > http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Hi,> Apparently the .deb file doesn't provide any rdma.so file: > > $ dpkg -c glusterfs_3.1.1-1_amd64.deb | grep rdma > $ > Do you have any clue about what's happening?I had the same experience while installing glusterfs. The deb file does indeed not contain the rdma module. I had to recompile/repackage to get a working version. Regards, J?rg Blank ------------------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------------------ Forschungszentrum Juelich GmbH 52425 Juelich Sitz der Gesellschaft: Juelich Eingetragen im Handelsregister des Amtsgerichts Dueren Nr. HR B 3498 Vorsitzender des Aufsichtsrats: MinDirig Dr. Karl Eugen Huthmacher Geschaeftsfuehrung: Prof. Dr. Achim Bachem (Vorsitzender), Dr. Ulrich Krafft (stellv. Vorsitzender), Prof. Dr.-Ing. Harald Bolt, Prof. Dr. Sebastian M. Schmidt ------------------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------------------