jayakrishnan mm
2016-Aug-22 07:33 UTC
[Gluster-users] Unable to start volume : libgfdb.so missing
Glusterfs 3.7.6 Host: x86_64-linux (both client & Server) Volume : Disperse Create volume is success. But when I am unable to start the volume. Brick log says libgfdb.so.0 can't be opened. How can I install this ? There is no mention about such lib in the build requirements ( https://gluster.readthedocs.io/en/latest/Developer-guide/Building-GlusterFS/ ) I could start it by force. But gluster vol status show Status of volume: dsi4-vol Gluster process TCP Port RDMA Port Online Pid ------------------------------------------------------------------------------ Brick 192.168.36.200:/home/jaya/gluster/dsi 4-brick1 N/A N/A N N/A Brick 192.168.36.200:/home/jaya/gluster/dsi 4-brick2 N/A N/A N N/A Brick 192.168.36.200:/home/jaya/gluster/dsi 4-brick3 N/A N/A N N/A Brick 192.168.36.200:/home/jaya/gluster/dsi 4-brick4 N/A N/A N N/A Brick 192.168.36.200:/home/jaya/gluster/dsi 4-brick5 N/A N/A N N/A Brick 192.168.36.200:/home/jaya/gluster/dsi 4-brick6 N/A N/A N N/A Brick 192.168.36.200:/home/jaya/gluster/dsi 4-brick7 N/A N/A N N/A Brick 192.168.36.200:/home/jaya/gluster/dsi 4-brick8 N/A N/A N N/A NFS Server on localhost N/A N/A N N/A Task Status of Volume dsi4-vol ------------------------------------------------------------------------------ There are no active volume tasks Pls help. best regards JK *usr-local-etc-glusterfs-glusterd.vol.log * *================================* [2016-08-20 10:31:34.712494] I [MSGID: 100030] [glusterfsd.c:2319:main] 0-/usr/local/sbin/glusterd: Started running /usr/local/sbin/glusterd version 3.7.6 (args: /usr/local/sbin/glusterd -p /var/run/glusterd.pid) [2016-08-20 10:31:34.718198] I [MSGID: 106478] [glusterd.c:1350:init] 0-management: Maximum allowed open file descriptors set to 65536 [2016-08-20 10:31:34.718246] I [MSGID: 106479] [glusterd.c:1399:init] 0-management: Using /var/lib/glusterd as working directory [2016-08-20 10:31:34.723445] W [MSGID: 103071] [rdma.c:4592:__gf_rdma_ctx_create] 0-rpc-transport/rdma: rdma_cm event channel creation failed [No such device] [2016-08-20 10:31:34.723479] W [MSGID: 103055] [rdma.c:4899:init] 0-rdma.management: Failed to initialize IB Device [2016-08-20 10:31:34.723490] W [rpc-transport.c:359:rpc_transport_load] 0-rpc-transport: 'rdma' initialization failed [2016-08-20 10:31:34.723558] W [rpcsvc.c:1597:rpcsvc_transport_create] 0-rpc-service: cannot create listener, initing the transport failed [2016-08-20 10:31:34.723573] E [MSGID: 106243] [glusterd.c:1623:init] 0-management: creation of 1 listeners failed, continuing with succeeded transport [2016-08-20 10:31:37.028385] I [MSGID: 106513] [glusterd-store.c:2071:glusterd_restore_op_version] 0-glusterd: retrieved op-version: 30706 [2016-08-20 10:31:37.028524] I [MSGID: 106194] [glusterd-store.c:3543:glusterd_store_retrieve_missed_snaps_list] 0-management: No missed snaps list. Final graph: +------------------------------------------------------------------------------+ 1: volume management 2: type mgmt/glusterd 3: option rpc-auth.auth-glusterfs on 4: option rpc-auth.auth-unix on 5: option rpc-auth.auth-null on 6: option rpc-auth-allow-insecure on 7: option transport.socket.listen-backlog 128 8: option ping-timeout 30 9: option transport.socket.read-fail-log off 10: option transport.socket.keepalive-interval 2 11: option transport.socket.keepalive-time 10 12: option transport-type rdma [2016-08-20 10:31:37.030150] I [MSGID: 101190] [event-epoll.c:633:event_dispatch_epoll_worker] 0-epoll: Started thread with index 2 13: option working-directory /var/lib/glusterd 14: end-volume 15: +------------------------------------------------------------------------------+ [2016-08-20 10:31:37.031436] I [MSGID: 101190] [event-epoll.c:633:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1 [2016-08-20 10:31:37.031508] I [MSGID: 101190] [event-epoll.c:633:event_dispatch_epoll_worker] 0-epoll: Started thread with index 2 [2016-08-20 10:31:37.139926] I [MSGID: 106544] [glusterd.c:159:glusterd_uuid_init] 0-management: retrieved UUID: 543ab2b3-de06-4655-b228-a1f085643613 2016-08-20 10:31:37.439380] W [common-utils.c:1685:gf_string2boolean] (-->/usr/local/lib/glusterfs/3.7.6/xlator/mgmt/glusterd.so(glusterd_op_commit_perform+0x7ab) [0x7f4fc382ad4b] -->/usr/local/lib/glusterfs/3.7.6/xlator/mgmt/glusterd.so(glusterd_op_start_volume+0x2c0) [0x7f4fc38a9be0] -->/usr/local/lib/libglusterfs.so.0(gf_string2boolean+0x15a) [0x7f4fc85fa0ca] ) 0-management: argument invalid [Invalid argument] [2016-08-20 10:31:37.695564] I [MSGID: 106144] [glusterd-pmap.c:274:pmap_registry_remove] 0-pmap: removing brick (null) on port 49152 [2016-08-20 10:31:37.698522] E [MSGID: 106005] [glusterd-utils.c:4555:glusterd_brick_start] 0-management: Unable to start brick 192.168.36.200:/home/jaya/gluster/dsi4-brick1 [2016-08-20 10:31:37.698565] E [MSGID: 106123] [glusterd-syncop.c:1404:gd_commit_op_phase] 0-management: Commit of operation 'Volume Start' failed on localhost *Brick log* *=======* [2016-08-20 10:31:37.686308] I [MSGID: 100030] [glusterfsd.c:2319:main] 0-/usr/local/sbin/glusterfsd: Started running /usr/local/sbin/glusterfsd version 3.7.6 (args: /usr/local/sbin/glusterfsd -s 192.168.36.200 --volfile-id dsi4-vol.192.168.36.200.home-jaya-gluster-dsi4-brick1 -p /var/lib/glusterd/vols/dsi4-vol/run/192.168.36.200-home-jaya-gluster-dsi4-brick1.pid -S /var/run/gluster/e67b36356fafc43687bf7d413d77ca67.socket --brick-name /home/jaya/gluster/dsi4-brick1 -l /var/log/glusterfs/bricks/home-jaya-gluster-dsi4-brick1.log --xlator-option *-posix.glusterd-uuid=543ab2b3-de06-4655-b228-a1f085643613 --brick-port 49152 --xlator-option dsi4-vol-server.listen-port=49152) [2016-08-20 10:31:37.692946] I [MSGID: 101190] [event-epoll.c:633:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1 [2016-08-20 10:31:37.695015] W [MSGID: 101095] [xlator.c:196:xlator_dynload] 0-xlator: libgfdb.so.0: cannot open shared object file: No such file or directory [2016-08-20 10:31:37.695041] E [graph.y:212:volume_type] 0-parser: Volume 'dsi4-vol-changetimerecorder', line 16: type 'features/changetimerecorder' is not valid or not found on this machine [2016-08-20 10:31:37.695081] E [graph.y:321:volume_end] 0-parser: "type" not specified for volume dsi4-vol-changetimerecorder [2016-08-20 10:31:37.695220] E [MSGID: 100026] [glusterfsd.c:2174:glusterfs_process_volfp] 0-: failed to construct the graph [2016-08-20 10:31:37.695413] W [glusterfsd.c:1237:cleanup_and_exit] (-->/usr/local/sbin/glusterfsd(mgmt_getspec_cbk+0x307) [0x40d6f7] -->/usr/local/sbin/glusterfsd(glusterfs_process_volfp+0x116) [0x408bd6] -->/usr/local/sbin/glusterfsd(cleanup_and_exit+0x5d) [0x4082bd] ) 0-: received signum (0), shutting down -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://www.gluster.org/pipermail/gluster-users/attachments/20160822/23bdcf23/attachment.html>
Niels de Vos
2016-Aug-22 08:34 UTC
[Gluster-users] [Gluster-devel] Unable to start volume : libgfdb.so missing
On Mon, Aug 22, 2016 at 03:33:18PM +0800, jayakrishnan mm wrote:> Glusterfs 3.7.6 > Host: x86_64-linux (both client & Server) > > Volume : Disperse > > Create volume is success. But when I am unable to start the volume. > > > Brick log says libgfdb.so.0 can't be opened. How can I install this ? > There is no mention about such lib in the build requirements > ( > https://gluster.readthedocs.io/en/latest/Developer-guide/Building-GlusterFS/ > )This library is part of Gluster. It should have gotten installed when you did a 'make install'. Tiering (with changetimerecorder as one component) uses libgfdb. My RPMs build from the master branch have this dependency: # ldd /usr/lib64/glusterfs/3.9dev/xlator/features/changetimerecorder.so ... libgfdb.so.0 => /lib64/libgfdb.so.0 (0x00007f60a90ba000) ... Could you explain why you are building an old version like 3.7.6 from the sources, eventhough we have (regular updated) packages for many different distrubutions available? HTH, Niels> > I could start it by force. But gluster vol status show > > > Status of volume: dsi4-vol > Gluster process TCP Port RDMA Port Online Pid > ------------------------------------------------------------------------------ > Brick 192.168.36.200:/home/jaya/gluster/dsi > 4-brick1 N/A N/A N > N/A > Brick 192.168.36.200:/home/jaya/gluster/dsi > 4-brick2 N/A N/A N > N/A > Brick 192.168.36.200:/home/jaya/gluster/dsi > 4-brick3 N/A N/A N > N/A > Brick 192.168.36.200:/home/jaya/gluster/dsi > 4-brick4 N/A N/A N > N/A > Brick 192.168.36.200:/home/jaya/gluster/dsi > 4-brick5 N/A N/A N > N/A > Brick 192.168.36.200:/home/jaya/gluster/dsi > 4-brick6 N/A N/A N > N/A > Brick 192.168.36.200:/home/jaya/gluster/dsi > 4-brick7 N/A N/A N > N/A > Brick 192.168.36.200:/home/jaya/gluster/dsi > 4-brick8 N/A N/A N > N/A > NFS Server on localhost N/A N/A N > N/A > > Task Status of Volume dsi4-vol > ------------------------------------------------------------------------------ > There are no active volume tasks > > > > Pls help. > > best regards > JK > > > > *usr-local-etc-glusterfs-glusterd.vol.log * > *================================* > > [2016-08-20 10:31:34.712494] I [MSGID: 100030] [glusterfsd.c:2319:main] > 0-/usr/local/sbin/glusterd: Started running /usr/local/sbin/glusterd > version 3.7.6 (args: /usr/local/sbin/glusterd -p /var/run/glusterd.pid) > [2016-08-20 10:31:34.718198] I [MSGID: 106478] [glusterd.c:1350:init] > 0-management: Maximum allowed open file descriptors set to 65536 > [2016-08-20 10:31:34.718246] I [MSGID: 106479] [glusterd.c:1399:init] > 0-management: Using /var/lib/glusterd as working directory > [2016-08-20 10:31:34.723445] W [MSGID: 103071] > [rdma.c:4592:__gf_rdma_ctx_create] 0-rpc-transport/rdma: rdma_cm event > channel creation failed [No such device] > [2016-08-20 10:31:34.723479] W [MSGID: 103055] [rdma.c:4899:init] > 0-rdma.management: Failed to initialize IB Device > [2016-08-20 10:31:34.723490] W [rpc-transport.c:359:rpc_transport_load] > 0-rpc-transport: 'rdma' initialization failed > [2016-08-20 10:31:34.723558] W [rpcsvc.c:1597:rpcsvc_transport_create] > 0-rpc-service: cannot create listener, initing the transport failed > [2016-08-20 10:31:34.723573] E [MSGID: 106243] [glusterd.c:1623:init] > 0-management: creation of 1 listeners failed, continuing with succeeded > transport > [2016-08-20 10:31:37.028385] I [MSGID: 106513] > [glusterd-store.c:2071:glusterd_restore_op_version] 0-glusterd: retrieved > op-version: 30706 > [2016-08-20 10:31:37.028524] I [MSGID: 106194] > [glusterd-store.c:3543:glusterd_store_retrieve_missed_snaps_list] > 0-management: No missed snaps list. > Final graph: > +------------------------------------------------------------------------------+ > 1: volume management > 2: type mgmt/glusterd > 3: option rpc-auth.auth-glusterfs on > 4: option rpc-auth.auth-unix on > 5: option rpc-auth.auth-null on > 6: option rpc-auth-allow-insecure on > 7: option transport.socket.listen-backlog 128 > 8: option ping-timeout 30 > 9: option transport.socket.read-fail-log off > 10: option transport.socket.keepalive-interval 2 > 11: option transport.socket.keepalive-time 10 > 12: option transport-type rdma > [2016-08-20 10:31:37.030150] I [MSGID: 101190] > [event-epoll.c:633:event_dispatch_epoll_worker] 0-epoll: Started thread > with index 2 > 13: option working-directory /var/lib/glusterd > 14: end-volume > 15: > +------------------------------------------------------------------------------+ > [2016-08-20 10:31:37.031436] I [MSGID: 101190] > [event-epoll.c:633:event_dispatch_epoll_worker] 0-epoll: Started thread > with index 1 > [2016-08-20 10:31:37.031508] I [MSGID: 101190] > [event-epoll.c:633:event_dispatch_epoll_worker] 0-epoll: Started thread > with index 2 > > > [2016-08-20 10:31:37.139926] I [MSGID: 106544] > [glusterd.c:159:glusterd_uuid_init] 0-management: retrieved UUID: > 543ab2b3-de06-4655-b228-a1f085643613 > > 2016-08-20 10:31:37.439380] W [common-utils.c:1685:gf_string2boolean] > (-->/usr/local/lib/glusterfs/3.7.6/xlator/mgmt/glusterd.so(glusterd_op_commit_perform+0x7ab) > [0x7f4fc382ad4b] > -->/usr/local/lib/glusterfs/3.7.6/xlator/mgmt/glusterd.so(glusterd_op_start_volume+0x2c0) > [0x7f4fc38a9be0] > -->/usr/local/lib/libglusterfs.so.0(gf_string2boolean+0x15a) > [0x7f4fc85fa0ca] ) 0-management: argument invalid [Invalid argument] > > > [2016-08-20 10:31:37.695564] I [MSGID: 106144] > [glusterd-pmap.c:274:pmap_registry_remove] 0-pmap: removing brick (null) on > port 49152 > [2016-08-20 10:31:37.698522] E [MSGID: 106005] > [glusterd-utils.c:4555:glusterd_brick_start] 0-management: Unable to start > brick 192.168.36.200:/home/jaya/gluster/dsi4-brick1 > [2016-08-20 10:31:37.698565] E [MSGID: 106123] > [glusterd-syncop.c:1404:gd_commit_op_phase] 0-management: Commit of > operation 'Volume Start' failed on localhost > > > > > > *Brick log* > *=======* > > [2016-08-20 10:31:37.686308] I [MSGID: 100030] [glusterfsd.c:2319:main] > 0-/usr/local/sbin/glusterfsd: Started running /usr/local/sbin/glusterfsd > version 3.7.6 (args: /usr/local/sbin/glusterfsd -s 192.168.36.200 > --volfile-id dsi4-vol.192.168.36.200.home-jaya-gluster-dsi4-brick1 -p > /var/lib/glusterd/vols/dsi4-vol/run/192.168.36.200-home-jaya-gluster-dsi4-brick1.pid > -S /var/run/gluster/e67b36356fafc43687bf7d413d77ca67.socket --brick-name > /home/jaya/gluster/dsi4-brick1 -l > /var/log/glusterfs/bricks/home-jaya-gluster-dsi4-brick1.log --xlator-option > *-posix.glusterd-uuid=543ab2b3-de06-4655-b228-a1f085643613 --brick-port > 49152 --xlator-option dsi4-vol-server.listen-port=49152) > [2016-08-20 10:31:37.692946] I [MSGID: 101190] > [event-epoll.c:633:event_dispatch_epoll_worker] 0-epoll: Started thread > with index 1 > [2016-08-20 10:31:37.695015] W [MSGID: 101095] > [xlator.c:196:xlator_dynload] 0-xlator: libgfdb.so.0: cannot open shared > object file: No such file or directory > [2016-08-20 10:31:37.695041] E [graph.y:212:volume_type] 0-parser: Volume > 'dsi4-vol-changetimerecorder', line 16: type 'features/changetimerecorder' > is not valid or not found on this machine > [2016-08-20 10:31:37.695081] E [graph.y:321:volume_end] 0-parser: "type" > not specified for volume dsi4-vol-changetimerecorder > [2016-08-20 10:31:37.695220] E [MSGID: 100026] > [glusterfsd.c:2174:glusterfs_process_volfp] 0-: failed to construct the > graph > [2016-08-20 10:31:37.695413] W [glusterfsd.c:1237:cleanup_and_exit] > (-->/usr/local/sbin/glusterfsd(mgmt_getspec_cbk+0x307) [0x40d6f7] > -->/usr/local/sbin/glusterfsd(glusterfs_process_volfp+0x116) [0x408bd6] > -->/usr/local/sbin/glusterfsd(cleanup_and_exit+0x5d) [0x4082bd] ) 0-: > received signum (0), shutting down> _______________________________________________ > Gluster-devel mailing list > Gluster-devel at gluster.org > http://www.gluster.org/mailman/listinfo/gluster-devel-------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 819 bytes Desc: not available URL: <http://www.gluster.org/pipermail/gluster-users/attachments/20160822/db0eb41d/attachment.sig>