thr3ads.net - Gluster users - [Gluster-users] Multiple versions on the same machine, errors on glusterd startup [Jan 2019]

If this information is useful, please help other people find it:
Share via:
Raphaël Yancey
2019-Jan-01 16:45 UTC
[Gluster-users] Multiple versions on the same machine, errors on glusterd startup

Hi,

I'm trying to host several GlusterFS versions on the same machine 
(3.8.8, 4.1.6 and 5.2), not to be ran together of course.

I built them with the following procedure (examples with 3.8.8):
> git clone https://github.com/gluster/glusterfs .
> git checkout v3.8.8
> ./autogen
> ./configure --program-suffix="-3.8.8"
> make
> sudo make install
> sudo cp -a extras/systemd/glusterd.service 
> /etc/systemd/system/glusterd-3.8.8.service
> sudo systemctl load glusterd-3.8.8I had to edit the service for it to execute the right version of glusterd:
> ExecStart=/usr/local/sbin/glusterd*-3.8.8* -p /var/run/glusterd.pid? 
> --log-level $LOG_LEVEL $GLUSTERD_OPTIONS
And I had to create symlinks for glusterd:
> cd /usr/local/sbin
> ln -s glusterd-3.8.8 glusterfsd-3.8.8I also ran ldconfig for good mesure...
> sudo ldconfig
When I run glusterd in the foreground (not even with systemd) I'm left 
with some errors and the process exits (errors emphasized):
> user at host0:~/glusterfs-3.8.8 on e5f3a990c [!?]# sudo glusterd-3.8.8 
> --debug
> [2019-01-01 16:23:37.120684] I [MSGID: 100030] 
> [glusterfsd.c:2454:main] 0-glusterd-3.8.8: Started running 
> glusterd-3.8.8 version 3.8.8 (args: glusterd-3.8.8 --debug)
> [2019-01-01 16:23:37.120765] D 
> [logging.c:1791:__gf_log_inject_timer_event] 0-logging-infra: Starting 
> timer now. Timeout = 120, current buf size = 5
> [2019-01-01 16:23:37.121187] D [MSGID: 0] [glusterfsd.c:660:get_volfp] 
> 0-glusterfsd: loading volume file /usr/local/etc/glusterfs/glusterd.vol
> [2019-01-01 16:23:37.137003] I [MSGID: 106478] [glusterd.c:1379:init] 
> 0-management: Maximum allowed open file descriptors set to 65536
> [2019-01-01 16:23:37.137064] I [MSGID: 106479] [glusterd.c:1428:init] 
> 0-management: Using /var/lib/glusterd as working directory
> [2019-01-01 16:23:37.137262] D [MSGID: 0] 
> [glusterd.c:406:glusterd_rpcsvc_options_build] 0-glusterd: 
> listen-backlog value: 128
> [2019-01-01 16:23:37.137683] D [rpcsvc.c:2316:rpcsvc_init] 
> 0-rpc-service: RPC service inited.
> [2019-01-01 16:23:37.137723] D [rpcsvc.c:1866:rpcsvc_program_register] 
> 0-rpc-service: New program registered: GF-DUMP, Num: 123451501, Ver: 
> 1, Port: 0
> [2019-01-01 16:23:37.137798] D 
> [rpc-transport.c:283:rpc_transport_load] 0-rpc-transport: attempt to 
> load file /usr/local/lib/glusterfs/3.8.8/rpc-transport/socket.so
> [2019-01-01 16:23:37.151778] D [socket.c:3938:socket_init] 
> 0-socket.management: Configued transport.tcp-user-timeout=0
> [2019-01-01 16:23:37.151823] D [socket.c:4021:socket_init] 
> 0-socket.management: SSL support on the I/O path is NOT enabled
> [2019-01-01 16:23:37.151862] D [socket.c:4024:socket_init] 
> 0-socket.management: SSL support for glusterd is NOT enabled
> [2019-01-01 16:23:37.151890] D [socket.c:4041:socket_init] 
> 0-socket.management: using system polling thread
> [2019-01-01 16:23:37.151927] D [name.c:584:server_fill_address_family] 
> 0-socket.management: option address-family not specified, defaulting 
> to inet
> [2019-01-01 16:23:37.152173] D 
> [rpc-transport.c:283:rpc_transport_load] 0-rpc-transport: attempt to 
> load file /usr/local/lib/glusterfs/3.8.8/rpc-transport/rdma.so
> [2019-01-01 16:23:37.155510] D 
> [rpc-transport.c:321:rpc_transport_load] 0-rpc-transport: dlsym 
> (gf_rpc_transport_reconfigure) on 
> /usr/local/lib/glusterfs/3.8.8/rpc-transport/rdma.so: undefined 
> symbol: reconfigure
> [2019-01-01 16:23:37.155830] W [MSGID: 103071] 
> [rdma.c:4589:__gf_rdma_ctx_create] 0-rpc-transport/rdma: rdma_cm event 
> channel creation failed [No such device]
> [2019-01-01 16:23:37.155884] W [MSGID: 103055] [rdma.c:4896:init] 
> 0-rdma.management: Failed to initialize IB Device
> [2019-01-01 16:23:37.155920] W 
> [rpc-transport.c:354:rpc_transport_load] 0-rpc-transport: 'rdma' 
> initialization failed
> [2019-01-01 16:23:37.156224] W [rpcsvc.c:1638:rpcsvc_create_listener] 
> 0-rpc-service: cannot create listener, initing the transport failed
> *[2019-01-01 16:23:37.156258] E [MSGID: 106243] [glusterd.c:1652:init] 
> 0-management: creation of 1 listeners failed, continuing with 
> succeeded transport*
> [2019-01-01 16:23:37.156300] D [rpcsvc.c:1866:rpcsvc_program_register] 
> 0-rpc-service: New program registered: GlusterD svc peer, Num: 
> 1238437, Ver: 2, Port: 0
> [2019-01-01 16:23:37.156332] D [rpcsvc.c:1866:rpcsvc_program_register] 
> 0-rpc-service: New program registered: GlusterD svc cli read-only, 
> Num: 1238463, Ver: 2, Port: 0
> [2019-01-01 16:23:37.156356] D [rpcsvc.c:1866:rpcsvc_program_register] 
> 0-rpc-service: New program registered: GlusterD svc mgmt, Num: 
> 1238433, Ver: 2, Port: 0
> [2019-01-01 16:23:37.156384] D [rpcsvc.c:1866:rpcsvc_program_register] 
> 0-rpc-service: New program registered: GlusterD svc mgmt v3, Num: 
> 1238433, Ver: 3, Port: 0
> [2019-01-01 16:23:37.156414] D [rpcsvc.c:1866:rpcsvc_program_register] 
> 0-rpc-service: New program registered: Gluster Portmap, Num: 34123456, 
> Ver: 1, Port: 0
> [2019-01-01 16:23:37.156438] D [rpcsvc.c:1866:rpcsvc_program_register] 
> 0-rpc-service: New program registered: Gluster Handshake, Num: 
> 14398633, Ver: 2, Port: 0
> [2019-01-01 16:23:37.156468] D [rpcsvc.c:1866:rpcsvc_program_register] 
> 0-rpc-service: New program registered: Gluster MGMT Handshake, Num: 
> 1239873, Ver: 1, Port: 0
> [2019-01-01 16:23:37.156591] D [rpcsvc.c:2316:rpcsvc_init] 
> 0-rpc-service: RPC service inited.
> [2019-01-01 16:23:37.156619] D [rpcsvc.c:1866:rpcsvc_program_register] 
> 0-rpc-service: New program registered: GF-DUMP, Num: 123451501, Ver: 
> 1, Port: 0
> [2019-01-01 16:23:37.156665] D 
> [rpc-transport.c:283:rpc_transport_load] 0-rpc-transport: attempt to 
> load file /usr/local/lib/glusterfs/3.8.8/rpc-transport/socket.so
> [2019-01-01 16:23:37.156854] D [socket.c:3887:socket_init] 
> 0-socket.management: disabling nodelay
> [2019-01-01 16:23:37.156882] D [socket.c:3938:socket_init] 
> 0-socket.management: Configued transport.tcp-user-timeout=0
> [2019-01-01 16:23:37.156912] D [socket.c:4021:socket_init] 
> 0-socket.management: SSL support on the I/O path is NOT enabled
> [2019-01-01 16:23:37.156933] D [socket.c:4024:socket_init] 
> 0-socket.management: SSL support for glusterd is NOT enabled
> [2019-01-01 16:23:37.156961] D [socket.c:4041:socket_init] 
> 0-socket.management: using system polling thread
> [2019-01-01 16:23:37.157095] D [rpcsvc.c:1866:rpcsvc_program_register] 
> 0-rpc-service: New program registered: GlusterD svc cli, Num: 1238463, 
> Ver: 2, Port: 0
> [2019-01-01 16:23:37.157125] D [rpcsvc.c:1866:rpcsvc_program_register] 
> 0-rpc-service: New program registered: Gluster Handshake (CLI 
> Getspec), Num: 14398633, Ver: 2, Port: 0
> [2019-01-01 16:23:37.157282] D [MSGID: 0] 
> [glusterd-utils.c:6379:glusterd_sm_tr_log_init] 0-glusterd: returning 0
> [2019-01-01 16:23:37.157318] D [MSGID: 0] [glusterd.c:1720:init] 
> 0-management: cannot get run-with-valgrind value
> *[2019-01-01 16:23:37.170633] E [MSGID: 106229] 
> [glusterd.c:455:glusterd_check_gsync_present] 0-glusterd: 
> geo-replication module not working as desired*
> [2019-01-01 16:23:37.171476] D [MSGID: 0] 
> [glusterd.c:465:glusterd_check_gsync_present] 0-glusterd: Returning -1
> *[2019-01-01 16:23:37.171572] E [MSGID: 101019] 
> [xlator.c:433:xlator_init] 0-management: Initialization of volume 
> 'management' failed, review your volfile again*
> *[2019-01-01 16:23:37.171613] E [MSGID: 101066] 
> [graph.c:324:glusterfs_graph_init] 0-management: initializing 
> translator failed*
> *[2019-01-01 16:23:37.171649] E [MSGID: 101176] 
> [graph.c:673:glusterfs_graph_activate] 0-graph: init failed*
> [2019-01-01 16:23:37.173130] D 
> [logging.c:1765:gf_log_flush_extra_msgs] 0-logging-infra: Log buffer 
> size reduced. About to flush 5 extra log messages
> [2019-01-01 16:23:37.173187] D 
> [logging.c:1768:gf_log_flush_extra_msgs] 0-logging-infra: Just flushed 
> 5 extra log messages
> [2019-01-01 16:23:37.173280] W [MSGID: 100032] 
> [glusterfsd.c:1327:cleanup_and_exit] 0-: received signum (1), shutting 
> down
> [2019-01-01 16:23:37.173335] D 
> [glusterfsd-mgmt.c:2385:glusterfs_mgmt_pmap_signout] 0-fsd-mgmt: 
> portmapper signout arguments not given
I can't pin what particular error caused the process to exit and I 
failed findind informations on the 'management' volume fail... any
hints?

Thanks,
Raphael.

-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://lists.gluster.org/pipermail/gluster-users/attachments/20190101/a19482d9/attachment.html>
Gluster users - Jan 2019 - Multiple versions on the same machine, errors on glusterd startup

[Gluster-users] Multiple versions on the same machine, errors on glusterd startup
