Cesar da Silva
2017-Aug-20 21:19 UTC
[Gluster-users] Glusterd not working with systemd in redhat 7
Hi! I am having same issue but I am running Ubuntu v16.04. It does not mount during boot, but works if I mount it manually. I am running the Gluster-server on the same machines (3 machines) Here is the /tc/fstab file /dev/sdb1 /data/gluster ext4 defaults 0 0 web1.dasilva.network:/www /mnt/glusterfs/www glusterfs defaults,_netdev,log-level=debug,log-file=/var/log/gluster.log 0 0 web1.dasilva.network:/etc /mnt/glusterfs/etc glusterfs defaults,_netdev,log-level=debug,log-file=/var/log/gluster.log 0 0 Here is the logfile /var/log/gluster.log --8<--start of log file ---------------------------------- [2017-08-20 20:30:39.638989] I [MSGID: 100030] [glusterfsd.c:2476:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.11.2 (args: /usr/sbin/glusterfs --log-level=DEBUG --log-file=/var/log/gluster.log --volfile-server=web1.dasilva.network --volfile-id=/www /mnt/glusterfs/www) [2017-08-20 20:30:39.639024] I [MSGID: 100030] [glusterfsd.c:2476:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.11.2 (args: /usr/sbin/glusterfs --log-level=DEBUG --log-file=/var/log/gluster.log --volfile-server=web1.dasilva.network --volfile-id=/etc /mnt/glusterfs/etc) [2017-08-20 20:30:39.926333] D [MSGID: 0] [glusterfsd.c:442:set_fuse_mount_options] 0-glusterfsd: fopen-keep-cache mode 2 [2017-08-20 20:30:39.926376] D [MSGID: 0] [glusterfsd.c:506:set_fuse_mount_options] 0-glusterfsd: fuse direct io type 2 [2017-08-20 20:30:39.926389] D [MSGID: 0] [glusterfsd.c:530:set_fuse_mount_options] 0-glusterfsd: fuse no-root-squash mode 0 [2017-08-20 20:30:39.926486] D [MSGID: 0] [options.c:1224:xlator_option_init_double] 0-fuse: option negative-timeout using set value 0.000000 [2017-08-20 20:30:39.926532] D [MSGID: 0] [glusterfsd.c:442:set_fuse_mount_options] 0-glusterfsd: fopen-keep-cache mode 2 [2017-08-20 20:30:39.926557] D [MSGID: 0] [glusterfsd.c:506:set_fuse_mount_options] 0-glusterfsd: fuse direct io type 2 [2017-08-20 20:30:39.926569] D [MSGID: 0] [glusterfsd.c:530:set_fuse_mount_options] 0-glusterfsd: fuse no-root-squash mode 0 [2017-08-20 20:30:39.926568] D [MSGID: 0] [options.c:1221:xlator_option_init_bool] 0-fuse: option no-root-squash using set value disable [2017-08-20 20:30:39.926649] D [MSGID: 0] [options.c:1224:xlator_option_init_double] 0-fuse: option negative-timeout using set value 0.000000 [2017-08-20 20:30:39.926726] D [MSGID: 0] [options.c:1221:xlator_option_init_bool] 0-fuse: option no-root-squash using set value disable [2017-08-20 20:30:39.927105] D [logging.c:1790:__gf_log_inject_timer_event] 0-logging-infra: Starting timer now. Timeout = 120, current buf size = 5 [2017-08-20 20:30:39.927359] D [rpc-clnt.c:1062:rpc_clnt_connection_init] 0-glusterfs: defaulting frame-timeout to 30mins [2017-08-20 20:30:39.927373] D [rpc-clnt.c:1076:rpc_clnt_connection_init] 0-glusterfs: disable ping-timeout [2017-08-20 20:30:39.927385] D [rpc-transport.c:279:rpc_transport_load] 0-rpc-transport: attempt to load file /usr/lib/x86_64-linux-gnu/glusterfs/3.11.2/rpc-transport/socket.so [2017-08-20 20:30:39.927774] D [logging.c:1790:__gf_log_inject_timer_event] 0-logging-infra: Starting timer now. Timeout = 120, current buf size = 5 [2017-08-20 20:30:39.927994] D [rpc-clnt.c:1062:rpc_clnt_connection_init] 0-glusterfs: defaulting frame-timeout to 30mins [2017-08-20 20:30:39.928008] D [rpc-clnt.c:1076:rpc_clnt_connection_init] 0-glusterfs: disable ping-timeout [2017-08-20 20:30:39.928019] D [rpc-transport.c:279:rpc_transport_load] 0-rpc-transport: attempt to load file /usr/lib/x86_64-linux-gnu/glusterfs/3.11.2/rpc-transport/socket.so [2017-08-20 20:30:40.380267] W [MSGID: 101002] [options.c:954:xl_opt_validate] 0-glusterfs: option 'address-family' is deprecated, preferred is 'transport.address-family', continuing with correction [2017-08-20 20:30:40.380391] D [socket.c:4163:socket_init] 0-glusterfs: Configued transport.tcp-user-timeout=0 [2017-08-20 20:30:40.380403] D [socket.c:4181:socket_init] 0-glusterfs: Reconfigued transport.keepalivecnt=9 [2017-08-20 20:30:40.380410] D [socket.c:4264:socket_init] 0-glusterfs: SSL support on the I/O path is NOT enabled [2017-08-20 20:30:40.380417] D [socket.c:4267:socket_init] 0-glusterfs: SSL support for glusterd is NOT enabled [2017-08-20 20:30:40.380423] D [socket.c:4284:socket_init] 0-glusterfs: using system polling thread [2017-08-20 20:30:40.380432] D [rpc-clnt.c:1581:rpcclnt_cbk_program_register] 0-glusterfs: New program registered: GlusterFS Callback, Num: 52743234, Ver: 1 [2017-08-20 20:30:40.382224] W [MSGID: 101002] [options.c:954:xl_opt_validate] 0-glusterfs: option 'address-family' is deprecated, preferred is 'transport.address-family', continuing with correction [2017-08-20 20:30:40.382305] D [socket.c:4163:socket_init] 0-glusterfs: Configued transport.tcp-user-timeout=0 [2017-08-20 20:30:40.382315] D [socket.c:4181:socket_init] 0-glusterfs: Reconfigued transport.keepalivecnt=9 [2017-08-20 20:30:40.382322] D [socket.c:4264:socket_init] 0-glusterfs: SSL support on the I/O path is NOT enabled [2017-08-20 20:30:40.382328] D [socket.c:4267:socket_init] 0-glusterfs: SSL support for glusterd is NOT enabled [2017-08-20 20:30:40.382334] D [socket.c:4284:socket_init] 0-glusterfs: using system polling thread [2017-08-20 20:30:40.382343] D [rpc-clnt.c:1581:rpcclnt_cbk_program_register] 0-glusterfs: New program registered: GlusterFS Callback, Num: 52743234, Ver: 1 [2017-08-20 20:30:40.466338] D [MSGID: 0] [common-utils.c:327:gf_resolve_ip6] 0-resolver: returning ip-192.168.1.8 (port-24007) for hostname: web1.dasilva.network and port: 24007 [2017-08-20 20:30:40.466364] D [MSGID: 0] [common-utils.c:327:gf_resolve_ip6] 0-resolver: returning ip-192.168.1.8 (port-24007) for hostname: web1.dasilva.network and port: 24007 [2017-08-20 20:30:40.466470] D [MSGID: 0] [common-utils.c:348:gf_resolve_ip6] 0-resolver: next DNS query will return: ip-192.168.1.19 port-24007 [2017-08-20 20:30:40.466480] D [MSGID: 0] [common-utils.c:348:gf_resolve_ip6] 0-resolver: next DNS query will return: ip-192.168.1.19 port-24007 [2017-08-20 20:30:40.466482] D [socket.c:3050:socket_fix_ssl_opts] 0-glusterfs: disabling SSL for portmapper connection [2017-08-20 20:30:40.466490] D [socket.c:3050:socket_fix_ssl_opts] 0-glusterfs: disabling SSL for portmapper connection [2017-08-20 20:30:40.466699] I [MSGID: 101190] [event-epoll.c:602:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1 [2017-08-20 20:30:40.466699] I [MSGID: 101190] [event-epoll.c:602:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1 [2017-08-20 20:30:40.466725] E [socket.c:2369:socket_connect_finish] 0-glusterfs: connection to 192.168.1.8:24007 failed (F?rbindelse v?gras); disconnecting socket [2017-08-20 20:30:40.466726] E [socket.c:2369:socket_connect_finish] 0-glusterfs: connection to 192.168.1.8:24007 failed (F?rbindelse v?gras); disconnecting socket [2017-08-20 20:30:40.466736] D [socket.c:686:__socket_shutdown] 0-glusterfs: shutdown() returned -1. Transportslutpunkten ?r inte f?rbunden [2017-08-20 20:30:40.466737] D [socket.c:686:__socket_shutdown] 0-glusterfs: shutdown() returned -1. Transportslutpunkten ?r inte f?rbunden [2017-08-20 20:30:40.466743] D [socket.c:733:__socket_disconnect] 0-glusterfs: __socket_teardown_connection () failed: Transportslutpunkten ?r inte f?rbunden [2017-08-20 20:30:40.466745] D [socket.c:733:__socket_disconnect] 0-glusterfs: __socket_teardown_connection () failed: Transportslutpunkten ?r inte f?rbunden [2017-08-20 20:30:40.466749] D [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:30:40.466751] D [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:30:40.466764] I [glusterfsd-mgmt.c:2171:mgmt_rpc_notify] 0-glusterfsd-mgmt: disconnected from remote-host: web1.dasilva.network [2017-08-20 20:30:40.466764] I [glusterfsd-mgmt.c:2171:mgmt_rpc_notify] 0-glusterfsd-mgmt: disconnected from remote-host: web1.dasilva.network [2017-08-20 20:30:40.658255] D [rpc-clnt-ping.c:99:rpc_clnt_remove_ping_timer_locked] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x13b)[0x7f3f0f82abbb] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked+0x84)[0x7f3f0f5fd074] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0xd4)[0x7f3f0f5f9774] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x288)[0x7f3f0f5fa218] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_transport_notify+0x23)[0x7f3f0f5f6493] ))))) 0-: 192.168.1.8:24007: ping timer event already removed [2017-08-20 20:30:40.658268] D [rpc-clnt-ping.c:99:rpc_clnt_remove_ping_timer_locked] (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x13b)[0x7f8f7039dbbb] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked+0x84)[0x7f8f70170074] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0xd4)[0x7f8f7016c774] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x288)[0x7f8f7016d218] (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_transport_notify+0x23)[0x7f8f70169493] ))))) 0-: 192.168.1.8:24007: ping timer event already removed [2017-08-20 20:30:43.928116] D [MSGID: 0] [common-utils.c:327:gf_resolve_ip6] 0-resolver: returning ip-192.168.1.19 (port-24007) for hostname: web1.dasilva.network and port: 24007 [2017-08-20 20:30:43.928164] D [socket.c:3050:socket_fix_ssl_opts] 0-glusterfs: disabling SSL for portmapper connection [2017-08-20 20:30:43.929085] D [MSGID: 0] [common-utils.c:327:gf_resolve_ip6] 0-resolver: returning ip-192.168.1.19 (port-24007) for hostname: web1.dasilva.network and port: 24007 [2017-08-20 20:30:43.929124] D [socket.c:3050:socket_fix_ssl_opts] 0-glusterfs: disabling SSL for portmapper connection [2017-08-20 20:30:46.927870] D [socket.c:686:__socket_shutdown] 0-glusterfs: shutdown() returned -1. Transportslutpunkten ?r inte f?rbunden [2017-08-20 20:30:46.927916] D [socket.c:733:__socket_disconnect] 0-glusterfs: __socket_teardown_connection () failed: Transportslutpunkten ?r inte f?rbunden [2017-08-20 20:30:46.927924] D [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:30:46.927935] I [glusterfsd-mgmt.c:2192:mgmt_rpc_notify] 0-glusterfsd-mgmt: Exhausted all volfile servers [2017-08-20 20:30:46.927938] D [socket.c:686:__socket_shutdown] 0-glusterfs: shutdown() returned -1. Transportslutpunkten ?r inte f?rbunden [2017-08-20 20:30:46.927959] D [socket.c:733:__socket_disconnect] 0-glusterfs: __socket_teardown_connection () failed: Transportslutpunkten ?r inte f?rbunden [2017-08-20 20:30:46.927966] D [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:30:46.927976] I [glusterfsd-mgmt.c:2192:mgmt_rpc_notify] 0-glusterfsd-mgmt: Exhausted all volfile servers [2017-08-20 20:30:46.928016] D [logging.c:1764:gf_log_flush_extra_msgs] 0-logging-infra: Log buffer size reduced. About to flush 5 extra log messages [2017-08-20 20:30:46.928028] D [logging.c:1767:gf_log_flush_extra_msgs] 0-logging-infra: Just flushed 5 extra log messages [2017-08-20 20:30:46.928058] W [glusterfsd.c:1331:cleanup_and_exit] (-->/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0xab) [0x7f8f7016d03b] -->/usr/sbin/glusterfs(+0x1041e) [0x55bfe6ff641e] -->/usr/sbin/glusterfs(cleanup_and_exit+0x54) [0x55bfe6fef6e4] ) 0-: received signum (1), shutting down [2017-08-20 20:30:46.928068] D [glusterfsd-mgmt.c:2653:glusterfs_mgmt_pmap_signout] 0-fsd-mgmt: portmapper signout arguments not given [2017-08-20 20:30:46.928085] I [fuse-bridge.c:5883:fini] 0-fuse: Unmounting '/mnt/glusterfs/www'. [2017-08-20 20:30:46.928447] D [logging.c:1764:gf_log_flush_extra_msgs] 0-logging-infra: Log buffer size reduced. About to flush 5 extra log messages [2017-08-20 20:30:46.928463] D [logging.c:1767:gf_log_flush_extra_msgs] 0-logging-infra: Just flushed 5 extra log messages [2017-08-20 20:30:46.928486] W [glusterfsd.c:1331:cleanup_and_exit] (-->/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0xab) [0x7f3f0f5fa03b] -->/usr/sbin/glusterfs(+0x1041e) [0x5638af0e941e] -->/usr/sbin/glusterfs(cleanup_and_exit+0x54) [0x5638af0e26e4] ) 0-: received signum (1), shutting down [2017-08-20 20:30:46.928495] D [glusterfsd-mgmt.c:2653:glusterfs_mgmt_pmap_signout] 0-fsd-mgmt: portmapper signout arguments not given [2017-08-20 20:30:46.928507] I [fuse-bridge.c:5883:fini] 0-fuse: Unmounting '/mnt/glusterfs/etc'. [2017-08-20 20:30:46.931358] D [MSGID: 0] [common-utils.c:327:gf_resolve_ip6] 0-resolver: returning ip-192.168.1.8 (port-24007) for hostname: web1.dasilva.network and port: 24007 [2017-08-20 20:30:46.931461] D [MSGID: 0] [common-utils.c:348:gf_resolve_ip6] 0-resolver: next DNS query will return: ip-192.168.1.19 port-24007 [2017-08-20 20:30:46.931469] D [socket.c:3050:socket_fix_ssl_opts] 0-glusterfs: disabling SSL for portmapper connection [2017-08-20 20:30:46.931585] I [timer.c:198:gf_timer_registry_init] (-->/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(+0x2ff6f) [0x7f8f703a8f6f] -->/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_reconnect+0xee) [0x7f8f7016c54e] -->/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(gf_timer_call_after+0x204) [0x7f8f703a9324] ) 0-timer: ctx cleanup started [2017-08-20 20:30:46.931626] E [timer.c:44:gf_timer_call_after] (-->/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(+0x2ff6f) [0x7f8f703a8f6f] -->/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_reconnect+0xee) [0x7f8f7016c54e] -->/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(gf_timer_call_after+0x245) [0x7f8f703a9365] ) 0-timer: !reg [2017-08-20 20:30:46.931634] E [rpc-clnt.c:432:rpc_clnt_reconnect] 0-glusterfs: Error adding to timer event queue [2017-08-20 20:30:46.932553] D [MSGID: 0] [common-utils.c:327:gf_resolve_ip6] 0-resolver: returning ip-192.168.1.8 (port-24007) for hostname: web1.dasilva.network and port: 24007 [2017-08-20 20:30:46.932664] D [MSGID: 0] [common-utils.c:348:gf_resolve_ip6] 0-resolver: next DNS query will return: ip-192.168.1.19 port-24007 [2017-08-20 20:30:46.932673] D [socket.c:3050:socket_fix_ssl_opts] 0-glusterfs: disabling SSL for portmapper connection [2017-08-20 20:30:46.932762] I [timer.c:198:gf_timer_registry_init] (-->/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(+0x2ff6f) [0x7f3f0f835f6f] -->/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_reconnect+0xee) [0x7f3f0f5f954e] -->/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(gf_timer_call_after+0x204) [0x7f3f0f836324] ) 0-timer: ctx cleanup started [2017-08-20 20:30:46.932802] E [timer.c:44:gf_timer_call_after] (-->/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(+0x2ff6f) [0x7f3f0f835f6f] -->/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_reconnect+0xee) [0x7f3f0f5f954e] -->/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(gf_timer_call_after+0x245) [0x7f3f0f836365] ) 0-timer: !reg [2017-08-20 20:30:46.932810] E [rpc-clnt.c:432:rpc_clnt_reconnect] 0-glusterfs: Error adding to timer event queue [2017-08-20 20:30:46.944014] I [fuse-bridge.c:5888:fini] 0-fuse: Closing fuse connection to '/mnt/glusterfs/etc'. [2017-08-20 20:30:46.944107] W [glusterfsd.c:1331:cleanup_and_exit] (-->/lib/x86_64-linux-gnu/libpthread.so.0(+0x76ba) [0x7f3f0efb96ba] -->/usr/sbin/glusterfs(glusterfs_sigwaiter+0xe5) [0x5638af0e28c5] -->/usr/sbin/glusterfs(cleanup_and_exit+0x54) [0x5638af0e26e4] ) 0-: received signum (15), shutting down [2017-08-20 20:30:46.948018] I [fuse-bridge.c:5888:fini] 0-fuse: Closing fuse connection to '/mnt/glusterfs/www'. [2017-08-20 20:30:46.948329] W [glusterfsd.c:1331:cleanup_and_exit] (-->/lib/x86_64-linux-gnu/libpthread.so.0(+0x76ba) [0x7f8f6fb2c6ba] -->/usr/sbin/glusterfs(glusterfs_sigwaiter+0xe5) [0x55bfe6fef8c5] -->/usr/sbin/glusterfs(cleanup_and_exit+0x54) [0x55bfe6fef6e4] ) 0-: received signum (15), shutting down --8<--end of log file ---------------------------------- As you can see bellow, the ports are also available tcp LISTEN 0 128 *:24007 *:* tcp TIME-WAIT 0 0 192.168.1.8:49110 192.168.1.8:24007 tcp TIME-WAIT 0 0 192.168.1.8:49081 192.168.1.8:24007 tcp TIME-WAIT 0 0 192.168.1.8:49118 192.168.1.8:24007 tcp ESTAB 0 0 192.168.1.8:49146 192.168.1.8:24007 tcp TIME-WAIT 0 0 192.168.1.8:49104 192.168.1.8:24007 tcp TIME-WAIT 0 0 192.168.1.8:49094 192.168.1.8:24007 tcp TIME-WAIT 0 0 192.168.1.8:49097 192.168.1.8:24007 tcp TIME-WAIT 0 0 192.168.1.8:49085 192.168.1.8:24007 tcp TIME-WAIT 0 0 192.168.1.8:49123 192.168.1.8:24007 tcp ESTAB 0 0 192.168.1.8:49151 192.168.1.10:24007 tcp TIME-WAIT 0 0 192.168.1.8:49096 192.168.1.8:24007 tcp TIME-WAIT 0 0 192.168.1.8:49101 192.168.1.8:24007 tcp TIME-WAIT 0 0 192.168.1.8:49103 192.168.1.8:24007 tcp TIME-WAIT 0 0 192.168.1.8:49088 192.168.1.8:24007 tcp TIME-WAIT 0 0 192.168.1.8:49087 192.168.1.8:24007 tcp TIME-WAIT 0 0 192.168.1.8:49140 192.168.1.8:24007 tcp TIME-WAIT 0 0 192.168.1.8:49125 192.168.1.8:24007 tcp TIME-WAIT 0 0 192.168.1.8:49147 192.168.1.8:24007 tcp TIME-WAIT 0 0 192.168.1.8:49138 192.168.1.8:24007 tcp TIME-WAIT 0 0 192.168.1.8:49093 192.168.1.8:24007 tcp TIME-WAIT 0 0 192.168.1.8:49098 192.168.1.8:24007 tcp TIME-WAIT 0 0 192.168.1.8:49091 192.168.1.8:24007 tcp TIME-WAIT 0 0 192.168.1.8:49119 192.168.1.8:24007 tcp ESTAB 0 0 127.0.0.1:24007 127.0.0.1:49147 tcp TIME-WAIT 0 0 192.168.1.8:49090 192.168.1.8:24007 tcp TIME-WAIT 0 0 192.168.1.8:49148 192.168.1.8:24007 tcp TIME-WAIT 0 0 192.168.1.8:49149 192.168.1.8:24007 tcp TIME-WAIT 0 0 192.168.1.8:49117 192.168.1.8:24007 tcp TIME-WAIT 0 0 192.168.1.8:49095 192.168.1.8:24007 tcp TIME-WAIT 0 0 192.168.1.8:49112 192.168.1.8:24007 tcp TIME-WAIT 0 0 192.168.1.8:49111 192.168.1.8:24007 tcp TIME-WAIT 0 0 192.168.1.8:49086 192.168.1.8:24007 tcp ESTAB 0 0 192.168.1.8:49150 192.168.1.9:24007 tcp TIME-WAIT 0 0 192.168.1.8:49142 192.168.1.8:24007 tcp TIME-WAIT 0 0 192.168.1.8:49141 192.168.1.8:24007 tcp TIME-WAIT 0 0 192.168.1.8:49084 192.168.1.8:24007 tcp TIME-WAIT 0 0 192.168.1.8:49100 192.168.1.8:24007 tcp ESTAB 0 0 127.0.0.1:49147 127.0.0.1:24007 tcp TIME-WAIT 0 0 192.168.1.8:49127 192.168.1.8:24007 tcp TIME-WAIT 0 0 192.168.1.8:49144 192.168.1.8:24007 tcp ESTAB 0 0 192.168.1.8:24007 192.168.1.8:49145 tcp TIME-WAIT 0 0 192.168.1.8:49139 192.168.1.8:24007 tcp TIME-WAIT 0 0 192.168.1.8:49089 192.168.1.8:24007 tcp TIME-WAIT 0 0 192.168.1.8:49102 192.168.1.8:24007 tcp TIME-WAIT 0 0 192.168.1.8:49083 192.168.1.8:24007 tcp TIME-WAIT 0 0 192.168.1.8:49129 192.168.1.8:24007 tcp TIME-WAIT 0 0 192.168.1.8:49114 192.168.1.8:24007 tcp TIME-WAIT 0 0 192.168.1.8:49099 192.168.1.8:24007 tcp TIME-WAIT 0 0 192.168.1.8:49107 192.168.1.8:24007 tcp TIME-WAIT 0 0 192.168.1.8:49126 192.168.1.8:24007 tcp TIME-WAIT 0 0 192.168.1.8:49082 192.168.1.8:24007 tcp TIME-WAIT 0 0 192.168.1.8:49109 192.168.1.8:24007 tcp TIME-WAIT 0 0 192.168.1.8:49115 192.168.1.8:24007 tcp TIME-WAIT 0 0 192.168.1.8:49106 192.168.1.8:24007 tcp ESTAB 0 0 192.168.1.8:49145 192.168.1.8:24007 tcp TIME-WAIT 0 0 192.168.1.8:49124 192.168.1.8:24007 tcp TIME-WAIT 0 0 192.168.1.8:49143 192.168.1.8:24007 tcp TIME-WAIT 0 0 192.168.1.8:49108 192.168.1.8:24007 tcp ESTAB 0 0 192.168.1.8:24007 192.168.1.8:49146 tcp TIME-WAIT 0 0 192.168.1.8:49136 192.168.1.8:24007 tcp TIME-WAIT 0 0 192.168.1.8:49128 192.168.1.8:24007 tcp TIME-WAIT 0 0 192.168.1.8:49137 192.168.1.8:24007 tcp TIME-WAIT 0 0 192.168.1.8:49092 192.168.1.8:24007 tcp TIME-WAIT 0 0 192.168.1.8:49121 192.168.1.8:24007 tcp TIME-WAIT 0 0 192.168.1.8:49105 192.168.1.8:24007 tcp TIME-WAIT 0 0 192.168.1.8:49116 192.168.1.8:24007 tcp TIME-WAIT 0 0 192.168.1.8:49120 192.168.1.8:24007 tcp TIME-WAIT 0 0 192.168.1.8:49122 192.168.1.8:24007 And here is the information about the volumes: sudo gluster volume info Volume Name: etc Type: Replicate Volume ID: dd4e08e6-9543-4ad5-bb2e-e41a0e47c9c5 Status: Started Snapshot Count: 0 Number of Bricks: 1 x 3 = 3 Transport-type: tcp Bricks: Brick1: web1.dasilva.network:/data/gluster/etc Brick2: web2.dasilva.network:/data/gluster/etc Brick3: web3.dasilva.network:/data/gluster/etc Options Reconfigured: nfs.disable: on transport.address-family: inet Volume Name: log Type: Replicate Volume ID: 06451895-b6cc-40f7-a173-c793a7610229 Status: Started Snapshot Count: 0 Number of Bricks: 1 x 3 = 3 Transport-type: tcp Bricks: Brick1: web1.dasilva.network:/data/gluster/log Brick2: web2.dasilva.network:/data/gluster/log Brick3: web3.dasilva.network:/data/gluster/log Options Reconfigured: nfs.disable: on transport.address-family: inet Volume Name: www Type: Replicate Volume ID: ef7bee14-30a6-471e-84fa-51341f2908b5 Status: Started Snapshot Count: 0 Number of Bricks: 1 x 3 = 3 Transport-type: tcp Bricks: Brick1: web1.dasilva.network:/data/gluster/www Brick2: web2.dasilva.network:/data/gluster/www Brick3: web3.dasilva.network:/data/gluster/www Options Reconfigured: nfs.disable: on transport.address-family: inet Regards, Cesar da Silva -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.gluster.org/pipermail/gluster-users/attachments/20170820/5535390a/attachment.html>
Atin Mukherjee
2017-Aug-21 11:57 UTC
[Gluster-users] Glusterd not working with systemd in redhat 7
On Mon, Aug 21, 2017 at 2:49 AM, Cesar da Silva <thunderlight1 at gmail.com> wrote:> Hi! > I am having same issue but I am running Ubuntu v16.04. > It does not mount during boot, but works if I mount it manually. I am > running the Gluster-server on the same machines (3 machines) > Here is the /tc/fstab file > > /dev/sdb1 /data/gluster ext4 defaults 0 0 > > web1.dasilva.network:/www /mnt/glusterfs/www glusterfs > defaults,_netdev,log-level=debug,log-file=/var/log/gluster.log 0 0 > web1.dasilva.network:/etc /mnt/glusterfs/etc glusterfs > defaults,_netdev,log-level=debug,log-file=/var/log/gluster.log 0 0 > > Here is the logfile /var/log/gluster.log >Could you point us to the glusterd log file content?> --8<--start of log file ---------------------------------- > [2017-08-20 20:30:39.638989] I [MSGID: 100030] [glusterfsd.c:2476:main] > 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.11.2 > (args: /usr/sbin/glusterfs --log-level=DEBUG --log-file=/var/log/gluster.log > --volfile-server=web1.dasilva.network --volfile-id=/www > /mnt/glusterfs/www) > [2017-08-20 20:30:39.639024] I [MSGID: 100030] [glusterfsd.c:2476:main] > 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.11.2 > (args: /usr/sbin/glusterfs --log-level=DEBUG --log-file=/var/log/gluster.log > --volfile-server=web1.dasilva.network --volfile-id=/etc > /mnt/glusterfs/etc) > [2017-08-20 20:30:39.926333] D [MSGID: 0] [glusterfsd.c:442:set_fuse_mount_options] > 0-glusterfsd: fopen-keep-cache mode 2 > [2017-08-20 20:30:39.926376] D [MSGID: 0] [glusterfsd.c:506:set_fuse_mount_options] > 0-glusterfsd: fuse direct io type 2 > [2017-08-20 20:30:39.926389] D [MSGID: 0] [glusterfsd.c:530:set_fuse_mount_options] > 0-glusterfsd: fuse no-root-squash mode 0 > [2017-08-20 20:30:39.926486] D [MSGID: 0] [options.c:1224:xlator_option_init_double] > 0-fuse: option negative-timeout using set value 0.000000 > [2017-08-20 20:30:39.926532] D [MSGID: 0] [glusterfsd.c:442:set_fuse_mount_options] > 0-glusterfsd: fopen-keep-cache mode 2 > [2017-08-20 20:30:39.926557] D [MSGID: 0] [glusterfsd.c:506:set_fuse_mount_options] > 0-glusterfsd: fuse direct io type 2 > [2017-08-20 20:30:39.926569] D [MSGID: 0] [glusterfsd.c:530:set_fuse_mount_options] > 0-glusterfsd: fuse no-root-squash mode 0 > [2017-08-20 20:30:39.926568] D [MSGID: 0] [options.c:1221:xlator_option_init_bool] > 0-fuse: option no-root-squash using set value disable > [2017-08-20 20:30:39.926649] D [MSGID: 0] [options.c:1224:xlator_option_init_double] > 0-fuse: option negative-timeout using set value 0.000000 > [2017-08-20 20:30:39.926726] D [MSGID: 0] [options.c:1221:xlator_option_init_bool] > 0-fuse: option no-root-squash using set value disable > [2017-08-20 20:30:39.927105] D [logging.c:1790:__gf_log_inject_timer_event] > 0-logging-infra: Starting timer now. Timeout = 120, current buf size = 5 > [2017-08-20 20:30:39.927359] D [rpc-clnt.c:1062:rpc_clnt_connection_init] > 0-glusterfs: defaulting frame-timeout to 30mins > [2017-08-20 20:30:39.927373] D [rpc-clnt.c:1076:rpc_clnt_connection_init] > 0-glusterfs: disable ping-timeout > [2017-08-20 20:30:39.927385] D [rpc-transport.c:279:rpc_transport_load] > 0-rpc-transport: attempt to load file /usr/lib/x86_64-linux-gnu/ > glusterfs/3.11.2/rpc-transport/socket.so > [2017-08-20 20:30:39.927774] D [logging.c:1790:__gf_log_inject_timer_event] > 0-logging-infra: Starting timer now. Timeout = 120, current buf size = 5 > [2017-08-20 20:30:39.927994] D [rpc-clnt.c:1062:rpc_clnt_connection_init] > 0-glusterfs: defaulting frame-timeout to 30mins > [2017-08-20 20:30:39.928008] D [rpc-clnt.c:1076:rpc_clnt_connection_init] > 0-glusterfs: disable ping-timeout > [2017-08-20 20:30:39.928019] D [rpc-transport.c:279:rpc_transport_load] > 0-rpc-transport: attempt to load file /usr/lib/x86_64-linux-gnu/ > glusterfs/3.11.2/rpc-transport/socket.so > [2017-08-20 20:30:40.380267] W [MSGID: 101002] [options.c:954:xl_opt_validate] > 0-glusterfs: option 'address-family' is deprecated, preferred is > 'transport.address-family', continuing with correction > [2017-08-20 20:30:40.380391] D [socket.c:4163:socket_init] 0-glusterfs: > Configued transport.tcp-user-timeout=0 > [2017-08-20 20:30:40.380403] D [socket.c:4181:socket_init] 0-glusterfs: > Reconfigued transport.keepalivecnt=9 > [2017-08-20 20:30:40.380410] D [socket.c:4264:socket_init] 0-glusterfs: > SSL support on the I/O path is NOT enabled > [2017-08-20 20:30:40.380417] D [socket.c:4267:socket_init] 0-glusterfs: > SSL support for glusterd is NOT enabled > [2017-08-20 20:30:40.380423] D [socket.c:4284:socket_init] 0-glusterfs: > using system polling thread > [2017-08-20 20:30:40.380432] D [rpc-clnt.c:1581:rpcclnt_cbk_program_register] > 0-glusterfs: New program registered: GlusterFS Callback, Num: 52743234, > Ver: 1 > [2017-08-20 20:30:40.382224] W [MSGID: 101002] [options.c:954:xl_opt_validate] > 0-glusterfs: option 'address-family' is deprecated, preferred is > 'transport.address-family', continuing with correction > [2017-08-20 20:30:40.382305] D [socket.c:4163:socket_init] 0-glusterfs: > Configued transport.tcp-user-timeout=0 > [2017-08-20 20:30:40.382315] D [socket.c:4181:socket_init] 0-glusterfs: > Reconfigued transport.keepalivecnt=9 > [2017-08-20 20:30:40.382322] D [socket.c:4264:socket_init] 0-glusterfs: > SSL support on the I/O path is NOT enabled > [2017-08-20 20:30:40.382328] D [socket.c:4267:socket_init] 0-glusterfs: > SSL support for glusterd is NOT enabled > [2017-08-20 20:30:40.382334] D [socket.c:4284:socket_init] 0-glusterfs: > using system polling thread > [2017-08-20 20:30:40.382343] D [rpc-clnt.c:1581:rpcclnt_cbk_program_register] > 0-glusterfs: New program registered: GlusterFS Callback, Num: 52743234, > Ver: 1 > [2017-08-20 20:30:40.466338] D [MSGID: 0] [common-utils.c:327:gf_resolve_ip6] > 0-resolver: returning ip-192.168.1.8 (port-24007) for hostname: > web1.dasilva.network and port: 24007 > [2017-08-20 20:30:40.466364] D [MSGID: 0] [common-utils.c:327:gf_resolve_ip6] > 0-resolver: returning ip-192.168.1.8 (port-24007) for hostname: > web1.dasilva.network and port: 24007 > [2017-08-20 20:30:40.466470] D [MSGID: 0] [common-utils.c:348:gf_resolve_ip6] > 0-resolver: next DNS query will return: ip-192.168.1.19 port-24007 > [2017-08-20 20:30:40.466480] D [MSGID: 0] [common-utils.c:348:gf_resolve_ip6] > 0-resolver: next DNS query will return: ip-192.168.1.19 port-24007 > [2017-08-20 20:30:40.466482] D [socket.c:3050:socket_fix_ssl_opts] > 0-glusterfs: disabling SSL for portmapper connection > [2017-08-20 20:30:40.466490] D [socket.c:3050:socket_fix_ssl_opts] > 0-glusterfs: disabling SSL for portmapper connection > [2017-08-20 20:30:40.466699] I [MSGID: 101190] [event-epoll.c:602:event_dispatch_epoll_worker] > 0-epoll: Started thread with index 1 > [2017-08-20 20:30:40.466699] I [MSGID: 101190] [event-epoll.c:602:event_dispatch_epoll_worker] > 0-epoll: Started thread with index 1 > [2017-08-20 20:30:40.466725] E [socket.c:2369:socket_connect_finish] > 0-glusterfs: connection to 192.168.1.8:24007 failed (F?rbindelse v?gras); > disconnecting socket > [2017-08-20 20:30:40.466726] E [socket.c:2369:socket_connect_finish] > 0-glusterfs: connection to 192.168.1.8:24007 failed (F?rbindelse v?gras); > disconnecting socket > [2017-08-20 20:30:40.466736] D [socket.c:686:__socket_shutdown] > 0-glusterfs: shutdown() returned -1. Transportslutpunkten ?r inte f?rbunden > [2017-08-20 20:30:40.466737] D [socket.c:686:__socket_shutdown] > 0-glusterfs: shutdown() returned -1. Transportslutpunkten ?r inte f?rbunden > [2017-08-20 20:30:40.466743] D [socket.c:733:__socket_disconnect] > 0-glusterfs: __socket_teardown_connection () failed: Transportslutpunkten > ?r inte f?rbunden > [2017-08-20 20:30:40.466745] D [socket.c:733:__socket_disconnect] > 0-glusterfs: __socket_teardown_connection () failed: Transportslutpunkten > ?r inte f?rbunden > [2017-08-20 20:30:40.466749] D [socket.c:2474:socket_event_handler] > 0-transport: EPOLLERR - disconnecting now > [2017-08-20 20:30:40.466751] D [socket.c:2474:socket_event_handler] > 0-transport: EPOLLERR - disconnecting now > [2017-08-20 20:30:40.466764] I [glusterfsd-mgmt.c:2171:mgmt_rpc_notify] > 0-glusterfsd-mgmt: disconnected from remote-host: web1.dasilva.network > [2017-08-20 20:30:40.466764] I [glusterfsd-mgmt.c:2171:mgmt_rpc_notify] > 0-glusterfsd-mgmt: disconnected from remote-host: web1.dasilva.network > [2017-08-20 20:30:40.658255] D [rpc-clnt-ping.c:99:rpc_clnt_remove_ping_timer_locked] > (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x13b)[0x7f3f0f82abbb] > (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_remove_ > ping_timer_locked+0x84)[0x7f3f0f5fd074] (--> /usr/lib/x86_64-linux-gnu/ > libgfrpc.so.0(rpc_clnt_connection_cleanup+0xd4)[0x7f3f0f5f9774] (--> > /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x288)[0x7f3f0f5fa218] > (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_transport_notify+0x23)[0x7f3f0f5f6493] > ))))) 0-: 192.168.1.8:24007: ping timer event already removed > [2017-08-20 20:30:40.658268] D [rpc-clnt-ping.c:99:rpc_clnt_remove_ping_timer_locked] > (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x13b)[0x7f8f7039dbbb] > (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_remove_ > ping_timer_locked+0x84)[0x7f8f70170074] (--> /usr/lib/x86_64-linux-gnu/ > libgfrpc.so.0(rpc_clnt_connection_cleanup+0xd4)[0x7f8f7016c774] (--> > /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x288)[0x7f8f7016d218] > (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_transport_notify+0x23)[0x7f8f70169493] > ))))) 0-: 192.168.1.8:24007: ping timer event already removed > [2017-08-20 20:30:43.928116] D [MSGID: 0] [common-utils.c:327:gf_resolve_ip6] > 0-resolver: returning ip-192.168.1.19 (port-24007) for hostname: > web1.dasilva.network and port: 24007 > [2017-08-20 20:30:43.928164] D [socket.c:3050:socket_fix_ssl_opts] > 0-glusterfs: disabling SSL for portmapper connection > [2017-08-20 20:30:43.929085] D [MSGID: 0] [common-utils.c:327:gf_resolve_ip6] > 0-resolver: returning ip-192.168.1.19 (port-24007) for hostname: > web1.dasilva.network and port: 24007 > [2017-08-20 20:30:43.929124] D [socket.c:3050:socket_fix_ssl_opts] > 0-glusterfs: disabling SSL for portmapper connection > [2017-08-20 20:30:46.927870] D [socket.c:686:__socket_shutdown] > 0-glusterfs: shutdown() returned -1. Transportslutpunkten ?r inte f?rbunden > [2017-08-20 20:30:46.927916] D [socket.c:733:__socket_disconnect] > 0-glusterfs: __socket_teardown_connection () failed: Transportslutpunkten > ?r inte f?rbunden > [2017-08-20 20:30:46.927924] D [socket.c:2474:socket_event_handler] > 0-transport: EPOLLERR - disconnecting now > [2017-08-20 20:30:46.927935] I [glusterfsd-mgmt.c:2192:mgmt_rpc_notify] > 0-glusterfsd-mgmt: Exhausted all volfile servers > [2017-08-20 20:30:46.927938] D [socket.c:686:__socket_shutdown] > 0-glusterfs: shutdown() returned -1. Transportslutpunkten ?r inte f?rbunden > [2017-08-20 20:30:46.927959] D [socket.c:733:__socket_disconnect] > 0-glusterfs: __socket_teardown_connection () failed: Transportslutpunkten > ?r inte f?rbunden > [2017-08-20 20:30:46.927966] D [socket.c:2474:socket_event_handler] > 0-transport: EPOLLERR - disconnecting now > [2017-08-20 20:30:46.927976] I [glusterfsd-mgmt.c:2192:mgmt_rpc_notify] > 0-glusterfsd-mgmt: Exhausted all volfile servers > [2017-08-20 20:30:46.928016] D [logging.c:1764:gf_log_flush_extra_msgs] > 0-logging-infra: Log buffer size reduced. About to flush 5 extra log > messages > [2017-08-20 20:30:46.928028] D [logging.c:1767:gf_log_flush_extra_msgs] > 0-logging-infra: Just flushed 5 extra log messages > [2017-08-20 20:30:46.928058] W [glusterfsd.c:1331:cleanup_and_exit] > (-->/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0xab) > [0x7f8f7016d03b] -->/usr/sbin/glusterfs(+0x1041e) [0x55bfe6ff641e] > -->/usr/sbin/glusterfs(cleanup_and_exit+0x54) [0x55bfe6fef6e4] ) 0-: > received signum (1), shutting down > [2017-08-20 20:30:46.928068] D [glusterfsd-mgmt.c:2653:glusterfs_mgmt_pmap_signout] > 0-fsd-mgmt: portmapper signout arguments not given > [2017-08-20 20:30:46.928085] I [fuse-bridge.c:5883:fini] 0-fuse: > Unmounting '/mnt/glusterfs/www'. > [2017-08-20 20:30:46.928447] D [logging.c:1764:gf_log_flush_extra_msgs] > 0-logging-infra: Log buffer size reduced. About to flush 5 extra log > messages > [2017-08-20 20:30:46.928463] D [logging.c:1767:gf_log_flush_extra_msgs] > 0-logging-infra: Just flushed 5 extra log messages > [2017-08-20 20:30:46.928486] W [glusterfsd.c:1331:cleanup_and_exit] > (-->/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0xab) > [0x7f3f0f5fa03b] -->/usr/sbin/glusterfs(+0x1041e) [0x5638af0e941e] > -->/usr/sbin/glusterfs(cleanup_and_exit+0x54) [0x5638af0e26e4] ) 0-: > received signum (1), shutting down > [2017-08-20 20:30:46.928495] D [glusterfsd-mgmt.c:2653:glusterfs_mgmt_pmap_signout] > 0-fsd-mgmt: portmapper signout arguments not given > [2017-08-20 20:30:46.928507] I [fuse-bridge.c:5883:fini] 0-fuse: > Unmounting '/mnt/glusterfs/etc'. > [2017-08-20 20:30:46.931358] D [MSGID: 0] [common-utils.c:327:gf_resolve_ip6] > 0-resolver: returning ip-192.168.1.8 (port-24007) for hostname: > web1.dasilva.network and port: 24007 > [2017-08-20 20:30:46.931461] D [MSGID: 0] [common-utils.c:348:gf_resolve_ip6] > 0-resolver: next DNS query will return: ip-192.168.1.19 port-24007 > [2017-08-20 20:30:46.931469] D [socket.c:3050:socket_fix_ssl_opts] > 0-glusterfs: disabling SSL for portmapper connection > [2017-08-20 20:30:46.931585] I [timer.c:198:gf_timer_registry_init] > (-->/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(+0x2ff6f) > [0x7f8f703a8f6f] -->/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_reconnect+0xee) > [0x7f8f7016c54e] -->/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(gf_timer_call_after+0x204) > [0x7f8f703a9324] ) 0-timer: ctx cleanup started > [2017-08-20 20:30:46.931626] E [timer.c:44:gf_timer_call_after] > (-->/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(+0x2ff6f) > [0x7f8f703a8f6f] -->/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_reconnect+0xee) > [0x7f8f7016c54e] -->/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(gf_timer_call_after+0x245) > [0x7f8f703a9365] ) 0-timer: !reg > [2017-08-20 20:30:46.931634] E [rpc-clnt.c:432:rpc_clnt_reconnect] > 0-glusterfs: Error adding to timer event queue > [2017-08-20 20:30:46.932553] D [MSGID: 0] [common-utils.c:327:gf_resolve_ip6] > 0-resolver: returning ip-192.168.1.8 (port-24007) for hostname: > web1.dasilva.network and port: 24007 > [2017-08-20 20:30:46.932664] D [MSGID: 0] [common-utils.c:348:gf_resolve_ip6] > 0-resolver: next DNS query will return: ip-192.168.1.19 port-24007 > [2017-08-20 20:30:46.932673] D [socket.c:3050:socket_fix_ssl_opts] > 0-glusterfs: disabling SSL for portmapper connection > [2017-08-20 20:30:46.932762] I [timer.c:198:gf_timer_registry_init] > (-->/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(+0x2ff6f) > [0x7f3f0f835f6f] -->/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_reconnect+0xee) > [0x7f3f0f5f954e] -->/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(gf_timer_call_after+0x204) > [0x7f3f0f836324] ) 0-timer: ctx cleanup started > [2017-08-20 20:30:46.932802] E [timer.c:44:gf_timer_call_after] > (-->/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(+0x2ff6f) > [0x7f3f0f835f6f] -->/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_reconnect+0xee) > [0x7f3f0f5f954e] -->/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(gf_timer_call_after+0x245) > [0x7f3f0f836365] ) 0-timer: !reg > [2017-08-20 20:30:46.932810] E [rpc-clnt.c:432:rpc_clnt_reconnect] > 0-glusterfs: Error adding to timer event queue > [2017-08-20 20:30:46.944014] I [fuse-bridge.c:5888:fini] 0-fuse: Closing > fuse connection to '/mnt/glusterfs/etc'. > [2017-08-20 20:30:46.944107] W [glusterfsd.c:1331:cleanup_and_exit] > (-->/lib/x86_64-linux-gnu/libpthread.so.0(+0x76ba) [0x7f3f0efb96ba] > -->/usr/sbin/glusterfs(glusterfs_sigwaiter+0xe5) [0x5638af0e28c5] > -->/usr/sbin/glusterfs(cleanup_and_exit+0x54) [0x5638af0e26e4] ) 0-: > received signum (15), shutting down > [2017-08-20 20:30:46.948018] I [fuse-bridge.c:5888:fini] 0-fuse: Closing > fuse connection to '/mnt/glusterfs/www'. > [2017-08-20 20:30:46.948329] W [glusterfsd.c:1331:cleanup_and_exit] > (-->/lib/x86_64-linux-gnu/libpthread.so.0(+0x76ba) [0x7f8f6fb2c6ba] > -->/usr/sbin/glusterfs(glusterfs_sigwaiter+0xe5) [0x55bfe6fef8c5] > -->/usr/sbin/glusterfs(cleanup_and_exit+0x54) [0x55bfe6fef6e4] ) 0-: > received signum (15), shutting down > --8<--end of log file ---------------------------------- > > As you can see bellow, the ports are also available > > tcp LISTEN 0 128 *:24007 > *:* > tcp TIME-WAIT 0 0 192.168.1.8:49110 > 192.168.1.8:24007 > tcp TIME-WAIT 0 0 192.168.1.8:49081 > 192.168.1.8:24007 > tcp TIME-WAIT 0 0 192.168.1.8:49118 > 192.168.1.8:24007 > tcp ESTAB 0 0 192.168.1.8:49146 > 192.168.1.8:24007 > tcp TIME-WAIT 0 0 192.168.1.8:49104 > 192.168.1.8:24007 > tcp TIME-WAIT 0 0 192.168.1.8:49094 > 192.168.1.8:24007 > tcp TIME-WAIT 0 0 192.168.1.8:49097 > 192.168.1.8:24007 > tcp TIME-WAIT 0 0 192.168.1.8:49085 > 192.168.1.8:24007 > tcp TIME-WAIT 0 0 192.168.1.8:49123 > 192.168.1.8:24007 > tcp ESTAB 0 0 192.168.1.8:49151 > 192.168.1.10:24007 > tcp TIME-WAIT 0 0 192.168.1.8:49096 > 192.168.1.8:24007 > tcp TIME-WAIT 0 0 192.168.1.8:49101 > 192.168.1.8:24007 > tcp TIME-WAIT 0 0 192.168.1.8:49103 > 192.168.1.8:24007 > tcp TIME-WAIT 0 0 192.168.1.8:49088 > 192.168.1.8:24007 > tcp TIME-WAIT 0 0 192.168.1.8:49087 > 192.168.1.8:24007 > tcp TIME-WAIT 0 0 192.168.1.8:49140 > 192.168.1.8:24007 > tcp TIME-WAIT 0 0 192.168.1.8:49125 > 192.168.1.8:24007 > tcp TIME-WAIT 0 0 192.168.1.8:49147 > 192.168.1.8:24007 > tcp TIME-WAIT 0 0 192.168.1.8:49138 > 192.168.1.8:24007 > tcp TIME-WAIT 0 0 192.168.1.8:49093 > 192.168.1.8:24007 > tcp TIME-WAIT 0 0 192.168.1.8:49098 > 192.168.1.8:24007 > tcp TIME-WAIT 0 0 192.168.1.8:49091 > 192.168.1.8:24007 > tcp TIME-WAIT 0 0 192.168.1.8:49119 > 192.168.1.8:24007 > tcp ESTAB 0 0 127.0.0.1:24007 > 127.0.0.1:49147 > tcp TIME-WAIT 0 0 192.168.1.8:49090 > 192.168.1.8:24007 > tcp TIME-WAIT 0 0 192.168.1.8:49148 > 192.168.1.8:24007 > tcp TIME-WAIT 0 0 192.168.1.8:49149 > 192.168.1.8:24007 > tcp TIME-WAIT 0 0 192.168.1.8:49117 > 192.168.1.8:24007 > tcp TIME-WAIT 0 0 192.168.1.8:49095 > 192.168.1.8:24007 > tcp TIME-WAIT 0 0 192.168.1.8:49112 > 192.168.1.8:24007 > tcp TIME-WAIT 0 0 192.168.1.8:49111 > 192.168.1.8:24007 > tcp TIME-WAIT 0 0 192.168.1.8:49086 > 192.168.1.8:24007 > tcp ESTAB 0 0 192.168.1.8:49150 > 192.168.1.9:24007 > tcp TIME-WAIT 0 0 192.168.1.8:49142 > 192.168.1.8:24007 > tcp TIME-WAIT 0 0 192.168.1.8:49141 > 192.168.1.8:24007 > tcp TIME-WAIT 0 0 192.168.1.8:49084 > 192.168.1.8:24007 > tcp TIME-WAIT 0 0 192.168.1.8:49100 > 192.168.1.8:24007 > tcp ESTAB 0 0 127.0.0.1:49147 > 127.0.0.1:24007 > tcp TIME-WAIT 0 0 192.168.1.8:49127 > 192.168.1.8:24007 > tcp TIME-WAIT 0 0 192.168.1.8:49144 > 192.168.1.8:24007 > tcp ESTAB 0 0 192.168.1.8:24007 > 192.168.1.8:49145 > tcp TIME-WAIT 0 0 192.168.1.8:49139 > 192.168.1.8:24007 > tcp TIME-WAIT 0 0 192.168.1.8:49089 > 192.168.1.8:24007 > tcp TIME-WAIT 0 0 192.168.1.8:49102 > 192.168.1.8:24007 > tcp TIME-WAIT 0 0 192.168.1.8:49083 > 192.168.1.8:24007 > tcp TIME-WAIT 0 0 192.168.1.8:49129 > 192.168.1.8:24007 > tcp TIME-WAIT 0 0 192.168.1.8:49114 > 192.168.1.8:24007 > tcp TIME-WAIT 0 0 192.168.1.8:49099 > 192.168.1.8:24007 > tcp TIME-WAIT 0 0 192.168.1.8:49107 > 192.168.1.8:24007 > tcp TIME-WAIT 0 0 192.168.1.8:49126 > 192.168.1.8:24007 > tcp TIME-WAIT 0 0 192.168.1.8:49082 > 192.168.1.8:24007 > tcp TIME-WAIT 0 0 192.168.1.8:49109 > 192.168.1.8:24007 > tcp TIME-WAIT 0 0 192.168.1.8:49115 > 192.168.1.8:24007 > tcp TIME-WAIT 0 0 192.168.1.8:49106 > 192.168.1.8:24007 > tcp ESTAB 0 0 192.168.1.8:49145 > 192.168.1.8:24007 > tcp TIME-WAIT 0 0 192.168.1.8:49124 > 192.168.1.8:24007 > tcp TIME-WAIT 0 0 192.168.1.8:49143 > 192.168.1.8:24007 > tcp TIME-WAIT 0 0 192.168.1.8:49108 > 192.168.1.8:24007 > tcp ESTAB 0 0 192.168.1.8:24007 > 192.168.1.8:49146 > tcp TIME-WAIT 0 0 192.168.1.8:49136 > 192.168.1.8:24007 > tcp TIME-WAIT 0 0 192.168.1.8:49128 > 192.168.1.8:24007 > tcp TIME-WAIT 0 0 192.168.1.8:49137 > 192.168.1.8:24007 > tcp TIME-WAIT 0 0 192.168.1.8:49092 > 192.168.1.8:24007 > tcp TIME-WAIT 0 0 192.168.1.8:49121 > 192.168.1.8:24007 > tcp TIME-WAIT 0 0 192.168.1.8:49105 > 192.168.1.8:24007 > tcp TIME-WAIT 0 0 192.168.1.8:49116 > 192.168.1.8:24007 > tcp TIME-WAIT 0 0 192.168.1.8:49120 > 192.168.1.8:24007 > tcp TIME-WAIT 0 0 192.168.1.8:49122 > 192.168.1.8:24007 > > > And here is the information about the volumes: > > sudo gluster volume info > > Volume Name: etc > Type: Replicate > Volume ID: dd4e08e6-9543-4ad5-bb2e-e41a0e47c9c5 > Status: Started > Snapshot Count: 0 > Number of Bricks: 1 x 3 = 3 > Transport-type: tcp > Bricks: > Brick1: web1.dasilva.network:/data/gluster/etc > Brick2: web2.dasilva.network:/data/gluster/etc > Brick3: web3.dasilva.network:/data/gluster/etc > Options Reconfigured: > nfs.disable: on > transport.address-family: inet > > Volume Name: log > Type: Replicate > Volume ID: 06451895-b6cc-40f7-a173-c793a7610229 > Status: Started > Snapshot Count: 0 > Number of Bricks: 1 x 3 = 3 > Transport-type: tcp > Bricks: > Brick1: web1.dasilva.network:/data/gluster/log > Brick2: web2.dasilva.network:/data/gluster/log > Brick3: web3.dasilva.network:/data/gluster/log > Options Reconfigured: > nfs.disable: on > transport.address-family: inet > > Volume Name: www > Type: Replicate > Volume ID: ef7bee14-30a6-471e-84fa-51341f2908b5 > Status: Started > Snapshot Count: 0 > Number of Bricks: 1 x 3 = 3 > Transport-type: tcp > Bricks: > Brick1: web1.dasilva.network:/data/gluster/www > Brick2: web2.dasilva.network:/data/gluster/www > Brick3: web3.dasilva.network:/data/gluster/www > Options Reconfigured: > nfs.disable: on > transport.address-family: inet > > Regards, > Cesar da Silva > > _______________________________________________ > Gluster-users mailing list > Gluster-users at gluster.org > http://lists.gluster.org/mailman/listinfo/gluster-users >-------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.gluster.org/pipermail/gluster-users/attachments/20170821/edfca6e1/attachment.html>
Cesar da Silva
2017-Aug-21 13:29 UTC
[Gluster-users] Glusterd not working with systemd in redhat 7
Hi! Please see bellow. Note that web1.dasilva.network is the address of the local machine where one of the bricks is installed and that ties to mount. [2017-08-20 20:30:40.359236] I [MSGID: 100030] [glusterfsd.c:2476:main] 0-/usr/sbin/glusterd: Started running /usr/sbin/glusterd version 3.11.2 (args: /usr/sbin/glusterd -p /var/run/glusterd.pid) [2017-08-20 20:30:40.973249] I [MSGID: 106478] [glusterd.c:1422:init] 0-management: Maximum allowed open file descriptors set to 65536 [2017-08-20 20:30:40.973303] I [MSGID: 106479] [glusterd.c:1469:init] 0-management: Using /var/lib/glusterd as working directory [2017-08-20 20:30:41.489229] W [MSGID: 103071] [rdma.c:4591:__gf_rdma_ctx_create] 0-rpc-transport/rdma: rdma_cm event channel creation failed [Enheten finns inte] [2017-08-20 20:30:41.489263] W [MSGID: 103055] [rdma.c:4898:init] 0-rdma.management: Failed to initialize IB Device [2017-08-20 20:30:41.489270] W [rpc-transport.c:350:rpc_transport_load] 0-rpc-transport: 'rdma' initialization failed [2017-08-20 20:30:41.489308] W [rpcsvc.c:1660:rpcsvc_create_listener] 0-rpc-service: cannot create listener, initing the transport failed [2017-08-20 20:30:41.489318] E [MSGID: 106243] [glusterd.c:1693:init] 0-management: creation of 1 listeners failed, continuing with succeeded transport [2017-08-20 20:30:57.917320] I [MSGID: 106513] [glusterd-store.c:2193:glusterd_restore_op_version] 0-glusterd: retrieved op-version: 31100 [2017-08-20 20:31:01.785150] I [MSGID: 106498] [glusterd-handler.c:3602:glusterd_friend_add_from_peerinfo] 0-management: connect returned 0 [2017-08-20 20:31:01.827584] I [MSGID: 106498] [glusterd-handler.c:3602:glusterd_friend_add_from_peerinfo] 0-management: connect returned 0 [2017-08-20 20:31:01.827639] W [MSGID: 106062] [glusterd-handler.c:3399:glusterd_transport_inet_options_build] 0-glusterd: Failed to get tcp-user-timeout [2017-08-20 20:31:01.827678] I [rpc-clnt.c:1059:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600 [2017-08-20 20:31:01.827752] W [MSGID: 101002] [options.c:954:xl_opt_validate] 0-management: option 'address-family' is deprecated, preferred is 'transport.address-family', continuing with correction [2017-08-20 20:31:01.828546] W [MSGID: 106062] [glusterd-handler.c:3399:glusterd_transport_inet_options_build] 0-glusterd: Failed to get tcp-user-timeout [2017-08-20 20:31:01.828568] I [rpc-clnt.c:1059:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600 [2017-08-20 20:31:01.828623] W [MSGID: 101002] [options.c:954:xl_opt_validate] 0-management: option 'address-family' is deprecated, preferred is 'transport.address-family', continuing with correction [2017-08-20 20:31:01.881962] I [MSGID: 106544] [glusterd.c:158:glusterd_uuid_init] 0-management: retrieved UUID: b5718e49-db55-4f01-8839-01b3b257b8b2 Final graph: +------------------------------------------------------------------------------+ 1: volume management 2: type mgmt/glusterd 3: option rpc-auth.auth-glusterfs on 4: option rpc-auth.auth-unix on 5: option rpc-auth.auth-null on 6: option rpc-auth-allow-insecure on 7: option transport.socket.listen-backlog 128 8: option event-threads 1 9: option ping-timeout 0 10: option transport.socket.read-fail-log off 11: option transport.socket.keepalive-interval 2 12: option transport.socket.keepalive-time 10 13: option transport-type rdma 14: option working-directory /var/lib/glusterd 15: end-volume 16: +------------------------------------------------------------------------------+ [2017-08-20 20:31:01.888009] I [MSGID: 101190] [event-epoll.c:602:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1 [2017-08-20 20:31:01.891406] W [rpcsvc.c:265:rpcsvc_program_actor] 0-rpc-service: RPC program not available (req 1298437 330) for 192.168.1.63:49148 [2017-08-20 20:31:01.891429] E [rpcsvc.c:557:rpcsvc_check_and_reply_error] 0-rpcsvc: rpc actor failed to complete successfully [2017-08-20 20:31:02.746317] I [MSGID: 106493] [glusterd-rpc-ops.c:485:__glusterd_friend_add_cbk] 0-glusterd: Received ACC from uuid: 8f66df4a-e286-4c63-9b0b-257c1ccd08b0, host: web3.dasilva.network, port: 0 [2017-08-20 20:31:02.890721] I [rpc-clnt.c:1059:rpc_clnt_connection_init] 0-nfs: setting frame-timeout to 600 [2017-08-20 20:31:02.958990] I [MSGID: 106132] [glusterd-proc-mgmt.c:83:glusterd_proc_stop] 0-management: nfs already stopped [2017-08-20 20:31:02.959047] I [MSGID: 106568] [glusterd-svc-mgmt.c:228:glusterd_svc_stop] 0-management: nfs service is stopped [2017-08-20 20:31:02.987001] I [rpc-clnt.c:1059:rpc_clnt_connection_init] 0-glustershd: setting frame-timeout to 600 [2017-08-20 20:31:03.022959] I [MSGID: 106132] [glusterd-proc-mgmt.c:83:glusterd_proc_stop] 0-management: glustershd already stopped [2017-08-20 20:31:03.023014] I [MSGID: 106568] [glusterd-svc-mgmt.c:228:glusterd_svc_stop] 0-management: glustershd service is stopped [2017-08-20 20:31:03.023084] I [MSGID: 106567] [glusterd-svc-mgmt.c:196:glusterd_svc_start] 0-management: Starting glustershd service [2017-08-20 20:31:04.344856] I [rpc-clnt.c:1059:rpc_clnt_connection_init] 0-quotad: setting frame-timeout to 600 [2017-08-20 20:31:04.435237] I [MSGID: 106132] [glusterd-proc-mgmt.c:83:glusterd_proc_stop] 0-management: quotad already stopped [2017-08-20 20:31:04.435294] I [MSGID: 106568] [glusterd-svc-mgmt.c:228:glusterd_svc_stop] 0-management: quotad service is stopped [2017-08-20 20:31:04.444638] I [rpc-clnt.c:1059:rpc_clnt_connection_init] 0-bitd: setting frame-timeout to 600 [2017-08-20 20:31:04.451161] I [MSGID: 106132] [glusterd-proc-mgmt.c:83:glusterd_proc_stop] 0-management: bitd already stopped [2017-08-20 20:31:04.451203] I [MSGID: 106568] [glusterd-svc-mgmt.c:228:glusterd_svc_stop] 0-management: bitd service is stopped [2017-08-20 20:31:04.455392] I [rpc-clnt.c:1059:rpc_clnt_connection_init] 0-scrub: setting frame-timeout to 600 [2017-08-20 20:31:04.494930] I [MSGID: 106132] [glusterd-proc-mgmt.c:83:glusterd_proc_stop] 0-management: scrub already stopped [2017-08-20 20:31:04.494972] I [MSGID: 106568] [glusterd-svc-mgmt.c:228:glusterd_svc_stop] 0-management: scrub service is stopped [2017-08-20 20:31:04.545704] I [rpc-clnt.c:1059:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600 [2017-08-20 20:31:04.573657] I [rpc-clnt.c:1059:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600 [2017-08-20 20:31:04.588684] I [glusterd-utils.c:5468:glusterd_brick_start] 0-management: discovered already-running brick /data/gluster/www [2017-08-20 20:31:04.588717] I [MSGID: 106143] [glusterd-pmap.c:279:pmap_registry_bind] 0-pmap: adding brick /data/gluster/www on port 49154 [2017-08-20 20:31:04.588758] I [rpc-clnt.c:1059:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600 [2017-08-20 20:31:04.588901] I [rpc-clnt.c:1059:rpc_clnt_connection_init] 0-snapd: setting frame-timeout to 600 [2017-08-20 20:31:04.602973] I [rpc-clnt.c:1059:rpc_clnt_connection_init] 0-snapd: setting frame-timeout to 600 [2017-08-20 20:31:04.603087] I [rpc-clnt.c:1059:rpc_clnt_connection_init] 0-snapd: setting frame-timeout to 600 [2017-08-20 20:31:04.603337] I [MSGID: 106493] [glusterd-rpc-ops.c:485:__glusterd_friend_add_cbk] 0-glusterd: Received ACC from uuid: 62d463b1-700f-490b-a56e-3d5cb42a7c2a, host: web2.dasilva.network, port: 0 [2017-08-20 20:31:04.762187] I [MSGID: 106493] [glusterd-rpc-ops.c:700:__glusterd_friend_update_cbk] 0-management: Received ACC from uuid: 8f66df4a-e286-4c63-9b0b-257c1ccd08b0 [2017-08-20 20:31:04.763112] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:31:04.763782] I [MSGID: 106005] [glusterd-handler.c:5846:__glusterd_brick_rpc_notify] 0-management: Brick web1.dasilva.network:/data/gluster/etc has disconnected from glusterd. [2017-08-20 20:31:04.764406] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:31:04.765022] I [MSGID: 106005] [glusterd-handler.c:5846:__glusterd_brick_rpc_notify] 0-management: Brick web1.dasilva.network:/data/gluster/log has disconnected from glusterd. [2017-08-20 20:31:04.765674] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:31:04.766270] I [MSGID: 106005] [glusterd-handler.c:5846:__glusterd_brick_rpc_notify] 0-management: Brick web1.dasilva.network:/data/gluster/www has disconnected from glusterd. [2017-08-20 20:31:04.835086] I [MSGID: 106493] [glusterd-rpc-ops.c:700:__glusterd_friend_update_cbk] 0-management: Received ACC from uuid: 62d463b1-700f-490b-a56e-3d5cb42a7c2a [2017-08-20 20:31:06.310602] I [MSGID: 106143] [glusterd-pmap.c:279:pmap_registry_bind] 0-pmap: adding brick /data/gluster/etc on port 49152 [2017-08-20 20:31:06.325580] I [MSGID: 106143] [glusterd-pmap.c:279:pmap_registry_bind] 0-pmap: adding brick /data/gluster/log on port 49153 [2017-08-20 20:31:08.281721] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:31:08.282326] I [MSGID: 106005] [glusterd-handler.c:5846:__glusterd_brick_rpc_notify] 0-management: Brick web1.dasilva.network:/data/gluster/www has disconnected from glusterd. [2017-08-20 20:31:11.289971] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:31:14.395812] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:31:17.401739] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:31:20.405027] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:31:23.406061] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:31:26.410511] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:31:29.412599] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:31:32.419994] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:31:35.421374] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:31:38.428775] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:31:41.432908] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:31:44.438472] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:31:47.447419] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:31:50.446943] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:31:53.450128] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:31:56.450635] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:31:59.451675] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:32:02.452400] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:32:05.453685] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:32:08.452641] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:32:11.453445] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:32:14.455196] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:32:17.456529] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:32:20.457299] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:32:23.457298] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:32:26.458316] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:32:29.462464] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:32:32.463509] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:32:35.471852] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:32:38.478059] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:32:41.481627] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now The message "I [MSGID: 106005] [glusterd-handler.c:5846:__glusterd_brick_rpc_notify] 0-management: Brick web1.dasilva.network:/data/gluster/www has disconnected from glusterd." repeated 31 times between [2017-08-20 20:31:08.282326] and [2017-08-20 20:32:41.482613] [2017-08-20 20:32:44.483922] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:32:44.484643] I [MSGID: 106005] [glusterd-handler.c:5846:__glusterd_brick_rpc_notify] 0-management: Brick web1.dasilva.network:/data/gluster/www has disconnected from glusterd. [2017-08-20 20:32:47.489732] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:32:50.497276] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:32:53.501593] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:32:56.501910] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:32:59.502005] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:33:02.503433] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:33:05.504268] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:33:08.504652] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:33:11.505057] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:33:14.505655] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:33:17.506508] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:33:20.508507] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:33:23.509627] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:33:26.512980] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:33:29.512411] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:33:32.514311] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:33:35.514366] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:33:38.515273] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:33:41.515779] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:33:44.523155] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:33:47.525106] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:33:50.525899] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:33:53.532027] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:33:56.532302] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:33:59.532237] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:34:02.533960] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:34:05.535229] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:34:08.535468] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:34:11.536024] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:34:14.536086] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:34:17.537216] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:34:20.537552] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:34:23.538223] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:34:26.539057] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:34:29.538971] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:34:32.541228] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:34:35.541824] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now [2017-08-20 20:34:38.542531] I [socket.c:2474:socket_event_handler] 0-transport: EPOLLERR - disconnecting now And this repeats on and on. Regards, Cesar da SIlva 2017-08-21 13:57 GMT+02:00 Atin Mukherjee <amukherj at redhat.com>:> > > On Mon, Aug 21, 2017 at 2:49 AM, Cesar da Silva <thunderlight1 at gmail.com> > wrote: > >> Hi! >> I am having same issue but I am running Ubuntu v16.04. >> It does not mount during boot, but works if I mount it manually. I am >> running the Gluster-server on the same machines (3 machines) >> Here is the /tc/fstab file >> >> /dev/sdb1 /data/gluster ext4 defaults 0 0 >> >> web1.dasilva.network:/www /mnt/glusterfs/www glusterfs >> defaults,_netdev,log-level=debug,log-file=/var/log/gluster.log 0 0 >> web1.dasilva.network:/etc /mnt/glusterfs/etc glusterfs >> defaults,_netdev,log-level=debug,log-file=/var/log/gluster.log 0 0 >> >> Here is the logfile /var/log/gluster.log >> > > Could you point us to the glusterd log file content? > > >> --8<--start of log file ---------------------------------- >> [2017-08-20 20:30:39.638989] I [MSGID: 100030] [glusterfsd.c:2476:main] >> 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.11.2 >> (args: /usr/sbin/glusterfs --log-level=DEBUG --log-file=/var/log/gluster.log >> --volfile-server=web1.dasilva.network --volfile-id=/www >> /mnt/glusterfs/www) >> [2017-08-20 20:30:39.639024] I [MSGID: 100030] [glusterfsd.c:2476:main] >> 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.11.2 >> (args: /usr/sbin/glusterfs --log-level=DEBUG --log-file=/var/log/gluster.log >> --volfile-server=web1.dasilva.network --volfile-id=/etc >> /mnt/glusterfs/etc) >> [2017-08-20 20:30:39.926333] D [MSGID: 0] [glusterfsd.c:442:set_fuse_mount_options] >> 0-glusterfsd: fopen-keep-cache mode 2 >> [2017-08-20 20:30:39.926376] D [MSGID: 0] [glusterfsd.c:506:set_fuse_mount_options] >> 0-glusterfsd: fuse direct io type 2 >> [2017-08-20 20:30:39.926389] D [MSGID: 0] [glusterfsd.c:530:set_fuse_mount_options] >> 0-glusterfsd: fuse no-root-squash mode 0 >> [2017-08-20 20:30:39.926486] D [MSGID: 0] [options.c:1224:xlator_option_init_double] >> 0-fuse: option negative-timeout using set value 0.000000 >> [2017-08-20 20:30:39.926532] D [MSGID: 0] [glusterfsd.c:442:set_fuse_mount_options] >> 0-glusterfsd: fopen-keep-cache mode 2 >> [2017-08-20 20:30:39.926557] D [MSGID: 0] [glusterfsd.c:506:set_fuse_mount_options] >> 0-glusterfsd: fuse direct io type 2 >> [2017-08-20 20:30:39.926569] D [MSGID: 0] [glusterfsd.c:530:set_fuse_mount_options] >> 0-glusterfsd: fuse no-root-squash mode 0 >> [2017-08-20 20:30:39.926568] D [MSGID: 0] [options.c:1221:xlator_option_init_bool] >> 0-fuse: option no-root-squash using set value disable >> [2017-08-20 20:30:39.926649] D [MSGID: 0] [options.c:1224:xlator_option_init_double] >> 0-fuse: option negative-timeout using set value 0.000000 >> [2017-08-20 20:30:39.926726] D [MSGID: 0] [options.c:1221:xlator_option_init_bool] >> 0-fuse: option no-root-squash using set value disable >> [2017-08-20 20:30:39.927105] D [logging.c:1790:__gf_log_inject_timer_event] >> 0-logging-infra: Starting timer now. Timeout = 120, current buf size = 5 >> [2017-08-20 20:30:39.927359] D [rpc-clnt.c:1062:rpc_clnt_connection_init] >> 0-glusterfs: defaulting frame-timeout to 30mins >> [2017-08-20 20:30:39.927373] D [rpc-clnt.c:1076:rpc_clnt_connection_init] >> 0-glusterfs: disable ping-timeout >> [2017-08-20 20:30:39.927385] D [rpc-transport.c:279:rpc_transport_load] >> 0-rpc-transport: attempt to load file /usr/lib/x86_64-linux-gnu/glus >> terfs/3.11.2/rpc-transport/socket.so >> [2017-08-20 20:30:39.927774] D [logging.c:1790:__gf_log_inject_timer_event] >> 0-logging-infra: Starting timer now. Timeout = 120, current buf size = 5 >> [2017-08-20 20:30:39.927994] D [rpc-clnt.c:1062:rpc_clnt_connection_init] >> 0-glusterfs: defaulting frame-timeout to 30mins >> [2017-08-20 20:30:39.928008] D [rpc-clnt.c:1076:rpc_clnt_connection_init] >> 0-glusterfs: disable ping-timeout >> [2017-08-20 20:30:39.928019] D [rpc-transport.c:279:rpc_transport_load] >> 0-rpc-transport: attempt to load file /usr/lib/x86_64-linux-gnu/glus >> terfs/3.11.2/rpc-transport/socket.so >> [2017-08-20 20:30:40.380267] W [MSGID: 101002] >> [options.c:954:xl_opt_validate] 0-glusterfs: option 'address-family' is >> deprecated, preferred is 'transport.address-family', continuing with >> correction >> [2017-08-20 20:30:40.380391] D [socket.c:4163:socket_init] 0-glusterfs: >> Configued transport.tcp-user-timeout=0 >> [2017-08-20 20:30:40.380403] D [socket.c:4181:socket_init] 0-glusterfs: >> Reconfigued transport.keepalivecnt=9 >> [2017-08-20 20:30:40.380410] D [socket.c:4264:socket_init] 0-glusterfs: >> SSL support on the I/O path is NOT enabled >> [2017-08-20 20:30:40.380417] D [socket.c:4267:socket_init] 0-glusterfs: >> SSL support for glusterd is NOT enabled >> [2017-08-20 20:30:40.380423] D [socket.c:4284:socket_init] 0-glusterfs: >> using system polling thread >> [2017-08-20 20:30:40.380432] D [rpc-clnt.c:1581:rpcclnt_cbk_program_register] >> 0-glusterfs: New program registered: GlusterFS Callback, Num: 52743234, >> Ver: 1 >> [2017-08-20 20:30:40.382224] W [MSGID: 101002] >> [options.c:954:xl_opt_validate] 0-glusterfs: option 'address-family' is >> deprecated, preferred is 'transport.address-family', continuing with >> correction >> [2017-08-20 20:30:40.382305] D [socket.c:4163:socket_init] 0-glusterfs: >> Configued transport.tcp-user-timeout=0 >> [2017-08-20 20:30:40.382315] D [socket.c:4181:socket_init] 0-glusterfs: >> Reconfigued transport.keepalivecnt=9 >> [2017-08-20 20:30:40.382322] D [socket.c:4264:socket_init] 0-glusterfs: >> SSL support on the I/O path is NOT enabled >> [2017-08-20 20:30:40.382328] D [socket.c:4267:socket_init] 0-glusterfs: >> SSL support for glusterd is NOT enabled >> [2017-08-20 20:30:40.382334] D [socket.c:4284:socket_init] 0-glusterfs: >> using system polling thread >> [2017-08-20 20:30:40.382343] D [rpc-clnt.c:1581:rpcclnt_cbk_program_register] >> 0-glusterfs: New program registered: GlusterFS Callback, Num: 52743234, >> Ver: 1 >> [2017-08-20 20:30:40.466338] D [MSGID: 0] [common-utils.c:327:gf_resolve_ip6] >> 0-resolver: returning ip-192.168.1.8 (port-24007) for hostname: >> web1.dasilva.network and port: 24007 >> [2017-08-20 20:30:40.466364] D [MSGID: 0] [common-utils.c:327:gf_resolve_ip6] >> 0-resolver: returning ip-192.168.1.8 (port-24007) for hostname: >> web1.dasilva.network and port: 24007 >> [2017-08-20 20:30:40.466470] D [MSGID: 0] [common-utils.c:348:gf_resolve_ip6] >> 0-resolver: next DNS query will return: ip-192.168.1.19 port-24007 >> [2017-08-20 20:30:40.466480] D [MSGID: 0] [common-utils.c:348:gf_resolve_ip6] >> 0-resolver: next DNS query will return: ip-192.168.1.19 port-24007 >> [2017-08-20 20:30:40.466482] D [socket.c:3050:socket_fix_ssl_opts] >> 0-glusterfs: disabling SSL for portmapper connection >> [2017-08-20 20:30:40.466490] D [socket.c:3050:socket_fix_ssl_opts] >> 0-glusterfs: disabling SSL for portmapper connection >> [2017-08-20 20:30:40.466699] I [MSGID: 101190] >> [event-epoll.c:602:event_dispatch_epoll_worker] 0-epoll: Started thread >> with index 1 >> [2017-08-20 20:30:40.466699] I [MSGID: 101190] >> [event-epoll.c:602:event_dispatch_epoll_worker] 0-epoll: Started thread >> with index 1 >> [2017-08-20 20:30:40.466725] E [socket.c:2369:socket_connect_finish] >> 0-glusterfs: connection to 192.168.1.8:24007 failed (F?rbindelse >> v?gras); disconnecting socket >> [2017-08-20 20:30:40.466726] E [socket.c:2369:socket_connect_finish] >> 0-glusterfs: connection to 192.168.1.8:24007 failed (F?rbindelse >> v?gras); disconnecting socket >> [2017-08-20 20:30:40.466736] D [socket.c:686:__socket_shutdown] >> 0-glusterfs: shutdown() returned -1. Transportslutpunkten ?r inte f?rbunden >> [2017-08-20 20:30:40.466737] D [socket.c:686:__socket_shutdown] >> 0-glusterfs: shutdown() returned -1. Transportslutpunkten ?r inte f?rbunden >> [2017-08-20 20:30:40.466743] D [socket.c:733:__socket_disconnect] >> 0-glusterfs: __socket_teardown_connection () failed: Transportslutpunkten >> ?r inte f?rbunden >> [2017-08-20 20:30:40.466745] D [socket.c:733:__socket_disconnect] >> 0-glusterfs: __socket_teardown_connection () failed: Transportslutpunkten >> ?r inte f?rbunden >> [2017-08-20 20:30:40.466749] D [socket.c:2474:socket_event_handler] >> 0-transport: EPOLLERR - disconnecting now >> [2017-08-20 20:30:40.466751] D [socket.c:2474:socket_event_handler] >> 0-transport: EPOLLERR - disconnecting now >> [2017-08-20 20:30:40.466764] I [glusterfsd-mgmt.c:2171:mgmt_rpc_notify] >> 0-glusterfsd-mgmt: disconnected from remote-host: web1.dasilva.network >> [2017-08-20 20:30:40.466764] I [glusterfsd-mgmt.c:2171:mgmt_rpc_notify] >> 0-glusterfsd-mgmt: disconnected from remote-host: web1.dasilva.network >> [2017-08-20 20:30:40.658255] D [rpc-clnt-ping.c:99:rpc_clnt_remove_ping_timer_locked] >> (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x13b)[0x7f3f0f82abbb] >> (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_remove_ping >> _timer_locked+0x84)[0x7f3f0f5fd074] (--> /usr/lib/x86_64-linux-gnu/libg >> frpc.so.0(rpc_clnt_connection_cleanup+0xd4)[0x7f3f0f5f9774] (--> >> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x288)[0x7f3f0f5fa218] >> (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_transport_notify+0x23)[0x7f3f0f5f6493] >> ))))) 0-: 192.168.1.8:24007: ping timer event already removed >> [2017-08-20 20:30:40.658268] D [rpc-clnt-ping.c:99:rpc_clnt_remove_ping_timer_locked] >> (--> /usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x13b)[0x7f8f7039dbbb] >> (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_remove_ping >> _timer_locked+0x84)[0x7f8f70170074] (--> /usr/lib/x86_64-linux-gnu/libg >> frpc.so.0(rpc_clnt_connection_cleanup+0xd4)[0x7f8f7016c774] (--> >> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x288)[0x7f8f7016d218] >> (--> /usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_transport_notify+0x23)[0x7f8f70169493] >> ))))) 0-: 192.168.1.8:24007: ping timer event already removed >> [2017-08-20 20:30:43.928116] D [MSGID: 0] [common-utils.c:327:gf_resolve_ip6] >> 0-resolver: returning ip-192.168.1.19 (port-24007) for hostname: >> web1.dasilva.network and port: 24007 >> [2017-08-20 20:30:43.928164] D [socket.c:3050:socket_fix_ssl_opts] >> 0-glusterfs: disabling SSL for portmapper connection >> [2017-08-20 20:30:43.929085] D [MSGID: 0] [common-utils.c:327:gf_resolve_ip6] >> 0-resolver: returning ip-192.168.1.19 (port-24007) for hostname: >> web1.dasilva.network and port: 24007 >> [2017-08-20 20:30:43.929124] D [socket.c:3050:socket_fix_ssl_opts] >> 0-glusterfs: disabling SSL for portmapper connection >> [2017-08-20 20:30:46.927870] D [socket.c:686:__socket_shutdown] >> 0-glusterfs: shutdown() returned -1. Transportslutpunkten ?r inte f?rbunden >> [2017-08-20 20:30:46.927916] D [socket.c:733:__socket_disconnect] >> 0-glusterfs: __socket_teardown_connection () failed: Transportslutpunkten >> ?r inte f?rbunden >> [2017-08-20 20:30:46.927924] D [socket.c:2474:socket_event_handler] >> 0-transport: EPOLLERR - disconnecting now >> [2017-08-20 20:30:46.927935] I [glusterfsd-mgmt.c:2192:mgmt_rpc_notify] >> 0-glusterfsd-mgmt: Exhausted all volfile servers >> [2017-08-20 20:30:46.927938] D [socket.c:686:__socket_shutdown] >> 0-glusterfs: shutdown() returned -1. Transportslutpunkten ?r inte f?rbunden >> [2017-08-20 20:30:46.927959] D [socket.c:733:__socket_disconnect] >> 0-glusterfs: __socket_teardown_connection () failed: Transportslutpunkten >> ?r inte f?rbunden >> [2017-08-20 20:30:46.927966] D [socket.c:2474:socket_event_handler] >> 0-transport: EPOLLERR - disconnecting now >> [2017-08-20 20:30:46.927976] I [glusterfsd-mgmt.c:2192:mgmt_rpc_notify] >> 0-glusterfsd-mgmt: Exhausted all volfile servers >> [2017-08-20 20:30:46.928016] D [logging.c:1764:gf_log_flush_extra_msgs] >> 0-logging-infra: Log buffer size reduced. About to flush 5 extra log >> messages >> [2017-08-20 20:30:46.928028] D [logging.c:1767:gf_log_flush_extra_msgs] >> 0-logging-infra: Just flushed 5 extra log messages >> [2017-08-20 20:30:46.928058] W [glusterfsd.c:1331:cleanup_and_exit] >> (-->/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0xab) >> [0x7f8f7016d03b] -->/usr/sbin/glusterfs(+0x1041e) [0x55bfe6ff641e] >> -->/usr/sbin/glusterfs(cleanup_and_exit+0x54) [0x55bfe6fef6e4] ) 0-: >> received signum (1), shutting down >> [2017-08-20 20:30:46.928068] D [glusterfsd-mgmt.c:2653:glusterfs_mgmt_pmap_signout] >> 0-fsd-mgmt: portmapper signout arguments not given >> [2017-08-20 20:30:46.928085] I [fuse-bridge.c:5883:fini] 0-fuse: >> Unmounting '/mnt/glusterfs/www'. >> [2017-08-20 20:30:46.928447] D [logging.c:1764:gf_log_flush_extra_msgs] >> 0-logging-infra: Log buffer size reduced. About to flush 5 extra log >> messages >> [2017-08-20 20:30:46.928463] D [logging.c:1767:gf_log_flush_extra_msgs] >> 0-logging-infra: Just flushed 5 extra log messages >> [2017-08-20 20:30:46.928486] W [glusterfsd.c:1331:cleanup_and_exit] >> (-->/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0xab) >> [0x7f3f0f5fa03b] -->/usr/sbin/glusterfs(+0x1041e) [0x5638af0e941e] >> -->/usr/sbin/glusterfs(cleanup_and_exit+0x54) [0x5638af0e26e4] ) 0-: >> received signum (1), shutting down >> [2017-08-20 20:30:46.928495] D [glusterfsd-mgmt.c:2653:glusterfs_mgmt_pmap_signout] >> 0-fsd-mgmt: portmapper signout arguments not given >> [2017-08-20 20:30:46.928507] I [fuse-bridge.c:5883:fini] 0-fuse: >> Unmounting '/mnt/glusterfs/etc'. >> [2017-08-20 20:30:46.931358] D [MSGID: 0] [common-utils.c:327:gf_resolve_ip6] >> 0-resolver: returning ip-192.168.1.8 (port-24007) for hostname: >> web1.dasilva.network and port: 24007 >> [2017-08-20 20:30:46.931461] D [MSGID: 0] [common-utils.c:348:gf_resolve_ip6] >> 0-resolver: next DNS query will return: ip-192.168.1.19 port-24007 >> [2017-08-20 20:30:46.931469] D [socket.c:3050:socket_fix_ssl_opts] >> 0-glusterfs: disabling SSL for portmapper connection >> [2017-08-20 20:30:46.931585] I [timer.c:198:gf_timer_registry_init] >> (-->/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(+0x2ff6f) >> [0x7f8f703a8f6f] -->/usr/lib/x86_64-linux-gnu/l >> ibgfrpc.so.0(rpc_clnt_reconnect+0xee) [0x7f8f7016c54e] >> -->/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(gf_timer_call_after+0x204) >> [0x7f8f703a9324] ) 0-timer: ctx cleanup started >> [2017-08-20 20:30:46.931626] E [timer.c:44:gf_timer_call_after] >> (-->/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(+0x2ff6f) >> [0x7f8f703a8f6f] -->/usr/lib/x86_64-linux-gnu/l >> ibgfrpc.so.0(rpc_clnt_reconnect+0xee) [0x7f8f7016c54e] >> -->/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(gf_timer_call_after+0x245) >> [0x7f8f703a9365] ) 0-timer: !reg >> [2017-08-20 20:30:46.931634] E [rpc-clnt.c:432:rpc_clnt_reconnect] >> 0-glusterfs: Error adding to timer event queue >> [2017-08-20 20:30:46.932553] D [MSGID: 0] [common-utils.c:327:gf_resolve_ip6] >> 0-resolver: returning ip-192.168.1.8 (port-24007) for hostname: >> web1.dasilva.network and port: 24007 >> [2017-08-20 20:30:46.932664] D [MSGID: 0] [common-utils.c:348:gf_resolve_ip6] >> 0-resolver: next DNS query will return: ip-192.168.1.19 port-24007 >> [2017-08-20 20:30:46.932673] D [socket.c:3050:socket_fix_ssl_opts] >> 0-glusterfs: disabling SSL for portmapper connection >> [2017-08-20 20:30:46.932762] I [timer.c:198:gf_timer_registry_init] >> (-->/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(+0x2ff6f) >> [0x7f3f0f835f6f] -->/usr/lib/x86_64-linux-gnu/l >> ibgfrpc.so.0(rpc_clnt_reconnect+0xee) [0x7f3f0f5f954e] >> -->/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(gf_timer_call_after+0x204) >> [0x7f3f0f836324] ) 0-timer: ctx cleanup started >> [2017-08-20 20:30:46.932802] E [timer.c:44:gf_timer_call_after] >> (-->/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(+0x2ff6f) >> [0x7f3f0f835f6f] -->/usr/lib/x86_64-linux-gnu/l >> ibgfrpc.so.0(rpc_clnt_reconnect+0xee) [0x7f3f0f5f954e] >> -->/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(gf_timer_call_after+0x245) >> [0x7f3f0f836365] ) 0-timer: !reg >> [2017-08-20 20:30:46.932810] E [rpc-clnt.c:432:rpc_clnt_reconnect] >> 0-glusterfs: Error adding to timer event queue >> [2017-08-20 20:30:46.944014] I [fuse-bridge.c:5888:fini] 0-fuse: Closing >> fuse connection to '/mnt/glusterfs/etc'. >> [2017-08-20 20:30:46.944107] W [glusterfsd.c:1331:cleanup_and_exit] >> (-->/lib/x86_64-linux-gnu/libpthread.so.0(+0x76ba) [0x7f3f0efb96ba] >> -->/usr/sbin/glusterfs(glusterfs_sigwaiter+0xe5) [0x5638af0e28c5] >> -->/usr/sbin/glusterfs(cleanup_and_exit+0x54) [0x5638af0e26e4] ) 0-: >> received signum (15), shutting down >> [2017-08-20 20:30:46.948018] I [fuse-bridge.c:5888:fini] 0-fuse: Closing >> fuse connection to '/mnt/glusterfs/www'. >> [2017-08-20 20:30:46.948329] W [glusterfsd.c:1331:cleanup_and_exit] >> (-->/lib/x86_64-linux-gnu/libpthread.so.0(+0x76ba) [0x7f8f6fb2c6ba] >> -->/usr/sbin/glusterfs(glusterfs_sigwaiter+0xe5) [0x55bfe6fef8c5] >> -->/usr/sbin/glusterfs(cleanup_and_exit+0x54) [0x55bfe6fef6e4] ) 0-: >> received signum (15), shutting down >> --8<--end of log file ---------------------------------- >> >> As you can see bellow, the ports are also available >> >> tcp LISTEN 0 128 *:24007 >> *:* >> tcp TIME-WAIT 0 0 192.168.1.8:49110 >> 192.168.1.8:24007 >> tcp TIME-WAIT 0 0 192.168.1.8:49081 >> 192.168.1.8:24007 >> tcp TIME-WAIT 0 0 192.168.1.8:49118 >> 192.168.1.8:24007 >> tcp ESTAB 0 0 192.168.1.8:49146 >> 192.168.1.8:24007 >> tcp TIME-WAIT 0 0 192.168.1.8:49104 >> 192.168.1.8:24007 >> tcp TIME-WAIT 0 0 192.168.1.8:49094 >> 192.168.1.8:24007 >> tcp TIME-WAIT 0 0 192.168.1.8:49097 >> 192.168.1.8:24007 >> tcp TIME-WAIT 0 0 192.168.1.8:49085 >> 192.168.1.8:24007 >> tcp TIME-WAIT 0 0 192.168.1.8:49123 >> 192.168.1.8:24007 >> tcp ESTAB 0 0 192.168.1.8:49151 >> 192.168.1.10:24007 >> tcp TIME-WAIT 0 0 192.168.1.8:49096 >> 192.168.1.8:24007 >> tcp TIME-WAIT 0 0 192.168.1.8:49101 >> 192.168.1.8:24007 >> tcp TIME-WAIT 0 0 192.168.1.8:49103 >> 192.168.1.8:24007 >> tcp TIME-WAIT 0 0 192.168.1.8:49088 >> 192.168.1.8:24007 >> tcp TIME-WAIT 0 0 192.168.1.8:49087 >> 192.168.1.8:24007 >> tcp TIME-WAIT 0 0 192.168.1.8:49140 >> 192.168.1.8:24007 >> tcp TIME-WAIT 0 0 192.168.1.8:49125 >> 192.168.1.8:24007 >> tcp TIME-WAIT 0 0 192.168.1.8:49147 >> 192.168.1.8:24007 >> tcp TIME-WAIT 0 0 192.168.1.8:49138 >> 192.168.1.8:24007 >> tcp TIME-WAIT 0 0 192.168.1.8:49093 >> 192.168.1.8:24007 >> tcp TIME-WAIT 0 0 192.168.1.8:49098 >> 192.168.1.8:24007 >> tcp TIME-WAIT 0 0 192.168.1.8:49091 >> 192.168.1.8:24007 >> tcp TIME-WAIT 0 0 192.168.1.8:49119 >> 192.168.1.8:24007 >> tcp ESTAB 0 0 127.0.0.1:24007 >> 127.0.0.1:49147 >> tcp TIME-WAIT 0 0 192.168.1.8:49090 >> 192.168.1.8:24007 >> tcp TIME-WAIT 0 0 192.168.1.8:49148 >> 192.168.1.8:24007 >> tcp TIME-WAIT 0 0 192.168.1.8:49149 >> 192.168.1.8:24007 >> tcp TIME-WAIT 0 0 192.168.1.8:49117 >> 192.168.1.8:24007 >> tcp TIME-WAIT 0 0 192.168.1.8:49095 >> 192.168.1.8:24007 >> tcp TIME-WAIT 0 0 192.168.1.8:49112 >> 192.168.1.8:24007 >> tcp TIME-WAIT 0 0 192.168.1.8:49111 >> 192.168.1.8:24007 >> tcp TIME-WAIT 0 0 192.168.1.8:49086 >> 192.168.1.8:24007 >> tcp ESTAB 0 0 192.168.1.8:49150 >> 192.168.1.9:24007 >> tcp TIME-WAIT 0 0 192.168.1.8:49142 >> 192.168.1.8:24007 >> tcp TIME-WAIT 0 0 192.168.1.8:49141 >> 192.168.1.8:24007 >> tcp TIME-WAIT 0 0 192.168.1.8:49084 >> 192.168.1.8:24007 >> tcp TIME-WAIT 0 0 192.168.1.8:49100 >> 192.168.1.8:24007 >> tcp ESTAB 0 0 127.0.0.1:49147 >> 127.0.0.1:24007 >> tcp TIME-WAIT 0 0 192.168.1.8:49127 >> 192.168.1.8:24007 >> tcp TIME-WAIT 0 0 192.168.1.8:49144 >> 192.168.1.8:24007 >> tcp ESTAB 0 0 192.168.1.8:24007 >> 192.168.1.8:49145 >> tcp TIME-WAIT 0 0 192.168.1.8:49139 >> 192.168.1.8:24007 >> tcp TIME-WAIT 0 0 192.168.1.8:49089 >> 192.168.1.8:24007 >> tcp TIME-WAIT 0 0 192.168.1.8:49102 >> 192.168.1.8:24007 >> tcp TIME-WAIT 0 0 192.168.1.8:49083 >> 192.168.1.8:24007 >> tcp TIME-WAIT 0 0 192.168.1.8:49129 >> 192.168.1.8:24007 >> tcp TIME-WAIT 0 0 192.168.1.8:49114 >> 192.168.1.8:24007 >> tcp TIME-WAIT 0 0 192.168.1.8:49099 >> 192.168.1.8:24007 >> tcp TIME-WAIT 0 0 192.168.1.8:49107 >> 192.168.1.8:24007 >> tcp TIME-WAIT 0 0 192.168.1.8:49126 >> 192.168.1.8:24007 >> tcp TIME-WAIT 0 0 192.168.1.8:49082 >> 192.168.1.8:24007 >> tcp TIME-WAIT 0 0 192.168.1.8:49109 >> 192.168.1.8:24007 >> tcp TIME-WAIT 0 0 192.168.1.8:49115 >> 192.168.1.8:24007 >> tcp TIME-WAIT 0 0 192.168.1.8:49106 >> 192.168.1.8:24007 >> tcp ESTAB 0 0 192.168.1.8:49145 >> 192.168.1.8:24007 >> tcp TIME-WAIT 0 0 192.168.1.8:49124 >> 192.168.1.8:24007 >> tcp TIME-WAIT 0 0 192.168.1.8:49143 >> 192.168.1.8:24007 >> tcp TIME-WAIT 0 0 192.168.1.8:49108 >> 192.168.1.8:24007 >> tcp ESTAB 0 0 192.168.1.8:24007 >> 192.168.1.8:49146 >> tcp TIME-WAIT 0 0 192.168.1.8:49136 >> 192.168.1.8:24007 >> tcp TIME-WAIT 0 0 192.168.1.8:49128 >> 192.168.1.8:24007 >> tcp TIME-WAIT 0 0 192.168.1.8:49137 >> 192.168.1.8:24007 >> tcp TIME-WAIT 0 0 192.168.1.8:49092 >> 192.168.1.8:24007 >> tcp TIME-WAIT 0 0 192.168.1.8:49121 >> 192.168.1.8:24007 >> tcp TIME-WAIT 0 0 192.168.1.8:49105 >> 192.168.1.8:24007 >> tcp TIME-WAIT 0 0 192.168.1.8:49116 >> 192.168.1.8:24007 >> tcp TIME-WAIT 0 0 192.168.1.8:49120 >> 192.168.1.8:24007 >> tcp TIME-WAIT 0 0 192.168.1.8:49122 >> 192.168.1.8:24007 >> >> >> And here is the information about the volumes: >> >> sudo gluster volume info >> >> Volume Name: etc >> Type: Replicate >> Volume ID: dd4e08e6-9543-4ad5-bb2e-e41a0e47c9c5 >> Status: Started >> Snapshot Count: 0 >> Number of Bricks: 1 x 3 = 3 >> Transport-type: tcp >> Bricks: >> Brick1: web1.dasilva.network:/data/gluster/etc >> Brick2: web2.dasilva.network:/data/gluster/etc >> Brick3: web3.dasilva.network:/data/gluster/etc >> Options Reconfigured: >> nfs.disable: on >> transport.address-family: inet >> >> Volume Name: log >> Type: Replicate >> Volume ID: 06451895-b6cc-40f7-a173-c793a7610229 >> Status: Started >> Snapshot Count: 0 >> Number of Bricks: 1 x 3 = 3 >> Transport-type: tcp >> Bricks: >> Brick1: web1.dasilva.network:/data/gluster/log >> Brick2: web2.dasilva.network:/data/gluster/log >> Brick3: web3.dasilva.network:/data/gluster/log >> Options Reconfigured: >> nfs.disable: on >> transport.address-family: inet >> >> Volume Name: www >> Type: Replicate >> Volume ID: ef7bee14-30a6-471e-84fa-51341f2908b5 >> Status: Started >> Snapshot Count: 0 >> Number of Bricks: 1 x 3 = 3 >> Transport-type: tcp >> Bricks: >> Brick1: web1.dasilva.network:/data/gluster/www >> Brick2: web2.dasilva.network:/data/gluster/www >> Brick3: web3.dasilva.network:/data/gluster/www >> Options Reconfigured: >> nfs.disable: on >> transport.address-family: inet >> >> Regards, >> Cesar da Silva >> >> _______________________________________________ >> Gluster-users mailing list >> Gluster-users at gluster.org >> http://lists.gluster.org/mailman/listinfo/gluster-users >> > >-- Regards, Cesar da Silva Bernstr?msv?gen 42 146 38 Tullinge Sweden Mobile: +46-(0)735-05 12 08 E-mail: cesar at da-silva.se G-Mail: thunderligth1 at gmail.com Skype: cesar.dasilva MSN: cesardasilva at hotmail.com Homepage: http://www.da-silva.se -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.gluster.org/pipermail/gluster-users/attachments/20170821/ef32ae9e/attachment.html>