Punit Dambiwal
2015-Mar-20 04:30 UTC
[Gluster-users] Client keep disconnecting connection | Brick Logs
Hi, I have seen some error in the bricks log file... -------------------- [2015-03-20 04:10:07.688859] I [server-handshake.c:585:server_setvolume] 0-ds01-server: accepted client from cpu01-20541-2015/03/20-04:10:02:198340-ds01-client-0-0-0 (version: 3.6.2) [2015-03-20 04:10:12.930118] I [server-handshake.c:585:server_setvolume] 0-ds01-server: accepted client from cpu04-20740-2015/03/20-04:11:15:159475-ds01-client-0-0-0 (version: 3.6.2) [2015-03-20 04:10:12.945648] I [server-handshake.c:585:server_setvolume] 0-ds01-server: accepted client from cpu02-20463-2015/03/20-04:10:07:436641-ds01-client-0-0-0 (version: 3.6.2) [2015-03-20 04:10:12.952929] I [server-handshake.c:585:server_setvolume] 0-ds01-server: accepted client from cpu03-20529-2015/03/20-04:10:31:246941-ds01-client-0-0-0 (version: 3.6.2) [2015-03-20 04:12:04.247216] I [login.c:82:gf_auth] 0-auth/login: allowed user names: 6ba6d773-cf70-4ba9-98d3-d2e31bcbb14c [2015-03-20 04:12:04.247270] I [server-handshake.c:585:server_setvolume] 0-ds01-server: accepted client from cpu03-20682-2015/03/20-04:12:27:544067-ds01-client-0-0-0 (version: 3.6.2) [2015-03-20 04:12:04.287656] I [server.c:518:server_rpc_notify] 0-ds01-server: disconnecting connection from cpu03-20682-2015/03/20-04:12:27:544067-ds01-client-0-0-0 [2015-03-20 04:12:04.287717] I [client_t.c:417:gf_client_unref] 0-ds01-server: Shutting down connection cpu03-20682-2015/03/20-04:12:27:544067-ds01-client-0-0-0 [2015-03-20 04:12:11.111914] I [server.c:518:server_rpc_notify] 0-ds01-server: disconnecting connection from cpu02-20463-2015/03/20-04:10:07:436641-ds01-client-0-0-0 [2015-03-20 04:12:11.112005] I [client_t.c:417:gf_client_unref] 0-ds01-server: Shutting down connection cpu02-20463-2015/03/20-04:10:07:436641-ds01-client-0-0-0 [2015-03-20 04:12:11.611692] I [server.c:518:server_rpc_notify] 0-ds01-server: disconnecting connection from cpu04-20740-2015/03/20-04:11:15:159475-ds01-client-0-0-0 [2015-03-20 04:12:11.611772] I [client_t.c:417:gf_client_unref] 0-ds01-server: Shutting down connection cpu04-20740-2015/03/20-04:11:15:159475-ds01-client-0-0-0 [2015-03-20 04:12:14.299109] I [server.c:518:server_rpc_notify] 0-ds01-server: disconnecting connection from cpu03-20529-2015/03/20-04:10:31:246941-ds01-client-0-0-0 [2015-03-20 04:12:14.299182] I [client_t.c:417:gf_client_unref] 0-ds01-server: Shutting down connection cpu03-20529-2015/03/20-04:10:31:246941-ds01-client-0-0-0 [2015-03-20 04:12:16.059672] I [server.c:518:server_rpc_notify] 0-ds01-server: disconnecting connection from cpu01-20541-2015/03/20-04:10:02:198340-ds01-client-0-0-0 [2015-03-20 04:12:16.059748] I [client_t.c:417:gf_client_unref] 0-ds01-server: Shutting down connection cpu01-20541-2015/03/20-04:10:02:198340-ds01-client-0-0-0 ------------------- Already tried with the following :- 1. Reboot the glusterd and glusterfsd services.. 2. Reboot the storage nodes.. 3. Network should not be a problem as it was working before...and stop working suddenly...anyways i have 10G network with bonding for gluster... 3. Selinux disabled on all the nodes.. 4. Iptables allowed the below ports for gluster (Even try with stop the iptables):- ----------------- # glusterd -A INPUT -p tcp -m tcp --dport 24007 -j ACCEPT # Ports for gluster volume bricks (default 100 ports) -A INPUT -p tcp -m tcp --dport 24009:24208 -j ACCEPT -A INPUT -p tcp -m tcp --dport 49152:49351 -j ACCEPT ------------------ Network Topology in My ENV :- On Each Host i have 6 ethernet cards :- eth0 :- ovirtmgmt eth1 :- VM Network (Private) eth2 & eth3 (Bond1) :- VM Network (Public) eth4 & eth5 (Bond0) 10G :- Storage Gluster use... I can ping telnet other servers on this storage network but still in the brick logs it's disconnecting connection error....please help me to solve this problem... Thanks, Punit -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://www.gluster.org/pipermail/gluster-users/attachments/20150320/72f3ccd5/attachment.html>
Punit Dambiwal
2015-Mar-23 01:51 UTC
[Gluster-users] Client keep disconnecting connection | Brick Logs
Hi, Can anybody help me here to solve this problem .... Thanks, Punit On Fri, Mar 20, 2015 at 12:30 PM, Punit Dambiwal <hypunit at gmail.com> wrote:> Hi, > > I have seen some error in the bricks log file... > > -------------------- > [2015-03-20 04:10:07.688859] I [server-handshake.c:585:server_setvolume] > 0-ds01-server: accepted client from > cpu01-20541-2015/03/20-04:10:02:198340-ds01-client-0-0-0 (version: 3.6.2) > [2015-03-20 04:10:12.930118] I [server-handshake.c:585:server_setvolume] > 0-ds01-server: accepted client from > cpu04-20740-2015/03/20-04:11:15:159475-ds01-client-0-0-0 (version: 3.6.2) > [2015-03-20 04:10:12.945648] I [server-handshake.c:585:server_setvolume] > 0-ds01-server: accepted client from > cpu02-20463-2015/03/20-04:10:07:436641-ds01-client-0-0-0 (version: 3.6.2) > [2015-03-20 04:10:12.952929] I [server-handshake.c:585:server_setvolume] > 0-ds01-server: accepted client from > cpu03-20529-2015/03/20-04:10:31:246941-ds01-client-0-0-0 (version: 3.6.2) > [2015-03-20 04:12:04.247216] I [login.c:82:gf_auth] 0-auth/login: allowed > user names: 6ba6d773-cf70-4ba9-98d3-d2e31bcbb14c > [2015-03-20 04:12:04.247270] I [server-handshake.c:585:server_setvolume] > 0-ds01-server: accepted client from > cpu03-20682-2015/03/20-04:12:27:544067-ds01-client-0-0-0 (version: 3.6.2) > [2015-03-20 04:12:04.287656] I [server.c:518:server_rpc_notify] > 0-ds01-server: disconnecting connection from > cpu03-20682-2015/03/20-04:12:27:544067-ds01-client-0-0-0 > [2015-03-20 04:12:04.287717] I [client_t.c:417:gf_client_unref] > 0-ds01-server: Shutting down connection > cpu03-20682-2015/03/20-04:12:27:544067-ds01-client-0-0-0 > [2015-03-20 04:12:11.111914] I [server.c:518:server_rpc_notify] > 0-ds01-server: disconnecting connection from > cpu02-20463-2015/03/20-04:10:07:436641-ds01-client-0-0-0 > [2015-03-20 04:12:11.112005] I [client_t.c:417:gf_client_unref] > 0-ds01-server: Shutting down connection > cpu02-20463-2015/03/20-04:10:07:436641-ds01-client-0-0-0 > [2015-03-20 04:12:11.611692] I [server.c:518:server_rpc_notify] > 0-ds01-server: disconnecting connection from > cpu04-20740-2015/03/20-04:11:15:159475-ds01-client-0-0-0 > [2015-03-20 04:12:11.611772] I [client_t.c:417:gf_client_unref] > 0-ds01-server: Shutting down connection > cpu04-20740-2015/03/20-04:11:15:159475-ds01-client-0-0-0 > [2015-03-20 04:12:14.299109] I [server.c:518:server_rpc_notify] > 0-ds01-server: disconnecting connection from > cpu03-20529-2015/03/20-04:10:31:246941-ds01-client-0-0-0 > [2015-03-20 04:12:14.299182] I [client_t.c:417:gf_client_unref] > 0-ds01-server: Shutting down connection > cpu03-20529-2015/03/20-04:10:31:246941-ds01-client-0-0-0 > [2015-03-20 04:12:16.059672] I [server.c:518:server_rpc_notify] > 0-ds01-server: disconnecting connection from > cpu01-20541-2015/03/20-04:10:02:198340-ds01-client-0-0-0 > [2015-03-20 04:12:16.059748] I [client_t.c:417:gf_client_unref] > 0-ds01-server: Shutting down connection > cpu01-20541-2015/03/20-04:10:02:198340-ds01-client-0-0-0 > ------------------- > > Already tried with the following :- > 1. Reboot the glusterd and glusterfsd services.. > 2. Reboot the storage nodes.. > 3. Network should not be a problem as it was working before...and stop > working suddenly...anyways i have 10G network with bonding for gluster... > 3. Selinux disabled on all the nodes.. > 4. Iptables allowed the below ports for gluster (Even try with stop the > iptables):- > > ----------------- > # glusterd > -A INPUT -p tcp -m tcp --dport 24007 -j ACCEPT > > # Ports for gluster volume bricks (default 100 ports) > -A INPUT -p tcp -m tcp --dport 24009:24208 -j ACCEPT > -A INPUT -p tcp -m tcp --dport 49152:49351 -j ACCEPT > ------------------ > > Network Topology in My ENV :- > > On Each Host i have 6 ethernet cards :- > eth0 :- ovirtmgmt > eth1 :- VM Network (Private) > eth2 & eth3 (Bond1) :- VM Network (Public) > eth4 & eth5 (Bond0) 10G :- Storage Gluster use... > > I can ping telnet other servers on this storage network but still in the > brick logs it's disconnecting connection error....please help me to solve > this problem... > > Thanks, > Punit > > >-------------- next part -------------- An HTML attachment was scrubbed... URL: <http://www.gluster.org/pipermail/gluster-users/attachments/20150323/3ecbf24a/attachment.html>