Mark Ruys
2015-Sep-21 07:48 UTC
[Gluster-users] Launching heal operation has been unsuccessful
Hi, I?ve trouble the two bricks in replica (on two servers, file1 and file2). They fail to perform a heal: file1:~$ sudo gluster volume heal GLUSTER-SHARE Launching Heal operation on volume GLUSTER-SHARE has been unsuccessful file2:~$ sudo gluster volume heal GLUSTER-SHARE Commit failed on file1. Please check the log file for more details. As a result, I can?t fix a split brain situation on these bricks. Other volumes on the same machine don?t have this problem. How can I fix it? Thanks, Mark PS. Some configuration and status details: file1:~$ sudo gluster volume status GLUSTER-SHARE Status of volume: GLUSTER-SHARE Gluster process Port Online Pid ------------------------------------------------------------------------------ Brick file1:/data/export-share-1 49152 Y 1229 Brick file2:/data/export-share-2 49160 Y 4966 NFS Server on localhost 2049 Y 16980 Self-heal Daemon on localhost N/A Y 16988 NFS Server on file2 2049 Y 4978 Self-heal Daemon on file2 N/A Y 4995 There are no active volume tasks file2:~$ sudo gluster volume status GLUSTER-SHARE Status of volume: GLUSTER-SHARE Gluster process Port Online Pid ------------------------------------------------------------------------------ Brick file1:/data/export-share-1 49152 Y 1229 Brick file2:/data/export-share-2 49160 Y 4966 NFS Server on localhost 2049 Y 4978 Self-heal Daemon on localhost N/A Y 4995 NFS Server on file1 2049 Y 16980 Self-heal Daemon on file1 N/A Y 16988 There are no active volume tasks file1:~$ sudo gluster volume info GLUSTER-SHARE Volume Name: GLUSTER-SHARE Type: Replicate Volume ID: e6eb05aa-be3b-456c-bf30-27275faa529c Status: Started Number of Bricks: 1 x 2 = 2 Transport-type: tcp Bricks: Brick1: file1:/data/export-share-1 Brick2: file2:/data/export-share-2 Options Reconfigured: features.limit-usage: /:10gb auth.allow: 10.0.0.* features.quota: on nfs.disable: off cli.log on file1: [2015-09-21 07:40:32.848845] W [rpc-transport.c:175:rpc_transport_load] 0-rpc-transport: missing 'option transport-type'. defaulting to "socket" [2015-09-21 07:40:32.851395] I [socket.c:3564:socket_init] 0-glusterfs: SSL support is NOT enabled [2015-09-21 07:40:32.852809] I [socket.c:3579:socket_init] 0-glusterfs: using system polling thread [2015-09-21 07:40:33.006118] I [cli-rpc-ops.c:6293:gf_cli_heal_volume_cbk] 0-cli: Received resp to heal volume [2015-09-21 07:40:33.006211] I [input.c:36:cli_batch] 0-: Exiting with: -1 cli.log on file2: [2015-09-21 07:39:42.730058] W [rpc-transport.c:175:rpc_transport_load] 0-rpc-transport: missing 'option transport-type'. defaulting to "socket" [2015-09-21 07:39:42.730809] I [socket.c:3564:socket_init] 0-glusterfs: SSL support is NOT enabled [2015-09-21 07:39:42.730833] I [socket.c:3579:socket_init] 0-glusterfs: using system polling thread [2015-09-21 07:39:42.828081] I [cli-rpc-ops.c:6293:gf_cli_heal_volume_cbk] 0-cli: Received resp to heal volume [2015-09-21 07:39:42.828212] I [input.c:36:cli_batch] 0-: Exiting with: 0 Gluster version: file1:/var/log/glusterfs$ dpkg -l 'gluster*' Desired=Unknown/Install/Remove/Purge/Hold | Status=Not/Inst/Conf-files/Unpacked/halF-conf/Half-inst/trig-aWait/Trig-pend |/ Err?=(none)/Reinst-required (Status,Err: uppercase=bad) ||/ Name Version Description +++-=====================================-=====================================-=========================================================================================un glusterfs <none> (no description available) ii glusterfs-client 3.4.7-ubuntu1~precise1 clustered file-system (client package) ii glusterfs-common 3.4.7-ubuntu1~precise1 GlusterFS common libraries and translator modules ii glusterfs-server 3.4.7-ubuntu1~precise1 clustered file-system (server package) --- Oudenhof 4c, 4191NW Geldermalsen, The Netherlands Web site and travel directions: www.peercode.nl <http://peercode.nl/> Phone +31.88.0084124 :: Mobile +31.6.51298623 -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://www.gluster.org/pipermail/gluster-users/attachments/20150921/593a29c9/attachment.html>
Ravishankar N
2015-Sep-21 09:19 UTC
[Gluster-users] Launching heal operation has been unsuccessful
On 09/21/2015 01:18 PM, Mark Ruys wrote:> Hi, > > I?ve trouble the two bricks in replica (on two servers, file1 and > file2). They fail to perform a heal: > > file1:~$ sudo gluster volume heal GLUSTER-SHARE > Launching Heal operation on volume GLUSTER-SHARE has been unsuccessful > > > file2:~$ sudo gluster volume heal GLUSTER-SHARE > Commit failed on file1. Please check the log file for more details.Can you share the output of what gets logged to glustershd.log and usr-local-etc-glusterfs-glusterd.vol.log from both nodes when you run the heal command?> > As a result, I can?t fix a split brain situation on these bricks. > Other volumes on the same machine don?t have this problem. > > How can I fix it? > > Thanks, Mark > > > PS. Some configuration and status details: > > file1:~$ sudo gluster volume status GLUSTER-SHARE > Status of volume: GLUSTER-SHARE > Gluster processPortOnlinePid > ------------------------------------------------------------------------------ > Brick file1:/data/export-share-149152Y1229 > Brick file2:/data/export-share-249160Y4966 > NFS Server on localhost2049Y16980 > Self-heal Daemon on localhostN/AY16988 > NFS Server on file22049Y4978 > Self-heal Daemon on file2N/AY4995 > > > There are no active volume tasks > > > file2:~$ sudo gluster volume status GLUSTER-SHARE > Status of volume: GLUSTER-SHARE > Gluster processPortOnlinePid > ------------------------------------------------------------------------------ > Brick file1:/data/export-share-149152Y1229 > Brick file2:/data/export-share-249160Y4966 > NFS Server on localhost2049Y4978 > Self-heal Daemon on localhostN/AY4995 > NFS Server on file12049Y16980 > Self-heal Daemon on file1N/AY16988 > > > There are no active volume tasks > > > file1:~$ sudo gluster volume info GLUSTER-SHARE > > > Volume Name: GLUSTER-SHARE > Type: Replicate > Volume ID: e6eb05aa-be3b-456c-bf30-27275faa529c > Status: Started > Number of Bricks: 1 x 2 = 2 > Transport-type: tcp > Bricks: > Brick1: file1:/data/export-share-1 > Brick2: file2:/data/export-share-2 > Options Reconfigured: > features.limit-usage: /:10gb > auth.allow: 10.0.0.* > features.quota: on > nfs.disable: off > > > cli.log on file1: > > [2015-09-21 07:40:32.848845] W > [rpc-transport.c:175:rpc_transport_load] 0-rpc-transport: missing > 'option transport-type'. defaulting to "socket" > [2015-09-21 07:40:32.851395] I [socket.c:3564:socket_init] > 0-glusterfs: SSL support is NOT enabled > [2015-09-21 07:40:32.852809] I [socket.c:3579:socket_init] > 0-glusterfs: using system polling thread > [2015-09-21 07:40:33.006118] I > [cli-rpc-ops.c:6293:gf_cli_heal_volume_cbk] 0-cli: Received resp to > heal volume > [2015-09-21 07:40:33.006211] I [input.c:36:cli_batch] 0-: Exiting with: -1 > > cli.log on file2: > > [2015-09-21 07:39:42.730058] W > [rpc-transport.c:175:rpc_transport_load] 0-rpc-transport: missing > 'option transport-type'. defaulting to "socket" > [2015-09-21 07:39:42.730809] I [socket.c:3564:socket_init] > 0-glusterfs: SSL support is NOT enabled > [2015-09-21 07:39:42.730833] I [socket.c:3579:socket_init] > 0-glusterfs: using system polling thread > [2015-09-21 07:39:42.828081] I > [cli-rpc-ops.c:6293:gf_cli_heal_volume_cbk] 0-cli: Received resp to > heal volume > [2015-09-21 07:39:42.828212] I [input.c:36:cli_batch] 0-: Exiting with: 0 > > > Gluster version: > > file1:/var/log/glusterfs$ dpkg -l 'gluster*' > Desired=Unknown/Install/Remove/Purge/Hold > | > Status=Not/Inst/Conf-files/Unpacked/halF-conf/Half-inst/trig-aWait/Trig-pend > |/ Err?=(none)/Reinst-required (Status,Err: uppercase=bad) > ||/ Name Version > Description > +++-=====================================-=====================================-=========================================================================================> un glusterfs <none> (no description > available) > ii glusterfs-client 3.4.7-ubuntu1~precise1 clustered > file-system (client package) > ii glusterfs-common 3.4.7-ubuntu1~precise1 GlusterFS > common libraries and translator modules > ii glusterfs-server 3.4.7-ubuntu1~precise1 clustered > file-system (server package) > > > > > --- > Oudenhof 4c, 4191NW Geldermalsen, The Netherlands > Web site and travel directions: www.peercode.nl <http://peercode.nl> > Phone +31.88.0084124 :: Mobile +31.6.51298623 > > > > _______________________________________________ > Gluster-users mailing list > Gluster-users at gluster.org > http://www.gluster.org/mailman/listinfo/gluster-users-------------- next part -------------- An HTML attachment was scrubbed... URL: <http://www.gluster.org/pipermail/gluster-users/attachments/20150921/beef2de0/attachment.html>