search for: afr_selfheal_entry_do

...D: 106118] [glusterd-handler.c:6342:__glusterd_peer_rpc_notify] 0-management: Lock not released for thedude ??? - on node 2, volume are up but don't seem to be willing to correctly heal. The logs show a lot of : ??? ??? [2018-05-02 09:23:01.054196] I [MSGID: 108026] [afr-self-heal-entry.c:887:afr_selfheal_entry_do] 0-thedude-replicate-0: performing entry selfheal on 4dc0ae36-c365-4fc7-b44c-d717392c7bd3 ??? ??? [2018-05-02 09:23:01.222596] E [MSGID: 114031] [client-rpc-fops.c:233:client3_3_mknod_cbk] 0-thedude-client-2: remote operation failed. Path: <gfid:74ea4c57-61e5-4674-96e4-51356dd710db> [No space...

...42:__glusterd_peer_rpc_notify] 0-management: Lock > not released for thedude > > > ??? - on node 2, volume are up but don't seem to be willing to correctly > heal. The logs show a lot of : > ??? ??? [2018-05-02 09:23:01.054196] I [MSGID: 108026] > [afr-self-heal-entry.c:887:afr_selfheal_entry_do] 0-thedude-replicate-0: > performing entry selfheal on 4dc0ae36-c365-4fc7-b44c-d717392c7bd3 > ??? ??? [2018-05-02 09:23:01.222596] E [MSGID: 114031] > [client-rpc-fops.c:233:client3_3_mknod_cbk] 0-thedude-client-2: remote > operation failed. Path: <gfid:74ea4c57-61e5-4674-96e4-51356d...

...43a733000 We repeated this scenario a second time with a fresh setup and got the same results. Does anyone know what we are doing wrong ? Is there maybe a problem with glusterfs and tar ? Log excerpts: glustershd.log [2017-07-26 15:31:36.290908] I [MSGID: 108026] [afr-self-heal-entry.c:833:afr_selfheal_entry_do] 0-gv0-replicate-0: performing entry selfheal on fe5c42ac-5fda-47d4-8221-484c8d826c06 [2017-07-26 15:31:36.294289] W [MSGID: 114031] [client-rpc-fops.c:2933:client3_3_lookup_cbk] 0-gv0-client-1: remote operation failed. Path: (null) (00000000-0000-0000-0000-000000000000) [No data available] [2017-0...

...and got the same > results. > > Does anyone know what we are doing wrong ? > > Is there maybe a problem with glusterfs and tar ? > > > Log excerpts: > > > glustershd.log > > [2017-07-26 15:31:36.290908] I [MSGID: 108026] > [afr-self-heal-entry.c:833:afr_selfheal_entry_do] 0-gv0-replicate-0: > performing entry selfheal on fe5c42ac-5fda-47d4-8221-484c8d826c06 > [2017-07-26 15:31:36.294289] W [MSGID: 114031] > [client-rpc-fops.c:2933:client3_3_lookup_cbk] 0-gv0-client-1: remote > operation failed. Path: (null) (00000000-0000-0000-0000-000000000000) [No &gt...

...second time with a fresh setup and got the same results. This is a real problem for us, so I would be very thankful if anyone can help us with this issue or point us in the right direction. Log excerpts: glustershd.log [2017-07-26 15:31:36.290908] I [MSGID: 108026] [afr-self-heal-entry.c:833:afr_selfheal_entry_do] 0-gv0-replicate-0: performing entry selfheal on fe5c42ac-5fda-47d4-8221-484c8d826c06 [2017-07-26 15:31:36.294289] W [MSGID: 114031] [client-rpc-fops.c:2933:client3_3_lookup_cbk] 0-gv0-client-1: remote operation failed. Path: (null) (00000000-0000-0000-0000-000000000000) [No data available] [2017-0...

...9faa25156 [2018-04-09 06:58:53.757677] I [MSGID: 108026] [afr-self-heal-common.c:1656:afr_log_selfheal] 0-myvol-private-replicate-0: Completed metadata selfheal on 1cc6facf-eca5-481c-a905-7a39faa25156. sources=[2] sinks=0 1 [2018-04-09 06:58:53.775939] I [MSGID: 108026] [afr-self-heal-entry.c:887:afr_selfheal_entry_do] 0-myvol-private-replicate-0: performing entry selfheal on 1cc6facf-eca5-481c-a905-7a39faa25156 [2018-04-09 06:58:53.776237] I [MSGID: 108026] [afr-self-heal-metadata.c:52:__afr_selfheal_metadata_do] 0-myvol-private-replicate-0: performing metadata selfheal on 13880e8c-13da-442f-8180-fa40b6f5327c [...

...[2018-04-09 06:58:53.757677] I [MSGID: 108026] [afr-self-heal-common.c:1656:afr_log_selfheal] 0-myvol-private-replicate-0: Completed metadata selfheal on 1cc6facf-eca5-481c-a905-7a39faa25156. sources=[2] sinks=0 1 > > [2018-04-09 06:58:53.775939] I [MSGID: 108026] [afr-self-heal-entry.c:887:afr_selfheal_entry_do] 0-myvol-private-replicate-0: performing entry selfheal on 1cc6facf-eca5-481c-a905-7a39faa25156 > > [2018-04-09 06:58:53.776237] I [MSGID: 108026] [afr-self-heal-metadata.c:52:__afr_selfheal_metadata_do] 0-myvol-private-replicate-0: performing metadata selfheal on 13880e8c-13da-442f-8180-fa4...

...09 06:58:53.757677] I [MSGID: 108026] [afr-self-heal-common.c:1656:afr_log_selfheal] 0-myvol-private-replicate-0: Completed metadata selfheal on 1cc6facf-eca5-481c-a905-7a39faa25156. sources=[2] sinks=0 1 > > > > [2018-04-09 06:58:53.775939] I [MSGID: 108026] [afr-self-heal-entry.c:887:afr_selfheal_entry_do] 0-myvol-private-replicate-0: performing entry selfheal on 1cc6facf-eca5-481c-a905-7a39faa25156 > > > > [2018-04-09 06:58:53.776237] I [MSGID: 108026] [afr-self-heal-metadata.c:52:__afr_selfheal_metadata_do] 0-myvol-private-replicate-0: performing metadata selfheal on 13880e8c-13da-442...

...I [MSGID: 108026] [afr-self-heal-common.c:1656:afr_log_selfheal] 0-myvol-private-replicate-0: Completed metadata selfheal on 1cc6facf-eca5-481c-a905-7a39faa25156. sources=[2] sinks=0 1 > > > > > > > > [2018-04-09 06:58:53.775939] I [MSGID: 108026] [afr-self-heal-entry.c:887:afr_selfheal_entry_do] 0-myvol-private-replicate-0: performing entry selfheal on 1cc6facf-eca5-481c-a905-7a39faa25156 > > > > > > > > [2018-04-09 06:58:53.776237] I [MSGID: 108026] [afr-self-heal-metadata.c:52:__afr_selfheal_metadata_do] 0-myvol-private-replicate-0: performing metadata selfheal...

...:58:53.757677] I [MSGID: 108026] [afr-self-heal-common.c:1656:afr_log_selfheal] 0-myvol-private-replicate-0: Completed metadata selfheal on 1cc6facf-eca5-481c-a905-7a39faa25156. sources=[2] sinks=0 1 >>> >>> [2018-04-09 06:58:53.775939] I [MSGID: 108026] [afr-self-heal-entry.c:887:afr_selfheal_entry_do] 0-myvol-private-replicate-0: performing entry selfheal on 1cc6facf-eca5-481c-a905-7a39faa25156 >>> >>> [2018-04-09 06:58:53.776237] I [MSGID: 108026] [afr-self-heal-metadata.c:52:__afr_selfheal_metadata_do] 0-myvol-private-replicate-0: performing metadata selfheal on 13880e8c-13d...

...[MSGID: 108026] [afr-self-heal-common.c:1656:afr_log_selfheal] 0-myvol-private-replicate-0: Completed metadata selfheal on 1cc6facf-eca5-481c-a905-7a39faa25156. sources=[2] sinks=0 1 >>>>> >>>>> [2018-04-09 06:58:53.775939] I [MSGID: 108026] [afr-self-heal-entry.c:887:afr_selfheal_entry_do] 0-myvol-private-replicate-0: performing entry selfheal on 1cc6facf-eca5-481c-a905-7a39faa25156 >>>>> >>>>> [2018-04-09 06:58:53.776237] I [MSGID: 108026] [afr-self-heal-metadata.c:52:__afr_selfheal_metadata_do] 0-myvol-private-replicate-0: performing metadata selfheal...

...fr-self-heal-common.c:1656:afr_log_selfheal] 0-myvol-private-replicate-0: Completed metadata selfheal on 1cc6facf-eca5-481c-a905-7a39faa25156. sources=[2] sinks=0 1 > > > > > > > > > > > > [2018-04-09 06:58:53.775939] I [MSGID: 108026] [afr-self-heal-entry.c:887:afr_selfheal_entry_do] 0-myvol-private-replicate-0: performing entry selfheal on 1cc6facf-eca5-481c-a905-7a39faa25156 > > > > > > > > > > > > [2018-04-09 06:58:53.776237] I [MSGID: 108026] [afr-self-heal-metadata.c:52:__afr_selfheal_metadata_do] 0-myvol-private-replicate-0: performin...

...blem with glusterfs and tar ? > >>> > >>> > >>> Log excerpts: > >>> > >>> > >>> glustershd.log > >>> > >>> [2017-07-26 15:31:36.290908] I [MSGID: 108026] > >>> [afr-self-heal-entry.c:833:afr_selfheal_entry_do] 0-gv0-replicate-0: > >>> performing entry selfheal on fe5c42ac-5fda-47d4-8221-484c8d826c06 > >>> [2017-07-26 15:31:36.294289] W [MSGID: 114031] > >>> [client-rpc-fops.c:2933:client3_3_lookup_cbk] 0-gv0-client-1: remote > >>> operation failed. Path: (...

...[afr-self-heal-common.c:1656:afr_log_selfheal] 0-myvol-private-replicate-0: Completed metadata selfheal on 1cc6facf-eca5-481c-a905-7a39faa25156. sources=[2] sinks=0 1 >>>>>>> >>>>>>> [2018-04-09 06:58:53.775939] I [MSGID: 108026] [afr-self-heal-entry.c:887:afr_selfheal_entry_do] 0-myvol-private-replicate-0: performing entry selfheal on 1cc6facf-eca5-481c-a905-7a39faa25156 >>>>>>> >>>>>>> [2018-04-09 06:58:53.776237] I [MSGID: 108026] [afr-self-heal-metadata.c:52:__afr_selfheal_metadata_do] 0-myvol-private-replicate-0: performing m...

Hey Richard, Could you share the following informations please? 1. gluster volume info <volname> 2. getfattr output of that file from all the bricks getfattr -d -e hex -m . <brickpath/filepath> 3. glustershd & glfsheal logs Regards, Karthik On Thu, Oct 26, 2017 at 10:21 AM, Amar Tumballi <atumball at redhat.com> wrote: > On a side note, try recently released health

On a side note, try recently released health report tool, and see if it does diagnose any issues in setup. Currently you may have to run it in all the three machines. On 26-Oct-2017 6:50 AM, "Amar Tumballi" <atumball at redhat.com> wrote: > Thanks for this report. This week many of the developers are at Gluster > Summit in Prague, will be checking this and respond next

...k] 0-home-client-4: Server and Client lk-version numbers are not same, reopening the fds [2017-10-25 10:13:36.382826] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-home-client-4: Server lk version = 1 [2017-10-25 10:13:36.385704] I [MSGID: 108026] [afr-self-heal-entry.c:847:afr_selfheal_entry_do] 0-home-replicate-0: performing entry selfheal on a3f5a769-8859-48e3-96ca-60a988eb9358 [2017-10-25 10:13:36.657952] W [MSGID: 108015] [afr-self-heal-entry.c:56:afr_selfheal_entry_delete] 0-home-replicate-0: expunging file a3f5a769-8859-48e3-96ca-60a988eb9358/D7AD3790B357F32D2D56251D89DEA3C8518F7BAE...