search for: cb39a1e4

...could be wrong? > > I only see these errors on one of the "good" servers in glustershd.log: > > [2024-01-18 06:08:57.328480 +0000] W [MSGID: 114031] > [client-rpc-fops_v2.c:2561:client4_0_lookup_cbk] 0-workdata-client-0: > remote operation failed. > [{path=<gfid:cb39a1e4-2a4c-4727-861d-3ed9ef00681b>}, > {gfid=cb39a1e4-2a4c-4727-861d-3ed9e > f00681b}, {errno=2}, {error=No such file or directory}] > [2024-01-18 06:08:57.594051 +0000] W [MSGID: 114031] > [client-rpc-fops_v2.c:2561:client4_0_lookup_cbk] 0-workdata-client-1: > remote operation failed....

...t doesn't with version 11. What could be wrong? I only see these errors on one of the "good" servers in glustershd.log: [2024-01-18 06:08:57.328480 +0000] W [MSGID: 114031] [client-rpc-fops_v2.c:2561:client4_0_lookup_cbk] 0-workdata-client-0: remote operation failed. [{path=<gfid:cb39a1e4-2a4c-4727-861d-3ed9ef00681b>}, {gfid=cb39a1e4-2a4c-4727-861d-3ed9e f00681b}, {errno=2}, {error=No such file or directory}] [2024-01-18 06:08:57.594051 +0000] W [MSGID: 114031] [client-rpc-fops_v2.c:2561:client4_0_lookup_cbk] 0-workdata-client-1: remote operation failed. [{path=<gfid:3e9b178c-...

...could be wrong? > > I only see these errors on one of the "good" servers in glustershd.log: > > [2024-01-18 06:08:57.328480 +0000] W [MSGID: 114031] > [client-rpc-fops_v2.c:2561:client4_0_lookup_cbk] 0-workdata-client-0: > remote operation failed. > [{path=<gfid:cb39a1e4-2a4c-4727-861d-3ed9ef00681b>}, > {gfid=cb39a1e4-2a4c-4727-861d-3ed9e > f00681b}, {errno=2}, {error=No such file or directory}] > [2024-01-18 06:08:57.594051 +0000] W [MSGID: 114031] > [client-rpc-fops_v2.c:2561:client4_0_lookup_cbk] 0-workdata-client-1: > remote operation failed....

...gt; I only see these errors on one of the "good" servers in glustershd.log: > > > > [2024-01-18 06:08:57.328480 +0000] W [MSGID: 114031] > > [client-rpc-fops_v2.c:2561:client4_0_lookup_cbk] 0-workdata-client-0: > > remote operation failed. > > [{path=<gfid:cb39a1e4-2a4c-4727-861d-3ed9ef00681b>}, > > {gfid=cb39a1e4-2a4c-4727-861d-3ed9e > > f00681b}, {errno=2}, {error=No such file or directory}] > > [2024-01-18 06:08:57.594051 +0000] W [MSGID: 114031] > > [client-rpc-fops_v2.c:2561:client4_0_lookup_cbk] 0-workdata-client-1: > >...

...these errors on one of the "good" servers in glustershd.log: >>> >>> [2024-01-18 06:08:57.328480 +0000] W [MSGID: 114031] >>> [client-rpc-fops_v2.c:2561:client4_0_lookup_cbk] 0-workdata-client-0: >>> remote operation failed. >>> [{path=<gfid:cb39a1e4-2a4c-4727-861d-3ed9ef00681b>}, >>> {gfid=cb39a1e4-2a4c-4727-861d-3ed9e >>> f00681b}, {errno=2}, {error=No such file or directory}] >>> [2024-01-18 06:08:57.594051 +0000] W [MSGID: 114031] >>> [client-rpc-fops_v2.c:2561:client4_0_lookup_cbk] 0-workdata-client-1...

...gt; I only see these errors on one of the "good" servers in glustershd.log: > > > > [2024-01-18 06:08:57.328480 +0000] W [MSGID: 114031] > > [client-rpc-fops_v2.c:2561:client4_0_lookup_cbk] 0-workdata-client-0: > > remote operation failed. > > [{path=<gfid:cb39a1e4-2a4c-4727-861d-3ed9ef00681b>}, > > {gfid=cb39a1e4-2a4c-4727-861d-3ed9e > > f00681b}, {errno=2}, {error=No such file or directory}] > > [2024-01-18 06:08:57.594051 +0000] W [MSGID: 114031] > > [client-rpc-fops_v2.c:2561:client4_0_lookup_cbk] 0-workdata-client-1: > >...

...rs on one of the "good" servers in glustershd.log: > > > > > > [2024-01-18 06:08:57.328480 +0000] W [MSGID: 114031] > > > [client-rpc-fops_v2.c:2561:client4_0_lookup_cbk] 0-workdata-client-0: > > > remote operation failed. > > > [{path=<gfid:cb39a1e4-2a4c-4727-861d-3ed9ef00681b>}, > > > {gfid=cb39a1e4-2a4c-4727-861d-3ed9e > > > f00681b}, {errno=2}, {error=No such file or directory}] > > > [2024-01-18 06:08:57.594051 +0000] W [MSGID: 114031] > > > [client-rpc-fops_v2.c:2561:client4_0_lookup_cbk] 0-workdata-...

...ot;good" servers in glustershd.log: >> > > >> > > [2024-01-18 06:08:57.328480 +0000] W [MSGID: 114031] >> > > [client-rpc-fops_v2.c:2561:client4_0_lookup_cbk] 0-workdata-client-0: >> > > remote operation failed. >> > > [{path=<gfid:cb39a1e4-2a4c-4727-861d-3ed9ef00681b>}, >> > > {gfid=cb39a1e4-2a4c-4727-861d-3ed9e >> > > f00681b}, {errno=2}, {error=No such file or directory}] >> > > [2024-01-18 06:08:57.594051 +0000] W [MSGID: 114031] >> > > [client-rpc-fops_v2.c:2561:client4_0_lookup_...

...ot;good" servers in glustershd.log: >> > > >> > > [2024-01-18 06:08:57.328480 +0000] W [MSGID: 114031] >> > > [client-rpc-fops_v2.c:2561:client4_0_lookup_cbk] 0-workdata-client-0: >> > > remote operation failed. >> > > [{path=<gfid:cb39a1e4-2a4c-4727-861d-3ed9ef00681b>}, >> > > {gfid=cb39a1e4-2a4c-4727-861d-3ed9e >> > > f00681b}, {errno=2}, {error=No such file or directory}] >> > > [2024-01-18 06:08:57.594051 +0000] W [MSGID: 114031] >> > > [client-rpc-fops_v2.c:2561:client4_0_lookup_...

...glustershd.log: > >> > > > >> > > [2024-01-18 06:08:57.328480 +0000] W [MSGID: 114031] > >> > > [client-rpc-fops_v2.c:2561:client4_0_lookup_cbk] 0-workdata-client-0: > >> > > remote operation failed. > >> > > [{path=<gfid:cb39a1e4-2a4c-4727-861d-3ed9ef00681b>}, > >> > > {gfid=cb39a1e4-2a4c-4727-861d-3ed9e > >> > > f00681b}, {errno=2}, {error=No such file or directory}] > >> > > [2024-01-18 06:08:57.594051 +0000] W [MSGID: 114031] > >> > > [client-rpc-fops_v2.c:25...

...glustershd.log: > >> > > > >> > > [2024-01-18 06:08:57.328480 +0000] W [MSGID: 114031] > >> > > [client-rpc-fops_v2.c:2561:client4_0_lookup_cbk] 0-workdata-client-0: > >> > > remote operation failed. > >> > > [{path=<gfid:cb39a1e4-2a4c-4727-861d-3ed9ef00681b>}, > >> > > {gfid=cb39a1e4-2a4c-4727-861d-3ed9e > >> > > f00681b}, {errno=2}, {error=No such file or directory}] > >> > > [2024-01-18 06:08:57.594051 +0000] W [MSGID: 114031] > >> > > [client-rpc-fops_v2.c:25...

ok, finally managed to get all servers, volumes etc runnung, but took a couple of restarts, cksum checks etc. One problem: a volume doesn't heal automatically or doesn't heal at all. gluster volume status Status of volume: workdata Gluster process TCP Port RDMA Port Online Pid ------------------------------------------------------------------------------