Gluster users - Sep 2022 - Upgrading while still having heal pending entries experiences

Hi all,

We are facing problems with our current configuration in replica scheme 
and have many unhealed directory entries with "error 22" in the shd
log,
that then loop infinitely and so remain stuck.
> [2022-09-11 08:28:04.346243 +0000] E [MSGID: 114031] 
> [client-rpc-fops_v2.c:211:client4_0_mkdir_cbk] *0-client-2*: remote 
> operation failed. [{*path=(null)*}, {*errno=22*}, *{error=Das Argument 
> ist ung?ltig}] *
There is a different thread regarding our non-healing volume and we 
followed the various suggestions (for which we thank everyone so much).

What we were wondering while assessing the risks of any of the 
last-resort suggested operations (e.g. removing-re-adding brick) is how 
high on that scale is upgrading our glusterfs version online or offline 
(and if makes some difference in terms of risk to do it offline respect 
to online for example).

Did you have any experience on this? We know the recommendation is to 
upgrade only after no healing entries are reported, but perhaps someone 
has had the same need as us (the behaviour is much like a bug as we have 
tried really many approaches) and had a successful story upgrading 
without having all entries healed before starting? The idea behind it is 
that if it is a bug that has been fixed now, then the healing entries 
will get "unstuck". We are currently on 9.2.

Best regards.

Ilias

-- 
?forumZFD
Entschieden f?r Frieden | Committed to Peace

Ilias Chasapakis
Referent IT | IT Consultant

Forum Ziviler Friedensdienst e.V. | Forum Civil Peace Service
Am K?lner Brett 8 | 50825 K?ln | Germany

Tel 0221 91273243 | Fax 0221 91273299 |http://www.forumZFD.de

Vorstand nach ? 26 BGB, einzelvertretungsberechtigt | Executive Board:
Oliver Knabe (Vorsitz | Chair), Jens von Bargen, Alexander Mauz
VR 17651 Amtsgericht K?ln

Spenden | Donations: IBAN DE37 3702 0500 0008 2401 01 BIC BFSWDE33XXX

-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://lists.gluster.org/pipermail/gluster-users/attachments/20220912/6729f09e/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: OpenPGP_signature
Type: application/pgp-signature
Size: 665 bytes
Desc: OpenPGP digital signature
URL:
<http://lists.gluster.org/pipermail/gluster-users/attachments/20220912/6729f09e/attachment.sig>

There is always a reason a directory is not healing...Check the number of files,
their attributes (?getfattr -d -m . -e hex file) and if there are any pending
file heals.
Best Regards,Strahil Nikolov?
 
 
  On Wed, Sep 14, 2022 at 2:36, Ilias Chasapakis forumZFD<chasapakis at
forumZFD.de> wrote:
Hi all,
 
We are facing problems with our current configuration in replica scheme and have
many unhealed directory entries with "error 22" in the shd log, that
then loop infinitely and so remain stuck.
 

 [2022-09-11 08:28:04.346243 +0000] E [MSGID: 114031]
[client-rpc-fops_v2.c:211:client4_0_mkdir_cbk] 0-client-2: remote operation
failed. [{path=(null)}, {errno=22}, {error=Das Argument ist ung?ltig}]
 

 
There is a different thread regarding our non-healing volume and we followed the
various suggestions (for which we thank everyone so much).
 
 
What we were wondering while assessing the risks of any of the last-resort
suggested operations (e.g. removing-re-adding brick) is how high on that scale
is upgrading our glusterfs version online or offline (and if makes some
difference in terms of risk to do it offline respect to online for example).
 
Did you have any experience on this? We know the recommendation is to upgrade
only after no healing entries are reported, but perhaps someone has had the same
need as us (the behaviour is much like a bug as we have tried really many
approaches) and had a successful story upgrading without having all entries
healed before starting? The idea behind it is that if it is a bug that has been
fixed now, then the healing entries will get "unstuck". We are
currently on 9.2.
 
Best regards.
 
Ilias
 
 -- 
?forumZFD
Entschieden f?r Frieden | Committed to Peace

Ilias Chasapakis
Referent IT | IT Consultant

Forum Ziviler Friedensdienst e.V. | Forum Civil Peace Service
Am K?lner Brett 8 | 50825 K?ln | Germany

Tel 0221 91273243 | Fax 0221 91273299 | http://www.forumZFD.de

Vorstand nach ? 26 BGB, einzelvertretungsberechtigt | Executive Board:
Oliver Knabe (Vorsitz | Chair), Jens von Bargen, Alexander Mauz
VR 17651 Amtsgericht K?ln

Spenden | Donations: IBAN DE37 3702 0500 0008 2401 01 BIC BFSWDE33XXX ________



Community Meeting Calendar:

Schedule -
Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC
Bridge: https://meet.google.com/cpu-eiue-hvk
Gluster-users mailing list
Gluster-users at gluster.org
https://lists.gluster.org/mailman/listinfo/gluster-users
  
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://lists.gluster.org/pipermail/gluster-users/attachments/20220914/7c7d8d18/attachment.html>