dovecot - May 2021 - huge mdbox broken / Log synchronization error

> On 05/05/2021 12:42 Florian Lohoff <f at zz.de> wrote:
> 
>  
> Hi,
> its the second time in 6 Month i have issues with a huge mdbox. It
> broken in November and i restored from backup because force-resync
> twice didnt fix it. (And restore from borg-backup was MUCH faster
> than force-resync)
> 
> This time i have heavy delivery into that mailbox (postfix concurrency 1) 
> and i tried merging folders with doveadm move. The move froze and now
> i seem to have a broken mdbox:
> 
> Errors are:
> 
> May 05 10:21:09 lda(inbox at wasteland.rfc822.org): Error: Log
> 	synchronization error at seq=2736,offset=135540 for
> 	/var/vmail/wasteland.rfc822.org/inbox/mdbox/storage/dovecot.map.index:
> 	Extension record inc drops number below zero (uid=7757856, diff=-1,
> 	orig=0)
> 
> trying
> 
> root at pax:~# doveadm -D -v force-resync -u inbox at wasteland.rfc822.org
\*
> 
> now. Although this will mostly likely take 8-10 hours. 
> 
> Mailbox is 44GByte (Compressed mdbox) and 220K folders.
> 
> This is dovecot on Debian/Stretch 
> 
> dovecot-core            1:2.2.27-3+deb9u7
> dovecot-imapd           1:2.2.27-3+deb9u7
> dovecot-ldap            1:2.2.27-3+deb9u7
> dovecot-managesieved    1:2.2.27-3+deb9u7
> dovecot-pop3d           1:2.2.27-3+deb9u7
> dovecot-sieve           1:2.2.27-3+deb9u7
> dovecot-solr            1:2.2.27-3+deb9u7
> 
> Flo
> -- 
> Florian Lohoff                                                     f at
zz.de
>    Any sufficiently advanced technology is indistinguishable from magic.
Hi!

That version is pretty old already, there has been fixes to mdbox format after
that. Can you at least try to upgrade to 2.2.36?

Aki

On Wed, May 05, 2021 at 03:30:39PM +0300, Aki Tuomi
wrote:
> Hi!
> 
> That version is pretty old already, there has been fixes to mdbox format
after that. Can you at least try to upgrade to 2.2.36?
Aborted force-resync after 16 hours - Every fsck took 2-3 hours. It
always restarted from the beginning it seems. Numbers for the
inconsistency changed from run to run.

[ ... ]
doveadm(inbox at wasteland): Warning: Transaction log file
/var/vmail/wasteland/inbox/mdbox/storage/dovecot.map.index.log was locked for
10337 seconds (mdbox storage rebuild)
doveadm(inbox at wasteland): Warning: mdbox
/var/vmail/wasteland/inbox/mdbox/storage: Inconsistency in map index
(2736,135512 != 2736,811812)
doveadm(inbox at wasteland): Warning: fscking index file
/var/vmail/wasteland/inbox/mdbox/storage/dovecot.map.index
doveadm(inbox at wasteland): Warning: mdbox
/var/vmail/wasteland/inbox/mdbox/storage: Inconsistency in map index
(2736,135512 != 2736,811828)
doveadm(inbox at wasteland): Warning: fscking index file
/var/vmail/wasteland/inbox/mdbox/storage/dovecot.map.index
doveadm(inbox at wasteland): Warning: mdbox
/var/vmail/wasteland/inbox/mdbox/storage: rebuilding indexes
doveadm(inbox at wasteland): Warning: Transaction log file
/var/vmail/wasteland/inbox/mdbox/storage/dovecot.map.index.log was locked for
9959 seconds (mdbox storage rebuild)
doveadm(inbox at wasteland): Warning: mdbox
/var/vmail/wasteland/inbox/mdbox/storage: Inconsistency in map index
(2736,135512 != 2736,863376)
doveadm(inbox at wasteland): Warning: fscking index file
/var/vmail/wasteland/inbox/mdbox/storage/dovecot.map.index
doveadm(inbox at wasteland): Warning: mdbox
/var/vmail/wasteland/inbox/mdbox/storage: Inconsistency in map index
(2736,135512 != 2736,970728)
doveadm(inbox at wasteland): Warning: fscking index file
/var/vmail/wasteland/inbox/mdbox/storage/dovecot.map.index
doveadm(inbox at wasteland): Warning: mdbox
/var/vmail/wasteland/inbox/mdbox/storage: rebuilding indexes

I upgraded to 2.3.4 from stretch-backports now and rerunning force-fsck now.

Flo
-- 
Florian Lohoff                                                     f at zz.de
  Any sufficiently advanced technology is indistinguishable from magic.
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 833 bytes
Desc: not available
URL:
<https://dovecot.org/pipermail/dovecot/attachments/20210506/5b4bab88/attachment.sig>