dovecot - Mar 2021 - archive namespace reports mdbox_deleted: same as mdbox: is that ok?

> On 15/03/2021 13:56 Marc <marc at f1-outsourcing.eu> wrote:
> 
>  
> Sorry Aki for asking again. I need to run the purge, but I want to make
sure some user did not accedentally deleted a large folder.
> 
> I decided to keep tests limited for now to the main inbox namespace. But
also here weird results.
> 
> Status of folders before the test[1], selected 10 messages from INBOX/test2
and shift+deleted them. Then restarted thunderbird (otherwise thunderbird kept
showing 211 messages), INBOX/test2 indeed shows 10 fewer messages, now 201, but
no deleted messages found INBOX/test2 and weirdly 1 in INBOX??? (result is the
same after a force-resync)
> 
> If this surpasses public support let me know.
> 
> 
> [1]
> [@ testtest]# doveadm -v purge -u testtest
> 
> [@ testtest]# doveadm -o
mail_location=mdbox:/home/popusers/testtest/mdbox:INDEX=/home/popindex/testtest/index
mailbox status -u testtest 'messages vsize' '*'
> Sent messages=17 vsize=7473
> Drafts messages=6 vsize=91785
> INBOX/test2 messages=211 vsize=13443443
> Junk messages=2 vsize=1969
> Deleted Messages messages=1 vsize=956
> Trash messages=47 vsize=769284
> INBOX messages=1117 vsize=207623033
> 
> [@ testtest]# doveadm -o
mail_location=mdbox_deleted:/home/popusers/testtest/mdbox:INDEX=/home/popindex/testtest/index
mailbox status -u testtest 'messages vsize' '*'
> Sent messages=0 vsize=0
> Drafts messages=0 vsize=0
> INBOX/test2 messages=0 vsize=0
> Junk messages=0 vsize=0
> Deleted Messages messages=0 vsize=0
> Trash messages=0 vsize=0
> INBOX messages=0 vsize=0
> 
> [2]
> [@ testtest]# doveadm -o
mail_location=mdbox:/home/popusers/testtest/mdbox:INDEX=/home/popindex/testtest/index
mailbox status -u testtest 'messages vsize' '*'
> Sent messages=17 vsize=7473
> Drafts messages=5 vsize=3457
> INBOX/test2 messages=201 vsize=12806313
> Junk messages=2 vsize=1969
> Deleted Messages messages=1 vsize=956
> Trash messages=47 vsize=769284
> INBOX messages=1117 vsize=207623033
> 
> [@ testtest]# doveadm -o
mail_location=mdbox_deleted:/home/popusers/testtest/mdbox:INDEX=/home/popindex/testtest/index
mailbox status -u testtest 'messages vsize' '*'
> Sent messages=0 vsize=0
> Drafts messages=0 vsize=0
> INBOX/test2 messages=0 vsize=0
> Junk messages=0 vsize=0
> Deleted Messages messages=0 vsize=0
> Trash messages=0 vsize=0
> INBOX messages=1 vsize=88328
> 
> 
> [3]
> [@]# doveconf | grep mail_location
> mail_location =
mdbox:~/mdbox:INDEX=/home/popindex/%u/index:CONTROL=~/mail/control
Can you please be more specific about the steps you've taken and provide
some steps how you did this testing including deleting mails and such? Now
it's bit random and hard to track.

Aki

New test

step 1. 
======initial state inbox and deleted

[@ testtest]# doveadm -o
mail_location=mdbox:/home/popusers/testtest/mdbox:INDEX=/home/popindex/testtest/index
mailbox status -u testtest 'messages vsize' '*'
Sent messages=17 vsize=7473
Drafts messages=6 vsize=67170
INBOX/test2 messages=198 vsize=12552420
Junk messages=2 vsize=1969
Deleted Messages messages=0 vsize=0
Trash messages=47 vsize=769284
INBOX messages=1117 vsize=207623033

[@ testtest]# doveadm -o
mail_location=mdbox_deleted:/home/popusers/testtest/mdbox:INDEX=/home/popindex/testtest/index
mailbox status -u testtest 'messages vsize' '*'
Sent messages=0 vsize=0
Drafts messages=0 vsize=0
INBOX/test2 messages=0 vsize=0
Junk messages=0 vsize=0
Deleted Messages messages=0 vsize=0
Trash messages=0 vsize=0
INBOX messages=2 vsize=89284

step 2.
======check if we have messages indeed stored

[@ testtest]# grep 45765765870 /home/popusers/testtest/mdbox/storage/*
/home/popusers/testtest/mdbox/storage/m.893:Subject: New file uploaded
45765765870


step 3. 
======delete 5 messages including the one having subject '45765765870'
from inbox/test2 mailbox with thunderbird shift+delete, restart thunderbird
(otherwise nothing happens on server)

step 4. 
======verify if messages are indeed deleted, looks like ok, indeed 5 fewer
messages.

[@ testtest]# doveadm -o
mail_location=mdbox:/home/popusers/testtest/mdbox:INDEX=/home/popindex/testtest/index
mailbox status -u testtest 'messages vsize' '*'
Sent messages=17 vsize=7473
Drafts messages=6 vsize=67170
INBOX/test2 messages=193 vsize=12296609
Junk messages=2 vsize=1969
Deleted Messages messages=0 vsize=0
Trash messages=47 vsize=769284
INBOX messages=1117 vsize=207623033

step 5.
======verify refcount=0 messages in folders, not ok, INBOX/test2 should have 5

[@ testtest]# doveadm -o
mail_location=mdbox_deleted:/home/popusers/testtest/mdbox:INDEX=/home/popindex/testtest/index
mailbox status -u testtest 'messages vsize' '*'
Sent messages=0 vsize=0
Drafts messages=0 vsize=0
INBOX/test2 messages=0 vsize=0
Junk messages=0 vsize=0
Deleted Messages messages=0 vsize=0
Deleted Messages/test messages=0 vsize=0
Trash messages=0 vsize=0
INBOX messages=3 vsize=90243