dovecot - Feb 2011 - Regenerating mdbox/sis

It's apparent I have some level of corruption in my mailboxes -
something to do with the combination of mdbox, sis, and zlib. I should
note that I know I have a mix of compressed and raw messages - if that
makes any difference in identifying the problems. 

I think I need to
somehow regenerate the mailboxes with issues. Is there a suggestion for
how to accomplish this? Should I perhaps use dsync to shift to a
temporary mail location and then rename it back? 

If I DO use dsync in
this manner, and I have zlib enabled - will this then compress all the
messages in the new mail storage? 

-- 

Daniel

On 16.2.2011, at 2.35, <dmiller at amfes.com> <dmiller at amfes.com>
wrote:
> It's apparent I have some level of corruption in my mailboxes -
> something to do with the combination of mdbox, sis, and zlib. I should
> note that I know I have a mix of compressed and raw messages - if that
> makes any difference in identifying the problems. 
The mixing shouldn't make any difference. Would be nice to know if the
problem is from mdbox+sis, mdbox+zlib or if it really needs a combination of all
3.

I wonder if http://hg.dovecot.org/dovecot-2.0/rev/b71834419ea3 might help here.
> I think I need to
> somehow regenerate the mailboxes with issues. Is there a suggestion for
> how to accomplish this? Should I perhaps use dsync to shift to a
> temporary mail location and then rename it back? 
That should do it.
> If I DO use dsync in
> this manner, and I have zlib enabled - will this then compress all the
> messages in the new mail storage? 
When dsync reads messages it decompresses them into memory, and recompresses
them when saving.

On 2/21/2011 8:23 AM, Daniel L. Miller wrote:

After applying last two patches, I see:
root at bubba:/var/mail# dsync -u amiller at amfes.com -o
mail_plugins="zlib"
backup maildir:/var/mail/backup/amiller
dsync(amiller at amfes.com): Error: Corrupted dbox file 
/var/mail/amfes.com/amiller/mdbox/storage/m.1 (around offset=237479): 
Ext refs metadata corrupted: 356039 144422 B72 
0a/5a/0a5ae26f12adad628d9e5049e7ec8a756dafe49d-7c35b90f82a1c94ce151000
03bc41c5f
dsync(amiller at amfes.com): Error: Corrupted dbox file 
/var/mail/amfes.com/amiller/mdbox/storage/m.1 (around offset=237479): 
uid=5 points to broken data at offset=237449
dsync(amiller at amfes.com): Error: msg-get failed: box=Drafts uid=5 
guid=1156208717.P32762Q0M962249.amy
dsync(amiller at amfes.com): Error: Corrupted dbox file 
/var/mail/amfes.com/amiller/mdbox/storage/m.2 (around offset=46): Ext 
refs metadata corrupted: 485733 478770 - 
f2/12/f212f6dbff17cea018ec1f256cff6f61a873a100-7d35b90f82a1c94ce15100003bc41
c5f
dsync(amiller at amfes.com): Error: Corrupted dbox file 
/var/mail/amfes.com/amiller/mdbox/storage/m.2 (around offset=46): uid=9 
points to broken data at offset=16
dsync(amiller at amfes.com): Error: msg-get failed: box=Drafts uid=9 
guid=1157518326.P23171Q0M772523.amy
dsync(amiller at amfes.com): Warning: mdbox 
/var/mail/amfes.com/amiller/mdbox/storage: rebuilding indexes

-- 
Daniel