dovecot - May 2015 - Bug#776094: dovecot-imapd: corrupts mailbox after trying to retrieve it (fwd)

Am 04.05.2015 um 21:04 schrieb Santiago Vila:
> Greetings.
> 
> Thanks to Jelmer Vernooij, who has just uploaded version 2.2.16 for
> Debian unstable, I can confirm that this bug may still be reproduced
> in version 2.2.16, so it has *not* been fixed yet.
> 
> Several months ago I was told "I can't reproduce it in dovecot
hg", or
> something like that. Well, having this fixed in hg does not help very
> much if the bug is still present in the latest released version (2.2.16).
> 
> Would anyone here please tell which commit exactly fixed this issue?
> 
> If it's not fixed yet, I would love to provide a patch, but I'm not
a
> programmer myself.
> 
> However, I provided a very precise and detailed explanation about how
> to reproduce this bug, which you will still find in the Debian BTS:
> 
> https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=776094
> 
> Really, it should not be so much difficult to reproduce it. Try on a
> Debian 8 system. I'm sure that if you follow the steps exactly as I
> described, you will find the problem the same way as I did.
> 
> Thanks.
> 
Boh fetchmail .... did you verified with getmail ?

http://pyropus.ca/software/getmail/

dig you tried fetchmail with

bad-header accept ?

what are dovecot verbose logs tell


Best Regards
MfG Robert Schetterer

-- 
[*] sys4 AG

http://sys4.de, +49 (89) 30 90 46 64
Franziskanerstra?e 15, 81669 M?nchen

Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263
Vorstand: Patrick Ben Koetter, Marc Schiffbauer
Aufsichtsratsvorsitzender: Florian Kirstein

On Mon, May 04, 2015 at 09:23:57PM +0200, Robert Schetterer
wrote:
> Boh fetchmail .... did you verified with getmail ?
No, I didn't. The client should be irrelevant. Nobody should be able
to corrupt a remote mailbox only by issuing imap commands.

BTW: Does getmail have an option doing the same as fetchmail --folder
option at all?
> dig you tried fetchmail with
> 
> bad-header accept ?
I appreciate that you are trying to help, but it seems to me that you
didn't read the report, or you didn't understand it.

Answer: No. I didn't. Why should I? The mbox was fine before I tried
to retrieve it. Please read the report!

Am 04.05.2015 um 22:13 schrieb Santiago Vila:
> On Mon, May 04, 2015 at 09:23:57PM +0200, Robert Schetterer wrote:
>> Boh fetchmail .... did you verified with getmail ?
> 
> No, I didn't. The client should be irrelevant. Nobody should be able
> to corrupt a remote mailbox only by issuing imap commands.
> 
> BTW: Does getmail have an option doing the same as fetchmail --folder
> option at all?
http://pyropus.ca/software/getmail/configuration.html#retriever-parameters

 All IMAP retriever types also take the following optional parameters:

    mailboxes (tuple of quoted strings) ? a list of mailbox paths to
retrieve mail from, expressed as a Python tuple. If not specified, the
default is to retrieve mail from the mail folder named INBOX. You might
want to retrieve messages from several different mail folders, using a
configuration like this:

    mailboxes = ("INBOX", "INBOX.spam",
        "mailing-lists.model-railroading")

> 
>> dig you tried fetchmail with
>>
>> bad-header accept ?
> 
> I appreciate that you are trying to help, but it seems to me that you
> didn't read the report, or you didn't understand it.
> 
> Answer: No. I didn't. Why should I? The mbox was fine before I tried
> to retrieve it. Please read the report!
> 
sorry i wont invest any time in fetchmail, i quit with it years ago
by tons of problems i managed to forget


Best Regards
MfG Robert Schetterer

-- 
[*] sys4 AG

http://sys4.de, +49 (89) 30 90 46 64
Franziskanerstra?e 15, 81669 M?nchen

Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263
Vorstand: Patrick Ben Koetter, Marc Schiffbauer
Aufsichtsratsvorsitzender: Florian Kirstein

I have just verified with IMAP commands. This is the procedure:

telnet localhost 143

and then type this:

A0001 CAPABILITY
A0002 LOGIN "bluser" "bluser"
A0003 SELECT "inbox-b"
A0004 EXPUNGE
A0005 FETCH 1:12 RFC822.SIZE
A0006 FETCH 1 RFC822.HEADER
A0007 FETCH 1 BODY.PEEK[TEXT]
A0008 STORE 1 +FLAGS (\Seen \Deleted)
A0009 EXPUNGE
A0010 FETCH 1 RFC822.HEADER
A0011 FETCH 1 BODY.PEEK[TEXT]
A0012 STORE 1 +FLAGS (\Seen \Deleted)
A0013 EXPUNGE
A0014 FETCH 1 RFC822.HEADER
A0015 FETCH 1 BODY.PEEK[TEXT]
A0016 STORE 1 +FLAGS (\Seen \Deleted)
A0017 EXPUNGE
A0018 FETCH 1 RFC822.HEADER
A0019 FETCH 1 BODY.PEEK[TEXT]
A0020 STORE 1 +FLAGS (\Seen \Deleted)
A0021 EXPUNGE
A0022 FETCH 1 RFC822.HEADER
A0023 FETCH 1 BODY.PEEK[TEXT]
A0024 STORE 1 +FLAGS (\Seen \Deleted)
A0025 EXPUNGE
A0026 FETCH 1 RFC822.HEADER
A0027 FETCH 1 BODY.PEEK[TEXT]
A0028 STORE 1 +FLAGS (\Seen \Deleted)
A0029 EXPUNGE
A0030 FETCH 1 RFC822.HEADER
A0031 FETCH 1 BODY.PEEK[TEXT]
A0032 STORE 1 +FLAGS (\Seen \Deleted)
A0033 EXPUNGE
A0034 FETCH 1 RFC822.HEADER
A0035 FETCH 1 BODY.PEEK[TEXT]
A0036 STORE 1 +FLAGS (\Seen \Deleted)
A0037 EXPUNGE
A0038 FETCH 1 RFC822.HEADER
A0039 FETCH 1 BODY.PEEK[TEXT]
A0040 STORE 1 +FLAGS (\Seen \Deleted)
A0041 EXPUNGE
A0042 FETCH 1 RFC822.HEADER
A0043 FETCH 1 BODY.PEEK[TEXT]
A0044 STORE 1 +FLAGS (\Seen \Deleted)
A0045 EXPUNGE
A0046 FETCH 1 RFC822.HEADER
A0047 FETCH 1 BODY.PEEK[TEXT]
A0048 STORE 1 +FLAGS (\Seen \Deleted)
A0049 EXPUNGE
A0050 FETCH 1 RFC822.HEADER
A0051 LOGOUT

After this, mbox folder inbox-b is corrupted, as the line saying

From: abcdefghijklmnopqrstuvwxyzabcdefghijklmnopqrstuvwxyz at example.com

becomes

rstuvwxyzabcdefghijklmnopqrstuvwxyz at example.com


So: Could we please stop blaming fetchmail for this?
It's just the messenger.

Am 05.05.2015 um 16:26 schrieb Santiago Vila:
> I have just verified with IMAP commands. This is the procedure:
> 
> telnet localhost 143
> 
> and then type this:
> 
> A0001 CAPABILITY
> A0002 LOGIN "bluser" "bluser"
> A0003 SELECT "inbox-b"
> A0004 EXPUNGE
> A0005 FETCH 1:12 RFC822.SIZE
> A0006 FETCH 1 RFC822.HEADER
> A0007 FETCH 1 BODY.PEEK[TEXT]
> A0008 STORE 1 +FLAGS (\Seen \Deleted)
> A0009 EXPUNGE
> A0010 FETCH 1 RFC822.HEADER
> A0011 FETCH 1 BODY.PEEK[TEXT]
> A0012 STORE 1 +FLAGS (\Seen \Deleted)
> A0013 EXPUNGE
> A0014 FETCH 1 RFC822.HEADER
> A0015 FETCH 1 BODY.PEEK[TEXT]
> A0016 STORE 1 +FLAGS (\Seen \Deleted)
> A0017 EXPUNGE
> A0018 FETCH 1 RFC822.HEADER
> A0019 FETCH 1 BODY.PEEK[TEXT]
> A0020 STORE 1 +FLAGS (\Seen \Deleted)
> A0021 EXPUNGE
> A0022 FETCH 1 RFC822.HEADER
> A0023 FETCH 1 BODY.PEEK[TEXT]
> A0024 STORE 1 +FLAGS (\Seen \Deleted)
> A0025 EXPUNGE
> A0026 FETCH 1 RFC822.HEADER
> A0027 FETCH 1 BODY.PEEK[TEXT]
> A0028 STORE 1 +FLAGS (\Seen \Deleted)
> A0029 EXPUNGE
> A0030 FETCH 1 RFC822.HEADER
> A0031 FETCH 1 BODY.PEEK[TEXT]
> A0032 STORE 1 +FLAGS (\Seen \Deleted)
> A0033 EXPUNGE
> A0034 FETCH 1 RFC822.HEADER
> A0035 FETCH 1 BODY.PEEK[TEXT]
> A0036 STORE 1 +FLAGS (\Seen \Deleted)
> A0037 EXPUNGE
> A0038 FETCH 1 RFC822.HEADER
> A0039 FETCH 1 BODY.PEEK[TEXT]
> A0040 STORE 1 +FLAGS (\Seen \Deleted)
> A0041 EXPUNGE
> A0042 FETCH 1 RFC822.HEADER
> A0043 FETCH 1 BODY.PEEK[TEXT]
> A0044 STORE 1 +FLAGS (\Seen \Deleted)
> A0045 EXPUNGE
> A0046 FETCH 1 RFC822.HEADER
> A0047 FETCH 1 BODY.PEEK[TEXT]
> A0048 STORE 1 +FLAGS (\Seen \Deleted)
> A0049 EXPUNGE
> A0050 FETCH 1 RFC822.HEADER
> A0051 LOGOUT
> 
> After this, mbox folder inbox-b is corrupted, as the line saying
> 
> From: abcdefghijklmnopqrstuvwxyzabcdefghijklmnopqrstuvwxyz at example.com
> 
> becomes
> 
> rstuvwxyzabcdefghijklmnopqrstuvwxyz at example.com
is this related to mbox only ?
i have no mbox install online to test

did you try install dovecot from scratch with latest sources?

i used a script to install a quick dovecot test server on ubuntu

see
https://sys4.de/de/blog/2013/06/06/postfix-dovecot-ceph-cluster-storage/

beyond

...
Dovecot install
...

then retry with telnet , sorry no time to test myself
> 
> 
> So: Could we please stop blaming fetchmail for this?
> It's just the messenger.
> 


Best Regards
MfG Robert Schetterer

-- 
[*] sys4 AG

http://sys4.de, +49 (89) 30 90 46 64
Franziskanerstra?e 15, 81669 M?nchen

Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263
Vorstand: Patrick Ben Koetter, Marc Schiffbauer
Aufsichtsratsvorsitzender: Florian Kirstein

On 05/05/2015 05:26 PM, Santiago Vila wrote:
> I have just verified with IMAP commands. This is the procedure:
> 
> telnet localhost 143
> 
> and then type this:
> 
> A0001 CAPABILITY
> A0002 LOGIN "bluser" "bluser"
> A0003 SELECT "inbox-b"
> A0004 EXPUNGE
> A0005 FETCH 1:12 RFC822.SIZE
> A0006 FETCH 1 RFC822.HEADER
> A0007 FETCH 1 BODY.PEEK[TEXT]
> A0008 STORE 1 +FLAGS (\Seen \Deleted)
> A0009 EXPUNGE
> A0010 FETCH 1 RFC822.HEADER
> A0011 FETCH 1 BODY.PEEK[TEXT]
> A0012 STORE 1 +FLAGS (\Seen \Deleted)
> A0013 EXPUNGE
> A0014 FETCH 1 RFC822.HEADER
> A0015 FETCH 1 BODY.PEEK[TEXT]
> A0016 STORE 1 +FLAGS (\Seen \Deleted)
> A0017 EXPUNGE
> A0018 FETCH 1 RFC822.HEADER
> A0019 FETCH 1 BODY.PEEK[TEXT]
> A0020 STORE 1 +FLAGS (\Seen \Deleted)
> A0021 EXPUNGE
> A0022 FETCH 1 RFC822.HEADER
> A0023 FETCH 1 BODY.PEEK[TEXT]
> A0024 STORE 1 +FLAGS (\Seen \Deleted)
> A0025 EXPUNGE
> A0026 FETCH 1 RFC822.HEADER
> A0027 FETCH 1 BODY.PEEK[TEXT]
> A0028 STORE 1 +FLAGS (\Seen \Deleted)
> A0029 EXPUNGE
> A0030 FETCH 1 RFC822.HEADER
> A0031 FETCH 1 BODY.PEEK[TEXT]
> A0032 STORE 1 +FLAGS (\Seen \Deleted)
> A0033 EXPUNGE
> A0034 FETCH 1 RFC822.HEADER
> A0035 FETCH 1 BODY.PEEK[TEXT]
> A0036 STORE 1 +FLAGS (\Seen \Deleted)
> A0037 EXPUNGE
> A0038 FETCH 1 RFC822.HEADER
> A0039 FETCH 1 BODY.PEEK[TEXT]
> A0040 STORE 1 +FLAGS (\Seen \Deleted)
> A0041 EXPUNGE
> A0042 FETCH 1 RFC822.HEADER
> A0043 FETCH 1 BODY.PEEK[TEXT]
> A0044 STORE 1 +FLAGS (\Seen \Deleted)
> A0045 EXPUNGE
> A0046 FETCH 1 RFC822.HEADER
> A0047 FETCH 1 BODY.PEEK[TEXT]
> A0048 STORE 1 +FLAGS (\Seen \Deleted)
> A0049 EXPUNGE
> A0050 FETCH 1 RFC822.HEADER
> A0051 LOGOUT
> 
> After this, mbox folder inbox-b is corrupted, as the line saying
> 
> From: abcdefghijklmnopqrstuvwxyzabcdefghijklmnopqrstuvwxyz at example.com
> 
> becomes
> 
> rstuvwxyzabcdefghijklmnopqrstuvwxyz at example.com
> 
> 
> So: Could we please stop blaming fetchmail for this?
> It's just the messenger.
Could you also sprovide your "dovecot -n" output and any warnings and
errors in dovecot logs.

br,
Teemu Huovila