dovecot - Aug 2007 - FETCH for mailbox XXX UID XXX got too little data.

Hi Timo,

I am receiving the above error in dovecot's logs, here's how it looks 
like:

dovecot: Aug 05 19:52:19 Info: imap-login: Login: user=<XXXXXXXXXXXX>, 
method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured
dovecot: Aug 05 19:53:36 Error: IMAP(XXXXXXXXXXXX): FETCH for mailbox Bulk Mails
UID 32
got too little data: 9199 vs 39532
dovecot: Aug 05 19:53:36 Info: IMAP(XXXXXXXXXXXX): Disconnected: Disconnected


When I attempted a telnet to the IMAP port, a fetch body[text] of the 
message begins with a partial portion of the Received headers:

  dsl-146-173-81.clt.bellsouth.net (72.146.173.81)
   by mx6.pacific.net.sg with SMTP; 1 Aug 2007 01:48:14 -0000

and I get abruptly disconnected:
Connection to localhost closed by foreign host.


May I know what could have gone wrong? To protect the user's privacy, I 
will be e-mailing you the actual bad e-mail in a separate e-mail.

Thanking in advance.

Cheers.

Following this is a partial transcript of the IMAP transaction:

a1 fetch 32 full
* 32 FETCH (FLAGS (\Seen) INTERNALDATE "26-Jul-2007 00:35:20 +0800" 
RFC822.SIZE 40598 ENVELOPE ("Thu, 26 Jul 2007 00:22:09 +0800"
"ADV:
Empowering Your Presentation Skills" (("Personal Development
Workshops"
NIL "enews" "JuzEvents2.com")) (("Personal Development
Workshops" NIL
"enews" "JuzEvents2.com")) (("Personal Development
Workshops" NIL "enews"
"JuzEvents2.com")) ((NIL NIL "XXXXXXXXXXXX"
"pacific.net.sg")) NIL NIL NIL
"<004e4411357e78a1b6eec83d00114028 at juzevents2.com>") BODY
("text" "html"
("charset" "gb2312") NIL NIL "base64" 39532 508))
a1 OK Fetch completed.
a1 fetch 32 body[text]
* 32 FETCH (BODY[TEXT] {39532}
dsl-146-173-81.clt.bellsouth.net (72.146.173.81)
   by mx6.pacific.net.sg with SMTP; 1 Aug 2007 01:48:14 -0000
Received: from NHGF ([10.161.42.56])
         by adsl-146-173-81.clt.bellsouth.net (8.13.4/8.13.4) with SMTP id 
i154842195219s7Ho019018
         for <XXXXXXXXXXXX at pacific.net.sg>; Tue, 31 Jul 2007 21:48:10
-0500
(CDT)
         (envelope-from espainolax_6666 at yahoo.es)
Message-ID: <005801c7d3de$046dbe90$51ad9248 at NHGF>
From: "espainolax_6666" <espainolax_6666 at yahoo.es>
To: <XXXXXXXXXXXX at pacific.net.sg>
Subject: soggy fighter pilot
Date: Wed, 01 Aug 2007 10:45:38 +0800
MIME-Version: 1.0
Content-Type: multipart/related;
         boundary="----=_NextPart_000_0055_01C7D3BC.7D1C7D80";
         type="multipart/alternative"
X-Priority: 3
X-MSMail-Priority: Normal
X-Mailer: Microsoft Outlook Express 6.00.2900.3138
X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.3138

*** blah ***
Connection to localhost closed by foreign host.

On Sun, 2007-08-05 at 20:03 +0800, Tan Shao Yi wrote:
> dovecot: Aug 05 19:53:36 Error: IMAP(XXXXXXXXXXXX): FETCH for mailbox Bulk
Mails UID 32
> got too little data: 9199 vs 39532
This means that Dovecot thought the message had 39532 bytes. It either
looked this up from dovecot.index.cache file or from the ,S=39532 part
in maildir filename. But when the message was being read, EOF was found
after 9199 bytes.

So, does the maildir filename have the ,S= part? If yes, remove it and
figure out why it was wrong to prevent this in future. Otherwise delete
dovecot.index.cache and see if it helps. Would be nice to figure out why
that would happen too..

It would also be nice if Dovecot fixed this situation itself, but
unfortunately it's not very simple with the current code and so far
there haven't been many complaints.

-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 189 bytes
Desc: This is a digitally signed message part
URL:
<http://dovecot.org/pipermail/dovecot/attachments/20070805/9eba1743/attachment-0002.bin>

Timo Sirainen wrote:
> On Sun, 2007-08-05 at 20:03 +0800, Tan Shao Yi wrote:
>> dovecot: Aug 05 19:53:36 Error: IMAP(XXXXXXXXXXXX): FETCH for mailbox
Bulk Mails UID 32
>> got too little data: 9199 vs 39532
> 
> This means that Dovecot thought the message had 39532 bytes. It either
> looked this up from dovecot.index.cache file or from the ,S=39532 part
> in maildir filename. But when the message was being read, EOF was found
> after 9199 bytes.
> 
> So, does the maildir filename have the ,S= part? If yes, remove it and
> figure out why it was wrong to prevent this in future. Otherwise delete
> dovecot.index.cache and see if it helps. Would be nice to figure out why
> that would happen too..
> 
> It would also be nice if Dovecot fixed this situation itself, but
> unfortunately it's not very simple with the current code and so far
> there haven't been many complaints.
> 
Hi Timo,

I just realised from the e-mail I sent earlier, the output of FETCH 32 
FULL and FETCH 32 BODY[TEXT] are not the same. They are referring to 
different messages.

a1 fetch 32 full
* 32 FETCH (FLAGS (\Seen) INTERNALDATE "26-Jul-2007 00:35:20 +0800" 
RFC822.SIZE 40598 ENVELOPE ("Thu, 26 Jul 2007 00:22:09 +0800"
"ADV:
Empowering Your Presentation Skills" (("Personal Development
Workshops"
NIL "enews" "JuzEvents2.com")) (("Personal Development
Workshops" NIL
"enews" "JuzEvents2.com")) (("Personal Development
Workshops" NIL
"enews" "JuzEvents2.com")) ((NIL NIL
"XXXXXXXXXXXX" "pacific.net.sg"))
NIL NIL NIL "<004e4411357e78a1b6eec83d00114028 at
juzevents2.com>") BODY
("text" "html" ("charset" "gb2312") NIL
NIL "base64" 39532 508))
a1 OK Fetch completed.
a1 fetch 32 body[text]
* 32 FETCH (BODY[TEXT] {39532}
dsl-146-173-81.clt.bellsouth.net (72.146.173.81)
   by mx6.pacific.net.sg with SMTP; 1 Aug 2007 01:48:14 -0000
Received: from NHGF ([10.161.42.56])
         by adsl-146-173-81.clt.bellsouth.net (8.13.4/8.13.4) with SMTP 
id i154842195219s7Ho019018
         for <XXXXXXXXXXXX at pacific.net.sg>; Tue, 31 Jul 2007 21:48:10 
-0500 (CDT)
         (envelope-from espainolax_6666 at yahoo.es)
Message-ID: <005801c7d3de$046dbe90$51ad9248 at NHGF>
From: "espainolax_6666" <espainolax_6666 at yahoo.es>
To: <XXXXXXXXXXXX at pacific.net.sg>
Subject: soggy fighter pilot

I had to delete the dovecot.index.cache file for it to work.

Is there anything I can do to help with the debugging? The tricky part 
is that this is a user mailbox, so I may not be able to have control 
when e-mails get deleted.

Cheers.