dovecot - Sep 2008 - Outlook 2003 and Thunderbird IMAP + getting new headers

Hi,

 

We run 1.1.3 and I use Outlook to connect to my IMAP box and a couple of
times per day (randomly) when I click certain folders IMAP will start
retrieving ALL headers for that folder again ('retrieving new headers')!

I don't understand this. What triggers IMAP to do so, why not just retrieve
only the NEW headers?

 

Is it Dovecot or Outlook (probably) and what can be done about this? I
already use the Dovecot Outlook workarounds.

 

I have also gotten word that this behavior happens with Thunderbird.

 

This is really a problem causing a lot of load on our storage (I am not the
only user).

 

Cheers,

 

Jan

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Hi Jan,

Jan van den Berg wrote:
> We run 1.1.3 and I use Outlook to connect to my IMAP box and a couple of
> times per day (randomly) when I click certain folders IMAP will start
> retrieving ALL headers for that folder again ('retrieving new
headers')!
> 
> I don't understand this. What triggers IMAP to do so, why not just
retrieve
> only the NEW headers?
> 
>  
> 
> Is it Dovecot or Outlook (probably) and what can be done about this? I
> already use the Dovecot Outlook workarounds.
> 
>  
> 
> I have also gotten word that this behavior happens with Thunderbird.
> 
>  
> 
> This is really a problem causing a lot of load on our storage (I am not the
> only user).
Please give us some more information. Output of `dovecot -n` would be a good
start. Also check the logs for dovecot reporting problems (and/or switch on
debug logging).

Patrick.

- --
STAR Software (Shanghai) Co., Ltd.              http://www.star-group.net/
Phone:    +86 (21) 3462 7688 x 826               Fax:   +86 (21) 3462 7779

PGP key:  E883A005 https://stshacom1.star-china.net/keys/patrick_nagel.asc
Fingerprint:             E09A D65E 855F B334 E5C3 5386 EF23 20FC E883 A005
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.7 (GNU/Linux)
Comment: Using GnuPG with Fedora - http://enigmail.mozdev.org

iD8DBQFIx4zX7yMg/OiDoAURAtWVAKCiFcHQGzyGoF3NtRzqlH78JGVPIgCeKeOV
v9ixInWS+RWG0gcMFtg5Lk8=1uNp
-----END PGP SIGNATURE-----

On Wed, 2008-09-10 at 10:29 +0200, Jan van den Berg
wrote:
> We run 1.1.3 and I use Outlook to connect to my IMAP box and a couple of
> times per day (randomly) when I click certain folders IMAP will start
> retrieving ALL headers for that folder again ('retrieving new
headers')!
Typically that means that the mailbox's UIDVALIDITY has changed. Or the
messages get assigned new UIDs for some reason (e.g. Dovecot sees that
they're gone, later sees them again). You could verify these by using
e.g. rawlog (http://wiki.dovecot.org/Debugging/Rawlog) and seeing if the
UIDVALIDITY value after SELECT command changes and if the returned UIDs
get changed.

Do you do anything on the server with dovecot-uidlist files? Or
dovecot.index* files? Like deleting them once in a while as someone was
doing in a cron job? :)

-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 197 bytes
Desc: This is a digitally signed message part
URL:
<http://dovecot.org/pipermail/dovecot/attachments/20080910/648038a3/attachment-0002.bin>

Hi,

I dont do anything with the dovecot-uidlist.

This is part of what the rawlog looks like (with a folder that started
getting new headers):

tbgy SELECT "My Folders.Klanten"
rty3 UID FETCH 1668:* (UID FLAGS RFC822.SIZE BODY.PEEK[HEADER] INTERNALDATE)
9d54 UID FETCH 1:1667 (UID FLAGS)
0ntr UID FETCH 1667 (UID FLAGS BODY.PEEK[] INTERNALDATE)
znim IDLE
DONE
4ogq UID FETCH 1668 (UID FLAGS BODY.PEEK[] INTERNALDATE)
5131 IDLE

How should I interpret this? I see 1668 and 1667?

Cheers,

Jan


-----Oorspronkelijk bericht-----
Van: dovecot-bounces+jan.vandenberg=isp.solcon.nl at dovecot.org
[mailto:dovecot-bounces+jan.vandenberg=isp.solcon.nl at dovecot.org] Namens
Timo Sirainen
Verzonden: woensdag 10 september 2008 20:45
Aan: Jan van den Berg
CC: 'Dovecot Mailing List'
Onderwerp: Re: [Dovecot] Outlook 2003 and Thunderbird IMAP + gettingnew
headers

On Wed, 2008-09-10 at 10:29 +0200, Jan van den Berg
wrote:
> We run 1.1.3 and I use Outlook to connect to my IMAP box and a couple of
> times per day (randomly) when I click certain folders IMAP will start
> retrieving ALL headers for that folder again ('retrieving new
headers')!
Typically that means that the mailbox's UIDVALIDITY has changed. Or the
messages get assigned new UIDs for some reason (e.g. Dovecot sees that
they're gone, later sees them again). You could verify these by using
e.g. rawlog (http://wiki.dovecot.org/Debugging/Rawlog) and seeing if the
UIDVALIDITY value after SELECT command changes and if the returned UIDs
get changed.

Do you do anything on the server with dovecot-uidlist files? Or
dovecot.index* files? Like deleting them once in a while as someone was
doing in a cron job? :)