dovecot - Feb 2007 - Reproducible duplicate messages bug with Mail.app+Dovecot

Hey guys,

I am not sure if this is a Mail.app bug or a dovecot bug.  I can  
reproduce it 100% of the time using dovecot and Mail.app.   I cannot  
reproduce it with other imap clients, which at first made me think it  
was Mail.app, but then I tried Mail.app with other imap servers and  
couldn't reproduce it either, so it's definitely the combination of  
the two.    So I thought I'd try you guys first before submitting a  
bug to Apple.

The problem:   If I move  multiple messages (set "A") from one imap  
folder to another, then delete those messages, and then move another  
set into that same folder (set "B"), then all the messages in set B  
show up as duplicates until I relaunch Mail.app.

My configuration:
Server: Dovecot 1.0rc22 using Maildir on FreeBSD 6.1
Client:  Mail.app 2.1 on OS X 10.4.8

Steps to reproduce:  (these steps involve trashing messages, so it's  
best to test this on email you are going to toss anyway)

1) Create a new imap folder (let's say "bar")
2) Drag more than one message (let's say 3 or 4) from existing imap  
folder "foo" to new folder "bar".
3) Click on new folder "bar" and see messages in there.
4) Select messages and delete them (Delete key).  Messages are gone  
as expected.
5) Go back to original folder "foo" and drag a few more messages into
new folder "bar"
6) Click on bar.
7) You will notice that all the second set of messages show up twice.

Relaunching Mail.app at this point makes the problem disappear.   I'm  
guessing this has something to do with the deleted messages from Set  
A being purged until the close of imap connection.
Any help narrowing this down would be appreciated.

Thank you,

--Andy

-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 2423 bytes
Desc: not available
URL:
<http://dovecot.org/pipermail/dovecot/attachments/20070210/14cd2bdc/attachment-0002.bin>

Andrew Moran schrieb:
> Hey guys,
> 
> I am not sure if this is a Mail.app bug or a dovecot bug.  I can
> reproduce it 100% of the time using dovecot and Mail.app.   I cannot
> reproduce it with other imap clients, which at first made me think it
> was Mail.app, but then I tried Mail.app with other imap servers and
> couldn't reproduce it either, so it's definitely the combination of
the
> two.    So I thought I'd try you guys first before submitting a bug to
> Apple.
> 
> The problem:   If I move  multiple messages (set "A") from one
imap
> folder to another, then delete those messages, and then move another set
> into that same folder (set "B"), then all the messages in set B
show up
> as duplicates until I relaunch Mail.app.
> 
> My configuration:
> Server: Dovecot 1.0rc22 using Maildir on FreeBSD 6.1
> Client:  Mail.app 2.1 on OS X 10.4.8
> 
> Steps to reproduce:  (these steps involve trashing messages, so it's
> best to test this on email you are going to toss anyway)
> 
> 1) Create a new imap folder (let's say "bar")
> 2) Drag more than one message (let's say 3 or 4) from existing imap
> folder "foo" to new folder "bar".
> 3) Click on new folder "bar" and see messages in there.
> 4) Select messages and delete them (Delete key).  Messages are gone as
> expected.
> 5) Go back to original folder "foo" and drag a few more messages
into
> new folder "bar"
> 6) Click on bar.
> 7) You will notice that all the second set of messages show up twice.
> 
> Relaunching Mail.app at this point makes the problem disappear.   I'm
> guessing this has something to do with the deleted messages from Set A
> being purged until the close of imap connection.
> Any help narrowing this down would be appreciated.
> 
> Thank you,
> 
> --Andy
> 
Hi Andrew,

i have some reports for double mails with a courier server imap
with apple mail too ( which i cant  found in  the mail log, and have no
real idea where they come from, i was nearly sure users double them with
some filters in the client over some other server, but hearing your
problem  i get awake that this might be a general apple mail bug),
so are sure that is not a apple bug, have you asked at some apple mail
list for clearing?
I hadnt the chance to inspect some of that so called double mail, cause
the users delete them always at once ( i told them to leave me examples
in imap , but as users are they ignore what i said but cry on if the
failure comes again )
So iam really unsure if there is any relations between your failure and
mine, but a broken client might be also a answer.
I am sorry to have no apple at my own  to make tests with my dovecot or
courier setups

After all i sometimes see likely behavior in thunderbird too with imap
dovecot and courier for short times, its a caching thing, if i click on
the meant to be double mails,
imap syncs and they disapear, ( so there is no double in fact ) so i
simple ignore this, i think this comes up with many mails and choosen
option folders for offline usage.

-- 
Mit freundlichen Gruessen
Best Regards

Robert Schetterer

https://www.schetterer.org
Munich/Bavaria/Germany

On Feb 10, 2007, at 4:30 PM, Robert Schetterer wrote:
>
> Hi Andrew,
>
> i investigated the imap bugs from apple mail app with google
> trough the years, and i saw there was  no version without a bug with
> imap, so i speculate its not dovecot what does something wrong here
>

Oh I have no doubt that Apple's Mail.app is very buggy, but I submit  
a bug to them which only happens with dovecot IMAP server, I'm sure  
they are going to be quick to blame dovecot rather than investigate  
it fully.   This is why I was hoping that someone on this list who  
has Mail.app and Dovecot can (a) verify that it is happening for them  
(it's 100% reproducible to me) and (b) figure out exactly what's  
going on, at least to the point of knowing it's Mail.app's fault and  
not something Dovecot is doing, or a combination of both (such as  
dovecot doing something other IMAP servers don't and Mail.app  
misinterpreting it).


--Andy
-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 2423 bytes
Desc: not available
URL:
<http://dovecot.org/pipermail/dovecot/attachments/20070211/7eb96de1/attachment-0002.bin>

On Sat, 2007-02-10 at 12:00 -0800, Andrew Moran wrote:
> Server: Dovecot 1.0rc22 using Maildir on FreeBSD 6.1
Linux here.
> Client:  Mail.app 2.1 on OS X 10.4.8
Same here. Says 2.1 (752/752.2).
> 1) Create a new imap folder (let's say "bar")
> 2) Drag more than one message (let's say 3 or 4) from existing imap  
> folder "foo" to new folder "bar".
By this I suppose you mean the move operation, which does internally
COPY + STORE \Deleted for the selected messages.
> 3) Click on new folder "bar" and see messages in there.
> 4) Select messages and delete them (Delete key).  Messages are gone  
> as expected.
So just mark them deleted, no expunge?
> 5) Go back to original folder "foo" and drag a few more messages
into
> new folder "bar"
> 6) Click on bar.
> 7) You will notice that all the second set of messages show up twice.
The first set is still gone?

I couldn't reproduce it. What Trash settings do you have? Anyway like
others suggested looking at rawlog output would be helpful in showing
what goes wrong.

Also have you tried recreating your Dovecot account in Mail.app? That
alone might fix it..
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 189 bytes
Desc: This is a digitally signed message part
URL:
<http://dovecot.org/pipermail/dovecot/attachments/20070212/56e8cafe/attachment.bin>