[Dovecot] New deduplicate doveadm command - was Re: v2.2.4 released

Charles Marcus
Tue, 25 Jun 2013 11:14:19 -0000

On 2013-06-24 7:56 PM, Timo Sirainen <tss at iki.fi>
wrote:
> http://dovecot.org/releases/2.2/dovecot-2.2.4.tar.gz
> http://dovecot.org/releases/2.2/dovecot-2.2.4.tar.gz.sig
>
> OK, this should be a pretty good and stable version.
>
>          + doveadm: Added "deduplicate" command to expunge
message duplicates.

Hey Timo,

2 questions on this new 'deduplicate' capability of doveadm...

Obviously this could be scripted with a cron job, but I was wondering if
it wouldn't make sense to do this automatically whenever messages are
being moved around in the mailstore?

An interesting 'feature' of gmail is that if/when you are copying lots
of messages from a non gmail account to a gmail account through IMAP, if
the folder you are copying from contains duplicate messages, gmail will
silently discard the duplicates after the first one is successfully
copied up...

I discovered this a long time ago the first time I encountered an
anomaly where I copied an entire folder, but the number of messages on
the gmail account didn't match the number in the source folder. After
comparing, I discovered that there were duplicates in the source folder,
which accounted for the discrepancy.

Thanks,

--

Best regards,

Charles