Hi all, I am starting fresh with a local repository of mails, which almost certainly have duplicates in them. I am going to use maildirs, and ensure all mails are input with CRLFs. The question is: does anybody know how I can find and remove duplicates, either while injecting mail with IMAP, or afterward? I can use tools to find duplicate Message-IDs, but don't know of a way to remove duplicates in mailboxes that are already imported as opposed to incoming mail. Perhaps there is a way to use the IMAP protocol for this? Cheers, Sabahattin -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 2655 bytes Desc: not available URL: <http://dovecot.org/pipermail/dovecot/attachments/20100314/56caadf0/attachment-0002.bin>
Em 14/03/2010 08:21, Sabahattin Gucukoglu escreveu:> Hi all, > > I am starting fresh with a local repository of mails, which almost certainly have duplicates in them. I am going to use maildirs, and ensure all mails are input with CRLFs. > > The question is: does anybody know how I can find and remove duplicates, either while injecting mail with IMAP, or afterward? I can use tools to find duplicate Message-IDs, but don't know of a way to remove duplicates in mailboxes that are already imported as opposed to incoming mail. Perhaps there is a way to use the IMAP protocol for this? > >i've used console tool named fdupes to find duplicate messages on Maildirs. That's done directly on the filesystem, there's no IMAP or dovecot involved. for a user way of doing that, i've used the excellent Thunderbird add-on called 'Remove Duplicated Messages' https://addons.mozilla.org/en-US/thunderbird/addon/956 it's SUPER fast and can check parameters that fdupes cannot. In fact fdupes search for duplicated FILES while the add-on can be configured to really find duplicated MESSAGES, based on Message-ID and other things. -- Atenciosamente / Sincerily, Leonardo Rodrigues Solutti Tecnologia http://www.solutti.com.br Minha armadilha de SPAM, N?O mandem email gertrudes at solutti.com.br My SPAMTRAP, do not email it
On 2010-03-14, Sabahattin Gucukoglu <mail at sabahattin-gucukoglu.com> wrote:> The question is: does anybody know how I can find and remove duplicates, > either while injecting mail with IMAP, or afterward? I can use tools to > find duplicate Message-IDs, but don't know of a way to remove duplicates > in mailboxes that are already imported as opposed to incoming mail. > Perhaps there is a way to use the IMAP protocol for this?This works fairly well: http://www.athensfbc.com/imap_tools/#delIMAPdups
On Mar 14, 2010, at 4:21 AM, Sabahattin Gucukoglu wrote:> Hi all, > > I am starting fresh with a local repository of mails, which almost certainly have duplicates in them. I am going to use maildirs, and ensure all mails are input with CRLFs. > > The question is: does anybody know how I can find and remove duplicates, either while injecting mail with IMAP, or afterward? I can use tools to find duplicate Message-IDs, but don't know of a way to remove duplicates in mailboxes that are already imported as opposed to incoming mail. Perhaps there is a way to use the IMAP protocol for this?<http://freshmeat.net/projects/imapsync> It will skip duplicates during transfer. -Terry