Hi all Deduplicating data is not really a new thing, but quite efficient in mail systems where an email with an nMB attachment may be sent to multiple recipients. This might call for deduplicating data. Is there a way to do this, or is it far off? If I understand the system correctly, usually an MTA is calling dovecot on every single message, meaning the message itself won't necessarily be a duplicate in terms of headers (BCCs and so on). Would it be possible to dedup the content in terms of using separate files for the header and content and then deduping this with hard or symbolic links? Sorry if this is an old question, but I couldn't find anything about it. roy -- Roy Sigurd Karlsbakk (+47) 97542685 roy at karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et element?rt imperativ for alle pedagoger ? unng? eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer p? norsk.
On Tue, 2009-06-16 at 20:42 +0200, Roy Sigurd Karlsbakk wrote:> Deduplicating data is not really a new thing, but quite efficient in > mail systems where an email with an nMB attachment may be sent to > multiple recipients. This might call for deduplicating data. Is there > a way to do this, or is it far off? If I understand the system > correctly, usually an MTA is calling dovecot on every single message, > meaning the message itself won't necessarily be a duplicate in terms > of headers (BCCs and so on). Would it be possible to dedup the content > in terms of using separate files for the header and content and then > deduping this with hard or symbolic links? > > Sorry if this is an old question, but I couldn't find anything about it.If the exact same message is sent to multiple recipients, you can have deliver hard link the same file to all recipients' maildirs. That's the only thing we have currently. dbox format might in future have something better. -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 197 bytes Desc: This is a digitally signed message part URL: <http://dovecot.org/pipermail/dovecot/attachments/20090622/2f67970d/attachment-0002.bin>
On 6/22/2009, Timo Sirainen (tss at iki.fi) wrote:> If the exact same message is sent to multiple recipients, you can > have deliver hard link the same file to all recipients' maildirs.Is how to do this documented anywhere on the wiki? Thanks Timo, -- Best regards, Charles