search for: deduplication

Hello, I'm trying to create automated backup recovery using "doveadm import" and "doveadm deduplicate". During testing I noticed that deduplicate only deletes some duplicates and has to be called multiple times to find them all. Here's what I've been trying (in shell commands): First, expunge inbox (the end result is the same even if you delete only some

On 13.2.2015 16:59, Kevin Laurie wrote: > Dear Jiri, > > I tried the following to try to get the inbox deduplicated. My inbox is > quite large and urgently need to remove the duplicated messages. > Is there an easy way to do this? > Sorry for being so presistant but I need help. > > The command I tried:- > > doveadm deduplicate -u user at domain.net mailbox inbox

Dear Jiri Noted. Thanks On Fri, Feb 13, 2015 at 11:15 PM, Jiri Bourek <bourek at thinline.cz> wrote: > On 13.2.2015 15:54, Kevin Laurie wrote: > >> Hello, >> I just migrated my emails from gmail using getmail. >> In the process I got some emails that have been doubled or tripled >> How do I run the doveadm command to delete copies of same emails? >>

...? Best regards, George | Developer | Access Softek, Inc ________________________________ От: David Blaikie <dblaikie at gmail.com> Отправлено: 16 декабря 2017 г. 22:25 Кому: George Rimar Копия: Sean Silva; llvm-dev at lists.llvm.org; Rui Ueyama; Rafael Espindola Тема: Re: [llvm-dev] [RFC] - Deduplication of debug information in linkers (LLD). On Sat, Dec 16, 2017 at 4:08 AM George Rimar <grimar at accesssoftek.com<mailto:grimar at accesssoftek.com>> wrote: >Wasn't our (lld/ELF's) position on debug info size that we should focus on providing a great split-dwarf workflow an...

Hi list, is there any working solution for deduplication of data for centos? We are trying to find a solution for our backup server which runs a bash script invoking xdelta(3). But having this functionality in fs is much more friendly... We have looked into lessfs, sdfs and ddar. Are these filesystems ready to use (on centos)? ddar is sthg different,...

I have deduplication active in my first mdbox: type mailbox, but how do I find out how well the deduplication works? Is there a way of finding out how much disk space I saved (if I saved some :) )? -- Ralf Hildebrandt Gesch?ftsbereich IT | Abteilung Netzwerk Charit? - Universit?tsmedizin Berlin Campus Benjamin...

>Wasn't our (lld/ELF's) position on debug info size that we should focus on providing a great split-dwarf workflow and not try go too far out of our way to deduplicate >or otherwise reduce debug info size inside LLD? I recall there being some patches that made linking of large debug binaries like 1.5GB+ clang faster, but we decided to >reject those changes because split-dwarf was

Nothing too interesting here, I was just playing around with the idea of a deduplication allocator for nbdkit (“allocator=dedup”, see https://rwmj.wordpress.com/2020/06/15/compressed-ram-disks/). Before implementing such a thing I wanted to know if there's much duplicated structure in a disk image. It seems to depend very critically on the block size, but also there are no signif...

Hello, I just migrated my emails from gmail using getmail. In the process I got some emails that have been doubled or tripled How do I run the doveadm command to delete copies of same emails? I tried running the following:- doveadm deduplicate -u user at domain.net inbox but I get error:- doveadm(root): Fatal: Unknown argument INBOX Could someone share some way to automatically remove

Have you considered to introduce a "deduplicate mode" for rsync, replacing duplicate files in the destination directory by hard links? Of course there might be a lot of problems together with this feature, but on creating backups it could help to save a lot of disk space. --link-dest might be interesting in this context, too. Regards Harri

Hi: I am very interested in the ZFS deduplication, where can I get the the source code? Or would anybody send me an actual source code achive which contains the ZFS deduplication? I am looking forward your kind help. Thanks very much. Best Rgards -- Yujuan Tan, PhD Candidate Wuhan National Laboratory for Optoelectronics, Wuhan, China Key Lab...

Hello, some questions regarding btrfs deduplication. - What is the state of it? Is it "safe" to use? https://btrfs.wiki.kernel.org/index.php/Deduplication does not yield much information. - https://pypi.python.org/pypi/bedup says: "bedup looks for new and changed files, making sure that multiple copies of identical files share space...

Dear Jiri, I tried the following to try to get the inbox deduplicated. My inbox is quite large and urgently need to remove the duplicated messages. Is there an easy way to do this? Sorry for being so presistant but I need help. The command I tried:- doveadm deduplicate -u user at domain.net mailbox inbox On Fri, Feb 13, 2015 at 11:40 PM, Kevin Laurie <superinterstellar at gmail.com>

Hi all, I'm running dovecot 2.3.7.1, with mdbox and single instance storage. I use offline deduplication like this: mail_attachment_fs = sis-queue /mailboxes/%d/_attachments_/queue:posix Each week I run doveadm sis deduplicate to deduplicate the mail attachments. Everything was fine until I mistakenly run doveadm sis deduplicate twice, simultaneously. I ended up having some error messages like this...

Hi. I am seriously considering employing btrfs on my systems, particularly due to some space-saving features that it has (namely, deduplication and compression). In fact, I was (a few moments ago) trying to back up some of my systems to a 2TB HD that has an ext4 filesystem and, in the middle of the last one, I got the error message that the backup HD was full. Given that what I backup there are systems where I have some of the data prese...

Hi All: We have been looking at implementing deduplication on a backup server. >From what I have been able to find the available documentation is pretty thin. I ended up trying to install LessFS on this CentOS 5.7 box but we have now encountered problems with fuse version. Has anyone out there been able to get LessFS running on CentOS 5.7 and can provi...

Will the material ever be posted. Looks there is some huge bugs with zfs deduplication that the organizers do not want to post it also there is no indication on sun website if there will be a deduplication feature. I think its best they concentrate on improving zfs performance and speed with compression enabled. -------------- next part -------------- An HTML attachment was scrubbed....

...> George | Developer | Access Softek, Inc > ------------------------------ > *От:* George Rimar > *Отправлено:* 16 декабря 2017 г. 22:27 > *Кому:* David Blaikie > > *Копия:* Sean Silva; llvm-dev at lists.llvm.org; Rui Ueyama; Rafael Espindola > *Тема:* Re: [llvm-dev] [RFC] - Deduplication of debug information in > linkers (LLD). > > ​But could not we for example do split dwarf, but for example do dedup of > types ? > > I do not mean right now, but in a theory ? > > > Best regards, > George | Developer | Access Softek, Inc > --------------------------...

Hi, I'm currently running GlusterFS over XFS, and it works quite well. I'm wondering if it's possible to add data deduplication into the mix by: glusterfs --> lessfs --> xfs or glusterfs --> opendedupe --> xfs Has anybody tried doing this? We're running VM images on gluster, and I figure we could get a bit of space saving bu deduplicating the data. Gerald

...obably not a good idea for external library. I feel it is much more convinent to do such proccessing in a linker. Linker do and knows much more about things like sections that are ICFed, eliminated, about COMDATs and many things like strings dedups. So it can rebuild relocations and perform DWARF deduplication probably in a faster/more convinent way probably than external API could provide. Honestly I did not yet think about it too much, just current feelings. Geоrge. -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.llvm.org/pipermail/llvm-dev/attachment...