similar to: vdo statustics on Dedup?

On May 3, 2020 8:33:33 AM GMT+03:00, Erick Perez - Quadrian Enterprises <eperez at quadrianweb.com> wrote: >sorry corrections: >For this test I created a 40GB lvm volume group with /dev/sdb and >/dev/sdc >then a 40GB LV >then a 60GB VDO vol (for testing purposes) > >vdostats --verbose /dev/mapper/vdoas | grep -B6 'saving percent' >output from just created

My two cents: 1- Do you have an encrypted filesystem on top of VDO? If yes, you will see no benefit from dedupe. 2- can you post the stats of vdostats ?verbose /dev/mapper/xxxxx (replace with your device) you can do something like: "vdostats -verbose /dev/mapper/xxxxxxxx | grep -B6 'save percentage' On Sat, May 2, 2020 at 9:54 PM david <david at daku.org> wrote: >

sorry corrections: For this test I created a 40GB lvm volume group with /dev/sdb and /dev/sdc then a 40GB LV then a 60GB VDO vol (for testing purposes) vdostats --verbose /dev/mapper/vdoas | grep -B6 'saving percent' output from just created vdoas [root at localhost ~]# vdostats --verbose /dev/mapper/vdoas | grep -B6 'saving percent' physical blocks : 10483712

Hi David, in my opinion, VDO isn't worth the effort. I tried VDO for the same use case: backups. My dataset is 2-3TB and I backup daily. Even with a smaller dataset, VDO couldn't stand up to it's promises. It used tons of CPU and memory and with a lot of tuning I could get it to kind of work, but it became corrupted at the slightest problem (even a shutdown could do this, and

Folks I'm looking for a solution for backups because ZFS has failed on me too many times. In my environment, I have a large amount of data (around 2tb) that I periodically back up. I keep the last 5 "snapshots". I use rsync so that when I overwrite the oldest backup, most of the data is already there and the backup completes quickly, because only a small number of files have

Folks I was impressed with the description of VDO (Virtual Device Optimizer?) in the RedHat documentaion, so much that I tried to use it. The tutorials led me to a few commands. I built a VDO device on top of two USB disks which I made into a Logical Volume, and I was ready to go. In my test case, I had a file set of about 600 GB. There was 5 TB of space between the two disk LVMs. So, I

Also, if you want to use deduplication (via VDO) then you must remember to "dedupe then encrypt" Storage > LUKS > VDO > LVM old but good reference to: https://access.redhat.com/articles/2106521 On Tue, Jun 16, 2020 at 3:00 PM Jason Edgecombe <jwedgeco at uncc.edu> wrote: > > I recommend having LUKS be "under" LVM. the layers would be: > /dev/sda ->

CentOS Errata and Bugfix Advisory 2018:1408 Upstream details at : https://access.redhat.com/errata/RHBA-2018:1408 The following updated files have been uploaded and are currently syncing to the mirrors: ( sha256sum Filename ) x86_64: c5b48207e2d3003ba38df515a78b57062c7e27a21ebdcd9fd4a4043f55a50622 vdo-6.1.0.168-18.x86_64.rpm Source:

I tried the deduplication feature but the performance of my fileserver dived from writing 50MB/s via CIFS to 4MB/s. what happens to the deduped blocks when you set dedup=off? are they written back to disk? is the deduptable deleted or is it still there? thanks -- This message posted from opensolaris.org

Hi all, Back in March someone asked about deduplication in Centos and I replied I'm using LessFS. I want to report that my overall experience is that I have performance issue up to the point that I would like to abandon it. The OP was asking http://www.opendedup.org/ How is it? Thanks Fajar

??????? Hello everybody, ?? On a Dovecot 2.x, what is the best way to delete an user mailbox when : * all attachments for all users detach in a common directory (mail_attachment_dir = var/mail/attachments ). * attachments use SIS deduplication (mail_attachment_fs = sis posix) * mailbox are in mdbox Trying to delete user mailbox directory (rm) and do the command? : doveadm -v purge -u johndoe ,

On Sat, May 2, 2020 at 10:54 PM david <david at daku.org> wrote: > > I'm looking for a solution for backups because ZFS has failed on me > too many times. In my environment, I have a large amount of data > (around 2tb) that I periodically back up. I keep the last 5 > "snapshots". I use rsync so that when I overwrite the oldest backup, > most of the data is

Hi all Deduplicating data is not really a new thing, but quite efficient in mail systems where an email with an nMB attachment may be sent to multiple recipients. This might call for deduplicating data. Is there a way to do this, or is it far off? If I understand the system correctly, usually an MTA is calling dovecot on every single message, meaning the message itself won't

Hello ZFS experts: I would like to study ZFS de-duplication feature. Can someone please let me know which directory/files I should be looking at? Thanks in advance. -- This message posted from opensolaris.org

> Am 04.03.2019 um 22:19 schrieb Francis via dovecot <dovecot at dovecot.org>: > > Le lun. 4 mars 2019 ? 12:48, Gerald Galster via dovecot <dovecot at dovecot.org <mailto:dovecot at dovecot.org>> a ?crit : > > Hallo Francis, > > have you tried removing the account from your ldap? If dovecot has no information about a particular user, it won't

Deduplication was committed last night by Mr. Bonwick: > Log message: > PSARC 2009/571 ZFS Deduplication Properties > 6677093 zfs should have dedup capability http://mail.opensolaris.org/pipermail/onnv-notify/2009-November/010683.html Via c0t0d0s0.org.

Is there an easy way to find out what datasets have dedup''d data in them. Even better would be to discover which files in a particular dataset are dedup''d. I ran # zdb -DDDD which gave output like: index 1055c9f21af63 refcnt 2 single DVA[0]=<0:1e274ec3000:2ac00:STD:1> [L0 deduplicated block] sha256 uncompressed LE contiguous unique unencrypted 1-copy size=20000L/20000P

Nothing too interesting here, I was just playing around with the idea of a deduplication allocator for nbdkit (“allocator=dedup”, see https://rwmj.wordpress.com/2020/06/15/compressed-ram-disks/). Before implementing such a thing I wanted to know if there's much duplicated structure in a disk image. It seems to depend very critically on the block size, but also there are no significant

Hello, some questions regarding btrfs deduplication. - What is the state of it? Is it "safe" to use? https://btrfs.wiki.kernel.org/index.php/Deduplication does not yield much information. - https://pypi.python.org/pypi/bedup says: "bedup looks for new and changed files, making sure that multiple copies of identical files share space on disk. It integrates deeply with btrfs so

Hi, We are considering using a ZFS based storage as a staging disk for Networker. We''re aiming at providing enough storage to be able to keep 3 months worth of backups on disk, before it''s moved to tape. To provide storage for 3 months of backups, we want to utilize the dedup functionality in ZFS. I''ve searched around for these topics and found no success stories,