search for: bedup

Dear All, I have a very slow deduplication going on on an external usb disk. I'm using it for backups - I rsync the relevent files to the disk and then take a snapshot. I then deduplicate with bedup dedup <disk-mount-point> What I am finding is that it is reporting a deduplication between the data on the disk and its snapshot e.g.: Deduplicated: - u'/mnt/floppy/_home/ftp/pub/Linux/Slackware/slackware-current/slackware/t/tetex-3.0-i486-7.txz' - u'/mnt/floppy/snapshots/_home_...

...an attached USB3 drive into a scratch area, then take a snapshot of this area. I''d like to have these snapshots immutable, so they should be read-only. Since rsync won''t discover moved files but instead place a new copy of that in the backup, I''m running the wonderful bedup application[2] to deduplicate my backup drive from time to time and it almost always gains back a good pile of gigabytes. The rest of storage space issues is taken care of by using rsync''s inplace option (although this won''t cover the case of files moved and changed between ba...

Hello, some questions regarding btrfs deduplication. - What is the state of it? Is it "safe" to use? https://btrfs.wiki.kernel.org/index.php/Deduplication does not yield much information. - https://pypi.python.org/pypi/bedup says: "bedup looks for new and changed files, making sure that multiple copies of identical files share space on disk. It integrates deeply with btrfs so that scans are incremental and low-impact." Is is file-based deduplcation only or is there also a block-based mode? Does not seem so a...

Welcome, I''ve been using btrfs for over a 3 months to store my personal data on my NAS server. Almost all interactions with files on the server are done using unison synchronizer. After another use of bedup (https://github.com/g2p/bedup) on my btrfs volume I experienced huge perfomance loss with synchronization. It now takes over 3 hours what have taken only 15 minutes! File browsing is not affected; but it takes forever to read contents of the files! When I use `iotop -o -d 30` (which measures I...

...understanding correct? Will compressed blocks among many files also be deduplicated? * How exactly do the recently merged offline deduplication features in the kernel interfere with what was (in my limited understanding) already possible with userspace tools like <https://github.com/g2p/bedup>? Are such third-party tools likely to be integrated into btrfs-progs? Are they supposed to be kept separate? * Does this change the on-disk format? Putting it another way, will it be safe to possibly go back to a previous kernel, if there is some problem with the current kernels? (Not...

According to https://github.com/g2p/bedup/tree/wip/dedup-syscall "The clone call is considered a write operation and won''t work on read-only snapshots." Is this fixed on newer kernels? -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to majordomo@vger.kernel.o...

...hin the duperemove repo is a file, btrfs-extent-same.c that acts as a test wrapper around the ioctl. It can be compiled completely seperately from the rest of the project via "make btrfs-extent-same". This makes direct testing of the ioctl more convenient. Gabriel de Perthuis also has a bedup branch which works against this ioctl. The branch can be found at: https://github.com/g2p/bedup/tree/wip/dedup-syscall Limitations We can''t yet dedupe within the same file (that is, source and destination are the same inode). This is due to a limitation in btrfs_clone(). Code review...