similar to: Patch for rsyncable zlib with new rolling checksum

Displaying 20 results from an estimated 100 matches similar to: "Patch for rsyncable zlib with new rolling checksum"

2004 May 03
1
gzip-rsyncable.diff
Hi, I currently create large (500MB-2.5GB) tar.gz files that I am trying to get to rsync better. After doing some research by reading a lecture presented by the original author of rsync and googling the list archives, I have concluded that the gzip-rsyncable.diff is the best way to get gzipped files to rsync nicely. The only version I could find of this patch is available here:
2003 Aug 28
1
Fw: Re: GZIP, ZIP, ISO, RPM files and rsync, tar, cpio
On Thu, Aug 28, 2003 at 12:51:16PM +0300, Sviatoslav Sviridov/Lintec Project wrote: > > Sorry for direct reply, but mail server at samba.org blocks my messages. Postmasters, Martin, For your consideration. > Begin forwarded message: > > Date: Thu, 28 Aug 2003 12:43:54 +0300 > From: Sviatoslav Sviridov/Lintec Project <svd@lintec.minsk.by> > To: rsync@lists.samba.org
2009 Jul 06
3
How to make big MySQL database more diffable/rsyncable? (aka rsyncing big files)
Hello group, I'm having a very hard time rsyncing efficiently a MySQL database which contains very large binary blobs. (Actually, it's the database of Mantis bug tracker [http://www.mantisbt.org/], with file attachments stored directly in the table rows. I know it's a bad idea from many other reasons, but let's say it was given to me as such.) First, I was dumping the
2019 Jun 19
0
libvirtd does not update VM .xml configurations on filesystem after virsh snapshot/blockcommit
Hi, Recently We've upgraded some KVM hosts from Fedora 29 to Fedora 30 and now experience broken VM configurations on filesystem after virsh blockcommit. Commands "virsh dumpxml ..." and "virsh dumpxml --inactive ..." is showing diffrent configuration than the one on filesystem. In case of restart libvirtd or system reboot, there are broken VM xml configurations on
2003 Jul 28
2
compression and encryption
Hello folks! I've been thinking about adding the capability to store files compressed and/or encrypted on either side of the rsync transfer. Let's say there's a storage space provider. I want to store my files on that server compressed (so I don't use more paid space than I need), and encrypted (so they can't read my data). I don't know much about encryption, but I
2019 Jun 19
2
libvirtd does not update VM .xml configuration on filesystem after virsh blockcommit
Hi, Recently We've upgraded some KVM hosts from Fedora 29 to Fedora 30 and now experience broken VM configurations on filesystem after virsh blockcommit. Commands "virsh dumpxml ..." and "virsh dumpxml --inactive ..." is showing diffrent configuration than the one on filesystem. In case of restart libvirtd or system reboot, there are broken VM xml configurations on
2008 Mar 03
1
PST Rsync Issues
Hi All, I have a 1.8GB PST file that is backed up every night from a cygwin install) and every night rsync transfers about 1.8GB of data for that file. It changes a bit, but for all intents and purposes the entire file is transferred. There are other files on this system that rsync more typically, so I'm fairly certain this isn't a switch or command error on the calling end. I have also
2016 May 15
1
--inplace option seems sending whole file
Hi I'm having issues sendig a lot of tar.gz backup files to a ZFS remote filesystem server. This files are compressed with the --rsyncable option. Sending without --inplace option rsync works well and send only the differences, but to create a temporary file and rewrite the file destination, zfs snapshots contain the full size of the backup, not only differences block. I've tried
2016 Dec 07
3
rsyncing from a compressed tarball.
Mike, As it stands right now, we use xz for our compression, so if rsync had a similar option for xz that would probably be an improvement. However, I think being able to decompress directly to the remote system would save more; elsewise I don't see how I'm going to be able to avoid untarring and uncompressing the whole xz file on the other end. thanks much, ed On Tue, Dec 6, 2016 at
2001 Dec 20
3
rsync *Still* Copying All Files?
Hi, all. This is my first post to the list, so please forgive me if this is an old issue. I scoured the mailing list archives by hand and could find no mention of it, and the official FAQ-o-matic mentions it, but doesn't offer a fix that works for me. I've set up an rsync daemon on Windows NT4 by installing the latest cygwin. Using the cygwin1.dll and rsync.exe, I'm able to connect
2005 Feb 06
0
Announcement - rsyncrypto 0.02 released
Hi all, I'm sorry if this is off topic here. I'll send this one anyways, but do let me know if you are interested in related project's release announcements so that I don't spam this list unnecessarily in the future. rsyncrypto is a utility that encrypts file in a rsync friendly way. Small changes to the plain text file will result in small changes to the cypher text file.
2005 Feb 13
2
Rsync friendly zlib/gzip compression - revisited
Hi, all - I've been digging into the question of using rsync to sync up compressed data, and read with interest the conversations regarding the rsync friendly patch available for gzip (I belive Rusty provided this patch). For anyone interested, the message thread is archived at http://lists.samba.org/archive/rsync/2002-June/thread.html. The broad outline of this approach were mentioned in
2023 Mar 04
3
Trying to diagnose incomplete file transfer
At $work I have an odd situation involving incomplete file transfers, but I am unsure where the issue may be occurring. Here is the scenario. Problem: Sometimes the file transfer seems to have completed, but the file size does not match that on the remote system. Details: I transfer a number of large (>1GB) Tar-Gzipped (.tgz) files via SSH tunnels from $customer. Because of some previous
2001 Jul 27
0
(fwd) Re: rsync and named-xfer
i'm posting this to the bind-users and rsync mailing lists in order to get this archived for the next person who needs to do this :) comments and suggestions are welcome, but please cc: to me because i'm not subscribed to either list. craig ----- Forwarded message from Craig Sanders <cas@taz.net.au> ----- Date: Fri, 27 Jul 2001 10:30:20 +1000 From: Craig Sanders
2009 Jan 19
5
file compression on target side
Hello All, I have been using rsync to backup several filesystems by using Mike Rubel's hard link method (http://www.mikerubel.org/computers/rsync_snapshots/). The problem is, I am backing up a lot of ASCII .log, csv, and .txt files. These files are large and can range anywhere from 1GB to 30GB. I was wondering if on the target side (the backup side), if I can use some sort of compression. I
2005 Feb 04
2
rsync huge tar files
Hi folks, Are there any tricks known to let rsync operate on huge tar files? I've got a local tar file (e.g. 2GByte uncompressed) that is rebuilt each night (with just some tiny changes, of course), and I would like to update the remote copies of this file without extracting the tar files into temporary directories. Any ideas? Regards Harri
2003 Mar 05
2
compressed archives
Suppose I have a particular version of a largish compressed archive, most likely a .tgz or .tbz2, and that a remote machine has a newer, and only slightly different, version of the same archive, where most of the content hasn't actually changed much. I might attempt to obtain a copy of the newer archive by first copying my local older copy to the newer name as a file to update from. My
2002 Dec 23
1
deflate on token returned 0 (16384 bytes left)
Hello All, I have searched for this error and found similiar errors, but everything seems to indicate that this should be fixed in the 2.5.5 version. rsync version 2.5.5 protocol version 26 I am running rsync with -axz, trying to sync up a large gz file : Source machine: -rw-r--r-- 1 root other 175214792 Dec 22 00:17
2003 Aug 28
1
GZIP, ZIP, ISO, RPM files and rsync, tar, cpio
I noticed with rsync and compressed files or package files the transfer efficiency drops considerably. Eg. rsync an ISO image of a distribution will give you between 30% and 60% of the original transfer although from Beta1-Beta2 the change could not have been that great. The same thing happens with ZIP files for obvious reasons. My question or feature request if you want to call it is. Is it
2003 Jun 22
1
rsync backup performance question
Dear all, I am implementing a backup system, where thousands of postgreSQL databases (max 1 Gb in size) on as much clients need to be backed up nightly across ISDN lines. Because of the limited bandwidth, rsync is the prime candidate of course. Potential problems I see are server load (I/O and CPU), and filesystem limits. Does anyone have experience with such setups? Ron Arts -- NeoNova BV