Hi: I need periodically rsync a bunch of very big files. These files are append-only so changes are already at the end of the file. Because files are big, I assume it will take some time comparing the first part of files. Is there a way that I can tell rsync to sync only the extra part at the end of file, and do not compare the first part of files? Thanks. Chuang
On Thu, 2008-02-07 at 20:16 -0600, chuang liu wrote:> I need periodically rsync a bunch of very big files. These files > are append-only so changes are already at the end of the file. > > Because files are big, I assume it will take some time comparing the first > part of files. Is there a way that I can tell rsync to sync only the extra > part at the end of file, and do not compare the first part of files?The --append option of the current development rsync works the way you want. (The option that compares the first parts has been renamed to --append-verify .) Matt
Thanks a lot. Will "--backup --inplace" do the same trick? On Thu, 7 Feb 2008, Matt McCutchen wrote:> On Thu, 2008-02-07 at 20:16 -0600, chuang liu wrote: > > I need periodically rsync a bunch of very big files. These files > > are append-only so changes are already at the end of the file. > > > > Because files are big, I assume it will take some time comparing the first > > part of files. Is there a way that I can tell rsync to sync only the extra > > part at the end of file, and do not compare the first part of files? > > The --append option of the current development rsync works the way you > want. (The option that compares the first parts has been renamed to > --append-verify .) > > Matt > > >
On Thu, 2008-02-07 at 20:38 -0600, chuang liu wrote:> Thanks a lot. Will "--backup --inplace" do the same trick?No, --backup --inplace will make a complete backup copy of the destination file and then compare the whole source file to the destination file. Matt> On Thu, 7 Feb 2008, Matt McCutchen wrote: > > > On Thu, 2008-02-07 at 20:16 -0600, chuang liu wrote: > > > I need periodically rsync a bunch of very big files. These files > > > are append-only so changes are already at the end of the file. > > > > > > Because files are big, I assume it will take some time comparing the first > > > part of files. Is there a way that I can tell rsync to sync only the extra > > > part at the end of file, and do not compare the first part of files? > > > > The --append option of the current development rsync works the way you > > want. (The option that compares the first parts has been renamed to > > --append-verify .) > > > > Matt
Apparently Analagous Threads
- rsync daemon troubleshooting
- rsync: connection unexpectedly closed (0 bytes received so far) [receiver]
- rsyncd performance when handling multiple clients in parallel
- [Bug 8990] New: --append-verify doesn't spot file differences, even with --checksum
- [Bridge] [PATCH] bridge: Bug fix for incorrect interpretation of MLDv2 maximum response code