rsync - Aug 2005 - rsync and large files

Hello,

      I have a few files of the order of 50G, that get synchronized to a remote
server over ssh. These files have binary data and the
change before the next time they are synchronized over. My question is, I am
observing that the data being sent over is almost
equal to the size of the file. Would an insertion of a few blocks in a binary
file, move the alignment of the entire file and cause this
to happen ? Does rsync internally understand that the file is almost the same,
but the data is just skewed a little bit ?

Please advise.

Thanks,
Sameer.
-------------- next part --------------
HTML attachment scrubbed and removed

On Mon, Aug 15, 2005 at 12:11:35PM -0400, Sameer Kamat
wrote:
> My question is, I am observing that the data being sent over is almost
> equal to the size of the file. Would an insertion of a few blocks in a
> binary file, move the alignment of the entire file and cause this to
> happen?
That depends on the file and your options.  Is the file compressed?  If
so, all data after the change is radically different, and will not match
(unless you use an rsync-friendly compression algorithm, such as
"gzip --rsyncable").   If that's not the case, are you using
--inplace?
(That option specifically mentions that it doesn't handle early
insertions well.)  Or is --whole-file being specified or implied?  (It is
implied by a local transfer, so specify --no-whole-file if you need to
test using a local transfer.)

..wayne..