rsync - Apr 2015 - Skip based on checksum not worked as expected when using with complex filter rules.

On Fri, 17 Apr 2015 21:27:56 -0400, Kevin Korb wrote:
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
> 
> Any time rsync wants to do something to a file you don't think it
should
> be see what --itemize-changes says about it.  In fact, -v is almost
> entirely useless without --itemize-changes.  In fact, if I was in charge
> I would make -v include --itemize-changes.
Thanks a lot for your hints.

Based on your hints, I use the `-cniv' options combinations and do the 
extract as follows on the output of rsync:

awk '/^>fc/'

And it does the trick.

Regards
-- 
.: Hongyi Zhao [ hongyi.zhao AT gmail.com ] Free as in Freedom :.

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

So, I am assuming that without --itemize-changes you couldn't tell the
difference between "I am transferring a file" and "I am fixing
the
timestamp on a file".

Even if I am right, you are probably still mis-using --checksum.  When
you use --checksum you force a checksumming of absolutely everything
on both ends before anything else happens.  Without --checksum a file
with a wrong timestamp will be delta-xferred.  A delta-xfer is at
worst the same as a both side checksum.  If you let it delta-xfer
files with wrong timestamps that is much faster than --checksum since
- --checksum wastes time checksumming files that can't possibly have a
checksum match.

Simply put, if you use --checksum without one of --itemize-changes,
- --link-dest, or --write-batch you are doing something horribly wrong.


On 04/17/2015 11:34 PM, Hongyi Zhao wrote:
> On Fri, 17 Apr 2015 21:27:56 -0400, Kevin Korb wrote:
> 
>> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1
>> 
>> Any time rsync wants to do something to a file you don't think it
>> should be see what --itemize-changes says about it.  In fact, -v
>> is almost entirely useless without --itemize-changes.  In fact,
>> if I was in charge I would make -v include --itemize-changes.
> 
> Thanks a lot for your hints.
> 
> Based on your hints, I use the `-cniv' options combinations and do
> the extract as follows on the output of rsync:
> 
> awk '/^>fc/'
> 
> And it does the trick.
> 
> Regards
> 
- -- 
~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~
	Kevin Korb			Phone:    (407) 252-6853
	Systems Administrator		Internet:
	FutureQuest, Inc.		Kevin at FutureQuest.net  (work)
	Orlando, Florida		kmk at sanitarium.net (personal)
	Web page:			http://www.sanitarium.net/
	PGP public key available on web site.
~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2

iEYEARECAAYFAlUx02YACgkQVKC1jlbQAQeNKACg5NU2TiogzWzqMii98NExtI+V
ou4AoLNW320LrRCCYp9vZQIN4sLruWKW
=oM7m
-----END PGP SIGNATURE-----

On Fri, 17 Apr 2015 23:45:42 -0400, Kevin Korb wrote:
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
> 
> So, I am assuming that without --itemize-changes you couldn't tell the
> difference between "I am transferring a file" and "I am
fixing the
> timestamp on a file".
> 
> Even if I am right, you are probably still mis-using --checksum.  When
> you use --checksum you force a checksumming of absolutely everything on
> both ends before anything else happens.  Without --checksum a file with
> a wrong timestamp will be delta-xferred.  A delta-xfer is at worst the
> same as a both side checksum.  If you let it delta-xfer files with wrong
> timestamps that is much faster than --checksum since - --checksum wastes
> time checksumming files that can't possibly have a checksum match.
Yes, with `--checksum' is a time-consuming thing ;-(
> 
> Simply put, if you use --checksum without one of --itemize-changes,
> - --link-dest, or --write-batch you are doing something horribly wrong.
So, I think that use the `-niv' combinations and then do the extract as 
follows:

awk '/^>f/'

Should enuogh for most cases to check the stuff which are need to be 
updated.

Regards
-- 
.: Hongyi Zhao [ hongyi.zhao AT gmail.com ] Free as in Freedom :.