search for: xxh64

...rdlinks, hardlink-specials, > hardlink-symlinks, IPv6, atimes, batchfiles, inplace, append, no ACLs, > xattrs, optional protect-args, iconv, prealloc, stop-at, no crtimesOptimizations: > SIMD-roll, no asm-roll, openssl-crypto, no asm-MD5 > Checksum list: > xxh128 xxh3 xxh64 (xxhash) md5 md4 none > Compress list: > zstd lz4 zlibx zlib none > > OS: > Photon OS 3.0 with openssl fips enabled > > I'm using rsync like below: > > rsync -arXHpvxog <src> <dest> > > While doing so, if any file in src or dest location has a xa...

...ends to > reduce transfer size. Still. You claim in your patch that | Benchmarks C SSE2 SSSE3 | - Intel i7-7700hq 1850 MB/s 2550 MB/s 4050 MB/s while xxhash [0] claims on a Core i5-3340M @2.7GHz that: |Version Speed on 64-bit Speed on 32-bit |XXH64 13.8 GB/s 1.9 GB/s so using xxhash64 for that work would also boost !x86 platforms. However your patch has the benefit that no changes are required on the remote side. I like that. [0] https://github.com/Cyan4973/xxHash#benchmarks Sebastian

...s, symlinks, symtimes, hardlinks, hardlink-specials, hardlink-symlinks, IPv6, atimes, batchfiles, inplace, append, no ACLs, xattrs, optional protect-args, iconv, prealloc, stop-at, no crtimesOptimizations: SIMD-roll, no asm-roll, openssl-crypto, no asm-MD5 Checksum list: xxh128 xxh3 xxh64 (xxhash) md5 md4 none Compress list: zstd lz4 zlibx zlib none OS: Photon OS 3.0 with openssl fips enabled I'm using rsync like below: rsync -arXHpvxog <src> <dest> While doing so, if any file in src or dest location has a xattr value which is more than 32 bytes long, rsync s...

...7f "", s=0x100000000 <error: Cannot access memory at address 0x100000000>, bufsize=bufsize at entry=209) at lib/compat.c:120 #2 0x0000000000435903 in get_default_nno_list ( nno=0x47e840 <valid_checksums>, to_buf=to_buf at entry=0x7fffffffbe50 "xxh128 xxh3 xxh64 (xxhash) md5p8 md5 md4 none (", to_buf_len=to_buf_len at entry=256, dup_markup=dup_markup at entry=40 '(') at compat.c:478 #3 0x000000000043d717 in print_rsync_version (f=f at entry=FINFO) at usage.c:194 #4 0x000000000042fcee in parse_arguments (argc_p=argc_p at entry=0x7fffffffc...

I don't disagree that MD5 could (or even should) be replaced so it is no longer the bottleneck in several real-world cases (including mine). However this patch is not for MD5 performance, rather for the rolling checksum rsync uses to match blocks on existing files on both ends to reduce transfer size. On Mon, May 18, 2020 at 5:44 PM Filipe Maia via rsync <rsync at lists.samba.org>

...izes that @@ -362,9 +362,9 @@ void file_checksum(const char *fname, const STRUCT_STAT *st_p, char *sum) exit_cleanup(RERR_STREAMIO); } - for (i = 0; i + CSUM_CHUNK <= len; i += CSUM_CHUNK) { + for (i = 0; i + CHUNK_SIZE <= len; i += CHUNK_SIZE) { XXH_errorcode const updateResult = - XXH64_update(state, (uchar *)map_ptr(buf, i, CSUM_CHUNK), CSUM_CHUNK); + XXH64_update(state, (uchar *)map_ptr(buf, i, CHUNK_SIZE), CHUNK_SIZE); if (updateResult == XXH_ERROR) { rprintf(FERROR, "error computing XXH64 hash"); exit_cleanup(RERR_STREAMIO); @@ -373,7 +373,7 @@ void file_che...

Can anyone tell me the repository to use to upgrade to a version of rsync later than 3.1.2? Chris -- Christopher Wensink IS Administrator Five Star Plastics, Inc 1339 Continental Drive Eau Claire, WI 54701 Office: 715-831-1682 Mobile: 715-563-3112 Fax: 715-831-6075 cwensink at five-star-plastics.com www.five-star-plastics.com

...ities: ??? 64-bit files, 64-bit inums, 64-bit timestamps, 64-bit long ints, ??? socketpairs, hardlinks, symlinks, IPv6, atimes, batchfiles, inplace, ??? append, no ACLs, xattrs, optional protect-args, iconv, symtimes, prealloc Optimizations: ??? no SIMD, asm, openssl-crypto Checksum list: ??? xxh64 (xxhash) md5 md4 none Compress list: ??? zstd lz4 zlibx zlib none > > On 06/08/2020 16:40, Christopher Wensink wrote: >> Can anyone tell me the repository to use to upgrade to a version of >> rsync later than 3.1.2? >> >> Chris >> >