search for: max_map_size

Attached is a patch that makes window strides constant when files are walked with a constant block size. In these cases, it completely avoids all memmoves. In my simple local test of rsyncing 57MB of 10 local files, memmoved bytes went from 18MB to zero. I haven't tested this for a big variety of file cases. I think that this will always reduce the memmoves involved with walking a large

Hi, On systems with HAVE_SETATTRLIST, commit b936741 breaks compilation. This is because do_setattrlist_times hasn't been converted to STRUCT_STAT *stp. Here's a small patch to do it. Cheers, Filipe PS: I've been playing with IO_BUFFER_SIZE, MAX_MAP_SIZE and WRITE_SIZE. Any plans to make it configurable at runtime? It seems to make a big difference for large files on a fast link (about 5x in my case) -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.samba.org/pipermail/rsync/attachments/20200425/724210...

https://bugzilla.samba.org/show_bug.cgi?id=1463 ------- Additional Comments From wayned@samba.org 2004-06-18 14:45 ------- Created an attachment (id=543) --> (https://bugzilla.samba.org/attachment.cgi?id=543&action=view) Suggested patch from Craig Barratt Wallace Matthews confirmed that this alleviates the poor performance. Just need to confirm that the window isn't getting too

In looking at source, I started at fileio and found write routines but no read routines. I found a 'WRITE_SIZE' (32K), but no 'READ_SIZE' -- is that' what the MAX_MAP_SIZE (256K)? I would like to make so that rsync can use larger I/O sizes if (maybe a command line option?).... The map routine led me to receiver -- where it looks like it is responsible for reading the file. A comment says: "Receiver process runs on the same host as the generator process."...

...file changed, 10 insertions(+), 10 deletions(-) diff --git a/checksum.c b/checksum.c index 2e804c47..4aa9f4b7 100644 --- a/checksum.c +++ b/checksum.c @@ -294,7 +294,7 @@ void file_checksum(const char *fname, const STRUCT_STAT *st_p, char *sum) if (fd == -1) return; - buf = map_file(fd, len, MAX_MAP_SIZE, CSUM_CHUNK); + buf = map_file(fd, len, MAX_MAP_SIZE, CHUNK_SIZE); switch (checksum_type) { case CSUM_MD5: { @@ -302,8 +302,8 @@ void file_checksum(const char *fname, const STRUCT_STAT *st_p, char *sum) MD5_Init(&m5); - for (i = 0; i + CSUM_CHUNK <= len; i += CSUM_CHUNK) - MD5_Upda...

.../rsync/fileio.c,v retrieving revision 1.5 diff -r1.5 fileio.c 79c79,107 < return write(f,buf,len); --- > static char *writeBuf; > static size_t writeBufSize; > static size_t writeBufCnt; > > if ( !writeBuf ) { > writeBufSize = MAX_MAP_SIZE; > writeBufCnt = 0; > writeBuf = (char*)malloc(MAX_MAP_SIZE); > if (!writeBuf) out_of_memory("write_file"); > } > ret = len; > do { > if ( buf && writeBufCnt < writeBufSize ) { >...

...io.c Fri Jan 25 15:07:34 2002 +++ rsync-craig/fileio.c Sat Dec 7 22:21:10 2002 @@ -76,7 +76,35 @@ int ret = 0; if (!sparse_files) { - return write(f,buf,len); + static char *writeBuf; + static size_t writeBufSize; + static size_t writeBufCnt; + + if ( !writeBuf ) { + writeBufSize = MAX_MAP_SIZE; + writeBufCnt = 0; + writeBuf = (char*)malloc(MAX_MAP_SIZE); + if (!writeBuf) out_of_memory("write_file"); + } + ret = len; + do { + if ( buf && writeBufCnt < writeBufSize ) { + size_t copyLen = len; + if ( copyLen > writeBufSize - writeBufCnt )...

Hi all, I am having a problem while sycing file. An error is given as follows: "io timeout after 55 second - exiting". I have found this problem being posted in the mailing list previously. But after reading those mails, i understood that this problem occured only for files greater than 100M file size. But the file am trying to sync is of just 2MB. Let

https://bugzilla.samba.org/show_bug.cgi?id=8512 Summary: rsync -a slower than cp -a Product: rsync Version: 3.1.0 Platform: All OS/Version: All Status: NEW Severity: normal Priority: P5 Component: core AssignedTo: wayned at samba.org ReportedBy: linux.news at bucksch.org QAContact:

...); + if (!ret) + openssl_failure(__func__); + mdlib_free_ctx(mdctx); +} + void file_checksum(const char *fname, const STRUCT_STAT *st_p, char *sum) { struct map_struct *buf; @@ -207,19 +277,9 @@ void file_checksum(const char *fname, const STRUCT_STAT *st_p, char *sum) buf = map_file(fd, len, MAX_MAP_SIZE, CSUM_CHUNK); switch (checksum_type) { + case CSUM_SHA1: case CSUM_MD5: - md5_begin(&m); - - for (i = 0; i + CSUM_CHUNK <= len; i += CSUM_CHUNK) { - md5_update(&m, (uchar *)map_ptr(buf, i, CSUM_CHUNK), - CSUM_CHUNK); - } - - remainder = (int32)(len - i); - if (rema...

...to determine size", fname); + else { + st.st_size = off; + off = lseek(fd, 0, SEEK_SET); + if (off != 0) + rsyserr(FERROR, errno, "failed to seek back to beginning of %s to read it", fname); + } + } + if (st.st_size) { int32 read_size = MAX(s->blength * 3, MAX_MAP_SIZE); mbuf = map_file(fd, st.st_size, read_size, s->blength);