search for: generate_and_send_sums

...ion| |FIXED ------- Additional Comments From wayned@samba.org 2004-07-14 09:55 ------- Your bug report made the problem easy to find. I've checked in a fix to CVS, but you can fix your current source by changing the "size_t" to "OFF_T" in the generate_and_send_sums() function in generator.c. It should look like this: static void generate_and_send_sums(struct map_struct *buf, OFF_T len, int f_out) Then, recompile, install, and the problem should be gone. -- Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email ------- You are receiving thi...

...tch; + extern int read_batch; extern int list_only; extern int only_existing; extern int orig_umask; *************** *** 124,132 **** /* * set (initialize) the size entries in the per-file sum_struct ! * calulating dynamic block ans checksum sizes. * ! * This is only called from generate_and_send_sums() but is a seperate * function to encapsulate the logic. * * The block size is a rounded square root of file length. --- 125,133 ---- /* * set (initialize) the size entries in the per-file sum_struct ! * calculating dynamic block and checksum sizes. * ! * This is only called...

...have no checksums - */ + */ void write_sum_head(int f, struct sum_struct *sum) { @@ -133,7 +117,87 @@ write_int(f, sum->remainder); } +/* + * set (initialize) the size entries in the per-file sum_struct + * calulating dynamic block ans checksum sizes. + * + * This is only called from generate_and_send_sums() but is a seperate + * function to encapsulate the logic. + * + * The block size is a rounded square root of file length. + * + * The checksum size is determined according to: + * blocksum_bits = BLOCKSUM_EXP + 2*log2(file_len) - log2(block_len) + * provided by Donovan Baarda which gives a pro...

Hi, I was trying to synchronize data sitting on our Sun Solaris 8 server with data size of about 800 GB to a remote Linux server in our LAN. Either the rsync process hangs for ever else I get "core dump" after about 15 minutes of time on the source host (solaris 8 server). I used rsync 2.6.2 using the basic command options as shown below # rsync -avz -e rsh <source folder

...0); - } + /* we don't have checksums */ + write_int(f_out, 0); + write_int(f_out, block_size); + write_int(f_out, 0); } @@ -162,57 +146,43 @@ generate approximately one checksum every n bytes */ -static struct sum_struct *generate_sums(struct map_struct *buf,OFF_T len,int n) +void generate_and_send_sums(struct map_struct *buf,OFF_T len,int block_len, int f_out) { - int i; - struct sum_struct *s; - int count; - int block_len = n; - int remainder = (len%block_len); + size_t i; + struct sum_struct sum; OFF_T offset = 0; - count = (len+(block_len-1))/block_len; - - s = (struct sum_struct *)malloc...

...ret & ~15; /* multiple of 16 */ - if (ret < bsize) ret = bsize; - if (ret > CHUNK_SIZE/2) ret = CHUNK_SIZE/2; - return ret; -} - /* * NULL sum_struct means we have no checksums @@ -156,24 +141,50 @@ * * Generate approximately one checksum every block_len bytes. */ -static void generate_and_send_sums(struct map_struct *buf, OFF_T len, - int block_len, int f_out) +static void generate_and_send_sums(struct map_struct *buf, OFF_T len, int f_out) { + extern int block_size; + int block_len; size_t i; struct sum_struct sum; OFF_T offset = 0; + /* adapt block size if not fixed */ + if (...

https://bugzilla.samba.org/show_bug.cgi?id=12527 Bug ID: 12527 Summary: Sender waits for timeout when fuzzy basis file found Product: rsync Version: 3.1.2 Hardware: All OS: All Status: NEW Severity: critical Priority: P5 Component: core Assignee: wayned at samba.org

Maybe security related mails should be sent elsewhere? I didn't notice any so here it goes: sender.c:receive_sums() s->count = read_int(f); .. s->sums = (struct sum_buf *)malloc(sizeof(s->sums[0])*s->count); if (!s->sums) out_of_memory("receive_sums"); for (i=0; i < (int) s->count;i++) { s->sums[i].sum1 = read_int(f);

...one file which is now greater than 2Gb it goes into an infinite loop in generator.c:sum_sizes_sqroot The code at fault seems to be: for (l = len; l >>= 1; b += 2) {} Here's the stack: #0 0x00402ae3 in sum_sizes_sqroot (sum=0x8bf530, len=-2073107852) at generator.c:455 #1 0x00402c56 in generate_and_send_sums (fd=5, len=-2073107852, f_out=4, f_copy=-1) at generator.c:490 #2 0x00405035 in recv_generator (fname=0x8bfc40 "gf_profile_file.MYD", file=0x1788f8, ndx=517, itemizing=1, maybe_ATTRS_REPORT=1, code=FLOG, f_out=4) at generator.c:1338 #3 0x00405400 in generate_files (f_out=4, flist=0x144...

...one file which is now greater than 2Gb it goes into an infinite loop in generator.c:sum_sizes_sqroot The code at fault seems to be: for (l = len; l >>= 1; b += 2) {} Here's the stack: #0 0x00402ae3 in sum_sizes_sqroot (sum=0x8bf530, len=-2073107852) at generator.c:455 #1 0x00402c56 in generate_and_send_sums (fd=5, len=-2073107852, f_out=4, f_copy=-1) at generator.c:490 #2 0x00405035 in recv_generator (fname=0x8bfc40 "gf_profile_file.MYD", file=0x1788f8, ndx=517, itemizing=1, maybe_ATTRS_REPORT=1, code=FLOG, f_out=4) at generator.c:1338 #3 0x00405400 in generate_files (f_out=4, flist=0x144...

https://bugzilla.samba.org/show_bug.cgi?id=5324 Summary: with option --xattrs the process rsync is more long time Product: rsync Version: 3.0.0 Platform: x86 OS/Version: Other Status: NEW Severity: normal Priority: P3 Component: core AssignedTo: wayned@samba.org ReportedBy: fauthier@free.fr

Attached is a patch that makes window strides constant when files are walked with a constant block size. In these cases, it completely avoids all memmoves. In my simple local test of rsyncing 57MB of 10 local files, memmoved bytes went from 18MB to zero. I haven't tested this for a big variety of file cases. I think that this will always reduce the memmoves involved with walking a large

I've added the: /etc/services /etc/inetd entries as well as /etc/rsync.conf with the contents: [io] path = //Volumes/Mac_OS_X/Library/WebServer/iolanguage.com/Io comment = iolanguage source code But I get this error: % rsync -rvR --progress localhost:/ . localhost.dekorte.com: Connection refused rsync: connection unexpectedly closed (0 bytes read so far) rsync error:

...ame: %s -> %s\n", src, dest); + + } +} diff -rupNP rsync-2.6.2/generator.c rsync-2.6.2-fnameconv.clean/generator.c --- rsync-2.6.2/generator.c 2004-04-15 19:55:23.000000000 +0300 +++ rsync-2.6.2-fnameconv.clean/generator.c 2004-05-29 21:17:09.000000000 +0300 @@ -264,6 +264,12 @@ static void generate_and_send_sums(struc * * @note This comment was added later by mbp who was trying to work it * out. It might be wrong. + * + * TODO: The filename seen in recv_generator is after filename + * conversion. In verbose mode, directories, symlinks and device + * files are printf()ed here but regular files are r...

Hello, I'm running HP-UX 11i on an rp74xx. It's 64-bit. C compiler is as follows: B3901BA B.11.11.03 HP C/ANSI C Developer's Bundle for HP-UX 11.i (S800) B3913DB C.03.30.02 HP aC++ Compiler (S800) /usr/bin/cc: LINT B.11.11.02 CXREF B.11.11.02 HP92453-01 B.11.11.02 HP C Compiler $ Sep 8 2000 23:13:51 $ I have successfully compiled rsync 2.6.2 and it