Displaying 16 results from an estimated 16 matches for "receive_sums".
Did you mean:
receive_smb
2018 May 11
4
[Bug 13433] New: out_of_memory in receive_sums on large files
https://bugzilla.samba.org/show_bug.cgi?id=13433
Bug ID: 13433
Summary: out_of_memory in receive_sums on large files
Product: rsync
Version: 3.1.3
Hardware: All
OS: All
Status: NEW
Severity: normal
Priority: P5
Component: core
Assignee: wayned at samba.org
Reporter: toasty at dragondata.com...
2015 Apr 09
3
rsync error: error allocating core memory buffers
Hi,
I've configured 'backuppc' to transfer files via rsyncd, with enabled
checksums. Whith one of the shares I get the error (in syslog):
---------------------------------------------------------------------
robbe rsyncd[2183]: ERROR: out of memory in receive_sums [sender]
robbe rsyncd[2183]: rsync error: error allocating core memory buffers
(code 22) at util2.c(106) [sender=3.1.2dev]
robbe rsyncd[9821]: connect from elefant.control.local (192.168.1.200)
robbe rsyncd[9821]: rsync on . from backuppc at elefant.control.local
(192.168.1.200)
-----------------...
2003 Oct 05
2
Possible security hole
Maybe security related mails should be sent elsewhere? I didn't notice
any so here it goes:
sender.c:receive_sums()
s->count = read_int(f);
..
s->sums = (struct sum_buf *)malloc(sizeof(s->sums[0])*s->count);
if (!s->sums) out_of_memory("receive_sums");
for (i=0; i < (int) s->count;i++) {
s->sums[i].sum1 = read_int(f);
read_buf(f,s->sums[i].sum2,csum_length);
..
I...
2013 Feb 28
1
rsync memory usage with block-size option
...akes a 52 GB file, even hitting it with 7z it only
gets down to 5G plus it makes it harder to script the process. Then I got
to fooling around with the -B option and found on a smaller test database
that when I get to -B1024 it make the smallest file so I tried that. I get
an Out of memory error in receive_sums so I back it off and when I get to
about -B5120 it is good but only makes the file 36GB. I was wondering is
there a hard limit, the machine has tons of free ram, the program used
1.1GB of RAM at -B5120,the version is 3.0.9-1 in cygwin on the sender via
an ssh connection.
One other thing I though...
2012 Mar 20
4
Batch mode creates huge diffs, bug(s)?
...ode) but I get a error and cannot proceed. I
have tried in both rsync v3.0.6 and v3.0.7 to specify the block size, but
the result is the same:
1. Command:
1. rsync --block-size=512 ?only-write-batch=img1toimg2_diff image2
image1
2. Error message:
1. ERROR: Out of memory in receive_sums [sender]
2. rsync error: error allocating core memory buffers (code 22) at
util.c(117) [sender=3.0.7]
I looked at the changelog and haven't seen any updates to util.c since
rsync v3.0.6 was released that might address this issue. So i think that I
might be seeing two bugs: 1) hug...
2015 Apr 09
0
rsync error: error allocating core memory buffers
...,
>
> I've configured 'backuppc' to transfer files via rsyncd, with
> enabled checksums. Whith one of the shares I get the error (in
> syslog):
> ---------------------------------------------------------------------
>
>
robbe rsyncd[2183]: ERROR: out of memory in receive_sums [sender]
> robbe rsyncd[2183]: rsync error: error allocating core memory
> buffers (code 22) at util2.c(106) [sender=3.1.2dev] robbe
> rsyncd[9821]: connect from elefant.control.local (192.168.1.200)
> robbe rsyncd[9821]: rsync on . from backuppc at elefant.control.local
> (192.168...
2008 Jun 04
0
3.0.3pre2 compile warnings under cygwin
...: warning: unsigned int format, uint32_t arg (arg 5)
rsync.c:460: warning: unsigned int format, uint32_t arg (arg 5)
receiver.c: In function `receive_data':
receiver.c:227: warning: int format, int32_t arg (arg 3)
receiver.c:252: warning: int format, int32_t arg (arg 3)
sender.c: In function `receive_sums':
sender.c:112: warning: int format, int32_t arg (arg 3)
sender.c:112: warning: int format, int32_t arg (arg 4)
sender.c:112: warning: unsigned int format, uint32_t arg (arg 6)
exclude.c: In function `parse_filter_file':
exclude.c:1053: warning: unsigned int format, uint32_t arg (arg 5)
m...
2017 Apr 05
0
Transfer hangs, both sides waiting on receive
...buf (buf=0x7ffe7c1aa380 "", len=4) at io.c:895
#3 0x00007f9a71e47643 in read_buf (f=<optimized out>, buf=buf at entry=0x7ffe7c1aa380 "", len=len at entry=4) at io.c:1840
#4 0x00007f9a71e47851 in read_int (f=<optimized out>) at io.c:1711
#5 0x00007f9a71e2f652 in receive_sums (f=<optimized out>) at sender.c:96
#6 send_files (f_in=4, f_out=1930300096) at sender.c:332
#7 0x00007f9a71e37f6c in do_server_sender (argv=<optimized out>, argc=<optimized out>, f_out=3, f_in=3) at main.c:840
#8 start_server (f_in=3, f_out=3, argc=2, argv=0x7f9a7302f240) at...
2001 Aug 06
1
merge rsync+ into rsync (was Re: rsync-2.4.7 NEWS file)
> Just curious: what about the rsync+ patch?
Thanks for the reminder.
I've just committed Jos's rsync+ patch onto the
"branch_mbp_rsyncplus_merge" branch. If it works OK and nobody
screams I will move it across onto the main tree tomorrow or
Wednesday.
I see the patch doesn't add documentation about the new options to the
man page, so we should fix that in the future.
2002 Mar 28
1
(no subject)
...s':
generator.c:191: warning: int format, different type arg (arg 3)
generator.c:191: warning: int format, different type arg (arg 4)
generator.c:191: warning: int format, different type arg (arg 5)
gcc -I. -I. -g -O2 -DHAVE_CONFIG_H -Wall -W -c sender.c -o sender.o
sender.c: In function `receive_sums':
sender.c:50: warning: int format, different type arg (arg 3)
sender.c:50: warning: int format, different type arg (arg 4)
sender.c:50: warning: int format, different type arg (arg 5)
gcc -I. -I. -g -O2 -DHAVE_CONFIG_H -Wall -W -c match.c -o match.o
match.c: In function `hash_search'...
2003 Mar 30
1
[RFC][patch] dynamic rolling block and sum sizes II
...te_version < 27)
+ {
+ sum->s2length = csum_length;
+ } else {
+ sum->s2length = read_int(f);
+ }
+ sum->remainder = read_int(f);
+}
+
/**
* Receive the checksums for a buffer
**/
@@ -49,14 +62,14 @@
s = (struct sum_struct *)malloc(sizeof(*s));
if (!s) out_of_memory("receive_sums");
- s->count = read_int(f);
- s->n = read_int(f);
- s->remainder = read_int(f);
+ read_sum_head(f, s);
+
s->sums = NULL;
if (verbose > 3)
rprintf(FINFO,"count=%ld n=%ld rem=%ld\n",
- (long) s->count, (long) s->n, (long) s->remainder);
+ (long...
2004 Jan 17
1
--delete-sent-files (AKA --move-files)
...dex: sender.c
--- sender.c 15 Jan 2004 08:56:33 -0000 1.34
+++ sender.c 17 Jan 2004 05:04:57 -0000
@@ -27,6 +27,7 @@ extern int dry_run;
extern int am_server;
extern int am_daemon;
extern int protocol_version;
+extern int delete_sent_files;
/**
@@ -104,7 +105,28 @@ static struct sum_struct *receive_sums(i
return s;
}
+static struct file_list *the_flist;
+void successful_send(int i)
+{
+ char fname[MAXPATHLEN];
+ struct file_struct *file;
+ int offset = 0;
+
+ if (!the_flist)
+ return;
+
+ file = the_flist->files[i];
+ if (!(file->flags & FLAG_SENT))
+ return; /* We didn't se...
2003 Mar 23
1
[RFC] dynamic checksum size
...te_version < 27)
+ {
+ sum->s2length = csum_length;
+ } else {
+ sum->s2length = read_int(f);
+ }
+ sum->remainder = read_int(f);
+}
+
/**
* Receive the checksums for a buffer
**/
@@ -49,14 +62,14 @@
s = (struct sum_struct *)malloc(sizeof(*s));
if (!s) out_of_memory("receive_sums");
- s->count = read_int(f);
- s->n = read_int(f);
- s->remainder = read_int(f);
+ read_sum_head(f, s);
+
s->sums = NULL;
if (verbose > 3)
rprintf(FINFO,"count=%ld n=%ld rem=%ld\n",
- (long) s->count, (long) s->n, (long) s->remainder);
+ (long...
2002 Nov 06
4
Rsync-2.5.5 on Tru64 UNIX V51.A
...int format, different type arg (arg 5)
gcc -I. -I. -g -O2 -DHAVE_CONFIG_H -Wall -W -I./popt -c receiver.c -o
receiver.o
gcc -I. -I. -g -O2 -DHAVE_CONFIG_H -Wall -W -I./popt -c cleanup.c -o
cleanup.o
gcc -I. -I. -g -O2 -DHAVE_CONFIG_H -Wall -W -I./popt -c sender.c -o sender.o
sender.c: In function `receive_sums':
sender.c:50: warning: int format, different type arg (arg 3)
sender.c:50: warning: int format, different type arg (arg 4)
sender.c:50: warning: int format, different type arg (arg 5)
gcc -I. -I. -g -O2 -DHAVE_CONFIG_H -Wall -W -I./popt -c exclude.c -o
exclude.o
exclude.c: In function `get_exc...
2002 Nov 15
0
building rsync on MacOSX 10.2.2
...warning: int format, size_t arg (arg 5)
gcc -I. -I. -g -O2 -DHAVE_CONFIG_H -Wall -W -I./popt -c receiver.c -o receiver.o
gcc -I. -I. -g -O2 -DHAVE_CONFIG_H -Wall -W -I./popt -c cleanup.c -o cleanup.o
gcc -I. -I. -g -O2 -DHAVE_CONFIG_H -Wall -W -I./popt -c sender.c -o sender.o
sender.c: In function `receive_sums':
sender.c:50: warning: int format, size_t arg (arg 3)
sender.c:50: warning: int format, size_t arg (arg 4)
sender.c:50: warning: int format, size_t arg (arg 5)
gcc -I. -I. -g -O2 -DHAVE_CONFIG_H -Wall -W -I./popt -c exclude.c -o exclude.o
gcc -I. -I. -g -O2 -DHAVE_CONFIG_H -Wall -W -I./popt -c...
2002 Aug 05
5
[patch] read-devices
...nt verbose;
extern int remote_version;
extern int csum_length;
extern struct stats stats;
extern int io_error;
extern int dry_run;
extern int am_server;
-
+extern int read_devices;
/*
receive the checksums for a buffer
*/
@@ -163,8 +164,9 @@
io_error = 1;
rprintf(FERROR,"receive_sums failed\n");
return;
}
+ rprintf(FINFO, "#ET#>send_files: got s, s->count=%.0f\n", (double)s->count);
if (write_batch)
write_batch_csum_info(&i,flist->count,s);
@@ -186,17 +188,38 @@
close(fd);
return;
}
+ if (read_devices...