similar to: Has anyone experience with rsync out of memory

Displaying 20 results from an estimated 1000 matches similar to: "Has anyone experience with rsync out of memory"

2007 Aug 27
3
rsync out of memory at 8 MB although ulimit is 512MB
Hello again, I encountered something amazing. First I thought there is not enough memory allowed through ulimit. ulimit is now set to (almost) 512MB but rsync still gets out fo memory at 8MB. Can anyone tell me why? That's my configuration: rsync version 2.6.2 from AIX 5.3 to SuSE Linux 9 (also has rsync 2.6.2) ulimit -a (AIX) ulimit -a AIX (source): -------------------------
2003 Nov 08
2
malloc errors? out of memory with many files on HP-UX
Hi, folks. I've started getting these errors from rsync, and any help would be appreciated: >ERROR: out of memory in string_area_new buffer >rsync error: error allocating core memory buffers (code 22) at util.c(115) >ERROR: out of memory in string_area_new buffer >rsync error: error allocating core memory buffers (code 22) at util.c(115) >ERROR: out of memory in
2011 Jun 17
1
rsync out of memory in flist_expand
Hi, I have been using rsync for years to perform my backups, but since a few days it crashes with an "out of memory" error. I am running Ubuntu 11.04/x86_64, which ships rsync-3.0.8, and I have also tried with the git version. I can see the following messages: [generator] expand file_list pointer array to 524288 bytes, did move [generator] expand file_list pointer array to 1048576
2005 Jun 29
1
Again, the error in rsync prototocol
Hello list, I am doing something really simple. It worked twice and now fails for an unknown reason. I am on MacOSX (Tiger) and I am simply making a backup of a volume on an external Firewire drive. Here is the command I am using (which went fine for the first 2 rsyncs). I tried to stop some processes, I looked into the drives directory tree but nothing seemed bad. Any idea?
2008 Aug 19
1
rsync hangs after aborting a process
Greetings. In testing an rsync backup script I'd created, I made a mistake and aborted the running script with a ctrl-C keyboard interrupt. The command that was running at the time was as follows: ${RSYNC_CMD} -aNHAXx --protect-args --fileflags --force-change --rsync-path="/usr/local/bin/rsync" <username>@<my.server.com>:${CPY_SRC} ${CPY_DEST} The expected data
2009 Aug 20
1
Creating a list of combinations
Dear R Users, I have 120 objects stored in R's memory and I want to pass the names of these many objects to be held as just one single object. The naming convention is month, year in sequence for all months between January 1986 to December 1995 (e.g. Jan86, Feb86, Mar86... through to Dec95). I hope to pass all these names (and their data I guess) to an object called file_list, however,
2004 Feb 06
4
memory reduction
As those of you who watch CVS will be aware Wayne has been making progress in reducing memory requirements of rsync. Much of what he has done has been the product of discussions between he and myself that started a month ago with John Van Essen. Most recently Wayne has changed how the file_struct and its associated data are allocated, eliminating the string areas. Most of these changes have been
2003 Jul 24
0
(no subject)
Here is a diff which should allow applying batch updates remotely ( as apposed to copying the batch files to the remote server and running rsync there ). Eg rsync --write-batch=test src dst1::dst rsync --read-batch=test dst2::dst Oli Dewdney diff -E -B -c -r rsync-2.5.6/flist.c rsync-2.5.6-remotebatch/flist.c *** rsync-2.5.6/flist.c Sat Jan 18 18:00:23 2003 ---
2006 Apr 08
0
[WIP] rebuild initramfs when content changes
hpa notified me in private mail that we have an issue that when building initramfs - if the content changes (say kinit) then the initramfs will not be rebuild. The solution I have come up with is to let make check all the files included in the initramfs and rebuild it if any files are newer than the initramfs and also rebuild if arguments changes (root_uid). In same process the usr/Kbuild file
2009 Aug 20
0
Using 'unlist' (incorrectly?!) to collate a series of objects
Dear R Users, I am attempting to write a new netCDF file (using the ncdf) package, using 120 grids I've created and which are held in R's memory. I am reaching the point where I try to put the data into the newly created file, but receive the following error: > put.var.ncdf(evap_file, evap_dims, unlist(noquote(file_list))) Error in put.var.ncdf(evap_file, evap_dims,
2003 Jun 20
0
(code 12) at io.c(177) error
We are using rsync to backup files from a bunch of computers to a central server using rsync in --daemon mode. I've got a problem and are looking for suggestions. I'm not a newbie to rsync and have checked the archives without getting any useable conclusions. Our old server works great - a redhat 7.2 / 2.4.18 machine. But it's getting full and there's no more updates for
2009 Feb 16
2
rsync 3.0.5 - ERROR: buffer overflow in recv_file_entry [generator]
Hi, Rsync 3.0.5 on both sides. receiver is Open Solaris and sender is Linux. I got a nested directory - relatively depth but still it should work. It fails instead. sending daemon args: --server --sender -vvlWHogDtpre.is --ignore-errors --numeric-ids --inplace . TEST/ receiving incremental file list delta-transmission disabled for local transfer or --whole-file [...] overflow: xflags=0x7a
2004 Mar 10
4
HFS+ resource forks: WIP patch included
As you all know, rsync doesn't have any special handling for Mac OS X HFS+ resource forks. Kevin Boyd made RsyncX and rsync_hfs, to address this gap, but they only work when the destination filesystem is also HFS+. I haven't been able to find any references to an rsync that is capable of syncing from HFS+ to UFS (etc). The only solutions I've seen involve lots of preprocessing
2007 May 03
3
[PATCH] pygrub: look harder for elilo.conf
Keir, This would also be appropriate for 3.1.0, since the /usr/lib fix makes pygrub work on ia64 Presently pygrub only looks in /efi/redhat/elilo.conf. It should check for other distributions, plus a couple fallback locations. Signed-off-by: Aron Griffis <aron@hp.com> diff -r 6d64f9eefad5 -r 67df28389f46 tools/pygrub/src/pygrub --- a/tools/pygrub/src/pygrub Wed May 02 14:50:56 2007
2005 Mar 21
1
exclude problem
I have looked on the mailing lists and through rsync documentation but those still haven't solved my problem. I may be calling rsync incorrectly but the problem I have is that the exclude file seems to be ignored. My final goal is to replicate an entire host, excluding some files that contain specific IP, hostname configuration things. I'm trying to start small by mirroring a
2001 Nov 20
2
patch to enable faster mirroring of large filesystems
I have attached a patch that adds 4 options to rsync that have helped me to speed up my mirroring. I hope this is useful to someone else, but I fear that my relative inexperience with rsync has caused me to miss a way to do what I want without having to patch the code. So please let me know if I'm all wet. Here's my story: I have a large filesystem (around 20 gigabytes of data) that
2004 Jul 11
0
[PATCH] [TRIVIAL] whitespace + variable rename
The attached patch adds some whitespace to the recv_files() function declaration, and renames variable 'f' to 'f_out' in generate_files(). -------------- next part -------------- Index: generator.c =================================================================== RCS file: /cvsroot/rsync/generator.c,v retrieving revision 1.93 diff -b -c -r1.93 generator.c *** generator.c 30 Jun
2005 Jun 12
0
[Bug 2791] New: a long exclude-from list is not parsed correctly
https://bugzilla.samba.org/show_bug.cgi?id=2791 Summary: a long exclude-from list is not parsed correctly Product: rsync Version: 2.6.5 Platform: All OS/Version: OpenBSD Status: NEW Severity: normal Priority: P3 Component: core AssignedTo: wayned@samba.org ReportedBy: kaiowas@gentoo.org
2004 Jan 29
1
different behavior for --backup-dir relative/path vs --backup-dir /full/path
Why does using --delete -b --backup-dir relative/path puts the deleted files in the target folder, while using the full path works as expected? my experimentation... root@feral:/tmp/test (0)>uname -a Linux feral 2.4.22-1.2115.nptlsmp #1 SMP Wed Oct 29 15:30:09 EST 2003 i686 i686 i386 GNU/Linux root@feral:/tmp/test (0)>rsync --version rsync version 2.5.6 protocol version 26
2003 Jan 14
4
specifying a list of files to transfer
Hi, I don't want to start another --files-from war, but I am attaching an updated version of my patch to allow you to specify a list of files to transfer. The normal rsync syntax allows you to specify a list of SRC files to transfer on the command line. This patch adds some new options to allow you to instead supply a file that contains a list of files to transfer. The previous version of