similar to: Question about --partial-dir and aborted transfers of large files

Hi all, rsync is a fantastic tool. :-) I'm blown away with what I've seen so far. I have a question about --partial-dir transfers. I've read through this thread: http://lists.samba.org/archive/rsync/2011-July/026575.html ...but while similar, I don't think it's quite the same, and I didn't find my answer there. The short(ish) version: 1. Am I correct in inferring that

Yes, I've read the FAQ, just hoping for a boon... I'm in the process of relocating a large amount of data from one nfs server to another (Network Appliance filers). The process I've been using is to nfs mount both source and destination to a server (solaris8) and simply use rsync -a /source/ /dest . It works great except for the few that have > 10 million files. On these I get

OK, I know a lot about unix environments and am very familiar with rsync (and a big fan). My MS windows knowledge is at "I play a doctor on TV" stage. Hmm. OK, the analogy needs work. I know what the words mean and can stumble my way through many common problems. And now I'm trying to use rsync (2.6.3) from the most recent cygwin distribution. It works fine, except that

David, I've used rsync to transfer multiple terabytes when replacing or consolidating storage. The practical limit is not the overall size, but there are a couple that will crop up: 1. This is alluded to in the FAQ, but the relationship between amount of memory on the hosts and the number of files per sync is important. Rsync will use ~100 bytes per file on both the source and

Hi all, (Just because the last reminder is getting buried in spam...) ==> DON''T POST TO THIS GROUP!! <== This group is closing as discussed[1][2]. The archives will remain online. Use the replacement group instead: http://groups.google.com/group/prototype-scriptaculous prototype-scriptaculous-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org If you''re continuing an

So, my use case is : 1. lot of connections over dial-up lines 2. need to transfer safely A SINGLE BZIPPED FILE to the server 3. if dial-up line fails, it's automatically restarted after 5 minutes and transfer start again I heard about the --partial option in order to keep the partial transferred file. I thought that rsync will apply his incremental check and update alghoritm on that

Hi, I'm not sure if this is a bug, but after reading the manual, this does not seem like expected behavior. I'm using the following rsync command to approximate an atomic update (I can't use --link-dest as hard links in hfsplus filesystems are fubar under linux as of 2.6.27): rsync -a --delete-excluded --backup --backup-dir=../bar.archive --backup-suffix=.2008-12-15-0115

The detect-renamed patch is an amazing patch with one problem: It doesn't work when a file is moved to a directory that doesn't exist on the receiving end. In this case it reverts to transferring the entire file. This problem is easily solved by a simple change to the detect-renamed.diff patch in this ticket: https://bugzilla.samba.org/show_bug.cgi?id=8847 Any chance this improvement

http://bugzilla.mindrot.org/show_bug.cgi?id=1360 Summary: Connection aborted on large data -R transfer Product: Portable OpenSSH Version: 4.7p1 Platform: Other OS/Version: Linux Status: NEW Severity: major Priority: P2 Component: ssh AssignedTo: bitbucket at mindrot.org ReportedBy: t8m at

https://bugzilla.samba.org/show_bug.cgi?id=5654 Summary: Combination of --remove-sent-files, --partial, -- partial-dir, --tmp-dir and --delay-updates can cause data loss Product: rsync Version: 3.0.3 Platform: x64 OS/Version: Linux Status: NEW Severity: normal Priority: P3

Does anyone have advice on how to instruct R CMD check to use a non-standard set of libraries? Here's the situation: I'm trying to do some automated checking on package dependencies of a package I maintain. In order to do that I've written code that takes the list of the dependent packages and for each package (1) downloads the most recent/available .tar.gz file; (2) installs the

Hi, I need to use rsync with options inplace and no-whole-file, but have problems with transfers of large files being frequently interrupted. partial-dir could be the solution, but it does not work with inplace-updating of destination files. I am thinking of doing the sync in two steps: 1) sync with --partial-dir and --backup-dir to send updated files to a different directory at the

When --partial-dir is used rsync creates new or updated files inside a temporary dir. For example the new version of some/path/file is created in some/path/<partial-dir-name>/file and later moved. What happens if a new directory is created? If some/path/newdir/newfile is to be copied, is it done in some/path/<partial-dir-name>/newdir/<partial-dir-name>/newfile? Or is newdir

If the --partial-dir is specified and cannot be created, the handle_partial_dir() function silently fails. Because we depend on this feature in our platform, it would be nice to get a warning.

Here's a running instance caught by ps (lines broken for readibility): rsync --perms --times --timeout=3600 --stats --no-motd -hh --force --hard-links -ii --links --partial-dir=.~tmp~ --recursive --exclude <some excludes> --out-format=<format> --delete-during --max-delete=75000 --ignore-errors source dest During download files are being created at path/.filename.random-string

Hi, I frequently rsync larger files from my rented server to my PC. Sometimes I have to stop the rsync process and restart it a while after (e.g. I'm shutting down my PC for the night, ...), sometimes several times per source file. I like the two following features: (1) The unfinished files should stay in a own directory (I call it '.dl'). I'm talking here about the 'temp'

Hello there, recently stumbled over a problem syncing subdirectory structures in combination with partial-dir. Files are saved within partial-dir, but without the subdirectory path they came from, so having the same file names within different subdirectories causes them to be overwritten (and/or lost, of course). Currently I'm using rsync 3.0.9 protocol version 30 in Linux

https://bugzilla.samba.org/show_bug.cgi?id=5977 Summary: --delay-updates --partial-dir Product: rsync Version: 3.0.4 Platform: x86 OS/Version: Windows XP Status: NEW Severity: normal Priority: P3 Component: core AssignedTo: wayned@samba.org ReportedBy: gb43254@vip.sina.com

https://bugzilla.samba.org/show_bug.cgi?id=9813 Summary: --resume parameter to improve speed of dropped/partial transfers Product: rsync Version: 3.1.0 Platform: All OS/Version: All Status: NEW Severity: enhancement Priority: P5 Component: core AssignedTo: wayned at samba.org

https://bugzilla.samba.org/show_bug.cgi?id=9670 Summary: missing substructure within partial-dir causes files to be lost or overwritten Product: rsync Version: 3.0.9 Platform: All OS/Version: All Status: NEW Severity: major Priority: P5 Component: core AssignedTo: wayned at