similar to: Transferring large files using rsync

rsync is optimized to conserve network resources, sometimes at the expense of CPU resources. As long as CPU's are fast and networks are slow, rsync with compression does a great job. However, if I run rsync on a slow box (166MHz Ultra SPARC) over a fast network (100Mb/s), the compression kills the transfer rate. I turned compression off and I should be done rsyncing my files (60GB)

With the increased number of "brute force" login attempts against port 22, I am concerned that an intruder may actually stumble accross a valid user/pass combination. To combat this, I would like to request an sshd_config option that would cause the running sshd parent process to keep track of login failures by IP address. If there are more than X number of login failures for a

Yes, I've read the FAQ, just hoping for a boon... I'm in the process of relocating a large amount of data from one nfs server to another (Network Appliance filers). The process I've been using is to nfs mount both source and destination to a server (solaris8) and simply use rsync -a /source/ /dest . It works great except for the few that have > 10 million files. On these I get

Hi, I have a project where I have to backup (copy /dev/hda on a server) and recover (copy back) hardrives from the clients. I tried this with rsync using: BACKUP: rsync /dev/hda user@host:/path/to/image RECOVER: rsync user@host:/path/to/image /dev/hda There is a problem when accessing devices like /dev/hda. The transfer aborts after a few seconds with the error message: write failed on

Hi, I'm mirroring a single server to multiple clients. Currently I'm using scp, but I (think I) want to use rsync. The files I'm mirroring are large - c.4GB (video data) Each client has a different set of these files. The transfer is done over the internet, and may fail (regularly!). I set up a separate directory for each client, and put in symlinks to the actual files (maximum

Hi, What are the limits to file size and file count when doing a rsync transfer using 2.5.6? I was trying to rsync about 500 GB of data with many files and many directories, but it has been stuck building the file list for several hours. First of all, is it possible to transfer 500 GB of data? Secondly, what would the limit for file count be when doing a rsync transfer? Any comments or help

Hi, I tried performing a complete copy of 17GB of filesystems over the WAN (0.8GB/hr) with the speed of 16Mbps. The filesystem consists of several large g-zipped files. These large g-zipped files have actually been zipped out of other sub-filesystems and directories. I noticed that while transferring a lists of large g-zipped files, rsync tends to take a much longer time to transfer those files

I am using AIX 4.3.3 and 5.1, rsync version 2.5.5 protocol version 26 when rsyncing files that are larger than 2gb it dies. You get message about broken something. root limits is -1 filesystems are large file enabled. I tested this with linux to linux and it does not have this problem. any reason why it does not work in AIX? __________________________________ Do you Yahoo!? Yahoo!

During my initial download for my home directory backup, it took rsync over 6 hours to do the initial backup, but I can FTP the stuff in about 30 Mins. Is Rsync usualy this slow? I have compression turned on, and its across a 100 MB/S network, Anyone had this problem before? Steve Sills

--- exclude.c.org 2002-11-04 04:17:05.000000000 +0100 +++ exclude.c 2002-11-04 04:21:13.000000000 +0100 @@ -219,8 +219,15 @@ int fatal, int include) { struct exclude_struct **list=list1; - FILE *f = fopen(fname,"r"); + FILE *f; char line[MAXPATHLEN]; + + if( fname[0]=='-' &&

Hi all, I want to copy files from a remote server to a local directory with ssh. I've some difficulties with that because on the Remoteserver I have a directory "/www/ftp" with a lot of subdirectories with each of them 4 other subdirectories. I want to sync only */data/* to the local machine without */images/* or */doc/* or */movies/* Any solution would be appreciated. regardsMac

Howdy, I am just starting to use rsync and now have an rsync server set up to back up our various machines. I recently started getting an error that is confusing and I can't find info documented on it. I searched the news group and found it mentioned but no solution yet. I get the error when sync'ing from a Solaris 8 machine to my Solaris 8 server. stat

Dear JW, I spent hours checking and upgrading my hardware. There is nothing wrong with it. It is a 'mature' Pentium-II 400MHz system that has been running my servers WITHOUT ANY CRASHES for nearly 2 years now 24/7 Listen to me: "The crashes are dues to rsync" There is an IDENTICAL report from a totally different source at

I've got a patch that changes f_name_to() to return an unsigned int (like snprintf() and strlcpy() do) and adds checking to ensure that we didn't overflow the name before we try to use it: http://www.blorf.net/name-overflow.patch If anyone would care to check out the following patch before I commit it, please do. ..wayne..

Hello, rsync.h is always including the syslog.h file, even though it is only used when the LOG_DAEMON macro is defined. Could someone change it to be as follows: #ifdef LOG_DAEMON #include <syslog.h> #endif OpenVMS currently does not have a syslog facility, so it does not have a syslog.h. Thank you, -John wb8tyw@qsl.net Personal Opinion Only

Hi, I would like to log whatever happens with rsync on client side when it runs with Cygwin on NT4. First, I just did a redirect of the screen output to a log-file: rsync -rtv --delete --modify-window=2 --stats /cygdrive/g/users/bco/test/ bee2bs01::d/test/ >>c:\rsync\log\%FDATE%.log The problem with this method is that it does not redirect whatever Rsync reports as errors; because they

Hi, In http://sources.redhat.com/ml/cygwin/2002-09/msg01155.html, I noted that the often-observed hangs of rsync under Cygwin were assuaged by a call to msleep(). After upgrading my Cygwin environment to rsync 2.5.6, I'm seeing these hangs again, not surprisingly given a CVS entry for main.c notes that this kludge was not harmless: Revision 1.162 / (download) - annotate - [select for

Hi, I have 2 ftp servers with 3 identical users. I want server B to be updated of server A. Whatever changes mmade by users on server A should be made on server B say every 5 hours. Is rsync the right tool to use here? Can rsync be used such that only changed files are downloaded? Thanks a lot and bye. With warm regards, -Payal -- For GNU/Linux Success Stories and Articles visit:

I was saddened to learn today that JW Schultz was found dead back on March 27th of this year. JW was a big help in the recent development of rsync and I sorely missed his presence during the last release cycle. JW was also the author of the Dirvish backup software, and Keith Lofstrom (who provided me with the sad news) has plans to put some memorial information onto the new dirvish site as

All, I just had a power failure that caused me a little drama. This spurred me into trying to get NUT up on my cyberpower 1500 again. For about 6 months I tried to get it to work with the new power panel drive with no luck. Today I removed all the old files for NUT and installed the newest version I could find (2.4.3) and it works perfectly now with my UPS. Hopefully now I