similar to: rsync with multiple threads for transferring huge file

Hi, I tried performing a complete copy of 17GB of filesystems over the WAN (0.8GB/hr) with the speed of 16Mbps. The filesystem consists of several large g-zipped files. These large g-zipped files have actually been zipped out of other sub-filesystems and directories. I noticed that while transferring a lists of large g-zipped files, rsync tends to take a much longer time to transfer those files

HI, I'm trying to have files to be included during rsync. I have the filesystem /stor/circuit_design/, with the following subdirectories as its contents: clock_speed fub_layout test_simulations pattern_flow I would only like to rsync the following 2 subdirectories to the destination machine: clock_speed fub_layout and they're contained in the file called files_included: # cat

Hi, I'm transferring a huge gzip file approximately 6GB over the WAN. I was wondering if there is a way which I can initiate a multi-threaded(multi-connection) rsync for transferring one gzip file? Could someone kindly show me how it should be done? Thanks.

Hi, I'm transferring a huge gzip file approximately 6GB over the WAN. I was wondering if there is a way which I can initiate a multi-threaded(multi-connection) rsync for transferring one gzip file? Could someone kindly show me how it should be done? Thanks.

HI, I had read from the rsync man page on transferring files using the user's numeric id and gid. I have a user which resides on 2 remote sites, having the same user names, but different uid and gid on both sites. I'm transferring the files as a root user. site A site B ----------------------------------------------- usr_A usr_A uid = 100 uid = 200 file1(usr_A)

Hi, Is there a way in which rsync's -z compression (zlib) utility can be benchmarked? I'm trying to compare the compression ratio between rsync and external compression tools like gzip and bzip2. Are there any advantages to using rsync's internal compression mechanism specified with the -z option compared to solely applying external compression i.e. bzip2 to the files and invoking

Hi, I'm transferring a huge gzip file approximately 6GB over the WAN. I was wondering if there is a way which I can initiate a multi-threaded(multi-connection) rsync for transferring one gzip file? Could someone kindly show me how it should be done? Thanks.

You're obviously not the first to need this. That's why the '--bwlimit=' option was added. Set it to however many Kbps you want rsync to use. I usually use 768 going over our wan, to spare some bandwidth on the T1, and maybe 10000 over the lan (in my case, all the dasd is nfs). I suspect that it may affect local-to-local transfers as well, but haven't tested it, but

The "-a" option (the "--links", "--perms", "--devices", and "--times" options are redundant, as they, as well as "--owner", "--group", and "--recursive" are implied by "-a" )does dictate that permissions on files being sent be brought over from the source. Are all files losing permissions, or only files

HI, I'm currently using rsync version 2.4.4 protocol version 24 on a HP11.0, Solaris 8 and Redhat 7.1 platforms. In my earlier posting, I asked about the problem on "Value too large to be stored in data type" when transferring files which are >= 2GB in size., i.e. building file list ... global/FCSI/WP_RLS05/rundir/wp_celtic_max_fullwarn.tcl.log: Value too large to be stored in

First, an item to fix: the substitution of "-P" for "-p". All good operating systems are case-sensitive, and many utilities, ssh included, are case sensitive about their options. "-P" is passed along with the "-p" to signal that the next parameter is the passphrase, to enable passphrase setting directly in the commandline. If that's wrong,

HI, I'm trying to exclude some files & directories from a filesystem which I would like to copy to a different site. I did: # rsync -avz --exclude-file=/fs21/tmp/perl_scripts/exclude.txt /fs22/a/circuit_design mickey.willow.com:/cpu/store/design where file /fs21/tmp/perl_scripts/exclude.txt contains the following directories and files to be excluded from /fs22/a/circuit_design :

Whoops, I apologize for the off topic e-nail. I meant to write a reply but I mixed up my messages to the various listservers I'm subscribed to. I'll remember to check my address next time. I've found a new way to run Rsync, it works pretty well, and involves a disk image mounted on a server that's created with Disk Copy. It serves our purpose pretty well for what we're doing

Hi!:) - try using the sudo command as a prefix to all of that. I know that if I didn't do that it would default to nobody.nobody when I copied. -Tito > > Hi All, > I recently installed Rsync to perform backup features - this > includes backing up a /home dir and keeping ownerships/permissions > intact is obviously very important.... > > However when I perform.

Gouri: close. Try "Ssh-keygen -p -P ''". You might argue that ssh should guess that -P imlplies -p, but that's an issue for your ssh maintainer. Also: you don't ordinarily distribute the private key. You need the PUBLIC key in $HOME/.ssh/authorized_keys on any system you want to access with the private key. Maybe i'm seing your application backward, and you

Tim, I reported a protocol data stream error on 9/8/2002 Deatils are in my postes at that time rsync still fails everytime I run it. This time I added three v's as you just suggested and rsync just hung with two tasks in execution thus: root 3178 0.1 0.9 1796 868 pts/1 S 09:57 0:00 /usr/bin/rsync -vvva --delete --exclude=root/snapsh root 3179 0.0 0.6 1628 632 pts/1

Oh. Now i feel like an *enlightened* idiot. I 've always thought of a checksum, crc, or whatever as giving 1/2^^length certainty, and I have a sense that that knowing the file length adds another amount of certainty, though I can't quantify that. I just know that if the size doesn't match, the checksum doesn't matter. I'd never considered the implications of the

HI, I have a scenario where a filesystem i.e /fs13/m6.uecommon.1/wmt8/utils is residing on a fileserver i.e. fs13. Contents of this filesystem are as follows: # ls -l /fs13/m6.uecommon.1/wmt8/utils lrwxrwxrwx ........ include-> /fs12/m6.uecommon.1/utils/include lrwxrwxrwx ........ tool_utils-> /fs12/m6.uecommon.1/utils/tool_utils The filesystems being pointed to i.e

HI, I'm trying to transfer a list of files within a filesystem to another filesystem. I've used the option: # rsync -avzol --progress /wp05/global/FCSI/WP_RLS05/rundir/ /nfs_proj/global/WP/ However, it had produced the error below: building file list ... global/FCSI/WP_RLS05/rundir/wp_celtic_max_fullwarn.tcl.log: Value too large to be stored in data type # du -sk wp_celtic_max.tcl.log

This message is in MIME format. The first part should be readable text, while the remaining parts are likely unreadable without MIME-aware tools. Send mail to mime@docserver.cac.washington.edu for more info. --1918950298-1868141776-898362261=:6767 Content-Type: TEXT/PLAIN; charset=US-ASCII Something to think about for CRAN's future. best, -tony --1918950298-1868141776-898362261=:6767