similar to: how to reduce rsync system usage

This is a patch to fix one annoyance of having rsync processes race: I usually keep our servers synced with the following script, run by cron. #!/bin/sh lockfile -r 2 -l 1000 /tmp/synchome.lock || exit 1 rsync -e ssh -avHP --delete zorro01:/home/\* /home >/dev/null rm -f /tmp/synchome.lock -- Sometimes my users (including myself) are in a hurry and syncronise files and directories in their

Hi Friends, I am using rsync to copy data from Production File Server to Disaster Recovery file server. I have 100Mbps link setup between these two servers. Folder structure is very deep. It is having path like /reports/folder1/date/folder2/file.tx, where we have 1600 directories like 'folder1', daily folders since last year in date folder and 2 folders for each date folder like folder2

Hello, I've just spent several hours going over several Google searches trying to find a way to configure rsync to log into a file named "/var/log/rsync.log". So far, every instance where I've found someone asking about rsync logging remained unanswered (which is kind of weird in itself). As far as I can tell, the only way to do this is to setup rsync as a daemon process so

Hi All, I was hoping someone would know the answer to this question I had... I know the rsync daemon has the "Max connections" module, which works great. However, I was wondering if there was a good way for me to: 1: Query rsync to get the number of live connections it thinks it has? 2: Or better yet, how does rsync itself check for the number of connections? I'm trying to

Hi, I have a cron job to rsync one directory from one server to another every 5 minutes. There are some really big files. So it happens when the second instance of rsync tries to copy the same file when the first instance is not done yet. It drives my CPU crazy on the source server. Is there a way to avoid this problem? Thanks,

Hi there, I use rsync over ssh to syncronise various directories between a windows machine and a linux box. Now I want to sync files between two linux boxes. Because the I want to do that as a cron job I need rsa key authentification. I have a user called test on both machines. On both pc I also run "ssh-keygen -t rsa1" and enter no passphrase. I copied the identity.pub file from the

Hi - Suppose I have a Q-1 Vorbis stream being served from a machine on a low-bandwidth internet connection. I listen to the stream locally using Winamp, which shows the bitrate fluctuating between around 35-55 kbps, the average being 48k. Now suppose I have 10 external listeners connected. How much bandwidth will they need/use? Common sense says: average bitrate * 10 = 480kbps (plus any

I have the following as a line in a script kicked off from cron: sudo rsync -e ssh -avz /Times_QPS/ 192.168.22.72:/Times_QPS/ --eahfs It logs the output to a log file, however rsync caused the log file to go to an 80gb file and fill up my disk because it threw a mental when a file it went to sync was no longer there! Is there some way to get the sync to ignore errors? -Jason

Hi There, This post is brought about due to the following two: http://www.mail-archive.com/rsync@lists.samba.org/msg10702.html http://www.mail-archive.com/rsync@lists.samba.org/msg10709.html I have a situation where I need to upload large files over an unstable link (resuming is a requirement) and only when they are complete can they be renamed and hence replace the original file. The

First off BackgroundRb rocks!!!!. Top marks Ezra, it''s gone a long way to stopping us from doing a nasty curl/cron hack :) Okay so here''s what we''re using it for. We''re synchronising data from a Filemaker database, via web service equest, into a mysql database via a rails model called ''Syncer'' [How''s that for an oddball use case!].

Hi Kevin, Thank you very much. I changed my user in the remote machine (su). Then, by trying again with rsync but with no modification in the source folder, I see that file ownership continues the same. Would be possible for rsync to change the ownership in this case (I am not root) ? Thanks, Regards,CJ Em Quinta-feira, 10 de Setembro de 2015 20:01, Kevin Korb <kmk at

Dear list, I'd like to have your expertise opinion on following issue. Out of a concrete need we developed an application that will rsync any changes on a local directory structure to a remove system the moment they happen using the linux kernel watch feature. This is in our opinion much more elegant compared to invoking rsync every x seconds/minutes from cron, or having to use a special

Hi I'd like to rsync a large amount of data over a slow connection, but only during night hours. I couldn't find a parameter that limits the time that rsync is running, only the timeout on idle time. I guess the way to go would be to start rsync, get the process ID and kill the process later on. Has anybody already written a bash script that would do something like that? Are there other

Hi, does anybody know, how a bash shell script looks, which automatically enters the ssh password? the rsync call should be: rsync -avz -e ssh /home/johndoe/data/repository billythegate@192.168.10.102:/home/johndoe/junk the call causes a password question. Is ist possible to automate that by a cron? If yes how should the script look to automatically enter the password? ThanX for an answer.

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Try it without any --delete options. On 03/27/2015 09:31 AM, Aron Rotteveel wrote: > I am now running with --delete --numeric-ids --relative but the > problem still persists. > > -- Best regards / Met vriendelijke groet, > > Aron Rotteveel > > 2015-03-27 14:22 GMT+01:00 Kevin Korb <kmk at sanitarium.net >

Hello All, I am trying to put puppet into push mode only. The instructions I''ve seen have said to put listen=true in puppet.conf but that doesn''t seem to have stopped the pull every 30 minutes. What else needs to be set? Thanks, Jim -- “Twenty years from now you will be more disappointed by the things that you didn’t do than by the ones you did do. So throw off the bowlines.

Hi, I have 2 linux accounts on different machines (same login, same password). Can you please tell me how I use rsync directories between 2 accounts? Thank you.

I second Francis here. You don't need to diagnose incomplete file transfers as long as you have racing conditions as you described. This leads to strange result inevitably. NEVER start several rsync jobs manipulating the same data - especially if there are modifications to BOTH sides source and destination. You do not necessarily define a service like Francis suggests. A simple semaphore

This is the case - mounted Inetpub's windows-webserver on /mnt/web1 /mnt/web2, etc. - rsync this to local dir: rsync -av --delete /mnt/web1 /mass/kuurne/day rsync -av --delete /mnt/web2 /mass/kuurne/day etc.. - when logged in, everything works (I do see some errors about non-existing files, but rsync won't stop. When used this command in cron 00 01 * * * rsync -av --delete

I'm looking for feedback on this first patch. The node has been pushed towards a more generic boot process. With this patch the node can now boot up and execute a few specifically-named scripts that reside in /etc/node.d/ at key points during the startup. After this goes upstream, the next step will be to define in more detail the remote interfaces for the "managed" runtime