similar to: rsync big file

Displaying 20 results from an estimated 40000 matches similar to: "rsync big file"

2008 Mar 31
1
RFE: Lockfile option for use in cronjobs
Hi, Looking for an easy way to prevent a repetitive rsync to be running multiple times, I was wondering if it could be useful to have an option like: --pidfile /some/path/rsync-mirror-org.pid So that rsync can be run directly from cron without requiring a wrapper script to do pidfile handling. This way rsync on startup could check the pid-file, see if another rsync is using this pid, and
1998 Aug 14
1
Pine 4.02 and directory perms
Hey linux-security-ers: I just compiled/installed Pine 4.02 for my RH 5.0 machine today (didn't see an RPM last time I checked ftp.redhat.com:/pub/contrib), and after I got it installed, it kept giving me errors about not being able to create a lockfile when dinking with my mailspool in /var/spool/mail. After doing some digging on DejaNews and the Pine website, I find a document who says the
2003 Oct 06
2
Patch to revive tmpfiles
This is a patch to fix one annoyance of having rsync processes race: I usually keep our servers synced with the following script, run by cron. #!/bin/sh lockfile -r 2 -l 1000 /tmp/synchome.lock || exit 1 rsync -e ssh -avHP --delete zorro01:/home/\* /home >/dev/null rm -f /tmp/synchome.lock -- Sometimes my users (including myself) are in a hurry and syncronise files and directories in their
2005 Jun 15
3
proposed new parameter: --time-limit 5:30
I find that rsync is an excellent tool for backing up my large partitions, often over slower links on the Internet. I run a cron job every night to update backup mirrors. But occasionally I make large changes to the source disk, and the rsync update takes more thanb 24 ours to complete. Then I can have two or more rsyncs working over the same source and destination directories. What I really
2010 Nov 25
4
[PATCH]improve suspend_evtchn lock processing
While doing migration, sometimes found suspend lock file was not unlinked in previous operations, then there is an obsolete lock file in place, which causes the current and later migration cannot get lock. That happens seldomly but do happen. After checking the source code, I found there are some places that potentially cause lock file unlinked, including: 1) in lock_suspend_event() function,
2005 May 26
4
how to reduce rsync system usage
hi all we're using rsync to backup our web server at the moment using it in a cron job the server we are using to receive all the sync files is a live but not heavily used linux machine but rsync still takes up more resources than we want it to it takes up to 95% (fluctuating) cpu load and a fair bit of memory too the cron job uses nice -19 rsync but that doesn't seem to do anything,
2006 Apr 25
2
NFS
I've finally managed to run Dovecot without errors in two computers with maildir and indexes stored in NFS. I added a page to wiki about this: http://wiki.dovecot.org/NFS Suggestions how to keep attribute cache enabled but to allow Dovecot to specifically request not to use a cached value (when it's important) would be welcome. -------------- next part -------------- A non-text
2008 Jan 25
1
Windows share modes and Linux file locking, flock & fcntl
Hi, I am trying to understand file locking and share modes. I am using RedHat Enterprise Linux 4, with kernel 2.6.9-55.ELsmp, samba-3.0.10-1.4E.11 and Windows XP. In particular I am looking at a machine running Linux exporting its local filesystem using Samba, with a Windows client accessing the file share. If I use byte range locking (fcntl() on Linux, LockFile() on Windows) things work as
2009 Feb 26
2
problems with dotlock
I have to make dotlock work because this openwebmail thing only supports one of dotlock or flock, but procmail delivery does dotlock and fcntl. procmail correctly creates a dotlock file in /var/spool/mail/username.lock when delivering, I can watch this with `while :; do ls -la | grep lock; done`. It works fine when lock_method=fcntl, but no dotlock file shows up in /var/spool/mail.
2005 Apr 08
3
Database Locking
Locking of Quartz databases is currently done with a lockfile. This works well from the actual locking side, but the downside is that the lock isn't released if a process doesn't destroy the Xapian::WritableDatabase object. This is made worse because some of the bindings don't call destructors (or don't do it reliably). The obvious alternative is to use actual locking APIs. On
2007 Jul 11
9
NFS cache flush tester
http://dovecot.org/tools/nfstest.c I wrote a test utility that tests different ways to flush NFS attribute cache and data cache. Please test in your NFS setup and show me the results, so I can make Dovecot v1.1 works well with NFS. Run the test several times (3 should be enough) to make sure the output stays the same, because the attribute cache flushes might incorrectly say "OK". And
2007 Jan 30
1
rsync files with mtime
Hi, I try to rsync files only X days old. This is my setup. The backup server needs to store all servers' backup and only has space for 7 days backup. But each individual server has backup for 21 days. On the backup server, i remove files older than 7 days. When backup server pulls files, I want rsync only pull files with mtime last 7 days. Searching through the archive, someone suggested
2003 Jul 24
1
does rsync lock exclusively files to copy?
I'm running rsync 2.5.6 on windows (via cygwin) and I've had other processes try to open the same files as rsync, but could not get through sometimes. Does rsync place a shared lock or an exclusive lock on the files it will copy from? I checked into the sources but did not find any use of flock() which could specify either LOCK_SH or LOCK_EX, so I'm not sure what the open() does when
2013 Aug 25
1
Local and remote back up behave differently
I have run out of ideas on why the local and remote back ups done with the script below behave differently. The local always seems to be a complete back up while the remotes are delta back ups except on Mondays. Cron line example: /root/bin/backups /export/home redwood "--exclude='*.sock' --exclude='*cache*' --exclude=/export/home/*/.gvfs" #!/bin/bash # Script for one
2006 Jun 09
1
logrotate and logger reload
I have one system that went totally crazy on me. It went into an infinite loop rotating * message and log files. From the asterisk console I kept seeing the message about re-loading logger.conf over and over and it just kept creating more and more files. I baby set many different * boxes all running the same script without this problem. Here is my cron script: /var/log/asterisk/cdr-csv/*csv {
2003 May 17
1
Postfix locking equivalence?
/etc/postfix/main.cf.default: mailbox_delivery_lock = flock, dotlock Is flock equivalent to dovecot's fnctl locking? For mbox what type of locking settings should I be using? (No NFS, only local filesystem.) Warren Togami warren at togami.com
2006 Sep 28
2
Duplicate record weirdness ?
First off BackgroundRb rocks!!!!. Top marks Ezra, it''s gone a long way to stopping us from doing a nasty curl/cron hack :) Okay so here''s what we''re using it for. We''re synchronising data from a Filemaker database, via web service equest, into a mysql database via a rails model called ''Syncer'' [How''s that for an oddball use case!].
2012 Apr 12
3
Rsync takes long time to finish
Hi Friends, I am using rsync to copy data from Production File Server to Disaster Recovery file server. I have 100Mbps link setup between these two servers. Folder structure is very deep. It is having path like /reports/folder1/date/folder2/file.tx, where we have 1600 directories like 'folder1', daily folders since last year in date folder and 2 folders for each date folder like folder2
2008 Oct 07
2
1.1.4 and trouble over NFS
Hello, I have some trouble with the current setup (it's a testing environment): 2 server with Dovecot 1.1.4 from source (OS Debian testing 2.6.26) (name: "exim" and "exim2") 1 NFS server (OS Debian testing 2.6.26) I use NFS v.4, indexes shared over NFS. The relavant part of Dovecot configuration: dotlock_use_excl = yes mail_nfs_storage = yes mail_nfs_index = yes
2017 Sep 07
2
Should I worry about the "vanished files" warning?
Hi I would like to ask, when the "vanished files" warning is a sign that something bad is happening somewhere. I know that the `rsync-no-vanished` script can silence the warning, but I am wondering whether this is a sane thing to do. My guess based on https://bugzilla.samba.org/show_bug.cgi?id=3653#c26 and https://bugzilla.samba.org/show_bug.cgi?id=10356 is that it's fine, but