Displaying 20 results from an estimated 4000 matches similar to: "rsync --link-dest option with the destination directory containing old files."
2003 Jun 03
1
Rsync: --link-dest when target and compare_dir both have file
On Mon, Jun 02, 2003 at 03:32:04PM -0700, Michael Rubel wrote:
> Hi J.W.,
>
> Please pardon this intrusion on your private address; the rsync list seems
> to be down (no messages since yesterday), so I'm forwarding this directly
> to you. If you'd rather wait until the list restarts, that's fine too.
I'm CCing the list.
>
> Best regards,
> Mike
>
2003 Jun 02
1
--link-dest when target and compare_dir both have file
Hi J.W. et al,
Kevin Everets was kind enough to inform me about some strange behavior in
his backup script, which seems to be the result of --link-dest behaving
unexpectedly in the case where target/ is already populated with older
versions of the same file.
Here's the situation:
We want to do:
$ rsync -a --link-dest=../backup.1 source/ backup.0/
There is a file present under all three
2009 Nov 18
0
rsync Digest, Vol 83, Issue 12
Dear rsync folks,
Re the recent discussion of:
Subject: RE: Does files-from work with --delete?
We have come across the same issue, in doing partial backups of a file
system and using the --files-from and --link-dest feature to a re-cycled
area. Files that should be deleted tend to build up.
I mentioned this issue to a colleague.
He suggested that after the backup is done, a reverse rsync -n
2013 Jan 23
0
Changed attributes for a file in destination that is hard linked get propagated to --link-dest directories
Folks,
Thinking again about the issue of
changed attributes for a file in source that is identical in content
to a file in destination that is hard linked get propagated to the
--link-dest directories
I would like to suggest a new flag, (perhaps called something like
--preserve-linked-attributes), to allow callers to get the
behaviour that is needed to allow the use of recycled
2003 Jan 03
1
[Fwd: Re: rsync windows -> unix still hanging :(]
Author of the message didn't include rsync@lists.samba.org in the reply,
and I think this message is in topic.
-------- Original Message --------
Subject: Re: rsync windows -> unix still hanging :(
Date: Mon, 30 Dec 2002 17:24:47 -0800
From: Jim Kleckner <jek_subs@kleckner.net>
To: Mike Rubel <mrubel@galcit.caltech.edu>
CC: cygwin@cygwin.com
References:
2015 Apr 07
0
Patch for rsync --link-dest won't link even if existing file is out of date (fwd)
Folks,
We faced a similar situation to that which Ken described - we recycle
backup directories, for good reason.
There is a patch to solve the problem.
Our systems administrator provided the following description of the
patches we use:
============================================================================
1. rsync_link_dest improvement
by Bryant Hansen
Normally, existing files in
2012 Aug 24
1
[patch] link-dest messages and max-size warnings (fwd)
rsync Folks,
The following explanatory text is by me and the patches are by Rowan
McKenzie for use by the Advanced Scientific Computing group at CSIRO.
This patch builds upon the --link-dest patch by Bryant Hansen (Thanks heaps!).
1. The original patch provided an alternate behaviour for rsync when
using the --link-dest option.
When there are identical files in the source and link-dest areas,
2015 Apr 16
2
Recycling directories and backup performance. Was: Re: rsync --link-dest won't link even if existing file is out of date (fwd)
rsync folks,
Henri Shustak <henri.shustak at gmail.com> wrote:
> LBackup always starts a new backup snapshot with an empty directory. I
> have been looking at extending --link-dest options to scan beyond just
> the previous successful backup to (failed backups / older backups).
> However, there are all kinds of edge cases which are worth considering
> with such a changes. At
2002 Apr 09
0
possibly new rsync trick: rotating snapshots
I wouldn't worry about users reading each others files, either, if you
give each his own module, password-protected.
Tim Conway
tim.conway@philips.com
303.682.4917
Philips Semiconductor - Longmont TC
1880 Industrial Circle, Suite D
Longmont, CO 80501
Available via SameTime Connect within Philips, n9hmg on AIM
perl -e 'print pack(nnnnnnnnnnnn,
2003 Jan 03
0
[Fwd: Re: rsync windows -> unix still hanging :(]
Author of the message didn't include rsync@lists.samba.org in the reply,
and I think this message is in topic.
-------- Original Message --------
Subject: Re: rsync windows -> unix still hanging :(
Date: Mon, 30 Dec 2002 16:10:32 -0800
From: Jim Kleckner <jek-cygwin@kleckner.net>
To: Mike Rubel <mrubel@galcit.caltech.edu>, cygwin@cygwin.com
Mike -
Greger Cronquist and I
2015 Sep 21
0
[Bug 11523] New: Request: Add option to unlink hard links when permissions change
Folks,
bugs at stupidkitties.com wrote:
" I was wondering if it'd be feasible to add an option (or multiple options,
depending on the desired granularity) to cause rsync to treat changes in file
attributes the same way it treats changes to the file's contents when it
encounters hard links at the destination. Maybe something like --relink-p or
something?"
One of colleagues has
2012 Sep 07
0
rsync Digest, Vol 116, Issue 19
Wayne,
Thanks for the information - that looks useful for the future, and
would replace our option.
Rob.
> Date: Fri, 24 Aug 2012 23:10:43 -0700
> From: Wayne Davison <wayned at samba.org>
> To: Robert Bell <Robert.Bell at csiro.au>
> Cc: rsync at lists.samba.org
> Subject: Re: [patch] link-dest messages and max-size warnings (fwd)
>
> On Thu, Aug 23, 2012 at
2014 Sep 16
0
Recycling and keeping backups - Tower of Hanoi management of backups using rsync
Thanks to Kevin and Paul for responses.
We use a modified Tower of Hanoi scheme (on top of rsync and --link-dest
and recycling) for deciding which backups to keep.
Here is a sample of our holdings for one area:
home.20111124.seq.0 set 0
home.20130512.seq.512 set 10
home.20140203.seq.768 set 9
home.20140414.seq.832 set 7
home.20140708.seq.896 set 8
home.20140815.seq.928 set 6
2015 Nov 19
0
rsync - detecting change/no-change without an itemised list
rsync watchers,
I've been using rsync version 3.1.1+, and do like the improved --stats
output: e.g.
Number of files: 2480403 (reg: 2034290, dir: 233487, link: 212174, special: 452)
Number of created files: 356 (reg: 6, dir: 3, link: 347)
Number of regular files transferred: 16
...
- thanks to the developers.
However, I want to be able to look at the --stats output and make a
decision
2014 Sep 12
2
Backup scripts - recycling old backup directories
Folks,
Kevin Korb wrote:
> Have you considered more advanced methods such as subvolume snapshots
> provided by ZFS and BTRFS? At work we were forced to abandon rsync
> - --link-dest because of the amount of time it takes to delete old
> backups when the data is primarily many millions of small files
> (shared web hosting company).
We don't have more advanced methods like
2013 Jan 22
0
rsync - using a --files-from list to cut out scanning. How to handle deletions? (fwd)B
Paul Wayne, Kevin, Teodor and others,
Thanks for your contributions in response to my postings.
Paul: I was very imprecise if not plain wrong in my description. :-(
Thanks for explaining what really happens.
> "Rsync will not update an existing file in-place unless you use the
> --inplace option. So --whole-file is irrelevant for this.
> Rsync (without --inplace) will always
2016 Jun 23
1
rsync Digest, Vol 162, Issue 18
Folks,
Am 20.06.2016 um 22:01 schrieb Larry Irwin (gmail):
> The scripts I use analyze the rsync log after it completes and then
sftp's a summary to the root of the just completed rsync.
> If no summary is found or the summary is that it failed, the folder
rotation for that set is skipped and that folder is re-used on the
subsequent rsync.
> The key here is that the folder
2013 Jan 15
2
rsync - using a --files-from list to cut out scanning. How to handle deletions?
Folks,
We use rsync extensively for protecting data by making backups.
Thank you to the authors and maintainers.
Like many others, we use the --link-dest option to cut down on the space
occupied by the backups.
Unlike many others, we re-cycle old backup directories. Since most file
systems change only slowly (ours average about 0.5% of files and about
1.5% of data being churned each day), a
2014 Sep 15
2
Backup scripts - recycling old backup directories (Kevin Korb)
Kevin,
Thanks for the reply and interest in this topic.
Comments below.
Regards
Rob.
> I did consider that but rejected it for 2 reasons...
>
> 1. Backup run time. We have a 4 hour window to run backups at night.
> Using recycled directories significantly extended the backup run
> time. The deletion time is eliminated but frankly, we have the other
> 20 hours of the day
2013 Jan 18
1
rsync - using a --files-from list to cut out scanning. How to handle deletions? (fwd)
Kevin,
Thanks for your response.
Some observations are inter-lined below.
Rob.
Regards
Rob. Bell e-mail: Robert.Bell at csiro.au
--
Dr Robert C. Bell, BSc (Hons) PhD
Technical Services Manager
Advanced Scientific Computing
CSIRO IM&T
Phone: +61 3 9669 8102 | Mobile: +61 428 108 333 | CSIRO 93 3810
Robert.Bell at csiro.au | http://www.csiro.au/ | http://www.hpsc.csiro.au/