Hi, I am using rsync to backup various machines to a central server (all archlinux, rsync 3.0.7 on ext4). Yesterday I needed one of those backups, and I found out it is useless since a lot of files never got updated. Even when I enable checksums some files are not updated. I am pretty sure I am missing something, but am not sure what it is. This is (a stripped version of) the command I use: rsync --stats -vvvvvvv -xaz --append --delete-during --delete-excluded /etc/profile.d backup at server:client/etc/ In this example, the server has an older version of the file 'mozilla-common.sh', but this file does not get updated. I have attached the logfile of this command. With checksums enabled, some files are touched, but the 'mozilla-common.sh' file is not. I have attached this log as well. This is what the directories look like after syncing: client: drwxr-xr-x 2 root root 4096 May 15 13:48 . drwxr-xr-x 64 root root 4096 May 16 10:44 .. -rwxr-xr-x 1 root root 28 May 3 12:38 glib2.csh -rwxr-xr-x 1 root root 28 May 3 12:38 glib2.sh -rwxr-xr-x 1 root root 102 Dec 6 04:49 gpm.sh -rwxr-xr-x 2 root root 102 May 16 10:41 locale.sh -rwxr-xr-x 1 root root 13 Sep 20 2009 local.sh -rwxr-xr-x 1 root root 22 May 7 03:33 mercurial.sh -rwxr-xr-x 1 root root 50 Jun 13 2009 mozilla-common.csh -rwxr-xr-x 1 root root 50 Jun 13 2009 mozilla-common.sh -rwxr-xr-x 1 root root 299 Sep 10 2009 openjdk6.sh -rwxr-xr-x 1 root root 132 Apr 2 23:56 openoffice.sh -rwxr-xr-x 1 root root 118 Oct 3 2009 perlbin.sh -rwxr-xr-x 1 root root 131 Feb 27 00:51 qt3.sh -rwxr-xr-x 1 root root 2142 Apr 9 18:26 udisks-bash-completion.sh -rwxr-xr-x 1 root root 392 Jan 31 12:19 xorg.sh server after first sync: drwxr-xr-x 2 backup nobody 4096 May 15 13:48 . drwxr-xr-x 64 backup nobody 4096 May 16 10:44 .. -rwxr-xr-x 1 backup nobody 28 Jan 15 2009 glib2.csh -rwxr-xr-x 1 backup nobody 28 Jan 15 2009 glib2.sh -rwxr-xr-x 1 backup nobody 102 Dec 6 04:49 gpm.sh -rwxr-xr-x 1 backup nobody 102 Jan 31 22:00 locale.sh -rwxr-xr-x 1 backup nobody 13 Sep 20 2009 local.sh -rwxr-xr-x 1 backup nobody 22 May 7 03:33 mercurial.sh -rwxr-xr-x 1 backup nobody 50 Jun 13 2009 mozilla-common.csh -rwxr-xr-x 1 backup nobody 75 Jun 29 2008 mozilla-common.sh -rwxr-xr-x 1 backup nobody 299 Sep 10 2009 openjdk6.sh -rwxr-xr-x 1 backup nobody 132 Mar 31 14:38 openoffice.sh -rwxr-xr-x 1 backup nobody 118 Jul 7 2008 perlbin.sh -rwxr-xr-x 1 backup nobody 131 Sep 14 2008 qt3.sh -rwxr-xr-x 1 backup nobody 2142 Mar 16 11:20 udisks-bash-completion.sh -rwxr-xr-x 1 backup nobody 392 Feb 22 2009 xorg.sh server after sync +checksum: drwxr-xr-x 2 backup nobody 4096 May 15 13:48 . drwxr-xr-x 64 backup nobody 4096 May 16 10:44 .. -rwxr-xr-x 1 backup nobody 28 May 3 12:38 glib2.csh -rwxr-xr-x 1 backup nobody 28 May 3 12:38 glib2.sh -rwxr-xr-x 1 backup nobody 102 Dec 6 04:49 gpm.sh -rwxr-xr-x 1 backup nobody 102 Jan 31 22:00 locale.sh -rwxr-xr-x 1 backup nobody 13 Sep 20 2009 local.sh -rwxr-xr-x 1 backup nobody 22 May 7 03:33 mercurial.sh -rwxr-xr-x 1 backup nobody 50 Jun 13 2009 mozilla-common.csh -rwxr-xr-x 1 backup nobody 75 Jun 29 2008 mozilla-common.sh -rwxr-xr-x 1 backup nobody 299 Sep 10 2009 openjdk6.sh -rwxr-xr-x 1 backup nobody 132 Apr 2 23:56 openoffice.sh -rwxr-xr-x 1 backup nobody 118 Oct 3 2009 perlbin.sh -rwxr-xr-x 1 backup nobody 131 Feb 27 00:51 qt3.sh -rwxr-xr-x 1 backup nobody 2142 Apr 9 18:26 udisks-bash-completion.sh -rwxr-xr-x 1 backup nobody 392 Jan 31 12:19 xorg.sh Thanks, Sjon Hortensius -------------- next part -------------- An embedded and charset-unspecified text was scrubbed... Name: rsync.log URL: <http://lists.samba.org/pipermail/rsync/attachments/20100516/d8116a2c/attachment.ksh> -------------- next part -------------- An embedded and charset-unspecified text was scrubbed... Name: rsync+checksum.log URL: <http://lists.samba.org/pipermail/rsync/attachments/20100516/d8116a2c/attachment-0001.ksh>
Matthias Schniedermeyer
2010-May-16 10:30 UTC
rsync over ssh - existing files are not updated?
On 16.05.2010 12:23, Sjon Hortensius wrote:> Hi, > > I am using rsync to backup various machines to a central server (all > archlinux, rsync 3.0.7 on ext4). Yesterday I needed one of those > backups, and I found out it is useless since a lot of files never got > updated. Even when I enable checksums some files are not updated. I am > pretty sure I am missing something, but am not sure what it is. This is > (a stripped version of) the command I use: > > rsync --stats -vvvvvvv -xaz --append --delete-during --delete-excluded > /etc/profile.d backup at server:client/etc/man rsync keyword: --append You should use: --append-verify or just don't use --append. That option is for transfers where you know that the files are only appended to, like (non-rotated) log-files. Bis denn -- Real Programmers consider "what you see is what you get" to be just as bad a concept in Text Editors as it is in women. No, the Real Programmer wants a "you asked for it, you got it" text editor -- complicated, cryptic, powerful, unforgiving, dangerous.