Hello all,
I am experiencing a (consistent, reproducible) condition whereby rsync
is hanging indefinitely at the following stage :
generate_files phase=1
The condition does not occur if --dry-run is specified - only when the
run is "for real". Finally, i can scp the files without problems, so
it is not a general connection issue, nor is it a problem with
permissions (everything is running via sudo in any case).
The pertinent info :
Initiating machine (backup-01) :
[rsync-backup@backup-01 ~]$ uname -a
Linux backup-01 2.6.23.1-21.fc7 #1 SMP Thu Nov 1 21:09:24 EDT 2007 i686
i686 i386 GNU/Linux
[rsync-backup@backup-01 ~]$ rsync --version | head -n 8
rsync version 3.0.0 protocol version 30
Copyright (C) 1996-2007 by Andrew Tridgell, Wayne Davison, and others.
Web site: http://rsync.samba.org/
Capabilities:
64-bit files, 64-bit inums, 32-bit timestamps, 64-bit long ints,
socketpairs, hardlinks, symlinks, IPv6, batchfiles, inplace,
append, ACLs, xattrs, iconv, no symtimes
(Commandline, generated by in-house script...)
[rsync-backup@backup-01 ~]$ /usr/bin/sudo /usr/bin/rsync -bavz
--fake-super --delete --numeric-ids -R
--rsync-path="/usr/bin/sudo /usr/bin/rsync"
--log-file=/opt/rsync-backup/rsync-backup.log
--backup-dir=/opt/rsync-backup/192.168.0.88/2008-03-21T09:51:42 -e
"/usr/bin/ssh -i /home/rsync-backup/.ssh/id_rsa"
rsync-backup@192.168.0.88:"/cygdrive/d/BACKUP"
/opt/rsync-backup/192.168.0.88/CURRENT/
The machine being connected to (192.168.0.88) :
$ uname -a
CYGWIN_NT-5.2 crm-server-02 1.5.25(0.156/4/2) 2008-03-05 19:27 i686
Cygwin
$ rsync --version | head -n 6
rsync version 2.6.9 protocol version 29
Copyright (C) 1996-2006 by Andrew Tridgell, Wayne Davison, and others.
<http://rsync.samba.org/>
Capabilities: 64-bit files, socketpairs, hard links, symlinks,
batchfiles, inplace, no IPv6, 64-bit system inums, 64-bit internal inums
As you might imagine, i'm inclined to believe it's got something to do
with rsync on Cygwin. Of course, there's the obligatory "it worked
fine for a few days", which it did, and (of course) i changed nothing
on either end.
Any insight would be more than welcome. I'm happy to provide any
further information as necessary.
As a side-note, i've been using rsync as part of our backup strategy
for about half a year now, and this is the only problem i've
encountered since we've gone into production. I'd say that's a
pretty
solid track record so far. :)
--
Daniel Maher <dma AT witbe.net>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 189 bytes
Desc: not available
Url :
http://lists.samba.org/archive/rsync/attachments/20080321/ad9553e1/signature.bin
On 21 Mar, 2008, at 11:45 , Daniel Maher wrote:> --rsync-path="/usr/bin/sudo /usr/bin/rsync" > --log-file=/opt/rsync-backup/rsync-backup.log > --backup-dir=/opt/rsync-backup/192.168.0.88/2008-03-21T09:51:42 -e > "/usr/bin/ssh -i /home/rsync-backup/.ssh/id_rsa" > rsync-backup@192.168.0.88:"/cygdrive/d/BACKUP" /opt/rsync-backup/ > 192.168.0.88/CURRENT/interesting. So presumably you give rsync-backup the option to run only rsync without a password. Double security. ssh key for logging in as rsync-backup and sudo restriction in place. Correct? Of course one that gets hold of the key, could run rsync as root, overwrite rsync and then rerun that rsync to do what he pleases. I wonder though if you really have to specity the ssh. ssh should be by default and the key is the default key. Well, this protects you from changes in either rsync defaults or ssh global configuration. I Wonder too if you will get one or two, given the recent discussion... should be one, if the list software looks at the To:. Giuliano
On Fri, 21 Mar 2008 13:53:11 +0100 Giuliano Gavazzi <dev+lists@humph.com> wrote:> > On 21 Mar, 2008, at 11:45 , Daniel Maher wrote: > > --rsync-path="/usr/bin/sudo /usr/bin/rsync" > > --log-file=/opt/rsync-backup/rsync-backup.log > > --backup-dir=/opt/rsync-backup/192.168.0.88/2008-03-21T09:51:42 -e > > "/usr/bin/ssh -i /home/rsync-backup/.ssh/id_rsa" > > rsync-backup@192.168.0.88:"/cygdrive/d/BACKUP" /opt/rsync-backup/ > > 192.168.0.88/CURRENT/ > > ssh key for logging in as rsync-backup and sudo restriction in > place. Correct? Of course one that gets hold of the key, could run > rsync as root, overwrite rsync and then rerun that rsync to do what > he pleases.Correct. Of course, some security is better than no security. :)> I wonder though if you really have to specity the ssh. ssh should be > by default and the key is the default key. Well, this protects you > from changes in either rsync defaults or ssh global configuration.What can i say, i like to be explicit. :P> I Wonder too if you will get one or two, given the recent > discussion... should be one, if the list software looks at the To:.Just one. -- Daniel Maher <dma AT witbe.net> -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 189 bytes Desc: not available Url : http://lists.samba.org/archive/rsync/attachments/20080321/fd0948c1/signature.bin
On Fri, 21 Mar 2008 11:45:20 +0100 Daniel Maher <dma+rsynclist@witbe.net> wrote:> I am experiencing a (consistent, reproducible) condition whereby rsync > is hanging indefinitely at the following stage : > generate_files phase=1 > > The condition does not occur if --dry-run is specified - only when the > run is "for real". Finally, i can scp the files without problems, so > it is not a general connection issue, nor is it a problem with > permissions (everything is running via sudo in any case).In case anybody is interested, here's my follow-up to this issue : Eschewing the 2.6.9 that ships by default on Cygwin, I compiled Matt's patched rsync 3.0.0 by hand and moved forward with that binary. After trying a few more scenarios - and hanging each time at the same phase noted above - i tried the --whole-file switch (copy files whole), which solved the problem nicely. Now, of course, i'm not sure /why/ that worked (which is to say that i'm not sure why the algorithm was failing), but there you go. :) -- Daniel Maher <dma AT witbe.net> -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 189 bytes Desc: not available Url : http://lists.samba.org/archive/rsync/attachments/20080331/67a20595/signature.bin