I'm trying to use rsync under Cygwin on 2 machines running Windows 2000 Server There's a 2MB link between them and I'm using SSH setup for a passwordless connection rsync hangs part way through transfers and when run again hangs at the same place in the same files with no explanation no matter what verbosity level I set it to. Each time it hangs it leaves an rsync process running on the "source" machine I added the timeout option to the command which gives the following info: (don't know if this will help track down this issue) io timeout after 60 seconds - exiting:00 rsync error: timeout in data send/receive (code 30) at /home/lapo/packaging/tmp/rsync-2.6.0/io.c(109) rsync: connection unexpectedly closed (72412 bytes read so far) rsync error: error in rsync protocol data stream (code 12) at /home/lapo/packaging/tmp/rsync-2.6.0/io.c(189) If I run it again the "bytes read so far" values is identical If I delete the particular file that it hangs at (from the destination) then the same thing happens again using or not using the -W option makes no difference using or not using compression makes no difference Now this bit is very odd: If I change directory on the destination machine into the directory where the problem file is and change the rsync command to transfer all the files in that directory (adding the directory/* to the source parameter) then the file is transferred just fine! go figure! I then rerun rsync and it will carry on past this file (since it is now up to date on the destination) until it hits some other "problem" file and hangs again. any ideas most appreciated! There's a note on the website home page that using daemon mode sometimes works around this The man page hints that I can run rsync in daemon mode on the "source" machine by specifying the right parameters on the client command line If I'm using SSH do I still need to open up the rsync server port on the "server" machine, or does the traffic come over the ssh connection? If so what is the format of the client command line - try as I may I can't get it to work - it just exits immediately as soon as I add the --daemon parameter Info about my rsync/ssh/Cygwin setup client version: $ rsync --version rsync version 2.6.0 protocol version 27 Copyright (C) 1996-2004 by Andrew Tridgell and others <rsync.samba.org> Capabilities: 64-bit files, socketpairs, hard links, symlinks, batchfiles, no IPv6, 64-bit system inums, 64-bit internal inums On source: $ ssh -V OpenSSH_3.8p1, SSH protocols 1.5/2.0, OpenSSL 0.9.7d 17 Mar 2004 $ cygcheck -s 1100k 2004/03/19 E:\cygwin\bin\cygwin1.dll Cygwin DLL version info: DLL version: 1.5.9 DLL epoch: 19 DLL bad signal mask: 19005 DLL old termios: 5 DLL malloc env: 28 API major: 0 API minor: 112 Shared data: 4 DLL identifier: cygwin1 Mount registry: 2 Cygnus registry name: Cygnus Solutions Cygwin registry name: Cygwin Program options name: Program Options Cygwin mount registry name: mounts v2 Cygdrive flags: cygdrive flags Cygdrive prefix: cygdrive prefix Cygdrive default prefix: Build date: Thu Mar 18 23:05:18 EST 2004 Shared id: cygwin1S4 openssh 3.8p1-1 openssl 0.9.7d-1 rsync 2.6.0-1 Tim Moss SiteSpeed Ltd Mobile: 0 77 9613 4891 Email: <mailto:tim.moss@site-speed.co.uk> tim.moss@site-speed.co.uk Website: <site-speed.co.uk> site-speed.co.uk This email contains information from SiteSpeed Ltd, which may be privileged or confidential. If you are not the intended recipient, be aware that any disclosure, copying, distribution or use of the contents of this information is prohibited. If you have received this electronic message in error, please notify us immediately. -------------- next part -------------- A non-text attachment was scrubbed... Name: winmail.dat Type: application/ms-tnef Size: 10278 bytes Desc: not available Url : lists.samba.org/archive/rsync/attachments/20040514/ad504df7/winmail.bin
On Fri, May 14, 2004 at 12:47:15PM +0100, tim.moss@site-speed.com wrote:> I'm trying to use rsync under Cygwin on 2 machines running Windows 2000 > Server > There's a 2MB link between them and I'm using SSH setup for a passwordless > connection > > rsync hangs part way through transfers and when run again hangs at the same > place in the same files with no explanation no matter what verbosity level I > set it to. Each time it hangs it leaves an rsync process running on the > "source" machinei don't know the details and/or of solutions but i do know that there are known issues with rsync under cygwin. check out the rsync changelogs, i think there are mentions of some of the bugs being fixed in some of the recent version. Latest is 2.6.2. danno
Which version of rsync, AND which version of Cygwin, that you run is VERY crucial. Rsync itself wasn't actually the source of the "hang" bugs under Cygwin, the cygwin1.dll file was, from my understanding. Either way, if you upgrade both Cygwin and Rsync to the latest versions, your problem should go away. -J> I'm trying to use rsync under Cygwin on 2 machines running Windows 2000 > Server > There's a 2MB link between them and I'm using SSH setup for a passwordless > connection > > rsync hangs part way through transfers and when run again hangs at the same > place in the same files with no explanation no matter what verbosity level I > set it to. Each time it hangs it leaves an rsync process running on the > "source" machine > > I added the timeout option to the command which gives the following info: > (don't know if this will help track down this issue) > > io timeout after 60 seconds - exiting:00 > rsync error: timeout in data send/receive (code 30) at > /home/lapo/packaging/tmp/rsync-2.6.0/io.c(109) > rsync: connection unexpectedly closed (72412 bytes read so far) > rsync error: error in rsync protocol data stream (code 12) at > /home/lapo/packaging/tmp/rsync-2.6.0/io.c(189) > > If I run it again the "bytes read so far" values is identical > If I delete the particular file that it hangs at (from the destination) then > the same thing happens again > using or not using the -W option makes no difference > using or not using compression makes no difference > > > > Now this bit is very odd: > If I change directory on the destination machine into the directory where > the problem file is > and change the rsync command to transfer all the files in that directory > (adding the directory/* to the source parameter) > then the file is transferred just fine! > > go figure! > > I then rerun rsync and it will carry on past this file (since it is now up > to date on the destination) until it hits some other "problem" file and > hangs again. > > > any ideas most appreciated! > There's a note on the website home page that using daemon mode sometimes > works around this > > > > The man page hints that I can run rsync in daemon mode on the "source" > machine by specifying the right parameters on the client command line > If I'm using SSH do I still need to open up the rsync server port on the > "server" machine, or does the traffic come over the ssh connection? > If so what is the format of the client command line - try as I may I can't > get it to work - it just exits immediately as soon as I add the --daemon > parameter > > > > > > > Info about my rsync/ssh/Cygwin setup > > client version: > > $ rsync --version > rsync version 2.6.0 protocol version 27 > Copyright (C) 1996-2004 by Andrew Tridgell and others > <rsync.samba.org> > Capabilities: 64-bit files, socketpairs, hard links, symlinks, batchfiles, > no IPv6, 64-bit system inums, 64-bit internal inums > > > On source: > > $ ssh -V > OpenSSH_3.8p1, SSH protocols 1.5/2.0, OpenSSL 0.9.7d 17 Mar 2004 > > $ cygcheck -s > 1100k 2004/03/19 E:\cygwin\bin\cygwin1.dll > Cygwin DLL version info: > DLL version: 1.5.9 > DLL epoch: 19 > DLL bad signal mask: 19005 > DLL old termios: 5 > DLL malloc env: 28 > API major: 0 > API minor: 112 > Shared data: 4 > DLL identifier: cygwin1 > Mount registry: 2 > Cygnus registry name: Cygnus Solutions > Cygwin registry name: Cygwin > Program options name: Program Options > Cygwin mount registry name: mounts v2 > Cygdrive flags: cygdrive flags > Cygdrive prefix: cygdrive prefix > Cygdrive default prefix: > Build date: Thu Mar 18 23:05:18 EST 2004 > Shared id: cygwin1S4 > > openssh 3.8p1-1 > openssl 0.9.7d-1 > rsync 2.6.0-1 > > > > > > > Tim Moss > SiteSpeed Ltd > Mobile: 0 77 9613 4891 > > Email: <mailto:tim.moss@site-speed.co.uk> > tim.moss@site-speed.co.uk > > Website: <site-speed.co.uk> > site-speed.co.uk > > This email contains information from SiteSpeed Ltd, which may be privileged > or confidential. If you are not the intended recipient, be aware that any > disclosure, copying, distribution or use of the contents of this information > is prohibited. If you have received this electronic message in error, please > notify us immediately. > > > >
Slight clarification: When I said "latest version" of rsync, I did NOT mean the latest binary packaged with cygwin, I meant the latest source version, which you can compile yourself under cygwin (if you've installed gcc, ming, and make) or you can use the pre-compiled binaries now available at cwrsync's site.> I'm trying to use rsync under Cygwin on 2 machines running Windows 2000 > Server > There's a 2MB link between them and I'm using SSH setup for a passwordless > connection > > rsync hangs part way through transfers and when run again hangs at the same > place in the same files with no explanation no matter what verbosity level I > set it to. Each time it hangs it leaves an rsync process running on the > "source" machine > > I added the timeout option to the command which gives the following info: > (don't know if this will help track down this issue) > > io timeout after 60 seconds - exiting:00 > rsync error: timeout in data send/receive (code 30) at > /home/lapo/packaging/tmp/rsync-2.6.0/io.c(109) > rsync: connection unexpectedly closed (72412 bytes read so far) > rsync error: error in rsync protocol data stream (code 12) at > /home/lapo/packaging/tmp/rsync-2.6.0/io.c(189) > > If I run it again the "bytes read so far" values is identical > If I delete the particular file that it hangs at (from the destination) then > the same thing happens again > using or not using the -W option makes no difference > using or not using compression makes no difference > > > > Now this bit is very odd: > If I change directory on the destination machine into the directory where > the problem file is > and change the rsync command to transfer all the files in that directory > (adding the directory/* to the source parameter) > then the file is transferred just fine! > > go figure! > > I then rerun rsync and it will carry on past this file (since it is now up > to date on the destination) until it hits some other "problem" file and > hangs again. > > > any ideas most appreciated! > There's a note on the website home page that using daemon mode sometimes > works around this > > > > The man page hints that I can run rsync in daemon mode on the "source" > machine by specifying the right parameters on the client command line > If I'm using SSH do I still need to open up the rsync server port on the > "server" machine, or does the traffic come over the ssh connection? > If so what is the format of the client command line - try as I may I can't > get it to work - it just exits immediately as soon as I add the --daemon > parameter > > > > > > > Info about my rsync/ssh/Cygwin setup > > client version: > > $ rsync --version > rsync version 2.6.0 protocol version 27 > Copyright (C) 1996-2004 by Andrew Tridgell and others > <rsync.samba.org> > Capabilities: 64-bit files, socketpairs, hard links, symlinks, batchfiles, > no IPv6, 64-bit system inums, 64-bit internal inums > > > On source: > > $ ssh -V > OpenSSH_3.8p1, SSH protocols 1.5/2.0, OpenSSL 0.9.7d 17 Mar 2004 > > $ cygcheck -s > 1100k 2004/03/19 E:\cygwin\bin\cygwin1.dll > Cygwin DLL version info: > DLL version: 1.5.9 > DLL epoch: 19 > DLL bad signal mask: 19005 > DLL old termios: 5 > DLL malloc env: 28 > API major: 0 > API minor: 112 > Shared data: 4 > DLL identifier: cygwin1 > Mount registry: 2 > Cygnus registry name: Cygnus Solutions > Cygwin registry name: Cygwin > Program options name: Program Options > Cygwin mount registry name: mounts v2 > Cygdrive flags: cygdrive flags > Cygdrive prefix: cygdrive prefix > Cygdrive default prefix: > Build date: Thu Mar 18 23:05:18 EST 2004 > Shared id: cygwin1S4 > > openssh 3.8p1-1 > openssl 0.9.7d-1 > rsync 2.6.0-1 > > > > > > > Tim Moss > SiteSpeed Ltd > Mobile: 0 77 9613 4891 > > Email: <mailto:tim.moss@site-speed.co.uk> > tim.moss@site-speed.co.uk > > Website: <site-speed.co.uk> > site-speed.co.uk > > This email contains information from SiteSpeed Ltd, which may be privileged > or confidential. If you are not the intended recipient, be aware that any > disclosure, copying, distribution or use of the contents of this information > is prohibited. If you have received this electronic message in error, please > notify us immediately. > > > >
Updated both ends with the rsync.exe from cwrsync Same thing: io timeout after 23 seconds - exiting rsync error: timeout in data send/receive (code 30) at io.c(143) rsync: connection unexpectedly closed (72412 bytes read so far) rsync error: error in rsync protocol data stream (code 12) at io.c(342) That number "72412" is the same as before and its always the same number whatever the "problem" file it reaches Is that the size of some buffer in rsync or something? Carried out some tests and rsync doesn't hang if the client is sending files, only if it is receiving......> -----Original Message----- > From: Tim Moss [mailto:tim@bango.net] > Sent: 14 May 2004 22:20 > To: 'Jim Salter' > Subject: RE: rsync hanging on Cygwin > > Ah ha - I'll give using the latest and greatest rsync from CVS a go. > I hadn't realised that the pre-compiled binary was out of date. > > > -----Original Message----- > > From: Jim Salter [mailto:jim@jrssystems.net] > > Sent: 14 May 2004 17:03 > > To: tim@bango.net > > Cc: rsync@lists.samba.org > > Subject: Re: rsync hanging on Cygwin > > > > Slight clarification: > > > > When I said "latest version" of rsync, I did NOT mean the latest > > binary packaged with cygwin, I meant the latest source > version, which > > you can compile yourself under cygwin (if you've installed > gcc, ming, > > and make) or you can use the pre-compiled binaries now available at > > cwrsync's site. > > > > > I'm trying to use rsync under Cygwin on 2 machines > running Windows > > > 2000 Server There's a 2MB link between them and I'm using > SSH setup > > > for a passwordless connection > > > > > > rsync hangs part way through transfers and when run again > > hangs at the > > > same place in the same files with no explanation no matter what > > > verbosity level I set it to. Each time it hangs it > leaves an rsync > > > process running on the "source" machine > > > > > > I added the timeout option to the command which gives the > > following info: > > > (don't know if this will help track down this issue) > > > > > > io timeout after 60 seconds - exiting:00 rsync error: > > timeout in data > > > send/receive (code 30) at > > > /home/lapo/packaging/tmp/rsync-2.6.0/io.c(109) > > > rsync: connection unexpectedly closed (72412 bytes read so > > far) rsync > > > error: error in rsync protocol data stream (code 12) at > > > /home/lapo/packaging/tmp/rsync-2.6.0/io.c(189) > > > > > > If I run it again the "bytes read so far" values is > identical If I > > > delete the particular file that it hangs at (from the > destination) > > > then the same thing happens again using or not using the > -W option > > > makes no difference using or not using compression makes no > > difference > > > > > > > > > > > > Now this bit is very odd: > > > If I change directory on the destination machine into the > directory > > > where the problem file is and change the rsync command to > > transfer all > > > the files in that directory (adding the directory/* to the source > > > parameter) then the file is transferred just fine! > > > > > > go figure! > > > > > > I then rerun rsync and it will carry on past this file > (since it is > > > now up to date on the destination) until it hits some other > > "problem" > > > file and hangs again. > > > > > > > > > any ideas most appreciated! > > > There's a note on the website home page that using daemon mode > > > sometimes works around this > > > > > > > > > > > > The man page hints that I can run rsync in daemon mode on > > the "source" > > > machine by specifying the right parameters on the client > > command line > > > If I'm using SSH do I still need to open up the rsync > > server port on > > > the "server" machine, or does the traffic come over the ssh > > connection? > > > If so what is the format of the client command line - try > > as I may I > > > can't get it to work - it just exits immediately as soon as > > I add the > > > --daemon parameter > > > > > > > > > > > > > > > > > > > > > Info about my rsync/ssh/Cygwin setup > > > > > > client version: > > > > > > $ rsync --version > > > rsync version 2.6.0 protocol version 27 Copyright (C) > > 1996-2004 by > > > Andrew Tridgell and others <rsync.samba.org> > > > Capabilities: 64-bit files, socketpairs, hard links, > > symlinks, batchfiles, > > > no IPv6, 64-bit system inums, 64-bit internal inums > > > > > > > > > On source: > > > > > > $ ssh -V > > > OpenSSH_3.8p1, SSH protocols 1.5/2.0, OpenSSL 0.9.7d 17 Mar 2004 > > > > > > $ cygcheck -s > > > 1100k 2004/03/19 E:\cygwin\bin\cygwin1.dll > > > Cygwin DLL version info: > > > DLL version: 1.5.9 > > > DLL epoch: 19 > > > DLL bad signal mask: 19005 > > > DLL old termios: 5 > > > DLL malloc env: 28 > > > API major: 0 > > > API minor: 112 > > > Shared data: 4 > > > DLL identifier: cygwin1 > > > Mount registry: 2 > > > Cygnus registry name: Cygnus Solutions > > > Cygwin registry name: Cygwin > > > Program options name: Program Options > > > Cygwin mount registry name: mounts v2 > > > Cygdrive flags: cygdrive flags > > > Cygdrive prefix: cygdrive prefix > > > Cygdrive default prefix: > > > Build date: Thu Mar 18 23:05:18 EST 2004 > > > Shared id: cygwin1S4 > > > > > > openssh 3.8p1-1 > > > openssl 0.9.7d-1 > > > rsync 2.6.0-1 > > > > > > > > > > > > > > > > > > > > > Tim Moss > > > SiteSpeed Ltd > > > Mobile: 0 77 9613 4891 > > > > > > Email: <mailto:tim.moss@site-speed.co.uk> > > > tim.moss@site-speed.co.uk > > > > > > Website: <site-speed.co.uk> > > > site-speed.co.uk > > > > > > This email contains information from SiteSpeed Ltd, which may be > > > privileged or confidential. If you are not the intended > > recipient, be > > > aware that any disclosure, copying, distribution or use of the > > > contents of this information is prohibited. If you have > > received this > > > electronic message in error, please notify us immediately. > > > > > > > > > > > > > > >-------------- next part -------------- A non-text attachment was scrubbed... Name: winmail.dat Type: application/ms-tnef Size: 4446 bytes Desc: not available Url : lists.samba.org/archive/rsync/attachments/20040515/daaa2ee2/winmail.bin