Has anyone else experienced high CPU usage when using RSYNC in windows 2000 server? I am using the rsync.exe (and applicable DLL's) from the cygwin installation (I am not however running cygwin on this machine). The linux machine connecting to the windows rsync daemon has a very low performance hit when the session is running (see below). However, the windows machine, which has a much faster CPU hits a CPU usage of 100%. If anyone else has seen this, and/or can help alleviate the issue, that would be great. I am using rsync to backup across our network our branch file servers. CPU states: 1.5% user, 3.1% system, 0.0% nice, 95.2% idle Mem: 126636K av, 124008K used, 2628K free, 0K shrd, 26580K buff Swap: 1020560K av, 7360K used, 1013200K free 32044K cached PID USER PRI NI SIZE RSS SHARE STAT %CPU %MEM TIME COMMAND 18600 root 15 0 7544 7544 704 R 3.1 5.9 0:05 rsync 18644 root 15 0 1040 1040 832 R 1.1 0.8 0:02 top 18557 root 15 0 1740 1680 1428 S 0.1 1.3 0:00 sshd
Did you compile from the sources, or did you grab the cygwin binary? I suggest you build it from the sources and apply the "craigb-perf.diff" patch which is in the patches directory in the 2.5.6 distribution. This patch makes all the difference for Windows (system calls cost a lot under cygwin). If you don't want to compile it yourself, I have an older version (2.5.6cvs from august last year, works nicely) available at http://www.niradynamics.se/~nira_greger/ /Greger _Chris McKeever_ wrote:>Has anyone else experienced high CPU usage when using RSYNC in windows 2000 >server? I am using the rsync.exe (and applicable DLL's) from the cygwin >installation (I am not however running cygwin on this machine). > >The linux machine connecting to the windows rsync daemon has a very low >performance hit when the session is running (see below). However, the >windows machine, which has a much faster CPU hits a CPU usage of 100%. > >If anyone else has seen this, and/or can help alleviate the issue, that >would be great. I am using rsync to backup across our network our branch >file servers. > >CPU states: 1.5% user, 3.1% system, 0.0% nice, 95.2% idle >Mem: 126636K av, 124008K used, 2628K free, 0K shrd, 26580K >buff >Swap: 1020560K av, 7360K used, 1013200K free 32044K >cached > > PID USER PRI NI SIZE RSS SHARE STAT %CPU %MEM TIME COMMAND >18600 root 15 0 7544 7544 704 R 3.1 5.9 0:05 rsync >18644 root 15 0 1040 1040 832 R 1.1 0.8 0:02 top >18557 root 15 0 1740 1680 1428 S 0.1 1.3 0:00 sshd > > >
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 _Chris McKeever_ wrote: >The linux machine connecting to the windows rsync daemon has a very low >performance hit when the session is running (see below). However, the >windows machine, which has a much faster CPU hits a CPU usage of 100%. > rsync CPU usage is not symmetric, this could be "normal". But it has spikes of 100% or a continuous use of 100%? Are you working in a local LAN? Is transfer imited by LAN speed? by HDD speed? by CPU speed? In that case, for files not too long, it may be "better" CPU-wise to use the normal check for date instead of the full block hash checking... - -- Lapo 'Raist' Luchini lapo@lapo.it (PGP & X.509 keys available) http://www.lapo.it (ICQ UIN: 529796) -----BEGIN PGP SIGNATURE----- Version: PGP 8.0 - not licensed for commercial use: www.pgp.com iQA/AwUBPu4fbmiYgizI8lL7EQL0tACgm8hpX0koJl2NNfNA2fq6T36p93oAn0G4 Qq8ID5Wg+cq7BLW4f/u6SWZx =JBLS -----END PGP SIGNATURE-----
Thanks for your response...> > > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > _Chris McKeever_ wrote: > > >The linux machine connecting to the windows rsync daemon > has a very low > >performance hit when the session is running (see below). > However, the > >windows machine, which has a much faster CPU hits a CPU > usage of 100%. > > > rsync CPU usage is not symmetric, this could be "normal". > But it has spikes of 100% or a continuous use of 100%?as soon as a remote server connects to it, it spikes and sticks at 100%> Are you working in a local LAN?yes, connected via point-to=point t-1 lines> Is transfer imited by LAN speed?to a degree by HDD speed? by CPU speed? seems on the windows machine it is the CPU> In that case, for files not too long, it may be "better" > CPU-wise to use > the normal check for date instead of the full block hash checking...I may give the date check a go tonight and see if help remedies the issues.> > - -- > Lapo 'Raist' Luchini > lapo@lapo.it (PGP & X.509 keys available) > http://www.lapo.it (ICQ UIN: 529796) > > > -----BEGIN PGP SIGNATURE----- > Version: PGP 8.0 - not licensed for commercial use: www.pgp.com > > iQA/AwUBPu4fbmiYgizI8lL7EQL0tACgm8hpX0koJl2NNfNA2fq6T36p93oAn0G4 > Qq8ID5Wg+cq7BLW4f/u6SWZx > =JBLS > -----END PGP SIGNATURE----- > >
Lapo - With this:> > In that case, for files not too long, it may be "better" > > CPU-wise to use > > the normal check for date instead of the full block hash checking...did you mean the -u switch? or something else?> -----Original Message----- > From: Chris McKeever > Sent: Monday, June 16, 2003 4:03 PM > To: 'Lapo Luchini'; _Chris McKeever_; rsync > Subject: RE: Rsync Performance In Windows > > > Thanks for your response... > > > > > > -----BEGIN PGP SIGNED MESSAGE----- > > Hash: SHA1 > > > > _Chris McKeever_ wrote: > > > > >The linux machine connecting to the windows rsync daemon > > has a very low > > >performance hit when the session is running (see below). > > However, the > > >windows machine, which has a much faster CPU hits a CPU > > usage of 100%. > > > > > rsync CPU usage is not symmetric, this could be "normal". > > But it has spikes of 100% or a continuous use of 100%? > > as soon as a remote server connects to it, it spikes and > sticks at 100% > > > Are you working in a local LAN? > > yes, connected via point-to=point t-1 lines > > > Is transfer imited by LAN speed? > to a degree > by HDD speed? > by CPU speed? > seems on the windows machine it is the CPU > > > In that case, for files not too long, it may be "better" > > CPU-wise to use > > the normal check for date instead of the full block hash checking... > > I may give the date check a go tonight and see if help > remedies the issues. > > > > > - -- > > Lapo 'Raist' Luchini > > lapo@lapo.it (PGP & X.509 keys available) > > http://www.lapo.it (ICQ UIN: 529796) > > > > > > -----BEGIN PGP SIGNATURE----- > > Version: PGP 8.0 - not licensed for commercial use: www.pgp.com > > > > iQA/AwUBPu4fbmiYgizI8lL7EQL0tACgm8hpX0koJl2NNfNA2fq6T36p93oAn0G4 > > Qq8ID5Wg+cq7BLW4f/u6SWZx > > =JBLS > > -----END PGP SIGNATURE----- > > > > >
Thanks for your reply!> -----Original Message----- > From: Greger Cronquist [mailto:greger_cronquist@yahoo.se] > Sent: Monday, June 16, 2003 2:42 PM > To: _Chris McKeever_ > Cc: rsync@lists.samba.org > Subject: Re: Rsync Performance In Windows > > > Did you compile from the sources, or did you grab the cygwin binary?I just did the standard install (which I dont think was a full source compile)> > I suggest you build it from the sources and apply the > "craigb-perf.diff" > patch which is in the patches directory in the 2.5.6 > distribution. This > patch makes all the difference for Windows (system calls cost a lot > under cygwin). >as I said, I am not running cygwin on that machine, only rsync which I copied from the other cygwin install. Do you suggest that I run cygwin on the windows box that I am using rsync?> If you don't want to compile it yourself, I have an older version > (2.5.6cvs from august last year, works nicely) available at > http://www.niradynamics.se/~nira_greger/ > > /Greger > > _Chris McKeever_ wrote: > > >Has anyone else experienced high CPU usage when using RSYNC > in windows 2000 > >server? I am using the rsync.exe (and applicable DLL's) > from the cygwin > >installation (I am not however running cygwin on this machine). > > > >The linux machine connecting to the windows rsync daemon has > a very low > >performance hit when the session is running (see below). > However, the > >windows machine, which has a much faster CPU hits a CPU > usage of 100%. > > > >If anyone else has seen this, and/or can help alleviate the > issue, that > >would be great. I am using rsync to backup across our > network our branch > >file servers. > > > >CPU states: 1.5% user, 3.1% system, 0.0% nice, 95.2% idle > >Mem: 126636K av, 124008K used, 2628K free, 0K > shrd, 26580K > >buff > >Swap: 1020560K av, 7360K used, 1013200K free > 32044K > >cached > > > > PID USER PRI NI SIZE RSS SHARE STAT %CPU %MEM TIME COMMAND > >18600 root 15 0 7544 7544 704 R 3.1 5.9 0:05 rsync > >18644 root 15 0 1040 1040 832 R 1.1 0.8 0:02 top > >18557 root 15 0 1740 1680 1428 S 0.1 1.3 0:00 sshd > > > > > > > >
Greger.. I replaced the rsync.exe with the one from your link, it relieved the windows CPU some (from 100% to 98% with flucuation to 100%). I also took the advice of using the -u switch. From the man: -u, --update update only (don't overwrite newer files) I just want to make sure I am interpretting this flag correctly. On the receiving end, if there is a file that is newer than on the sending end, it wont update, but if the sending end file is newer or non-existant then it will send? This reduced the CPU load tremendously and also reduced the transfer time to something very acceptable. I just want to make sure it is still doing what I wanted it to. Thanks for all your help> > -----Original Message----- > > From: Greger Cronquist [mailto:greger_cronquist@yahoo.se] > > Sent: Monday, June 16, 2003 2:42 PM > > To: _Chris McKeever_ > > Cc: rsync@lists.samba.org > > Subject: Re: Rsync Performance In WindowsvAll you need to run rsync properly is rsync.exe, cygwin1.dll and cygpopt- 0.dll. There is no difference in performance if you do a full cygwin install or not. However, I suggest you try and download the version I compiled and see if it makes any difference. It does for me. (It buffers the IO calls so that the number of cygwin system calls are minimized.) Regards, Greger> -----Original Message----- > From: Chris McKeever > Sent: Monday, June 16, 2003 5:29 PM > To: 'Greger Cronquist'; _Chris McKeever_ > Cc: rsync@lists.samba.org > Subject: RE: Rsync Performance In Windows > > > Thanks for your reply! > > > -----Original Message----- > > From: Greger Cronquist [mailto:greger_cronquist@yahoo.se] > > Sent: Monday, June 16, 2003 2:42 PM > > To: _Chris McKeever_ > > Cc: rsync@lists.samba.org > > Subject: Re: Rsync Performance In Windows > > > > > > Did you compile from the sources, or did you grab the cygwin binary? > > I just did the standard install (which I dont think was a > full source compile) > > > > I suggest you build it from the sources and apply the > > "craigb-perf.diff" > > patch which is in the patches directory in the 2.5.6 > > distribution. This > > patch makes all the difference for Windows (system calls cost a lot > > under cygwin). > > > > as I said, I am not running cygwin on that machine, only > rsync which I copied from the other cygwin install. Do you > suggest that I run cygwin on the windows box that I am using rsync? > > > If you don't want to compile it yourself, I have an older version > > (2.5.6cvs from august last year, works nicely) available at > > http://www.niradynamics.se/~nira_greger/ > > > > /Greger > > > > _Chris McKeever_ wrote: > > > > >Has anyone else experienced high CPU usage when using RSYNC > > in windows 2000 > > >server? I am using the rsync.exe (and applicable DLL's) > > from the cygwin > > >installation (I am not however running cygwin on this machine). > > > > > >The linux machine connecting to the windows rsync daemon has > > a very low > > >performance hit when the session is running (see below). > > However, the > > >windows machine, which has a much faster CPU hits a CPU > > usage of 100%. > > > > > >If anyone else has seen this, and/or can help alleviate the > > issue, that > > >would be great. I am using rsync to backup across our > > network our branch > > >file servers. > > > > > >CPU states: 1.5% user, 3.1% system, 0.0% nice, 95.2% idle > > >Mem: 126636K av, 124008K used, 2628K free, 0K > > shrd, 26580K > > >buff > > >Swap: 1020560K av, 7360K used, 1013200K free > > 32044K > > >cached > > > > > > PID USER PRI NI SIZE RSS SHARE STAT %CPU %MEM > TIME COMMAND > > >18600 root 15 0 7544 7544 704 R 3.1 5.9 0:05 rsync > > >18644 root 15 0 1040 1040 832 R 1.1 0.8 0:02 top > > >18557 root 15 0 1740 1680 1428 S 0.1 1.3 0:00 sshd > > > > > > > > > > > > > >