I spent about 12 hours today writing a nice backup system based on Mike Rubel's snapshot system; but much to my dismay, when I took it for a test drive, I found that rsync hung on the first large directory I tried to back up. Aiee! A few web searches later, I realized that a lot of folks have seen this problem. I saw one proposed fix... http://sources.redhat.com/ml/cygwin/2002-09/msg01155.html This fix is in rsync 2.5.5-2, but rsync still hangs for me. I'm able to sync a smaller directory but this larger one fails consistently. My symptoms are much like the ones reported by other folks; if I run a command like this... rsync -vvv -a --delete --delete-excluded -e ssh othermachine:/c/gse/ t ...the last thing I see is recv_generator(vst/sync/weird/ww 2.6 presets.txt,4866) generate_files phase=1 There are 4867 files in the folder I'm trying to back up, for what that's worth. I've cruised the code briefly but I don't see anything obvious; then again, I barely know how the guts of rsync work as far as forking processes and whatnot. So I don't even know if the -vvv output is all coming from one process. Help! Am I the only one still seeing this hang? -- scott evans :: www.antisleep.com
On Sat, 28 Dec 2002, Scott Evans wrote:> I spent about 12 hours today writing a nice backup system based on > Mike Rubel's snapshot system; but much to my dismay, when I took it > for a test drive, I found that rsync hung on the first large directory > I tried to back up. Aiee![ ... ] Hey Scott, I'm Mike Rubel (author of that snapshot system page)--I haven't heard about this cygwin issue before, but this would definitely be worth adding to the FAQ. I'm sorry to hear you're having so much trouble with it! You're actually the second person to mention windows issues; the other fellow was using a SAMBA mount and rsyncing locally on the server. The problem there was files mysteriously getting copied when they hadn't changed, or deleted when they weren't supposed to be. I asked the list if anyone else had seen that behavior, but no one responded, so I'm not sure what to think. I'll add it to the FAQ, anyway, and maybe the BUGS section. Please let me know if you find any additional information. I'm on the rsync list but not the cygwin list (yet). I've had no trouble with this at home with my roommate's Win2K PC, but between this case and the previous one, it sounds like the rsync/windows interaction may still have some rough edges, which is not really acceptable for a backup solution. :( Thanks, Mike ps> I'm moving the site to a new server tonight; I tested it manually and it appears to be in order, but DNS probably won't catch up until tomorrow morning. Please let me know if you run into any trouble connecting!
I am seeing similar symptoms. -------------------------- Compaq 350 mhz CPU Top shows memory at: Mem: 154840K av, 25904K used, 128936K free, 0K shrd, 2532K buff Swap: 264592K av, 0K used, 264592K free 12004K cached Network is 10mb hub connection. Running: rsync version 2.5.4 protocol version 26 On a redhat 7.3 system, patched up to the current level. Updated Kernel 2.4.18-18.7.x #1 Wed Nov 13 19:30:43 EST -------------------------- Backing up Windows shares via samba mounts to a local dedicated ide disk (60mb). This solution works wonderfully, BTW. With one exception... Backing up a large volume of images that range in size from 18 mb to +100mb each. Approximately 45 GB total. Files are distributed in sub-directories, some large, but not overly excessive. Source machine is Windows 2000 server. Disk partition with approx 45 mb. The rsync proceeds nicely using: rsync -rtv /mnt/ntserver/sharename /mountedbackupdisk/ It produces expected results. However, when the command is run again, it finds two or three dozen files it thinks need to be refreshed. I stop the rsync, and check the file sizes, perms, and chksums. All are a match. If I allow it to refresh the files, and run the command again. It finds fewer to refresh. Subsequent runs will eventually cause the refreshes to stop. Odd behaviour. If I run: rsync -rtvvv /mnt/ntserver/sharename /mountedbackupdisk/ The /mnt/ntserver/sharename is a samba mounted win2000 filesystem. The output stops after about 1100 lines with: make_file(4,1mb/BMTT013.tif) The process is still there, but the load drops and there are no packets going in/out of the ethernet interface. I think rsync has hung. Note that this occurs only when I specify additional "-vvv". -------------------- I saw somewhat similar results when backing up the 4 office workstations, which run win98 and winxp. Re-running the command would find files that needed to be backed up. I thought these might be files that changed while backup was running, but running the command at night, I would see the same. Again, eventually, it would report no changes to be updated. -------------------- I have used rsync for years to backup Linux boxes to disk. It works wonderfully! I want the same reliability and efficiency when backing up windows too. If anyone can help, I would really appreciate it. If I can provide more details or do some testing, I have quite a few boxes at my disposal. Thanks! -- -------------------- Timothy Burt General Manager Arbor Group LLC Los Angeles, Calif. USA