similar to: huge number of files

Hi All I run rsync in an automated environment and it sometime will crash and leave a core dump file. from core dump, gdb shows that gdb) bt #0 add_dirs_to_tree (parent_ndx=-1, from_flist=0x56c590, dir_cnt=1) at flist.c:1422 #1 0x0000000000409eab in send_file_list (f=16, argc=-1, argv=0x56c238) at flist.c:2068 #2 0x0000000000419052 in client_run (f_in=16, f_out=16, pid=-1, argc=1,

Hi All Some time rsync just return error code 23 that some files are not transferred. Is there a way to get a list of these files so we can retry it later time? For example, we scan the whole file system and N files are not transferred. Instead of scan the whole file system later again, we can use files-from which is much faster. Thanks. -- Ming Zhang @#$%^ purging memory... (*!%

Hi I have a file system that contains millions of small files. Since I backup it everyday with rsync using slow WAN link, I think it will be nice that if rsync can do this: An option that let rsync only check with remote rsync daemon about local files that has last modification time newer than one day ago (so is modified since yesterday backup). This can greatly reduce the WAN traffic. Is this

Hi What should be the right exit code for vanished file in this scenario. (1) Use inotify or other mechanism to check changed files and then generate a file list. (2) < file get deleted> (3) run rsync with --files-from with the old list. then send_file_list()->link_stat() will return errno 2 on some files and then set exit code to 23. but shall rsync return 24? -- Ming Zhang

I have great luck running rsync from one linux system to another, or from a windows system (with cwRsync) to a linux system. But when I try to do an rsync backup from one directory on a Windows system to another, it fails. The cwRsync says its version is 2.6.9. Here's my Rsync command, boiled down to its simplest: rsync -rlptgD -vvv --delete --delete-excluded --modify-window=2

Hi All I tried to find out in the man page about what is the valid character we can use in module name in rsyncd.conf but failed. Anyone knows? Anyway, here is a bug. I defines a module with abc/def as name. $ rsync lab11-101:: abc/def this one show the module name, but when i try to use it. $ rsync vpn lab11-101::abc/def @ERROR: Unknown module 'abc' rsync error: error

Hi All Tried to search the list but could not find anything about this. I have a rsync daemon running with starting cwd as /usr/local/bin. then after some io, and after all io finished, its cwd is /fs1 which is one of the module path. now i need to umount fs1 and i can not do it. is this a known issue or something worthy fix? not sure what else information i need to provide. thanks. -- Ming

Hi All We always run rsync with --files-from and sometime it gets a error code 23, partial transfer. is it possible to find out what files are not transferred without check the error message by human eye(since we want to do it in a script)? Thanks. -- Ming Zhang @#$%^ purging memory... (*!% http://blackmagic02881.wordpress.com/ http://www.linkedin.com/in/blackmagic02881

Hi all When rsync replicate one file to remote side, will the extended attributes be copied as well? Thanks, Ming

Hello guys! I'm doing a middle scale backup job using ccollect [0], which uses rsyn, with about 50 servers, each about 1-10 GiB changes per day and have some problems, that servers do not finish their backup completly: [host1.backup] Read from remote host host1.backup: Connection reset by peer [host1.backup] rsync: connection unexpectedly closed (41306592 bytes received so far) [receiver]

Hi All. On Mac OS10.4, using rsync 3.0, it stops during a transfer. I mount an SMB share, and then use the line: sudo rsync -avhi --delete --stats --timeout=360 --progress --log-file=/Volumes/backup/20080429/rsynclog.txt --exclude="*:*" /Volumes/RAID_One /Volumes/backup/20080429 There's a few terabytes of data, and it never finishes a complete run. It can stop at anywhere during

Hi all! I'd like to use rsync to keep aligned physical volumes between linux servers. I know that there are other tools but I really need to use rsync. I would like to do something as rsync /dev/VG/SourceLogicalVolume root@dest_server:/dev/VG/DestinationLogicalVolume Do you think could it be possible? Thanks Marco

Hi, It seems that rsync transfers files whose names was changed or which were moved to another directory since the previous synchronization. I think that ability not to transfer (large) files which are present on another computer would be very helpful. Right before rsync is going to transfer some large file it could check if there some other files with the same size ( and maybe the same mtime

Hi All If rsync gets files from standard input, when it starts to process that file, immediately or read until EOF, or somewhere in between? For example, if a list is generated slowly but continuously and keep feeding to rsync, will rsync wait a very long time before ever handling the first file? Is this behavior controllable? Thanks! Ming -- never so busy...

I've just released rsync 3.0.0pre7, the latest pre-release version of the upcoming 3.0.0 release. This release contains fixed exclude checks for a "use chroot = no" daemon that has excludes listed in the config file. This is a partial fix for the 2nd advisory that was released recently. See the rsync security web page for the updated details and a patch for 2.6.9:

I've just released rsync 3.0.0pre7, the latest pre-release version of the upcoming 3.0.0 release. This release contains fixed exclude checks for a "use chroot = no" daemon that has excludes listed in the config file. This is a partial fix for the 2nd advisory that was released recently. See the rsync security web page for the updated details and a patch for 2.6.9:

Hi All Any idea when the 3.0.0 will be rolled out? Thanks! -- Ming Zhang @#$%^ purging memory... (*!% http://blackmagic02881.wordpress.com/ http://www.linkedin.com/in/blackmagic02881 --------------------------------------------

Hi All I ran into this situation when rsync some files to remote side and remote file system run out of space. rsync: writefd_unbuffered failed to write 4 bytes [sender]: Connection reset by peer (104) rsync: write failed on "/IMG_5106.JPG" (in dest): No space left on device (28) ~~~~ no space was detected and reported. rsync error: error in file IO (code 11) at receiver.c(298)

Hi All This can be reproduced easily. run rsync under gdb and set a break point at read_timeout(). then after rsync talk with remote rsync daemon and stop at this function, turn off remote machine directly. then let rsync run and it will run forever in this function. if we just kill remote rsync daemon, it is fine and quickly detected, because OS do clean up work. But if power off the box

Dear David Techer, I have read through your article on Xen VGA passthrough on http://www.davidgis.fr. It appears that the following command on your blog doesn''t work. dmesg | grep 01:00.0 | grep BAR The above command shows nothing at all. Is there an alternative solution? Thank you very much. Yours sincerely, Teo En Ming (Zhang Enming)