What is the current status of both rename-patches ? Are there alternative measures ? Frequently users reorganise directories and files. Recently a directory of 40GB was renamed... It took 3 weeks to re-copy all over an ADSL-link. I have followed the last couple of years the postings, and realise it is not as easy as it seems. But the users do not understand this at all 8-( Thanks, Nico
There is a project called link-backup which may be worth a look. I am not sure if this will help you at all, but check it out. All the best. Hope this helps.> What is the current status of both rename-patches ? > Are there alternative measures ? > > Frequently users reorganise directories and files. > Recently a directory of 40GB was renamed... > It took 3 weeks to re-copy all over an ADSL-link. > > I have followed the last couple of years the postings, > and realise it is not as easy as it seems. > But the users do not understand this at all 8-(
Thanks, can you give me some pointer ? Nico henri schreef:> There is a project called link-backup which may be worth a look. > > I am not sure if this will help you at all, but check it out. > > All the best. Hope this helps. > >> What is the current status of both rename-patches ? >> Are there alternative measures ? >> >> Frequently users reorganise directories and files. >> Recently a directory of 40GB was renamed... >> It took 3 weeks to re-copy all over an ADSL-link. >> >> I have followed the last couple of years the postings, >> and realise it is not as easy as it seems. >> But the users do not understand this at all 8-(
On Mon, Feb 16, 2009 at 10:14:25AM +0100, N.J. van der Horn (Nico) wrote:> What is the current status of both rename-patches ? > Are there alternative measures ?I'm not thrilled with how the rename patches work, especially since they disable incremental recursion. As such, I'm hoping to change how they work before considering adding renaming handling to a released version. One option is making further enhancements to the db.diff patch that would let rsync leverage DB info on where files are and what their checksums are. If the DB were kept updated via something like inotify, it would be an especially nice way to quickly find a file with the right size+mtime+checksum (or user-selected attributes). For those without inotify, an upgrade script could be run, perhaps right before the transfer. Or perhaps rsync could leverage one of the existing file-monitoring packages -- does something like beagle keep track of the file's checksum? ..wayne..
N.J. van der Horn (Nico) wrote:> What is the current status of both rename-patches ? > Are there alternative measures ? > > Frequently users reorganise directories and files. > Recently a directory of 40GB was renamed... > It took 3 weeks to re-copy all over an ADSL-link. > > I have followed the last couple of years the postings, > and realise it is not as easy as it seems. > But the users do not understand this at all 8-(Hi all, Only recently joined the list - so haven't seen the last couple of years worth of postings. Would there be a summary of the issues anywhere handy? I have a customer who has issues similar to Nico regarding directories being renamed with large amounts of storage needing deleting and re-creating in a "stock" rsync install...
Jamie Lokier wrote:> David Howe wrote: > > Jamie Lokier wrote: > > I am less worried about individual file renames and/or "missing" the > > opportunity to diff a large file that has been both moved and updated, > > than having to resync multiple gigs of stuff over a slow link, because > > some user renamed a directory. > > An approximate match of renamed directories may be possible without > even statting all the files. Just look for a similar name tree. If > it finds a good match, then it can do the more expensive finer-grained > checks.I was meaning to say, if it can be efficient, approximate matching big renamed directories sounds like another nice idea for uber-rsync someday. Thanks for the good idea David :-) -- Jamie
Jamie Lokier schreef:> David Howe wrote: > >> Jamie Lokier wrote: >> I am less worried about individual file renames and/or "missing" the >> opportunity to diff a large file that has been both moved and updated, >> than having to resync multiple gigs of stuff over a slow link, because >> some user renamed a directory. >> > > An approximate match of renamed directories may be possible without > even statting all the files. Just look for a similar name tree. If > it finds a good match, then it can do the more expensive finer-grained > checks. > > -- Jamie >On forehand you cant predict where the files are moved, so I think a DB is a necessity. (holding more characteristics than timestamp and size, especially signatures like checksum) Regards, Nico -- Behandeld door / Handled by: N.J. van der Horn (Nico) --- ICT Support Vanderhorn IT-works, www.vanderhorn.nl, Kamer van Koophandel / Chambre of Commerce 24228233, Voorstraat 55, 3135 HW Vlaardingen, The Netherlands, Tel +31 10 2486060, Fax +31 10 2486061