rsync - Apr 2009 - order transfers by file size

Is it possible to have rsync order transfers by file size (smallest
files first) ?

Would it be a big patch ?

Thanks
Viki

On Wed, April 8, 2009 8:19 am, Victoria Muntean wrote:
> Is it possible to have rsync order transfers by file size (smallest
> files first) ?
Ooooh, I like that.  I have a client that has a bad habit of creating  a
5GB zipfile, that, of course, fails to rsync across 3,000 miles.  Since
it's a zip file, rsync can't diff the old and new versions; it ends up
trying to send the whole thing and the connection just isn't reliable
enough.  It would be nice to be able to transfer everything else first.

As long as we're on that topic, a size limit on file size to be
transferred would be nice.

--Yan
>
> Would it be a big patch ?
>
> Thanks
> Viki
> --
> Please use reply-all for most replies to avoid omitting the mailing list.
> To unsubscribe or change options:
> https://lists.samba.org/mailman/listinfo/rsync
> Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
>
> !DSPAM:49dcc0b587011804284693!
>
>

-- 
Yan Seiner, PE

Support my bid for the 4J School Board
http://www.seiner.com

From: "Yan Seiner" <yan@seiner.com>
To: "Victoria Muntean" <vikimun@gmail.com>
Date: Wed, 8 Apr 2009 08:32:38 -0700 (PDT)
Subject: Re: order transfers by file size

On Wed, April 8, 2009 8:19 am, Victoria Muntean wrote:
> Is it possible to have rsync order transfers by file size (smallest
> files first) ?
> Ooooh, I like that.  I have a client that has a bad habit of creating  a
> 5GB zipfile, that, of course, fails to rsync across 3,000 miles.  Since
> it's a zip file, rsync can't diff the old and new versions; it ends
up
> trying to send the whole thing and the connection just isn't reliable
> enough.  It would be nice to be able to transfer everything else first.
> As long as we're on that topic, a size limit on file size to be
> transferred would be nice.
If you are on Unix or GNU, you can try "split" command and break up
your 5GB into 500MB chunks. Reassemble them with "cat" when transfer
is (are) complete.

Felipe

On Wed, Apr 08, 2009 at 06:19:52PM +0300, Victoria Muntean
wrote:
> Is it possible to have rsync order transfers by file size (smallest
> files first) ?
The only thing that is currently possible is to combine --min-size and
--max-size to do multiple transfers with different ranges of file sizes.
> Would it be a big patch ?
As long as you're willing to disable the incremental file-list feature,
someone could write a modified generator process that would either sort
the files into a custom processing order (with all dirs needing to be
sorted early in the list) without affecting the numbering of the files
(which can be done in a similar way as the iconv support), or an easier
approach would be to have the code internally perform multiple passes
over the file-list and process/ignore files by ranges of size.  The
latter might be pretty simple by using the existing min/max size options
and just adding an extra loop into the generator code (as well as
disabling incremental recursion). This is not something I plan to write,
though.

..wayne..