I have to rsync 200k files which range in size from 5kb to 800kb. Is there an optimal way to do this using rsync? or shall I use tar for this? TIA
On Fri 27 Feb 2009, Mag Gam wrote:> I have to rsync 200k files which range in size from 5kb to 800kb. Is > there an optimal way to do this using rsync? or shall I use tar for > this?Just do it, there's no reason why it shouldn't work. Paul
We sync about 12 million of files for about 4TB from sites around Europe in less than 3 hours. Ofcourse we do things in parallel, try to divide the work for different trees or hosts and run in the background. Regards, Nico Ryan Malayter schreef:> On Fri, Feb 27, 2009 at 7:20 AM, Mag Gam <magawake@gmail.com> wrote: > >> it works. But takes hours to do it. Was wondering if there was a faster way >> > > http://rob.sun3.org/misc/parallelizing-rsync-processes/ >