rsync - Sep 2008 - Rsync 3

Hi Everyone,

We want to use the rsync 3 for incremental file transfer of our File system
from one box to another, however there are about a million files
to be copied, so just wanted to know by any one of your's previous
experience with rsync 3, will these many files get copied at first time and
incrementally in the subsequent run of the crontab.


Replies will be much appreciated.

Thanks in advance.
Madhavan
-------------- next part --------------
HTML attachment scrubbed and removed

Thu, 25 Sep 2008 13:44:06 +0530, madhavanchari wrote:
> We want to use the rsync 3 for incremental file transfer of our File system
> from one box to another, however there are about a million files
> to be copied, so just wanted to know by any one of your's previous
> experience with rsync 3, will these many files get copied at first
> time and incrementally in the subsequent run of the crontab.
If you use one of the mailing list archives, you can get a wide
impression on what people experienced.

http://news.gmane.org/gmane.network.rsync.general/ 

Enter "million" in the "Search" field.

My summary: it does work for million of files! :-)

Sven

Hi,

On Thu, 25 Sep 2008, Madhavan Chari wrote:
> We want to use the rsync 3 for incremental file transfer of our File system
> from one box to another, however there are about a million files
> to be copied, so just wanted to know by any one of your's previous
> experience with rsync 3, will these many files get copied at first time and
> incrementally in the subsequent run of the crontab.
These are statistics of a "local" rsync-2.6.8 run (src and dst on 
same machine) which needed 150 minutes:


Number of files: 5986503
Number of files transferred: 7767
Total file size: 4871562029029 bytes
Total transferred file size: 26598656932 bytes
Literal data: 24673752889 bytes
Matched data: 1924901628 bytes
File list size: 195739303
File list generation time: 1381.047 seconds
File list transfer time: 0.000 seconds
Total bytes sent: 3988352
Total bytes received: 24874875277

sent 3988352 bytes  received 24874875277 bytes  3223277.01 bytes/sec
total size is 4871562029029  speedup is 195.81


Viele Gr??e
Eberhard M?nkeberg (emoenke@gwdg.de, em@kki.org)

-- 
Eberhard M?nkeberg
Arbeitsgruppe IT-Infrastruktur
E-Mail: emoenke@gwdg.de      Tel.: +49 (0)551 201-1551
-------------------------------------------------------------------------
Gesellschaft f?r wissenschaftliche Datenverarbeitung mbH G?ttingen (GWDG)
Am Fassberg 11, 37077 G?ttingen
URL:    http://www.gwdg.de             E-Mail: gwdg@gwdg.de
Tel.:   +49 (0)551 201-1510            Fax:    +49 (0)551 201-2150
Gesch?ftsf?hrer:            Prof. Dr. Bernhard Neumair
Aufsichtsratsvorsitzender:  Prof. Dr. Christian Griesinger
Sitz der Gesellschaft:      G?ttingen
Registergericht:            G?ttingen  Handelsregister-Nr. B 598
-------------------------------------------------------------------------