Rsync takes long time to finish

vijay patel
Thu, 12 Apr 2012 18:29:52 -0000

Hi Friends,

I am using rsync to copy data from Production File Server to Disaster Recovery
file server. I have 100Mbps link setup between these two servers. Folder
structure is very deep. It is having path like
/reports/folder1/date/folder2/file.tx, where we have 1600 directories like
'folder1',  daily folders since last year in date folder and 2 folders
for each date folder like folder2  which ultimately will contain the file. Files
are not too big but just design of folder structure is complex. Folder structure
design is done by application and we can't change it at the moment. I am
using following command in cron to run rsync.

rsync -avh --delete --exclude-from 'ex_file.txt' /reports/
10.10.10.100:/reports/ | tee /tmp/rsync_report.out >>
/tmp/rsync_report.out.$today

Initially we were running it every 5 mins then we increased it to every 30 mins
since one instance was not getting finished in 5 mins. Now we have made it to
run every 8 hours because of lots of folders. Is there a way i can improve
performance of my rsync??


Regards,
Vijay

-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://lists.samba.org/pipermail/rsync/attachments/20120412/b7f1eb16/attachment.html>