woo robbin
2006-Nov-01 14:08 UTC
Building file list takes hours,how to improve performance?
Hi there, I've backed up some files(about 20G,with many subdirectories and files) a months ago to an USB drive,and I use rsync to check if there are changes.After the process,I checked the log file and found no update needed.But the stats said: Number of files: 61775 Number of files transferred: 0 Total file size: 24169314260 bytes Total transferred file size: 0 bytes Literal data: 0 bytes Matched data: 0 bytes File list size: 2260510 File list generation time: 8631.470 seconds File list transfer time: 0.000 seconds Total bytes sent: 2288918 Total bytes received: 28412 sent 2288918 bytes received 28412 bytes 133.34 bytes/sec total size is 24169314260 speedup is 10429.81 That's awful,how to improve file list generation performance? -------------- next part -------------- HTML attachment scrubbed and removed
Jan-Benedict Glaw
2006-Nov-01 15:21 UTC
Building file list takes hours,how to improve performance?
On Wed, 2006-11-01 22:01:07 +0800, woo robbin <robbinwooo@gmail.com> wrote:> I've backed up some files(about 20G,with many subdirectories and files) a > months ago to an USB drive,and I use rsync to check if there are > changes.After the process,I checked the log file and found no update > needed.But the stats said: > > Number of files: 61775 > Number of files transferred: 0 > Total file size: 24169314260 bytes > Total transferred file size: 0 bytes > Literal data: 0 bytes > Matched data: 0 bytes > File list size: 2260510 > File list generation time: 8631.470 seconds > File list transfer time: 0.000 secondsWell, the USB stuff tends to be slow. And untuned filesystems are that, too. If it's ext3, you'd play with the dir_index flag. MfG, JBG -- Jan-Benedict Glaw jbglaw@lug-owl.de +49-172-7608481 Signature of: Ich hatte in letzter Zeit ein bi?chen viel Realitycheck. the second : Langsam m?chte ich mal wieder weitertr?umen k?nnen. -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 189 bytes Desc: Digital signature Url : http://lists.samba.org/archive/rsync/attachments/20061101/c6eb55cb/attachment.bin