search for: l5120

I'm trying to rsync a 8TB data folder containing squillions of small files and it's taking forever (i.e. weeks) to get anywhere. I'm assuming the slow bit is check-summing everything with a single CPU (even though it's on a 12-core server ;-( ) Is it possible to do something simple like scp the whole dir in one go so they're duplicates in the first instance, then get rsync to

...s it possible to do something simple like scp the whole dir in one go so they're duplicates in the first instance, then get rsync to just keep them in sync without an initial transfer? > > Or is there a better way? I use tar and ttcp for an initial transfer: On the receiving end: ttcp -l5120 -r | tar xf - On the transmitter: tar cf - . | ttcp -l5120 -t name-of-receiver Note: The files are transmitted without encryption. I easily get 110 Mbytes/sec. on a gigabit connection. If you need encryption, and your transfer is CPU limited, you should investigate which cipher to use. In my...