rsync - Jan 2013 - threaded rsync to improve performance over long distance ?

I try to rsync a lot of data over a long distance AU to UK and get a slow 
data rate because of the known slow scp performance over  long distances. 
Would it be possible with rsync to run multiple scp process at the same time 
?

Thank you
Markus

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

rsync does not use scp in any way.

On 01/20/13 14:47, Markus Moeller wrote:
> I try to rsync a lot of data over a long distance AU to UK and get
> a slow data rate because of the known slow scp performance over
> long distances. Would it be possible with rsync to run multiple scp
> process at the same time ?
> 
> Thank you Markus
> 
> 
- -- 
~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~
	Kevin Korb			Phone:    (407) 252-6853
	Systems Administrator		Internet:
	FutureQuest, Inc.		Kevin at FutureQuest.net  (work)
	Orlando, Florida		kmk at sanitarium.net (personal)
	Web page:			http://www.sanitarium.net/
	PGP public key available on web site.
~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.19 (GNU/Linux)
Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/

iEYEARECAAYFAlD8Xm8ACgkQVKC1jlbQAQeZbgCeKeCMPL2wkakiqYu9oKQ2S7Z6
Sq4An0fRzgLhBbg3ZYeaTjcaCo+OSco4
=YNSj
-----END PGP SIGNATURE-----

At the risk of stating the obvious, is there any way you can break your
datasets into smaller pieces?  Then, you could start several rsync
processes in parallel - one for each piece, possibly using separate
Internet connections.

As Kevin says, I'm sure there is no direct relationship between rsync
and scp - they are two separate transfer "protocols", but the above
might get around whatever bottleneck you are running into.

If rsync is slow, then any other protocol (taking the same path) will
probably be just as slow.  You can't get a wider pipe by changing faucets.

I don't know much about networking, but if you could use network
diagnostic tools like ping and traceroute to find the actual cause(s) of
the bottleneck (without getting accused of security violations), then
you might be able to find a solution.  E.g. maybe you could arrange to
send your data somewhere closer first with better bandwidth and use
their connection (hopefully faster as well - with their
permission/service agreement) to send it the rest of the way.

Joe

On 01/20/2013 02:47 PM, Markus Moeller wrote:
> I try to rsync a lot of data over a long distance AU to UK and get a
> slow data rate because of the known slow scp performance over  long
> distances. Would it be possible with rsync to run multiple scp process
> at the same time ?
>
> Thank you
> Markus
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://lists.samba.org/pipermail/rsync/attachments/20130120/1bb91f44/attachment.html>