Hi stable@ people, Idea for a SOC or other development: Not all ftp sites carry betas (understandably), that raises an inefficiency of human & net resources also seen similarly on ports/ , eg: I tried to download 7.2-BETA to test, Not on local ftp://ftp2.de.freebsd.org/pub/FreeBSD/releases/i386/ISO-IMAGES/7.2 ftp://ftp.de.freebsd.org/pub/FreeBSD/releases/i386/ISO-IMAGES/7.2 Found manually on ftp://ftp.uk.freebsd.org/pub/FreeBSD/releases/i386/ISO-IMAGES/7.2 but slow at 60 KB/s Faster @ 100K from USA ftp://ftp.freebsd.org/pub/FreeBSD/releases/i386/ISO-IMAGES/7.2 but I'd feel guilty loading main site & intercontinental band width. One could rustle up a ports/ entry to fetch ISO-IMAGES automatically from a list of nearest local national sites, using MASTER_SITE_BACKUP &/or MASTER_SITE_OVERRIDE, But does a pseudo port or tool exist already ? Choosing ftp site just by country is crude, (albeit better than global as once was), but if client is near national border, another country's adjacent city might be a nearer & faster server. Some servers for ports/ fetch are also incredibly slow, but fetch will hang in there trying, even if another site lower in the list might be nearer &/or faster. Perhaps some SOC student might like to develop some extension to fetch, or a new tool to intelligently save net bandwidth & human time (if not this year if SOC bids are in, then next) : Intelligently & automatically sniff fetch list to see where stuff is, measure the bandwidth, perhaps on a preliminary README, & automatically decide where to fetch from. & as 2nd stage, give up & try elsewhere if the server connection gets too bad. Cheers, Julian -- Julian Stacey: BSDUnixLinux C Prog Admin SysEng Consult Munich www.berklix.com Mail plain ASCII text. HTML & Base64 text are spam. www.asciiribbon.org
On 2009-4-7, at 14:21, Julian Stacey wrote:> Perhaps some SOC student might like to develop some extension to > fetch, or a new tool to intelligently save net bandwidth & human > time (if not this year if SOC bids are in, then next) : > Intelligently & automatically sniff fetch list to see where > stuff is, measure the bandwidth, perhaps on a preliminary > README, & automatically decide where to fetch from. > & as 2nd stage, give up & try elsewhere if the server > connection gets too bad.Use BitTorrent for all file distribution, it does all that. Yes, I'm half serious. Lars
Hi stable@ people, Ref my:> Found manually on > ftp://ftp.uk.freebsd.org/pub/FreeBSD/releases/i386/ISO-IMAGES/7.2 > but slow at 60 KB/s > Faster @ 100K from USA > ftp://ftp.freebsd.org/pub/FreeBSD/releases/i386/ISO-IMAGES/7.2 > but I'd feel guilty loading main site & intercontinental band width.Erwin Lansing emailed me off list:> ... Are you sure you hit the US mirror? ftp.freebsd.org is a DNS round > robin between a US and a danish mirror, so my guess would be that > if you'd have hit the danish one, it would have been faster. ...Thanks Erwin, You're right, nslookup: Name: ftp.freebsd.org Address: 87.51.34.132 Address: 204.152.184.73 For me in Munich Germany the Danish mirror 87.51.34.132 ftp.beastie.tdk.net. is 10 times faster than USA. 204.152.184.73 freebsd.isc.org. But I wouldn't want to load Denmark needlessly either, so look forward to reading follow up I see starting re. bitorrent & fastest_cvsup etc. Thanks all ! Cheers, Julian -- Julian Stacey: BSDUnixLinux C Prog Admin SysEng Consult Munich www.berklix.com Mail plain ASCII text. HTML & Base64 text are spam. www.asciiribbon.org
On Tue, 7 Apr 2009, Julian Stacey wrote:> Some servers for ports/ fetch are also incredibly slow, but fetch will > hang in there trying, even if another site lower in the list might > be nearer &/or faster. >There is a tool called fastest_sites that uses round trip for the tcp hanshake wich is a little bit better than ping. I wrote about it here: http://www.arnold.se/chris/2008/11/how-to-speed-up-downloading-ports/ But the real solution is to do this the right waw. And we are a couple of people involved in making this happen. Notheing ready yet but be shure you will read all about it soon on a mailling list close to you... /Chris -- http://www.arnold.se/chris