Andrzej Adam Filip
2004-Dec-03 20:14 UTC
SUGGESTION: rsyncing gziped source with non gziped destination
Would it be possible to make rsync capable to sync gziped source (at server) with non gziped detination file? PROBLEM: The rsyncd server provides a few *frequently* accessed, slow changing, *big* text files (DNS RBL zones). It seems that the source files are too big to stay in memory caches and rsync sessions cause to many hard disk I/O operations. Making rsynd capable to "ungzip" the files "on the fly" may help to fix the problem by reducing number of I/O operations. -- Andrzej [en:Andrew] Adam Filip anfi@priv.onet.pl anfi@xl.wp.pl Home Page http://anfi.homeunix.net/ [ PageRank 6 ]
Eberhard Moenkeberg
2004-Dec-03 20:26 UTC
SUGGESTION: rsyncing gziped source with non gziped destination
Hi, On Fri, 3 Dec 2004, Andrzej Adam Filip wrote:> Would it be possible to make rsync capable to sync gziped source (at server) > with non gziped detination file? > > PROBLEM: > The rsyncd server provides a few *frequently* accessed, slow changing, *big* > text files (DNS RBL zones). > > It seems that the source files are too big to stay in memory caches and rsync > sessions cause to many hard disk I/O operations. Making rsynd capable to > "ungzip" the files "on the fly" may help to fix the problem by reducing number > of I/O operations.You should think again about this. About the general "server quality" consequences for rsyncd, and about the efforts for your special case (=none, even contrary). Add more RAM to your server and/or improve your I/O throughput. Cheers -e -- Eberhard Moenkeberg (emoenke@gwdg.de, em@kki.org)